Open in app

Sign In

Write

Sign In

Agam Kushwaha
Agam Kushwaha

16 Followers

Home

About

Jan 9

Transferring Data from S3 to Amazon Redshift

Introduction Amazon Redshift is a fully managed, petabyte-scale data warehouse service in the cloud. It allows users to analyze large-scale data using BI tools to gain new insights for their business and customers. Amazon S3 or Simple Storage Service is an object storage service. …

Redshift

8 min read

Transferring Data from S3 to Amazon Redshift
Transferring Data from S3 to Amazon Redshift
Redshift

8 min read


Apr 13, 2022

Kafka-Integration-with-Apache-Spark

Objective Kafka is a potential messaging and integration platform for Spark Streaming. It acts as the central hub for real-time streams of data, which are processed in Spark Streaming using complex algorithms. Once the data is processed, Spark Streaming either publishes the results into another Kafka topic or stores them in…

Kafka

6 min read

Kafka-Integration-with-Apache-Spark
Kafka-Integration-with-Apache-Spark
Kafka

6 min read


Jan 30, 2022

Real Time Data Processing Using Spark Streaming

Objective A stream of data is nothing but a continuous inflow of data, for example, a live video or Amazon’s log data. There is no discrete start or end to this stream as it keeps flowing forever. Since this stream is continuous, it is also usually high-volume data, which means the…

Spark Streaming

18 min read

Real Time Data Processing Using Spark Streaming
Real Time Data Processing Using Spark Streaming
Spark Streaming

18 min read


Jan 14, 2022

Import/Export Using Apache Sqoop

Various Sqoop operations Problem Statement Apache Sqoop, which is short for ‘SQL to Hadoop’, is used for ingesting relational data. Essentially, it connects an RDBMS, such as MySQL and Oracle, to the HDFS and provides efficient, bidirectional data transfer between them in parallel, as shown in the image given below. Data can…

Apache Sqoop

16 min read

Import/Export Using Apache Sqoop
Import/Export Using Apache Sqoop
Apache Sqoop

16 min read


Nov 26, 2020

Logistic Regression Important Questions: Part 3

Q1. What is accuracy? Answer: Accuracy is the number of correct predictions out of all predictions made. Accuracy = (True Positives+True Negatives)/Total Number of Predictions Q2. Why is accuracy not a good measure for classification problems? Answer: Accuracy is not a good measure for classification problems because it gives equal…

Logistic Regression

5 min read

Logistic Regression Important Questions: Part 3
Logistic Regression Important Questions: Part 3
Logistic Regression

5 min read


Nov 26, 2020

Logistic Regression Important Questions: Part 2

Q1. What is the Maximum Likelihood Estimator (MLE)? Answer: The MLE chooses those sets of unknown parameters (estimator) that maximize the likelihood function. The method to find the MLE is to use calculus and setting the derivative of the logistic function with respect to an unknown parameter to zero, and…

Logistic Regression

3 min read

Logistic Regression Important Questions: Part 2
Logistic Regression Important Questions: Part 2
Logistic Regression

3 min read


Nov 25, 2020

Logistic Regression Important Questions: Part 1

Q1. What is a logistic function? What is the range of values of a logistic function? Answer: The logistic function is as defined below: f(z)=1/(1+e−z) The values of a logistic function will range from 0 to 1. The values of Z will vary from −∞ to +∞. Q2. Why is…

Logistic Regression

4 min read

Logistic Regression: Important Questions
Logistic Regression: Important Questions
Logistic Regression

4 min read


Nov 23, 2020

Linear Regression: Important Questions

Question 1: Explain the linear regression algorithm in detail. Answer: Linear Regression is a machine learning algorithm which is based on supervised learning category. It finds a best linear-fit relationship on any given data, between independent (Target) and dependent (Predictor) variables. In other words, it creates the best straight-line fitting…

Linear Regression

9 min read

Linear Regression Important Question
Linear Regression Important Question
Linear Regression

9 min read

Agam Kushwaha

Agam Kushwaha

16 Followers

Data Engineering and Analytics | AWS Enthusiast

Following
  • Satyam Kumar

    Satyam Kumar

  • Aman Kharwal

    Aman Kharwal

  • aarthi ramalingam

    aarthi ramalingam

  • Sole Techie

    Sole Techie

  • Keith Chen

    Keith Chen

See all (18)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech