mechanical gears to symbolize data engineering

Data Engineering

mechanical gears to symbolize data engineering

The Data Engineering domain of the AWS Machine Learning Specialist certification exam comprises obtaining the data, transforming it and transferring it to a repository. Twenty percent of the exam marks come from this knowledge domain which is divided into three subdomains.

The data repository (subdomain 1.1) is where the raw and processed data is stored. S3 is the repository of choice for Machine Learning in AWS although some other data stores are also mentioned. The data ingestion subdomain (1.2) is concerned with getting the raw data into the repository. This can be via batch processing or streaming data. With batch processing data is collected and grouped at a point in time and passed to the data store. Streaming data is constantly being collected and fed into the data store. The third subdomain (1.3) focuses on how raw data is transformed into data that can be used for ML processing. The transformation process changes the data structure. The data may also need to be cleaned, de-duplicated, incomplete data managed and have it’s attributes standardised.

Once these data engineering processes are complete the data is ready for further pre-processing prior to being fed into a Machine Learning algorithm. This preprocessing is covered by the second knowledge domain, Exploratory Data Analysis.

  1. For description of the exam structure see this article: https://www.mlexam.com/aws-machine-learning-exam-syllabus/.
  2. The AWS exam guide pdf can be downloaded from: https://d1.awsstatic.com/training-and-certification/docs-ml/AWS-Certified-Machine-Learning-Specialty_Exam-Guide.pdf

AWS Certified Machine Learning Study Guide: Specialty (MLS-C01) Exam

This study guide provides the domain-by-domain specific knowledge you need to build, train, tune, and deploy machine learning models with the AWS Cloud. The online resources that accompany this Study Guide include practice exams and assessments, electronic flashcards, and supplementary online resources. It is available in both paper and kindle version for immediate access. (Vist Amazon books)


Sample Data Engineering questions

This test is five questions randomly taken from 17 questions of the three sub-domains.

97

1 Data Engineering

This test is five questions randomly selected from the 17 public Data Engineering test questions.

1 / 5

Category: 1.3 Quiz

Which AWS services are available to prepare data for Machine Learning?

2 / 5

Category: 1.3 Quiz

There is no hint for this question.

3 / 5

Category: 1.2 Quiz

Glue components are:

  1. Glue Jobs
  2. Glue Crawlers
  3. Glue Databases
  4. Glue Tables
  5. Glue Triggers
  6. Glue Workflows

4 / 5

Category: 1.2 Quiz

What are the components of AWS Glue?

5 / 5

Category: 1.3 Quiz

What aspect of data preparation could EMR be used for?

Data engineering study guides

Whizlabs AWS certified machine learning course with a robot hand
Reviews

Whizlabs review – AWS Certified Machine Learning Specialty

Need more practice with the exams? Check out Whizlab’s free test with 15 questions. They also have three practice tests (65 questions each) and five section tests (10-15 questions each). Money off promo codes are below. For the AWS Certified Machine Learning Specialty Whizlabs provides a practice tests, a video course and hands-on labs. These…

A waterfall symbolizing streaming data for Machine Learning
Data Engineering (domain 1)

Streaming data for Machine Learning

Streaming data processing is used when data is continuously being generated and needs to be processed as it arrives. The AWS service for data streaming processing is Kinesis. Kineses comprises of four services each with different capabilities and some that can be used together. As well as Kinesis there is another AWS service that can…

Potters wheel with clay pot being made to symbolise data transformation for Machine Learning
Data Engineering (domain 1)

Data transformation for Machine Learning

This Study Guide is about transforming raw data so it is ready for Machine Learning. There are two types of transformation: Identify and implement a data-transformation solution is sub-domain 1.3 of the Data Engineering knowledge domain. For more information about the exam structure see: AWS Machine Learning exam syllabus Questions To confirm your understanding scroll to…

Balls of bread dough symbolizing batch processing for Machine Learning
Data Engineering (domain 1)

Batch processing for Machine Learning

For Machine Learning AWS glue and AWS Database Migration Service are used to ingest data. Batch processing refers to processing usually performed to a specific schedule. Before the batch process starts data is waiting and often any new data will have to wait for the next batch processing to be processed. In AWS any compute…

Pluralsight AWS Certified Machine Learning web page screen shot
Reviews

Pluralsight review – AWS Certified Machine Learning Specialty

Contains affiliate links. If you go to Whizlab’s website and make a purchase I may receive a small payment. The purchase price to you will be unchanged. Thank you for your support. The AWS Certified Machine Learning Specialty learning path from Pluralsight has six high quality video courses taught by expert instructors. Two are introductory…

Credits

MustangJoe on Pixabay