Streaming data for Machine Learning

Streaming data for Machine Learning

ByMichael Stainsbury

Streaming data processing is used when data is continuously being generated and needs to be processed as it arrives. The AWS service for data streaming processing is Kinesis. Kineses comprises of four services each with different capabilities and some that can be used together. As well as Kinesis there is another AWS service that can…

Data transformation for Machine Learning

Data transformation for Machine Learning

ByMichael Stainsbury

This Study Guide is about transforming raw data so it is ready for Machine Learning. There are two types of transformation: Identify and implement a data-transformation solution is sub-domain 1.3 of the Data Engineering knowledge domain. For more information about the exam structure see: AWS Machine Learning exam syllabus Questions To confirm your understanding scroll to…

Batch processing for Machine Learning

Batch processing for Machine Learning

ByMichael Stainsbury

For Machine Learning AWS glue and AWS Database Migration Service are used to ingest data. Batch processing refers to processing usually performed to a specific schedule. Before the batch process starts data is waiting and often any new data will have to wait for the next batch processing to be processed. In AWS any compute…