Data World 2 · Pipeline Plumbing · Stage 6

Change Capture

Change data capture reads the database's log: keep the log on, in rows, and long enough; capture every operation; and convert the schema before you move the data.

  • DMS change data capture
  • MySQL binary logs
  • DMS to Amazon S3
  • DMS Schema Conversion
Domain
Data engineering
World
Data World 2: Pipeline Plumbing (Associate)
Game type
Lake tuner: Tune a lake's tables until the queries fit their limit and budget.
Time
About 30 minutes on a first attempt (estimated)
Exam guides
  • DEA-C01Skill 1.1.1: Read data from streaming sources (for example, Amazon Kinesis, Amazon Managed Streaming for Apache Kafka [Amazon MSK], Amazon DynamoDB Streams, AWS DMS, AWS Glue, Amazon Redshift); Skill 1.1.2: Read data from batch sources (for example, Amazon S3, AWS Glue, Amazon EMR, AWS DMS, Amazon Redshift, AWS Lambda, Amazon AppFlow); Skill 2.4.3: Perform schema conversion (for example, by using AWS SCT and AWS DMS Schema Conversion)
  • SAP-C02Task 4.2: Determine the optimal migration approach for existing workloads