Play free

Data World 6 · Pipeline Detective · Stage 1

Quality Gate

Write the rule for the line that is wrong, quarantine the line, hold the night: a gate per grain.

  • AWS Glue Data Quality
  • DQDL rules
  • Row-level outcomes
  • DataBrew profiles
  • Sampling and skew
Domain
Data engineering
World
Data World 6: Pipeline Detective (Associate)
Game type
Lake tuner: Tune a lake's tables until the queries fit their limit and budget.
Time
About 15 minutes on a first attempt (estimated)
Exam guides
  • DEA-C01Skill 3.4.1: Run data quality checks while processing the data (for example, checking for empty fields); Skill 3.4.2: Define data quality rules (for example, DataBrew); Skill 3.4.3: Investigate data consistency (for example, DataBrew); Skill 3.4.4: Describe data sampling techniques; Skill 3.4.5: Implement data skew mechanisms; Skill 3.2.2: Verify and clean data (for example, Lambda, Athena, QuickSight, Jupyter Notebooks, Amazon SageMaker Data Wrangler); Skill 3.1.6: Prepare data for transformation (for example, AWS Glue DataBrew and Amazon SageMaker Unified Studio)
  • MLA-C02Skill 1.3.1: Validate data quality (for example, by using DataBrew, AWS Glue Data Quality)