Data World 1 · Lake Foundations · Stage 1

Shape the Files

Same charges, a hundredth of the bytes: pick the files that let Athena read only what a query needs.

  • Parquet and ORC
  • Compression
  • Athena pricing and workgroup limits
  • UNLOAD
Domain
Data engineering
World
Data World 1: Lake Foundations (Associate)
Game type
Lake tuner: Tune a lake's tables until the queries fit their limit and budget.
Time
About 15 minutes on a first attempt (estimated)
Article
Exam guides
  • SAA-C03Task 3.5: Determine high-performing data ingestion and transformation solutions
  • DEA-C01Skill 1.2.6: Transform data between formats (for example, from .csv to Apache Parquet); Skill 2.4.5: Describe best practices for indexing, partitioning strategies, compression, and other data optimization techniques; Skill 1.2.4: Optimize costs while processing data; Skill 3.1.7: Query data (for example, Amazon Athena)
  • MLA-C02Skill 1.1.5: Ingest from and write by using appropriate data formats (for example, Apache Parquet, JSON, CSV, ORC) based on data access patterns