Data World 2 · Pipeline Plumbing · Stage 3

Inside the Fence

A Glue job in a VPC is network interfaces with private addresses: let them talk to each other, give them a path to S3, and a NAT gateway for what lives on the internet.

  • Glue connections
  • Self-referencing security groups
  • S3 gateway endpoints
  • NAT gateways and allowlists
Domain
Data engineering
World
Data World 2: Pipeline Plumbing (Associate)
Game type
Network build: Place gateways, routes and rules on a VPC, then follow each packet.
Time
About 25 minutes on a first attempt (estimated)
Exam guides
  • SAA-C03Task 3.5: Determine high-performing data ingestion and transformation solutions
  • DEA-C01Skill 1.2.2: Connect to different data sources (for example, Java Database Connectivity [JDBC], Open Database Connectivity [ODBC]); Skill 2.2.5: Create new source or target connections for cataloging (for example, AWS Glue); Skill 1.1.8: Create allowlists for IP addresses to allow connections to data sources; Skill 4.1.1: Update VPC security groups; Skill 4.1.5: Apply IAM policies to roles, endpoints, and services (for example, S3 Access Points, AWS PrivateLink); Skill 4.2.2: Store application and database credentials (for example, Secrets Manager, AWS Systems Manager Parameter Store)