Pull pipeline config
Pull results
Trigger & wait
Trigger & wait
Trigger & wait
Trigger & wait
Write
Read schema
Read
Write
Read schema
Read
Write
Read schema
AWS Systems Manager iconAWS Systems Manager
App Config iconApp Config
Metadata pull, DQ execution

AWS Glue

Pipeline iconIngestion pipeline
Pipeline iconProcessing pipeline
Pipeline iconAggregation pipeline
Pipeline iconExport pipeline

S3

Bronze data bucket
Bronze data
Silver data bucket
Silver data
Gold data bucket
Gold data
Amazon QuickSight iconAmazon QuickSight
Amazon Athena iconAmazon Athena
External systems iconExternal systems
Training Pipeline iconTraining Pipeline
Serving Pipeline iconServing Pipeline
AWS EKS iconAWS EKS
Data Quality results
Apache Airflow iconApache Airflow
Open Metadata iconOpen Metadata
Notifications & events