AWS Glue
AWS Glue is a popular cloud-based ETL and data integration service that allows you to create workflows for moving and transforming data at scale. Automating execution from within AWS Glue creates an additional island of automation for IT Operations to manage. This allows you to easily integrate AWS Glue workflows with your existing enterprise workload automation solution. Simply define your processes in AWS Glue and allow your enterprise workload automation solution to manage the scheduling of these workflows. You are instantly inheriting the advanced capabilities of your enterprise solution to deliver your digital transformation quicker and more successfully. By extending your existing enterprise automation to AWS Glue you maintain end-to-end visibility, regain centralized command and control, alerting, SLA management, reporting and auditing.
Benefits and Use Cases
- Start and monitor AWS Glue jobs to automate extract, transform, and load (ETL) operations across multiple data sources.
- Trigger crawlers to catalog and prepare data for processing.
- Orchestrate Glue workflows, blueprints, and triggers as part of end-to-end data pipelines.
- Monitor execution status in real time.
Example Use Case: Data Preparation for Analytics
Automate the preparation and transformation of raw data for analytics and reporting in real time, ensuring analytics-ready data is consistently delivered with minimal manual effort.
Automic Features
- Run and Monitor AWS Glue jobs to completion
- Run and Monitor AWS Glue Workflows and Blueprints to completion
- Start AWS Crawlers
- Start Triggers
- View execution log for problem diagnosis
- Alert on failure of AWS Glue jobs
- Incorporate AWS Glue processing in existing enterprise automation workflows including dependency enforcement