AWS Elastic MapReduce (EMR)
Amazon EMR (Elastic MapReduce) is a big data platform from Amazon Web Services (AWS) that allows users to process and analyze large amounts of data. It's a managed cluster service that can be used to run big data frameworks like Apache Spark and Apache Hadoop on AWS. This allows you to easily integrate Amazon EMR activities with your existing enterprise workload automation solution. By extending your existing enterprise automation to AWS EMR you maintain end-to-end visibility, regain centralized command and control, alerting, SLA management, reporting and auditing.
Benefits and Use Cases
- Integrate cloud-based EMR processing with on-premises and multi-cloud systems for unified orchestration.
- Trigger Amazon EMR jobs to run Spark, Hadoop, or Presto-based processing as part of scheduled workflows.
- Monitor EMR job progress and completion status in real time.
- Cancel or restart EMR steps and clusters in response to job dependencies or failures.
Example Use Case: Scheduled Data Transformation Pipeline
Schedule recurring batch processing jobs that transform large datasets for analytics and reporting. Seamlessly ingest raw S3 data into clean datasets, maximize resource efficiency through programmatic job termination, and automatically trigger downstream reporting based on real-time execution status.
Automic Features
- Add steps to a cluster
- Start Notebook execution