Sean Murdock
Professor at Brigham Young University Idaho
Automate Data Pipelines
Schedule, monitor, and manage data workflows efficiently using tools like Apache Airflow. Build data pipelines by leveraging Airflow DAGs to organize tasks and utilize AWS resources such as S3 and Redshift to process and move data effectively between systems. Engage in hands-on projects to automate and maintain complex data pipelines, streamlining operations and improving data reliability. Gain expertise in workflow automation, data integration, and error handling, enabling you to construct efficient and scalable data pipelines in production environments. Ideal for data engineers and professionals aiming to advance their skills in managing and automating data workflows.
- Course
- Intermediate
- 9 hours
- Updated: Jun 28, 2025
Subscription · Monthly
- Cancel Anytime
- Unlimited access to hundreds of top-rated courses
- Hands-on projects with expert feedback
- Personalized career coaching and interview prep
- Program Certificates
Skills you'll learn
8 skills
- Apache Airflow
- Data pipeline dags
- Data pipeline partitioning
- Amazon s3
- Data pipeline maintenance
Prerequisites
6 prerequisites
Prior to enrolling, you should have the following knowledge:
- Data modeling basics
- Intermediate Python
- Database fundamentals
- Intermediate SQL
- Amazon web services basics
You will also need to be able to communicate fluently and professionally in written and spoken English.
Course Outline
- 6 lessons
- 1 project
Program Instructors
1 instructor
Unlike typical professors, our instructors come from Fortune 500 and Global 2000 companies and have demonstrated leadership and expertise in their professions:
Sean Murdock
Professor at Brigham Young University Idaho
Subscription · Monthly
- Cancel Anytime
- Unlimited access to hundreds of top-rated courses
- Hands-on projects with expert feedback
- Personalized career coaching and interview prep
- Program Certificates