Scheduling an SQL script, using Apache Airflow
In this, small project, I was using Airflow to schedule my SQL script. In my data engineering project, I'm collecting everyday batch data inside the MySQL database. The idea behind using airflow is that to collect previous day data from a database and put it inside another table. Things I learn,
How to schedule SQL scripts using Apache Airflow
How Airflow connects to the database using the connection id
How to pass in parameters at run-time using macros