Azure Synapse & Data Factory Workshop

What is Azure Synapse?

Azure Synapse Analytics is a limitless analytics service that brings together data integration, enterprise data warehousing, and big data analytics. It gives you the freedom to query data on your terms, using either serverless or dedicated options—at scale.

What is Azure Data Factory?

Azure Data Factory is Azure's cloud ETL service for scale-out serverless data integration and data transformation. It offers a code-free UI for intuitive authoring and single-pane-of-glass monitoring and management. You can also lift and shift existing SSIS packages to Azure and run them with full compatibility in ADF. Thus, Azure Data Factory is a cloud-based PaaS Solution which combines capabilities such as data integration services, orchestration & automation, and data transformation.

🤔 Prerequisites

• An Azure account with an active subscription. Note: If you don't have access to an Azure subscription, you may be able to start with a free account.
• You must have the necessary privileges within your Azure subscription to create resources, perform role assignments, register resource providers (if required), etc.

🧪 Lab Environment Setup

• Module00: Lab Environment

📚 Learning Modules

1. Module01: Create a dedicated SQL pool in Azure Synapse Analytics Studio

1a. Module01a: Load New York Taxi dataset into Synapse Using Microsoft Learn Demo

2. Module02: Load Data into Azure Synapse Analytics using Azure Data Factory Pipelines

3. Module03: Transform Big Data using Azure Data Factory Mapping Data Flows

📚 [OPTIONAL] Learning Modules

4. Module04: Create self-hosted integration runtime within ADF

5. Module05: Synapse - dedicated spark pool