README.md

Data integrations

Data integration is synchronizing data from an external system to an internal system or vice versa.

• Overview
• How to build a data integration pipeline
• Sources
  • Available sources
  • Add a new source
  • Adapt an existing source
• Destinations
  • Available destinations
  • Add a new destination
  • Adapt an existing destination

Overview

Syncing external data → internal systems

If you have data in 3rd party systems (e.g other SaaS tools) and you want that data available in your database, data warehouse, or data lake, you can use Mage to sync data between those systems.

Syncing internal data → external systems (reverse)

Your internal database or data warehouse may contain application data generated by your users or customers. This data can be valuable if used in conjunction with 3rd party SaaS tools.

You can use Mage to sync data from your internal systems, and have that data appear in various 3rd party SaaS tools.

How to build a data integration pipeline

Documentation here

Sources

A source is a system that you want to load data from and synchronize it into another system. A source can be a 3rd party API, SaaS, database, data warehouse, or a data lake.

Read more about Sources:

• Technical documentation
• Add a new source
• Adapt an existing source (aka Tap)

Available sources

• Amplitude
• MySQL
• Redshift (Amazon Web Services)
• Salesforce
• Stripe
• Airtable (coming soon)
• Chargebee (coming soon)
• Google Analytics (coming soon)
• Google Search Console (coming soon)
• Google Sheets (coming soon)
• HubSpot (coming soon)
• MongoDB (coming soon)
• Shopify (coming soon)
• Zendesk (coming soon)

Mage adheres to the data engineering standard for data integrations called the Singer Spec.

All sources (aka taps) that has been developed by the open-source community can be adapted to use in Mage. Here is a short list of available ones.

Don’t see a source you need?

Check out the next section on Add a new source or tell us on Slack and we can help you build it.

Destinations

A destination is a system that you want to export data into. A destination can be a 3rd party API, SaaS, database, data warehouse, or a data lake.

Read more about destinations:

• Technical documentation
• Add a new destination
• Adapt an existing destination (aka Target)

Available destinations

• MySQL
• PostgreSQL
• Snowflake
• Amazon Web Services (AWS) Redshift (coming soon)
• Amazon Web Services (AWS) S3 (coming soon)
• Azure Blob Storage (coming soon)
• Google Cloud Platform (GCP) BigQuery (coming soon)
• HubSpot (coming soon)
• Salesforce (coming soon)

Mage adheres to the data engineering standard for data integrations called the Singer Spec.

All destinations (aka targets) that has been developed by the open-source community can be adapted to use in Mage. Here is a short list of available ones.

Don’t see a destination you need?

Check out the next section on Add a new destination or tell us on Slack and we can help you build it.