Connector for generic REST APIs as a metadata source

[Adaverse]

REST API Source Connector Request

Issue Description

I'm looking to ingest metadata from a REST API into DataHub, but couldn't find any out-of-the-box connector for this purpose. I've reviewed the available connectors in the documentation and GitHub repository, but none seem to support generic REST API sources.

Current Situation

• I need to ingest metadata from: [briefly describe your REST API source]
• I've already explored these options:
  • Standard connectors (S3, PostgreSQL, etc.)
  • Custom source development using the Python SDK
  • File-based ingestion

Questions

1. Is there an existing connector for REST API sources that I might have missed?
2. Are there recommended workarounds, such as:
   • Dumping API data to local files and then ingesting
   • Using an intermediate storage like S3 or a database
   • Writing a custom connector
3. If a custom connector is needed, are there any examples or templates specifically for REST APIs?

Feature Request

If no solution exists, I'd like to request consideration for a generic REST API connector that could:

• Support configurable endpoints
• Allow custom authentication methods
• Provide mapping capabilities from API responses to DataHub metadata models

Thank you!