Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when running dlt deploy cli with airflow-composer parameter #2159

Open
Isarien opened this issue Dec 17, 2024 · 1 comment
Open

Error when running dlt deploy cli with airflow-composer parameter #2159

Isarien opened this issue Dec 17, 2024 · 1 comment

Comments

@Isarien
Copy link

Isarien commented Dec 17, 2024

dlt version

1.4.1

Describe the problem

Hello,

I am encountering an issue when trying to deploy a pipeline on Airflow-Composer.
The pipeline works perfectly, but when I run the command :

dlt deploy .\rest_api_pipeline.py airflow-composer

I get the following error:

Your current repository origin is not set to GitHub but to [https://gitlab.*****/test-dlt-composter.git](https://gitlab.%2A%2A%2A%2A%2A/test-dlt-composter.git).
You must change it to be able to run the pipelines with GitHub Actions: https://docs.github.com/en/get-started/getting-started-with-git/managing-remote-repositories
NOTE: Please refer to our docs at 'https://dlthub.com/docs/walkthroughs/deploy-a-pipeline' for further assistance.

I do not understand why the CLI is trying to use GitHub Actions, as I haven’t specified anything in my configuration.
I therefore believe this might be a bug.

Expected behavior

Generation of a DAG file with my pipeline

Steps to reproduce

Install latest version of dlt
create a simple rest api to bigquery pipeline
run pipeline to check that all is working fine
run dlt deploy .\rest_api_pipeline.py airflow-composer command

Operating system

Windows

Runtime environment

Local

Python version

3.9

dlt data source

service now rest api

dlt destination

Google BigQuery

Other deployment details

No response

Additional information

No response

@Isarien Isarien changed the title dlt deploy .\rest_api_pipeline.py airflow-composer Error when running dlt deploy cli with airflow-composer parameter Dec 17, 2024
@Isarien
Copy link
Author

Isarien commented Dec 18, 2024

After some research, it turns out that having a repository pointing to GitHub is a prerequisite (_get_origin() method in deploy_command_helpers.py), even if GitHub Actions are not being used.
So, I added a dummy repo with github.com in the URL of my repo, and it works. I find it counterintuitive, but I couldn’t find any other way to make the command work.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Todo
Development

No branches or pull requests

1 participant