Druid Ingestion task submitting failed - airflow.exceptions.AirflowException: Did not get 200 when submitting the Druid job

[TheRum]

Hello Community,

Recently, I upgraded Airflow to 2.0.1 from 1.10.12. Everything seems good. DAGs are loading, tasks are running except DruidOperator.
When I am trying to submit a Druid ingestion task via Druid Operator, getting
airflow.exceptions.AirflowException: Did not get 200 when submitting the Druid job

I also downgraded to 1.10.12 with the same code except for changes in the 'import'. And it's working as usual. There is no change on the Druid side or anywhere.

Am I missing something? or is it a known issue? Tried searching in github issues as well but no luck. Any help would be very appreciated as I've got a production upgrade deadline.

[2021-02-18 03:35:50,340] {{base.py:65}} INFO - Using connection to: id: druid_ingest_conn. Host: druid-master, Port: 8081, Schema: , Login: , Password: None, extra: XXXXXXXX
[2021-02-18 03:35:50,343] {{connectionpool.py:227}} DEBUG - Starting new HTTP connection (1): druid-master:8081
[2021-02-18 03:35:50,349] {{connectionpool.py:452}} DEBUG - http://druid-master:8081 "POST /druid/indexer/v1/task HTTP/1.1" 500 15714
[2021-02-18 03:35:50,350] {{taskinstance.py:570}} DEBUG - Refreshing TaskInstance <TaskInstance: druid_compact_daily.compact_1day 2021-02-17T01:20:00+00:00 [running]> from DB
[2021-02-18 03:35:50,359] {{taskinstance.py:605}} DEBUG - Refreshed TaskInstance <TaskInstance: druid_compact_daily.compact_1day 2021-02-17T01:20:00+00:00 [running]>
[2021-02-18 03:35:50,361] {{taskinstance.py:1455}} ERROR - Did not get 200 when submitting the Druid job to http://druid-master:8081/druid/indexer/v1/task
Traceback (most recent call last):
  File "/usr/local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1112, in _run_raw_task
    self._prepare_and_execute_task_with_callbacks(context, task)
  File "/usr/local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1285, in _prepare_and_execute_task_with_callbacks
    result = self._execute_task(context, task_copy)
  File "/usr/local/lib/python3.8/site-packages/airflow/models/taskinstance.py", line 1315, in _execute_task
    result = task_copy.execute(context=context)
  File "/usr/local/lib/python3.8/site-packages/airflow/providers/apache/druid/operators/druid.py", line 58, in execute
    hook.submit_indexing_job(json.loads(self.json_index_file))
  File "/usr/local/lib/python3.8/site-packages/airflow/providers/apache/druid/hooks/druid.py", line 94, in submit_indexing_job
    raise AirflowException(f'Did not get 200 when submitting the Druid job to {url}')
airflow.exceptions.AirflowException: Did not get 200 when submitting the Druid job to http://druid-master:8081/druid/indexer/v1/task
[2021-02-18 03:35:50,362] {{taskinstance.py:1862}} DEBUG - Task Duration set to 0.372725
[2021-02-18 03:35:50,363] {{taskinstance.py:1496}} INFO - Marking task as FAILED. dag_id=druid_compact_daily, task_id=compact_1day, execution_date=20210217T012000, start_date=20210218T033549, end_date=20210218T033550