Skip to content
Open
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
203 commits
Select commit Hold shift + click to select a range
d26dca8
refactor: Added Apache Arrow provider and implemented basic AdbcHook
davidblain-infrabel Jun 27, 2025
a42d821
Merge branch 'main' into feature/apache-arrow-provider
dabla Jun 27, 2025
d44a7f2
Merge branch 'main' into feature/apache-arrow-provider
dabla Jun 28, 2025
b7ec972
refactor: Fixed adbc connection docs, still needs additional document…
davidblain-infrabel Jun 28, 2025
61f480e
refactor: Updated link to ADBC site
davidblain-infrabel Jun 28, 2025
6171a75
refactor: Fixed version in pyproject.toml
davidblain-infrabel Jun 28, 2025
edc7408
refactor: Fixed breeze test_docs_filter for Common SQL provider packa…
davidblain-infrabel Jun 28, 2025
7e0b3ad
Merge branch 'main' into feature/apache-arrow-provider
dabla Jun 30, 2025
f0aba05
Merge branch 'main' into feature/apache-arrow-provider
dabla Jun 30, 2025
a95ba2a
Merge branch 'main' into feature/apache-arrow-provider
dabla Jul 2, 2025
a2695ef
Merge branch 'main' into feature/apache-arrow-provider
dabla Jul 3, 2025
6c307d9
Merge branch 'main' into feature/apache-arrow-provider
dabla Jul 3, 2025
565bbd2
Merge branch 'main' into feature/apache-arrow-provider
dabla Jul 4, 2025
985163d
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 4, 2025
04163a8
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 5, 2025
80208ab
refactor: Implemented ADBC dialect
davidblain-infrabel Aug 6, 2025
b56cb0c
refactor: Implemented get_column_names in PostgresDialect so we don't…
davidblain-infrabel Aug 7, 2025
d4edee5
refactor: Removed AdbcDialect and make sure AdbcHook can work with ex…
davidblain-infrabel Aug 7, 2025
6f85e54
refactor: Don't use prepared statement in PostgresDialect for get_pri…
davidblain-infrabel Aug 12, 2025
ff296c6
refactor: Refactored insert_rows of AdbcHook using pyarrow RecordBatch
davidblain-infrabel Aug 12, 2025
1def92d
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 12, 2025
b1bad8f
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
55ae8ae
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
0b7993d
refactor: Replace native placeholders with ADBC placeholder to suppor…
davidblain-infrabel Aug 13, 2025
f2c19eb
refactor: Use prepared statements in PostgresDialect
davidblain-infrabel Aug 13, 2025
a741d46
refactor: Fixed placeholders in prepared statements in PostgresDialect
davidblain-infrabel Aug 13, 2025
fcb1d20
refactor: Refactored _run_command in AdbcHook
davidblain-infrabel Aug 13, 2025
6fded87
refactor: Updated adbc-driver-manager and pyarrow dependencies
davidblain-infrabel Aug 13, 2025
11d21d6
refactor: Refactored insert_rows
dabla Aug 13, 2025
8ea29bf
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
fc6068d
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
a44d975
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
67bc924
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 13, 2025
1124109
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 14, 2025
20f3e4e
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 18, 2025
ac59e63
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 18, 2025
fda7c41
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 18, 2025
fc18a8a
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 19, 2025
59b9454
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 20, 2025
3e3e1c3
refactor: Removed apache-airflow-providers-apache-arrow from airflow …
dabla Aug 20, 2025
c1c30b6
refactor: Removed apache-airflow-providers-apache-arrow from airflow …
dabla Aug 21, 2025
596d8ed
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 21, 2025
ffc3b2c
Revert "refactor: Removed apache-airflow-providers-apache-arrow from …
dabla Aug 21, 2025
e36613a
refactor: Removed apache-airflow-providers-apache-arrow from airflow …
dabla Aug 21, 2025
a3f166f
refactor: Removed duplicate get_column_names in PostgresDialect
dabla Aug 21, 2025
59f4b39
refactor: Added missing apache arrow entries in pyproject.toml
dabla Aug 21, 2025
c8769a4
refactor: Changed signature get_records in AdbcHook
dabla Aug 21, 2025
0bb6a96
refactor: Changed minimum required pyarrow version to 18.0.0 to not h…
dabla Aug 21, 2025
0a3f462
fix: Fixed name for flit module in apache arrow
dabla Aug 21, 2025
507e5e0
fix: Fixed import of AdbcHook in TestAdbcHook
dabla Aug 21, 2025
ce8da7d
refactor: Added apache arrow to remove and test sources YAML files
dabla Aug 21, 2025
d9eccff
refactor: Updated pyproject.toml
dabla Aug 21, 2025
49d35a5
refactor: Fixed provider package name in docs of arrow
dabla Aug 21, 2025
802108b
refactor: Fixed project urls in pyproject.toml
dabla Aug 21, 2025
a688fd1
refactor: Fixed version in apache arrow provider
dabla Aug 21, 2025
3e60219
refactor: Fixed message in RuntimeError for provider info in apache a…
dabla Aug 21, 2025
519d725
refactor: Reformatted get_provider_info
dabla Aug 21, 2025
cecdcc8
refactor: Reformatted AdbcHook
dabla Aug 21, 2025
13179ad
refactor: Reorganized imports for TestAdbcHook
dabla Aug 21, 2025
24a3581
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 21, 2025
fe7d65b
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 21, 2025
600ddf6
refactor: Removed handler parameter from overridden get_records metho…
dabla Aug 21, 2025
5702b6e
refactor: Fixed include for security.rst
dabla Aug 21, 2025
954f7d6
refactor: Fixed include for installing-providers-from-sources.rst
dabla Aug 21, 2025
bfb4836
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 21, 2025
90d85a8
refactor: Fixed static checks and mypy issues on AdbcHook
dabla Aug 22, 2025
6f080bf
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 22, 2025
bde3082
refactor: Fxied fetch_all_handler
dabla Aug 22, 2025
f857231
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 22, 2025
24f04e8
Merge branch 'main' into feature/apache-arrow-provider
dabla Aug 28, 2025
d73a2b9
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 9, 2025
442ccb6
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 13, 2025
aa0301e
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 13, 2025
899dc5e
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 13, 2025
fd4f318
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 14, 2025
fd77c65
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 15, 2025
8629eea
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 17, 2025
bae2196
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 22, 2025
a62c473
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 24, 2025
7751929
Merge branch 'main' into feature/apache-arrow-provider
dabla Sep 25, 2025
a49e018
refactor: Changed required python version check
dabla Sep 25, 2025
312410f
refactor: Uncommented apache-arrow in pyproject.toml
dabla Sep 25, 2025
5a14869
refactor: Removed min version from arrow
dabla Sep 28, 2025
3fabaca
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 4, 2025
996d96e
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 7, 2025
0129adf
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 7, 2025
84df206
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 8, 2025
d438807
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 8, 2025
0f41546
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 18, 2025
41ae36a
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 28, 2025
b9b940a
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 29, 2025
8b192a3
Merge branch 'main' into feature/apache-arrow-provider
dabla Oct 30, 2025
8f25ef6
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 4, 2025
82c4e29
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 5, 2025
e4518ce
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 5, 2025
9778c9e
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 5, 2025
47b04bf
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 5, 2025
75efe12
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 6, 2025
483d7e0
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 12, 2025
90c93fc
refactor: Updated pyproject.toml and added LICENSE en NOTICE
dabla Nov 13, 2025
0007ad8
refactor: Updated documentation
dabla Nov 13, 2025
3a369e1
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 13, 2025
bd0ce99
refactor: Added redirect for adbc connections in docs
dabla Nov 13, 2025
dc07166
refactor: Fixed title in index.rst for arrow provider
dabla Nov 13, 2025
399bbf5
refactor: Added Apache Arrow provider docs
dabla Nov 13, 2025
15f49bd
docs: Added Apache Arrow connection reference in Guides
dabla Nov 13, 2025
223dca6
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 13, 2025
614b4de
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 13, 2025
303301c
refactor: Added importlib resources dependency in apache arrow
dabla Nov 13, 2025
9121d96
refactor: Added apache-arrow provider in providers bug report YAML file
dabla Nov 14, 2025
17d3cf0
Merge branch 'main' into feature/apache-arrow-provider
dabla Nov 14, 2025
ead913d
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 4, 2025
5a67ee3
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 4, 2025
3a6a8ad
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 5, 2025
0b2d6e6
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 5, 2025
0b05d77
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 5, 2025
eef462c
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 8, 2025
dbf7f13
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 8, 2025
d60c08d
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 8, 2025
9e68499
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 9, 2025
60012df
refactor: Updated min required version of common sql provider
dabla Dec 11, 2025
d7301c1
refactor: Added version compat provider dependency, downgraded min re…
dabla Dec 11, 2025
666f7ff
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 11, 2025
16e6e7b
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 16, 2025
57ed88a
refactor: We don't need common compat here
dabla Dec 16, 2025
333f38f
refactor: Changed min required airflow version to 2.11.0
dabla Dec 16, 2025
5a0ee0e
refactor: Removed common-compat dev dependency
dabla Dec 17, 2025
cea45ff
refactor: Changed min required Airflow version assertion in arrow pro…
dabla Dec 17, 2025
0d5afbb
refactor: Updated docs
dabla Dec 17, 2025
993d73f
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 17, 2025
2eef324
refactor: Reformatted index in docs
dabla Dec 17, 2025
c618585
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 21, 2025
09f825b
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 21, 2025
57e53a8
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 24, 2025
8f4a8a7
refactor: Return default if dialect name was not specified for AdbcHook
dabla Dec 24, 2025
2a59d40
refactor: Added sqlite as dialect in connection fixture
dabla Dec 24, 2025
ad527f5
refactor: Make sure driver property from AdbcHook first checks if dri…
dabla Dec 24, 2025
ad1cb76
Revert "refactor: Added sqlite as dialect in connection fixture"
dabla Dec 24, 2025
536cf01
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 24, 2025
174d0e0
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 25, 2025
6323764
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 26, 2025
3a7ea6a
refactor: Added adbc-driver-sqlite as dev dependency to allow running…
dabla Dec 26, 2025
fb8a8fa
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 26, 2025
4cfb29e
refactor: Re-use logic from connection.get_uri but change prefix
dabla Dec 26, 2025
b80df9f
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 27, 2025
3d57bab
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 28, 2025
9453fc1
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 29, 2025
feb03ef
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 31, 2025
4fe184f
Merge branch 'main' into feature/apache-arrow-provider
dabla Dec 31, 2025
234c69e
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 4, 2026
56e737b
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 6, 2026
4df55b3
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 7, 2026
525b259
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 7, 2026
7ee4fdb
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 7, 2026
87fa511
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 8, 2026
7bcdb8b
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 8, 2026
347fca6
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 8, 2026
0b62f8a
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 9, 2026
facd3bc
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 9, 2026
592db75
Merge branch 'main' into feature/apache-arrow-provider
dabla Jan 15, 2026
0cf5318
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 3, 2026
5a4ebdf
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 3, 2026
d7a07b1
refactor: Changed version of ADBC provider to 0.1.0
dabla Mar 3, 2026
3cc7c4c
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 3, 2026
cb646af
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 3, 2026
829d704
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 3, 2026
830dedb
refactor: Added one more logo
dabla Mar 3, 2026
b796b2d
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 10, 2026
eeb49dc
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 10, 2026
5bfb9d4
refactor: Removed wrong references to apache-beam
dabla Mar 10, 2026
0591e0a
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 10, 2026
f334fa5
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 10, 2026
4720bf8
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 10, 2026
dc3780a
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 16, 2026
1bf4a44
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 17, 2026
3487f33
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 19, 2026
61cae75
refactor: Updated uv.lock file
dabla Mar 20, 2026
9021aad
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 20, 2026
c0cba88
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 20, 2026
7e591c0
refactor: Skip tests if adbc_driver_sqlite isn't available
dabla Mar 24, 2026
230c2b9
refactor: Optimize insert_rows to check use_native_bind outside for loop
dabla Mar 24, 2026
0bea882
refactor: Added unit tests on AdbcHook
dabla Mar 24, 2026
5d6706a
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 24, 2026
8f6c30f
refactor: Fixed param for test_docs_filter
dabla Mar 24, 2026
dd3d692
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 25, 2026
702ab85
refactor: Must check if host in connection is not None first
dabla Mar 25, 2026
216eddf
refactor: Updated pyproject
dabla Mar 25, 2026
0ed9c0a
refactor: Reformatted files
dabla Mar 25, 2026
f2c03fa
refactor: Updated release references
dabla Mar 26, 2026
70b5e2a
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 26, 2026
c9452ae
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 26, 2026
26b436b
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 26, 2026
4d7efd7
refactor: Reformatted uri method
dabla Mar 27, 2026
cc7c3ac
refactor: Updated pyproject
dabla Mar 27, 2026
88d12d7
refactor: Updated uv.lock file
dabla Mar 27, 2026
9ea765e
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 27, 2026
754d772
refactor: Updated pyproject
dabla Mar 27, 2026
d3ecae3
refactor: Fixed static checks on AdbcHook
dabla Mar 28, 2026
bdaea97
refactor: Added adbc drivers in optional dependencies
dabla Mar 28, 2026
a871422
Merge branch 'main' into feature/apache-arrow-provider
dabla Mar 28, 2026
61421be
refactor: Added comment for optional dependencies in provider.yaml
dabla Mar 30, 2026
10408eb
refactor: Reformatted replace_placeholders method in adbc module
dabla Mar 30, 2026
5cbac82
refactor: Updated uv.lock
dabla Mar 30, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
81 changes: 81 additions & 0 deletions providers/apache/arrow/README.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@

.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.

.. NOTE! THIS FILE IS AUTOMATICALLY GENERATED AND WILL BE OVERWRITTEN!

.. IF YOU WANT TO MODIFY TEMPLATE FOR THIS FILE, YOU SHOULD MODIFY THE TEMPLATE
``PROVIDER_README_TEMPLATE.rst.jinja2`` IN the ``dev/breeze/src/airflow_breeze/templates`` DIRECTORY

Package ``apache-airflow-providers-apache-arrow``
Comment thread
dabla marked this conversation as resolved.

Release: ``1.0.0``


`Apache Arrow <https://arrow.apache.org/>`__
Comment thread
dabla marked this conversation as resolved.


Provider package
----------------

This is a provider package for ``apache.arrow`` provider. All classes for this provider package
are in ``airflow.providers.apache.arrow`` python package.

You can find package information and changelog for the provider
in the `documentation <https://airflow.apache.org/docs/apache-airflow-providers-apache-arrow/1.0.0/>`_.

Installation
------------

You can install this package on top of an existing Airflow 2 installation (see ``Requirements`` below
for the minimum Airflow version supported) via
``pip install apache-airflow-providers-apache-arrow``

The package supports the following python versions: 3.9,3.10,3.11,3.12

Requirements
------------

======================================= ==================
PIP package Version required
======================================= ==================
``apache-airflow`` ``>=2.10.0``
``apache-airflow-providers-common-sql`` ``>=1.20.0``
``adbc-driver-manager`` ``>=1.6.0``
======================================= ==================

Cross provider package dependencies
-----------------------------------

Those are dependencies that might be needed in order to use all the features of the package.
You need to install the specified providers in order to use them.

You can install such cross-provider dependencies when installing from PyPI. For example:

.. code-block:: bash

pip install apache-airflow-providers-arrow[common.sql]


============================================================================================================ ==============
Dependent package Extra
============================================================================================================ ==============
`apache-airflow-providers-common-sql <https://airflow.apache.org/docs/apache-airflow-providers-common-sql>`_ ``common.sql``
============================================================================================================ ==============

The changelog for the provider package can be found in the
`changelog <https://airflow.apache.org/docs/apache-airflow-providers-arrow/1.0.0/changelog.html>`_.
1 change: 1 addition & 0 deletions providers/apache/arrow/docs/.latest-doc-only-change.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
7b2ec33c7ad4998d9c9735b79593fcdcd3b9dd1f
49 changes: 49 additions & 0 deletions providers/apache/arrow/docs/changelog.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,49 @@
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.


.. NOTE TO CONTRIBUTORS:
Please, only add notes to the Changelog just below the "Changelog" header when there are some breaking changes
and you want to add an explanation to the users on how they are supposed to deal with them.
The changelog is updated and maintained semi-automatically by release manager.

``apache-airflow-providers-arrow``

Changelog
---------

1.0.0
.....

.. note::
This release of provider is only available for Airflow 2.10+ as explained in the
Apache Airflow providers support policy <https://github.com/apache/airflow/blob/main/PROVIDERS.rst#minimum-supported-version-of-airflow-for-community-managed-providers>_.

Misc
~~~~

* ``Bump min Airflow version in providers to 2.10 (#49843)``

.. Below changes are excluded from the changelog. Move them to
appropriate section above if needed. Do not delete the lines(!):
* ``Update description of provider.yaml dependencies (#50231)``
* ``Avoid committing history for providers (#49907)``

1.0.0
.....

Initial version of the provider.
35 changes: 35 additions & 0 deletions providers/apache/arrow/docs/commits.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,35 @@

.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.

.. NOTE! THIS FILE IS AUTOMATICALLY GENERATED AND WILL BE OVERWRITTEN!

.. IF YOU WANT TO MODIFY THIS FILE, YOU SHOULD MODIFY THE TEMPLATE
`PROVIDER_COMMITS_TEMPLATE.rst.jinja2` IN the `dev/breeze/src/airflow_breeze/templates` DIRECTORY

.. THE REMAINDER OF THE FILE IS AUTOMATICALLY GENERATED. IT WILL BE OVERWRITTEN!

Package apache-airflow-providers-arrow
------------------------------------------------------

`ADBC: Arrow Database Connectivity <https://github.com/apache/arrow-adbc/>`__


This is detailed commit list of changes for versions provider package: ``arrow``.
For high-level changelog, see :doc:`package information including changelog <index>`.

.. airflow-providers-commits::
27 changes: 27 additions & 0 deletions providers/apache/arrow/docs/conf.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Disable Flake8 because of all the sphinx imports
#
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied. See the License for the
# specific language governing permissions and limitations
# under the License.
"""Configuration of Providers docs building."""

from __future__ import annotations

import os

os.environ["AIRFLOW_PACKAGE_NAME"] = "apache-airflow-providers-arrow"

from docs.provider_conf import * # noqa: F403
19 changes: 19 additions & 0 deletions providers/apache/arrow/docs/configurations-ref.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.

.. include:: /../../../devel-common/src/sphinx_exts/includes/providers-configurations-ref.rst
.. include:: /../../../devel-common/src/sphinx_exts/includes/sections-and-options.rst
61 changes: 61 additions & 0 deletions providers/apache/arrow/docs/connections/adbc.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
.. Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

.. http://www.apache.org/licenses/LICENSE-2.0

.. Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.

.. _howto/connection:jdbc:

JDBC connection
Comment thread
dabla marked this conversation as resolved.
Outdated
===============

The JDBC connection type enables connection to a JDBC data source.

Configuring the Connection
--------------------------

Host (required)
The host to connect to.

Schema (required)
Specify the database name to be used in.

Login (required)
Specify the user name to connect to.

Password (required)
Specify the password to connect to.

Port (optional)
Port of host to connect to. Not user in ``JdbcOperator``.

Extra (optional)
Specify the extra parameters (as json dictionary) that can be used in JDBC connection. The following parameters out of the standard python parameters are supported:

- ``driver_class``
* Full qualified Java class name of the JDBC driver. For ``JdbcOperator``.
Note that this is only considered if ``allow_driver_class_in_extra`` is set to True in airflow config section
``providers.jdbc`` (by default it is not considered). Note: if setting this config from env vars, use
``AIRFLOW__PROVIDERS_JDBC__ALLOW_DRIVER_CLASS_IN_EXTRA=true``.

- ``driver_path``
* Jar filename or sequence of filenames for the JDBC driver libs. For ``JdbcOperator``.
Note that this is only considered if ``allow_driver_path_in_extra`` is set to True in airflow config section
``providers.jdbc`` (by default it is not considered). Note: if setting this config from env vars, use
``AIRFLOW__PROVIDERS_JDBC__ALLOW_DRIVER_PATH_IN_EXTRA=true``.

.. note::
Setting ``allow_driver_path_in_extra`` or ``allow_driver_class_in_extra`` to True allows users to set the driver
via the Airflow Connection's ``extra`` field. By default this is not allowed. If enabling this functionality,
you should make sure that you trust the users who can edit connections in the UI to not use it maliciously.
Loading
Loading