Skip to content

Commit 3bd0670

Browse files
authored
Prepare pre-release 3.0.0rc1 (#1725)
1 parent 50e2337 commit 3bd0670

26 files changed

+221
-218
lines changed

.bumpversion.cfg

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
[bumpversion]
2-
current_version = 3.0.0b3
2+
current_version = 3.0.0rc1
33
commit = False
44
tag = False
55
tag_name = {new_version}

CONTRIBUTING.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -316,7 +316,7 @@ available_node_types:
316316
SubnetId: {replace with subnet within above AZs}
317317
318318
setup_commands:
319-
- pip install "awswrangler[modin, ray]==3.0.0b3"
319+
- pip install "awswrangler[modin, ray]==3.0.0rc1"
320320
- pip install pytest
321321
322322
```

CONTRIBUTING_COMMON_ERRORS.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -13,9 +13,9 @@ Requirement already satisfied: pbr!=2.1.0,>=2.0.0 in ./.venv/lib/python3.7/site-
1313
Using legacy 'setup.py install' for python-Levenshtein, since package 'wheel' is not installed.
1414
Installing collected packages: awswrangler, python-Levenshtein
1515
Attempting uninstall: awswrangler
16-
Found existing installation: awswrangler 3.0.0b3
17-
Uninstalling awswrangler-3.0.0b3:
18-
Successfully uninstalled awswrangler-3.0.0b3
16+
Found existing installation: awswrangler 3.0.0rc1
17+
Uninstalling awswrangler-3.0.0rc1:
18+
Successfully uninstalled awswrangler-3.0.0rc1
1919
Running setup.py develop for awswrangler
2020
Running setup.py install for python-Levenshtein ... error
2121
ERROR: Command errored out with exit status 1:

README.md

+40-40
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
1111

1212
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | [email protected]
1313
14-
[![Release](https://img.shields.io/badge/release-3.0.0b3-brightgreen.svg)](https://pypi.org/project/awswrangler/)
14+
[![Release](https://img.shields.io/badge/release-3.0.0rc1-brightgreen.svg)](https://pypi.org/project/awswrangler/)
1515
[![Python Version](https://img.shields.io/badge/python-3.7%20%7C%203.8%20%7C%203.9%20%7C%203.10-brightgreen.svg)](https://anaconda.org/conda-forge/awswrangler)
1616
[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/psf/black)
1717
[![License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
@@ -26,7 +26,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q
2626
| **[PyPi](https://pypi.org/project/awswrangler/)** | [![PyPI Downloads](https://pepy.tech/badge/awswrangler)](https://pypi.org/project/awswrangler/) | `pip install awswrangler` |
2727
| **[Conda](https://anaconda.org/conda-forge/awswrangler)** | [![Conda Downloads](https://img.shields.io/conda/dn/conda-forge/awswrangler.svg)](https://anaconda.org/conda-forge/awswrangler) | `conda install -c conda-forge awswrangler` |
2828

29-
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
29+
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
3030
➡️ `pip install pyarrow==2 awswrangler`
3131

3232
Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](https://arrow.apache.org/powered_by/)
@@ -45,7 +45,7 @@ Powered By [<img src="https://arrow.apache.org/img/arrow.png" width="200">](http
4545

4646
Installation command: `pip install awswrangler`
4747

48-
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
48+
> ⚠️ **For platforms without PyArrow 3 support (e.g. [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr-cluster), [Glue PySpark Job](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs), MWAA):**<br>
4949
➡️`pip install pyarrow==2 awswrangler`
5050

5151
```py3
@@ -102,7 +102,7 @@ AWS SDK for pandas can also run your workflows at scale by leveraging [modin](ht
102102

103103
### Installation
104104
```
105-
pip install "awswrangler[modin,ray]==3.0.0b3"
105+
pip install "awswrangler[modin,ray]==3.0.0rc1"
106106
```
107107

108108
As a result existing scripts can run on significantly larger datasets with no code rewrite. Supported APIs are parallelized across cores on a single machine or across multiple nodes on a cluster in the cloud.
@@ -133,17 +133,17 @@ As a result existing scripts can run on significantly larger datasets with no co
133133

134134
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/)
135135

136-
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/what.html)
137-
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html)
138-
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#pypi-pip)
139-
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#conda)
140-
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#aws-lambda-layer)
141-
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#aws-glue-python-shell-jobs)
142-
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#aws-glue-pyspark-jobs)
143-
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#amazon-sagemaker-notebook)
144-
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#amazon-sagemaker-notebook-lifecycle)
145-
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#emr)
146-
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/install.html#from-source)
136+
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/what.html)
137+
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html)
138+
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#pypi-pip)
139+
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#conda)
140+
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-lambda-layer)
141+
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-python-shell-jobs)
142+
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#aws-glue-pyspark-jobs)
143+
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#amazon-sagemaker-notebook)
144+
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#amazon-sagemaker-notebook-lifecycle)
145+
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#emr)
146+
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/install.html#from-source)
147147
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials)
148148
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb)
149149
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb)
@@ -178,31 +178,31 @@ As a result existing scripts can run on significantly larger datasets with no co
178178
- [031 - OpenSearch](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/031%20-%20OpenSearch.ipynb)
179179
- [032 - Lake Formation Governed Tables](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/032%20-%20Lake%20Formation%20Governed%20Tables.ipynb)
180180
- [033 - Amazon Neptune](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/033%20-%20Amazon%20Neptune.ipynb)
181-
- [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb)
182-
- [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb)
183-
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html)
184-
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-s3)
185-
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#aws-glue-catalog)
186-
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-athena)
187-
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#aws-lake-formation)
188-
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-redshift)
189-
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#postgresql)
190-
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#mysql)
191-
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#sqlserver)
192-
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#oracle)
193-
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#data-api-redshift)
194-
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#data-api-rds)
195-
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#opensearch)
196-
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-neptune)
197-
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#dynamodb)
198-
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-timestream)
199-
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-emr)
200-
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-cloudwatch-logs)
201-
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-chime)
202-
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#amazon-quicksight)
203-
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#aws-sts)
204-
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#aws-secrets-manager)
205-
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/api.html#global-configurations)
181+
- [034 - Distributing Calls Using Ray](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0/tutorials/034%20-%20Distributing%20Calls%20using%20Ray.ipynb)
182+
- [035 - Distributing Calls on Ray Remote Cluster](https://github.com/aws/aws-sdk-pandas/blob/release-3.0.0/tutorials/035%20-%20Distributing%20Calls%20on%20Ray%20Remote%20Cluster.ipynb)
183+
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html)
184+
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-s3)
185+
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-glue-catalog)
186+
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-athena)
187+
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-lake-formation)
188+
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-redshift)
189+
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#postgresql)
190+
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#mysql)
191+
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#sqlserver)
192+
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#oracle)
193+
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#data-api-redshift)
194+
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#data-api-rds)
195+
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#opensearch)
196+
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-neptune)
197+
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#dynamodb)
198+
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-timestream)
199+
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-emr)
200+
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-cloudwatch-logs)
201+
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-chime)
202+
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#amazon-quicksight)
203+
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-sts)
204+
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#aws-secrets-manager)
205+
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/api.html#global-configurations)
206206
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt)
207207
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md)
208208

VERSION

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
3.0.0b3
1+
3.0.0rc1

awswrangler/__metadata__.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -7,5 +7,5 @@
77

88
__title__: str = "awswrangler"
99
__description__: str = "Pandas on AWS."
10-
__version__: str = "3.0.0b3"
10+
__version__: str = "3.0.0rc1"
1111
__license__: str = "Apache License 2.0"

awswrangler/athena/_read.py

+8-8
Original file line numberDiff line numberDiff line change
@@ -689,11 +689,11 @@ def read_sql_query(
689689
690690
**Related tutorial:**
691691
692-
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
692+
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
693693
tutorials/006%20-%20Amazon%20Athena.html>`_
694-
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
694+
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
695695
tutorials/019%20-%20Athena%20Cache.html>`_
696-
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
696+
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
697697
tutorials/021%20-%20Global%20Configurations.html>`_
698698
699699
**There are three approaches available through ctas_approach and unload_approach parameters:**
@@ -757,7 +757,7 @@ def read_sql_query(
757757
/athena.html#Athena.Client.get_query_execution>`_ .
758758
759759
For a practical example check out the
760-
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
760+
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
761761
tutorials/024%20-%20Athena%20Query%20Metadata.html>`_!
762762
763763
@@ -1002,11 +1002,11 @@ def read_sql_table(
10021002
10031003
**Related tutorial:**
10041004
1005-
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
1005+
- `Amazon Athena <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
10061006
tutorials/006%20-%20Amazon%20Athena.html>`_
1007-
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
1007+
- `Athena Cache <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
10081008
tutorials/019%20-%20Athena%20Cache.html>`_
1009-
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
1009+
- `Global Configurations <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
10101010
tutorials/021%20-%20Global%20Configurations.html>`_
10111011
10121012
**There are two approaches to be defined through ctas_approach parameter:**
@@ -1051,7 +1051,7 @@ def read_sql_table(
10511051
/athena.html#Athena.Client.get_query_execution>`_ .
10521052
10531053
For a practical example check out the
1054-
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/
1054+
`related tutorial <https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/
10551055
tutorials/024%20-%20Athena%20Query%20Metadata.html>`_!
10561056
10571057

awswrangler/s3/_read_parquet.py

+2-2
Original file line numberDiff line numberDiff line change
@@ -410,7 +410,7 @@ def read_parquet(
410410
must return a bool, True to read the partition or False to ignore it.
411411
Ignored if `dataset=False`.
412412
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
413-
https://aws-data-wrangler.readthedocs.io/en/3.0.0b3/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
413+
https://aws-data-wrangler.readthedocs.io/en/3.0.0rc1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
414414
columns : List[str], optional
415415
List of columns to read from the file(s).
416416
validate_schema : bool, default False
@@ -622,7 +622,7 @@ def read_parquet_table(
622622
must return a bool, True to read the partition or False to ignore it.
623623
Ignored if `dataset=False`.
624624
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
625-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
625+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
626626
columns : List[str], optional
627627
List of columns to read from the file(s).
628628
validate_schema : bool, default False

awswrangler/s3/_read_text.py

+3-3
Original file line numberDiff line numberDiff line change
@@ -225,7 +225,7 @@ def read_csv(
225225
This function MUST return a bool, True to read the partition or False to ignore it.
226226
Ignored if `dataset=False`.
227227
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
228-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
228+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
229229
parallelism : int, optional
230230
The requested parallelism of the read. Only used when `distributed` add-on is installed.
231231
Parallelism may be limited by the number of files of the dataset. 200 by default.
@@ -378,7 +378,7 @@ def read_fwf(
378378
This function MUST return a bool, True to read the partition or False to ignore it.
379379
Ignored if `dataset=False`.
380380
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
381-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
381+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
382382
parallelism : int, optional
383383
The requested parallelism of the read. Only used when `distributed` add-on is installed.
384384
Parallelism may be limited by the number of files of the dataset. 200 by default.
@@ -535,7 +535,7 @@ def read_json(
535535
This function MUST return a bool, True to read the partition or False to ignore it.
536536
Ignored if `dataset=False`.
537537
E.g ``lambda x: True if x["year"] == "2020" and x["month"] == "1" else False``
538-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
538+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/023%20-%20Flexible%20Partitions%20Filter.html
539539
parallelism : int, optional
540540
The requested parallelism of the read. Only used when `distributed` add-on is installed.
541541
Parallelism may be limited by the number of files of the dataset. 200 by default.

awswrangler/s3/_write_parquet.py

+3-3
Original file line numberDiff line numberDiff line change
@@ -304,18 +304,18 @@ def to_parquet( # pylint: disable=too-many-arguments,too-many-locals,too-many-b
304304
concurrent_partitioning: bool
305305
If True will increase the parallelism level during the partitions writing. It will decrease the
306306
writing time and increase the memory usage.
307-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/022%20-%20Writing%20Partitions%20Concurrently.html
307+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/022%20-%20Writing%20Partitions%20Concurrently.html
308308
mode: str, optional
309309
``append`` (Default), ``overwrite``, ``overwrite_partitions``. Only takes effect if dataset=True.
310310
For details check the related tutorial:
311-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/004%20-%20Parquet%20Datasets.html
311+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/004%20-%20Parquet%20Datasets.html
312312
catalog_versioning : bool
313313
If True and `mode="overwrite"`, creates an archived version of the table catalog before updating it.
314314
schema_evolution : bool
315315
If True allows schema evolution (new or missing columns), otherwise a exception will be raised. True by default.
316316
(Only considered if dataset=True and mode in ("append", "overwrite_partitions"))
317317
Related tutorial:
318-
https://aws-sdk-pandas.readthedocs.io/en/3.0.0b3/tutorials/014%20-%20Schema%20Evolution.html
318+
https://aws-sdk-pandas.readthedocs.io/en/3.0.0rc1/tutorials/014%20-%20Schema%20Evolution.html
319319
database : str, optional
320320
Glue/Athena catalog: Database name.
321321
table : str, optional

0 commit comments

Comments
 (0)