Skip to content

Commit

Permalink
fix(datasets): Drop pyarrow constraint when using snowpark (#538)
Browse files Browse the repository at this point in the history
* Free pyarrow req

Signed-off-by: Felipe Monroy <[email protected]>

* Free pyarrow req

Signed-off-by: Felipe Monroy <[email protected]>

---------

Signed-off-by: Felipe Monroy <[email protected]>
Co-authored-by: Nok Lam Chan <[email protected]>
  • Loading branch information
felipemonroy and noklam authored Feb 8, 2024
1 parent 09409e3 commit 004888c
Showing 1 changed file with 1 addition and 4 deletions.
5 changes: 1 addition & 4 deletions kedro-datasets/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -87,10 +87,7 @@ def _collect_requirements(requires):
}
redis_require = {"redis.PickleDataset": ["redis~=4.1"]}
snowflake_require = {
"snowflake.SnowparkTableDataset": [
"snowflake-snowpark-python~=1.0",
"pyarrow~=8.0",
]
"snowflake.SnowparkTableDataset": ["snowflake-snowpark-python~=1.0"]
}
spark_require = {
"spark.SparkDataset": [SPARK, HDFS, S3FS],
Expand Down

0 comments on commit 004888c

Please sign in to comment.