Skip to content

Releases: apache/opendal

v0.51.0 - 本当の僕らをありがとう

23 Dec 16:56
@Zheaoli Zheaoli
v0.51.0
7f0c9a1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.51.0 - 本当の僕らをありがとう Latest
Latest

Upgrade

Rust Core Public API

New VISION: One Layer, All Storage

OpenDAL has refined its vision to One Layer, All Storage, driven by the following core principles: Open Community, Solid Foundation, Fast Access, Object Storage First, and Extensible Architecture.

Explore the detailed vision at OpenDAL Vision.

RFC-5313: Remove Metakey

OpenDAL v0.51 implements RFC-5313, which removes the concept of metakey.

The following structs have been removed:

  • Metakey

The following APIs have been removed:

  • list_with(path).metakey()

Users no longer need to pass the metakey into the list. Instead, services will make their best effort to return as much metadata as possible. Users can check items like Capability::list_has_etag before making a call.

Remove not used capability: write_multi_align_size

The capability write_multi_align_size is not utilized by any services, and we have no plans to support it in the future; therefore, we have removed it.

CapabilityCheckLayer and CorrectnessCheckLayer

OpenDAL used to perform capability checks for all services, but since v0.51, it only conducts checks that impact data correctness like write_with_if_not_exists or delete_with_version by default in the CorrectnessCheckLayer. If users wish to verify other non-critical capabilities like write_with_content_type or write_with_cache_control, they should manually enable the CapabilityCheckLayer.

RFC-3911: Deleter API

OpenDAL v0.51 implements RFC-3911, which adds Deleter in OpenDAL to replace batch operation.

The following new APIs have been added:

  • [Operator::delete_iter]
  • [Operator::delete_try_iter]
  • [Operator::delete_stream]
  • [Operator::delete_try_stream]
  • [Operator::deleter]
  • [Deleter::delete]
  • [Deleter::delete_iter]
  • [Deleter::delete_try_iter]
  • [Deleter::delete_stream]
  • [Deleter::delete_try_stream]
  • [Deleter::flush]
  • [Deleter::close]
  • [Deleter::into_sink]
  • [DeleteInput]
  • [IntoDeleteInput]
  • [FuturesDeleteSink]

The following APIs have been deprecated and will be removed in the future releases:

  • Operator::remove (replace with [Operator::delete_iter])
  • Operator::remove_via (replace with [Operator::delete_stream])

As a result of this change, the limit and with_limit APIs on Operator have also been deprecated; they are currently no-ops.

Rust Core Raw API

adapter::kv now returns Scanner instead of Vec<String>

To support returning key-value entries in a streaming manner instead of loading them all into memory, OpenDAL updated its adapter API to return a Scanner instead of a Vec<String>.

- async fn scan(&self, path: &str) -> Result<Vec<String>>
+ async fn scan(&self, path: &str) -> Result<Self::Scanner>

All services intending to implement kv::Adapter should adhere to this API change.

Align metadata API to info

OpenDAL changes it's old metadata API to info to align with the new AccessorInfo struct.

- fn metadata(&self) -> Arc<AccessorInfo>
+ fn info(&self) -> Arc<AccessorInfo>

Remove not used struct: RangeWriter

The struct RangeWriter is not utilized by any services, and we have no plans to support it in the future; therefore, we have removed it.

What's Changed

Added

  • feat(adapter/kv): support async iterating on scan results by @PragmaTwice in #5208
  • feat(bindings/ruby): Add simple operators to Ruby binding by @erickguan in #5246
  • feat(core/services-gcs): support user defined metadata by @jorgehermo9 in #5276
  • feat(core): add if_not_exist in OpWrite by @kemingy in #5305
  • feat: Add {stat,list}has* to carry the metadata that backend returns by @Xuanwo in #5318
  • feat(core): Implement write if not exists for azblob,azdls,gcs,oss,cos by @Xuanwo in #5321
  • feat(core): add new cap shared by @TennyZhuang in #5328
  • feat(bindings/python): support pickle [de]serialization for Operator by @TennyZhuang in #5324
  • feat(bindings/cpp): init the async support of C++ binding by @PragmaTwice in #5195
  • feat(bindings/go): support darwin by @yuchanns in #5334
  • feat(services/gdrive): List shows modified timestamp gdrive by @erickguan in #5226
  • feat(service/s3): support delete with version by @Frank-III in #5349
  • feat: upgrade pyo3 to 0.23 by @XmchxUp in #5368
  • feat: publish python3.13t free-threaded wheel by @XmchxUp in #5387
  • feat: add progress bar for oli cp command by @waynexia in #5369
  • feat(types/buffer): skip copying in to_bytes when NonContiguous contains a single Bytes by @ever0de in #5388
  • feat(bin/oli): support command mv by @meteorgan in #5370
  • feat(core): add if-match to OpWrite by @Frank-III in #5360
  • feat(core/layers): add correctness_check and capability_check layer to verify whether the operation and arguments is supported by @meteorgan in #5352
  • feat(bindings/ruby): Add I/O class for Ruby by @erickguan in #5354
  • feat(core): Add content_encoding to MetaData by @Frank-III in #5400
  • feat:(core): add content encoding to Opwrite by @Frank-III in #5390
  • feat(services/obs): support user defined metadata by @Frank-III in #5405
  • feat: impl configurable OperatorOutputStream maxBytes by @tisonkun in #5422

Changed

  • refactor (bindings/zig): Improvements by @kassane in #5247
  • refactor: Remove metakey concept by @Xuanwo in #5319
  • refactor(core)!: Remove not used cap write_multi_align_size by @Xuanwo in #5322
  • refactor(core)!: Remove the range writer that has never been used by @Xuanwo in #5323
  • refactor(core): MaybeSend does not need to be unsafe by @drmingdrmer in #5338
  • refactor: Implement RFC-3911 Deleter API by @Xuanwo in #5392
  • refactor: Remove batch concept from opendal by @Xuanwo in #5393

Fixed

  • fix(services/webdav): Fix lister failing when root contains spaces by @skrimix in #5298
  • fix(bindings/c): Bump min CMake version to support CMP0135 by @palash25 in #5308
  • fix(services/webhdfs): rename auth value by @notauserx in #5342
  • fix(bindings/cpp): remove the warning of CMP0135 by @PragmaTwice in #5346
  • build(python): fix pyproject meta file by @trim21 in #5348
  • fix(services/unftp): add / when not presented by @Frank-III in #5382
  • fix: update document against target format check and add hints by @waynexia in #5361
  • fix: oli clippy and CI file by @waynexia in #5389
  • fix(services/obs): support huawei.com by @FayeSpica in #5399
  • fix(integrations/cloud_filter): use explicit stat instead of Entry::metadata in fetch_placeholders by @ho-229 in #5416
  • fix(core): S3 multipart uploads does not set file metadata by @catcatmu in #5430
  • fix: always contains path label if configured by @waynexia in #5433

Docs

  • docs: Enable force_orphan to reduce clone size by @Xuanwo in #5289
  • docs: Establish VISION for "One Layer, All Storage" by @Xuanwo in #5309
  • docs: Polish docs for write with if not exists by @Xuanwo in #5320
  • docs(core): add the description of version parameter for operator by @meteorgan in #5144
  • docs(core): Add upgrade to v0.51 by @Xuanwo in #5406
  • docs: Update release.md by @tisonkun in #5431

CI

  • ci: Remove the token of codspeed by @Xuanwo in #5283
  • ci: Allow force push for gh-pages by @Xuanwo in #5290
  • build(bindings/java): fix lombok process by @tisonkun in #5297
  • build(bindings/python): add python 3.10 back and remove pypy by @trim21 in #5347

Chore

  • chore(core/layers): align info method of trait Access and trait LayeredAccess by @koushiro in #525...
Read more

Contributors

drmingdrmer, erickguan, and 23 other contributors
Assets 2
Loading
0 Join discussion

v0.50.2

07 Nov 06:00
@Zheaoli Zheaoli
v0.50.2
4c1d566
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.50.2

Release List

Name Version Next
core 0.50.1 0.50.2
integrations/cloud_filter 0.0.2 0.0.3
integrations/compat 1.0.0 1.0.1
integrations/dav-server 0.2.1 0.2.2
integrations/fuse3 0.0.8 0.0.9
integrations/object_store 0.48.1 0.48.2
integrations/parquet 0.2.1 0.2.2
integrations/spring - -
integrations/unftp-sbe 0.0.8 0.0.9
integrations/virtiofs - -
bin/oay 0.41.12 0.41.13
bin/ofs 0.0.13 0.0.14
bin/oli 0.41.12 0.41.13
bindings/c 0.45.0 0.45.1
bindings/cpp 0.45.12 0.45.13
bindings/dotnet 0.1.10 0.1.11
bindings/go 0.1.4 0.1.5
bindings/haskell 0.44.12 0.44.13
bindings/java 0.47.4 0.47.5
bindings/lua 0.1.10 0.1.11
bindings/nodejs 0.47.6 0.47.7
bindings/ocaml - -
bindings/php 0.1.10 0.1.11
bindings/python 0.45.11 0.45.12
bindings/ruby 0.1.10 0.1.11
bindings/swift - -
bindings/zig - -

What's Changed

Added

Changed

  • refactor(bin/oli): use clap_derive to reduce boilerplate code by @koushiro in #5233

Fixed

  • fix: add all-features flag for opendal_compat doc build by @XmchxUp in #5234
  • fix(integrations/compat): Capability has different fields by @Xuanwo in #5236
  • fix(integration/compat): Fix opendal 0.50 OpList has new field by @Xuanwo in #5238
  • fix(integrations/compat): Fix dead loop happened during list by @Xuanwo in #5240

Docs

CI

  • ci(asf): Don't add [DISCUSS] prefix for discussion by @Xuanwo in #5210
  • build: enable services-mysql for Java and Python bindings by @tisonkun in #5222
  • build(binding/python): Support Python 3.13 by @Zheaoli in #5248

Chore

New Contributors

Full Changelog: v0.50.1...v0.50.2

Contributors

erickguan, Xuanwo, and 10 other contributors
Assets 2
Loading

v0.50.1

23 Oct 03:11
@Xuanwo Xuanwo
v0.50.1
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
e4d8d40
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.50.1

Upgrade

Bindings C upgrade to v0.45

Change to use Cmake to build the C binding.

Release List

Name Version Next
core 0.50.0 0.50.1
integrations/cloud_filter 0.0.1 0.0.2
integrations/compat - 1.0.0
integrations/dav-server 0.2.0 0.2.1
integrations/fuse3 0.0.7 0.0.8
integrations/object_store 0.48.0 0.48.1
integrations/parquet 0.2.0 0.2.1
integrations/spring - -
integrations/unftp-sbe 0.0.7 0.0.8
integrations/virtiofs - -
bin/oay 0.41.11 0.41.12
bin/ofs 0.0.12 0.0.13
bin/oli 0.41.11 0.41.12
bindings/c 0.44.13 0.45.0
bindings/cpp 0.45.11 0.45.12
bindings/dotnet 0.1.9 0.1.10
bindings/go 0.1.3 0.1.4
bindings/haskell 0.44.11 0.44.12
bindings/java 0.47.3 0.47.4
bindings/lua 0.1.9 0.1.10
bindings/nodejs 0.47.5 0.47.6
bindings/ocaml - -
bindings/php 0.1.9 0.1.10
bindings/python 0.45.10 0.45.11
bindings/ruby 0.1.9 0.1.10
bindings/swift - -
bindings/zig - -

What's Changed

Added

  • feat(core/redis): Replace client requests with connection pool by @jackyyyyyssss in #5117
  • feat: add copy api for lakefs service. by @liugddx in #5114
  • feat(core): add version(bool) for List operation to include version d… by @meteorgan in #5106
  • feat(bindings/python): export ConcurrentLimitLayer by @TennyZhuang in #5140
  • feat(bindings/c): add writer operation for Bindings C and Go by @yuchanns in #5141
  • feat(ofs): introduce ofs macos support by @oowl in #5136
  • feat: Reduce stat operation if we are reading all by @Xuanwo in #5146
  • feat: add NebulaGraph config by @GG2002 in #5147
  • feat(integrations/spring): add spring serialize method by @shoothzj in #5154
  • feat: support write,read,delete with template by @shoothzj in #5156
  • feat(bindings/java): support ConcurrentLimitLayer by @tisonkun in #5168
  • feat: Add if_none_match for write by @ForestLH in #5129
  • feat: Add OpenDAL Compat by @Xuanwo in #5185
  • feat(core): abstract HttpFetch trait for raw http client by @everpcpc in #5184
  • feat: Support NebulaGraph by @GG2002 in #5116
  • feat(bindings/cpp): rename is_exist to exists as core did by @PragmaTwice in #5198
  • feat(bindings/c): add opendal_operator_exists and mark is_exist deprecated by @PragmaTwice in #5199
  • feat(binding/java): prefix thread name with opendal-tokio-worker by @tisonkun in #5197

Changed

  • refactor(services/cloudflare-kv): remove unneeded async and result on parse_error by @tsfotis in #5128
  • refactor(*): remove unneeded async and result on parse_error by @tsfotis in #5131
  • refactor: align C binding pattern by @tisonkun in #5160
  • refactor: more consistent C binding pattern by @tisonkun in #5162
  • refactor(integration/parquet): Use ParquetMetaDataReader instead by @Xuanwo in #5170
  • refactor: resolve c pointers const by @tisonkun in #5171
  • refactor(types/operator): rename is_exist to exists by @photino in #5193

Fixed

  • fix(services/huggingface): Align with latest HuggingFace API by @morristai in #5123
  • fix(bindings/c): use ManuallyDrop instead of forget to make sure pointer is valid by @ethe in #5166
  • fix(services/s3): Mark xml deserialize error as temporary during list by @Xuanwo in #5178

Docs

CI

Chore

New Contributors

Full Changelog: v0.50.0...v0.50.1

Contributors

davide125, meteorgan, and 19 other contributors
Assets 2
Loading

v0.50.0

18 Sep 09:05
@Xuanwo Xuanwo
v0.50.0
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
4d060f2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.50.0

Release List

Name Version Next
core 0.49.2 0.50.0
integrations/dav-server 0.1.0 0.1.1
integrations/fuse3 0.0.6 0.0.7
integrations/object_store 0.47.0 0.47.1
integrations/parquet 0.1.2 0.2.0
integrations/unftp-sbe 0.0.6 0.0.7
bin/oay 0.41.10 0.41.11
bin/ofs 0.0.11 0.0.12
bin/oli 0.41.10 0.41.11
bindings/c 0.44.12 0.44.13
bindings/cpp 0.45.10 0.45.11
bindings/dotnet 0.1.8 0.1.9
bindings/go 0.1.2 0.1.3
bindings/haskell 0.44.10 0.44.11
bindings/java 0.47.2 0.47.3
bindings/lua 0.1.8 0.1.9
bindings/nodejs 0.47.4 0.47.5
bindings/php 0.1.8 0.1.9
bindings/python 0.45.9 0.45.10
bindings/ruby 0.1.8 0.1.9

Upgrade to OpenDAL Core v0.50

Public API

services-postgresql's connect string now supports only URL format

Previously, it supports both URL format and key-value format. After switching the implementation from tokio-postgres to sqlx, the service now supports only the URL format.

list now returns path itself

Previously, list("a/b") would not return a/b even if it does exist. Since v0.50.0, this behavior has been changed. OpenDAL will now return the path itself if it exists. This change applies to all cases, whether the path is a directory or a file.

Refactoring of the metrics-related layer

In OpenDAL v0.50.0, we did a refactor on all metrics-related layers. They are now sharing the same underlying implemenationts. PrometheusLayer, PrometheusClientLayer and MetricsLayer are now have similar public APIs and exactly the same metrics value.

What's Changed

Added

Changed

  • refactor: use sqlx for sql services by @tisonkun in #5040
  • refactor(core)!: Add observe layer as building block by @Xuanwo in #5064
  • refactor(layers/prometheus): rewrite prometheus layer based on observe mod by @koushiro in #5069
  • refactor(bindings/java): replace num_cpus with std::thread::available_parallelism by @miroim in #5080
  • refactor(layers/prometheus): provide builder APIs by @koushiro in #5072
  • refactor(layers/prometheus-client): provide builder APIs by @koushiro in #5073
  • refactor(layers/metrics): rewrite metrics layer using observe layer by @koushiro in #5098

Fixed

  • fix(core): TimeoutLayer now needs enable tokio time by @Xuanwo in #5057
  • fix(core): Fix failed list related tests by @Xuanwo in #5058
  • fix(services/memory): blocking_scan right range by @meteorgan in #5062
  • fix(core/services/mysql): Fix mysql Capability by @jackyyyyyssss in #5067
  • fix: fix rust 1.76 error due to temporary value being dropped by @aawsome in #5071
  • fix(service/fs): error due to temporary value being dropped by @miroim in #5079
  • fix(core/services/hdfs): Fix the HDFS write failure when atomic_write_dir is set by @meteorgan in #5039
  • fix(services/icloud): adjust error handling code to avoid having to write out result type explicitly by @koushiro in #5091
  • fix(services/monoiofs): handle async cancel during file open by @NKID00 in #5094

Docs

CI

  • ci(bindings/go): add golangci-lint by @yuchanns in #5060
  • ci(bindings/zig): Fix build and test of zig on 0.13 by @Xuanwo in #5102
  • ci: Don't publish with all features by @Xuanwo in #5108
  • ci: Fix upload-artifacts doesn't include hidden files by @Xuanwo in #5112

Chore

  • chore(bindings/go): bump ffi and sys version by @shoothzj in #5055
  • chore: Bump backon to 1.0.0 by @Xuanwo in #5056
  • chore(services/rocksdb): fix misuse rocksdb prefix iterator by @meteorgan in #5059
  • chore(README): add Go binding badge by @yuchanns in #5074
  • chore(deps): bump crate-ci/typos from 1.23.6 to 1.24.3 by @dependabot in #5085
  • chore(layers/prometheus-client): export PrometheusClientLayerBuilder type by @koushiro in #5093
  • chore(layers): check the examples when running tests by @koushiro in #5104
  • chore(integrations/parquet): Bump parquet to 53 by @Xuanwo in #5109
  • chore: Bump OpenDAL to 0.50.0 by @Xuanwo in #5110

New Contributors

Full Changelog: v0.49.2...v0.50.0

Contributors

meteorgan, Xuanwo, and 10 other contributors
Assets 2
Loading
0 Join discussion

v0.49.2

29 Aug 07:40
@Xuanwo Xuanwo
v0.49.2
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
9c20590
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.49.2

Release List

Name Version
core 0.49.2
integrations/dav-server 0.1.0
integrations/fuse3 0.0.6
integrations/object_store 0.47.0
integrations/parquet 0.1.2
integrations/unftp-sbe 0.0.6
bin/oay 0.41.10
bin/ofs 0.0.11
bin/oli 0.41.10
bindings/c 0.44.12
bindings/cpp 0.45.10
bindings/dotnet 0.1.8
bindings/go 0.1.2
bindings/haskell 0.44.10
bindings/java 0.47.2
bindings/lua 0.1.8
bindings/nodejs 0.47.4
bindings/php 0.1.8
bindings/python 0.45.9
bindings/ruby 0.1.8

What's Changed

Added

  • feat(ovfs): support read and write by @zjregee in #5016
  • feat(bin/ofs): introduce integrations/cloudfilter for ofs by @ho-229 in #4935
  • feat(integrations/spring): add AutoConfiguration class for Spring Mvc and Webflux by @shoothzj in #5019
  • feat(services/monoiofs): impl read and write, add behavior test by @NKID00 in #4944
  • feat(core/services-s3): support user defined metadata by @haoqixu in #5030
  • feat: align fn root semantics; fix missing root for some services; rm duplicated normalize ops by @yjhmelody in #5035
  • feat(core): expose configs always by @tisonkun in #5034
  • feat(services/monoiofs): append, create_dir, copy and rename by @NKID00 in #5041

Changed

  • refactor(core): new type to print context and reduce allocations by @evenyag in #5021
  • refactor(layers/prometheus-client): remove useless scheme field from PrometheusAccessor and PrometheusMetricWrapper type by @koushiro in #5026
  • refactor(layers/prometheus-client): avoid multiple clone of labels by @koushiro in #5028
  • refactor(core/services-oss): remove the starts_with by @haoqixu in #5036

Fixed

  • fix(layers/prometheus-client): remove duplicated increment_request_total of write operation by @koushiro in #5023
  • fix(services/monoiofs): drop JoinHandle in worker thread by @NKID00 in #5031

CI

  • ci: Add contents write permission for build-website by @Xuanwo in #5017
  • ci: Fix test for service ghac by @Xuanwo in #5018
  • ci(integrations/spring): add spring boot bean load test by @shoothzj in #5032

Chore

New Contributors

Full Changelog: v0.49.1...v0.49.2

Contributors

Xuanwo, evenyag, and 9 other contributors
Assets 2
Loading
0 Join discussion

v0.49.1

20 Aug 07:19
@Xuanwo Xuanwo
v0.49.1
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
468fca7
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.49.1

Release List

Name Next
core 0.49.1
integrations/dav-server 0.0.8
integrations/fuse3 0.0.5
integrations/object_store 0.46.1
integrations/parquet 0.1.1
integrations/unftp-sbe 0.0.5
bin/oay 0.41.9
bin/ofs 0.0.10
bin/oli 0.41.9
bindings/c 0.44.11
bindings/cpp 0.45.9
bindings/dotnet 0.1.7
bindings/go 0.1.1
bindings/haskell 0.44.9
bindings/java 0.47.1
bindings/lua 0.1.7
bindings/nodejs 0.47.3
bindings/php 0.1.7
bindings/python 0.45.8
bindings/ruby 0.1.7

What's Changed

Added

  • feat(ovfs): add lookup and unit tests by @zjregee in #4997
  • feat(gcs): allow setting a token directly by @jdockerty in #4978
  • feat(integrations/cloudfilter): introduce behavior tests by @ho-229 in #4973
  • feat(integrations/spring): add spring project module by @shoothzj in #4988
  • feat(fs): expose the metadata for fs services by @Aitozi in #5005
  • feat(ovfs): add file creation and deletion by @zjregee in #5009

Fixed

  • fix(integrations/spring): correct parent artifactId by @shoothzj in #5007
  • fix(bindings/python): Make sure read until EOF by @Bicheka in #4995

Docs

  • docs: Fix version detect in website by @Xuanwo in #5003
  • docs: add branding, license and trademarks to integrations by @PsiACE in #5006
  • docs(integrations/cloudfilter): improve docs and examples by @ho-229 in #5010

CI

  • ci(bindings/python): Fix aws-lc-rs build on arm platforms by @Xuanwo in #5004

Chore

New Contributors

Full Changelog: v0.49.0...v0.49.1

Contributors

Xuanwo, Aitozi, and 7 other contributors
Assets 2
Loading
0 Join discussion

v0.49.0

13 Aug 09:51
@Xuanwo Xuanwo
v0.49.0
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
42c41ea
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.49.0

Release List

Name Next
core 0.49.0
integrations/dav-server 0.0.7
integrations/fuse3 0.0.4
integrations/object_store 0.46.0
integrations/parquet 0.1.0
integrations/unftp-sbe 0.0.4
bin/oay 0.41.8
bin/ofs 0.0.9
bin/oli 0.41.8
bindings/c 0.44.10
bindings/cpp 0.45.8
bindings/dotnet 0.1.6
bindings/go 0.1.0
bindings/haskell 0.44.8
bindings/java 0.47.0
bindings/lua 0.1.6
bindings/nodejs 0.47.2
bindings/php 0.1.6
bindings/python (*) 0.45.8
bindings/ruby 0.1.6
  • (*): We expected to release Python 0.45.8, but due to #5000, we were unable to. We will release it next time.

OpenDAL Core Upgrade to v0.49

Public API

Configurator now returns associated builder instead

Configurator used to return impl Builder, but now it returns associated builder type directly. This will allow users to use the builder in a more flexible way.

impl Configurator for MemoryConfig {
-    fn into_builder(self) -> impl Builder {
+    type Builder = MemoryBuilder;
+    fn into_builder(self) -> Self::Builder {
        MemoryBuilder { config: self }
    }
}

LoggingLayer now accepts LoggingInterceptor

LoggingLayer now accepts LoggingInterceptor trait instead of configuration. This change will allow users to customize the logging behavior more flexibly.

pub trait LoggingInterceptor: Debug + Clone + Send + Sync + Unpin + 'static {
    fn log(
        &self,
        info: &AccessorInfo,
        operation: Operation,
        context: &[(&str, &str)],
        message: &str,
        err: Option<&Error>,
    );
}

Users can now implement the log in the way they want.

OpenDAL Java Binding Upgrade to v0.47

Breaking change

artifactId of the opendal-java has changed from to opendal to align with the convention of entire OpenDAL project.

<dependencies>
<dependency>
  <groupId>org.apache.opendal</groupId>
-  <artifactId>opendal-java</artifactId>
+  <artifactId>opendal</artifactId>
  <version>${opendal.version}</version>
</dependency>
<dependency>
  <groupId>org.apache.opendal</groupId>
-  <artifactId>opendal-java</artifactId>
+  <artifactId>opendal</artifactId>
  <version>${opendal.version}</version>
  <classifier>${os.detected.classifier}</classifier>
</dependency>
</dependencies>

What's Changed

Added

  • feat(o): Add cargo-o layout by @Xuanwo in #4934
  • feat: impl put_multipart in object_store by @Rachelint in #4793
  • feat: introduce opendal AsyncWriter for parquet integrations by @WenyXu in #4958
  • feat(services/http): implement presigned request for backends without authorization by @NickCao in #4970
  • feat(bindings/python): strip the library for minimum file size by @NickCao in #4971
  • feat(gcs): allow unauthenticated requests by @jdockerty in #4965
  • feat: introduce opendal AsyncReader for parquet integrations by @WenyXu in #4972
  • feat(services/s3): add role_session_name in assume roles by @nerdroychan in #4981
  • feat: support root path for moka and mini-moka by @meteorgan in #4984
  • feat(ovfs): export VirtioFs struct by @zjregee in #4983
  • feat(core)!: implement an interceptor for the logging layer by @evenyag in #4961
  • feat(ovfs): support getattr and setattr by @zjregee in #4987

Changed

  • refactor(java)!: Rename artifacts id opendal-java to opendal by @Xuanwo in #4957
  • refactor(core)!: Return associated builder instead by @Xuanwo in #4968
  • refactor(raw): Merge all operations into one enum by @Xuanwo in #4977
  • refactor(core): Use kv based context to avoid allocations by @Xuanwo in #4986

Fixed

Docs

  • docs: nominate-committer add announcement template by @tisonkun in #4954

CI

Chore

New Contributors

Full Changelog: v0.48.0...v0.49.0

Contributors

meteorgan, Xuanwo, and 13 other contributors
Assets 2
Loading
0 Join discussion

v0.48.0

29 Jul 12:35
@Xuanwo Xuanwo
v0.48.0
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
aee7446
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.48.0

Release List

Name Version
core 0.48.0
integrations/cloudfilter 0.0.0
integrations/dav-server 0.0.6
integrations/fuse3 0.0.3
integrations/object_store 0.45.0
integrations/unftp-sbe 0.0.3
bin/oay 0.41.7
bin/ofs 0.0.8
bin/oli 0.41.7
bindings/c 0.44.9
bindings/cpp 0.45.7
bindings/dotnet 0.1.5
bindings/haskell 0.44.7
bindings/java 0.46.4
bindings/lua 0.1.5
bindings/nodejs 0.47.1
bindings/php 0.1.5
bindings/python 0.45.7
bindings/ruby 0.1.5

OpenDAL Core Upgrade to v0.48

Public API

Typo in customized_credential_load

Since v0.48, the customed_credential_load function has been renamed to customized_credential_load to fix the typo of customized.

- builder.customed_credential_load(v);
+ builder.customized_credential_load(v);

S3 service rename security_token to session_token

In 2014 Amazon switched from AWS_SECURITY_TOKEN to AWS_SESSION_TOKEN. To be consistent with the naming of AWS STS, we have renamed the security_token field to session_token in the S3 service.

- builder.security_token(v);
+ builder.session_token(v);

Operator from_iter and via_iter replaces from_map and via_map

Since v0.48, Operator's new APIs from_iter and via_iter methods have deprecated the from_map and via_map methods.

- Operator::from_map::<Fs>(map)?.finish();
+ Operator::from_iter::<Fs>(map)?.finish();

New API from_iter and via_iter should cover all use cases of from_map and via_map.

Service builder now takes ownership

Since v0.48, all service builder now takes ownership self instead of &mut self. This change will allow users to configure the service in a more flexible way.

- let mut builder = S3::default();
- builder.bucket("test");
- builder.root("/path/to/root");
+ let builder = S3::default().bucket("test").root("/path/to/root");
  let op = Operator::new(builder)?.finish();

Raw API

oio::Write::write will write the whole buffer

Starting from version 0.48, oio::Write::write now writes the entire buffer. This update aligns the API more closely with oio::Read::read and simplifies the implementation of concurrent writing.

  trait Write {
-     fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<usize>>;
+     fn write(&mut self, bs: Buffer) -> impl Future<Output = Result<()>>;
  }

write will now return Result<()> instead of Result<usize>. The number of bytes written can be obtained from the buffer's length.

Access::metadata() will return Arc<AccessInfo>

Starting from version 0.48, Access::metadata() will return Arc<AccessInfo> instead of AccessInfo. This change is intended to improve performance and reduce memory usage.

  trait Access {
-     fn metadata(&self) -> AccessInfo;
+     fn metadata(&self) -> Arc<AccessInfo>;
  }

MinitraceLayer renamed to FastraceLayer

The MinitraceLayer has been renamed to FastraceLayer to respond to the transition from minitrace to fastrace.

- use opendal::layers::MinitraceLayer;
+ use opendal::layers::FastraceLayer;

Use Configurator to replace Builder::from_config

Since v0.48, the Builder::from_config and Builder::from_map method has been replaced by the Configurator trait. The Configurator trait provides a more flexible and extensible way to configure OpenDAL.

Service implementers should update their code to use the Configurator trait instead:

impl Configurator for MemoryConfig {
    fn into_builder(self) -> impl Builder {
        MemoryBuilder { config: self }
    }
}

impl Builder for MemoryBuilder {
    const SCHEME: Scheme = Scheme::Memory;
    type Config = MemoryConfig;

    fn build(self) -> Result<impl Access> {
        ...
    }
}

What's Changed

Added

  • feat(services/fs): Support fs config by @meteorgan in #4853
  • feat(services): init monoiofs by @NKID00 in #4855
  • feat(core/types): avoid a copy in Buffer::to_bytes() by cloning contiguous bytes by @LDeakin in #4858
  • feat(core): Add object versioning for OSS by @Lzzzzzt in #4870
  • feat: fs add concurrent write by @hoslo in #4817
  • feat(services/s3): Add object versioning for S3 by @Lzzzzzt in #4873
  • feat(integrations/cloudfilter): read only cloud filter by @ho-229 in #4856
  • feat(bindings/go): Add full native support from C to Go. by @yuchanns in #4886
  • feat(bindings/go): add benchmark. by @yuchanns in #4893
  • feat(core): support user defined metadata for oss by @meteorgan in #4881
  • feat(service/fastrace): rename minitrace to fastrace by @andylokandy in #4906
  • feat(prometheus-client): add metric label about root on using PrometheusClientLayer by @flaneur2020 in #4907
  • feat(services/monoiofs): monoio wrapper by @NKID00 in #4885
  • feat(layers/mime-guess): add a layer that can automatically set Content-Type based on the extension in the path. by @czy-29 in #4912
  • feat(core)!: Make config data object by @tisonkun in #4915
  • feat(core)!: from_map is now fallible by @tisonkun in #4917
  • ci(bindings/go): always test against the latest core by @yuchanns in #4913
  • feat(!): Allow users to build operator from config by @Xuanwo in #4919
  • feat: Add from_iter and via_iter for operator by @Xuanwo in #4921

Changed

  • refactor(services/s3)!: renamed security_token to session_token by @Zyyeric in #4875
  • refactor(core)!: Make oio::Write always write all given buffer by @Xuanwo in #4880
  • refactor(core)!: Return Arc<AccessInfo> for metadata by @Lzzzzzt in #4883
  • refactor(core!): Make service builder takes ownership by @Xuanwo in #4922
  • refactor(integrations/cloudfilter): implement Filter instead of SyncFilter by @ho-229 in #4920

Fixed

  • fix(services/s3): NoSuchBucket is a ConfigInvalid for OpenDAL by @tisonkun in #4895
  • fix: oss will not use the port by @Lzzzzzt in #4899

Docs

CI

  • ci: Add issue template and pr template for opendal by @Xuanwo in #4884
  • ci: Remove CI reviewer since it doesn't work by @Xuanwo in #4891

Chore

New Contributors

Full Changelog: v0.47.3...v0.48.0

Contributors

flaneur2020, jbampton, and 13 other contributors
Assets 2
Loading
0 Join discussion

v0.47.3

07 Jul 01:29
@Xuanwo Xuanwo
v0.47.3
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
f9df0fa
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.47.3

Release List

Name Version Next
core 0.47.2 0.47.3
integrations/dav-server 0.0.4 0.0.5
integrations/fuse3 0.0.1 0.0.2
integrations/object_store 0.44.2 0.44.3
integrations/unftp-sbe 0.0.1 0.0.2
bin/oay 0.41.5 0.41.6
bin/ofs 0.0.6 0.0.7
bin/oli 0.41.5 0.41.6
bindings/c 0.44.7 0.44.8
bindings/cpp 0.45.5 0.45.6
bindings/dotnet 0.1.3 0.1.4
bindings/haskell 0.44.5 0.44.6
bindings/java 0.46.2 0.46.3
bindings/lua 0.1.3 0.1.4
bindings/nodejs 0.47.0 0.47.0
bindings/php 0.1.3 0.1.4
bindings/python 0.45.5 0.45.6
bindings/ruby 0.1.3 0.1.4

What's Changed

Changed

  • refactor: Move ChunkedWrite logic into WriteContext by @Xuanwo in #4826
  • refactor(services/aliyun-drive): directly implement oio::Write. by @yuchanns in #4821

Fixed

  • fix(integration/object_store): Avoid calling API inside debug by @Xuanwo in #4846
  • fix(integration/object_store): Fix metakey requested is incomplete by @Xuanwo in #4844

Docs

  • docs(integration/unftp-sbe): Polish docs for unftp-sbe by @Xuanwo in #4838
  • docs(bin): Polish README for all bin by @Xuanwo in #4839

Chore

Full Changelog: v0.47.2...v0.47.3

Contributors

Xuanwo, TennyZhuang, and 2 other contributors
Assets 2
Loading
0 Join discussion

v0.47.2

03 Jul 05:08
@Xuanwo Xuanwo
v0.47.2
This tag was signed with the committer’s verified signature.
Xuanwo Xuanwo
GPG key ID: E95B7C7CB352F6C1
Learn about vigilant mode.
a58e802
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
Compare
Choose a tag to compare
v0.47.2

Relelase List

Name Version Next
core 0.47.1 0.47.2
integrations/cloudfilter 0.0.0 0.0.0
integrations/dav-server 0.0.3 0.0.4
integrations/fuse3 0.0.0 0.0.1
integrations/object_store 0.44.1 0.44.2
integrations/unftp-sbe 0.0.0 0.0.1
integrations/virtiofs 0.0.0 0.0.0
bin/oay 0.41.4 0.41.5
bin/ofs 0.0.5 0.0.6
bin/oli 0.41.4 0.41.5
bindings/c 0.44.6 0.44.7
bindings/cpp 0.45.4 0.45.5
bindings/dotnet 0.1.2 0.1.3
bindings/go 0.0.0 0.0.0
bindings/haskell 0.44.4 0.44.5
bindings/java 0.46.1 0.46.2
bindings/lua 0.1.2 0.1.3
bindings/nodejs 0.46.2 0.47.0
bindings/ocaml 0.0.0 0.0.0
bindings/php 0.1.2 0.1.3
bindings/python 0.45.4 0.45.5
bindings/ruby 0.1.2 0.1.3
bindings/swift 0.0.0 0.0.0
bindings/zig 0.0.0 0.0.0
  • bindings/nodejs 0.47.0 release failed, we will get it fixed in next release.

Breaking changes

Binding Node.js Public API

Now, the append operation has been removed. You can use below code instead.

op.write("path/to/file", Buffer.from("hello world"), { append: true });

What's Changed

Added

Changed

  • refactor(nodejs)!: Remove append api by @bxb100 in #4796
  • refactor(core): Remove unused layer MadsimLayer by @zzzk1 in #4788

Fixed

  • fix(services/aliyun-drive): list dir without trailing slash by @yuchanns in #4766
  • fix(unftp-sbe): remove buffer for get by @George-Miao in #4775
  • fix(services/aliyun-drive): write op cannot overwrite existing files by @yuchanns in #4781
  • fix(core/services/onedrive): remove @odata.count for onedrive list op by @imWildCat in #4803
  • fix(core): Gcs's RangeWrite doesn't support concurrent write by @Xuanwo in #4806
  • fix(tests/behavior): skip test of write_with_overwrite for ghac by @yuchanns in #4823
  • fix(docs): some typos in website and nodejs binding docs by @suyanhanx in #4814
  • fix(core/aliyun_drive): Fix write_multi_max_size might overflow by @Xuanwo in #4830

Docs

CI

Chore

New Contributors

Full Changelog: v0.47.1...v0.47.2

Contributors

imWildCat, Xuanwo, and 10 other contributors
Assets 2
Loading
0 Join discussion