Skip to content

Customise the dag params when making CARs #72

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
olizilla opened this issue Jul 13, 2021 · 3 comments
Closed

Customise the dag params when making CARs #72

olizilla opened this issue Jul 13, 2021 · 3 comments

Comments

@olizilla
Copy link
Contributor

Logging this as it's a discussion that we didn't resolve yet... we have the option of using non-default options for creating the DAG when the client creates the CAR on put. e.g Using a larger fixed chunk size e.g 2MB would reduce the total number of CIDs we'd have to announce.

The list of options we can tweak in the js-unix-fs importer are defined here https://github.com/ipfs/js-ipfs-unixfs/tree/master/packages/ipfs-unixfs-importer#api

We'd need update ipfs-car.pack to accept overrides here https://github.com/web3-storage/ipfs-car/blob/9bf13783b25d92c093ebcc076cb7c47810c58f12/src/pack/index.ts#L20-L26

@vasco-santos
Copy link
Contributor

I added support for this in ipfs-car storacha/ipfs-car#61

@olizilla
Copy link
Contributor Author

Max safe chunk size is 1MiB ipfs-rust/ipfs-embed#72 (comment)

@alanshaw
Copy link
Member

I think I duplicated this in #173. Read that issue for information on what we did.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants