Sync files on one S3 bucket to another S3 bucket.
- AWS S3 CLI
- NodeJS 18+
Options can be provided either as command line options or environment variables.
% npx @eyevinn/s3-sync \
--source-access-key=<source-access-key> \
--source-secret-key=<source-secret-key> \
--source-region=<source-region> \
--dest-endpoint=<dest-endpoint> \
--dest-access-key=<dest-access-key> \
--dest-secret-key=<dest-secret-key> \
s3://source/files/ s3://dest/files/
Using environment variables stored in a file called .env in this example:
SOURCE_ACCESS_KEY=<source-access-key>
SOURCE_SECRET_KEY=<source-secret-key>
SOURCE_REGION=<source-region>
DEST_ENDPOINT=<dest-endpoint>
DEST_ACCESS_KEY=<dest-access-key>
DEST_SECRET_KEY=<dest-secret-key>
% set -a ; source .env ; set +a
% npx @eyevinn/s3-sync s3://source/files s3://dest/files/
Also available as an open web service in Eyevinn Open Source Cloud. This enables you to synchronize two S3 buckets without having to go through your local computer. Read this documentation for usage instructions.
% npm install
% set -a ; source .env ; set +a
% npm start -- s3://source/files s3://dest/files/
See CONTRIBUTING
This project is licensed under the MIT License, see LICENSE.
Join our community on Slack where you can post any questions regarding any of our open source projects. Eyevinn's consulting business can also offer you:
- Further development of this component
- Customization and integration of this component into your platform
- Support and maintenance agreement
Contact [email protected] if you are interested.
Eyevinn Technology is an independent consultant firm specialized in video and streaming. Independent in a way that we are not commercially tied to any platform or technology vendor. As our way to innovate and push the industry forward we develop proof-of-concepts and tools. The things we learn and the code we write we share with the industry in blogs and by open sourcing the code we have written.
Want to know more about Eyevinn and how it is to work here. Contact us at [email protected]!