An Amazon S3 bucket is a public cloud storage resource available in Amazon Web Services’ (AWS) Simple Storage Service (S3), an object storage offering. Amazon S3 buckets, which are similar to file folders, store objects, which consist of data and its descriptive metadata. AWS recently released their Command Line Tools, which work much like boto and can be installed using. Now, you can download AWS s3 bucket folder or files.
Install AWS Cli
sudo easy_install awscli or sudo pip install awscli
Download and install AWS CLI in your machine
- Install the AWS CLI using the MSI Installer (Windows).
Install the AWS CLI using the Bundled Installer for Linux, OS X, or Unix.
- Configure AWS CLI
Once installed the AWS CLI, you can then simply run the following commands to download AWS S3 bucket folders and files.
aws s3 sync s3://<source_bucket> <local_destination>
For example: aws s3 sync s3://mybucket will download all the objects in mybucket to the current directory.
You can also download a folder recursively in AWS S3 Bucket
aws s3 cp s3://BUCKETNAME/PATH/TO/FOLDER LocalFolderName --recursive
This will instruct the CLI to download all files and folder keys recursively within the PATH/TO/FOLDER directory within the BUCKETNAME bucket.
You can also read more about Downloading an Object AWS S3(Simple Storage Service).