{"id":7130,"date":"2021-06-12T13:01:47","date_gmt":"2021-06-12T13:01:47","guid":{"rendered":"https:\/\/linuxways.net\/?p=7130"},"modified":"2021-06-12T13:01:47","modified_gmt":"2021-06-12T13:01:47","slug":"how-to-install-s3cmd-in-linux-and-manage-amazon-s3-buckets","status":"publish","type":"post","link":"https:\/\/linuxways.net\/de\/centos\/how-to-install-s3cmd-in-linux-and-manage-amazon-s3-buckets\/","title":{"rendered":"How to Install s3cmd in Linux and Manage Amazon s3 Buckets"},"content":{"rendered":"

S3 , <\/strong>– Simple Storage Service- is Amazon\u2019s storage service that provides IT teams with a secure, scalable, and reliable way to store and retrieve files and folders on the cloud. S3 helps you make the most out of your data by making sure that it is available when needed and scalable as demand grows.<\/p>\n

Conventionally, S3 is accessed from a web browser after signing in to your AWS account. This can also be achieved on command-line using a nifty tool called s3cmd. The s3cmd<\/strong> utility is an opensource command-line tool that allows you to access and manage your S3 service. It allows you to create\/delete buckets, add\/remote files and folders and list the contents of your S3 buckets.<\/p>\n

This guide will seek to help you install s3cmd on Linux and help you make the most of it to manage your S3 account.<\/p>\n

How to install s3cmd on Linux<\/strong><\/h2>\n

Installing s3cmd on major Linux distributions such as Ubuntu, CentOS & RHEL is quite a walk in the park. This is because the s3cmd package is available on their repositories.<\/p>\n

Let\u2019s check out how you can install s3cmd on various distributions:<\/p>\n

On Ubuntu \/ Debian flavors<\/strong><\/h3>\n

For Debian \/ Ubuntu distributions use the APT package manage as follows:<\/p>\n

$ sudo apt install s3cmd<\/strong><\/pre>\n
<\/strong><\/p>\n
On CentOS 8 \/ RHEL 8<\/strong><\/h3>\n
On CentOS \/ RHEL distros install s3cmd using the command below:<\/p>\n
$ sudo dnf install s3cmd<\/strong><\/pre>\n
On SUSE Linux <\/strong><\/h3>\n
For SUSE Enterprise server , start by adding the repository and using the zypper <\/strong>command-line tool as shown.<\/p>\n
$ sudo zypper addrepo http:\/\/s3tools.org\/repo\/SLE_11\/s3tools.repo<\/strong><\/pre>\n
$ zypper install s3cmd<\/strong><\/pre>\n
Installation from source<\/strong><\/h2>\n
If your Linux distribution is not listed above, don\u2019t fret. You can install from source which will work in all distributions.<\/p>\n
First, download the zip file of the latest s3cmd version, which by this time is s3cmd 2.1.0.<\/p>\n
$ wget https:\/\/sourceforge.net\/projects\/s3tools\/files\/s3cmd\/2.1.0\/s3cmd-2.1.0.zip<\/strong><\/pre>\n
In your home directory, you should see the s3cmd-2.1.0.zip <\/strong>zip file.<\/p>\n
<\/p>\n
Next, unzip the file.<\/p>\n
$ unzip s3cmd-2.1.0<\/strong><\/pre>\n
Navigate to the uncompressed folder<\/p>\n
$ cd s3cmd-2.1.0<\/strong><\/pre>\n
And execute the command shown to install from source.<\/p>\n
$ sudo python3 setup.py install<\/strong><\/pre>\n
<\/strong><\/p>\n
Setting up the s3cmd environment<\/strong><\/h2>\n
Before we begin interacting with Amazon S3, we need to set up the s3cmd tool by providing the necessary credentials such as Access Key & Secret access to our account. So, run the command below to configure the s3cmd environment.<\/p>\n
$ s3cmd --configure<\/strong><\/pre>\n
Provide the access key, secret access , region and encryption password as shown in the screenshot below.<\/p>\n
Be sure to use the HTTPS protocol for enhanced security.<\/p>\n
<\/p>\n
<\/p>\n
List s3 buckets<\/strong><\/h2>\n
We have successfully configured the s3cmd tool, and we can now begin interacting with Amazon S3. Before you start interacting with S3, ensure that the user on your AWS has been configured with Amazon S3 IAM role.<\/p>\n
To list the existing S3 buckets on your account, execute the command:<\/p>\n
$ s3cmd ls<\/strong><\/pre>\n
So far, we have none since we are just getting started out.<\/p>\n
<\/p>\n
Let\u2019s create one \ud83d\ude42<\/p>\n
Create an S3 bucket<\/strong><\/h2>\n
To create a new S3 bucket, run the command shown. The command below creates a bucket in S3 called linuxways.<\/strong><\/p>\n
$ s3cmd mb s3:\/\/linuxways<\/strong><\/pre>\n
<\/p>\n
You can head over to your AWS account and confirm that the bucket has been created as shown.<\/p>\n
<\/p>\n
Upload a file to S3 bucket<\/strong><\/h2>\n
To upload a regular file to your bucket, invoke the put <\/strong>option followed by the file and the path to S3 bucket. The command below uploads the file hello.sh <\/strong>to S3.<\/p>\n
$ s3cmd put hello.sh s3:\/\/linuxways\/<\/strong><\/pre>\n
<\/p>\n
Upload a directory to S3 bucket<\/strong><\/h2>\n
To upload a directory, use the -r<\/strong> flag for adding the directory recursively alongside its contents. Take care not to add the leading \/ as this will only add the directory\u2019s contents and not the directory itself.<\/p>\n
Here, we are uploading the Pictures <\/strong>directory that contains a JPG image file.<\/p>\n
$ s3cmd put -r Pictures s3:\/\/linuxways\/<\/strong><\/pre>\n
<\/p>\n
List contents of S3 bucket<\/strong><\/h2>\n
To view or display what your S3 bucket contains, run the command.<\/p>\n
$ s3cmd ls s3:\/\/linuxways\/<\/strong><\/pre>\n
<\/p>\n
Delete a file or directory from an S3 bucket<\/strong><\/h2>\n
If you wish to remove or delete a file you no longer need, use the del <\/strong>option as shown.<\/p>\n
$ s3cmd del s3:\/\/linuxways\/hello.sh<\/strong><\/pre>\n
To delete a directory, use the same syntax as follows. However, this only works if the directory is empty.<\/p>\n
$ s3cmd del s3:\/\/linuxways\/Pictures<\/strong><\/pre>\n
<\/p>\n
If a directory is not empty, use the -r <\/strong>option to recursively delete all its contents as shown.<\/p>\n
$ s3cmd del -r s3:\/\/linuxways\/Pictures\/<\/strong><\/pre>\n
<\/p>\n
Remove a bucket from S3<\/strong><\/h2>\n
If you no longer require your bucket, you can delete it as follows.<\/p>\n
$ s3cmd rb s3:\/\/linuxways<\/strong><\/pre>\n
If the bucket still contains some files and folders, you will run into the error below informing you that the bucket is not empty.<\/p>\n
<\/p>\n
The solution is to go back and delete all the files and directories in your bucket and try again.<\/p>\n
<\/p>\n
Wrapping up<\/strong><\/h2>\n
That was a summary of the s3cmd command-line tool and how you can use it to manage your Amazon S3 storage feature.<\/p>","protected":false},"excerpt":{"rendered":"
S3 , – Simple Storage Service- is Amazon\u2019s storage service that provides IT teams with a secure, scalable, and reliable way to store and retrieve files and folders…<\/p>","protected":false},"author":1,"featured_media":7238,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,4,165,2],"tags":[366,93,17,198,365,100],"class_list":["post-7130","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-centos","category-debian","category-red-hat","category-ubuntu","tag-amazon-s3-buckets","tag-centos-8","tag-debian-10","tag-red-hat-enterprise-linux-8","tag-s3cmd","tag-ubuntu-20-04"],"_links":{"self":[{"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/posts\/7130","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/comments?post=7130"}],"version-history":[{"count":0,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/posts\/7130\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/media\/7238"}],"wp:attachment":[{"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/media?parent=7130"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/categories?post=7130"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/linuxways.net\/de\/wp-json\/wp\/v2\/tags?post=7130"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}