Kinh nghiệm sử dụng s3cmd của Amazon SDK

Kinh nghiệm sử dụng s3cmd của Amazon SDK

I came across this interesting utility to sync backup files to Amazon S3. With this utility in less than ten minutes I learned how easy it is to upload a local file to remote folder in S3 bucket.

I already had a script in place to backup the site's files and database dump. To make this script complete I needed a script/ utility to sync backup files. And s3cmd came there as a savior. I would like to share in this blog post how easy it was to install, configure and get started to make the potential use of the same. 

Our servers are running Ubuntu 12.04.1 LTS. Luckily this s3cmd package is available in Ubuntu's official repository. In no time, I got this installed in our machine with apt-get command.

The following command did the trick of installing,

 $ sudo apt-get install s3cmd

This command would prompt to install a dependency package python-support. Once the installation is done it can be validated with the below command,

 $ s3cmd

The output returned might be as below,

1 ERROR: /home/user/.s3cfg: No such file or directory
2 ERROR: Configuration file not available.
3 ERROR: Consider using --configure parameter to create one.

Essentially it looks for the presence of config file in home folder .s3cfg. In our case this is not in place, since this is the first time the utility is being used.

As suggested we need to create one by issuing the same command again with --configure argument.

1 $ s3cmd --configure

This will ask for a series of questions. Essentially Access Key, Secret Key and other optional settings like proxy, choice of protocol (http vs https), etc. 

When all the needful inputs are given, the utility smartly prompts to make a test before saving it to configuration file.

 1 New settings:
 2   Access Key: [your access key]
 3   Secret Key: [your securet key]
 4   Encryption password: somepassword
 5   Path to GPG program: /usr/bin/gpg
 6   Use HTTPS protocol: False
 7   HTTP Proxy server name: 
 8   HTTP Proxy server port: 0
10 Test access with supplied credentials? [Y/n] Y
11 Please wait...
12 Success. Your access key and secret key worked fine :-)
14 Now verifying that encryption works...
15 Success. Encryption and decryption worked fine :-)
17 Save settings? [y/N] y

I found this tiny feature very handy. I noticed that the Security key I had entered in the first attempt was wrong

Finally to achieve the intended goal, that is to sync the needed file to S3, I used the following command,

 $ s3cmd --delete-removed --reduced-redundancy sync my_backup.tar.gz s3://

Interactive output of the command is below,

1 my_backup.tar.gz -> s3://  [1 of 1]
2  63935864 of 63935864   100% in  186s   335.43 kB/s  done
3 Done. Uploaded 63935864 bytes in 186.1 seconds, 335.42 kB/s
Bạn thấy bài viết này như thế nào?: 
No votes yet
Ảnh của Tommy Tran

Tommy owner Express Magazine

Drupal Developer having 9+ year experience, implementation and having strong knowledge of technical specifications, workflow development. Ability to perform effectively and efficiently in team and individually. Always enthusiastic and interseted to study new technologies

  • Skype ID: tthanhthuy

Bình luận (1)

Ảnh của Tommy Tran
Tommy Tran- Jul 03, 2023 05:12 PM Reply

Điểm khác biệt giữa API Gateway và Proxy và Load Balancer là nó có thêm các chức năng như: Validation, Authen, Rate Limit, Circuit Breaker, ...


Add Comment

Filtered HTML

  • Các địa chỉ web và email sẽ tự động được chuyển sang dạng liên kết.
  • Các thẻ HTML được chấp nhận: <a> <em> <strong> <cite> <blockquote> <code> <ul> <ol> <li> <dl> <dt> <dd>
  • Tự động ngắt dòng và đoạn văn.

Plain text

  • No HTML tags allowed.
  • Các địa chỉ web và email sẽ tự động được chuyển sang dạng liên kết.
  • Tự động ngắt dòng và đoạn văn.
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Enter the characters shown in the image.

Tìm kiếm bất động sản





Dich vu khu trung tphcm

Dich vu diet chuot tphcm

Dich vu diet con trung

Quảng Cáo Bài Viết

Step 2: Sử dụng Composer trong Drupal 8 rất nhiều

Step 2: Sử dụng Composer trong Drupal 8 rất nhiều

Once we have the Packagist pull request done, and the hooks added to we can use the API key

On grids in design (and announcing the Square Grid Drupal theme)

Square Grid Drupal: Lưới thiết kế theme

Grids. They're powerful. They're helpful. They can make design work much easier. (And occasionally harder.) They can be used for good or ill. And they can trap the designer in a cage of vertical and horizontal bars.

7 bước xây dựng  Responsive Theme trong Drupal 7

7 bước xây dựng Responsive Theme trong Drupal 7

Based on the grid system and the nature of your design, download grids from In the case of the RoboSmart theme we have used a single grid at 600 which is fluid and works for any screen resolution greater than 600px.

Công ty diệt chuột T&C


Diet con trung