TABLE OF CONTENTS

• Requirements before migrating from Amazon S3 to Contabo Object Storage
• Configuring rclone
• Configuration for Amazon S3 (Source)
• Configuration for Contabo Object Storage (Destination)
• Starting the migration process
• Verifying the migration process

Requirements before migrating from Amazon S3 to Contabo Object Storage:

In order to migrate from Amazon S3 to Contabo Object Storage a few things are required: 

• An Amazon S3 Storage + Credentials (e.g. S3 URL, Access Key and Secret Key).
• A Contabo Object Storage + Credentials (e.g. S3 URL, Access Key and Secret Key).
• A Server with a Linux-based operating system.
• Rclone installed on your Linux-server.

To install rclone use this command: 

apt install rclone-y

Configure rclone:

To transfer the files from Amazon S3 to Contabo Object Storage we are recommend using the tool rclone. 

If you want to learn more about rclone and other tools that work with Contabo Object Storage check out the official documentation here. 

After installing it on your Linux-server, you need to configure the source-server, as well as the destination server. 

Although your own local PC with WSL on it or a linux workstation could be used, we recommend using a VPS (e.g. our VPS S SSD) because the migration process might take a while depending on the size of the files to copy. It’s crucial to execute the migration process uninterrupted.

Config for Amazon S3 (Source):

1. Create a new config by running this command:

   rclone config

2. Now type in “n” to make a new remote and press enter.
3. Now enter a name for this config (e.g. Amazon S3 or source).
4. Now type in “4” to select “Amazon S3 Compliant Storage Providers” and press enter.
5. Type “1” to select “Amazon Web Services (AWS) S3”.
6. Again, type in “1” to enter your AWS Credentials.
7. Now fill in your S3-Access Key ID and press enter.
8. Now paste in your S3-Secret Access Key.
9. Skip the next menus by pressing enter until it asks you “Edit advanced config?”.
10. Now type in “n” and press enter.
11. To finish the setup process, save everything by typing in “y” and hitting enter and typing in “q” to leave to configuration menu.

Config for Contabo Object Storage (Destination):

1. Create a new config by running this command:

   rclone config

2. Now type in “n” to make a new remote and press enter.
3. Now enter a name for this config (e.g. Contabo S3 or destination). 
4. Now type in “4” to select “Amazon S3 Compliant Storage Providers” and press enter.
5.  In the next menu type “2” to select “Ceph Object Storage”.
6. Type in “1” to enter your AWS Credentials.
7. Now enter your Access Key and hit enter.
8. Now enter your Secret Key and hit enter.
9. Skip the region by hitting enter.
10. For the Endpoint paste in the S3-URL (e.g. https://eu2.contabostorage.com).
11. Skip the next two menus by hitting enter two times.
12.  Now type in “n” to skip the advanced config.
13. Hit “y” to save the config and exit the config menu by typing in “q”.

Start the migration process:

1. Run the following command to start the migration process:

   rclone copy [Name of the Source config]:[Path] [Name of the Destination Config]:[Path]

2. If you want to migrate the whole content at once and not only a certain bucket, use this command instead:

   rclone copy source:~ dest:~

Verify the migration process:

It is important to check the migration is complete and everything has been copied over correctly. To do this you can compare the file counts of the source-server with the destination-server. To do so, use these commands: 

For Amazon S3 (Source server) run the following command:

rclone ls s3:~ --recursive | wc -l

For Contabo Object Storage (Destination Server) run the following command: 

rclone ls contabo:~ --recursive | wc -l