How to Upload to an AWS S3 Bucket from a Raspberry Pi

 

 Learn how to easily upload images videos and other data to a cloud storage bucket, Amazon S3. This is essential for many IoT applications. It is free to get started all you will need is an AWS account and some simple Python code! We are using a Raspberry Pi 4b for this video but you can use any Raspberry Pi model other than the Pico W.

Before reading the remainder, be sure to subscribe and support the channel if you have not!

Subscribe:

Youtube

Support:

https://www.buymeacoffee.com/mmshilleh

 

 

 

1-) S3 Setup

The first thing you want to do is create an AWS account by going to

aws.amazon.com

It is free to get started.

Once you enter AWS go into the Console search S3, and select the S3 panel which will allow you to create an S3 bucket. You can click through the steps to generate an S3 bucket with the default settings.

 

Name the bucket however you like.

Now that you have an empty bucket the next thing you will need is to create users with admin privileges to that bucket so they can put objects into the bucket from the Python code. Search the terms 'Users' in the console select the Users panel and click Create New User.

 

 

You need to then select the user and create a group under the Groups tab (see images), make sure the group has administrative privileges, or else you will get an error when trying to place an item into the bucket.

 

 

 

Finally, you want to create an Access/Secret Key pair for the user (See Images), ensure you save the values somewhere safe because this can allow people access to your bucket which can be dangerous for your application security.

 

 

Now that you have that, we are done on the S3 side of things and we can jump to the code!

 

 

 

2-) Code

Open any editor you like on your Raspberry Pi and create a Python file with the code in the project downloads.

Replace the respective values for your keys and your bucket name. There are a total of 3 values in the code you need to replace.

In this code specifically, all we are doing is taking a photo and a video with the Raspberry Pi camera, saving it to a local path on our Raspberry Pi desktop, and then sending it to S3 with the boto3 client, which is the official Python SDK for S3.

If this is your first time using S3 in Python on the Raspberry Pi you will have to pip install boto3, and you will also have to pip install picamera if you choose to use a camera to take an image. Really you do not need a camera, you can just upload any image you want if you have an existing image.

Finally, if the code ran successfully, you can go and view the object in your S3 bucket by going back to the AWS website and going to the bucket. You should see the names of the objects you created. Select one, and from the top right section you can Open or Download the item!

Congrats! This is a very powerful tool you can utilize for applications, especially those involving IoT. You are not limited to images or videos in S3 buckets, you can add all sorts of data necessary for your cloud storage needs. Get creative ;)

Create a free account to access full content.

All access to code and resources on ShillehTek.

Signup Now

Already a member? Sign In

Explore More on Our Blog

Create Tabular Product Descriptions on Your Shopify Store

Create Tabular Product Descriptions on Your Shopify Store

Enhance your Shopify store's product pages with our comprehensive guide on implementing tabular descriptions. Learn how to add a...

SSH Into Raspberry Pi with Tailscale VPN

SSH Into Raspberry Pi with Tailscale VPN

Effortlessly access and manage your Raspberry Pi from anywhere using Tailscale's secure mesh VPN.

Send Email with Lua and the ESP32

Send Email with Lua and the ESP32

In this tutorial, we delve into sending emails with the ESP32-S3 using Lua, focusing on the Xedge IDE's built-in SMTP...

How to Code with Lua on ESP32 with XEdge32

How to Code with Lua on ESP32 with XEdge32

Learn how to set up Xedge32 and start coding on the ESP32-S3 with Lua programming!

Stream Audio From Raspberry Pi to Local Computer

Stream Audio From Raspberry Pi to Local Computer

Discover the simplicity of streaming live audio directly from a USB microphone connected to your Raspberry Pi to...

SSH Raspberry Pi via Cell Phone

SSH Raspberry Pi via Cell Phone

This beginner-friendly guide will walk you through remotely controlling your Raspberry Pi using SSH through your cell phone.

Remotely Control Raspberry Pi via SSH from External Network

Remotely Control Raspberry Pi via SSH from External Network

Learn how to SSH into your Raspberry Pi from any network. This is critical in IoT since you can control...

Stream Video from Raspberry Pi Camera to YouTube Live

Stream Video from Raspberry Pi Camera to YouTube Live

Learn how to stream to YouTube from a Raspberry Pi Camera.

How to Connect BH1750 with Arduino: Measure Ambient Light

How to Connect BH1750 with Arduino: Measure Ambient Light

Learn how to measure ambient light for smart lighting control using Arduino and the BH1750 Light Intensity Module.

How to Connect MPU9250 and Raspberry Pi (Part 2 - Calibration)

How to Connect MPU9250 and Raspberry Pi (Part 2 - Calibration)

Learn how to calibrate the MPU9250 in Python with the Raspberry Pi to get more accurate acceleration and gyroscopic...

Back to blog

Leave a comment

Please note, comments need to be approved before they are published.