How to Upload to an AWS S3 Bucket from a Raspberry Pi

 

 Learn how to easily upload images videos and other data to a cloud storage bucket, Amazon S3. This is essential for many IoT applications. It is free to get started all you will need is an AWS account and some simple Python code! We are using a Raspberry Pi 4b for this video but you can use any Raspberry Pi model other than the Pico W.

Before reading the remainder, be sure to subscribe and support the channel if you have not!

Subscribe:

Youtube

Support:

https://www.buymeacoffee.com/mmshilleh

 

 

 

1-) S3 Setup

The first thing you want to do is create an AWS account by going to

aws.amazon.com

It is free to get started.

Once you enter AWS go into the Console search S3, and select the S3 panel which will allow you to create an S3 bucket. You can click through the steps to generate an S3 bucket with the default settings.

 

Name the bucket however you like.

Now that you have an empty bucket the next thing you will need is to create users with admin privileges to that bucket so they can put objects into the bucket from the Python code. Search the terms 'Users' in the console select the Users panel and click Create New User.

 

 

You need to then select the user and create a group under the Groups tab (see images), make sure the group has administrative privileges, or else you will get an error when trying to place an item into the bucket.

 

 

 

Finally, you want to create an Access/Secret Key pair for the user (See Images), ensure you save the values somewhere safe because this can allow people access to your bucket which can be dangerous for your application security.

 

 

Now that you have that, we are done on the S3 side of things and we can jump to the code!

 

 

 

2-) Code

Open any editor you like on your Raspberry Pi and create a Python file with the code in the project downloads.

Replace the respective values for your keys and your bucket name. There are a total of 3 values in the code you need to replace.

In this code specifically, all we are doing is taking a photo and a video with the Raspberry Pi camera, saving it to a local path on our Raspberry Pi desktop, and then sending it to S3 with the boto3 client, which is the official Python SDK for S3.

If this is your first time using S3 in Python on the Raspberry Pi you will have to pip install boto3, and you will also have to pip install picamera if you choose to use a camera to take an image. Really you do not need a camera, you can just upload any image you want if you have an existing image.

Finally, if the code ran successfully, you can go and view the object in your S3 bucket by going back to the AWS website and going to the bucket. You should see the names of the objects you created. Select one, and from the top right section you can Open or Download the item!

Congrats! This is a very powerful tool you can utilize for applications, especially those involving IoT. You are not limited to images or videos in S3 buckets, you can add all sorts of data necessary for your cloud storage needs. Get creative ;)

Create a free account to access full content.

All access to code and resources on ShillehTek.

Signup Now

Already a member? Sign In

Explore More on Our Blog

How to Connect MLX90614 Infrared Thermometer to Raspberry Pi Pico W: MicroPython Tutorial!

How to Connect MLX90614 Infrared Thermometer to Raspberry Pi Pico W: MicroPython Tutorial!

Learn how to use the MLX90614 with the Raspberry Pi Pico W and get infrared values in MicroPython.

Raspberry Pi Pico/Pico W Free Simulator

Raspberry Pi Pico/Pico W Free Simulator

Discover how to simulate Raspberry Pi Pico projects using Wokwi, a free online simulator for Arduino and MicroPython....

Interfacing the MPU6050 with Raspberry Pi Pico W in C++

Interfacing the MPU6050 with Raspberry Pi Pico W in C++

Interface with the MPU6050 using the Raspberry Pi Pico W in C++.

How to Write your First C++ Program on the Raspberry Pi Pico W

How to Write your First C++ Program on the Raspberry Pi Pico W

Write your first C++ Program on the Pico W in a few simple steps.

How to Use ThingSpeak with the Raspberry Pi Pico W

How to Use ThingSpeak with the Raspberry Pi Pico W

Learn how to create a real-time environmental monitoring system with the Raspberry Pi Pico W and ThingSpeak!

How to Use ADS1115 with the Raspberry Pi (Part 1)

How to Use ADS1115 with the Raspberry Pi (Part 1)

Discover how to expand your Raspberry Pi projects by integrating the ADS1115 ADC for precise analog signal reading....

How to Install Pip Packages in AWS Lambda Using Docker and ECR

How to Install Pip Packages in AWS Lambda Using Docker and ECR

Learn how to streamline AWS Lambda deployments by using Docker and Amazon Elastic Container Registry (ECR) to package...

Create Tabular Product Descriptions on Your Shopify Store

Create Tabular Product Descriptions on Your Shopify Store

Enhance your Shopify store's product pages with our comprehensive guide on implementing tabular descriptions. Learn how to add a...

SSH Into Raspberry Pi with Tailscale VPN

SSH Into Raspberry Pi with Tailscale VPN

Effortlessly access and manage your Raspberry Pi from anywhere using Tailscale's secure mesh VPN.

Send Email with Lua and the ESP32

Send Email with Lua and the ESP32

In this tutorial, we delve into sending emails with the ESP32-S3 using Lua, focusing on the Xedge IDE's built-in SMTP...

Back to blog

Leave a comment

Please note, comments need to be approved before they are published.