Storing and visualizing time-series data from a Raspberry Pi
With the recent release of the Raspberry Pi 4 Model B, you can get faster CPU, 4K support, and up to 4GB of RAM. Coupled with the flexibility of Timescale Cloud, the possibilities are endless!
Last week, we announced our fully-managed time-series database service: Timescale Cloud. This week, we wanted to talk about the other end of the spectrum: the edge (and how you can combine the cloud with the edge for time-series data storage + processing).
When talking about IoT and edge with developers in our community, the mention of Raspberry Pi quickly becomes part of that conversation. For those that aren’t familiar, Raspberry Pi is a minicomputer that packs a powerful punch in a small package. It can be used “for whatever you want” and there are tons of project examples showcasing its versatility. However, specifically in the context of IoT, developers can use a Raspberry Pi to serve as a prototype for larger-scale edge initiatives.
In our case, we are interested in exploring how to run edge hardware, push time-series data from that hardware into a TimescaleDB, and configure a visualization of that data in Grafana. To demonstrate this scenario, in this post we will show you how to create an IoT system based on Raspberry Pi (the “edge”) and Timescale Cloud (for hosted TimescaleDB and hosted Grafana).
The Moving Parts
First, we will discuss the setup for our system. “The Edge” is a Raspberry Pi that has been wired to a photocell light sensor. Running on the device is a script (photoresister.py) which is recording the status of the light sensor at 5Hz. Each observation is sent to a TimescaleDB instance (hosted on Timescale Cloud) and recorded in a hypertable. A Grafana instance (also hosted on Timescale Cloud) is connected to the database to visualize the light values.
All the code and detailed instructions for the below can be found in this GitHub repository. (Note: there are also other TimescaleDB examples in that repository for you to experiment with.)
The Cloud
We need to create two things in Timescale Cloud: a TimescaleDB instance (to store the light sensor readings sent from the device) and a Grafana instance (to visualize the data in TimescaleDB).
If you don’t already have an account, sign up for a Timescale Cloud. Login and create a new TimescaleDB instance.
After a few minutes, the database instance is powered-up and ready to use. Using psql (or similar SQL client), connect to the database and create the schema.
With the TimescaleDB instance running and the schema in place, it’s time to create a new Grafana instance.
Next, log into your Grafana instance and configure your TimescaleDB instance as a data source. With the data source in place, you can create a Grafana Dashboard that connects to that data source and will visualize the data in TimescaleDB.
You can create the dashboard by importing the Grafana dashboard JSON found here.
Note: The above Grafana dashboard JSON assumes you have created datasource “Timescale Cloud”, so please adjust as necessary. You can find more details in our webinar “Visualizing Time-Series Data with TimescaleDB and Grafana”.
The Edge
We are starting with a standard Raspberry Pi setup with Raspbian. For our light sensor, these resources will explain how to configure a photocell:
With the photocell in place, we will setup the photoresistor.py python script. This script runs on the device, which will write aggregate sensor readings and batch insert the data into the TimescaleDB instance in the cloud.
Note: As a prerequisite (in addition the photocell setup) you’ll need to install the PostgreSQL database adapter for Python.
Create a systemd startup script which will help to ensure the sensor comes back online during reboot. Be sure to enable the TIMESCALEDB_CONNECTION within the environment variable.
The Outcome
With all the pieces in place (and letting the system run for a bit), here’s a snapshot of how the Grafana dashboard fluctuates over the course of ~25 minutes. You can see the light sensor readings show when we are in the light and in darkness.
Added bonus: Since Grafana supports creating alert rules, if you are feeling adventurous, you can setup a rule to send an alert when we are in the dark. Checkout our docs for more information on configuring Grafana for alerting.
Next Steps
Above is a small scale demonstration of what it looks like to get an IoT sensor system running with a Raspberry Pi and Timescale Cloud. We hope this gives you some ideas about what you can create on your own. If you are ready to get started, you can use this demonstration to get up and running today!
For a limited time, we are running a promo with Timescale Cloud where you’ll get $300 in trial credits to use for the next 30 days.
Have fun!
Like this post and interested in learning more? Sign up for our mailing list below or follow us on Twitter.