Difference between revisions of "StofAnanas"

From RevSpace
Jump to navigation Jump to search
(27 intermediate revisions by the same user not shown)
Line 3: Line 3:
 
  |Picture=StofAnanas.jpg
 
  |Picture=StofAnanas.jpg
 
  |Omschrijving=Showing particulate matter concentration as a coloured light
 
  |Omschrijving=Showing particulate matter concentration as a coloured light
  |Status=In progress
+
  |Status=Completed
 
  |Contact=bertrik
 
  |Contact=bertrik
 
}}
 
}}
Line 9: Line 9:
 
== The concept ==
 
== The concept ==
 
The stofananas/stoflama visualizes the current airborne particulate matter concentration from the nearest sensor.community measurement station, inspired by http://stoflamp.nl
 
The stofananas/stoflama visualizes the current airborne particulate matter concentration from the nearest sensor.community measurement station, inspired by http://stoflamp.nl
The data that the LED colour is based on is retrieved over WiFi from the sensor.community website every 5 minutes.
+
The data that the LED colour is based on is retrieved over WiFi from the stofradar.nl website every 5 minutes.
  
 
This lamp is a soft plastic translucent pine apple ("ananas") or lama, bought at the "Action" store.
 
This lamp is a soft plastic translucent pine apple ("ananas") or lama, bought at the "Action" store.
  
 
Features:
 
Features:
* The lamp shows PM10 particulate matter concentration as a colour, from dark blue for low concentration to bright pink for high concentration
+
* The lamp shows particulate matter concentration as a colour, from dark blue for low concentration to bright pink for high concentration
* The lamp retrieves the PM value over wifi from the the sensor.community website, there is a one-time setup to configure your WiFi network so the device can access the internet
+
* The lamp retrieves the PM value over wifi from the the stofradar.nl website, there is a one-time setup to configure your WiFi network so the device can access the internet
* The lamp automatically determines the nearest sensor.community particulate measurement station, by doing WiFi-based geolocation.
+
* The lamp determines its location by based on signal strength and BSSID of nearby WiFi base stations.
* The number/id of the sensor.community station can also be entered manually during the one-time setup.
 
 
* The hardware consists of a Wemos D1 mini board (about E3,-), a LED shield and a USB power supply + cable.
 
* The hardware consists of a Wemos D1 mini board (about E3,-), a LED shield and a USB power supply + cable.
 
* The software supports two different kinds of Wemos D1 mini LED "shield", both the shield with a single LED and the shield with 7 LEDs arranged in a star.  
 
* The software supports two different kinds of Wemos D1 mini LED "shield", both the shield with a single LED and the shield with 7 LEDs arranged in a star.  
 +
* Experimental branch retrieves particulate matter data from stofradar.nl, which is more responsive, also includes data from RIVM
  
Ideas/nice to have:
+
Ideas/nice to have/todo:
* Built-in web server, with links to historic measurement data of the sensor it's monitoring, link to google maps, etc.
 
** complication: the [https://www.madavi.de/sensor/graph.php?sensor=esp8266-9137604-pms nice graphs on madavi.de] are based on the *hardware id* (not database id), we can't get that automatically
 
** just show a table with all properties in the left column (PM values, WGS84 location) and their values in the right column?
 
 
* some kind of compatibility mode with the stoflamp from stoflamp.nl
 
* some kind of compatibility mode with the stoflamp from stoflamp.nl
 
* Run the software directly on a WiFi-enabled E14 RGB lamp from the Action store. This lamp has the microcontroller already built in. No separate USB power adapter is needed, it runs directly off 230V. See the [[WifiLamp]] project.
 
* Run the software directly on a WiFi-enabled E14 RGB lamp from the Action store. This lamp has the microcontroller already built in. No separate USB power adapter is needed, it runs directly off 230V. See the [[WifiLamp]] project.
 +
* Instead of controlling a light directly, send a command over infrared remote to an RGB lamp already having remote control, see https://www.instructables.com/Reverse-Engineering-RGB-LED-Bulb-with-IR-remote/
  
 
== Building it ==
 
== Building it ==
Line 65: Line 63:
 
* power up the lamp
 
* power up the lamp
 
* on a mobile phone, connect to the "ESP-PMLAMP" network, and select login
 
* on a mobile phone, connect to the "ESP-PMLAMP" network, and select login
* when presented with the captive portal, select a WiFi network, fill in the WiFi password, leave the luftdaten id field EMPTY, press SAVE
+
* when presented with the captive portal, select a WiFi network, fill in the WiFi password, press SAVE
* the closest sensor.community particulate matter sensor will automatically be determined
 
 
 
Manual configuration:
 
* on https://netherlands.maps.luftdaten.info find the particulate matter station you want to follow and note the number of the station, for example "12246"
 
* power up the lamp
 
* on a mobile phone, connect to the "ESP-PMLAMP" network, and select login
 
* when presented with the captive portal, select a WiFi network, fill in the WiFi password, AND ALSO fill in the number you looked up earlier, press SAVE
 
 
 
Alternatively:
 
* make sure at least the WiFi credentials have been entered and saved
 
* open a console to the serial port of the wemos D1 mini (115200 bps) and enter the following command:
 
  config auto
 
* within a few seconds, you should see it prints the current approximate geographic location and the id of the sensor.community station, the id should be non-zero. It is saved in internal memory.
 
  
 
=== Usage ===
 
=== Usage ===
Line 91: Line 76:
 
The LED can be one of these LED shields:
 
The LED can be one of these LED shields:
 
* 1-LED shield: https://wiki.wemos.cc/products:d1_mini_shields:ws2812b_rgb_shield
 
* 1-LED shield: https://wiki.wemos.cc/products:d1_mini_shields:ws2812b_rgb_shield
* 7-LED shield: https://wiki.wemos.cc/products:d1_mini_shields:rgb_led_shield
+
* 7-LED shield: https://www.wemos.cc/en/latest/d1_mini_shield/rgb_led.html
  
The 7-LED shield is a lot brighter than the 1-LED shield.
+
The 7-LED shield is a lot brighter than the 1-LED shield, I recommend to use the 7-led shield.
  
 
Unfortunately not all LED shields are equal, some contain an RGB LED, others have the RGB colours switched.
 
Unfortunately not all LED shields are equal, some contain an RGB LED, others have the RGB colours switched.
Line 104: Line 89:
 
To compile and upload it, I use platform io:
 
To compile and upload it, I use platform io:
 
   pio run -t upload
 
   pio run -t upload
 +
 +
The ESP8266 board support should be version 2.6.3!
  
 
You can also compile it with the Arduino IDE, libraries used:
 
You can also compile it with the Arduino IDE, libraries used:
* ArduinoJSON (v 6.17.2) for parsing the sensor.community response
+
* ArduinoJSON (v 6.19.4) for parsing the sensor.community response
* FastLED (v 3.3.3) is used to control the RGB LED
+
* FastLED (v 3.5.0) is used to control the RGB LED
* WiFiManager (v 0.15.0) is used to manage WiFi connection to the local WiFi access point
+
* WiFiManager (v 0.16.0) is used to manage WiFi connection to the local WiFi access point
  
=== Sensor.community interface ===
+
=== stofradar.nl interface ===
The current measurement value of a particular sensor can be determined by parsing the JSON messages retrieved over a REST interface, by performing an HTTP GET on URL
+
The firmware performs a GET on
   http://api.luftdaten.info/v1/sensor/<sensor-id>/
+
   http://stofradar.nl:9000/air/<latitude>/<longitude>
  http://data.sensor.community/airrohr/v1/sensor/<sensor-id>/
 
where <sensor-id> is the database id used by sensor.community (and visible on their map).
 
The trailing slash in the URL is significant.
 
  
For example:
+
This returns a JSON message as follows
   http://api.luftdaten.info/v1/sensor/12246/
+
   {"pm2.5":4.25}
  http://data.sensor.community/airrohr/v1/sensor/12246/
 
  
The software looks for the "P1" (PM10) sensor value in the JSON message and averages all measurements it finds (usually the current one and a previous one).
+
=== Colour mapping ===
 +
[[File:Fastled_rainbow.jpg|right|thumb|FastLED rainbow hue chart]]
  
=== Colour mapping ===
+
Mapping is currently as follows:
Mapping is as follows, with piecewise linear interpolation:
 
 
* 0 ug/m3: <span style="background:#0000FF>deep blue</span>
 
* 0 ug/m3: <span style="background:#0000FF>deep blue</span>
 
* 15 ug/m3: <span style="background:#00F00F>green</span>
 
* 15 ug/m3: <span style="background:#00F00F>green</span>
Line 130: Line 113:
 
* 60 ug/m3: <span style="background:#FF0000>red</span>
 
* 60 ug/m3: <span style="background:#FF0000>red</span>
 
* 120+ ug/m3: <span style="background:#FF0080>pink</span>
 
* 120+ ug/m3: <span style="background:#FF0080>pink</span>
 +
 +
This follows roughly a spectral colour scale with continuously varying 'hue',
 +
PM-values doubling for each step, with piecewise linear interpolation.
 +
 +
RIVM has an interesting paper on this subject at
 +
https://www.rivm.nl/bibliotheek/rapporten/2014-0050.pdf
 +
 +
Chapter 8.3 unfortunately still puts the final colour scale for an air quality index as a point under discussion:
 +
 +
  "Er is overeenstemming over het baseren van de index op dosis-respons
 +
  relaties en het schalen van de componenten naar ordegrootte
 +
  gezondheidseffecten. De analyse die heeft geleid tot een indeling in tien
 +
  klassen is beschreven in hoofdstuk 6. Er is tevens de wens geuit, zowel
 +
  door gebruikers als experts, om in de uiteindelijke presentatie te komen
 +
  tot vier klassen met bijbehorende kleur, labels en handelingsperspectief.
 +
  '''De precieze afkappunten daarvoor zijn arbitrair. Na de expertbijeenkomst,
 +
  '''bijeenkomsten met gebruikers en twee commentaarronden onder de experts
 +
  '''is nog geen consensus over de uiteindelijke indeling van de index in vier klassen.
 +
  De onderstaande indeling (zie Tabel 11) doet zoveel mogelijk recht aan de adviezen van
 +
  de experts en gebruikers, en biedt mogelijkheden om een consistent
 +
  geheel te vormen met de smogregeling. Nog openstaande
 +
  discussiepunten worden hier beschreven."
 +
 +
The https://www.luchtmeetnet.nl/ page uses the following range:
 +
https://www.luchtmeetnet.nl/informatie/luchtkwaliteit/luchtkwaliteitsindex-(lki)
  
 
== Next generation ==
 
== Next generation ==
 
[[File:pmlamp_sequence.png|right|thumb|lamp-sensor pairing sequence diagram]]
 
[[File:pmlamp_sequence.png|right|thumb|lamp-sensor pairing sequence diagram]]
  
The next generation will work as follows:
+
The next generation uses the ESP-NOW protocol, supported by both the ESP8266 and ESP32 microcontrollers.
* The protocol is ESP-NOW between roles 'lamp' and 'sensor', both can be ESP8266. ESP-NOW is a connection-less WiFi protocol running at a reduced rate of 1 Mbps, it does not require any credentials (like WEP/WPA) to be entered. '''The lamp is *not* connected to regular WiFi, this is different from (say) the mechanism used by the sensor.community flashing tool to find a sensor in the local network.'''
+
ESP-NOW is a connection-less WiFi protocol running at a reduced rate of 1 Mbps, it does not require any credentials (like WEP/WPA) to be entered.
* On startup, the lamp sends broadcast discovery messages at a regular interval, say every second, it flashes blue while doing so.
+
'''The lamp is *not* connected to regular WiFi, this is different from (say) the mechanism used by the sensor.community flashing tool to find a sensor in the local network.'''
* The sensor receives the discovery message and completes a pairing / association sequence with the lamp.
 
* When a new measurement is done, the lamp sends a data message to the lamp. The lamp shows the associated color.
 
  
 +
The idea is that you just put a ESP-now enabled light in the vicinity (several 10s of meters) of the particulate matter sensor
 +
and they will automatically discover each others' presence and start communicating measurement values.
 +
 +
=== Protocol ===
 
Pairing works as follows:
 
Pairing works as follows:
 
* The lamp sends broadcast discovery messages (possibly on different channels) to announce its presence and discover the sensor, it flashes blue while doing so.
 
* The lamp sends broadcast discovery messages (possibly on different channels) to announce its presence and discover the sensor, it flashes blue while doing so.
Line 145: Line 155:
 
* The lamp receives the associate message, it stops flashing blue.
 
* The lamp receives the associate message, it stops flashing blue.
 
* The (implicit) ACK from the lamp back to the sensor signals that the association is complete, the sensor remembers the lamp MAC and id
 
* The (implicit) ACK from the lamp back to the sensor signals that the association is complete, the sensor remembers the lamp MAC and id
 +
* When a new measurement is done, the sensor sends a data message to the lamp. The lamp shows the associated color.
  
 
The data format is JSON, human readable, extensible. Not so friendly on data size, but we can send up to 250 bytes, should be enough.
 
The data format is JSON, human readable, extensible. Not so friendly on data size, but we can send up to 250 bytes, should be enough.
Line 160: Line 171:
 
The lamp software can be implemented to either just display the color, or calculate it from the measurement.
 
The lamp software can be implemented to either just display the color, or calculate it from the measurement.
  
==== Hardware ====
+
When the sensor does not receive an ACK from the lamp during a number of consecutive transmissions (say 3), it assumes that the lamp is offline and goes back to discovery mode.
 +
When the lamp does not receive a message from the sensor during a certain interval (say 300 seconds), it assumes that the sensor is offline and goes back to discovery mode.
 +
 
 +
=== Hardware ===
 
You need two wemos d1 mini boards, one acting as the 'sensor', the other one as the 'lamp'.
 
You need two wemos d1 mini boards, one acting as the 'sensor', the other one as the 'lamp'.
 
The wemos d1 mini acting as 'lamp' should be fitted with an RGB shield.
 
The wemos d1 mini acting as 'lamp' should be fitted with an RGB shield.
  
==== Software ====
+
=== Software ===
 
Source code is available here: https://github.com/bertrik/pmlamp-espnow-proto
 
Source code is available here: https://github.com/bertrik/pmlamp-espnow-proto
  
 
Power on the lamp, the LED starts flashing blue, then power on the sensor, the LED stops flashing. You can connect over serial to the sensor node and type a command like 'led FF0000' to set the color of the lamp to red.
 
Power on the lamp, the LED starts flashing blue, then power on the sensor, the LED stops flashing. You can connect over serial to the sensor node and type a command like 'led FF0000' to set the color of the lamp to red.
  
==== Other resources ====
+
=== Other resources ===
 
* http://smallbits.marshall-tribe.net/blog/2018/05/20/esp8266-now-talk
 
* http://smallbits.marshall-tribe.net/blog/2018/05/20/esp8266-now-talk

Revision as of 13:12, 28 July 2022

Project StofAnanas
StofAnanas.jpg
Showing particulate matter concentration as a coloured light
Status Completed
Contact bertrik
Last Update 2022-07-28

The concept

The stofananas/stoflama visualizes the current airborne particulate matter concentration from the nearest sensor.community measurement station, inspired by http://stoflamp.nl The data that the LED colour is based on is retrieved over WiFi from the stofradar.nl website every 5 minutes.

This lamp is a soft plastic translucent pine apple ("ananas") or lama, bought at the "Action" store.

Features:

  • The lamp shows particulate matter concentration as a colour, from dark blue for low concentration to bright pink for high concentration
  • The lamp retrieves the PM value over wifi from the the stofradar.nl website, there is a one-time setup to configure your WiFi network so the device can access the internet
  • The lamp determines its location by based on signal strength and BSSID of nearby WiFi base stations.
  • The hardware consists of a Wemos D1 mini board (about E3,-), a LED shield and a USB power supply + cable.
  • The software supports two different kinds of Wemos D1 mini LED "shield", both the shield with a single LED and the shield with 7 LEDs arranged in a star.
  • Experimental branch retrieves particulate matter data from stofradar.nl, which is more responsive, also includes data from RIVM

Ideas/nice to have/todo:

  • some kind of compatibility mode with the stoflamp from stoflamp.nl
  • Run the software directly on a WiFi-enabled E14 RGB lamp from the Action store. This lamp has the microcontroller already built in. No separate USB power adapter is needed, it runs directly off 230V. See the WifiLamp project.
  • Instead of controlling a light directly, send a command over infrared remote to an RGB lamp already having remote control, see https://www.instructables.com/Reverse-Engineering-RGB-LED-Bulb-with-IR-remote/

Building it

stoflama

It consists of a few parts:

  • a Wemos D1 mini board
  • a LED shield, either the one with 1 LED, or the one with 7 LEDs (preferred, brighter)
  • a 5V USB charger with stable voltage output + USB cable
  • a plastic lamp enclosure

Steps:

  • solder the female headers onto the Wemos D1 mini, start with soldering just one pin so you can re-heat it and adjust it if the fit with the male pins is not quite right.
  • push the male headers into the female headers and solder the male headers onto the LED shield
  • connect the USB micro cable and flash the firmware into the Wemos d1 mini board
  • verify that it works as expected, on startup it does a quick colour animation, starting and ending with the red colour
  • remove the USB micro cable and push the Wemos d1 mini board + LED shield into the plastic enclosure
  • reattach the USB micro cable and verify it still works

It helps to make a few little knife cuts in the plastic of the enclosure to make the wemos d1 mini board fit more easily.

Operation Manual

stoflama

Flashing the firmware

  • Connect everything up as indicated under 'hardware' and connect the Wemos D1 board to the USB port of your development PC / laptop
  • Flash the software into the Wemos D1 mini. Open a command line and enter the 'stofananas' source code directory, then compile and upload it using the following command:
 pio run -t upload

This assumes you have platformio installed, this is done on Debian Linux for example, as follows:

 sudo apt install python-pip
 sudo pip install platformio

Configuration

configuration

Automatic configuration:

  • power up the lamp
  • on a mobile phone, connect to the "ESP-PMLAMP" network, and select login
  • when presented with the captive portal, select a WiFi network, fill in the WiFi password, press SAVE

Usage

  • Power up the lamp while in range of the WiFi network you configured. The LED shows a colour animation when starting up (starting with red and ending with red)
  • The LED turns white for a short time, then changes to a colour representing a PM concentration
  • A new PM measurement is retrieved automatically every 5 minutes.
  • A flashing colour (1x per second) means that something went wrong, either communication with the sensor.community server or decoding the sensor.community server response

Hardware

The electronic part consists of a Wemos D1 mini board and a LED shield.

The LED can be one of these LED shields:

The 7-LED shield is a lot brighter than the 1-LED shield, I recommend to use the 7-led shield.

Unfortunately not all LED shields are equal, some contain an RGB LED, others have the RGB colours switched. During startup, the colour animation should start and end with the RED colour.

Software

Getting and building the source code

Source code is available on github.

To compile and upload it, I use platform io:

 pio run -t upload

The ESP8266 board support should be version 2.6.3!

You can also compile it with the Arduino IDE, libraries used:

  • ArduinoJSON (v 6.19.4) for parsing the sensor.community response
  • FastLED (v 3.5.0) is used to control the RGB LED
  • WiFiManager (v 0.16.0) is used to manage WiFi connection to the local WiFi access point

stofradar.nl interface

The firmware performs a GET on

 http://stofradar.nl:9000/air/<latitude>/<longitude>

This returns a JSON message as follows

 {"pm2.5":4.25}

Colour mapping

FastLED rainbow hue chart

Mapping is currently as follows:

  • 0 ug/m3: deep blue
  • 15 ug/m3: green
  • 30 ug/m3: yellow
  • 60 ug/m3: red
  • 120+ ug/m3: pink

This follows roughly a spectral colour scale with continuously varying 'hue', PM-values doubling for each step, with piecewise linear interpolation.

RIVM has an interesting paper on this subject at https://www.rivm.nl/bibliotheek/rapporten/2014-0050.pdf

Chapter 8.3 unfortunately still puts the final colour scale for an air quality index as a point under discussion:

 "Er is overeenstemming over het baseren van de index op dosis-respons
 relaties en het schalen van de componenten naar ordegrootte
 gezondheidseffecten. De analyse die heeft geleid tot een indeling in tien
 klassen is beschreven in hoofdstuk 6. Er is tevens de wens geuit, zowel
 door gebruikers als experts, om in de uiteindelijke presentatie te komen
 tot vier klassen met bijbehorende kleur, labels en handelingsperspectief.
 De precieze afkappunten daarvoor zijn arbitrair. Na de expertbijeenkomst, 
 bijeenkomsten met gebruikers en twee commentaarronden onder de experts
 is nog geen consensus over de uiteindelijke indeling van de index in vier klassen.
 De onderstaande indeling (zie Tabel 11) doet zoveel mogelijk recht aan de adviezen van
 de experts en gebruikers, en biedt mogelijkheden om een consistent
 geheel te vormen met de smogregeling. Nog openstaande
 discussiepunten worden hier beschreven."

The https://www.luchtmeetnet.nl/ page uses the following range: https://www.luchtmeetnet.nl/informatie/luchtkwaliteit/luchtkwaliteitsindex-(lki)

Next generation

lamp-sensor pairing sequence diagram

The next generation uses the ESP-NOW protocol, supported by both the ESP8266 and ESP32 microcontrollers. ESP-NOW is a connection-less WiFi protocol running at a reduced rate of 1 Mbps, it does not require any credentials (like WEP/WPA) to be entered. The lamp is *not* connected to regular WiFi, this is different from (say) the mechanism used by the sensor.community flashing tool to find a sensor in the local network.

The idea is that you just put a ESP-now enabled light in the vicinity (several 10s of meters) of the particulate matter sensor and they will automatically discover each others' presence and start communicating measurement values.

Protocol

Pairing works as follows:

  • The lamp sends broadcast discovery messages (possibly on different channels) to announce its presence and discover the sensor, it flashes blue while doing so.
  • The dust sensor receives the broadcast discovery message and sends an associate message back.
  • The lamp receives the associate message, it stops flashing blue.
  • The (implicit) ACK from the lamp back to the sensor signals that the association is complete, the sensor remembers the lamp MAC and id
  • When a new measurement is done, the sensor sends a data message to the lamp. The lamp shows the associated color.

The data format is JSON, human readable, extensible. Not so friendly on data size, but we can send up to 250 bytes, should be enough. The dust sensor can show in its internal web page that a lamp was found and can display the lamp id.

Example broadcast discovery packet (lamp to dust sensor):

 {"msg":"discover","id":"PMLAMP-000D1DD8"}

Example unicast discovery response packet (dust sensor to lamp):

 {"msg":"associate","id":"SENSOR-00EE18EC"}

Example unicast measurement/color packet (dust sensor to lamp):

 {"msg":"data","PM10":12.3,"PM2.5":8.4,"PM1.0":4.5,"humidity":42.5,"temperature":14.3,"pressure":102511,"color":"#11FF00"}
 {"msg":"data","color":"#ffff00"}

The lamp software can be implemented to either just display the color, or calculate it from the measurement.

When the sensor does not receive an ACK from the lamp during a number of consecutive transmissions (say 3), it assumes that the lamp is offline and goes back to discovery mode. When the lamp does not receive a message from the sensor during a certain interval (say 300 seconds), it assumes that the sensor is offline and goes back to discovery mode.

Hardware

You need two wemos d1 mini boards, one acting as the 'sensor', the other one as the 'lamp'. The wemos d1 mini acting as 'lamp' should be fitted with an RGB shield.

Software

Source code is available here: https://github.com/bertrik/pmlamp-espnow-proto

Power on the lamp, the LED starts flashing blue, then power on the sensor, the LED stops flashing. You can connect over serial to the sensor node and type a command like 'led FF0000' to set the color of the lamp to red.

Other resources