Difference between revisions of "PowerLight"

From RevSpace
Jump to navigation Jump to search
(Backend)
(Backend)
(22 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
  |Name=PowerLight
 
  |Name=PowerLight
 
  |Picture=PowerLight.jpg
 
  |Picture=PowerLight.jpg
  |Omschrijving=Show energy mix of dutch power generation as a pie chart on a LED ring
+
  |Omschrijving=Shows mix of dutch electrical power generation as a pie chart on a LED ring
 
  |Status=Completed
 
  |Status=Completed
 
  |Contact=bertrik
 
  |Contact=bertrik
Line 8: Line 8:
  
 
== The concept ==
 
== The concept ==
Draw the current dutch electrical power generation-mix as pie chart on a LED ring light, with colors representing fractions of a specific power generation source.
+
Show the current dutch electrical power generation-mix as pie chart on a LED ring light, with colors representing fractions of a specific power generation source.
  
 
For example:
 
For example:
Line 15: Line 15:
 
* red: fossil
 
* red: fossil
 
* green: nuclear
 
* green: nuclear
* grey: other/waste
+
* purple: other/waste
  
 
== Power generation data ==
 
== Power generation data ==
Line 64: Line 64:
  
 
Main points relevant for me:
 
Main points relevant for me:
* the solar part reported to entso-e is way too small
+
* The solar part reported to entso-e is way too small. Note also at for example https://energy-charts.info/charts/energy_pie/chart.htm?l=en&c=NL that the solar part is tiny
* on-shore wind data is unreliable, but off-shore wind data is probably OK
+
* On-shore wind data is unreliable, but off-shore wind data is probably OK
* no biomass data is reported to entso-e
+
* No biomass data is reported to entso-e
 
 
Note also in https://energy-charts.info/charts/energy_pie/chart.htm?l=en&c=NL how the solar part is tiny
 
  
 
There is a model that estimates the solar fraction, also at a regional level and at fine time resolution, at https://api.netanders.io/
 
There is a model that estimates the solar fraction, also at a regional level and at fine time resolution, at https://api.netanders.io/
 
However use of this model requires a paid subscription, so I cant't use that.
 
However use of this model requires a paid subscription, so I cant't use that.
  
In my application, energy generation fractions are calculated as follows:
+
In my backend application, energy generation fractions are calculated as follows:
 
* solar = B16 (from the time-shifted '''forecast''' document A69)
 
* solar = B16 (from the time-shifted '''forecast''' document A69)
 
* wind = B18 (offshore, from '''generation''' document A75) + B19 (onshore, from time-shifted '''forecast''' document A69)  
 
* wind = B18 (offshore, from '''generation''' document A75) + B19 (onshore, from time-shifted '''forecast''' document A69)  
Line 84: Line 82:
 
(e.g. sunrise/sunset data from national weather institute KNMI, energieopwek.nl)
 
(e.g. sunrise/sunset data from national weather institute KNMI, energieopwek.nl)
 
so forecast data from the ENTSO-E document is shifted by 30 minutes in my model.
 
so forecast data from the ENTSO-E document is shifted by 30 minutes in my model.
 +
 +
In the end, all of the electrical generation data used in my backend application is ENTSO-E data.
  
 
==== Data schedule ====
 
==== Data schedule ====
Line 94: Line 94:
  
 
Parts:
 
Parts:
* LED ring light https://nl.aliexpress.com/item/1005003798658173.html
+
* LED ring light, for example
* Wemos D1 mini with an ESP8266
+
** 24-LED ring https://nl.aliexpress.com/item/32963152993.html I like this one, because it is in one piece and inexpensive
 +
** 40-LED ring https://nl.aliexpress.com/item/1005003798658173.html this has 4 segments that you have to join/solder
 +
** 60-LED ring https://nl.aliexpress.com/item/4000102576864.html also 4 segments
 +
* Wemos D1 mini board + pin headers, containing an ESP8266 microcontroller
 +
* "dupont"-cable, 4 wires
 +
* angled pin header, some rings have 2.0 mm pitch, others have 2.54 mm pitch
 +
* USB-A to USB-micro cable
 +
* 5V USB adapter
 +
 
 +
Connecting it:
 +
* Solder the straight pin headers that came with it on the wemos d1 mini
 +
* Solder the angled pin to the LED ring
 +
* Connect the dupont cable:
 +
** Wemos 5V goes to 5V on the LED ring
 +
** Wemos GND goes to GND on the LED ring
 +
** Wemos D3 goes to DI on the LED ring
 +
** Wemos D2 goes to DO on the LED ring
 +
 
 +
This [https://www.thingiverse.com/thing:3852495 picture stand] printed at 40% size works OK for the 24-LED ring.
  
 
== Software ==
 
== Software ==
Line 106: Line 124:
  
 
Runs as a REST-like resource, with the following endpoints:
 
Runs as a REST-like resource, with the following endpoints:
* http://stofradar.nl:9001/electricity/generation with details about the current (35-50 minute ago) electricity generation mix
+
* http://stofradar.nl:9001/electricity/generation with details about the current (35-50 minute ago) electricity generation mix, units are MW
* http://stofradar.nl:9001/electricity/price with day-ahead hourly electricity price-per-MWh for today
+
* http://stofradar.nl:9001/electricity/capacity with currently (per year) installed generation capacity, by source, units are MW
* http://stofradar.nl:9001/naturalgas/price with daily natural gas prices (neutral gas price) of [https://en.wikipedia.org/wiki/Title_Transfer_Facility TTF] spot market, in euro/MWh, multiply by 35.17/3600 to get euro/m3
+
* http://stofradar.nl:9001/electricity/price with day-ahead hourly electricity price-per-MWh for today, in euro/MWh, multiply by 0.001 to get euro/kWh
(1-minute rate limit)
+
* http://stofradar.nl:9001/naturalgas/price with daily natural gas prices (neutral gas price) of [https://en.wikipedia.org/wiki/Title_Transfer_Facility TTF] spot market, in euro/MWh, multiply by 35.17/3600 (= divide by 102.36 approximately) to get euro/m3
 +
* http://stofradar.nl:9001/naturalgas/flow with daily natural gas flows (MWh/day) in/out the dutch natural gas system
  
Returns a JSON-structure like:
+
Returns JSON-structures like:
 
<pre>
 
<pre>
 
{
 
{
Line 133: Line 152:
 
** most recent known power (megawatt)
 
** most recent known power (megawatt)
 
** hex color, for display on the led ring
 
** hex color, for display on the led ring
 +
 +
<pre>
 +
{
 +
  "current": { "date": "2022-10-30","price": 32.02 },
 +
  "day-ahead": [
 +
    { "date": "2022-10-31", "price": 62.631 },
 +
    { "date": "2022-11-01", "price": 49.293 }
 +
  ]
 +
}
 +
</pre>
  
 
=== Display ===
 
=== Display ===
 +
==== LED ring energy mix ====
 +
[[File:electriciteitsmix.jpg|right|thumb]]
  
==== Powerlight ====
+
Shows the dutch energy generation mix as a pie chart on a LED ring, one colour per source (solar/wind/fossil/etc)
Shows the dutch energy generation mix by source
 
 
Source code: https://github.com/bertrik/PowerLight
 
Source code: https://github.com/bertrik/PowerLight
  
 
The Arduino sketch polls the REST API using HTTP every minute.
 
The Arduino sketch polls the REST API using HTTP every minute.
 +
 +
The sketch auto-detects the number of LEDs in the ring, made possible by feeding the digital output of the last LED back into the microcontroller.
  
 
WiFi is managed by WifiManager. LEDs are controlled using FastLED. JSON content is parsed using ArduinoJSON.
 
WiFi is managed by WifiManager. LEDs are controlled using FastLED. JSON content is parsed using ArduinoJSON.
 +
 +
Hardware that I used:
 +
* Wemos D1 mini, contains an ESP8266 + USB-serial converter
 +
* 24-led pixel ring, for example this one https://nl.aliexpress.com/item/32963152993.html
 +
* "dupont"-cable, you need 4 wires
 +
** wemos 5V to LED ring 5V
 +
** wemos GND to LED ring GND
 +
** wemos D3 to LED ring DI
 +
** wemos D2 to LED ring DO
 +
 +
Firmware installation:
 +
* compiled using platformio
 +
* clone the code from github, enter the PowerLight directory
 +
* <pre>pio run -t upload</pre>
 +
 +
Configuration:
 +
* connect over WiFi to the "ESP-POWERLIGHT" network (no password)
 +
* open page at 192.168.4.1
 +
* enter WiFi credentials (select a network + password)
 +
 +
==== LED ring price clock ====
 +
Idea: display relative electricity price on a clock face.
 +
* LED ring with 24 coloured leds, 2 leds per hour
 +
* colour indicates relative price, green = low, red = high
 +
* indicate current time by making the corresponding LED extra bright
  
 
==== ElectricityPrice ====
 
==== ElectricityPrice ====

Revision as of 16:21, 13 May 2023

Project PowerLight
PowerLight.jpg
Shows mix of dutch electrical power generation as a pie chart on a LED ring
Status Completed
Contact bertrik
Last Update 2023-05-13

The concept

Show the current dutch electrical power generation-mix as pie chart on a LED ring light, with colors representing fractions of a specific power generation source.

For example:

  • yellow: solar
  • blue: wind
  • red: fossil
  • green: nuclear
  • purple: other/waste

Power generation data

Information about energy in Europe is collected at the european organisation https://www.entsoe.eu/ . The section about electrical energy is collected in ENTSO-E. Data is available from this platform at a 15-minute interval.

TenneT is the organisation that supplies ENTSO-E with data from the Netherlands.

Information about ENTSO-E generation domain API: https://transparency.entsoe.eu/content/static_content/Static%20content/web%20api/Guide.html#_generation_domain

Also possibly interesting (requires an API key), but might actually just use the entso-e data: https://static.electricitymap.org/api/docs/index.html#introduction

ENTSO-E data

ENTSO-E distinguishes energy generation into several types ("PsrType"). This is how they are relevant to the data from the Netherlands:

  • B01 (biomass): always 0, not useful
  • B02: not available
  • B03: not available
  • B04 (fossil hard coal): useful
  • B05 (fossil gas): useful
  • B06: not available
  • B07: not available
  • B08: not available
  • B09 (geothermal): not available
  • B10 (hydro): not available
  • B11 (hydro): always 0
  • B12 (hydro): not available
  • B13 (marine): not available
  • B14 (nuclear): useful
  • B15 (other renewable): not available
  • B16 (solar): hugely underreported, *not* useful
  • B17 (waste): useful
  • B18 (wind offshore): useful
  • B19 (wind onshore): useful
  • B20 (other): useful

Additionally, ENTSO-E provides a day-ahead forecast for:

  • B16 (solar)
  • B18 (wind offshore)
  • B19 (wind onshore)

A model for the energy generation mix of the Netherlands

For me, the most insightful information came from this article by Bert Hubert: https://berthub.eu/articles/posts/dutch-electrical-power-figures-2/

Main points relevant for me:

There is a model that estimates the solar fraction, also at a regional level and at fine time resolution, at https://api.netanders.io/ However use of this model requires a paid subscription, so I cant't use that.

In my backend application, energy generation fractions are calculated as follows:

  • solar = B16 (from the time-shifted forecast document A69)
  • wind = B18 (offshore, from generation document A75) + B19 (onshore, from time-shifted forecast document A69)
  • fossil = B04 (gas) + B05 (coal)
  • nuclear = B14
  • waste = B17
  • other = B20

Solar energy values from the forecast document show a systematic shift of about 30 minutes compared to other sources (e.g. sunrise/sunset data from national weather institute KNMI, energieopwek.nl) so forecast data from the ENTSO-E document is shifted by 30 minutes in my model.

In the end, all of the electrical generation data used in my backend application is ENTSO-E data.

Data schedule

Entso-E provides data with a resolution of 15 minutes. It appears to become available about 5m20s after the start of each 15 minute period (:00, :15, :30, :45). At that point, the most recent data is from an interval that ended 30 minutes ago. So, including the 5m20s minute processing delay, the most recent data available is about 35 minutes old.

Hardware

Parts:

Connecting it:

  • Solder the straight pin headers that came with it on the wemos d1 mini
  • Solder the angled pin to the LED ring
  • Connect the dupont cable:
    • Wemos 5V goes to 5V on the LED ring
    • Wemos GND goes to GND on the LED ring
    • Wemos D3 goes to DI on the LED ring
    • Wemos D2 goes to DO on the LED ring

This picture stand printed at 40% size works OK for the 24-LED ring.

Software

The software consists of two parts:

  • The backend part that collects the power generation data, written in Java, running on a VPS
  • The light part that visualizes the power generation as fractions on a LED ring, running on an Arduino

Backend

Source code: https://github.com/bertrik/energymix-server

Runs as a REST-like resource, with the following endpoints:

Returns JSON-structures like:

{
  "time": 1657057500,
  "total": 9122,
  "mix": [
    { "id": "solar", "power": 0, "color": "#FFFF00"},
    { "id": "wind", "power": 4, "color": "#0000FF"},
    { "id": "fossil", "power": 86, "color": "#FF0000"},
    { "id": "nuclear", "power": 5, "color": "#FF00FF"},
    { "id": "other", "power": 4, "color": "#444444"},
    { "id": "waste", "power": 1, "color": "#444444"}
  ]
}
  • time is a unix time stamp in seconds, representing the end of the 15-minute period that the power figures refer to
  • total is the total most recent electrical power (megawatt), suitable for display (on a numeric display inside the ring for example)
  • mix is an array of power sources, each with:
    • a short unique id
    • most recent known power (megawatt)
    • hex color, for display on the led ring
{
  "current": { "date": "2022-10-30","price": 32.02 },
  "day-ahead": [
    { "date": "2022-10-31", "price": 62.631 },
    { "date": "2022-11-01", "price": 49.293 }
  ]
}

Display

LED ring energy mix

Electriciteitsmix.jpg

Shows the dutch energy generation mix as a pie chart on a LED ring, one colour per source (solar/wind/fossil/etc) Source code: https://github.com/bertrik/PowerLight

The Arduino sketch polls the REST API using HTTP every minute.

The sketch auto-detects the number of LEDs in the ring, made possible by feeding the digital output of the last LED back into the microcontroller.

WiFi is managed by WifiManager. LEDs are controlled using FastLED. JSON content is parsed using ArduinoJSON.

Hardware that I used:

  • Wemos D1 mini, contains an ESP8266 + USB-serial converter
  • 24-led pixel ring, for example this one https://nl.aliexpress.com/item/32963152993.html
  • "dupont"-cable, you need 4 wires
    • wemos 5V to LED ring 5V
    • wemos GND to LED ring GND
    • wemos D3 to LED ring DI
    • wemos D2 to LED ring DO

Firmware installation:

  • compiled using platformio
  • clone the code from github, enter the PowerLight directory
  • pio run -t upload

Configuration:

  • connect over WiFi to the "ESP-POWERLIGHT" network (no password)
  • open page at 192.168.4.1
  • enter WiFi credentials (select a network + password)

LED ring price clock

Idea: display relative electricity price on a clock face.

  • LED ring with 24 coloured leds, 2 leds per hour
  • colour indicates relative price, green = low, red = high
  • indicate current time by making the corresponding LED extra bright

ElectricityPrice

Shows the current dutch electricity price, based on the day-ahead prices from yesterday. Source code: https://github.com/bertrik/ElectricityPrice

The Arduino sketch polls the REST price API using HTTP every 5 minutes. WiFi is managed by WifiManager. JSON content is parsed using ArduinoJSON.

Hardware is an ESP8266 controlling a 7-segment display based on a TM1637, on pins D3 and D4.

T-Display
Nlecprice mockup.png

Alternative: use a TTGO ESP32 T-Display.

It has a 240x135 pixel display. Plan is to show a kind of bar graph with 24 bars (one bar for each hour), each bar's height indicates the price of that hour. The background color shows green/black/red, to indicate cheap/moderate/expensive. Current price is shown as a big number.

Each bar is therefore 10 pixels wide, 9 pixels for the bar + 1 pixel separation.

SHA-badge

The SHA2017 badge has an ESP32 capable of performing the HTTP request, processing the JSON and displaying the result on its display. These badges are limited-edition, a few thousand of them were made for the SHA-2017 event and they're no longer being produced.

It has a 296x128 pixel epaper panel. So that could be a bar graph of 24 bars with a width of 12 pixels each, on the bottom 2/3rds of the display, and a current price on the top 1/3rd of the display.

Could be run as a micropython sketch. Alternatively could be run as an Arduino sketch.

Micropython:

  • ++ possibly quick development, script can be shared with other people
  • ++ has working libs for fetching HTTP, decoding JSON, controlling the display
  • -- script needs frequent garbage collection to avoid crashing?
  • -- unclear how to get a python script on this thing
  • -- sha badge firmware bootloops, currently unusable to me

Arduino:

  • ++ I know this environment, don't have to debug existing bootlooping firmware, no compiler setup required
  • ++ Already have HTTP and JSON working on Arduino
  • ++ Code starts immediately, no user interaction required
  • -- not sure if there is a usable epaper driver