RPI: issue during import meteohub data **solved**

This section covers the Meteobridge PRO, PRO2, NANO SD, Raspberry Pi and VM platforms exclusively

Moderator: Mattk

Post Reply
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

RPI: issue during import meteohub data **solved**

Post by jpouyaud »

hi,

looks like we have an issue with the import filter

I've imported a bunch of RAW meteohub (coming from a vantage pro2) data

I see some spike with Dewpoint external temp (th0)

original raw
20180226074851 th0 -23 55 -101

-23 means -2.3 °C for temp
55 means 55% humidity
-101 means -10.1 °C for dew temp

the imported dew temp value peak to -100°C when the original dew temp is <= -10°C
Capture d’écran 2021-08-15 à 18.46.29.png
Capture d’écran 2021-08-15 à 18.46.29.png (180.54 KiB) Viewed 1466 times
here is the extract of meteohub documentation, looks like the digit change

for th#
temperature [1/10 °C]
humidity (0-100) [%]
dew point [°C] (or 1/10 °C when number has leading 0)
Attachments
Capture d’écran 2021-08-15 à 18.46.44.jpg
Capture d’écran 2021-08-15 à 18.46.44.jpg (205.32 KiB) Viewed 1466 times
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

Re: RPI: issue during import meteohub data

Post by jpouyaud »

I'm continuing investigation. Windchill looks the same

wind direction (0-355)
gust speed (0-...) [1/10 m/s]
average speed (0-...) [1/10 m/s]
windchill [°C] (or 1/10 °C when number has leading 0)
Attachments
Capture d’écran 2021-08-15 à 19.35.22.png
Capture d’écran 2021-08-15 à 19.35.22.png (117.42 KiB) Viewed 1464 times
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

Re: RPI: issue during import meteohub data

Post by jpouyaud »

ok
for a reason I ignore, my initial meteohub raw data are not well formed:
-when the temp is below -10°. the 0 is not appended at the beginning, it should be as it's a xx,x value
looks like the issue is from meteohub

if someone have a solution, I will take it.

I'm thinking about a Regex...
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

Re: RPI: issue during import meteohub data

Post by jpouyaud »

ok, I've managed to fix the issue which was generated by meteohub

to recap

the leading 0 was missing for value when temperature <=10 °C

here is a sample
20180226074851 th0 -23 55 -101

it should be 20180226074851 th0 -23 55 -0101

so I've made 2 pass with sed command
sed 's/\(-1[0-9][0-9]\)/-0\1/g' original_raw > modify_raw_pass1

it search for -1xx value and append -0 to it

sed 's/-0-/-0/' modify_raw_pass1 > modify_raw_pass2

it replace -0- by -0

I will now double check if my data are fine
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: RPI: issue during import meteohub data

Post by admin »

Thanks for spotting this. Just released update should have this bug fixed.
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

Re: RPI: issue during import meteohub data **solved**

Post by jpouyaud »

cool

If I've understood well, you are talking about a fix on Meteohub side, right ?

cheers
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: RPI: issue during import meteohub data **solved**

Post by admin »

No, import function on Meteobridge has been fixed to handle the original Meteohub raw data.
jpouyaud
Junior Boarder
Junior Boarder
Posts: 35
Joined: Sun Sep 19, 2010 2:53 pm

Re: RPI: issue during import meteohub data **solved**

Post by jpouyaud »

great

thank you
Post Reply