Question on mapping sensors. **solved**

This section covers the Meteobridge PRO, PRO2, NANO SD, Raspberry Pi and VM platforms exclusively

Moderator: Mattk

grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Question on mapping sensors. **solved**

Post by grwkak »

Hello!

My Meteobridge installation has 3 different weather stations, one of which is a Tempest (Weatherflow).
I had to change out the sensor head under warranty due to issues with UV readings.
When I did so the sensor IDs changed. So for say rain total the sensor rain2!0total was no longer used and instead rain2!1total appeared.
If I want to access/graph both the old and the new data from this station, I assume I need to map sensors:

rain2!0total to rain2!1total or both rain2!0total and rain2!1total (physical) to rain2total (logical)

is this correct - so I can graph data from the old sensors and new in the same graph?

Guy
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

Looking around a bit, seems the data migration tool would be better.

So tested - tried migrating rain2!0total into rain2!1total - both no overwrite then overwrite.

Does not seem to work - my graph of rainfall using rain2!1total does not show the older data.

Running the latest build from May 1st.

Guy
User avatar
davidmc36
Expert Boarder
Expert Boarder
Posts: 87
Joined: Wed Apr 10, 2024 7:33 pm

Re: Question on mapping sensors

Post by davidmc36 »

I tried Migrate and also did not work. It will cause my data to be all mixed and skewed as I need to switch sensors during seasons.
User avatar
Gyvate
Platinum Boarder
Platinum Boarder
Posts: 453
Joined: Thu May 14, 2020 4:36 pm
Location: Saarbrücken, Germany

Re: Question on mapping sensors

Post by Gyvate »

I'm not sure what migration tool you are using (mind to share ?) - but I have (as part of a backup concept) daily CSV exports - which you can also make at least for the last year.
What I would do is export the old and new data - start the database from scratch again and then see what sensors are being used my MB.
Then modify the sensor names where necessary and import the whole stuff - this should work properly.
Can be nicely done with either Excel or Notepad++ (or a combination)
For import I used the MB raw format - needed some sorting to have all data grouped for all sensors in minute based chunks

Had to do this before as data were corrupted and the restore from before corruption would have left too big a gap.
It worked well - and I have four stations with ~30 sensor values per minute - took some time, but my RPi4B would do the job well.
One such station with a MB Pro would have taken ages - MB Pro2 maybe somewhat shorter.
WH4000SE 1.6.6/1 x DP1500/4 x GW1000 1.7.7/GW1100 2.3.0/HP1000SE Pro 1.9.3//2 x WH2650 1.7.7/GW2000 3.1.0
2xMeteobridge Pro [B+R] 15161, 2xRPi4B-2GB/16/32 3139,VM128 1704
Weather Landing page: https://meshka.eu
Ecowitt WiKi: https://meshka.eu/Ecowitt/dokuwiki
User avatar
davidmc36
Expert Boarder
Expert Boarder
Posts: 87
Joined: Wed Apr 10, 2024 7:33 pm

Re: Question on mapping sensors

Post by davidmc36 »

Gyvate wrote: Mon May 06, 2024 10:21 am I'm not sure what migration tool you are using (mind to share ?) .....
Ummmm, the Data Migration section under the Administration tab of MB of course.
User avatar
Gyvate
Platinum Boarder
Platinum Boarder
Posts: 453
Joined: Thu May 14, 2020 4:36 pm
Location: Saarbrücken, Germany

Re: Question on mapping sensors

Post by Gyvate »

you mean (meanwhile) under "Database" --> "Administration" ...
I thought there something more behind the term "tool ..."

Anyway, I prefer the "classical" approach as described earlier - always works (has to) 8)

one could also make a SQL dump, modify the data and a SQL import, but I suppose that at the end of the day the raw data import is the same behind the scene.
WH4000SE 1.6.6/1 x DP1500/4 x GW1000 1.7.7/GW1100 2.3.0/HP1000SE Pro 1.9.3//2 x WH2650 1.7.7/GW2000 3.1.0
2xMeteobridge Pro [B+R] 15161, 2xRPi4B-2GB/16/32 3139,VM128 1704
Weather Landing page: https://meshka.eu
Ecowitt WiKi: https://meshka.eu/Ecowitt/dokuwiki
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

May try that eventually, but I prefer the "simpler" approach within the user interface.
Maybe there is still a bug - the latest release mentions that it was to fix an issue with data migration.

Guy
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

@admin - any chance you can recheck the data migration function for errors?

Guy
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: Question on mapping sensors

Post by admin »

Latest version from May 1st should have it working, which are you using?
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

Meteobridge 5.9 (May 1 2024, build 3292), FW 1.3
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: Question on mapping sensors

Post by admin »

hm, any error messages or notifications in the log file? I tested with my system and logs tell me that migration is done. Not on your side?
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

It tells me migration is done. But when I try to use the data from that sensor (graph) - nothing shows.

I have rainfall data from my old Tempest sensor - does not graph when I migrate to the new sensor. Tried overwrite/no overwrite.

dbase (04.05.2024 06:42:26): reconstruction for sensor "rain2!1total" done in 0 secs.
dbase (04.05.2024 06:42:26): merged data (no overwrite) from sensor "rain2!0total" into sensor "rain2!1total" in 1 secs.
dbase (04.05.2024 06:44:21): reconstruction for sensor "rain2!1total" done in 0 secs.
dbase (04.05.2024 06:44:21): merged data (overwrite) from sensor "rain2!0total" into sensor "rain2!1total" in 1 secs.
dbase (04.05.2024 06:55:18): reconstruction for sensor "rain2!1rate" done in 0 secs.
dbase (04.05.2024 06:55:18): merged data (no overwrite) from sensor "rain2!0rate" into sensor "rain2!1rate" in 1 secs.

Guy
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: Question on mapping sensors

Post by admin »

Thanks, will check next week (currently on travel).
grwkak
Gold Boarder
Gold Boarder
Posts: 183
Joined: Thu Jan 30, 2014 2:15 am

Re: Question on mapping sensors

Post by grwkak »

Thanks, that would be appreciated.

Guy
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: Question on mapping sensors

Post by admin »

I tested to copy data from "th0temp" to "thb0temp". That worked, when I marked "overwrite existing data" flag. Not selecting this tells Meteobridge not to override data for time stamps where already is old data.
Post Reply