Page 1 of 2
Question on mapping sensors. **solved**
Posted: Thu May 02, 2024 11:34 am
by grwkak
Hello!
My Meteobridge installation has 3 different weather stations, one of which is a Tempest (Weatherflow).
I had to change out the sensor head under warranty due to issues with UV readings.
When I did so the sensor IDs changed. So for say rain total the sensor rain2!0total was no longer used and instead rain2!1total appeared.
If I want to access/graph both the old and the new data from this station, I assume I need to map sensors:
rain2!0total to rain2!1total or both rain2!0total and rain2!1total (physical) to rain2total (logical)
is this correct - so I can graph data from the old sensors and new in the same graph?
Guy
Re: Question on mapping sensors
Posted: Sat May 04, 2024 12:49 pm
by grwkak
Looking around a bit, seems the data migration tool would be better.
So tested - tried migrating rain2!0total into rain2!1total - both no overwrite then overwrite.
Does not seem to work - my graph of rainfall using rain2!1total does not show the older data.
Running the latest build from May 1st.
Guy
Re: Question on mapping sensors
Posted: Mon May 06, 2024 1:31 am
by davidmc36
I tried Migrate and also did not work. It will cause my data to be all mixed and skewed as I need to switch sensors during seasons.
Re: Question on mapping sensors
Posted: Mon May 06, 2024 10:21 am
by Gyvate
I'm not sure what migration tool you are using (mind to share ?) - but I have (as part of a backup concept) daily CSV exports - which you can also make at least for the last year.
What I would do is export the old and new data - start the database from scratch again and then see what sensors are being used my MB.
Then modify the sensor names where necessary and import the whole stuff - this should work properly.
Can be nicely done with either Excel or Notepad++ (or a combination)
For import I used the MB raw format - needed some sorting to have all data grouped for all sensors in minute based chunks
Had to do this before as data were corrupted and the restore from before corruption would have left too big a gap.
It worked well - and I have four stations with ~30 sensor values per minute - took some time, but my RPi4B would do the job well.
One such station with a MB Pro would have taken ages - MB Pro2 maybe somewhat shorter.
Re: Question on mapping sensors
Posted: Mon May 06, 2024 11:51 am
by davidmc36
Gyvate wrote: ↑Mon May 06, 2024 10:21 am
I'm not sure what migration tool you are using (mind to share ?) .....
Ummmm, the Data Migration section under the Administration tab of MB of course.
Re: Question on mapping sensors
Posted: Mon May 06, 2024 12:29 pm
by Gyvate
you mean (meanwhile) under "Database" --> "Administration" ...
I thought there something more behind the term "tool ..."
Anyway, I prefer the "classical" approach as described earlier - always works (has to)
one could also make a SQL dump, modify the data and a SQL import, but I suppose that at the end of the day the raw data import is the same behind the scene.
Re: Question on mapping sensors
Posted: Mon May 06, 2024 10:38 pm
by grwkak
May try that eventually, but I prefer the "simpler" approach within the user interface.
Maybe there is still a bug - the latest release mentions that it was to fix an issue with data migration.
Guy
Re: Question on mapping sensors
Posted: Tue May 14, 2024 11:27 am
by grwkak
@admin - any chance you can recheck the data migration function for errors?
Guy
Re: Question on mapping sensors
Posted: Tue May 14, 2024 2:26 pm
by admin
Latest version from May 1st should have it working, which are you using?
Re: Question on mapping sensors
Posted: Tue May 14, 2024 11:31 pm
by grwkak
Meteobridge 5.9 (May 1 2024, build 3292), FW 1.3
Re: Question on mapping sensors
Posted: Wed May 15, 2024 3:39 pm
by admin
hm, any error messages or notifications in the log file? I tested with my system and logs tell me that migration is done. Not on your side?
Re: Question on mapping sensors
Posted: Wed May 15, 2024 5:50 pm
by grwkak
It tells me migration is done. But when I try to use the data from that sensor (graph) - nothing shows.
I have rainfall data from my old Tempest sensor - does not graph when I migrate to the new sensor. Tried overwrite/no overwrite.
dbase (04.05.2024 06:42:26): reconstruction for sensor "rain2!1total" done in 0 secs.
dbase (04.05.2024 06:42:26): merged data (no overwrite) from sensor "rain2!0total" into sensor "rain2!1total" in 1 secs.
dbase (04.05.2024 06:44:21): reconstruction for sensor "rain2!1total" done in 0 secs.
dbase (04.05.2024 06:44:21): merged data (overwrite) from sensor "rain2!0total" into sensor "rain2!1total" in 1 secs.
dbase (04.05.2024 06:55:18): reconstruction for sensor "rain2!1rate" done in 0 secs.
dbase (04.05.2024 06:55:18): merged data (no overwrite) from sensor "rain2!0rate" into sensor "rain2!1rate" in 1 secs.
Guy
Re: Question on mapping sensors
Posted: Wed May 15, 2024 6:32 pm
by admin
Thanks, will check next week (currently on travel).
Re: Question on mapping sensors
Posted: Thu May 16, 2024 11:38 am
by grwkak
Thanks, that would be appreciated.
Guy
Re: Question on mapping sensors
Posted: Tue May 21, 2024 10:32 am
by admin
I tested to copy data from "th0temp" to "thb0temp". That worked, when I marked "overwrite existing data" flag. Not selecting this tells Meteobridge not to override data for time stamps where already is old data.