Data Import function for MB PRO and NANO SD

[admin]

Addendum: While thinking a minute about this... There might be a problem caused by NANO SD and PRO having different endianness. I am not sure how sqlite database engines handle this. If you like, you can give me a link to a backup of your PRO database and I can throw it to one of my NANO SDs to test. If it works it is the best way to import data for your situation.

[admin]

Just released update provides import of data from Meteohub and Meteoplug. Please read here: https://www.meteobridge.com/wiki/index.php/Forum

This feature is brand new and might still have some quirks. Therefore, please do a database backup before you test it. During my tests it behaved well, but you never know.

More to come...

[BeBe]

When I ordered a back-up (on tab System), MB Pro did a reboot. When the process started, no import funtion on tab History. I did a new reboot, but also no import function on tab history after the restart.

Meteobridge 3.8 (Dec 22 2018, build 12592), FW 1.4

Schermafbeelding 2018-12-22 om 17.50.48.jpg (132.43 KiB) Viewed 5713 times

[MeteoOudkarspel]

The import function is gone Boris

Meteobridge 3.8 (Dec 22 2018, build 12592), FW 1.4

[ConligWX]

I can confirm there is no import feature on the NANO SD history Tab either.

Also just a Query.

The "Historical Data" is on the Live Data Tab, when there is a "History" Tab, just curious as to why Historical Data is not on the History Tab.

[bardek]

no "import" after new firmware update.

by the way what is the format of those meteoplug, meteohub import file?
What about "generic" data format import?

Regrads

[digitalidea]

Boris, I confirm that data migration from MB-Pro to MB-Nano was successfully using your suggestion
Many Thanks

When doing a migration from the PRO to the NANO SD you can simply make a backup on the PRO to a USB stick and then move the backup from the USB stick via your PC into the backup folder of the NANO SD. Being there it can be selected from the NANO as a database backup to install.

To be honest, I did not try myself so far, but I can't see a reason why it should not work. If it does not work, please mail to "info(at)meteobridge.com".

[admin]

Import was still restricted to the units taking part of the beta testing. This way I keep away experimentation from the production version. Unfortunately that flag was still left in the production release, so no joy for you.

It is fixed with just released update and now you can start experimentation.

Does someone have a larger set of weatherlink export files? I would like to import those as well.

Currently we have...
- Meteohub
- Meteoplug
- Meteotemplate
- Cumulus Monthly

[ConligWX]

Import was still restricted to the units taking part of the beta testing. This way I keep away experimentation from the production version. Unfortunately that flag was still left in the production release, so no joy for you.

It is fixed with just released update and now you can start experimentation.
- Cumulus Monthly

Boris. Thank you for this feature. Much Appreciated.

When importing there is a prompt that says "Do you want to import and overwrite existing data from file ?"

As long as the data being imported is older than the exiting Nano data, will the existing data stay or is the whole existing DB wiped?

[admin]

No data is deleted. Data imported is added to the database. If it covers a time frame that already has data, dsta will be replaced by imported one.

I recommend to do a database backup before importing. As said, this is just tested with the few data snippets sent to me and should still be regarded beta. To be honest, it will need your feedback to get a grown-up feature. Anybody being serious in IT will know that data migration is a really complex endeavor.

[stewart45]

a question from the not so tech savvy, I have exported a database from my Meteotemplate data base in csv format is this ok , them how to import onto my nano sd card

[ConligWX]

copy it to the share.

\\IP_ADDRESS_OF_MB\data\import

I tried a CumulsMX import from SQL and csv both files.

Code: Select all

backup (23.12.2018 16:20:11): backup media size is 1.8G (1.7G free).
backup (23.12.2018 16:20:19): backup completed: dbase-201812231620.gz (228.0K)
import (23.12.2018 16:21:58): import of file "cumulus_db.sql" started.
import (23.12.2018 16:21:58): inconsistent timestamp order in line 17: ('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
import (23.12.2018 16:21:58): completed 15 records (0 ignored), 0 db writes

import (23.12.2018 18:36:21): import of file "cumulusmx_monthly.csv" started.
import (23.12.2018 18:36:27): completed 0 records (0 ignored), 0 db writes

so not sure what format or how this works.

[Mattk]

Boris, Have sent you 5 years of zipped (8mb) WeatherLink exported data, unzipped is around 42mb, I have more (longer period) if required

[admin]

copy it to the share.

\\IP_ADDRESS_OF_MB\data\import

I tried a CumulsMX import from SQL and csv both files.

Code: Select all

backup (23.12.2018 16:20:11): backup media size is 1.8G (1.7G free).
backup (23.12.2018 16:20:19): backup completed: dbase-201812231620.gz (228.0K)
import (23.12.2018 16:21:58): import of file "cumulus_db.sql" started.
import (23.12.2018 16:21:58): inconsistent timestamp order in line 17: ('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
import (23.12.2018 16:21:58): completed 15 records (0 ignored), 0 db writes

import (23.12.2018 18:36:21): import of file "cumulusmx_monthly.csv" started.
import (23.12.2018 18:36:27): completed 0 records (0 ignored), 0 db writes

so not sure what format or how this works.

Hi, can you please send the file that does not work to "info(at)smartbedded.com"?

[ConligWX]

Hi, can you please send the file that does not work to "info(at)smartbedded.com"?

Hi Boris, I've just sent the email now. Both csv and sql files are attached.