Data Import function for MB PRO and NANO SD

This section covers the Meteobridge PRO units exclusively

Moderator: Mattk

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5601
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Fri Dec 21, 2018 1:18 am

Addendum: While thinking a minute about this... There might be a problem caused by NANO SD and PRO having different endianness. I am not sure how sqlite database engines handle this. If you like, you can give me a link to a backup of your PRO database and I can throw it to one of my NANO SDs to test. If it works it is the best way to import data for your situation.

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5601
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Sat Dec 22, 2018 5:37 pm

Just released update provides import of data from Meteohub and Meteoplug. Please read here: https://www.meteobridge.com/wiki/index.php/Forum

This feature is brand new and might still have some quirks. Therefore, please do a database backup before you test it. During my tests it behaved well, but you never know. :D

More to come...

BeBe
Junior Boarder
Junior Boarder
Posts: 21
Joined: Fri Feb 12, 2016 6:36 pm
Location: Grou
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by BeBe » Sat Dec 22, 2018 6:58 pm

When I ordered a back-up (on tab System), MB Pro did a reboot. When the process started, no import funtion on tab History. I did a new reboot, but also no import function on tab history after the restart. :?:

Meteobridge 3.8 (Dec 22 2018, build 12592), FW 1.4
Schermafbeelding 2018-12-22 om 17.50.48.jpg
Schermafbeelding 2018-12-22 om 17.50.48.jpg (132.43 KiB) Viewed 315 times

MeteoOudkarspel
Senior Boarder
Senior Boarder
Posts: 69
Joined: Wed Jun 10, 2015 12:53 pm
Location: Oudkarspel
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by MeteoOudkarspel » Sat Dec 22, 2018 7:24 pm

The import function is gone Boris

Meteobridge 3.8 (Dec 22 2018, build 12592), FW 1.4
Attachments
2018-12-22.png
2018-12-22.png (126.01 KiB) Viewed 310 times
Sincerely,

Ron C.P.J Overtoom Meteo Oudkarspel Municipality Langedijk.

Image

http://www.meteooudkarspel-lt.pd0rok.nl

User avatar
ConligWX
Expert Boarder
Expert Boarder
Posts: 136
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Sat Dec 22, 2018 10:02 pm

I can confirm there is no import feature on the NANO SD history Tab either.

Also just a Query.

The "Historical Data" is on the Live Data Tab, when there is a "History" Tab, just curious as to why Historical Data is not on the History Tab.

bardek
Junior Boarder
Junior Boarder
Posts: 36
Joined: Fri Jan 16, 2015 7:49 pm
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by bardek » Sat Dec 22, 2018 10:15 pm

no "import" after new firmware update.

by the way what is the format of those meteoplug, meteohub import file?
What about "generic" data format import?

Regrads

digitalidea
Fresh Boarder
Fresh Boarder
Posts: 6
Joined: Mon Aug 27, 2012 2:16 pm

Re: Data Import function for MB PRO and NANO SD

Post by digitalidea » Sun Dec 23, 2018 8:42 am

Boris, I confirm that data migration from MB-Pro to MB-Nano was successfully using your suggestion
Many Thanks
admin wrote:
Fri Dec 21, 2018 1:14 am
When doing a migration from the PRO to the NANO SD you can simply make a backup on the PRO to a USB stick and then move the backup from the USB stick via your PC into the backup folder of the NANO SD. Being there it can be selected from the NANO as a database backup to install.

To be honest, I did not try myself so far, but I can't see a reason why it should not work. If it does not work, please mail to "info(at)meteobridge.com".

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5601
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Sun Dec 23, 2018 5:15 pm

Import was still restricted to the units taking part of the beta testing. This way I keep away experimentation from the production version. Unfortunately that flag was still left in the production release, so no joy for you. :oops:

It is fixed with just released update and now you can start experimentation.

Does someone have a larger set of weatherlink export files? I would like to import those as well.

Currently we have...
- Meteohub
- Meteoplug
- Meteotemplate
- Cumulus Monthly

User avatar
ConligWX
Expert Boarder
Expert Boarder
Posts: 136
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Sun Dec 23, 2018 5:49 pm

admin wrote:
Sun Dec 23, 2018 5:15 pm
Import was still restricted to the units taking part of the beta testing. This way I keep away experimentation from the production version. Unfortunately that flag was still left in the production release, so no joy for you. :oops:

It is fixed with just released update and now you can start experimentation.
- Cumulus Monthly
Boris. Thank you for this feature. Much Appreciated.

When importing there is a prompt that says "Do you want to import and overwrite existing data from file ?"

As long as the data being imported is older than the exiting Nano data, will the existing data stay or is the whole existing DB wiped?

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5601
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Sun Dec 23, 2018 6:12 pm

No data is deleted. Data imported is added to the database. If it covers a time frame that already has data, dsta will be replaced by imported one.

I recommend to do a database backup before importing. As said, this is just tested with the few data snippets sent to me and should still be regarded beta. To be honest, it will need your feedback to get a grown-up feature. Anybody being serious in IT will know that data migration is a really complex endeavor.

stewart45
Fresh Boarder
Fresh Boarder
Posts: 12
Joined: Tue Dec 16, 2014 6:43 pm

Re: Data Import function for MB PRO and NANO SD

Post by stewart45 » Sun Dec 23, 2018 7:38 pm

a question from the not so tech savvy, I have exported a database from my Meteotemplate data base in csv format is this ok , them how to import onto my nano sd card

User avatar
ConligWX
Expert Boarder
Expert Boarder
Posts: 136
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Sun Dec 23, 2018 8:20 pm

copy it to the share.

\\IP_ADDRESS_OF_MB\data\import

I tried a CumulsMX import from SQL and csv both files.

Code: Select all

backup (23.12.2018 16:20:11): backup media size is 1.8G (1.7G free).
backup (23.12.2018 16:20:19): backup completed: dbase-201812231620.gz (228.0K)
import (23.12.2018 16:21:58): import of file "cumulus_db.sql" started.
import (23.12.2018 16:21:58): inconsistent timestamp order in line 17: ('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
import (23.12.2018 16:21:58): completed 15 records (0 ignored), 0 db writes

import (23.12.2018 18:36:21): import of file "cumulusmx_monthly.csv" started.
import (23.12.2018 18:36:27): completed 0 records (0 ignored), 0 db writes
so not sure what format or how this works.

Mattk
Platinum Boarder
Platinum Boarder
Posts: 636
Joined: Mon Sep 22, 2014 3:24 am

Re: Data Import function for MB PRO and NANO SD

Post by Mattk » Sun Dec 23, 2018 10:19 pm

Boris, Have sent you 5 years of zipped (8mb) WeatherLink exported data, unzipped is around 42mb, I have more (longer period) if required

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5601
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Sun Dec 23, 2018 11:03 pm

ConligWX wrote:
Sun Dec 23, 2018 8:20 pm
copy it to the share.

\\IP_ADDRESS_OF_MB\data\import

I tried a CumulsMX import from SQL and csv both files.

Code: Select all

backup (23.12.2018 16:20:11): backup media size is 1.8G (1.7G free).
backup (23.12.2018 16:20:19): backup completed: dbase-201812231620.gz (228.0K)
import (23.12.2018 16:21:58): import of file "cumulus_db.sql" started.
import (23.12.2018 16:21:58): inconsistent timestamp order in line 17: ('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
import (23.12.2018 16:21:58): completed 15 records (0 ignored), 0 db writes

import (23.12.2018 18:36:21): import of file "cumulusmx_monthly.csv" started.
import (23.12.2018 18:36:27): completed 0 records (0 ignored), 0 db writes
so not sure what format or how this works.
Hi, can you please send the file that does not work to "info(at)smartbedded.com"?

User avatar
ConligWX
Expert Boarder
Expert Boarder
Posts: 136
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Mon Dec 24, 2018 2:19 am

admin wrote:
Sun Dec 23, 2018 11:03 pm
Hi, can you please send the file that does not work to "info(at)smartbedded.com"?
Hi Boris, I've just sent the email now. Both csv and sql files are attached.

Post Reply