RPI Meteobridge Import Data from MeteoPlug - *solved*

[grwkak]

Successfully installed Meteobridge on RPI 4B. Set-up all my weather services. I am trying to import my Meteoplug data.
I have exported the data, unzipped the file and then placed in the import network folder on the RPI. Just trying Dec and Nov 2020 for now.
I get an import start message after selecting the correct file and format. But the data do not seem to import at all.
Any suggestions? I am still on the trial license as I am going to transfer from my other Meteobridge.

Guy

[hymrog]

Hi

What does the log report? Also, see the wiki for importing into the MB Pro, that is process I followed to upload data from 2014 to present.


g

[grwkak]

Will try again and see what the log file reports. Right now all I see is:
Import (25.12.2020 17:05:37): import of file "XXXXXXX-2020-09" (42436 kb) started: type 2, mode 0 (XXX is the MAC address so I have hidden it).
This is one month of data - which could be extensive from what the WiKI says.
Nov and Dec seem to show up in the almanac section of the Weather Dashboard (shows high temps etc).
I think I may be confused as to where it will show up. I was hoping to:
Stop my old Meteobridge
Start and configure the new (RPI) - connected to the same weather station
Setup the same weather uploads etc
Import MeteoPlug data and then use that in the graphing functions etc

Guy

[grwkak]

Not sure what this means.
import (25.12.2020 17:05:37): import of file "XXX-2020-09" (42436 kb) started: type 2, mode 0
import (25.12.2020 20:36:10): import of file "XXX-2020-08" (43741 kb) started: type 2, mode 0
import (25.12.2020 21:12:19): import of file "XXX-2020-07" (43555 kb) started: type 2, mode 0
import (25.12.2020 21:16:20): import of file "XXX-2020-07" reached 18% (up to line 185900).
import (25.12.2020 21:20:37): import of file "XXX-2020-07" reached 37% (up to line 374031).
import (25.12.2020 21:24:43): import of file "XXX-2020-07" reached 57% (up to line 563550).
import (25.12.2020 21:29:57): import of file "XXX-2020-07" reached 76% (up to line 753560).
import (25.12.2020 21:35:11): import of file "XXX-2020-07" reached 95% (up to line 942275).
import (25.12.2020 21:36:53): completed 986499 lines, performing 678204 database updates.
import (25.12.2020 21:43:04): import of file "DC_A6_32_9B_F3_19-2020-09" (42436 kb) started: type 2, mode 1

One file seems to have uploaded. Tried a previous file with ignore bad data enabled.

Guy

[grwkak]

Update - some files load, others show no progress messages.

Guy

[hymrog]

It looks like you did have had some success as it looks like the same message I received when I uploaded my files. To confirm if your upload was successful you can look on History Tab then check Edit Hour Data tab and you should entries for the thOtemp etc.

Although, it is a pain I would follow the instructions in the wiki regarding how to upload meteoplug data to the PRO.The link for the PRO Tutorial is below once there go to the Data Import instrucitons.

https://meteobridge.com/wiki/index.php/PRO_Tutorial

Also, you can combine more than one month for your uploads, I found combining 3 months of data in to one upload file was sufficient enough to allow for a quck upload without any errors.

Are there any error messages for the files that did not upload?

g

[grwkak]

Thanks! I see no error messages.

Checking history and hourly data looks like some success! Let me try a few more and see what happens.

Guy

[grwkak]

Definitely, no error messages that tell me why the import does not succeed.

When it does succeed it shows the 10% completion messages posted above.

Edit: Some files are partially imported - maybe only a few days.

Looking at the content of the files using notepad - nothing stands out between files that are successful and those that are not.

Guy

[admin]

Can you please share what the Meteobridge messages section says about the import?
Can you please send the file to "info(at)meteobriodge.com" so that I can try with my rig?

[grwkak]

A successful import says:

import (25.12.2020 21:12:19): import of file "XXX-2020-07" (43555 kb) started: type 2, mode 0
import (25.12.2020 21:16:20): import of file "XXX-2020-07" reached 18% (up to line 185900).
import (25.12.2020 21:20:37): import of file "XXX-2020-07" reached 37% (up to line 374031).
import (25.12.2020 21:24:43): import of file "XXX-2020-07" reached 57% (up to line 563550).
import (25.12.2020 21:29:57): import of file "XXX-2020-07" reached 76% (up to line 753560).
import (25.12.2020 21:35:11): import of file "XXX-2020-07" reached 95% (up to line 942275).
import (25.12.2020 21:36:53): completed 986499 lines, performing 678204 database updates.

One that does not seem to work is:

import (25.12.2020 21:43:04): import of file "XXX-2020-09" (42436 kb) started: type 2, mode 1

The message says it started but then nothing else happens or no further messages appear.

Guy

[admin]

I tried with your files and both went fine.

Code: Select all

import (27.12.2020 15:19:41): import of file "2020-09" (42436 kb) started: type 2, mode 0
import (27.12.2020 15:23:42): import of file "2020-09" reached 17% (up to line 169196).
import (27.12.2020 15:29:34): import of file "2020-09" reached 35% (up to line 337306).
import (27.12.2020 15:35:14): import of file "2020-09" reached 53% (up to line 513804).
import (27.12.2020 15:39:36): import of file "2020-09" reached 70% (up to line 683477).
import (27.12.2020 15:44:03): import of file "2020-09" reached 88% (up to line 857297).
import (27.12.2020 15:48:37): completed 962400 lines, performing  655531 database updates.
import (27.12.2020 16:04:49): import of file "2020-08" (43741 kb) started: type 2, mode 0
import (27.12.2020 16:08:50): import of file "2020-08" reached 17% (up to line 173116).
import (27.12.2020 16:14:47): import of file "2020-08" reached 35% (up to line 350033).
import (27.12.2020 16:20:26): import of file "2020-08" reached 53% (up to line 526008).
import (27.12.2020 16:24:43): import of file "2020-08" reached 70% (up to line 699361).
import (27.12.2020 16:30:38): import of file "2020-08" reached 87% (up to line 870028).
import (27.12.2020 16:39:12): completed 991293 lines, performing  675124 database updates.

[grwkak]

Interesting - that rules out the files as an issue.

Guy

[grwkak]

Even renamed file to shorten it (extreme long shot) - the same issue with 2020-08. Basically chokes somehow.

Guy

[grwkak]

Decided to start fresh. Downloaded new copy of the disk image, burned to Micro SD Card, set-up Meteobridge from a backup of the configuration.

Used Etcher, not Raspberry Pi Imager.

Hmm, 2020-12 is now loading. I will see if others load. Maybe it was an issue with the disk image.

Guy

[grwkak]

Update - successfully imported 9 months of MeteoPlug exports. Right now a reimaging of the micro-sd seems to have helped.

Guy