Data Import function for MB PRO and NANO SD

This section covers the Meteobridge PRO, PRO2, NANO SD, Raspberry Pi and VM platforms exclusively

Moderator: Mattk

Post Reply
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin »

If you can send data from a time before leaf 4 showed up would help.
User avatar
staze
Gold Boarder
Gold Boarder
Posts: 197
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze »

admin wrote: Sun Jan 27, 2019 5:48 am If you can send data from a time before leaf 4 showed up would help.
Here ya go! It does look like that column has been permanently added to all my exports (or I misremember when I added Meteobridge). But a found a simple little Mac App (Table Tool) that let me remove the column with minimal effort.

Attached!
Attachments
WeatherCat Data Export 2359 Fri Nov 30 2018 to 2357 Mon Dec 31 2018.csv.zip
(128.88 KiB) Downloaded 279 times
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD
kds
Junior Boarder
Junior Boarder
Posts: 24
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds »

ConligWX wrote: Sun Jan 27, 2019 2:47 am My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.
User avatar
ConligWX
Platinum Boarder
Platinum Boarder
Posts: 329
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX »

kds wrote: Sun Jan 27, 2019 7:58 am
ConligWX wrote: Sun Jan 27, 2019 2:47 am My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.
the sql monthly table was extracted in two variants, sql i then converted to a csv as I have some erroneous errors, and differences in unit values to start with.

the sql layout would have been like so:

Code: Select all

INSERT INTO `Monthly` (`LogDateTime`, `Temp`, `Humidity`, `Dewpoint`, `Windspeed`, `Windgust`, `Windbearing`, `RainRate`, `TodayRainSoFar`, `Pressure`, `Raincounter`, `InsideTemp`, `InsideHumidity`, `LatestWindGust`, `WindChill`, `HeatIndex`, `UVindex`, `SolarRad`, `Evapotrans`, `AnnualEvapTran`, `ApparentTemp`, `MaxSolarRad`, `HrsSunShine`, `CurrWindBearing`, `RG11rain`, `RainSinceMidnight`, `WindbearingSym`, `CurrWindBearingSym`) VALUES
('2018-11-30 22:45:00', '4.3', '86', '2.1', '4.0', '8.0', '223', '0.0', '1.2', '1001.66', '553.0', '21.2', '42', '2.0', '2.7', '4.3', '0.0', '0.0', '0.6', '560.4', '1.4', '0.0', '2.1', '213', '0.0', '1.2', 'SW', 'SSW'),
('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:35:00', '4.3', '86', '2.1', '5.0', '12.0', '224', '0.0', '1.2', '1001.66', '553.0', '21.3', '42', '4.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '217', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:30:00', '4.3', '86', '2.1', '5.0', '12.0', '221', '0.0', '1.2', '1001.52', '553.0', '21.4', '42', '9.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '244', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:25:00', '4.2', '86', '2.1', '5.0', '12.0', '218', '0.0', '1.2', '1001.56', '553.0', '21.5', '42', '3.0', '2.2', '4.2', '0.0', '0.0', '0.6', '560.4', '1.0', '0.0', '2.1', '250', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:20:00', '4.1', '87', '2.1', '5.0', '12.0', '213', '0.0', '1.2', '1001.59', '553.0', '21.6', '42', '6.0', '2.1', '4.1', '0.0', '0.0', '0.6', '560.4', '0.9', '0.0', '2.1', '168', '0.0', '1.2', 'SSW', 'SSE'),
my csv was like so as far as I can remeber:

Code: Select all

"2016-04-20 23:15:00","6.6","89","4.9","0.0","1.0","254","0.0","0.0","1027.40","397.4","25.2","41","1.0","6.6","6.6","0.0","0.0","0.0","0.0","5.5","0.0","0.0","257","0.0","0.0","WSW","WSW"
"2016-04-20 23:20:00","6.4","89","4.8","0.0","1.0","256","0.0","0.0","1027.43","397.4","25.2","41","1.0","6.4","6.4","0.0","0.0","0.0","0.0","5.3","0.0","0.0","255","0.0","0.0","WSW","WSW"
"2016-04-20 23:25:00","6.3","89","4.7","0.0","1.0","256","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","256","0.0","0.0","WSW","WSW"
"2016-04-20 23:30:00","6.3","89","4.6","0.0","2.0","259","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","264","0.0","0.0","W","W"
"2016-04-20 23:35:00","6.2","89","4.5","1.0","2.0","264","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.7","0.0","0.0","273","0.0","0.0","W","W"
"2016-04-20 23:40:00","6.2","89","4.5","1.0","2.0","263","0.0","0.0","1027.74","397.4","25.2","41","2.0","6.2","6.2","0.0","0.0","0.0","0.0","4.6","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:45:00","6.2","89","4.5","0.0","2.0","260","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:50:00","6.2","89","4.5","0.0","2.0","270","0.0","0.0","1027.63","397.4","25.1","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
when I imported I only imported about 4 months at a time, since any bigger was maxing out the realtime buffer (100%) so you would loose data coming into the Nano from the Davis console.

First thing however is to backup meteobridge database and configuration each time before an import, just to be extra safe.
kds
Junior Boarder
Junior Boarder
Posts: 24
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds »

Thanks! I'll work on this soon.
mchd17
Senior Boarder
Senior Boarder
Posts: 41
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 »

importing from meteotemplate csv file. all data is in F and meteobridge uses that data as C,


All Time Max
example outdoor temp 58.5C / 137.3F
should be 14.72C / 58.5F

just an FYI
mchd17
Senior Boarder
Senior Boarder
Posts: 41
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 »

Well darnit.....

Deleted database on nano because of F to C problem from above post. Now I am not able to import rain data from console or min/max from console. Ideas on how to get that option back? Whoops!


FIXED, used the manual. Held blue button for 5 blinks. Going through original nano setup again. Looks like import from console is back. Still would like to import history from Meteotemplate csv correctly.

Nope, import from console was there until it rebooted with the sd card.
mchd17
Senior Boarder
Senior Boarder
Posts: 41
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 »

how about a weathercloud csv import? I can export that in Celsius :wink:
User avatar
ConligWX
Platinum Boarder
Platinum Boarder
Posts: 329
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX »

mchd17 wrote: Tue Feb 05, 2019 7:16 pm how about a weathercloud csv import? I can export that in Celsius :wink:
email info @ smartbedded.com with a sample of the csv and see what Boris says.
mchd17
Senior Boarder
Senior Boarder
Posts: 41
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 »

Done, thanks for the suggestion
User avatar
staze
Gold Boarder
Gold Boarder
Posts: 197
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze »

Hi @admin,

any info on being able to import weathercat data?

Thanks!
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD
User avatar
ConligWX
Platinum Boarder
Platinum Boarder
Posts: 329
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX »

staze wrote: Thu Feb 14, 2019 11:18 pm Hi @admin,

any info on being able to import weathercat data?

Thanks!
ConligWX wrote: Tue Feb 05, 2019 7:34 pm
email info @ smartbedded.com with a sample of the csv and see what Boris says.
User avatar
staze
Gold Boarder
Gold Boarder
Posts: 197
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze »

Thanks @conligWX. I had previously uploaded sample files here and he acknowledged them.

Just curious the status of the implementation...
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD
kds
Junior Boarder
Junior Boarder
Posts: 24
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds »

I'm still not able to get Cumulus data imported.

I reconstructed a CSV file according to what ConligWX posted above, and it all imported, but the values are not right... hardly any rainfall is showing up and temperatures of 180+F. I know we're warming up... but not that high!

I'm using regular Cumulus, not Cumulus MX.
User avatar
ConligWX
Platinum Boarder
Platinum Boarder
Posts: 329
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX »

can you post an extract of the data here so we can look at it to check the data is in the same format as mine, though I would need to find where I put my exported stuff:)
Post Reply