Data Import function for MB PRO and NANO SD

This section covers the Meteobridge PRO units exclusively

Moderator: Mattk

User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 5788
Joined: Mon Oct 01, 2007 10:51 pm

Re: Data Import function for MB PRO and NANO SD

Post by admin » Sun Jan 27, 2019 5:48 am

If you can send data from a time before leaf 4 showed up would help.

User avatar
staze
Senior Boarder
Senior Boarder
Posts: 79
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze » Sun Jan 27, 2019 6:19 am

admin wrote:
Sun Jan 27, 2019 5:48 am
If you can send data from a time before leaf 4 showed up would help.
Here ya go! It does look like that column has been permanently added to all my exports (or I misremember when I added Meteobridge). But a found a simple little Mac App (Table Tool) that let me remove the column with minimal effort.

Attached!
Attachments
WeatherCat Data Export 2359 Fri Nov 30 2018 to 2357 Mon Dec 31 2018.csv.zip
(128.88 KiB) Downloaded 15 times
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD

kds
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds » Sun Jan 27, 2019 7:58 am

ConligWX wrote:
Sun Jan 27, 2019 2:47 am
My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.

User avatar
ConligWX
Gold Boarder
Gold Boarder
Posts: 194
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Sun Jan 27, 2019 12:58 pm

kds wrote:
Sun Jan 27, 2019 7:58 am
ConligWX wrote:
Sun Jan 27, 2019 2:47 am
My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.
the sql monthly table was extracted in two variants, sql i then converted to a csv as I have some erroneous errors, and differences in unit values to start with.

the sql layout would have been like so:

Code: Select all

INSERT INTO `Monthly` (`LogDateTime`, `Temp`, `Humidity`, `Dewpoint`, `Windspeed`, `Windgust`, `Windbearing`, `RainRate`, `TodayRainSoFar`, `Pressure`, `Raincounter`, `InsideTemp`, `InsideHumidity`, `LatestWindGust`, `WindChill`, `HeatIndex`, `UVindex`, `SolarRad`, `Evapotrans`, `AnnualEvapTran`, `ApparentTemp`, `MaxSolarRad`, `HrsSunShine`, `CurrWindBearing`, `RG11rain`, `RainSinceMidnight`, `WindbearingSym`, `CurrWindBearingSym`) VALUES
('2018-11-30 22:45:00', '4.3', '86', '2.1', '4.0', '8.0', '223', '0.0', '1.2', '1001.66', '553.0', '21.2', '42', '2.0', '2.7', '4.3', '0.0', '0.0', '0.6', '560.4', '1.4', '0.0', '2.1', '213', '0.0', '1.2', 'SW', 'SSW'),
('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:35:00', '4.3', '86', '2.1', '5.0', '12.0', '224', '0.0', '1.2', '1001.66', '553.0', '21.3', '42', '4.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '217', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:30:00', '4.3', '86', '2.1', '5.0', '12.0', '221', '0.0', '1.2', '1001.52', '553.0', '21.4', '42', '9.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '244', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:25:00', '4.2', '86', '2.1', '5.0', '12.0', '218', '0.0', '1.2', '1001.56', '553.0', '21.5', '42', '3.0', '2.2', '4.2', '0.0', '0.0', '0.6', '560.4', '1.0', '0.0', '2.1', '250', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:20:00', '4.1', '87', '2.1', '5.0', '12.0', '213', '0.0', '1.2', '1001.59', '553.0', '21.6', '42', '6.0', '2.1', '4.1', '0.0', '0.0', '0.6', '560.4', '0.9', '0.0', '2.1', '168', '0.0', '1.2', 'SSW', 'SSE'),
my csv was like so as far as I can remeber:

Code: Select all

"2016-04-20 23:15:00","6.6","89","4.9","0.0","1.0","254","0.0","0.0","1027.40","397.4","25.2","41","1.0","6.6","6.6","0.0","0.0","0.0","0.0","5.5","0.0","0.0","257","0.0","0.0","WSW","WSW"
"2016-04-20 23:20:00","6.4","89","4.8","0.0","1.0","256","0.0","0.0","1027.43","397.4","25.2","41","1.0","6.4","6.4","0.0","0.0","0.0","0.0","5.3","0.0","0.0","255","0.0","0.0","WSW","WSW"
"2016-04-20 23:25:00","6.3","89","4.7","0.0","1.0","256","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","256","0.0","0.0","WSW","WSW"
"2016-04-20 23:30:00","6.3","89","4.6","0.0","2.0","259","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","264","0.0","0.0","W","W"
"2016-04-20 23:35:00","6.2","89","4.5","1.0","2.0","264","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.7","0.0","0.0","273","0.0","0.0","W","W"
"2016-04-20 23:40:00","6.2","89","4.5","1.0","2.0","263","0.0","0.0","1027.74","397.4","25.2","41","2.0","6.2","6.2","0.0","0.0","0.0","0.0","4.6","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:45:00","6.2","89","4.5","0.0","2.0","260","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:50:00","6.2","89","4.5","0.0","2.0","270","0.0","0.0","1027.63","397.4","25.1","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
when I imported I only imported about 4 months at a time, since any bigger was maxing out the realtime buffer (100%) so you would loose data coming into the Nano from the Davis console.

First thing however is to backup meteobridge database and configuration each time before an import, just to be extra safe.

kds
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds » Sun Jan 27, 2019 7:12 pm

Thanks! I'll work on this soon.

mchd17
Junior Boarder
Junior Boarder
Posts: 32
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 » Mon Feb 04, 2019 7:36 pm

importing from meteotemplate csv file. all data is in F and meteobridge uses that data as C,


All Time Max
example outdoor temp 58.5C / 137.3F
should be 14.72C / 58.5F

just an FYI

mchd17
Junior Boarder
Junior Boarder
Posts: 32
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 » Tue Feb 05, 2019 1:26 am

Well darnit.....

Deleted database on nano because of F to C problem from above post. Now I am not able to import rain data from console or min/max from console. Ideas on how to get that option back? Whoops!


FIXED, used the manual. Held blue button for 5 blinks. Going through original nano setup again. Looks like import from console is back. Still would like to import history from Meteotemplate csv correctly.

Nope, import from console was there until it rebooted with the sd card.

mchd17
Junior Boarder
Junior Boarder
Posts: 32
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 » Tue Feb 05, 2019 7:16 pm

how about a weathercloud csv import? I can export that in Celsius :wink:

User avatar
ConligWX
Gold Boarder
Gold Boarder
Posts: 194
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Tue Feb 05, 2019 7:34 pm

mchd17 wrote:
Tue Feb 05, 2019 7:16 pm
how about a weathercloud csv import? I can export that in Celsius :wink:
email info @ smartbedded.com with a sample of the csv and see what Boris says.

mchd17
Junior Boarder
Junior Boarder
Posts: 32
Joined: Tue Mar 20, 2018 11:40 pm

Re: Data Import function for MB PRO and NANO SD

Post by mchd17 » Tue Feb 05, 2019 9:33 pm

Done, thanks for the suggestion

User avatar
staze
Senior Boarder
Senior Boarder
Posts: 79
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze » Thu Feb 14, 2019 11:18 pm

Hi @admin,

any info on being able to import weathercat data?

Thanks!
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD

User avatar
ConligWX
Gold Boarder
Gold Boarder
Posts: 194
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Fri Feb 15, 2019 12:55 am

staze wrote:
Thu Feb 14, 2019 11:18 pm
Hi @admin,

any info on being able to import weathercat data?

Thanks!
ConligWX wrote:
Tue Feb 05, 2019 7:34 pm

email info @ smartbedded.com with a sample of the csv and see what Boris says.

User avatar
staze
Senior Boarder
Senior Boarder
Posts: 79
Joined: Fri Jan 18, 2019 2:56 am
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by staze » Fri Feb 15, 2019 1:24 am

Thanks @conligWX. I had previously uploaded sample files here and he acknowledged them.

Just curious the status of the implementation...
Davis Vantage Vue, Weather Envoy, Meteobridge Nano SD

kds
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sat Jan 26, 2019 10:13 pm

Re: Data Import function for MB PRO and NANO SD

Post by kds » Wed Feb 20, 2019 5:38 am

I'm still not able to get Cumulus data imported.

I reconstructed a CSV file according to what ConligWX posted above, and it all imported, but the values are not right... hardly any rainfall is showing up and temperatures of 180+F. I know we're warming up... but not that high!

I'm using regular Cumulus, not Cumulus MX.

User avatar
ConligWX
Gold Boarder
Gold Boarder
Posts: 194
Joined: Wed Nov 14, 2018 12:48 pm
Location: Conlig, Co. Down, UK
Contact:

Re: Data Import function for MB PRO and NANO SD

Post by ConligWX » Wed Feb 20, 2019 5:12 pm

can you post an extract of the data here so we can look at it to check the data is in the same format as mine, though I would need to find where I put my exported stuff:)

Post Reply