Page 5 of 10

Re: Data Import function for MB PRO and NANO SD

Posted: Sun Jan 27, 2019 5:48 am
by admin
If you can send data from a time before leaf 4 showed up would help.

Re: Data Import function for MB PRO and NANO SD

Posted: Sun Jan 27, 2019 6:19 am
by staze
admin wrote: Sun Jan 27, 2019 5:48 am If you can send data from a time before leaf 4 showed up would help.
Here ya go! It does look like that column has been permanently added to all my exports (or I misremember when I added Meteobridge). But a found a simple little Mac App (Table Tool) that let me remove the column with minimal effort.

Attached!

Re: Data Import function for MB PRO and NANO SD

Posted: Sun Jan 27, 2019 7:58 am
by kds
ConligWX wrote: Sun Jan 27, 2019 2:47 am My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.

Re: Data Import function for MB PRO and NANO SD

Posted: Sun Jan 27, 2019 12:58 pm
by ConligWX
kds wrote: Sun Jan 27, 2019 7:58 am
ConligWX wrote: Sun Jan 27, 2019 2:47 am My CumulusMX database table I exported was "Monthly". it held every data record collected in 5 minute intervals, for approx 2 years. extracted as a csv, and then imported into Meteobridge.
Can you post a sample of the table with the headers you had from CumulusMX? I can probably get it all into Excel and manipulate the columns to hopefully get Cumulus files to import into Meteobridge.
the sql monthly table was extracted in two variants, sql i then converted to a csv as I have some erroneous errors, and differences in unit values to start with.

the sql layout would have been like so:

Code: Select all

INSERT INTO `Monthly` (`LogDateTime`, `Temp`, `Humidity`, `Dewpoint`, `Windspeed`, `Windgust`, `Windbearing`, `RainRate`, `TodayRainSoFar`, `Pressure`, `Raincounter`, `InsideTemp`, `InsideHumidity`, `LatestWindGust`, `WindChill`, `HeatIndex`, `UVindex`, `SolarRad`, `Evapotrans`, `AnnualEvapTran`, `ApparentTemp`, `MaxSolarRad`, `HrsSunShine`, `CurrWindBearing`, `RG11rain`, `RainSinceMidnight`, `WindbearingSym`, `CurrWindBearingSym`) VALUES
('2018-11-30 22:45:00', '4.3', '86', '2.1', '4.0', '8.0', '223', '0.0', '1.2', '1001.66', '553.0', '21.2', '42', '2.0', '2.7', '4.3', '0.0', '0.0', '0.6', '560.4', '1.4', '0.0', '2.1', '213', '0.0', '1.2', 'SW', 'SSW'),
('2018-11-30 22:40:00', '4.3', '86', '2.1', '5.0', '12.0', '227', '0.0', '1.2', '1001.73', '553.0', '21.3', '42', '5.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '230', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:35:00', '4.3', '86', '2.1', '5.0', '12.0', '224', '0.0', '1.2', '1001.66', '553.0', '21.3', '42', '4.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '217', '0.0', '1.2', 'SW', 'SW'),
('2018-11-30 22:30:00', '4.3', '86', '2.1', '5.0', '12.0', '221', '0.0', '1.2', '1001.52', '553.0', '21.4', '42', '9.0', '2.3', '4.3', '0.0', '0.0', '0.6', '560.4', '1.1', '0.0', '2.1', '244', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:25:00', '4.2', '86', '2.1', '5.0', '12.0', '218', '0.0', '1.2', '1001.56', '553.0', '21.5', '42', '3.0', '2.2', '4.2', '0.0', '0.0', '0.6', '560.4', '1.0', '0.0', '2.1', '250', '0.0', '1.2', 'SW', 'WSW'),
('2018-11-30 22:20:00', '4.1', '87', '2.1', '5.0', '12.0', '213', '0.0', '1.2', '1001.59', '553.0', '21.6', '42', '6.0', '2.1', '4.1', '0.0', '0.0', '0.6', '560.4', '0.9', '0.0', '2.1', '168', '0.0', '1.2', 'SSW', 'SSE'),
my csv was like so as far as I can remeber:

Code: Select all

"2016-04-20 23:15:00","6.6","89","4.9","0.0","1.0","254","0.0","0.0","1027.40","397.4","25.2","41","1.0","6.6","6.6","0.0","0.0","0.0","0.0","5.5","0.0","0.0","257","0.0","0.0","WSW","WSW"
"2016-04-20 23:20:00","6.4","89","4.8","0.0","1.0","256","0.0","0.0","1027.43","397.4","25.2","41","1.0","6.4","6.4","0.0","0.0","0.0","0.0","5.3","0.0","0.0","255","0.0","0.0","WSW","WSW"
"2016-04-20 23:25:00","6.3","89","4.7","0.0","1.0","256","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","256","0.0","0.0","WSW","WSW"
"2016-04-20 23:30:00","6.3","89","4.6","0.0","2.0","259","0.0","0.0","1027.53","397.4","25.2","41","0.0","6.3","6.3","0.0","0.0","0.0","0.0","5.1","0.0","0.0","264","0.0","0.0","W","W"
"2016-04-20 23:35:00","6.2","89","4.5","1.0","2.0","264","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.7","0.0","0.0","273","0.0","0.0","W","W"
"2016-04-20 23:40:00","6.2","89","4.5","1.0","2.0","263","0.0","0.0","1027.74","397.4","25.2","41","2.0","6.2","6.2","0.0","0.0","0.0","0.0","4.6","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:45:00","6.2","89","4.5","0.0","2.0","260","0.0","0.0","1027.70","397.4","25.2","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
"2016-04-20 23:50:00","6.2","89","4.5","0.0","2.0","270","0.0","0.0","1027.63","397.4","25.1","41","0.0","6.2","6.2","0.0","0.0","0.0","0.0","4.9","0.0","0.0","270","0.0","0.0","W","W"
when I imported I only imported about 4 months at a time, since any bigger was maxing out the realtime buffer (100%) so you would loose data coming into the Nano from the Davis console.

First thing however is to backup meteobridge database and configuration each time before an import, just to be extra safe.

Re: Data Import function for MB PRO and NANO SD

Posted: Sun Jan 27, 2019 7:12 pm
by kds
Thanks! I'll work on this soon.

Re: Data Import function for MB PRO and NANO SD

Posted: Mon Feb 04, 2019 7:36 pm
by mchd17
importing from meteotemplate csv file. all data is in F and meteobridge uses that data as C,


All Time Max
example outdoor temp 58.5C / 137.3F
should be 14.72C / 58.5F

just an FYI

Re: Data Import function for MB PRO and NANO SD

Posted: Tue Feb 05, 2019 1:26 am
by mchd17
Well darnit.....

Deleted database on nano because of F to C problem from above post. Now I am not able to import rain data from console or min/max from console. Ideas on how to get that option back? Whoops!


FIXED, used the manual. Held blue button for 5 blinks. Going through original nano setup again. Looks like import from console is back. Still would like to import history from Meteotemplate csv correctly.

Nope, import from console was there until it rebooted with the sd card.

Re: Data Import function for MB PRO and NANO SD

Posted: Tue Feb 05, 2019 7:16 pm
by mchd17
how about a weathercloud csv import? I can export that in Celsius :wink:

Re: Data Import function for MB PRO and NANO SD

Posted: Tue Feb 05, 2019 7:34 pm
by ConligWX
mchd17 wrote: Tue Feb 05, 2019 7:16 pm how about a weathercloud csv import? I can export that in Celsius :wink:
email info @ smartbedded.com with a sample of the csv and see what Boris says.

Re: Data Import function for MB PRO and NANO SD

Posted: Tue Feb 05, 2019 9:33 pm
by mchd17
Done, thanks for the suggestion

Re: Data Import function for MB PRO and NANO SD

Posted: Thu Feb 14, 2019 11:18 pm
by staze
Hi @admin,

any info on being able to import weathercat data?

Thanks!

Re: Data Import function for MB PRO and NANO SD

Posted: Fri Feb 15, 2019 12:55 am
by ConligWX
staze wrote: Thu Feb 14, 2019 11:18 pm Hi @admin,

any info on being able to import weathercat data?

Thanks!
ConligWX wrote: Tue Feb 05, 2019 7:34 pm
email info @ smartbedded.com with a sample of the csv and see what Boris says.

Re: Data Import function for MB PRO and NANO SD

Posted: Fri Feb 15, 2019 1:24 am
by staze
Thanks @conligWX. I had previously uploaded sample files here and he acknowledged them.

Just curious the status of the implementation...

Re: Data Import function for MB PRO and NANO SD

Posted: Wed Feb 20, 2019 5:38 am
by kds
I'm still not able to get Cumulus data imported.

I reconstructed a CSV file according to what ConligWX posted above, and it all imported, but the values are not right... hardly any rainfall is showing up and temperatures of 180+F. I know we're warming up... but not that high!

I'm using regular Cumulus, not Cumulus MX.

Re: Data Import function for MB PRO and NANO SD

Posted: Wed Feb 20, 2019 5:12 pm
by ConligWX
can you post an extract of the data here so we can look at it to check the data is in the same format as mine, though I would need to find where I put my exported stuff:)