WXSIM - Meteobridge Pro

[hrvistaweather]

Hi Just checking back, we have finally sold our old house and moved into our new one and my Davis Vantage Pro 2 has been refurbished and on it's way back along with a new Meteobridge Pro Red. So just wondering if any one has yet been able to use Meteobridge Pro with WxSim.

Kind Regards.
Tony

[admin]

Sorry for being late on this. Having a look at the example files sent to me I think I can easily define an export template for the PRO and NANO SD. As the cumulus format can handle missing data in a better way (data fields are clearly delimited by comma) I would like to build a standard export template for that.

Code: Select all

01/09/14,00:00,14.8,61,7.3,8.0,14.5,354,0.0,0.0,1006.51,366.0,24.6,43,11.3,14.6,14.8,0.0,0,1.83,164.62,12.6,0,0.0,19,0.0,0.0
01/09/14,00:01,14.9,60,7.2,8.0,16.1,357,0.0,0.0,1006.51,366.0,24.6,43,9.7,14.8,14.9,0.0,0,-0.03,164.59,12.7,0,0.0,330,0.0,0.0
01/09/14,00:02,14.9,61,7.4,8.0,16.1,359,0.0,0.0,1006.54,366.0,24.5,43,4.8,14.8,14.9,0.0,0,-0.03,164.59,12.7,0,0.0,344,0.0,0.0
01/09/14,00:03,15.0,60,7.3,9.7,16.1,2,0.0,0.0,1006.54,366.0,24.5,43,4.8,14.6,15.0,0.0,0,-0.03,164.59,12.5,0,0.0,13,0.0,0.0
01/09/14,00:04,15.0,61,7.5,9.7,19.3,2,0.0,0.0,1006.57,366.0,24.4,43,12.9,14.6,15.0,0.0,0,-0.03,164.59,12.5,0,0.0,334,0.0,0.0
01/09/14,00:05,15.0,61,7.5,9.7,19.3,3,0.0,0.0,1006.54,366.0,24.4,44,3.2,14.6,15.0,0.0,0,-0.03,164.59,12.5,0,0.0,5,0.0,0.0
01/09/14,00:06,15.0,61,7.5,9.7,19.3,2,0.0,0.0,1006.54,366.0,24.4,44,8.0,14.6,15.0,0.0,0,-0.03,164.59,12.5,0,0.0,15,0.0,0.0

Can someone help me out in understanding the meaning of each of the fields? Date/time is clear, but the rest is not self explanatory.

[admin]

Is this the meaning of values?

Code: Select all

LogDateTime
Temp
Humidity
Dewpoint
Windspeed
Windgust
Windbearing
RainRate
TodayRainSoFar
Pressure
Raincounter
InsideTemp
InsideHumidity
LatestWindGust
WindChill
HeatIndex
UVindex
SolarRad
Evapotrans
AnnualEvapTran
ApparentTemp
MaxSolarRad
HrsSunShine
CurrWindBearing
RG11rain
RainSinceMidnight

Are all these used by WXSIM or does it just need a subset?

[weatherist34]

i hope you and tony can work this out i get regular requests to add the option to template but not being a wxsim user im not confident enough to add it on . brian

[admin]

To have daily rain summed up in a hourly or per minute resolution export, I had to invent new export selectors (daysum). Please update to just released Meteobridge version and then try this export template:

Code: Select all

# Cumulus-style export to feed WXSIM
#
[DD]/[MM]/[YY],[hh]:[mm],[th0temp-avg.1:],[th0hum-avg.0:],[th0dew-avg.1:],[wind0avgwind-avg=mph.1:],[wind0wind-max=mph.1:],[wind0dir-avg.0:],[rain0rate-avg.1:],[rain0total-daysum.1:],[thb0seapress-avg.1:],,[thb0temp-avg.1:],[thb0hum-avg.0:],[wind0wind-max=mph.1:],[wind0chill-avg.1:],[th0heatindex-avg.1:],[uv0index-avg.1:],[sol0rad-avg.0:],,,,,,,,,

[weatherist34]

To have daily rain summed up in a hourly or per minute resolution export, I had to invent new export selectors (daysum). Please update to just released Meteobridge version and then try this export template:

Code: Select all

# Cumulus-style export to feed WXSIM
#
[DD]/[MM]/[YY],[hh]:[mm],[th0temp-avg.1:],[th0hum-avg.0:],[th0dew-avg.1:],[wind0avgwind-avg=mph.1:],[wind0wind-max=mph.1:],[wind0dir-avg.0:],[rain0rate-avg.1:],[rain0total-daysum.1:],[thb0seapress-avg.1:],,[thb0temp-avg.1:],[thb0hum-avg.0:],[wind0wind-max=mph.1:],[wind0chill-avg.1:],[th0heatindex-avg.1:],[uv0index-avg.1:],[sol0rad-avg.0:],,,,,,,,,

hello boris i cant help think it will be tony give you best feedback and advice or if piet is on here . it was basically these two i relied on in the past for help where wxsim was concerned i just tried to make it look pretty ...brian

[hrvistaweather]

Hi Boris and Brian,

Thank you both for your help, greatly appreciated.

I am still waiting for my Davis Pro 2 to be returned after being refurbished (hopefully arrives next week) and also with it will be my new Meteobridge Pro Red. Once I receive them I will need to install them poles for anemometer etc and then engage Tom (wxsim) to tweek wxsim for my new location, once that is done I'll be able to test and engage.

Thank you again Boris for the assistance, I will reply again once I have everything running.

Kindest Regards,
Tony
https://beaumaris-weather.com

[hrvistaweather]

To have daily rain summed up in a hourly or per minute resolution export, I had to invent new export selectors (daysum). Please update to just released Meteobridge version and then try this export template:

Code: Select all

# Cumulus-style export to feed WXSIM
#
[DD]/[MM]/[YY],[hh]:[mm],[th0temp-avg.1:],[th0hum-avg.0:],[th0dew-avg.1:],[wind0avgwind-avg=mph.1:],[wind0wind-max=mph.1:],[wind0dir-avg.0:],[rain0rate-avg.1:],[rain0total-daysum.1:],[thb0seapress-avg.1:],,[thb0temp-avg.1:],[thb0hum-avg.0:],[wind0wind-max=mph.1:],[wind0chill-avg.1:],[th0heatindex-avg.1:],[uv0index-avg.1:],[sol0rad-avg.0:],,,,,,,,,

hello boris i cant help think it will be tony give you best feedback and advice or if piet is on here . it was basically these two i relied on in the past for help where wxsim was concerned i just tried to make it look pretty ...brian

Hi Boris,
Thank you so much for taking the time to look at this Cumulus Type export for wxsim.
I now have Meteobridge Pro Red running and Tom (wxsim) has asked for so example data so he can customize my wxsim setup for our new location.
However as I am new to using Meateobridge Pro I am unsure how to export each Monthly Log.
The meaning of the cumulus data points is here https://cumuluswiki.wxforum.net/a/Monthly_log_files and each month log is stored as "Dec18log.txt Jan19log.txt Feb19log.txtMar19log.txt Apr19log.txt May19log.txt Jun19log.txt Jul19log.txt Aug19log.txt Sept19log.txt Oct19log.txt Nov19log.txt Dec19log.txt" etc and current month log would need to be updated with current days data prior to each multiple daily run of wxsim forecast. Resolution could be from 1 minute to 5 mins etc.
I just don't know how to export each month or with that file name either.
Thank you again for your help it is greatly appreciated and I know this will be invaluable to many if we can achieve it.

kindest regards
Tony

[Mattk]

The MB export data format can be customized to whatever you require by copying/editing a .exp sample file in the template directory.
Check this link http://www.meteobridge.com/wiki/index.php/PRO_Tutorial and Schedule Generation of Exports

[thunderstorm]

I just tried this

Code: Select all

# Cumulus-style export to feed WXSIM
#
#pragma exportfile=[MMM][YY]log.txt
#pragma append=y
[DD]/[MM]/[YY],[hh]:[mm],[th0temp-avg.1:],[th0hum-avg.0:],[th0dew-avg.1:],[wind0avgwind-avg=mph.1:],[wind0wind-max=mph.1:],[wind0dir-avg.0:],[rain0rate-avg.1:],[rain0total-daysum.1:],[thb0seapress-avg.1:],,[thb0temp-avg.1:],[thb0hum-avg.0:],[wind0wind-max=mph.1:],[wind0chill-avg.1:],[th0heatindex-avg.1:],[uv0index-avg.1:],[sol0rad-avg.0:],,,,,,,,,

and scheduled it every hour

cum-export.png (37.31 KiB) Viewed 5419 times

Hope that works...

[thunderstorm]

Looks like wxsim searches for Sep.19log.txt Aug.19log.txt

wxsim-cumulus.png (107.61 KiB) Viewed 5410 times

so the file pattern should be

Code: Select all

#pragma exportfile=[MMM].[YY]log.txt

[thunderstorm]

I noticed two potential issues

1) I had an issues with rebooting (not related to wxsim export) but that resulted in a data loss and empty lines with no ore scattered values

Code: Select all

29/09/19,13:50,,,,0.9,4.0,184,,,,,,,4.0,21.9,,,663,,,,,,,,,
29/09/19,13:51,,,,,,,,,,,,,,,,,,,,,,,,,,

wxsimate wasn't happy about this and failed with a conversion error (from empty string to a double)

Is there a way to drop invalid data during export, in case there's no data at all or only a few ones ? I guess '#pragma emptylines=n' could help for completely empty lines, but how about badly populated ones ?
Alternatively wxsimate could be more tolerant here and drop these lines.

2) My Windows10 was running in German and some values like temperature wasn't converted correctly, eg. 19.4° was converted to 194°.
An export with a different format (semicolon as value delimiter and comma as decimal delimiter) could have solved that, but I didn't know how to do this in meteobridge. Switching Windows to English made it work as well.

Some ways to specify the export format in meteobridge or the import format in wxsimate would be helpful

[hrvistaweather]

Hi Thunderstorm,
Thank you for your help and examples, I have had your example running over night and at this stage I do not have my new wxsim installed in order to test, hopefully later this week.
I am on Win 10 English and in the past wxsimate accepted the "[MMM][YY]log.txt" format for me.
Also I found another issue on the midnight changeover it resulted in the following : a double entry for time 00:00 (the first instance being no values.

Code: Select all

29/09/19,23:50,8.1,65,1.9,2.9,6.9,209,0.0,0.0,1019.5,,27.6,37,6.9,7.1,8.1,0.0,0,,,,,,,,,
29/09/19,23:51,8.1,65,1.9,2.9,4.9,220,0.0,0.0,1019.5,,27.6,37,4.9,7.6,8.1,0.0,0,,,,,,,,,
29/09/19,23:52,8.1,65,1.9,3.1,6.9,218,0.0,0.0,1019.5,,27.5,37,6.9,6.9,8.1,0.0,0,,,,,,,,,
29/09/19,23:53,8.1,65,1.9,4.0,6.9,209,0.0,0.0,1019.5,,27.4,37,6.9,7.2,8.1,0.0,0,,,,,,,,,
29/09/19,23:54,8.2,65,2.0,4.0,8.1,217,0.0,0.0,1019.5,,27.4,37,8.1,6.9,8.2,0.0,0,,,,,,,,,
29/09/19,23:55,8.2,65,1.9,4.0,6.9,217,0.0,0.0,1019.5,,27.4,37,6.9,6.7,8.2,0.0,0,,,,,,,,,
29/09/19,23:56,8.3,65,2.1,4.0,6.0,227,0.0,0.0,1019.5,,27.4,38,6.0,7.3,8.3,0.0,0,,,,,,,,,
29/09/19,23:57,8.3,65,2.1,4.0,10.1,214,0.0,0.0,1019.5,,27.3,38,10.1,6.6,8.3,0.0,0,,,,,,,,,
29/09/19,23:58,8.3,65,2.1,4.0,10.0,217,0.0,0.0,1019.5,,27.3,38,10.0,7.1,8.3,0.0,0,,,,,,,,,
29/09/19,23:59,8.3,65,2.0,4.0,4.9,199,0.0,0.0,1019.5,,27.3,38,4.9,7.7,8.3,0.0,0,,,,,,,,,
30/09/19,00:00,,,,,,,,,,,,,,,,,,,,,,,,,,
30/09/19,00:00,8.4,65,2.1,4.0,4.0,210,0.0,0.0,1019.5,,27.3,38,4.0,7.9,8.4,0.0,0,,,,,,,,,
30/09/19,00:01,8.4,65,2.1,4.0,4.9,199,0.0,0.0,1019.5,,27.3,38,4.9,7.7,8.4,0.0,0,,,,,,,,,
30/09/19,00:02,8.4,64,2.0,4.0,4.0,225,0.0,0.0,1019.5,,27.2,38,4.0,7.9,8.4,0.0,0,,,,,,,,,
30/09/19,00:03,8.5,64,2.1,4.0,6.0,217,0.0,0.0,1019.6,,27.2,38,6.0,7.8,8.5,0.0,0,,,,,,,,,
30/09/19,00:04,8.6,64,2.0,4.0,6.0,215,0.0,0.0,1019.6,,27.2,38,6.0,7.6,8.6,0.0,0,,,,,,,,,
30/09/19,00:05,8.6,64,2.2,4.0,6.9,206,0.0,0.0,1019.6,,27.2,38,6.9,7.7,8.6,0.0,0,,,,,,,,,
30/09/19,00:06,8.6,63,2.0,4.0,6.0,208,0.0,0.0,1019.6,,27.2,38,6.0,8.1,8.6,0.0,0,,,,,,,,,
30/09/19,00:07,8.6,64,2.2,4.0,6.0,210,0.0,0.0,1019.6,,27.1,38,6.0,8.2,8.6,0.0,0,,,,,,,,,
30/09/19,00:08,8.6,64,2.2,4.0,4.0,215,0.0,0.0,1019.6,,27.1,38,4.0,8.2,8.6,0.0,0,,,,,,,,,
30/09/19,00:09,8.6,64,2.2,4.0,4.9,213,0.0,0.0,1019.6,,27.1,38,4.9,8.1,8.6,0.0,0,,,,,,,,,
30/09/19,00:10,8.5,64,2.1,4.0,4.9,210,0.0,0.0,1019.6,,27.1,38,4.9,7.9,8.5,0.0,0,,,,,,,,,

I have tried many was to achieve this output and one thing I would need to do is generate historic (previous) Monthly Logs, which this example does not achieve.

The stumbling block being inability to generate monthly data in minute resolution.

I am also still struggling to determine the missing variables between what's available in Meteobridge and the original Cumulus Monthly Logs.
Below is a compare of both.

Code: Select all

LogDate,               [DD]/[MM]/[YY],
LogTime,               [hh]:[mm],
Temp,                   [th0temp-avg.1:],
Humidity,              [th0hum-avg.0:],
Dewpoint,             [th0dew-avg.1:],
Windspeed,           [wind0avgwind-avg=kmh.1:],
Windgust,              [wind0wind-max=kmh.1:],
Windbearing,         [wind0dir-avg.0:],
RainRate,              [rain0rate-avg.1:],
TodayRainSoFar,     [rain0total-daysum.1:],
Pressure,               [thb0seapress-avg.1:],
Raincounter,          ? not required
InsideTemp,          [thb0temp-avg.1:],
InsideHumidity,     [thb0hum-avg.0:],
LatestWindGust,    [wind0wind-max=kmh.1:],
WindChill,             [wind0chill-avg.1:],
HeatIndex,            [th0heatindex-avg.1:],
UVindex,               [uv0index-avg.1:],
SolarRad,              [sol0rad-avg.0:],
Evapotrans,           ? Evapotranspiration
AnnualEvapTran,    ? Annual Evapotranspiration
ApparentTemp,      ? Apparent temperature
MaxSolarRad,         ? not required
HrsSunShine,          ? Hours of sunshine so far today
CurrWindBearing,   ? Current Wind bearing
RG-11 rain today,   ? not required
Total Rainfall since midnight, ? nor required

Kind regards,
Tony

[thunderstorm]

FWIW, I don't have the double entry at midnight, but I added to my template

Code: Select all

#pragma emptylines=n

Code: Select all

29/09/19,23:57,20.3,52,10.1,4.0,4.9,204,0.0,0.0,1005.7,,20.7,41,4.9,20.3,20.3,0.0,0,,,,,,,,,
29/09/19,23:58,20.3,52,10.1,4.0,11.0,231,0.0,0.0,1005.6,,20.7,41,11.0,20.3,20.3,0.0,0,,,,,,,,,
29/09/19,23:59,20.4,52,10.2,4.0,8.1,193,0.0,0.0,1005.6,,20.7,41,8.1,20.3,20.4,0.0,0,,,,,,,,,
30/09/19,00:00,20.4,52,10.2,4.0,4.9,278,0.0,0.0,1005.6,,20.7,41,4.9,20.4,20.4,0.0,0,,,,,,,,,
30/09/19,00:01,20.4,52,10.2,3.0,6.0,237,0.0,0.0,1005.7,,20.7,41,6.0,20.4,20.4,0.0,0,,,,,,,,,
30/09/19,00:02,20.4,52,10.2,2.9,8.9,220,0.0,0.0,1005.7,,20.7,41,8.9,20.4,20.4,0.0,0,,,,,,,,,
30/09/19,00:03,20.4,52,10.2,2.9,12.1,234,0.0,0.0,1005.7,,20.7,41,12.1,20.4,20.4,0.0,0,,,,,,,,,

Best,
Bernd

[hrvistaweather]

Hi Bernd,

Thanks for the feedback, strangely after last nights changeover it worked fine, however I have since added your

Code: Select all

#pragma emptylines=n

in case it happens again.

kind Regards,
Tony