Page 1 of 1

bad data *resolved*

Posted: Wed Dec 10, 2014 12:18 am
by xcom
Today meteohub started uploading data with bad dates on the monthly and yearly. Nothing changed it just started doing that...

Code: Select all

[sandbox]$ grep '1969' uploadMH/*
uploadMH/MHtags.php:alltime_localdate|19691231180404:|:
uploadMH/MHtags.php:month1_localdate|19691231181214:|:
uploadMH/MHtags.php:year1_localdate|19691231180404:|:
uploadMH/MHtags.php:seqday1_utcdate|19700101001214 19691231001214 19691230001214 19691229001214 19691228001214 19691227001214 19691226001214 19691225001214 19691224001214 19691223001214 19691222001214 19691221001214 19691220001214 19691219001214 19691218001214 19691217001214 19691216001214 19691215001214 19691214001214 19691213001214 19691212001214 19691211001214 19691210001214 19691209001214 :|:
uploadMH/MHtags.php:seqday1_localdate|19691231181214 19691230181214 19691229181214 19691228181214 19691227181214 19691226181214 19691225181214 19691224181214 19691223181214 19691222181214 19691221181214 19691220181214 19691219181214 19691218181214 19691217181214 19691216181214 19691215181214 19691214181214 19691213181214 19691212181214 19691211181214 19691210181214 19691209181214 19691208181214 :|:
uploadMH/MHtags.php:seqhour6_utcdate|19700101001214 19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 :|:
uploadMH/MHtags.php:seqhour6_localdate|19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 19691226001214 :|:
uploadMH/MHtags.php:seqmonth1_localdate|19691231180404 :|:
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231180404</item>
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231181214</item>
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231180404</item>
[sandbox]$


and:


root@meteohub:/data/myweb/uploads# grep -i 1969 /data/myweb/uploads/MHtags.php
alltime_localdate|19691231180404:|:
month1_localdate|19691231181214:|:
year1_localdate|19691231180404:|:
seqday1_utcdate|19700101001214 19691231001214 19691230001214 19691229001214 19691228001214 19691227001214 19691226001214 19691225001214 19691224001214 19691223001214 19691222001214 19691221001214 19691220001214 19691219001214 19691218001214 19691217001214 19691216001214 19691215001214 19691214001214 19691213001214 19691212001214 19691211001214 19691210001214 19691209001214 :|:
seqday1_localdate|19691231181214 19691230181214 19691229181214 19691228181214 19691227181214 19691226181214 19691225181214 19691224181214 19691223181214 19691222181214 19691221181214 19691220181214 19691219181214 19691218181214 19691217181214 19691216181214 19691215181214 19691214181214 19691213181214 19691212181214 19691211181214 19691210181214 19691209181214 19691208181214 :|:
seqhour6_utcdate|19700101001214 19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 :|:
seqhour6_localdate|19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 19691226001214 :|:
seqmonth1_localdate|19691231180404 :|:
root@meteohub:/data/myweb/uploads#
I have try everything I can think of and the file still comes up with that damn 12 31 1969 and its braking my site.
How can I fix this?

Thanks for the help.

Re: bad data

Posted: Wed Dec 10, 2014 12:57 pm
by YJB
At first sight I would say that the time is wrong on your setup. What is the time as displayed on the lefthand side of the Meteohub GUI?

Re: bad data

Posted: Wed Dec 10, 2014 3:52 pm
by xcom
Time is fine.
Both on the cli and on the web ui.
My monthly corrected it self... Bit my yearly it's still broken..... What is going on? :(

Re: bad data

Posted: Wed Dec 10, 2014 6:19 pm
by xcom
Yearly is now correct but my weather trends is showing pressure and temp in metric.....

Not sure why...

Re: bad data

Posted: Wed Dec 10, 2014 6:52 pm
by YJB
Have you checked "use imperial units" (on the settings page)?

Re: bad data

Posted: Wed Dec 10, 2014 7:22 pm
by xcom
Yes I did. This has been running for months just fine.... :(

Re: bad data

Posted: Wed Dec 10, 2014 9:38 pm
by xcom
Now it's recomputing the data all over again... :?: :?: :?:

Re: bad data

Posted: Wed Dec 10, 2014 9:39 pm
by xcom
Here is the page where the bad data displays....

http://www.txweather.org/index.php?p=61 ... #data-area

Re: bad data

Posted: Thu Dec 11, 2014 12:07 am
by xcom
Now is recomputing data all over again... :(

wmr928fulleval(10.12.2014 10:25:54): recomputation of weather data finished: 9776178 records processed in 66891 seconds (146 records per second)
wmr928fulleval(10.12.2014 10:30:03): recomputation of weather data started.

Re: bad data

Posted: Thu Dec 11, 2014 12:49 am
by xcom
Meteohub just keep fucking up data.... Now my all times records on rain change to some stupid amounts that I cant understand how is getting that data....
Does anybody know how to fix this?

Re: bad data *resolved*

Posted: Thu Dec 11, 2014 8:56 pm
by admin
Did you check with a graphing function, where the bad value in your raw data is?
If found by that you can delete it on "inspect data" page.

Re: bad data *resolved*

Posted: Thu Dec 11, 2014 10:51 pm
by xcom
Well after many hours of no sleep... LOL :P The metric issues was a broken coded that some "how" got inserted in my template.... It was not meteohub.
The garbage time seem to have been caused by network outage.... Meteohub could not recover from the network failure and cause the garbage in time.
After about 30hrs of re-computation, meteohub manage to fix the garbage time on its own.