bad data *resolved*

Discussion of the Meteohub software package

Moderator: Mattk

Post Reply
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

bad data *resolved*

Post by xcom »

Today meteohub started uploading data with bad dates on the monthly and yearly. Nothing changed it just started doing that...

Code: Select all

[sandbox]$ grep '1969' uploadMH/*
uploadMH/MHtags.php:alltime_localdate|19691231180404:|:
uploadMH/MHtags.php:month1_localdate|19691231181214:|:
uploadMH/MHtags.php:year1_localdate|19691231180404:|:
uploadMH/MHtags.php:seqday1_utcdate|19700101001214 19691231001214 19691230001214 19691229001214 19691228001214 19691227001214 19691226001214 19691225001214 19691224001214 19691223001214 19691222001214 19691221001214 19691220001214 19691219001214 19691218001214 19691217001214 19691216001214 19691215001214 19691214001214 19691213001214 19691212001214 19691211001214 19691210001214 19691209001214 :|:
uploadMH/MHtags.php:seqday1_localdate|19691231181214 19691230181214 19691229181214 19691228181214 19691227181214 19691226181214 19691225181214 19691224181214 19691223181214 19691222181214 19691221181214 19691220181214 19691219181214 19691218181214 19691217181214 19691216181214 19691215181214 19691214181214 19691213181214 19691212181214 19691211181214 19691210181214 19691209181214 19691208181214 :|:
uploadMH/MHtags.php:seqhour6_utcdate|19700101001214 19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 :|:
uploadMH/MHtags.php:seqhour6_localdate|19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 19691226001214 :|:
uploadMH/MHtags.php:seqmonth1_localdate|19691231180404 :|:
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231180404</item>
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231181214</item>
uploadMH/all-sensors.xml:    <item sensor="date0" cat="date" unit="local">19691231180404</item>
[sandbox]$


and:


root@meteohub:/data/myweb/uploads# grep -i 1969 /data/myweb/uploads/MHtags.php
alltime_localdate|19691231180404:|:
month1_localdate|19691231181214:|:
year1_localdate|19691231180404:|:
seqday1_utcdate|19700101001214 19691231001214 19691230001214 19691229001214 19691228001214 19691227001214 19691226001214 19691225001214 19691224001214 19691223001214 19691222001214 19691221001214 19691220001214 19691219001214 19691218001214 19691217001214 19691216001214 19691215001214 19691214001214 19691213001214 19691212001214 19691211001214 19691210001214 19691209001214 :|:
seqday1_localdate|19691231181214 19691230181214 19691229181214 19691228181214 19691227181214 19691226181214 19691225181214 19691224181214 19691223181214 19691222181214 19691221181214 19691220181214 19691219181214 19691218181214 19691217181214 19691216181214 19691215181214 19691214181214 19691213181214 19691212181214 19691211181214 19691210181214 19691209181214 19691208181214 :|:
seqhour6_utcdate|19700101001214 19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 :|:
seqhour6_localdate|19691231181214 19691231121214 19691231061214 19691231001214 19691230181214 19691230121214 19691230061214 19691230001214 19691229181214 19691229121214 19691229061214 19691229001214 19691228181214 19691228121214 19691228061214 19691228001214 19691227181214 19691227121214 19691227061214 19691227001214 19691226181214 19691226121214 19691226061214 19691226001214 :|:
seqmonth1_localdate|19691231180404 :|:
root@meteohub:/data/myweb/uploads#
I have try everything I can think of and the file still comes up with that damn 12 31 1969 and its braking my site.
How can I fix this?

Thanks for the help.
Last edited by xcom on Thu Dec 11, 2014 12:29 pm, edited 1 time in total.
User avatar
YJB
Platinum Boarder
Platinum Boarder
Posts: 387
Joined: Thu Feb 19, 2009 5:53 pm
Location: Venhuizen, Netherlands
Contact:

Re: bad data

Post by YJB »

At first sight I would say that the time is wrong on your setup. What is the time as displayed on the lefthand side of the Meteohub GUI?
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Time is fine.
Both on the cli and on the web ui.
My monthly corrected it self... Bit my yearly it's still broken..... What is going on? :(
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Yearly is now correct but my weather trends is showing pressure and temp in metric.....

Not sure why...
User avatar
YJB
Platinum Boarder
Platinum Boarder
Posts: 387
Joined: Thu Feb 19, 2009 5:53 pm
Location: Venhuizen, Netherlands
Contact:

Re: bad data

Post by YJB »

Have you checked "use imperial units" (on the settings page)?
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Yes I did. This has been running for months just fine.... :(
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Now it's recomputing the data all over again... :?: :?: :?:
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Here is the page where the bad data displays....

http://www.txweather.org/index.php?p=61 ... #data-area
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Now is recomputing data all over again... :(

wmr928fulleval(10.12.2014 10:25:54): recomputation of weather data finished: 9776178 records processed in 66891 seconds (146 records per second)
wmr928fulleval(10.12.2014 10:30:03): recomputation of weather data started.
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data

Post by xcom »

Meteohub just keep fucking up data.... Now my all times records on rain change to some stupid amounts that I cant understand how is getting that data....
Does anybody know how to fix this?
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7878
Joined: Mon Oct 01, 2007 10:51 pm

Re: bad data *resolved*

Post by admin »

Did you check with a graphing function, where the bad value in your raw data is?
If found by that you can delete it on "inspect data" page.
xcom
Senior Boarder
Senior Boarder
Posts: 79
Joined: Mon Jun 16, 2014 5:11 am

Re: bad data *resolved*

Post by xcom »

Well after many hours of no sleep... LOL :P The metric issues was a broken coded that some "how" got inserted in my template.... It was not meteohub.
The garbage time seem to have been caused by network outage.... Meteohub could not recover from the network failure and cause the garbage in time.
After about 30hrs of re-computation, meteohub manage to fix the garbage time on its own.
Post Reply