Meteohub freeze after 12-24h

[Jippe]

Meteohub freezes 12-24h after boot.
http gives "404 Not Found. The requested URL '/cgi-bin/meteohub.cgi' was not found on this server." -error.
ftp-uploads wont work, can't get ssh-connections. It seems that it still logs data (not sure)

After reboot it works 12-24h but it wont start recomputation even if I press recomputate-button. Theres "waiting"-text..


I don't know what is wrong and what I should look to find out the problem?

[admin]

Very odd. Do you have lots of services scheduled that are trigger every minute?
This looks like the system is flooded with tons of computation requests not taking
into account that the RPI is very very poor performer, much closer to the antique
NSLU2 than to any modern ARM platform.

[Jippe]

Leuven-template related uploads and five weather-network updates.
I had NSLU2 3 years without problems and now RPi maybe 4-5 months without problems.

[admin]

Can you please browse to "http://ip-of-your-meteohub/cgi-bin/help.cgi"?
Then I might be able to login and check.

[Jippe]

Done. Is this reverse ssh? Or do I have to open port for you?

[admin]

It is a reverse ssh tunnel. I can login.

Meteohub log shows:

Code: Select all

loggereval (09.01.2015 07:01:31): illegal data record in line 385398 while reading from file /data/weather/201309/raw: 220130924140044 wind0 0 22 45 0050
loggereval (09.01.2015 07:01:52): illegal data record in line 429025 while reading from file /data/weather/201309/raw: 2013092612324420130926123446 wind0 331 27 22 0033
loggereval (09.01.2015 07:01:52): illegal data record in line 429838 while reading from file /data/weather/201309/raw: 20130920130926133241 th0 53 95 0046
loggereval (09.01.2015 07:08:34): illegal data record in line 114092 while reading from file /data/weather/201312/raw: 2013120617logger (01.01.1970 02:01:54): System date not properly set. Please set date and time correctly before data logging can start.

So raw data for 2013-09 and 2013-12 contains bad data. I fixed this by using the cleanup features on "inspect data" page.

Doing some more experimentation the system crashed with these messages:
cat: /data/weather/201407/raw: Input/output error
cat: /data/weather/201408/raw: Input/output error
cat: /data/weather/201409/raw: Input/output error
cat: /data/weather/201410/raw: No such file or directory
cat: /data/weather/201411/raw: No such file or directory
cat: /data/weather/201412/raw: No such file or directory
/home/meteohub/wmr928fulleval: cannot create /data/log/meteohub.log: Read-only file system

Which simply speaking means that your file system goes corrupt out of nothing.
This is clear indication of a defective SD card or the RPI having trouble to connect
correctly to the SD card.

[Jippe]

ok. I had a usb stick crash 2014-07 and 2013-10. I tried restore data to new system from both sticks..
I have rsync backups on my NAS, do you mean that data is also corrupted? There is data all that time and meteohub is done succesful recomputation many times?
At this moment it's freezed again. I have ssh-connection which is partially working but no ftp or http.. example cat or ls commands not found???
These are all commans I can do for now:

Code: Select all

bg         command    dirs       enable     fc         help       local      read       shopt      trap       unset
./         bind       compgen    disown     esac       fg         history    logout     readarray  source     true       until
:          break      complete   do         eval       fi         if         mapfile    readonly   suspend    type       wait
[          builtin    compopt    done       exec       for        in         popd       return     test       typeset    while
[[         caller     continue   echo       exit       function   jobs       printf     select     then       ulimit     {
]]         case       coproc     elif       export     getopts    kill       pushd      set        time       umask      }
alias      cd         declare    else       false      hash       let        pwd        shift      times      unalias

So, new install to new sd-card?

[admin]

Definitely a HW problem. I wonder why you are using USB sticks?
Meteohub does run and store on SD cards. Did you do modifications?

[Jippe]

I had NSLU2 and usb-sticks 2010-2014. Raspi since 7/2014 with sd-card.

[Jippe]

Fresh install now and it seems to working.. recomputation is completed and system data usage is 74% (yesterday it was only 66%)
I did several checks to sd-card and it's fine and working.