Weather Data Computation stuck? (OK)

[gm4jjj]

I restored my data from my x86 system into my new RPi, and the Weather Data Recomputation appeared to get stuck after a short while at just 2 dots. I left it for 4 hours, but no more progress. I stopped data logging and rebooted the meteohub system.
Weather Data Recomputation says completed now.

When I look at the daily graphs they either show only data since the time that I started the new system instead of the whole 24 hours, or they just have a no data gnuplot execution failed.

If I look at the data it does appear to be there. Does Weather Data Recomputation need to complete properly before the graphs will work correctly? EDIT - Upon reading the manual I see that it does

I tried starting the recomputation manually but it stuck again after a short while.

I will try again and leave it overnight and see if it ever completes, perhaps I have a bad SD card? - or it is just the large size of the raw data and the slow access speed of the SD card or something?

[gm4jjj]

It appears that the recomputation is not stuck, but just very slow. After running all night it is now at 5 dots. I think it looks as if it will take about 24 hours to complete.


Storage
Media: NCard 02/2012 0x12603e90 (0.17 rounds)
Swap: 0MB of 127MB used (0%)
System: 1085MB of 1641MB used (66%)
Data: 1680MB of 13061MB used (12%)

Date and Time
UTC: 04.07.2014 07:26:42
Time Zone: Europe/London
Local Time: 04.07.2014 08:26:42
Uptime: 10 hours, 57 minutes
System Load: 3.65, 3.64, 3.45

Process
Weather Data Recomputation: in progress (■ ■ ■ ■ ■ □ □ □ □ □ □ )
Weather Data Logging: running (last data: 9 sec)
Weather Network "Rapid Fire": running
SSH Login: running
SMB Shares: running
Time Synchonization: running

[admin]

Despite the RPI hype, this system is really not fast... so you get what you paid for, which isn't a lot

[gm4jjj]

Yes, it is a good price and nice and simple and low power consumption, so I am pleased.

wmr928fulleval(04.07.2014 23:27:10): recomputation of weather data finished: 38132855 records processed in 88825 seconds (429 records per second)


wmr928fulleval(04.07.2014 23:30:02): recomputation of weather data started.

I am not sure why after finishing the recomputation it then started all over again? What would trigger that?

[admin]

When you did changes during recomputation running that can have an impact on aggregated data it starts again.

[gm4jjj]

Thanks.

If the system is left untouched, does it ever recompute the data, or is it only triggered by changes the user makes? I seem to remember a reboot starts recomputation. There is no stop button, so I suppose it is not safe to interrupt the recomputation?

As you can see I have a few years of data stored. Should I delete some old data and leave only perhaps 1 year so that the recomputation is faster? My data is already stored on Weather Underground so I would not be too worried about not having all the old data stored in Meteohub.

I will read the manual and see if there is a procedure for archive and deletion of data

Sorry for all the questions.