Page 1 of 4

How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 12:42 am
by admin
Let's make use of the feature of Version 3.2d to report recomputation speed for you Meteohub system. Beside the platform itself, I will expect the storage media to have a major impact as well. So please tell us your...
  • processed data records per second (from "meteohub log" )
  • platform (NSLU2 133MHz, ALIX.1D, etc...)
  • storage media (type of USB Stick, SSD, CF card, etc)

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 12:46 am
by admin
  • 14612451 records processed in 7265 seconds (2011 records per second)
  • fit-PC Slim
  • Transcend SSD TS8GSSD25-S
This is really fast compared to my NSLU2 experience ;-)

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 2:25 am
by admin
Meteohub on my server's VMware is even quite a bit faster :-)
  • 14153300 records processed in 766 seconds (18476 records per second)
  • VMware Server 2.0, Core2Duo, 3GHz

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 1:20 pm
by admin
Here good old NSLU2 as reference
  • 14179626 records processed in 29704 seconds (477 records per second)
  • NSLU2 266 MHz
  • 4GB USB stick OCZ ATV

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 8:04 pm
by skyewright
  • 7877937 records processed in 21277 seconds (370 records per second)
  • NSLU2 266 MHz
  • 4GB USB Freecom Databar
Data nature: 2x anemometer (14 second update), 2x rain (~45 second updates), 7 temp/hum or temp only (~ 1 minute updates). Most sensor in place for ~9 months.

Load during recompute: Reading from USB RFXCOM, updating one html template @ 15 minute intervals, feeding WD by TCP/IP protocol, another Meteohub (ALIX 1D) observing port 5557.


Memory age: 9 months

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Mon Dec 15, 2008 9:31 pm
by skyewright
  • 7879599 records processed in 4193 seconds (1879 records per second)
  • ALIX 1D
  • 4GB iCF 4000 Dual Channel Industrial Compact Flash - 266X
Data nature: 2x anemometer (14 second update), 2x rain (~45 second updates), 7 temp/hum or temp only (~ 1 minute updates). Most sensor in place for ~9 months.

Load during recompute: Reading from NSLU2 Meteohub by TCP/IP, updating one html template @ 15 minute intervals.

Memory age: New

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Tue Dec 16, 2008 12:12 am
by pirelli
# 5371448 records processed in 5021 seconds (1069 records per second)
# NSLU2 266 MHz
# Corsair USB Flash Voyager 4GB

Looks like the memory makes a difference. :)

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Tue Dec 16, 2008 11:37 am
by skyewright
pirelli wrote:Looks like the memory makes a difference. :)
Seems likely.
I just edited my posts to add in a few more details (nature of data, load during recompute, and age of the memory device) in case that helps build a better picture.

It might be interesting for me to try again after I have switched the ALIX 1D over to being the main device (i.e. after swaping the "load during recompute" characteristics from NSLU2 => ALIX 1D and vice versa).

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Tue Dec 23, 2008 8:56 pm
by gpfoto
- 912268 records processed in 741 seconds (1231 records per second)
- eBox 4300 (eTC-2500), 512MB RAM
- 4GB CF

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Wed Dec 24, 2008 12:12 am
by skyewright
skyewright wrote:It might be interesting for me to try again after I have switched the ALIX 1D over to being the main device (i.e. after swaping the "load during recompute" characteristics from NSLU2 => ALIX 1D and vice versa).
The figures for the ALIX 1D as "main device" (i.e. with a higher load during recompute) were almost identical at 1804 records per second.
I can't compare against the NSLU2 as "secondary" at present, because the file system on its USB stick failed and I haven't yet rebuilt it...

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Sun Dec 28, 2008 9:27 am
by pscho
Version 3.3 report.

recomputation of weather data finished: 145206 records processed in 84 seconds (1728 records per second)

system'ALIX 1 d

4 G. card

Update time every 10 minutes by cresta wxr 815

Power consumption 5,3 watt maximum !!

Regards
Paul

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Fri Jan 09, 2009 9:20 pm
by sanberger
[*]4972334 records processed in 2604 seconds (1909 records per second)
[*]Alix.3C2
[*]4GB NoName CF-Card

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Sat Jan 10, 2009 12:41 am
by admin
I see you have it running on ALIX.3C2. Very interesting, as I have not tested this. Difference between C and D models does not seem to be to much, but anyway good to know.

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Sat Jan 10, 2009 2:51 pm
by sanberger
I ordered Alix3D2 but was supplied with Alix.3C2 (Varia-Store). The 3C2 seems to be the predecessor of 3D2 but works fine so far. The MeteoHub System Info indicates a 3D2, but a print on the circuit board and the invoice from Varia-Store tell me its a 3C2.

Re:How fast is recomputation? Version 3.2d reports numbers!

Posted: Sat Jan 10, 2009 8:35 pm
by juergen_h.
- V3.3
- 3152527 records processed in 1377 seconds
- (2289 records per second)
- fit-PC slim with 4GB Transcend SSD

Regards
Juergen