Errors in writing data to files

Discussion of the Meteohub software package

Moderator: Mattk

Post Reply
julsing
Junior Boarder
Junior Boarder
Posts: 27
Joined: Sun Aug 03, 2008 6:15 pm

Errors in writing data to files

Post by julsing »

(19.10.2008 09:05:06): error while opening file /data/weather//hist-day1 for writing: Input/output error: Input/output error
wmr928eval (19.10.2008 09:05:10): error while opening file /data/weather//hist-hour1 for writing: Input/output error: Input/output error
wmr928eval (19.10.2008 09:05:16): error while opening file /data/weather//hist-last24h for writing: Input/output error: Input/output error
wmr928eval (19.10.2008 09:05:20): error while opening file /data/weather//hist-last60m for writing: Input/output error: Input/output error

Since 1 day I'm getting these error reports in meteohub.log

What's wrong?

Thanks for looking into it.
mvpel
Senior Boarder
Senior Boarder
Posts: 42
Joined: Fri Mar 14, 2008 1:38 pm
Location: Merrimack, NH, US

Re:Errors in writing data to files

Post by mvpel »

What kind of flash drive are you using? I had a KingMax 2GB, and two separate times the errors on the flash drive wedged the /data partition into read-only mode and forced me to run a bad-block check on it in order to get it back online.

I just switched to a Kingston 4GB flash drive, and while it was one of the most expensive 4GB flash drives, it should be more reliable with error-checking and correction circuitry to isolate errors from the operating system.

The most recent problem with the old stick, which prompted me to install the new one, was a block of bad data written into the raw data file which didn't cause the filesystem to go read-only, but broke generation of the graph data. I had to edit the raw file manually to remove the bad data, it was kind of a pain.
julsing
Junior Boarder
Junior Boarder
Posts: 27
Joined: Sun Aug 03, 2008 6:15 pm

Re:Errors in writing data to files

Post by julsing »

Thanks,

I ran a bad block check, the USB stick was 100% OK.
Point is that I'm missing the files that cause errors in my data\\weather directory.
Further: I have 9 4Gb files in this directory!
See attachment:
julsing
Junior Boarder
Junior Boarder
Posts: 27
Joined: Sun Aug 03, 2008 6:15 pm

Re:Errors in writing data to files

Post by julsing »

Attachment (this is probably the weirdest forum software on the net; not very inviting to post anything) Image

It took me 30 minutes to post this image!
G3ZSS
Junior Boarder
Junior Boarder
Posts: 30
Joined: Thu Jul 03, 2008 9:16 pm
Contact:

Re:Errors in writing data to files

Post by G3ZSS »

It looks like you have a problem with your USB stick. I had similar problems, but last month bought a new 4GB USB stick and now my Meteohub is behaving itself again. I did try on 3 different days to reflash the Meteohub image onto my old USB stick, but it still gave up after a day or two.
Peter
sevenless
Gold Boarder
Gold Boarder
Posts: 160
Joined: Wed Jul 02, 2008 7:35 pm
Location: Seattle WA, USA

Re:Errors in writing data to files

Post by sevenless »

I agree, this is absolutely a problem with the data. Either the stick itself is corrupted (though your block check suggests not) or the file system is corrupted.
I have 9 4Gb files in this directory
Think about that for a second -- that would mean you've got a 36 GB USB stick, plus however much space all the other data files are using! That alone should have been enough to tell you there's an error somewhere.

Personally, I'd buy a new USB stick from a reputable brand and install a fresh copy of Meteohub. If you want to try saving a few dollars you could try reinstalling the system on the same drive, but I'd be paranoid about the problem happening again.

I hope you've been backing up your data regularly!
julsing
Junior Boarder
Junior Boarder
Posts: 27
Joined: Sun Aug 03, 2008 6:15 pm

Re:Errors in writing data to files

Post by julsing »

I posted this before, but it seems to have gone missing.

I guess it's the stick then.

How can I make sure the data sofar are transferred to the new stick?
sevenless
Gold Boarder
Gold Boarder
Posts: 160
Joined: Wed Jul 02, 2008 7:35 pm
Location: Seattle WA, USA

Re:Errors in writing data to files

Post by sevenless »

Assuming you have a reliable backup of the data files found within 200808, 200809, 200810, you can copy those into the new data folder while the Data Logging Process is halted (do that via the maintenance tab on the web interface.) Note that this will overwrite any new data in the current month (200810) so do it as soon as you've installed the system on the new USB stick, then re-start the data logging process, which will start adding new data to the end of the 200810 data file.

Also, once you have copied the backup data to the new stick, be sure to perform a data recomputation (also on the maintenance tab) or your graphs won't display properly.
Post Reply