Page 1 of 1
Basic user definable Export / Report of data
Posted: Mon Mar 10, 2008 4:25 pm
by skyewright
It would be nice if there were somthing a bit like the Graphs option, but instead of generating a graph it generated a simple text file of delimited data, with (say):
a) one line per time 'bucket'
b) 1st field on a line is a time stamp for the bucket
c) Remaining fields on each line are values (as per the data points on a graph?).
It would be nice to be allowed user definable 'field separator' (e.g. comma, tab, space...), and user definable enclosure for text fields (e.g. none, double quote, single quote,...).
Perhaps an optional first line or field headers?
Maybe you could even re-use some of the existing 'Graphs' code to achieve this?
PS. If the time compacted data could allow for 1 minute buckets too that would be even better. :-)
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 2:41 am
by admin
Meteohub can generate user defined HTML and can load this up. Does this address your demand?
Generating formatted text as a png or jpeg is hard to do.
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 11:25 am
by skyewright
admin wrote:Meteohub can generate user defined HTML and can load this up. Does this address your demand?
Not so far as I am aware, because (unlike when requesting a graph) the HTML facilities do not allow me to set a time frame and resolution.
The facility I have in mind would allow production of a file listing a number of sensor values (e.g. windspeed and gustspeed for wind0 and wind 1, plus rainfall for rain0 and rain1) for some time frame, with one line per time bucket.
Generating formatted text as a png or jpeg is hard to do.
I am not asking for a graphic, just a basic text file (e.g. CSV). For example:
Code: Select all
20080311090000,59,76,121
20080311090005,59,77,125
20080311090010,58,75,120
My guess (and I could be totally wrong) is that this is pretty much the sort of data you already need to gather when you produce graphs, but presented as a text file rather fed being into a graphing engine to produce an image.
Such a text file can then be analysed, imported, archived or whatever in many ways using other software.
Does that make more sense now?
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 11:26 am
by patonnet74
Fantastic! I previously had a Lacrosee WS2300 and was just rebuilding my website around XML files and having just received my WMR200 yesterday (After WS2300 broke :-( ) was trying to work out how easiest to get the information I needed. I've just tested using the html generation to create an xml file on the fly.
One problem, there doesn't seem to be any date/time values for the min/max.
What I want to do is display today's high/low along with the time that it actually happened. The documentation shows for instance day1_th0_tempmin_time
but it doesn't return a value.
When I try http://..../meteograph.cgi?text=all I can't see any of the min/max datetime fields shown, should they be there?
Using the demo so far but not that I can see how to generate this XML I'm pretty sure a purchase is on it's way!
Thanks,
Alan
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 12:10 pm
by patonnet74
Hopefully not hijacking your thread. I can definitely see the point of this.
The ability to generate HTML on the fly enables an easy way to create a snapshot, but historic data to import would be very useful.
For my uses (selfish obviously!) I'm trying to think of a way to see daily min/max for a set time period, or similar to your example above, how can I easily export daily (or monthly/annual etc) rainfall for a set time?
I think we're both looking for the same thing here.
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 1:03 pm
by skyewright
patonnet74 wrote:Hopefully not hijacking your thread.
I think we're both looking for the same thing here.
I hope that I'm proposing something that would be useful to many people, so welcome aboard. :)
Delimited data can be used in so many ways...
For example if this facility were available I'd not need to 'wishlist' for multiple WD export formats, because with this facilty I could get the equivalent data out as a basic CSV then reformat it quite easily. Of course for that purpose 1 minute buckets would be best, but if it had to be 5 minute buckets I could manage. :)
I also hope I'm proposing something that would not be terribly hard to code. I'm sure that Boris has many things to do already! My hope is that at least some of the code used to collect data for Graphs might be reusable?
Re:Basic user definable Export / Report of data
Posted: Tue Mar 11, 2008 7:07 pm
by patonnet74
Just had a closer play with graphs now that I'm licenced! (That was so easy to do after you've used the evaluation!)
I agree, the data that I'm looking for seems to already be produced for the graphs, and if the page that produces the graphs could produce either csv or xml of the data behind it I think I'd have the setup I've been looking for!
Now all I need to do is work out how to import my 2 years of data from my WS2300 stored in my own format!
Next thread to create, how to import? I'm new here, I'll try to take my time with suggestions!
Cheers,
Alan
Re:Basic user definable Export / Report of data
Posted: Wed Mar 12, 2008 11:19 am
by skyewright
patonnet74 wrote:...could produce either csv or xml of the data...
Either csv or xml would be fine for me. I suggested delimited text because I was trying to keep my wish as simple as possible. If it turned out that xml was easier to arrange I'd still be happy.
The main point of my wish is to be able to extract data for one or more sensors over a range of time. Boris is best positioned to decide how to do that, if he chooses to implement it. :)
I really must resist the temptation to suggest how to code things. As a software developer I should know how that what I want users to tell me is what they want an application to 'achieve' not what they want it to 'do'. :)