CSV history import

All about the standard Meteobridge devices based on mobile routers from TP-Link, D-Link, ASUS

Moderator: Mattk

Post Reply
Wingfat
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sun Oct 08, 2017 10:32 pm

CSV history import

Post by Wingfat »

Wow.. enjoying my new Nano-SD ....

I'm looking for a way to import 2 years of data into the Nano-SD from the Weather Underground. The data has recently become available (again) by the new owners. Using Ken True's Saratoga History scripts modifications I can export my data into a CSV file like:

Date,TemperatureHighF,TemperatureAvgF,TemperatureLowF,DewpointHighF,DewpointAvgF,DewpointLowF,HumidityHigh,HumidityAvg,HumidityLow,PressureMaxIn,PressureMinIn,WindSpeedMaxMPH,WindSpeedAvgMPH,GustSpeedMaxMPH,PrecipitationSumIn
2018-1-1,75.7,65.9,58.6,65.8,60.4,57.2,96,83.7,56,30.19,30.07,17,3.6,19,0.00
2018-1-2,68.4,63.2,58.8,64,61.3,57.6,98,93.5,81,30.19,30.08,21,7.6,26,1.71
2018-1-3,67.6,59.3,49.8,66,55.1,39.4,97,86.1,67,30.08,29.89,25.9,7.3,36,0.34
2018-1-4,54.7,47.7,39.2,42.3,34.7,23.2,80,61.4,40,30.24,30.07,20,7.6,22,0.00
2018-1-5,58.6,49.9,40.8,48.2,38.5,27.9,82,65.8,37,30.38,30.24,15,6,16,0.00
2018-1-6,62.4,54.6,48.6,51.6,45.4,37.8,87,71.4,60,30.41,30.33,18,7.9,19,0.00
2018-1-7,70.3,60.4,51.1,58.5,53.2,48.6,92,78,49,30.40,30.28,19,5.8,23,0.01
2018-1-8,74.7,69,65.1,67.8,65,57.7,97,87.7,73,30.28,30.10,14.1,3.1,18,0.24

Please let me know if there is a way to import this file.. thanks.
User avatar
admin
Platinum Boarder
Platinum Boarder
Posts: 7854
Joined: Mon Oct 01, 2007 10:51 pm

Re: CSV history import

Post by admin »

Did you try import function on "History" tab? It needs to have the files located on the NANO's network share in the "import" folder first.
Wingfat
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sun Oct 08, 2017 10:32 pm

Re: CSV history import

Post by Wingfat »

I placed the file in the import folder and tried all the different formats for import. They all seem to fail on the first line or two. :(

I was able to follow your video on charting and that is just fantastic. :D I updated my site to include this function. Parkviewx.com
User avatar
wvdkuil
Platinum Boarder
Platinum Boarder
Posts: 605
Joined: Sun Jul 24, 2011 8:00 pm
Location: Belgium
Contact:

Re: CSV history import

Post by wvdkuil »

Wingfat wrote: Sun Aug 25, 2019 5:07 pm I placed the file in the import folder and tried all the different formats for import. They all seem to fail on the first line or two. :(

I was able to follow your video on charting and that is just fantastic. :D I updated my site to include this function. Parkviewx.com
Did you check the file, probably it has a blank line as first line.
Or it contains html like < b r >
Or both

If so open the CSV file with a program editor and remove those invalid characters.

Wim
Wingfat
Junior Boarder
Junior Boarder
Posts: 20
Joined: Sun Oct 08, 2017 10:32 pm

Re: CSV history import

Post by Wingfat »

The file is clean and generated these errors when attempted to import:

import (25.08.2019 12:53:22): import of file "2018csvdata.txt" started (type:1, mode:0).
import (25.08.2019 12:53:22): invalid timestamp in line 1: Date,TemperatureHighF,TemperatureAvgF,TemperatureLowF,DewpointHighF,DewpointAvgF,DewpointLowF,HumidityHigh,HumidityAvg,HumidityLow,PressureMaxIn,PressureMinIn,WindSpeedMaxMPH,WindSpeedAvgMPH,GustSpeedMaxMPH,PrecipitationSumIn
import (25.08.2019 12:53:22): completed 0 records (0 ignored), 0 db writes
import (25.08.2019 12:54:37): import of file "2018csvdata.txt" started (type:3, mode:0).
import (25.08.2019 12:54:37): invalid timestamp in line 2: 2018-1-1,75.7,65.9,58.6,65.8,60.4,57.2,96,83.7,56,30.19,30.07,17,3.6,19,0.00
import (25.08.2019 12:54:37): completed 0 records (0 ignored), 0 db writes
import (25.08.2019 12:55:32): import of file "2018csvdata.txt" started (type:4, mode:0).
import (25.08.2019 12:55:32): invalid timestamp in line 2: 2018-1-1,75.7,65.9,58.6,65.8,60.4,57.2,96,83.7,56,30.19,30.07,17,3.6,19,0.00
import (25.08.2019 12:55:32): completed 0 records (0 ignored), 0 db writes
import (25.08.2019 12:56:10): import of file "2018csvdata.txt" started (type:5, mode:0).
import (25.08.2019 12:56:10): invalid parameter sequence in line 2: 2018-1-1,75.7,65.9,58.6,65.8,60.4,57.2,96,83.7,56,30.19,30.07,17,3.6,19,0.00
import (25.08.2019 12:56:10): completed 0 records (0 ignored), 0 db writes
import (25.08.2019 12:56:39): import of file "2018csvdata.txt" started (type:6, mode:0).
import (25.08.2019 12:56:39): invalid timestamp in line 2: 2018-1-1,75.7,65.9,58.6,65.8,60.4,57.2,96,83.7,56,30.19,30.07,17,3.6,19,0.00
import (25.08.2019 12:56:39): completed 0 records (0 ignored), 0 db writes

I don't think this format is compatible with the templates in meteobridge.
Post Reply