meteohub.de

Meteohub Forum
https://forum.meteohub.de/

Still problems with wswin data import **solved**

https://forum.meteohub.de/viewtopic.php?t=15234

Page 1 of 1

Still problems with wswin data import **solved**

Posted: Fri Oct 23, 2020 1:00 pm
by WETRHE
Hi,

I am still having problems with wswin data import. After deleting all data from meteobridge, I tried to import the wswin export file EXP10_20.CSV from October for example. Meteobridge protocol says “reached 36%” and data has been imported until 8.10.only. If I run the same import again, meteobridge says “reached 60%” and data has been imported until 14.10. If I run the import again and again it finally says “reached 75%” and data has been imported until the 17.10. only but still not complete. I have no chance to reach 100% of data import.

import (23.10.2020 10:25:49): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:25:49): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:25:49): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:25:49): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:29:28): import of file "EXP10_20.CSV" reached 36% (2301 lines).
import (23.10.2020 10:31:06): completed 6339 lines, resulting into 2674 database updates
import (23.10.2020 10:50:54): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:50:54): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:50:54): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:50:54): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 10:54:37): import of file "EXP10_20.CSV" reached 60% (3801 lines).
import (23.10.2020 10:56:12): completed 6339 lines, resulting into 4424 database updates
import (23.10.2020 11:54:33): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 11:54:33): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 11:54:33): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 11:54:33): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 11:58:06): import of file "EXP10_20.CSV" reached 75% (4801 lines).
import (23.10.2020 12:00:39): completed 6339 lines, resulting into 5586 database updates
import (23.10.2020 12:12:34): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 12:12:34): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 12:12:34): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 12:12:34): import of file "EXP10_20.CSV" (626 kb) started (type:6, mode:1).
import (23.10.2020 12:16:09): import of file "EXP10_20.CSV" reached 75% (4801 lines).
import (23.10.2020 12:20:24): completed 6339 lines, resulting into 5586 database updates

Could you have a look at this please?
Thanks in advance & best regards!

Re: Still problems with wswin data import

Posted: Sat Oct 24, 2020 12:22 pm
by admin
Meteobridge has changed import function to do this in separated chunks and pausing after a while in order not to block other database operations like logging of new data, resolving templates, doing uploads etc.
Therefore, when having a look after few hours the logs should tell you that it is finally completed. This is the theory ;-)

Please send file to be imported to "info(at)smartbedded.com" so that I can check that import of this file behaves like it should.

Re: Still problems with wswin data import

Posted: Sat Oct 24, 2020 5:21 pm
by admin
I found an older WSWIN export and can reproduce the error. Please try just released update, which should have this solved.

Code: Select all

import (24.10.2020 17:23:43): import of file "EXP07_20.CSV" (338 kb) started (type:6, mode:0).
import (24.10.2020 17:26:08): completed 3393 lines, resulting into 3962 database updates
import (24.10.2020 17:26:53): import of file "EXP11_18.CSV" (1353 kb) started (type:6, mode:0).
import (24.10.2020 17:30:28): import of file "EXP11_18.CSV" reached 39% (3401 lines).
import (24.10.2020 17:38:35): import of file "EXP11_18.CSV" reached 78% (6801 lines).
import (24.10.2020 17:42:02): completed 8641 lines, resulting into 27322 database updates
Looks like the NANO SD is a bit quicker than an MB PRO when it comes to database operation as the EXP07_20.CSV was imported in one snap.

Re: Still problems with wswin data import **solved**

Posted: Sat Oct 24, 2020 6:00 pm
by WETRHE
I tried now with latest release and it ran better but still did not reach the 100%

import (24.10.2020 17:33:47): import of file "EXP10_20.CSV" (654 kb) started (type:6, mode:1).
import (24.10.2020 17:37:21): import of file "EXP10_20.CSV" reached 36% (2401 lines).
import (24.10.2020 17:44:43): import of file "EXP10_20.CSV" reached 72% (4801 lines).
import (24.10.2020 17:48:58): import of file "EXP10_20.CSV" reached 98% (6501 lines).
import (24.10.2020 17:50:46): completed 6628 lines, resulting into 7714 database updates

Re: Still problems with wswin data import **solved**

Posted: Sat Oct 24, 2020 6:07 pm
by admin
It did reach 6628 lines after it has stopped at line 6501 (98%) on the run before. So you should be good.
I will change the message to make it more obvious.
All times are UTC+02:00
Page 1 of 1

Powered by phpBB® Forum Software © phpBB Limited