meteohub.de

there is only one more thing to be considered for the backup USB device - if you want to keep all your minute based historical data and have many sensors (or even stations), the size of your database will eventually get bigger than 4 GB.
Then the FAT32 format for the external USB device will no longer work as the maximum file size under FAT32 is 4 GB.
Then your devcie needs to be formatted with e.g. ext4 - the latter making it unreadable directly under Windows.
Mounting it into the exported file system (SMB share) of Meteobridge will make it again readable from within Windows.

Hi,

Adding to this discussion from some months ago. I have also a problem with the 1 GB storage that is full. Due to many sensors and storing up to 1 year data in 1 minute interval. As the screenshot shows there is only 34 MB left.

How to release that data? I changed to storing mapped sensors for 180 days. But that doesn't release any used space. Only the remaining estimated days of use goes up a bit but no MB's are released.

Because of the full storage, database it is almost continuously locked and I can't generate graphs and service events don't work well.

Hoping for an answer,

Ton

looks like the Option has moved from System --> Administration to Database --> Administration
(the menu naming and menu items have changed in the last updates)
In the section "Time Resolution" you can choose the release of minute-based data now

if you want to keep your minute data - either do a regular (e.g.) daily export or/and change the internal USB stick to a bigger size (or use the microSD with USB adapter approach discussed in this thread earlier - cheaper and bigger sizes available)

There I changed it to 180 days already. All that happened is that 16 days storage became 26 days, but no memory was released.

TonvG wrote: ↑Thu Jun 08, 2023 7:24 pm There I changed it to 180 days already. All that happened is that 16 days storage became 26 days, but no memory was released.

the database will not shrink when the minute data is deleted (unless you make a database reorg, which won't be necessary) - however, there will be more free space in the already allocated database storage available for storing data; hence the increase from 16 to 26 days.

to remain in clear terminology:
storage = disk space (USB, microUSB)
memory = RAM

But how to increase the left space to an acceptable level. I think it is becoming critical as the system was stalling now.

How to do the database reorganisation? I can throw some mapped sensors out that are less important.

a database reorg won't give you extra space - it's just for the eye (so-to-say). Less free space in the database and more outside.
If you want to delete data ("unimportant" sensor data,) you will to do this via a mySQL script which does the job - and you need to know what you do - and in a couple of months you will stand at the same point.

I strongly suggest that you get yourself a small microSD to USB adapter, real thumbnailsize (+/- 10 EUR) and an e.g. 8 (or 16) GB SLC microSD - (16 GB = 30 EUR at arrows.com or mouser.com) and replace the 1 GB memory stick in your MB Pro. A video for performing the storage upgrade is available. It's pretty simple.

Time has moved on - in earlier times when the MB Pro was designed there was mainly basic sensor data and no minute data stored in the database.
So 1 GB would hold for up to 10 years. Times have changed though. More sensors, more needs for smaller interval data.
That's why the new MB Pro2 comes with 16 GB storage.
=> time to upgrade your MB Pro storage - I did it from 1 GB to 8 GB - and my MB on RPi run on a 16 GB SLC microSD.

I have a lot of sensors - with derived data it comes up to 50 items per minute per station.
My System information says 55% storage used and 2.2 more years to go (on my MB on RPi with three stations).
In two years I will replace my 16 GB SLC microSD by either a 32 or 64 GB SLC microSD and will live in peace for ten more years to come.

Ok.

But I accidentally once removed my database to the USB memory stick that I wanted to use for backup. Then is was mentioned that the internal 1GB storage was industry quality and better then a random USB memory stick.

Are micro SD's to USB better and more reliable?

Thanks for all the help BTW.

The operational USB stick needs to be SLC but a USB in the front or rear slots used for backup can be any good consumer grade and capacity

TonvG wrote: ↑Thu Jun 08, 2023 8:31 pm Ok.

But I accidentally once removed my database to the USB memory stick that I wanted to use for backup. Then is was mentioned that the internal 1GB storage was industry quality and better then a random USB memory stick.

Are micro SD's to USB better and more reliable?

Thanks for all the help BTW.

if you read closely what I have written, then you will see that I have always spoken of SLC microSD for the internal storage - the internal USB stick is also SLC industrial quality (official term: industrial grade flash memory with single level cells (SLC)).
The SLC microSD cards are used with a RaspberryPi and Meteobridge
See also https://meteobridge.com/wiki/index.php/Hardware under RaspberryPi

I use the Western Digital ones as they are the only ones available with bigger size (and a reasonable price).
Western Digital/SanDisk SDSDQED-008G-XI, SDSDQED-016G-XI, SDSDQED-032G-XI, SDSDQED-064G-XI (microSD Card, 8-64 GB, SLC Flash)
e.g. https://www.arrow.com/en/products/searc ... QED&r=true
8 GB: 18 EUR
industrial grade means here that it can take many more writes (TBW: terabytes written) than usual flash memory* and is built for more extreme operation environments (e.g. temperature - but not relevant for a Meteobridge )
*) even though there are meanwhile also consumer products which come close to the industrial grade as far as I/O operations are concerned. Other features are not relevant in our context.

the microSD to USB adapter is not impacted by the number of read/writes, only the flash memory (and if this resides inside a USB stick or on a microSD card doesn't matter) - SLC USB sticks (usually by ATP) are significantly more expensive and give no added value for the higher price over a microSD/USB adapter solution in this context here.

Indeed I found out by using Google that the SLC type is the industrial quality.

How is the easiest procedure further for me? I use my Meteobridge Pro now for about 1,5 years and buying the Pro 2 version at this moment is a bit too soon for me.

1. Buy a 8 or 16 GB SLC microSD and USB adaptor
2. Connect it and backup on the microSD
3. Switch to the microSD as the Database medium

Does that work in that way? Will it recognise and start from the backup file? Or do I have to export to and import from my computer?

in my view, from what I understand, you have two options:
1. upgrade your MB Pro from 1 GB to 8 or 16 GB storage (details in the thread earlier)
2. getting a new device in addition (also later or in parallel, ....)

If you can manage and really want a strong, flexible, expandable solution (with some more energy consumption than a MB Pro2), go for Meteobridge on RaspberryPi and start with a 16 GB SLC microSD - it's definitely more performant than a MB Pro2 (and cheaper too and can be easily expanded to bigger storage [32, 64 GB] whereas the MB Pro2 has 16 GB "only")

I myself have two MB Pros and moved to the RaspberryPi (RPi4B 2GB RAM, 16 GB microSD SLC storage) as the MB Pros were too weak to manage my number of sensors per station and more than one station. Plus the MB Pro2 didn't existing at that time - but eventually it will be too weak and too small storagewise for my scenarios.
It's a matter of choice, need etc. and a MB Pro with expanded storage (option 1) might simply meet your needs - it's 40 EUR vs. 400 EUR for a MB Pro2.
During this year the RPi4B will be available again for a reasonable price as per the manufacturer's announcement.

in my view, from what I understand, you have two options:
1. upgrade your MB Pro from 1 GB to 8 or 16 GB storage (details in the thread earlier)
2. getting a new device in addition (also later or in parallel, ....)

At the moment I'm going for option 1. I ordered some parts to make this possible. Cable and thumbnail connectors arrived already yesterday. Micro SD will arrive Monday or Tuesday. However I did buy another type. This one:

https://www.dataio.nl/sandisk-edge-16gb ... ore-anchor

I hope it is ging to work. My idea is to plug one in on the front and one one the back (I didn't realise first there was a micro USB connector there..). One for the database and one for regular backups.

The Western Digital version would take some weeks to arrive.

However, it seems something has changed. Last 2 days the Meteobridge restarted at 0:00 h. Further the 33 MB that is still left is now suddenly sufficient for 23.3 years?

Now it is SW version of June 9th. Something to do with that?

1. the usb-microSD adapter needs to be as flat as possible !
Some are a bit bulky at the microSD insertion end and risk not to fit !!
see video link below at 1:12
What looks good is e.g. https://www.amazon.nl/Micro-Kaartlezer- ... 00&sr=8-48

2. what do you need a cable for ?

3. I'm not sure if this rather new microSD card model is already on Boris' list of accepted microSD cards, but let's see
there's also a workaround

4. Western Digital has purchased SanDisk a few years ago

5. the video how to disassemble and re-assemble the MB Pro is https://www.youtube.com/watch?v=Wn0_tM_jjZI
just do as shown - only with the microSD/USD adapter combination instead of a USB stick

TonvG wrote: ↑Sun Jun 11, 2023 9:50 am .... Now it is SW version of June 9th. Something to do with that?

Hard to know without seeing what the release fixes were? Release log @ 11/6/23 shows the latest release as of May 18, 023