feature proposal - introduce a compression option for backup files on a RaspberryPi like with MB VM

all about Meteohub on the new Raspberry PI platform

Moderator: Mattk

Post Reply
User avatar
Gyvate
Platinum Boarder
Platinum Boarder
Posts: 453
Joined: Thu May 14, 2020 4:36 pm
Location: Saarbrücken, Germany

feature proposal - introduce a compression option for backup files on a RaspberryPi like with MB VM

Post by Gyvate »

I am admittedly an extensive user of the Meteobridge infrastructure, running, apart from 2 MB Pro with large storage extention, a MB on RPi4B / 2GB and a MB VM 128 GB installation.
The size of my MB database is meanwhile ~13 GB of storage which not only means the need for sufficient external backup storage (what I have, a 2 TB USB connected HDD) but also takes a long time to do in spite of the RPi4B power and the USB3 connection - during which the data loggin services are suspended (even though in principle data could be written to the Sqlite WAL (Write ahead logging) file and then retroactively written to the database after the backup is completed - but this doesn't happen. :( - One more thing to think about ....

On the MB VM the backups are created locally as compressed archives. Which saves a lot of storage space.

I suggest to offer, at least for RPi installations, a backup script option which compresses the database locally and then moves it to the external storage.
I am aware that sufficient local data storage is a prerequisite for that, but that's for the user to manage.
WH4000SE 1.6.6/1 x DP1500/4 x GW1000 1.7.7/GW1100 2.3.0/HP1000SE Pro 1.9.3//2 x WH2650 1.7.7/GW2000 3.1.0
2xMeteobridge Pro [B+R] 15161, 2xRPi4B-2GB/16/32 3139,VM128 1704
Weather Landing page: https://meshka.eu
Ecowitt WiKi: https://meshka.eu/Ecowitt/dokuwiki
Post Reply