CRIN Trac: Ticket Query

#35: Problem with the S3QL backups for Crin1

chris — Mon, 07 Sep 2015 10:55:30 GMT

Just tried mounting all the backup on Crin4 and there was a problem with the Crin1 backup:

umnt-s3ql crin1
/media/s3ql/crin1 is not on an S3QL file system
Can not check mounted file system.
mnt-s3ql crin1
Can not check mounted file system.
Filesystem check of s3c://s.qstack.advania.com:443/crin1 failed
Using 2 upload threads (memory limited).
Autodetected 65498 file descriptors available for cache entries
Using cached metadata.
File system damaged or not unmounted cleanly, run fsck!
Mounting s3c://s.qstack.advania.com:443/crin1 on /media/s3ql/crin1 failed
mnt-s3ql crin1 --force
Can not check mounted file system.
Filesystem check of s3c://s.qstack.advania.com:443/crin1 failed
Using 2 upload threads (memory limited).
Autodetected 65498 file descriptors available for cache entries
Using cached metadata.
File system damaged or not unmounted cleanly, run fsck!
Mounting s3c://s.qstack.advania.com:443/crin1 on /media/s3ql/crin1 failed

#39: S3QL backup problems

chris — Wed, 09 Sep 2015 11:36:18 GMT

Often backups fail during the rsync with "Transport endpoint is not connected".

The S3QL Crin3 backup script mounts on /tmp but the other scripts don't so where there is some issue the unmount don't work as the S3QL system is mounted in an unknown location, see ticket:35. [SOLVED]

There are also some unneeded scripts in /usr/local/bin on Crin3 which need removing to make things less confusing. [SOLVED]

#59: Trac Spam

chris — Wed, 13 Jan 2016 20:38:11 GMT

We might have to whitelist email addresses which can open tickets or something, see ticket:58

#67: S3QL 2.17 has been released

chris — Wed, 09 Mar 2016 19:07:56 GMT

This is worth noting:

From the changelog:

2016-03-08, S3QL 2.17

The internal file system revision has changed. File systems created with S3QL 2.17 or newer are not compatible with prior S3QL versions. To update an existing file system to the newest revision, use the s3qladm upgrade command.
https://groups.google.com/forum/?_escaped_fragment_=topic/s3ql/t36XMqiS5TU#!topic/s3ql/t36XMqiS5TU

Currently Debian unstable has 2.15:

https://packages.debian.org/stretch/s3ql

But it should update soon.

#68: {Spam?} Best watches.

Alasteir@… — Mon, 14 Mar 2016 00:35:03 GMT

 Order watches here-
... spam removed...

#70: s3ql backup error

chris — Mon, 11 Apr 2016 10:08:41 GMT

Email from Crin3:

Starting fsck of s3c://s.qstack.advania.com:443/crin4/
Using cached metadata.
WARNING: Remote metadata is outdated.
ERROR: File system revision too old, please run `s3qladm upgrade` first.

#79: Create accounts for Matthew

chris — Thu, 21 Jul 2016 10:15:23 GMT

Create Trac and other accounts for Matthew.

#85: Trac is run on a different IP

matthew — Tue, 04 Oct 2016 15:07:07 GMT

#90: Cost of backup is estimated

matthew — Tue, 25 Oct 2016 07:06:20 GMT

It would be useful to estimate the expected cost of back up, by estimated the size and correlating this with the advertised price page.

#60: Advania S3 Account

chris — Thu, 04 Feb 2016 11:36:22 GMT

This ticket is to track the time spent answering Andrew's questions regarding the Advania S3 account which is used for backups by Crin3.

#66: Optimise backups, omit some MySQL tables and delete old backups from s3ql

chris — Tue, 08 Mar 2016 10:59:50 GMT

Currently the DumpMysqlTables script doesn't omit or truncate any tables so the backups contain unneeded data, such as cache tables, Drupal tables which can be truncated, see:

https://drupal.stackexchange.com/questions/22041/which-drupal-tables-are-safe-to-clear

The same will be the case for Piwik and ownCloud and MediaWiki.

In addition php session files should be deleted.

Also the S3QLBackup script could be improved so it deleted old backups.

#81: crin3 backup issue

chris — Fri, 19 Aug 2016 09:36:01 GMT

Munin email alert I'm getting every 5 mins:

Date: Fri, 19 Aug 2016 09:30:16 +0000
From: munin application user <munin@crin1.crin.org>
Subject: crin3.crin.org Munin Alert
crin.org :: crin3.crin.org :: Disk usage in percent
        WARNINGs: / is 97.35 (outside range [:92]).
        OKs: /run is 10.40, /dev/shm is 0.00, /boot is 87.07, /run/lock is 0.00, /sys/fs/cgroup is 0.00, /run/user/1000 is 0.00.

#89: Broken Links

matthew — Mon, 24 Oct 2016 12:11:44 GMT

https://www.crin.org/en/library/publications/crin-newsletter-15-mainstreaming-child-rights https://www.crin.org/en/library/publications/crin-newsletter-16-children-and-young-peoples-participation

were reported as broken

#104: Problem with CRIN1 and CRIN2 backups

chris — Tue, 21 Mar 2017 09:32:43 GMT

Errors from the s3ql backup scripts:

Backend reports that file system is still mounted elsewhere. Either the file system has not been unmounted cleanly or the data has not yet propagated through the backend. In the later case, waiting for a while should fix the problem, in the former case you should try to run fsck on the computer where the file system has been mounted most recently. You may also continue and use whatever metadata is available in the backend. However, in that case YOU MAY LOOSE ALL DATA THAT HAS BEEN UPLOADED OR MODIFIED SINCE THE LAST SUCCESSFULL METADATA UPLOAD. Moreover, files and directories that you have deleted since then MAY REAPPEAR WITH SOME OF THEIR CONTENT LOST.

#111: Backups to Webarchitects server

chris — Thu, 13 Apr 2017 10:11:54 GMT

This is a ticket to setup backups to store1.webarch.net on.