Koozali.org: home of the SME Server

Backup to USB - Slowness

Offline janet

  • *****
  • 4,812
  • +0/-0
Re: Backup to USB - Slowness
« Reply #15 on: April 10, 2010, 02:23:22 AM »
daniel

See the "Backup config" wiki Howto article. You are best to use a sme backup & restore solution as the mysql databases are dumped, and proper pre and post signal events are run, for both backups and restores.

I don't quite understand why you need a full backup everytime. You can do one full backup (which takes a long time), and then numerous incremental backups  (which usually only take a few minutes depending on how much data has changed).
Using the GUI server manager Backup or restore panel options, you can selectively restore individual files, and you can select any date to restore your whole system to. The restore grabs information from the full backup and the chosen daily incremental backup to rebuild the server as it was on that day, except for installed applications (where they are not in ibays).

If you want a full and a incremental on the one "disk" to remove off site, then have multiple disks and initially run a full backup on each of them, then rotate the disks adding only (quicker to do) incrementals. Set the backup parameters appropriately of course.

Note tha Backup or restore panel gives you an estimate of the actual data being backed up, if you are unsure of the backup data size. My speed comments were based on that amount of total space used on your hard drive. If less, then it should be significantly quicker.

If you want quick backups on a regular basis, which includes the whole system, including applications, and assuming you are using RAID1, then put one drive into a removable caddie or front panel "HDD slot", and simply swap out one drive of the RAID array. Put the new drive in and run Manage disks (or similar name) from the Console to rebuild the array. Yes you do need to shutdown the server as current kernels do not support hot swap, but it will take less than 5 minutes, far quicker than waiting 7.5 hours.
You have to "zero" or blank the replacement drive if it already has data on it. Search the wiki and forums, it has been mentioned many times.
« Last Edit: April 10, 2010, 02:34:49 AM by mary »
Please search before asking, an answer may already exist.
The Search & other links to useful information are at top of Forum.

Offline cactus

  • *
  • 4,880
  • +3/-0
    • http://www.snetram.nl
Re: Backup to USB - Slowness
« Reply #16 on: April 10, 2010, 09:06:51 AM »
I saw in the SME 7.5 RC notes there was some updates to the backup. 
e-smith-backup
- Fix full backup on Sunday displayed as Everyday. [SME: 5624]
- workstation backup: add cifs credentials expand to bootstrap-console-save [SME: 4850]
- workstation backup: using credentials file for cifs mount [SME: 4850]
- workstation backup: allow many backups in the same day [SME: 5393]
- workstation restore: all needed backups must be available before restore [SME: 5395]
- workstation verify: add option to check integrity of backups needed in a full restore [SME: 5396]
- minor fix in translation [SME: 5406]
- Fix DAR e-mail message with regards to incremental backups [SME: 4579]
- Fix discrepancy in maximum compression level [SME: 4841]

I look forward to testing to see if these fixes have given me any performance improvements.
Not to disappoint you, but I see no performance related bugfixes... Backing up large amounts of data takes time as you already experienced.

Do you really need full backups every time? Otherwise you caould set up a scheme with full and incremental backups, which would speed up backing up at least for subsequent sets as only the difference needs to be archived.
Be careful whose advice you buy, but be patient with those who supply it. Advice is a form of nostalgia, dispensing it is a way of fishing the past from the disposal, wiping it off, painting over the ugly parts and recycling it for more than its worth ~ Baz Luhrmann - Everybody's Free (To Wear Sunscreen)