Topic: [ANNOUNCE] smeserver-dar2

[raem]

dtech

> I've installed the contrib and I can't seem to find anything that suggests incremental.

Darrell's contrib smeserver-dar2 and the other you mentioned e-smith-backup with dar are completely different contribs, and they do different things, Darrell mentioned this earlier in this thread (back a page or two).

[dtech]

So he did, RayMitchell, thanks for pointing that out. All of a sudden we have backup choices...

-P

[jpl]

For people who needs dar backup with incremental backup and selective restore I point that e-smith-backup with dar  has a new bugfix release : http://bugs.contribs.org/attachment.cgi?id=591

[wjhobbs]

I did a little testing over the past few months on backup2 and then dar2. Thought some of you might be interested in the results.

The machine had a 2.0GHz processor with 2GB SDRAM and a pair of 160GB IDE hard drives running under SME7. Quite a lot of the data (80-90%+) to be backed up contained images that already had some level of compression applied. So no conclusions should be drawn about the effectiveness of the compression routines.

In August 2006 we ran some backup tests using backup2 to try to get a sense of what worked best. Here are the results for backup of a server with 65.7GB data.

Tool--------Compression_Level--Transfer_Technology--Result_Size----Time----Compress _Size---Data_Rate
backup2-----------0-----------------10/100_ethernet-------65.7GB--------9_hrs-----------100%---------7.3GB/hr
backup2-----------3-----------------10/100_ethernet-------36.7GB--------19_hrs-----------56%---------3.5GB/hr
backup2-----------3--------------------USB_2------------------36.7GB-------21.5_hrs---------56%---------3.1GB/hr

The last two columns provide the most significant information.

Clearly, the compression is a bigger factor than data transfer speeds on overall backup time. This means that USB is only slightly slower than 10/100 Ethernet as a storage option for this situation.

We then tried the backup in October using dar2 on the same server with slightly less source data. Here are the results for backup of a server with 64.3GB data.

Tool--------Compression_Level--Transfer_Technology--Result_Size----Time----Compress_Size---Data_Rate
dar2---------------3--------------------USB_2------------------36.9GB-------11_hrs-----------59%-----------5.8GB/hr
dar2---------------3------------------SATA-150----------------36.9GB-------8.5_hrs-----------59%-----------7.6GB/hr
dar2---------------0------------------SATA-150----------------64.3GB-------45_min----------100%----------85.7GB/hr

The USB option for the two backup mechanisms shows 'dar' being much more efficient than 'rar' in terms of time (5.8GB/hr vs. 3.1GB/hr) for a similar compression effect (difference of 3% in compressed file size).

As one might expect, a backup to a locally attached SATA drive with no compression is by far the fastest approach. However, the data rate (85.7GB/hr in this environment) blew me away!

[dmay]

Great report!

As one might expect, a backup to a locally attached SATA drive with no compression is by far the fastest approach. However, the data rate (85.7GB/hr in this environment) blew me away!

What exact SATA hardware was used and how was the SATA drive connected? Internal, external, removable chassis, SATA controller?

Darrell

[wjhobbs]

Darrell,

This describes the environment http://forums.contribs.org/index.php?topic=34197.msg148082#msg148082

John

[dvdsmith]

Darrell,

Just loaded DAR2 the other day, thanks for the great work!  I really appreciate the choice of cifs or smbfs.

Currently I'm still using backup2 because I find the RAR files more convenient to open, but as I'm able I'll transition over to the new contrib.

Slightly off topic, but does anyone know of a Windows GUI app that supports DAR format?  I've done extensive searching and come up with squat.  My reason for this is because the most common occurence for me with my backup is to recover a single file or folder a user deleted a day or days ago.  A GUI app is more convenient and efficent in this situation.  Its also easier to teach someone else how to use it.  I know there is Kdar for the KDE desktop, but my primary work platform is a Windows PC.

Thanks, David

[dmay]

.. does anyone know of a Windows GUI app that supports DAR format?

Not that I've found. However there is a Windows command prompt version of dar in my contrib area. Follows the same syntax as the Linux version so see 'man dar' for details.

Darrell

[Matt]

I have installed backupusb on to my sme 7 box and when I get the following message in the log, can anyone help me sort this out so I can get backup working. Thanks

Nov 1 23:16:53 cranbrook esmith::event[13503]: Processing event: pre-backup2usb-custom 297802
Nov 1 23:16:53 cranbrook kernel: kjournald starting. Commit interval 5 seconds
Nov 1 23:16:53 cranbrook kernel: EXT3 FS on sda1, internal journal
Nov 1 23:16:53 cranbrook kernel: EXT3-fs: mounted filesystem with ordered data mode.
Nov 1 23:17:17 cranbrook e-smith-bg: cannot handle file 'libc.so.6' with TLS data

[dmay]

I have installed backupusb

Matt,

This thread is about smeserver-dar2. All backup2 contribs are deprecated and should be removed. Try smeserver-dar2. Read this thread for details.

Darrell

[wjhobbs]

Darrell,

I have specified "Expiry 2" in the server manager and have the backup running daily.

After today's run, should I expect to see 3 backup sets (today plus yesterday plus the day before yesterday) or should I expect to see just 2 (today and yesterday)?

John

[dmay]

Darrell,

I have specified "Expiry 2" in the server manager and have the backup running daily.

After today's run, should I expect to see 3 backup sets (today plus yesterday plus the day before yesterday) or should I expect to see just 2 (today and yesterday)?

John

It is based on your archive files last modified time. Here is the code in question:

Code: [Select]

/usr/bin/find $MOUNT/$ID/$DCF/*.dar -type f -mtime +$EXPIRY -exec /bin/rm -f {} \; > /dev/null 2>&1
'man mount' tells us:

Code: [Select]

     -mtime n
              File's data was last modified n*24 hours ago.
In most cases this will result in 'n' + 1 being left.

Darrell

[Carbon]

Set up dar2 and it worked fine but when I log onto the network later and do this......

[root@server ~]# /etc/e-smith/events/actions/dar2-backup backupdata

I get this......

Connecting /mnt/dar2/backupdata to //pentagon/dar
Error connecting to 192.168.0.145 (No route to host)
3897: Connection to pentagon failed
SMB connection failed
[root@server ~]#

and as you can see it because of this......

kmccain@pentagon:~$ ifconfig
eth0      Link encap:Ethernet  HWaddr 00:10:5C:DB:91:13
          inet addr:192.168.0.143  Bcast:192.168.0.255  Mask:255.255.255.0
          inet6 addr: fe80::210:5cff:fedb:9113/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:19564 errors:0 dropped:0 overruns:0 frame:0
          TX packets:8937 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:9215501 (8.7 MiB)  TX bytes:1004758 (981.2 KiB)
          Interrupt:201 Base address:0xe800

.... as the dhcp has given pentagon a new IP

so I tried restarting the client.... restating the dhcpd on the server.... but it appears that once the dar has backuped to an IP it sticks with it... But I feel sure that's not right.

Should I fix the IP of the client (pentagon), it's a laptop so I'd rather not. Or is there a config for dar that I've missed. I would have thought //pentagon/dar, which is constant would be OK.

Any help would be appreciated, thanks...

[dmay]

Connecting /mnt/dar2/backupdata to //pentagon/dar
Error connecting to 192.168.0.145 (No route to host)

Error reports should always go to the Bug Tracker. However, this is more likely a network WINS/DHCP config error. Make a bug report and we'll track it done in the Bug Tracker.

Darrell

[erykwol]

Darrell,

Is it possible to adjust the "Expiry logic" so, that the program "counts" backup sets instead of backup dates?.
I have a problem with more then 1 usbdisks, which I swap every day.
When I have 3 disks and I want to have 2 sets of backup on each, how can I setup that?

Any help would be appreciated, thanks...

Eryk