Large Archive Management

**Bunni** · 06-01-08, 05:05 PM

I have a archive of a couple thousand files ranging from sizes anywhere >1mb - <50mb. I need to compress them down and store them. Whats the best way of going about this? The files are currently arrange in groups of months.

I was thinking about rar'ing each month which seems to take the file size down to about a half.

I dont want to compress the entire archive into one giant rar, i need some kind of fault talerence, whats the best way of doing this?
I do not need to be able to access the files instantly so they can be in a tight compression...

Ive never done this before, anyone have any tips about the best way to go about doing this?

Any and all help will be greatly appreciated.

**RhysJD3** · 06-01-08, 10:26 PM

http://support.microsoft.com/kb/307987

http://techbold.com/2007/07/save-dis...g-folders.html

Probably doesn't compress enough for what you're doing though.

**Bunni** · 06-02-08, 11:05 AM

I was more or less debating upton raring each month up, then raring the rar'ed months up and split the total rar into several for quicker transfers.

Zip compresses it to about 80% while rar compresses it to 40-50%.

**DeusInnomen** · 06-02-08, 11:07 AM

Try using QuickPar to create parity files for the ZIP you create. It can be used to repair any errors in the data. http://www.quickpar.org.uk/

Also, the parity files can target multiple files, not just a single one.

**K0nTANK3Rous** · 06-02-08, 11:10 AM

WinRar is how i do it...you can split the monthly rar into several manageable file sizes that you can set the file size on. That way it's not so friggin' big and it does give it SOME fault tolerance. Whenever you compress though, you're risking file integrity.

**geeseven** · 06-02-08, 01:31 PM

Originally Posted by DeusInnomen

Try using QuickPar to create parity files for the ZIP you create. It can be used to repair any errors in the data. http://www.quickpar.org.uk/

Also, the parity files can target multiple files, not just a single one.

I wan going to recommend the same thing. Plus there are tools for par2 files for windows, OS X and linux.

**Veovis** · 06-02-08, 03:06 PM

Optical media is cheap and time is free. Just burn it all to DVD-R uncompressed.

You won't actually be sacrificing any time since your extra burn time would just be extra compress time if you were compressing.

amileqpetrov8541 · 12-01-12, 06:35 PM

ALERT!

Someone has tried to register using the IP Address 93.166.121.107 which is MATCHED IN THE RBL DATABASE of the proxies.dnsbl.sorbs.net RBL.

This registration attempt has been allowed and the account has been permanently banned.

Registration Details: amileqpetrov8541 ( amileqpetrov@cmail.com )