Would love to see some performance specs on that thing. Especially with a 10Gig Ethernet connection. WOW. Article brings up another good point about the speed of http for file transfer. Anyone using http/https instead of nfs/smb/etc..? I suppose it would take quite a bit of work to setup a web-based facility but the scalability options (especially in regards to an increasing presence of offsite freelancers and a decentralization of the studio) are definitely attractive.

Michael Oliver

Look Effects, Inc.

moliver@lookfx.com

wk: 323.469.4230 x111

cell: 858.336.1438

From: studiosysadmins-discuss-bounces@studiosysadmins.com [mailto:studiosysadmins-discuss-bounces@studiosysadmins.com] On Behalf Of Klaus Steden Sent: Tuesday, September 01, 2009 5:06 PM To: discuss@studiosysadmins.com Subject: Re: Question about network deleting.

You could try one of these ...

http://blog.backblaze.com/2009/09/01/petabytes-on-a-budget-how-to-build-chea p-cloud-storage/

Klaus

On 8/31/09 12:43 PM, "Greg Whynott" Greg.Whynott@oicr.on.ca etched on stone tablets:

Another free non rsync approach is a 'copy on write' file system, such as ZFS. I took a look at a snapshot solution on linux using XFS at a previous job which worked as expected. I'm sure there are other filesystems out there that support it. I don't think you have to spend a lot of money to get file level protection, its more a matter of available capacity.

-g

On 8/28/09 12:20 PM, "Jorg-Ulrich Mohnen, M.Sc., MBA" jorg.mohnen@wavgen.com wrote:

Just followed this thread and wanted to give my two cents on this. Perhaps someone already mentioned it.

Its really a 0 or a 1 here. If your company has no money, then setup a cheap RAIDed solution as Jesse C suggests, and do an rsync every night from 12 midnight to 6am on the folders you need rsynced. Its really quite easy under linux /etc

I have setup cheap Linux RAIDs for this type of nightly back up on Linux for under $2000 and with a more stable and secure MAC OSX server and XRAID for under $5000. The RAIDed linux software solution would yield about 4TB of usable space, and the MAC Server XRAID solution would yield around 6TB of usable space. Keep in mind that Apple only delivered IDE XRAIDs with maximum 500GB IDE disks. I bought the 750GB disks from CDW (OEM) and they work just fine under non-warranty conditions.

This solution guarantees a 24 hour ~quasi~ snap shot at times of low to minimal production. And make this KNOWN to the artists and folks that there are only 24 hour back ups as there is no money for a more expensive solution.

The more expensive hardware like Isolons and NetApps and especially BlueArcs have more elegant solutions and they will actually give you scripts. In Blue Arcs case, they actually have prewritten stuff as part of the deal. SUN MIcroSystems is a class in itself and are excellent in this type of support. If you pay $70,000 for a small 9TB usable volume (16TB raw), you might expect them to bend over backwards to help you out. And in the three companies I have recently worked for since SONY, they did (Jim Henson Co, YuCo, and StudioGPU). I rewrote some stuff elegantly and the snap shots approached runtime and were not ~quasi~ snapshots or nightly backups, but actual snapshots.

J.

On Aug 28, 2009, at 9:02 AM, Jesse C wrote:

We're currently snapshotting between 1.8TB and 2.3TB of production files with 2.7TB of snapshot disk. We snapshot every 6 hours and keep snapshots for a month by default, but we've got cron scripts that go through and remove older snapshots if we start running out disk space (which can happen if there has been ridiculous amounts of churn in the file system).

We could easily increase the size of our snapshot if we needed to. We've got 5x750GB drives right now in the RAID. If we had to, we could expand out to 6 drives in the RAID and move up to 2TB drives, which would give us close to 10TB. Not quite what you guys need, but there are motherboards out there with 10xSATA ports on them, which when combined with 2TB drives, would get you more into your ballpark.

On Fri, Aug 28, 2009 at 9:44 AM, Curtis Linstead curtis@rodeofx.com wrote:

Jesse,

Thanks for the info! I will definitely look further into this as a potential option for us.

How large was the pool you were doing the snapshot on and how large was the RAID you built?

From what I'm reading I would need the size of one full backup plus a

little more and my current data pool can hit upwards of 16TB.

Not sure how easily I could configure that on a montherboard based raid heh, but it definitely interests me.

Thanks again!

---

StudioSysAdmins-Discuss mailing list StudioSysAdmins-Discuss@studiosysadmins.com http://mailman.studiosysadmins.com/mailman/listinfo/studiosysadmins-discuss

Jorg-Ulrich Mohnen, M.Sc. MBA WavGen / Terratracer Incorporated 901 North Curson Avenue West Hollywood, CA 90046 Tel 888-654-5615 Email jorg.mohnen@wavgen.com

---

---

StudioSysAdmins-Discuss mailing list StudioSysAdmins-Discuss@studiosysadmins.com http://mailman.studiosysadmins.com/mailman/listinfo/studiosysadmins-discuss

No virus found in this incoming message. Checked by AVG - www.avg.com Version: 8.5.409 / Virus Database: 270.13.74/2339 - Release Date: 09/01/09 06:52:00