Forums >> StudioSysAdmins Lists (posts via e-mail only) >> Discuss@StudioSysAdmins.com


Symlink navigation

I need to spread some folders over multiple servers.? Some servers are OSX, some are NAS.? OSX doesn't handle UNC paths natively.? If? I mount the NAS on my OSX server and create symlinks in a folder to the NAS, does traffic to/from the NAS end up going through the OSX server on which the link lives or will it talk directly to the other server?

thanks

Re: Symlink navigation

Hi Daniel,

If you're pointing to a folder (be it a symlink or not) on your OS X server for information that actually resides on a NAS device the traffic will go through the OS X Server. The end device doesn't know about the symlink on the server, it only knows to look there for the information it requires.

Cheers, Andrina

On 2010-05-12, at 4:32 AM, Daniel Roizman wrote:

I need to spread some folders over multiple servers. Some servers are OSX, some are NAS. OSX doesn't handle UNC paths natively. If I mount the NAS on my OSX server and create symlinks in a folder to the NAS, does traffic to/from the NAS end up going through the OSX server on which the link lives or will it talk directly to the other server?

thanks

_ StudioSysAdmins-Discuss mailing list StudioSysAdmins-Discuss@studiosysadmins.com http://mailman.studiosysadmins.com/mailman/listinfo/studiosysadmins-discuss


StudioSysAdmins-Discuss mailing list StudioSysAdmins-Discuss@studiosysadmins.com http://mailman.studiosysadmins.com/mailman/listinfo/studiosysadmins-discuss
Re: Symlink navigation

It might be worth clarifying.


If you have a 100MB file on your NAS, and a symlink on your osx server, a NFS client will read the symlink and then read the 100MB file directly from the NAS. So it is reading something from your OS-X server every time, and when this scales up to a big renderfarm it can be a big issue (even if it is a small link tree), but for most setups this can work extremely well (say a renderfarm with < 1000 nodes).

I hope that helps...

Sam.

On Wed, May 12, 2010 at 5:42 AM, Andrina Kelly <andrina@magpies.ca> wrote:
Re: Symlink navigation

so there is an i/o penalty on the osx server, but the actual transfer will come directly from the NAS through the switch to your box?


On Wed, May 12, 2010 at 4:02 PM, Sam Richards <sam@imageworks.com> wrote:
It might be worth clarifying.

If you have a 100MB file on your NAS, and a symlink on your osx server, a NFS client will read the symlink and then read the 100MB file directly from the NAS. So it is reading something from your OS-X server every time, and when this scales up to a big renderfarm it can be a big issue (even if it is a small link tree), but for most setups this can work extremely well (say a renderfarm with < 1000 nodes).

I hope that helps...

Sam.

On Wed, May 12, 2010 at 5:42 AM, Andrina Kelly <andrina@magpies.ca> wrote:
Re: Symlink navigation

Until you are hitting it with a few 1000 cores (perhaps more), the load is very small on the osx server. One funny thing (or perhaps not so funny) that we have recently seen is that there are advantages to keep the depth of the paths short in terms of # of directories, since NFS will need to do a get-attribute lookup for each directory level to make sure that you have the access rights. So the shallower the depth the better.


There also is the alternative of using automounters, which can be good for certain types of directories.
I've often wondered about having a top level tree done with auto-mounters, going to a link-tree that goes to the NAS.

i.e.
/net/shows/SHOWNAME ? ?<- this being a automounter branchpoint.
/net/shows/SHOWNAME/SEQ/SHOT <- this being the link tree to the NAS (or even put it deeper).?
I think if you mostly have a single show at a time, there isnt a big advantage of this, but if you can end up with multiple shows, this can help spread the link-trees over several servers.

If you want to get really sneaky with automounters you can even have multiple link-trees and have the automounter load-balance between them.

Sam.


On Wed, May 12, 2010 at 4:37 PM, Daniel Roizman <roizman@kolektiv.com> wrote:

so there is an i/o penalty on the osx server, but the actual transfer will come directly from the NAS through the switch to your box?




On Wed, May 12, 2010 at 4:02 PM, Sam Richards <sam@imageworks.com> wrote:

    Contests/Surveys
  • ** COMING SOON **

TopofBlogs