Sponsors
Sponsor Products
Hard Linking on Isilon storage
posted by Steven Shapiro  on April 4, 2017, 9:41 p.m. (3 months, 22 days ago)
2 Responses     1 Plus One's     2 Comments  
I was just wondering if anyone out there would be willing to share an answer to a simple question.  Are you using hard linking to create duplicate sets of data or for other workflows, particularly on Isilon storage?  Alternatively, other storage solutions where you are using hard linking?   Any other details you can provide to experience and performance characteristics would be helpful.   Thank you.   -Steve

Thread Tags:
  storage 

Response from Brett Dellandre @ April 5, 2017, 12:52 a.m.

Yes. you can have 1000 hard links per file on Isilon storage. It is much easier to do via NFS or on the cluster or via API call versus SMB+Windows. It is circumstantial based on cross mounts for example within the same mount yes you can create a hard link but if you create it on mount1 and mount2 you will have issues but that is all filesystems and most filesystems that dont use a filesystem driver.

Note that you can raise that limit to 65k hard links with an Isilon system tunable but we rarely get that ask. And you should also keep in mind Quotas, Snapshots and SyncIQ workloads as they will have a significant impact for backend workflows.

This is all for OneFS 6.5+ ftr.

If you are lazy you can run dedupe (if you are licensed for it) as a post process job across the filesystem to effectively do the same type of data reduction if your workflow calls for it.

Eitherway yes. Feel free to contact me if you want to talk more about it.

-Brett Dellandre, Isilon System Engineer, Dell EMC Isilon Emerging Technologies Division

brett.dellandre@emc.com

brett.dellandre@gmail.com

 


1 Plus One's     1 Comments  
   

Response from Jean-Francois Panisset @ April 4, 2017, 10:30 p.m.
Flame can do that when exporting an image sequence / timeline if the source and destination are on the same volume. Makes for some interesting conform / grading workflows where you can import a large number of DPX files from a SAN volume (say), conform them, and publish the conformed sequence back to the same SAN volume without creating new media.

JF


On Tue, Apr 4, 2017 at 6:41 PM, Steven Shapiro <content@studiosysadmins.com> wrote:
I was just wondering if anyone out there would be willing to share an answer to a simple question. Are you using hard linking to create duplicate sets of data or for other workflows, particularly on Isilon storage? Alternatively, other storage solutions where you are using hard linking? Any other details you can provide to experience and performance characteristics would be helpful. Thank you. -Steve

To unsubscribe from the list send a blank e-mail to mailto:studiosysadmins-discuss-request@studiosysadmins.com?subject=unsubscribe


0 Plus One's     1 Comments