Error saving USD to network folder

   13581   28   5
User Avatar
Member
918 posts
Joined: March 2014
Offline
tas3d
Houdini 19.0.436 Added a new USD ROP parameter that allows Houdini to work around some USD issues with overwriting USD files on network drives (at the cost of a performance penalty during the save)

Try this. Perhaps mtucker can chime in if this feature can help in this case.

I've tried this today with the production build, and it does solve the problem within a single Houdini session. E.g. if the session writing the USD is itself referencing/sublayering, etc. it in a stage. And this is somewhat mentioned in the tool tip. It's great progress for asset creation and validation.

However, if you have the USD in question opened in another Houdini session, e.g. colleague workstation on the network this mechanism cannot work.

Therefore, the issue is still unresolved with SMB shares.
User Avatar
Staff
4525 posts
Joined: July 2005
Offline
Andy_23
However, if you have the USD in question opened in another Houdini session, e.g. colleague workstation on the network this mechanism cannot work.

Exactly. Even another process on the same machine will stop this from working. This is where we truly hit the wall of how Windows handles open file handles, and the fact that USD keeps file handles open. The only other suggestions I've seen have involved loading the entire contents of every USDC file into memory as soon as its opened, and closing the file handle. This is simply not possible for many of the files our customers are dealing with. And even if Houdini did this, every other process that uses USD would also have to do this as well or it would only solve Houdini-Houdini conflicts. Actually, if this approach happens to work in your use case and address the specific problems you find yourself having, and you've got lots of RAM, you can implement this solution for yourself by using Load Layer LOPs everywhere instead Sublayering or Referencing files directly from disk.
User Avatar
Member
652 posts
Joined: Nov. 2013
Offline
I see another problem that USD Rop can't write to an NTFS junction folder that is in a shared folder in remote windows server.
File cache Sop has no this problem.
Edited by jerry7 - Nov. 15, 2021 20:24:45

Attachments:
karma with junction folder.png (983.0 KB)

User Avatar
Member
120 posts
Joined: Jan. 2012
Offline
has anyone tried this fix yet?
I dont have network drive at hand.

mtucker, do you have any insight?

Attachments:
Screenshot 2022-01-25 164643.jpg (63.8 KB)

Michal Tas Maciejewski @ www.vfxtricks.com
User Avatar
Staff
4525 posts
Joined: July 2005
Offline
That version log entry has to do with Houdini code for writing files. The code that is causing the USD file to fail to write is in the USD library, and therefore unaffected by this change. However, I believe this change fixes the issue reported above:

Attachments:
changelog.png (14.9 KB)

User Avatar
Member
120 posts
Joined: Jan. 2012
Offline
ahh, thanks for explanation. Got my hopes high.
That is really tough problem to solve. Pixar probably doesn't have a single Windowz machine in their office.
Michal Tas Maciejewski @ www.vfxtricks.com
User Avatar
Member
67 posts
Joined: March 2017
Offline
I was pretty far down the path of moving our studio toward USD when I ran into this problem. It seems to be a complete showstopper for using USD in a collaborative pipeline. As a test, I tried switching our shares over to NFS, as suggested in this thread. This seemed to -sort of- fix this specific issue, but created lots of others. NFS connections were exhibiting performance and stability issues, and I think this lead to instability and crashing in Houdini also. I'm not an networking expert but NFS security seems like it might be lacking as well. I'll be switching back to SMB today.

Has there been any further progress or thinking on this?

Brad T.
User Avatar
Member
339 posts
Joined: Nov. 2013
Online
BradThompson
Has there been any further progress or thinking on this?

I think this thread is covering multiple issues and has got quite confusing. It might be worth starting a new thread with better specifics.
User Avatar
Member
67 posts
Joined: March 2017
Offline
Good idea, Antc. I've created a new thread in the Solaris forum, focusing on referenced USD file locking in SMB networks. Find it here: https://www.sidefx.com/forum/topic/83485/ [www.sidefx.com]
  • Quick Links