ROP Fetch/Geometry: Resume Partially Cached Batches?

   2900   3   0
User Avatar
Member
1705 posts
Joined: 3月 2020
Offline
Hi,

I was wondering if there's more documentation and/or examples on the Resume Partially Cached Batches option on the ROP Fetch and ROP Geometry node? (As in, what sort of mechanism does it provide, in more detail)

Specifically, I'm trying to set up a TOP network that could resume simulation from DOP checkpoint files and this toggle kinda sounds as something similar, but can't really get it to work.

(Sorry if this is already documented somewhere and I'm being ignorant)

Cheers
Imre
Imre Tuske
FX Supervisor | Senior FXTD @ Weta FX

qLib -- Houdini asset library
http://qlab.github.io/qLib/ [qlab.github.io]
https://www.facebook.com/qLibHoudini [www.facebook.com]
User Avatar
Member
9 posts
Joined: 10月 2018
Offline
Hi Imre,

I'm not sure how to setup 'Resume Partially Cached Batches' parm on the rop fetch but this is a custom setup to resume cached sims.
We need to set 'dopnet' and 'rop_output' parms on the pythonprocessor before running the graph. it will also log the total time that took to cook the graph in the end.

Cheers
Amir

Image Not Found

Attachments:
custom_resumable_cached_sim.hip (441.4 KB)

Amir Khaefi Ashkezari
Senior FX Artist at PFX

https://github.com/Amir-Ashkezari/ [github.com]
https://www.linkedin.com/in/amir-ashkezari/ [www.linkedin.com]
User Avatar
スタッフ
600 posts
Joined: 5月 2014
Offline
The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.

There should also log messages in the work item itself when it does that, something like:

10:54:35.150: Report cached results for sub items 0 to 3 10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0 10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0 10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0 10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0 10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0 10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0 10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0 10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0 10:54:35.157: Partial cook of batch from index=4 frame=5.0

I'll put together a more detailed example to include with the docs.
Edited by tpetrick - 2021年1月7日 10:58:48
User Avatar
Member
1 posts
Joined: 6月 2015
Offline
tpetrick
The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.

There should also log messages in the work item itself when it does that, something like:

10:54:35.150: Report cached results for sub items 0 to 3 10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0 10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0 10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0 10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0 10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0 10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0 10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0 10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0 10:54:35.157: Partial cook of batch from index=4 frame=5.0

I'll put together a more detailed example to include with the docs.
Hello
Does the detailed example got included in the docs?
  • Quick Links