Hi,
I was wondering if there's more documentation and/or examples on the Resume Partially Cached Batches option on the ROP Fetch and ROP Geometry node? (As in, what sort of mechanism does it provide, in more detail)
Specifically, I'm trying to set up a TOP network that could resume simulation from DOP checkpoint files and this toggle kinda sounds as something similar, but can't really get it to work.
(Sorry if this is already documented somewhere and I'm being ignorant)
Cheers
Imre
ROP Fetch/Geometry: Resume Partially Cached Batches?
2900 3 0- riviera
- Member
- 1705 posts
- Joined: 3月 2020
- Offline
Imre Tuske
FX Supervisor | Senior FXTD @ Weta FX
qLib -- Houdini asset library
http://qlab.github.io/qLib/ [qlab.github.io]
https://www.facebook.com/qLibHoudini [www.facebook.com]
FX Supervisor | Senior FXTD @ Weta FX
qLib -- Houdini asset library
http://qlab.github.io/qLib/ [qlab.github.io]
https://www.facebook.com/qLibHoudini [www.facebook.com]
- AmirAshkezari
- Member
- 9 posts
- Joined: 10月 2018
- Offline
Hi Imre,
I'm not sure how to setup 'Resume Partially Cached Batches' parm on the rop fetch but this is a custom setup to resume cached sims.
We need to set 'dopnet' and 'rop_output' parms on the pythonprocessor before running the graph. it will also log the total time that took to cook the graph in the end.
Cheers
Amir
I'm not sure how to setup 'Resume Partially Cached Batches' parm on the rop fetch but this is a custom setup to resume cached sims.
We need to set 'dopnet' and 'rop_output' parms on the pythonprocessor before running the graph. it will also log the total time that took to cook the graph in the end.
Cheers
Amir
Image Not Found
Amir Khaefi Ashkezari
Senior FX Artist at PFX
https://github.com/Amir-Ashkezari/ [github.com]
https://www.linkedin.com/in/amir-ashkezari/ [www.linkedin.com]
Senior FX Artist at PFX
https://github.com/Amir-Ashkezari/ [github.com]
https://www.linkedin.com/in/amir-ashkezari/ [www.linkedin.com]
- tpetrick
- スタッフ
- 600 posts
- Joined: 5月 2014
- Offline
The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.
There should also log messages in the work item itself when it does that, something like:
I'll put together a more detailed example to include with the docs.
There should also log messages in the work item itself when it does that, something like:
10:54:35.150: Report cached results for sub items 0 to 3
10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0
10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0
10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0
10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0
10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0
10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0
10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0
10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0
10:54:35.157: Partial cook of batch from index=4 frame=5.0
I'll put together a more detailed example to include with the docs.
Edited by tpetrick - 2021年1月7日 10:58:48
- Max_Steven
- Member
- 1 posts
- Joined: 6月 2015
- Offline
tpetrickHello
The "Resume Partially Cached Batches" option causes the ROP Fetch batch work item to check for existing output files as part of the work item job, before starting the simulation. It does that by looking at the output path for the frames in the work item -- it's not looking for .sim cache files for example. If it's a ROP Geometry it'll be looking for .bgeo.sc files on disk, etc. During that process, if it find files for frames 1, 2, 3 and 10 it'll start the simulation at frame 4 instead of frame 1, since it found a contiguous block of existing output files up to that frame.
There should also log messages in the work item itself when it does that, something like:10:54:35.150: Report cached results for sub items 0 to 3 10:54:35.150: PDG_RESULT: ropgeometry1_ropfetch1_34;0;/home/taylor/Desktop/geo/untitled.ropgeometry1.1.bgeo.sc;;0 10:54:35.151: PDG_SUCCESS: ropgeometry1_ropfetch1_34;0;0.0 10:54:35.152: PDG_RESULT: ropgeometry1_ropfetch1_34;1;/home/taylor/Desktop/geo/untitled.ropgeometry1.2.bgeo.sc;;0 10:54:35.152: PDG_SUCCESS: ropgeometry1_ropfetch1_34;1;0.0 10:54:35.153: PDG_RESULT: ropgeometry1_ropfetch1_34;2;/home/taylor/Desktop/geo/untitled.ropgeometry1.3.bgeo.sc;;0 10:54:35.153: PDG_SUCCESS: ropgeometry1_ropfetch1_34;2;0.0 10:54:35.154: PDG_RESULT: ropgeometry1_ropfetch1_34;3;/home/taylor/Desktop/geo/untitled.ropgeometry1.4.bgeo.sc;;0 10:54:35.154: PDG_SUCCESS: ropgeometry1_ropfetch1_34;3;0.0 10:54:35.157: Partial cook of batch from index=4 frame=5.0
I'll put together a more detailed example to include with the docs.
Does the detailed example got included in the docs?
-
- Quick Links