Getting the deadliner scheduler in TOPs to work?
13435 30 1- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi @Seelan,
I was wondering if you could assist me in making the Deadline Scheduler in TOPs work with Deadline.
In my pipeline we're currently using Houdini 17.5.229, we haven't been able to update to a new version such as the 17.5.362 build you suggested recently.
I got the submission of a simple wedge job (3 wedges) working and I see the jobs showing up in my Deadline Monitor, however the 3 tasks for each wedge respectively are being displayed as Command Line tasks and never kick off, nor do they show an error.
For the same reason I can't look at any logs or error reports since the jobs never launch on a deadline slave.
Does anything stand out to you as incorrect to you in my attached screenshots? Do you have any pointers for me on what I could do to get this to function properly?
Thanks,
Manu
I was wondering if you could assist me in making the Deadline Scheduler in TOPs work with Deadline.
In my pipeline we're currently using Houdini 17.5.229, we haven't been able to update to a new version such as the 17.5.362 build you suggested recently.
I got the submission of a simple wedge job (3 wedges) working and I see the jobs showing up in my Deadline Monitor, however the 3 tasks for each wedge respectively are being displayed as Command Line tasks and never kick off, nor do they show an error.
For the same reason I can't look at any logs or error reports since the jobs never launch on a deadline slave.
Does anything stand out to you as incorrect to you in my attached screenshots? Do you have any pointers for me on what I could do to get this to function properly?
Thanks,
Manu
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
You are using the old Deadline scheduler, so there are a few setup things you have to do (which you don't need to do with the new one in 17.5.362).
If the jobs are not being picked up, most likely you'll need to enable CommandLine plugin in Deadline Monitor's Configure Plugins. See attach screenshot.
If the jobs are not being picked up, most likely you'll need to enable CommandLine plugin in Deadline Monitor's Configure Plugins. See attach screenshot.
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
Thanks for the support. Hopefully we can update to the latest built soon, we have to wait for Redshift to be compiled for it.
By enabling the CommandLine plugin, I got the “deadline_jobpreload.py” tasks to run and complete, however now I'm getting an error for the tasks that follows after:
https://www.sidefx.com/forum/topic/61772/?page=1#post-275419 [www.sidefx.com]
I've been trying both “\” and “/” in the mapping, but it didn't make a difference.
Any idea why this mapping isn't working as expected?
Thanks for the support!
Manu
Thanks for the support. Hopefully we can update to the latest built soon, we have to wait for Redshift to be compiled for it.
By enabling the CommandLine plugin, I got the “deadline_jobpreload.py” tasks to run and complete, however now I'm getting an error for the tasks that follows after:
Error: Executable “C:\houdini\17.5.293/bin/hython”, does not exist. (System.Exception)According to the following thread, I added the mapping for hython.exe, but I'm still getting the error.
https://www.sidefx.com/forum/topic/61772/?page=1#post-275419 [www.sidefx.com]
I've been trying both “\” and “/” in the mapping, but it didn't make a difference.
Any idea why this mapping isn't working as expected?
Thanks for the support!
Manu
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
You might need to restart your slave instances for the env mapping to take effect. If it did get picked up, it should have the .exe at the end. If restarting doesn't help, change the Windows Path in the mapping and see if the error message changes (just to make sure the env mapping is being taken into account).
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
Thanks for the quick reply. Turns out the mapping for “$HFS/bin/hython.exe” wasn't taken into account, it was overridden from the Deadline Scheduler TOP itself. Once I fixed it there the error from above disappeared.
I attached a screenshot for the fix to this post.
I feel like I'm making progress, however now I'm running into another error.
Do you have an email address where we can continue the debugging since I'm not comfortable posting the entire log here in public?
Thanks,
Manu
Thanks for the quick reply. Turns out the mapping for “$HFS/bin/hython.exe” wasn't taken into account, it was overridden from the Deadline Scheduler TOP itself. Once I fixed it there the error from above disappeared.
I attached a screenshot for the fix to this post.
I feel like I'm making progress, however now I'm running into another error.
Do you have an email address where we can continue the debugging since I'm not comfortable posting the entire log here in public?
Thanks,
Manu
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
I just tried to submit an RFE ticket here on Sidefx.com, but I received an error when hitting submit.
For that reason I'm going to continue our conversation here out of complacency
I installed the new Houdini built 17.5.381 to make sure that I'm running the latest tech.
The deadline submission works straight away this time after specifying the correct path to the Deadline repository.
However this time I'm running into another error, that seems to be related to Sidefx code.
It all seems down to the line 62:
2019-09-17 14:09:56: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result
Here's the full log:
Have you run into this before? Any idea what's going wrong this time?
Thanks!
I just tried to submit an RFE ticket here on Sidefx.com, but I received an error when hitting submit.
For that reason I'm going to continue our conversation here out of complacency
I installed the new Houdini built 17.5.381 to make sure that I'm running the latest tech.
The deadline submission works straight away this time after specifying the correct path to the Deadline repository.
However this time I'm running into another error, that seems to be related to Sidefx code.
It all seems down to the line 62:
2019-09-17 14:09:56: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result
Here's the full log:
=======================================================
Error
=======================================================
Error: Process returned non-zero exit code: 1
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage arh)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ahl)
=======================================================
Log
=======================================================
2019-09-17 14:09:46: 0: Loading Job's Plugin timeout is Disabled
2019-09-17 14:09:47: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-17 14:09:47: 0: All job files are already synchronized
2019-09-17 14:09:47: 0: Plugin PDGDeadline was already synchronized.
2019-09-17 14:09:47: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-17 14:09:47: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-17 14:09:48: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d814a9029c02908d0ba532e\PDGDeadline.py’
2019-09-17 14:09:48: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-17 14:09:48: 0: INFO: About: PDG Plugin for Deadline
2019-09-17 14:09:48: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-17 14:09:48: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-17 14:09:48: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-17 14:09:48: 0: Start Job timeout is disabled.
2019-09-17 14:09:48: 0: Task timeout is disabled.
2019-09-17 14:09:48: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d814a9029c02908d0ba532e)
2019-09-17 14:09:48: 0: Executing plugin command of type ‘Start Job’
2019-09-17 14:09:48: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d814a9029c02908d0ba532e\GlobalJobPreLoad.py’
2019-09-17 14:09:48: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-17 14:09:48: 0: INFO: Looking for File Transfer controller in CProgram Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-17 14:09:48: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-17 14:09:48: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-17 14:09:48: 0: Done executing plugin command of type ‘Start Job’
2019-09-17 14:09:48: 0: Plugin rendering frame(s): 0
2019-09-17 14:09:48: 0: Executing plugin command of type ‘Render Task’
2019-09-17 14:09:48: 0: INFO: StartFrame: 0
2019-09-17 14:09:48: 0: INFO: Startup Directory: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/26900
2019-09-17 14:09:48: 0: INFO: Looking for task file: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/26900/job_2abb809be608423381849d926a93122d\task_0.txt
2019-09-17 14:09:49: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;Choudini/17.5.381/bin
2019-09-17 14:09:49: 0: INFO: $HYTHON mapped to: Choudini/17.5.381/bin/hython.exe
2019-09-17 14:09:49: 0: INFO: Task Executable: Choudini/17.5.381/bin/hython.exe
2019-09-17 14:09:49: 0: INFO: Task Arguments: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/26900/scripts/top.py –report none –hip Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-17 14:09:49: 0: INFO: Invoking: Run Process
2019-09-17 14:09:55: 0: STDOUT: Running Houdini 17.5.381
2019-09-17 14:09:55: 0: STDOUT: Loading .hip file Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-17 14:09:56: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-17 14:09:56: 0: STDOUT: Traceback (most recent call last):
2019-09-17 14:09:56: 0: STDOUT: File “Choudini/17.5.381/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-17 14:09:56: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-17 14:09:56: 0: STDOUT: File “Choudini/17.5.381/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-17 14:09:56: 0: STDOUT: result))
2019-09-17 14:09:56: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-17 14:09:58: 0: STDOUT: From node deadlinescheduler1:
2019-09-17 14:09:58: 0: STDOUT: Error running callback ‘onSchedule’: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-17 14:09:58: 0: STDOUT: Traceback (most recent call last):
2019-09-17 14:09:58: 0: STDOUT: File “Choudini/17.5.381/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-17 14:09:58: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-17 14:09:58: 0: STDOUT: File “Choudini/17.5.381/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-17 14:09:58: 0: STDOUT: result))
2019-09-17 14:09:58: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-17 14:09:58: 0: STDOUT: Traceback (most recent call last):
2019-09-17 14:09:58: 0: STDOUT: File “Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/26900/scripts/top.py”, line 223, in <module>
2019-09-17 14:09:58: 0: STDOUT: exit(1)
2019-09-17 14:09:58: 0: STDOUT: File “Choudini/17.5.381/python27\lib\site.py”, line 351, in __call__
2019-09-17 14:09:58: 0: STDOUT: raise SystemExit(code)
2019-09-17 14:09:59: 0: STDOUT: SystemExit: 1
2019-09-17 14:09:59: 0: Done executing plugin command of type ‘Render Task’
=======================================================
Details
=======================================================
Date: 09/17/2019 14:10:01
Frames: 0
Elapsed Time: 00:00:00:15
Job Submit Date: 09/17/2019 14:05:20
Job User: stormripper01
Average RAM Usage: 19883241472 (15%)
Peak RAM Usage: 19883241472 (15%)
Average CPU Usage: 8%
Peak CPU Usage: 13%
Used CPU Clocks (x10^6 cycles): 104567
Total CPU Clocks (x10^6 cycles): 1307076
=======================================================
Slave Information
=======================================================
Slave Name: STORMRIPPER01
Version: v10.0.9.4 Release (b6c080b1a)
Operating System: Windows 10 Pro
Running As Service: No
Machine User: Stormripper01
IP Address: 192.168.100.10
MAC Address: 00:0A:CD:2D:29:5C
CPU Architecture: x64
CPUs: 32
CPU Usage: 7%
Memory Usage: 18.5 GB / 127.9 GB (14%)
Free Disk Space: 1.366 TB (16.906 GB on C:\, 1.349 TB on D:\)
Video Card: NVIDIA GeForce GTX 1080
Have you run into this before? Any idea what's going wrong this time?
Thanks!
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
Hi Manuel,
The error is that it fails to parse the result from the Deadline submit command, where it is expecting a JSON result. I noticed that in some cases, Deadline will reply with other info before the result (such as if SSL is enabled for repository but the SSL cert is not provided for example).
Could you try launching the Deadline command in prompt mode and try to see what it says? To do so open a command window and enter the following:
Then type in the following with Enter after each line:
Let me know what you get as reply. It should be a JSON string.
The error is that it fails to parse the result from the Deadline submit command, where it is expecting a JSON result. I noticed that in some cases, Deadline will reply with other info before the result (such as if SSL is enabled for repository but the SSL cert is not provided for example).
Could you try launching the Deadline command in prompt mode and try to see what it says? To do so open a command window and enter the following:
"%DEADLINE_PATH%\deadlinecommand.exe" prompt
Then type in the following with Enter after each line:
json submitjob
Let me know what you get as reply. It should be a JSON string.
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
So that is what I expected to see (the result of the command in json format). It is replying with an error which is correct since submitjob requires arguments that we didn't provide it in the test.
I noticed that you were not using %DEADLINE_PATH% in the test, but rather went into to the Deadline10\bin directory. Is %DEADLINE_PATH% not setup for your machine? This is a required environment variable pointing to your Deadline installation. See screenshot.
If you do have that env var, then we have to debug further. In tomorrow's Houdini 17.5.383 build, I added some logging so that when the Deadline command result fails to parse, it should print out to console. Please try it out and paste the output here, similar to the output in your first post.
I noticed that you were not using %DEADLINE_PATH% in the test, but rather went into to the Deadline10\bin directory. Is %DEADLINE_PATH% not setup for your machine? This is a required environment variable pointing to your Deadline installation. See screenshot.
If you do have that env var, then we have to debug further. In tomorrow's Houdini 17.5.383 build, I added some logging so that when the Deadline command result fails to parse, it should print out to console. Please try it out and paste the output here, similar to the output in your first post.
Edited by seelan - Sept. 18, 2019 21:13:23
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
The “DEADLINE_PATH” env variable is indeed set to “C:\Program Files\Thinkbox\Deadline10\bin”.
I installed 17.5.383 and checked “Verbose Logging” on the Deadline Scheduler in TOPs.
Here's the output I'm getting:
Thanks for working with me on this!
Cheers,
M
The “DEADLINE_PATH” env variable is indeed set to “C:\Program Files\Thinkbox\Deadline10\bin”.
I installed 17.5.383 and checked “Verbose Logging” on the Deadline Scheduler in TOPs.
Here's the output I'm getting:
=======================================================
Error
=======================================================
Error: Process returned non-zero exit code: 1
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage arh)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ahl)
=======================================================
Log
=======================================================
2019-09-19 07:55:19: 0: Loading Job's Plugin timeout is Disabled
2019-09-19 07:55:21: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-19 07:55:21: 0: All job files are already synchronized
2019-09-19 07:55:21: 0: Synchronizing Plugin PDGDeadline from Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/8768/plugins\PDGDeadline took: 0 seconds
2019-09-19 07:55:21: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-19 07:55:21: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-19 07:55:22: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d8396d229c029621867f171\PDGDeadline.py’
2019-09-19 07:55:22: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-19 07:55:22: 0: INFO: About: PDG Plugin for Deadline
2019-09-19 07:55:22: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-19 07:55:22: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-19 07:55:22: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-19 07:55:22: 0: Start Job timeout is disabled.
2019-09-19 07:55:22: 0: Task timeout is disabled.
2019-09-19 07:55:22: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d8396d229c029621867f171)
2019-09-19 07:55:22: 0: Executing plugin command of type ‘Start Job’
2019-09-19 07:55:22: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d8396d229c029621867f171\GlobalJobPreLoad.py’
2019-09-19 07:55:22: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-19 07:55:22: 0: INFO: Looking for File Transfer controller in CProgram Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-19 07:55:22: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-19 07:55:22: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-19 07:55:22: 0: Done executing plugin command of type ‘Start Job’
2019-09-19 07:55:22: 0: Plugin rendering frame(s): 0
2019-09-19 07:55:22: 0: Executing plugin command of type ‘Render Task’
2019-09-19 07:55:22: 0: INFO: StartFrame: 0
2019-09-19 07:55:22: 0: INFO: Startup Directory: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/8768
2019-09-19 07:55:22: 0: INFO: Looking for task file: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/8768/job_e5f665dd47904015b68ba359f9368e1b\task_0.txt
2019-09-19 07:55:22: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;Choudini/17.5.383/bin
2019-09-19 07:55:22: 0: INFO: $HYTHON mapped to: Choudini/17.5.383/bin/hython.exe
2019-09-19 07:55:22: 0: INFO: Task Executable: Choudini/17.5.383/bin/hython.exe
2019-09-19 07:55:22: 0: INFO: Task Arguments: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/8768/scripts/top.py –report none –hip Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-19 07:55:22: 0: INFO: Invoking: Run Process
2019-09-19 07:55:32: 0: STDOUT: Running Houdini 17.5.383
2019-09-19 07:55:32: 0: STDOUT: Loading .hip file Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-19 07:55:33: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-19 07:55:33: 0: STDOUT: Traceback (most recent call last):
2019-09-19 07:55:33: 0: STDOUT: File “Choudini/17.5.383/houdini/pdg/types\schedulers\tbdeadline.py”, line 1902, in getNextOutputResult
2019-09-19 07:55:33: 0: STDOUT: json_data = json.loads(line)
2019-09-19 07:55:33: 0: STDOUT: File “C:\houdini\17.5.383\python27\lib\json\__init__.py”, line 339, in loads
2019-09-19 07:55:33: 0: STDOUT: return _default_decoder.decode(s)
2019-09-19 07:55:33: 0: STDOUT: File “C:\houdini\17.5.383\python27\lib\json\decoder.py”, line 364, in decode
2019-09-19 07:55:33: 0: STDOUT: obj, end = self.raw_decode(s, idx=_w(s, 0).end())
2019-09-19 07:55:33: 0: STDOUT: File “C:\houdini\17.5.383\python27\lib\json\decoder.py”, line 382, in raw_decode
2019-09-19 07:55:33: 0: STDOUT: raise ValueError(“No JSON object could be decoded”)
2019-09-19 07:55:33: 0: STDOUT: ValueError: No JSON object could be decoded
2019-09-19 07:55:33: 0: STDOUT: Traceback (most recent call last):
2019-09-19 07:55:33: 0: STDOUT: File “Choudini/17.5.383/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-19 07:55:34: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-19 07:55:34: 0: STDOUT: File “Choudini/17.5.383/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-19 07:55:34: 0: STDOUT: result))
2019-09-19 07:55:34: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-19 07:55:35: 0: STDOUT: 07:55:32 OnStartCook()
2019-09-19 07:55:35: 0: STDOUT: 07:55:32 PDGMQ as separate task: False
2019-09-19 07:55:35: 0: STDOUT: 07:55:32 Local Working Dir: Pstormborn/tst/wow/wow_0050/houdini
2019-09-19 07:55:35: 0: STDOUT: Remote Working Dir: Pstormborn/tst/wow/wow_0050/houdini
2019-09-19 07:55:35: 0: STDOUT: 07:55:32 Starting deadline command process
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 onSchedule: objectTest_ropfetch1_1 - 0
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Starting root job with PDGMQ server as monitor program
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Task 0 file: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/16028/job_8e86ccd24e2e4506bf2f62df3b9fcc29/task_0.txt
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Setting job directory: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/16028/job_8e86ccd24e2e4506bf2f62df3b9fcc29
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Job file=Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/16028/job_8e86ccd24e2e4506bf2f62df3b9fcc29/pdg_dl_job.txt
2019-09-19 07:55:35: 0: STDOUT: Plugin file=Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/16028/job_8e86ccd24e2e4506bf2f62df3b9fcc29/pdg_dl_plugin.txt
2019-09-19 07:55:35: 0: STDOUT: Expected JSON. Got Deadline Command 10.0
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 onStopCook()
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Cancelling tick timer
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Stopping shared servers
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 No root job running in onStopCook
2019-09-19 07:55:35: 0: STDOUT: 07:55:33 Stopping MQ Relay server
2019-09-19 07:55:36: 0: STDOUT: 07:55:33 MQ Relay stopped
2019-09-19 07:55:36: 0: STDOUT: 07:55:33 Stopping deadline command process
2019-09-19 07:55:36: 0: STDOUT: From node deadlinescheduler1:
2019-09-19 07:55:36: 0: STDOUT: Error running callback ‘onSchedule’: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-19 07:55:36: 0: STDOUT: Traceback (most recent call last):
2019-09-19 07:55:36: 0: STDOUT: File “Choudini/17.5.383/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-19 07:55:36: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-19 07:55:36: 0: STDOUT: File “Choudini/17.5.383/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-19 07:55:36: 0: STDOUT: result))
2019-09-19 07:55:36: 0: STDOUT: CookError: Deadline SubmitJob error: Unable to parse JSON result.
2019-09-19 07:55:36: 0: STDOUT: Traceback (most recent call last):
2019-09-19 07:55:36: 0: STDOUT: File “Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/8768/scripts/top.py”, line 223, in <module>
2019-09-19 07:55:36: 0: STDOUT: exit(1)
2019-09-19 07:55:36: 0: STDOUT: File “Choudini/17.5.383/python27\lib\site.py”, line 351, in __call__
2019-09-19 07:55:36: 0: STDOUT: raise SystemExit(code)
2019-09-19 07:55:36: 0: STDOUT: SystemExit: 1
2019-09-19 07:55:36: 0: Done executing plugin command of type ‘Render Task’
=======================================================
Details
=======================================================
Date: 09/19/2019 07:55:40
Frames: 0
Elapsed Time: 00:00:00:19
Job Submit Date: 09/19/2019 07:55:15
Job User: stormripper01
Average RAM Usage: 20241506304 (15%)
Peak RAM Usage: 20423659520 (15%)
Average CPU Usage: 5%
Peak CPU Usage: 12%
Used CPU Clocks (x10^6 cycles): 88598
Total CPU Clocks (x10^6 cycles): 1771951
=======================================================
Slave Information
=======================================================
Slave Name: STORMRIPPER01
Version: v10.0.9.4 Release (b6c080b1a)
Operating System: Windows 10 Pro
Running As Service: No
Machine User: Stormripper01
IP Address: 192.168.100.10
MAC Address: 00:0A:CD:2D:29:5C
CPU Architecture: x64
CPUs: 32
CPU Usage: 0%
Memory Usage: 18.8 GB / 127.9 GB (14%)
Free Disk Space: 1.410 TB (61.562 GB on C:\, 1.349 TB on D:\)
Video Card: NVIDIA GeForce GTX 1080
Thanks for working with me on this!
Cheers,
M
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Good morning Seelan!
I just installed v17.5.384 and I'm running into a new issue this time (although I believe we're making some progress):
The line to look out for is the following:
Error: could not find job info file: RunCommandForRepositoryDirectZdeadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
I just installed v17.5.384 and I'm running into a new issue this time (although I believe we're making some progress):
=======================================================
Error
=======================================================
Error: Process returned non-zero exit code: 1
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage arh)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ahl)
=======================================================
Log
=======================================================
2019-09-20 07:05:33: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 07:05:34: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 07:05:34: 0: All job files are already synchronized
2019-09-20 07:05:34: 0: Synchronizing Plugin PDGDeadline from Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 07:05:34: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 07:05:34: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 07:05:35: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d84dca429c0291d84f631b0\PDGDeadline.py’
2019-09-20 07:05:35: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 07:05:35: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 07:05:35: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 07:05:35: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 07:05:35: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 07:05:35: 0: Start Job timeout is disabled.
2019-09-20 07:05:35: 0: Task timeout is disabled.
2019-09-20 07:05:35: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d84dca429c0291d84f631b0)
2019-09-20 07:05:35: 0: Executing plugin command of type ‘Start Job’
2019-09-20 07:05:35: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d84dca429c0291d84f631b0\GlobalJobPreLoad.py’
2019-09-20 07:05:35: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 07:05:35: 0: INFO: Looking for File Transfer controller in CProgram Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 07:05:35: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 07:05:35: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 07:05:35: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 07:05:35: 0: Plugin rendering frame(s): 0
2019-09-20 07:05:35: 0: Executing plugin command of type ‘Render Task’
2019-09-20 07:05:35: 0: INFO: StartFrame: 0
2019-09-20 07:05:35: 0: INFO: Startup Directory: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 07:05:35: 0: INFO: Looking for task file: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_a2fda28c1efd4709a529aeea56a30e52\task_0.txt
2019-09-20 07:05:35: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;Choudini/17.5.384/bin
2019-09-20 07:05:35: 0: INFO: $HYTHON mapped to: Choudini/17.5.384/bin/hython.exe
2019-09-20 07:05:35: 0: INFO: Task Executable: Choudini/17.5.384/bin/hython.exe
2019-09-20 07:05:35: 0: INFO: Task Arguments: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 07:05:35: 0: INFO: Invoking: Run Process
2019-09-20 07:05:42: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 07:05:42: 0: STDOUT: Loading .hip file Pstormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 07:05:42: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-20 07:05:44: 0: STDOUT: Traceback (most recent call last):
2019-09-20 07:05:44: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-20 07:05:44: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-20 07:05:44: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-20 07:05:44: 0: STDOUT: result))
2019-09-20 07:05:44: 0: STDOUT: CookError: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 07:05:44: 0: STDOUT: 07:05:42 OnStartCook()
2019-09-20 07:05:44: 0: STDOUT: 07:05:42 PDGMQ as separate task: False
2019-09-20 07:05:44: 0: STDOUT: 07:05:42 Local Working Dir: Pstormborn/tst/wow/wow_0050/houdini
2019-09-20 07:05:44: 0: STDOUT: Remote Working Dir: Pstormborn/tst/wow/wow_0050/houdini
2019-09-20 07:05:44: 0: STDOUT: 07:05:42 Starting deadline command process
2019-09-20 07:05:44: 0: STDOUT: 07:05:42 onSchedule: objectTest_ropfetch1_1 - 0
2019-09-20 07:05:45: 0: STDOUT: 07:05:42 Starting root job with PDGMQ server as monitor program
2019-09-20 07:05:45: 0: STDOUT: 07:05:42 Task 0 file: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/21216/job_15e8be5ba71744778e32fd4c6b05c405/task_0.txt
2019-09-20 07:05:45: 0: STDOUT: 07:05:42 Setting job directory: Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/21216/job_15e8be5ba71744778e32fd4c6b05c405
2019-09-20 07:05:45: 0: STDOUT: 07:05:42 Job file=Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/21216/job_15e8be5ba71744778e32fd4c6b05c405/pdg_dl_job.txt
2019-09-20 07:05:45: 0: STDOUT: Plugin file=Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/21216/job_15e8be5ba71744778e32fd4c6b05c405/pdg_dl_plugin.txt
2019-09-20 07:05:45: 0: STDOUT: Ignoring Deadline command non-json result: Deadline Command 10.0
2019-09-20 07:05:45: 0: STDOUT: Ignoring Deadline command non-json result: Error: could not find job info file: RunCommandForRepositoryDirectZdeadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 onStopCook()
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 Cancelling tick timer
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 Stopping shared servers
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 No root job running in onStopCook
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 Stopping MQ Relay server
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 MQ Relay stopped
2019-09-20 07:05:45: 0: STDOUT: 07:05:44 Stopping deadline command process
2019-09-20 07:05:45: 0: STDOUT: From node deadlinescheduler1:
2019-09-20 07:05:45: 0: STDOUT: Error running callback ‘onSchedule’: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 07:05:45: 0: STDOUT: Traceback (most recent call last):
2019-09-20 07:05:45: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-20 07:05:45: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-20 07:05:45: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-20 07:05:46: 0: STDOUT: result))
2019-09-20 07:05:46: 0: STDOUT: CookError: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 07:05:46: 0: STDOUT: Error running callback ‘onStopCook’: Invalid argument
2019-09-20 07:05:46: 0: STDOUT: Traceback (most recent call last):
2019-09-20 07:05:46: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 721, in onStopCook
2019-09-20 07:05:46: 0: STDOUT: self.dlcmd_intr.stopProcess()
2019-09-20 07:05:46: 0: STDOUT: File “Choudini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1859, in stopProcess
2019-09-20 07:05:46: 0: STDOUT: self.dlcmd_proc.stdin.write('quit\n')
2019-09-20 07:05:46: 0: STDOUT: IOError: Invalid argument
2019-09-20 07:05:46: 0: STDOUT: Traceback (most recent call last):
2019-09-20 07:05:46: 0: STDOUT: File “Pstormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py”, line 223, in <module>
2019-09-20 07:05:46: 0: STDOUT: exit(1)
2019-09-20 07:05:46: 0: STDOUT: File “Choudini/17.5.384/python27\lib\site.py”, line 351, in __call__
2019-09-20 07:05:46: 0: STDOUT: raise SystemExit(code)
2019-09-20 07:05:46: 0: STDOUT: SystemExit: 1
2019-09-20 07:05:46: 0: Done executing plugin command of type ‘Render Task’
=======================================================
Details
=======================================================
Date: 09/20/2019 07:05:49
Frames: 0
Elapsed Time: 00:00:00:16
Job Submit Date: 09/20/2019 07:05:25
Job User: stormripper01
Average RAM Usage: 15103840256 (11%)
Peak RAM Usage: 15103840256 (11%)
Average CPU Usage: 4%
Peak CPU Usage: 8%
Used CPU Clocks (x10^6 cycles): 56168
Total CPU Clocks (x10^6 cycles): 1404195
=======================================================
Slave Information
=======================================================
Slave Name: STORMRIPPER01
Version: v10.0.9.4 Release (b6c080b1a)
Operating System: Windows 10 Pro
Running As Service: No
Machine User: Stormripper01
IP Address: 192.168.100.10
MAC Address: 00:0A:CD:2D:29:5C
CPU Architecture: x64
CPUs: 32
CPU Usage: 3%
Memory Usage: 14.1 GB / 127.9 GB (10%)
Free Disk Space: 1.407 TB (58.634 GB on C:\, 1.349 TB on D:\)
Video Card: NVIDIA GeForce GTX 1080
The line to look out for is the following:
Error: could not find job info file: RunCommandForRepositoryDirectZdeadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
If you only have a single Deadline repository, and its setup as the default one on your system, then could you try disabling the override on the Repository Path (and blanking out the path itself). The Repository Path is located in the TOP Deadline scheduler's parm under the Advanced section. Usually you don't need to set this if your are just using your default repository. See screenshot.
I am assuming that this was enabled or set when you updated from a saved hip file that was using the old scheduler, which did require the repository.
If on the other hand, you do need to specify a specific repository, there is a bug with that particular feature. I'll fix it for tomorrow's build.
I am assuming that this was enabled or set when you updated from a saved hip file that was using the old scheduler, which did require the repository.
If on the other hand, you do need to specify a specific repository, there is a bug with that particular feature. I'll fix it for tomorrow's build.
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
I need to set the Repository under the advanced tab, because it's located on one of our network drives.
When I submitted the job today of which I posted the log earlier, I actually deleted the Deadline Scheduler TOP and rebuilt it to make sure everything is brand new.
Just as a test, I removed the Repository checkbox as you suggested (also removed the path, just in case), I'm still getting an error:
I need to set the Repository under the advanced tab, because it's located on one of our network drives.
When I submitted the job today of which I posted the log earlier, I actually deleted the Deadline Scheduler TOP and rebuilt it to make sure everything is brand new.
Just as a test, I removed the Repository checkbox as you suggested (also removed the path, just in case), I'm still getting an error:
=======================================================
Error
=======================================================
Error: Process returned non-zero exit code: 1
at Deadline.Plugins.PluginWrapper.RenderTasks(String taskId, Int32 startFrame, Int32 endFrame, String& outMessage, AbortLevel& abortLevel)
=======================================================
Type
=======================================================
RenderPluginException
=======================================================
Stack Trace
=======================================================
at Deadline.Plugins.SandboxedPlugin.d(DeadlineMessage arh)
at Deadline.Plugins.SandboxedPlugin.RenderTask(String taskId, Int32 startFrame, Int32 endFrame)
at Deadline.Slaves.SlaveRenderThread.c(TaskLogWriter ahl)
=======================================================
Log
=======================================================
2019-09-20 08:26:39: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 08:26:40: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 08:26:40: 0: All job files are already synchronized
2019-09-20 08:26:40: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 08:26:40: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 08:26:40: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 08:26:41: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d84efab29c0293364e19a11\PDGDeadline.py’
2019-09-20 08:26:41: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 08:26:41: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 08:26:41: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 08:26:41: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 08:26:41: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 08:26:41: 0: Start Job timeout is disabled.
2019-09-20 08:26:41: 0: Task timeout is disabled.
2019-09-20 08:26:41: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d84efab29c0293364e19a11)
2019-09-20 08:26:41: 0: Executing plugin command of type ‘Start Job’
2019-09-20 08:26:41: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d84efab29c0293364e19a11\GlobalJobPreLoad.py’
2019-09-20 08:26:41: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 08:26:41: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 08:26:41: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 08:26:41: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 08:26:41: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 08:26:41: 0: Plugin rendering frame(s): 0
2019-09-20 08:26:41: 0: Executing plugin command of type ‘Render Task’
2019-09-20 08:26:41: 0: INFO: StartFrame: 0
2019-09-20 08:26:41: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 08:26:41: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_4cd4428cb6804d7e861d51fc2e559371\task_0.txt
2019-09-20 08:26:41: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 08:26:41: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 08:26:41: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 08:26:41: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 08:26:41: 0: INFO: Invoking: Run Process
2019-09-20 08:26:48: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 08:26:48: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 08:26:48: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-20 08:26:50: 0: STDOUT: Traceback (most recent call last):
2019-09-20 08:26:50: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-20 08:26:50: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-20 08:26:50: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-20 08:26:50: 0: STDOUT: result))
2019-09-20 08:26:50: 0: STDOUT: CookError: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 08:26:50: 0: STDOUT: 08:26:48 OnStartCook()
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 PDGMQ as separate task: False
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Local Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 08:26:51: 0: STDOUT: Remote Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Starting deadline command process
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 onSchedule: objectTest_ropfetch1_1 - 0
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Starting root job with PDGMQ server as monitor program
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Task 0 file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/18736/job_e78ed2996f9d4b7fba5c8fd6b57f9019/task_0.txt
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Setting job directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/18736/job_e78ed2996f9d4b7fba5c8fd6b57f9019
2019-09-20 08:26:51: 0: STDOUT: 08:26:48 Job file=P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/18736/job_e78ed2996f9d4b7fba5c8fd6b57f9019/pdg_dl_job.txt
2019-09-20 08:26:51: 0: STDOUT: Plugin file=P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/18736/job_e78ed2996f9d4b7fba5c8fd6b57f9019/pdg_dl_plugin.txt
2019-09-20 08:26:51: 0: STDOUT: Ignoring Deadline command non-json result: Deadline Command 10.0
2019-09-20 08:26:51: 0: STDOUT: Ignoring Deadline command non-json result: Error: could not find job info file: RunCommandForRepositoryDirectZ:/deadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 onStopCook()
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 Cancelling tick timer
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 Stopping shared servers
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 No root job running in onStopCook
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 Stopping MQ Relay server
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 MQ Relay stopped
2019-09-20 08:26:51: 0: STDOUT: 08:26:50 Stopping deadline command process
2019-09-20 08:26:51: 0: STDOUT: From node deadlinescheduler1:
2019-09-20 08:26:52: 0: STDOUT: Error running callback ‘onSchedule’: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 08:26:52: 0: STDOUT: Traceback (most recent call last):
2019-09-20 08:26:52: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 774, in onSchedule
2019-09-20 08:26:52: 0: STDOUT: self.remote_job_dir, remote_conn_file)
2019-09-20 08:26:52: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1549, in _startJobWithPDGMQMonitor
2019-09-20 08:26:52: 0: STDOUT: result))
2019-09-20 08:26:52: 0: STDOUT: CookError: Deadline SubmitJob error: No valid result from Deadline command.
2019-09-20 08:26:52: 0: STDOUT: Error running callback ‘onStopCook’: Invalid argument
2019-09-20 08:26:52: 0: STDOUT: Traceback (most recent call last):
2019-09-20 08:26:52: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 721, in onStopCook
2019-09-20 08:26:52: 0: STDOUT: self.dlcmd_intr.stopProcess()
2019-09-20 08:26:52: 0: STDOUT: File “C:/houdini/17.5.384/houdini/pdg/types\schedulers\tbdeadline.py”, line 1859, in stopProcess
2019-09-20 08:26:52: 0: STDOUT: self.dlcmd_proc.stdin.write('quit\n')
2019-09-20 08:26:52: 0: STDOUT: IOError: Invalid argument
2019-09-20 08:26:52: 0: STDOUT: Traceback (most recent call last):
2019-09-20 08:26:52: 0: STDOUT: File “P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py”, line 223, in <module>
2019-09-20 08:26:52: 0: STDOUT: exit(1)
2019-09-20 08:26:52: 0: STDOUT: File “C:/houdini/17.5.384/python27\lib\site.py”, line 351, in __call__
2019-09-20 08:26:52: 0: STDOUT: raise SystemExit(code)
2019-09-20 08:26:52: 0: STDOUT: SystemExit: 1
2019-09-20 08:26:53: 0: Done executing plugin command of type ‘Render Task’
=======================================================
Details
=======================================================
Date: 09/20/2019 08:26:55
Frames: 0
Elapsed Time: 00:00:00:16
Job Submit Date: 09/20/2019 08:26:36
Job User: stormripper01
Average RAM Usage: 14730694656 (11%)
Peak RAM Usage: 14884139008 (11%)
Average CPU Usage: 4%
Peak CPU Usage: 7%
Used CPU Clocks (x10^6 cycles): 56530
Total CPU Clocks (x10^6 cycles): 1413227
=======================================================
Slave Information
=======================================================
Slave Name: STORMRIPPER01
Version: v10.0.9.4 Release (b6c080b1a)
Operating System: Windows 10 Pro
Running As Service: No
Machine User: Stormripper01
IP Address: 192.168.100.10
MAC Address: 00:0A:CD:2D:29:5C
CPU Architecture: x64
CPUs: 32
CPU Usage: 0%
Memory Usage: 13.7 GB / 127.9 GB (10%)
Free Disk Space: 1.407 TB (58.620 GB on C:\, 1.349 TB on D:\)
Video Card: NVIDIA GeForce GTX 1080
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
From your log, it looks like its still using the override though:
Error: could not find job info file: RunCommandForRepositoryDirectZ:/deadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
Make sure you save the hip file after making the override disable change.
Even if the repository is located on a network drive, if your Deadline installation is setup to use it as the default, and the network drive doesn't change, then it should just work with the blank. You can test by opening up Deadline Monitor and setting the repository there.
Also for cooking with PDG and Deadline, you can try testing with just the regular cook workflow (Tasks -> Dirty and Cook Output Node), instead of using Submit Graph as Job (unless you do want to cook it separately).
Error: could not find job info file: RunCommandForRepositoryDirectZ:/deadlineRepository10 (Deadline.Submission.DeadlineSubmissionException)
Make sure you save the hip file after making the override disable change.
Even if the repository is located on a network drive, if your Deadline installation is setup to use it as the default, and the network drive doesn't change, then it should just work with the blank. You can test by opening up Deadline Monitor and setting the repository there.
Also for cooking with PDG and Deadline, you can try testing with just the regular cook workflow (Tasks -> Dirty and Cook Output Node), instead of using Submit Graph as Job (unless you do want to cook it separately).
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
Hi Seelan,
Thanks for your help.
So I made some progress.
You're right, the repository was already set in the deadline monitor, so I don't need to set it specifically in the Deadline Scheduler.
Here are some observations:
- If I right click on a ROP Geometry Output TOP and select “Dirty and Cook Output Node”, it sends a job to the farm and successfully executes it, so far so good.
- In the documentation of the “Tasks Menu” there's a “Dirty All” option which I can find in when right-clicking on a TOP node.
Currently the only way to recook everything (when making changes to let's say the SOP graph) is to click on “Delete Selected Node Results From Disk” and then click again on “Dirty and cook selected Node”. Is that the correct workflow or am I missing something?
Here's where it breaks again:
- when I click on “Submit Graph as Job” on the Deadline Scheduler. In this case I'm trying to cache 3 simple wedges, but rather then showing me 3 job items under 1 task in Deadline, I see 2 tasks, that hold 1 job item each. The first task never completes due to an error. Here's the log:
Thanks for your help.
So I made some progress.
You're right, the repository was already set in the deadline monitor, so I don't need to set it specifically in the Deadline Scheduler.
Here are some observations:
- If I right click on a ROP Geometry Output TOP and select “Dirty and Cook Output Node”, it sends a job to the farm and successfully executes it, so far so good.
- In the documentation of the “Tasks Menu” there's a “Dirty All” option which I can find in when right-clicking on a TOP node.
Currently the only way to recook everything (when making changes to let's say the SOP graph) is to click on “Delete Selected Node Results From Disk” and then click again on “Dirty and cook selected Node”. Is that the correct workflow or am I missing something?
Here's where it breaks again:
- when I click on “Submit Graph as Job” on the Deadline Scheduler. In this case I'm trying to cache 3 simple wedges, but rather then showing me 3 job items under 1 task in Deadline, I see 2 tasks, that hold 1 job item each. The first task never completes due to an error. Here's the log:
Connecting to STORMRIPPER01…
2019-09-20 10:08:25: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:08:25: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:08:25: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:08:25: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:08:25: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:08:25: 0: Start Job timeout is disabled.
2019-09-20 10:08:25: 0: Task timeout is disabled.
2019-09-20 10:08:25: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d85078029c0290d88163eea)
2019-09-20 10:08:25: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:08:25: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d85078029c0290d88163eea\GlobalJobPreLoad.py’
2019-09-20 10:08:25: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:08:25: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:08:25: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:08:25: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:08:25: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:08:25: 0: Plugin rendering frame(s): 0
2019-09-20 10:08:25: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:08:25: 0: INFO: StartFrame: 0
2019-09-20 10:08:25: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:08:25: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_aa4b1942d40d487d9a813768ce196653\task_0.txt
2019-09-20 10:08:25: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:08:25: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:08:25: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:08:25: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 10:08:25: 0: INFO: Invoking: Run Process
2019-09-20 10:08:31: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 10:08:31: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:08:32: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-20 10:08:32: 0: STDOUT: 10:08:32 OnStartCook()
2019-09-20 10:08:32: 0: STDOUT: 10:08:32 PDGMQ as separate task: False
2019-09-20 10:08:32: 0: STDOUT: 10:08:32 Local Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 10:08:32: 0: STDOUT: Remote Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 10:08:32: 0: STDOUT: 10:08:32 Starting deadline command process
2019-09-20 10:08:32: 0: STDOUT: 10:08:32 onStopCook()
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 Cancelling tick timer
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 Stopping shared servers
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 No root job running in onStopCook
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 Stopping MQ Relay server
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 MQ Relay stopped
2019-09-20 10:08:33: 0: STDOUT: 10:08:32 Stopping deadline command process
2019-09-20 10:08:33: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:08:34: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:08:34: INFO: STORMBORN job frames: 0
2019-09-20 10:08:34: INFO: STORMBORN job isWedge: False
2019-09-20 10:08:34: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:08:34: INFO: STORMBORN job sceneFile:
2019-09-20 10:08:34: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:08:34: INFO: STORMBORN job 5d85078029c0290d88163eea finished. status: “Completed”
2019-09-20 10:08:34: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:08:34: INFO: STORMBORN SHOW:
2019-09-20 10:08:34: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:08:34: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:08:34: File “none”, line 107, in OnJobFinished
2019-09-20 10:08:34: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:08:34: return Collection(self, name)
2019-09-20 10:08:34: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:08:34: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:08:34: InvalidName: collection names cannot be empty
2019-09-20 10:08:34: INFO: STORMBORN onJobComplete finished Completed
2019-09-20 10:08:37: 0: Executing plugin command of type ‘End Job’
2019-09-20 10:08:37: 0: Done executing plugin command of type ‘End Job’
2019-09-20 10:09:16: Skipping pending job scan because it is not required at this time
2019-09-20 10:09:16: Skipping repository repair because it is not required at this time
2019-09-20 10:09:16: Skipping house cleaning because it is not required at this time
2019-09-20 10:10:17: Skipping pending job scan because it is not required at this time
2019-09-20 10:10:17: Skipping repository repair because it is not required at this time
2019-09-20 10:10:17: Skipping house cleaning because it is not required at this time
2019-09-20 10:10:53: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 10:10:54: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:10:54: 0: All job files are already synchronized
2019-09-20 10:10:54: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 10:10:54: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:10:54: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:10:55: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d85081b29c0292674b5d9e2\PDGDeadline.py’
2019-09-20 10:10:55: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:10:55: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:10:55: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:10:55: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:10:55: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:10:55: 0: Start Job timeout is disabled.
2019-09-20 10:10:55: 0: Task timeout is disabled.
2019-09-20 10:10:55: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d85081b29c0292674b5d9e2)
2019-09-20 10:10:55: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:10:55: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d85081b29c0292674b5d9e2\GlobalJobPreLoad.py’
2019-09-20 10:10:55: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:10:55: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:10:55: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:10:55: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:10:55: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:10:55: 0: Plugin rendering frame(s): 0
2019-09-20 10:10:56: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:10:56: 0: INFO: StartFrame: 0
2019-09-20 10:10:56: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:10:56: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_859b6f3163fa4b3e82226fb0291e7440\task_0.txt
2019-09-20 10:10:56: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:10:56: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:10:56: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:10:56: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 10:10:56: 0: INFO: Invoking: Run Process
2019-09-20 10:11:02: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 10:11:02: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:11:05: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 OnStartCook()
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 PDGMQ as separate task: False
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Local Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 10:11:06: 0: STDOUT: Remote Working Dir: P:/stormborn/tst/wow/wow_0050/houdini
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Starting deadline command process
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 onStopCook()
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Cancelling tick timer
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Stopping shared servers
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 No root job running in onStopCook
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Stopping MQ Relay server
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 MQ Relay stopped
2019-09-20 10:11:06: 0: STDOUT: 10:11:05 Stopping deadline command process
2019-09-20 10:11:06: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:11:08: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:11:08: INFO: STORMBORN job frames: 0
2019-09-20 10:11:08: INFO: STORMBORN job isWedge: False
2019-09-20 10:11:08: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:11:08: INFO: STORMBORN job sceneFile:
2019-09-20 10:11:08: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:11:08: INFO: STORMBORN job 5d85081b29c0292674b5d9e2 finished. status: “Completed”
2019-09-20 10:11:08: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:11:08: INFO: STORMBORN SHOW:
2019-09-20 10:11:08: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:11:08: File “none”, line 107, in OnJobFinished
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:11:08: return Collection(self, name)
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:11:08: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:11:08: InvalidName: collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN onJobComplete finished Completed
2019-09-20 10:11:10: 0: Executing plugin command of type ‘End Job’
2019-09-20 10:11:10: 0: Done executing plugin command of type ‘End Job’
2019-09-20 10:11:17: Skipping pending job scan because it is not required at this time
2019-09-20 10:11:17: Skipping repository repair because it is not required at this time
2019-09-20 10:11:17: Skipping house cleaning because it is not required at this time
2019-09-20 10:12:19: Skipping pending job scan because it is not required at this time
2019-09-20 10:12:19: Skipping repository repair because it is not required at this time
2019-09-20 10:12:19: Skipping house cleaning because it is not required at this time
2019-09-20 10:13:26: Skipping pending job scan because it is not required at this time
2019-09-20 10:13:26: Skipping repository repair because it is not required at this time
2019-09-20 10:13:26: Skipping house cleaning because it is not required at this time
2019-09-20 10:14:28: Skipping pending job scan because it is not required at this time
2019-09-20 10:14:28: Skipping repository repair because it is not required at this time
2019-09-20 10:14:28: Skipping house cleaning because it is not required at this time
2019-09-20 10:15:30: Skipping pending job scan because it is not required at this time
2019-09-20 10:15:30: Skipping repository repair because it is not required at this time
2019-09-20 10:15:30: Skipping house cleaning because it is not required at this time
2019-09-20 10:16:31: Skipping pending job scan because it is not required at this time
2019-09-20 10:16:31: Skipping repository repair because it is not required at this time
2019-09-20 10:16:31: Skipping house cleaning because it is not required at this time
2019-09-20 10:17:36: Skipping pending job scan because it is not required at this time
2019-09-20 10:17:36: Skipping repository repair because it is not required at this time
2019-09-20 10:17:36: Skipping house cleaning because it is not required at this time
2019-09-20 10:18:40: Skipping pending job scan because it is not required at this time
2019-09-20 10:18:40: Skipping repository repair because it is not required at this time
2019-09-20 10:18:40: Skipping house cleaning because it is not required at this time
2019-09-20 10:19:46: Skipping pending job scan because it is not required at this time
2019-09-20 10:19:46: Skipping repository repair because it is not required at this time
2019-09-20 10:19:46: Skipping house cleaning because it is not required at this time
2019-09-20 10:20:48: Skipping pending job scan because it is not required at this time
2019-09-20 10:20:48: Skipping repository repair because it is not required at this time
2019-09-20 10:20:48: Skipping house cleaning because it is not required at this time
2019-09-20 10:21:52: Skipping pending job scan because it is not required at this time
2019-09-20 10:21:52: Skipping repository repair because it is not required at this time
2019-09-20 10:21:52: Skipping house cleaning because it is not required at this time
2019-09-20 10:22:07: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 10:22:09: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:22:09: 0: All job files are already synchronized
2019-09-20 10:22:09: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 10:22:09: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:22:09: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:22:10: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850ab729c0291404883070\PDGDeadline.py’
2019-09-20 10:22:10: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:22:10: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:22:10: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:22:10: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:22:10: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:22:10: 0: Start Job timeout is disabled.
2019-09-20 10:22:10: 0: Task timeout is disabled.
2019-09-20 10:22:10: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d850ab729c0291404883070)
2019-09-20 10:22:10: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:22:10: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850ab729c0291404883070\GlobalJobPreLoad.py’
2019-09-20 10:22:10: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:22:10: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:22:10: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:22:10: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:22:10: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:22:10: 0: Plugin rendering frame(s): 0
2019-09-20 10:22:10: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:22:10: 0: INFO: StartFrame: 0
2019-09-20 10:22:10: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:22:10: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_e1e4e6bf40ba4632a7c882254ea3a158\task_0.txt
2019-09-20 10:22:10: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:22:10: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:22:10: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:22:10: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 10:22:10: 0: INFO: Invoking: Run Process
2019-09-20 10:22:16: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 10:22:17: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:22:20: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
2019-09-20 10:25:56: Scheduler Thread - Task “0_0-0” could not be found because job with ID 5d850ab729c0291404883070 does not exist
2019-09-20 10:25:56: Scheduler Thread - Cancelling task…
2019-09-20 10:25:56: 0: Executing plugin command of type ‘Cancel Task’
2019-09-20 10:25:56: 0: Done executing plugin command of type ‘Cancel Task’
2019-09-20 10:25:56: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:25:56: 0: In the process of canceling current task: ignoring exception thrown by PluginLoader
2019-09-20 10:25:56: 0: Executing plugin command of type ‘End Job’
2019-09-20 10:25:56: 0: Done executing plugin command of type ‘End Job’
2019-09-20 10:25:57: Scheduler Thread - In the process of canceling current tasks: ignoring exception thrown by render thread 0
2019-09-20 10:25:59: Skipping pending job scan because it is not required at this time
2019-09-20 10:25:59: Skipping repository repair because it is not required at this time
2019-09-20 10:25:59: Skipping house cleaning because it is not required at this time
2019-09-20 10:26:09: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 10:26:10: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:26:10: 0: All job files are already synchronized
2019-09-20 10:26:10: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 10:26:10: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:26:10: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:26:11: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850baa29c0291100d62d86\PDGDeadline.py’
2019-09-20 10:26:11: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:26:11: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:26:11: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:26:11: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:26:11: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:26:11: 0: Start Job timeout is disabled.
2019-09-20 10:26:11: 0: Task timeout is disabled.
2019-09-20 10:26:11: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d850baa29c0291100d62d86)
2019-09-20 10:26:11: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:26:11: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850baa29c0291100d62d86\GlobalJobPreLoad.py’
2019-09-20 10:26:11: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:26:11: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:26:11: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:26:11: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:26:11: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:26:11: 0: Plugin rendering frame(s): 0
2019-09-20 10:26:12: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:26:12: 0: INFO: StartFrame: 0
2019-09-20 10:26:12: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:26:12: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_144ea87c4927459b80c0fe8e364ba348\task_0.txt
2019-09-20 10:26:12: 0: INFO: Starting monitor program: python.exe P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/pdgmq.py –xmlport 0 –relayport 0 –connectionfile P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_144ea87c4927459b80c0fe8e364ba348/pdgmq_server.txt –start
2019-09-20 10:26:12: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:26:12: 0: INFO: File “python.exe” is not rooted, checking current directory
2019-09-20 10:26:12: 0: INFO: File “python.exe” is not rooted and is not in the current directory, checking PATH
2019-09-20 10:26:12: 0: INFO: Starting monitored program: PDGMonitor
2019-09-20 10:26:12: 0: INFO: Program executable: C:\Python27\python.exe
2019-09-20 10:26:12: 0: INFO: Program arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/pdgmq.py –xmlport 0 –relayport 0 –connectionfile P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_144ea87c4927459b80c0fe8e364ba348/pdgmq_server.txt –start
2019-09-20 10:26:12: 0: PDG_MQ STORMRIPPER01 60534 60535
2019-09-20 10:26:12: 0: ## Message Queue Server Running
2019-09-20 10:26:12: 0: INFO: Got MQ server info: PDG_MQ STORMRIPPER01 60534 60535
2019-09-20 10:26:12: 0: ## Message Queue Server Running
2019-09-20 10:26:12: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:26:12: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:12: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:12: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_19 -fs 1 -fe 1 -fi 1
2019-09-20 10:26:12: 0: INFO: Invoking: Run Process
2019-09-20 10:26:13: 0: ## Connection from ('192.168.100.10', 60537)
2019-09-20 10:26:13: 0: ## Relay Mode Active
2019-09-20 10:26:19: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:26:22: 0: 0.0 mps, avg=0.0ms, max=0.0ms
2019-09-20 10:26:23: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_19;-1;'__PDG_DIR__/cache/object_2/objectTest_2.1.bgeo.sc';;0
2019-09-20 10:26:23: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:26:27: 0: Start Job timeout is disabled.
2019-09-20 10:26:27: 0: Task timeout is disabled.
2019-09-20 10:26:27: 0: Plugin rendering frame(s): 1
2019-09-20 10:26:28: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:26:28: 0: INFO: StartFrame: 1
2019-09-20 10:26:28: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:26:28: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_144ea87c4927459b80c0fe8e364ba348\task_1.txt
2019-09-20 10:26:28: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:26:28: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:28: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:28: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_18 -fs 1 -fe 1 -fi 1
2019-09-20 10:26:28: 0: INFO: Invoking: Run Process
2019-09-20 10:26:32: 0: 0.1 mps, avg=1.9ms, max=1.9ms
2019-09-20 10:26:35: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:26:39: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_18;-1;'__PDG_DIR__/cache/object_1/objectTest_1.1.bgeo.sc';;0
2019-09-20 10:26:39: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:26:42: 0: 0.1 mps, avg=2.6ms, max=2.6ms
2019-09-20 10:26:43: 0: Start Job timeout is disabled.
2019-09-20 10:26:43: 0: Task timeout is disabled.
2019-09-20 10:26:43: 0: Plugin rendering frame(s): 2
2019-09-20 10:26:44: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:26:44: 0: INFO: StartFrame: 2
2019-09-20 10:26:44: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:26:44: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_144ea87c4927459b80c0fe8e364ba348\task_2.txt
2019-09-20 10:26:44: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:26:44: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:44: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:26:44: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_17 -fs 1 -fe 1 -fi 1
2019-09-20 10:26:44: 0: INFO: Invoking: Run Process
2019-09-20 10:26:50: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:26:52: 0: 0.0 mps, avg=0.0ms, max=0.0ms
2019-09-20 10:26:54: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_17;-1;'__PDG_DIR__/cache/object_0/objectTest_0.1.bgeo.sc';;0
2019-09-20 10:26:54: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:26:55: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:26:55: INFO: STORMBORN job frames: 0-2
2019-09-20 10:26:55: INFO: STORMBORN job isWedge: False
2019-09-20 10:26:55: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:26:55: INFO: STORMBORN job sceneFile:
2019-09-20 10:26:55: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:26:55: INFO: STORMBORN job 5d850baa29c0291100d62d86 finished. status: “Completed”
2019-09-20 10:26:55: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:26:55: INFO: STORMBORN SHOW:
2019-09-20 10:26:55: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:26:55: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:26:55: File “none”, line 107, in OnJobFinished
2019-09-20 10:26:55: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:26:55: return Collection(self, name)
2019-09-20 10:26:55: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:26:55: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:26:55: InvalidName: collection names cannot be empty
2019-09-20 10:26:55: INFO: STORMBORN onJobComplete finished Completed
2019-09-20 10:26:56: 0: ## Shutdown requested
2019-09-20 10:26:56: 0: ## Server shutdown
2019-09-20 10:26:58: 0: Executing plugin command of type ‘End Job’
2019-09-20 10:26:58: 0: Done executing plugin command of type ‘End Job’
2019-09-20 10:27:06: Skipping pending job scan because it is not required at this time
2019-09-20 10:27:06: Skipping repository repair because it is not required at this time
2019-09-20 10:27:06: Skipping house cleaning because it is not required at this time
2019-09-20 10:28:11: Skipping pending job scan because it is not required at this time
2019-09-20 10:28:11: Skipping repository repair because it is not required at this time
2019-09-20 10:28:11: Skipping house cleaning because it is not required at this time
2019-09-20 10:29:13: Skipping pending job scan because it is not required at this time
2019-09-20 10:29:13: Skipping repository repair because it is not required at this time
2019-09-20 10:29:13: Skipping house cleaning because it is not required at this time
2019-09-20 10:30:16: Skipping pending job scan because it is not required at this time
2019-09-20 10:30:16: Skipping repository repair because it is not required at this time
2019-09-20 10:30:16: Skipping house cleaning because it is not required at this time
2019-09-20 10:31:23: Skipping pending job scan because it is not required at this time
2019-09-20 10:31:23: Skipping repository repair because it is not required at this time
2019-09-20 10:31:23: Skipping house cleaning because it is not required at this time
2019-09-20 10:32:25: Skipping pending job scan because it is not required at this time
2019-09-20 10:32:25: Skipping repository repair because it is not required at this time
2019-09-20 10:32:25: Skipping house cleaning because it is not required at this time
2019-09-20 10:33:28: Skipping pending job scan because it is not required at this time
2019-09-20 10:33:28: Skipping repository repair because it is not required at this time
2019-09-20 10:33:28: Skipping house cleaning because it is not required at this time
2019-09-20 10:34:32: Skipping pending job scan because it is not required at this time
2019-09-20 10:34:32: Skipping repository repair because it is not required at this time
2019-09-20 10:34:32: Skipping house cleaning because it is not required at this time
2019-09-20 10:35:32: Skipping pending job scan because it is not required at this time
2019-09-20 10:35:32: Skipping repository repair because it is not required at this time
2019-09-20 10:35:32: Skipping house cleaning because it is not required at this time
2019-09-20 10:36:36: Skipping pending job scan because it is not required at this time
2019-09-20 10:36:36: Skipping repository repair because it is not required at this time
2019-09-20 10:36:36: Skipping house cleaning because it is not required at this time
2019-09-20 10:37:30: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 10:37:32: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:37:32: 0: All job files are already synchronized
2019-09-20 10:37:32: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 10:37:32: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:37:32: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:37:32: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850e5129c0290a5843a173\PDGDeadline.py’
2019-09-20 10:37:33: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:37:33: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:37:33: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:37:33: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:37:33: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:37:33: 0: Start Job timeout is disabled.
2019-09-20 10:37:33: 0: Task timeout is disabled.
2019-09-20 10:37:33: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d850e5129c0290a5843a173)
2019-09-20 10:37:33: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:37:33: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850e5129c0290a5843a173\GlobalJobPreLoad.py’
2019-09-20 10:37:33: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:37:33: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:37:33: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:37:33: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:37:33: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:37:33: 0: Plugin rendering frame(s): 0
2019-09-20 10:37:33: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:37:33: 0: INFO: StartFrame: 0
2019-09-20 10:37:33: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:37:33: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_97a61d673f064df983ef4aaf20fee9e0\task_0.txt
2019-09-20 10:37:33: 0: INFO: Starting monitor program: python.exe P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/pdgmq.py –xmlport 0 –relayport 0 –connectionfile P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_97a61d673f064df983ef4aaf20fee9e0/pdgmq_server.txt –start
2019-09-20 10:37:33: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:37:33: 0: INFO: File “python.exe” is not rooted, checking current directory
2019-09-20 10:37:33: 0: INFO: File “python.exe” is not rooted and is not in the current directory, checking PATH
2019-09-20 10:37:33: 0: INFO: Starting monitored program: PDGMonitor
2019-09-20 10:37:33: 0: INFO: Program executable: C:\Python27\python.exe
2019-09-20 10:37:33: 0: INFO: Program arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/pdgmq.py –xmlport 0 –relayport 0 –connectionfile P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_97a61d673f064df983ef4aaf20fee9e0/pdgmq_server.txt –start
2019-09-20 10:37:34: 0: PDG_MQ STORMRIPPER01 61835 61836
2019-09-20 10:37:34: 0: ## Message Queue Server Running
2019-09-20 10:37:34: 0: INFO: Got MQ server info: PDG_MQ STORMRIPPER01 61835 61836
2019-09-20 10:37:34: 0: ## Message Queue Server Running
2019-09-20 10:37:34: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:37:34: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:37:34: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:37:34: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_26 -fs 1 -fe 1 -fi 1
2019-09-20 10:37:34: 0: INFO: Invoking: Run Process
2019-09-20 10:37:34: 0: ## Connection from ('192.168.100.10', 61839)
2019-09-20 10:37:34: 0: ## Relay Mode Active
2019-09-20 10:37:39: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:37:43: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_26;-1;'__PDG_DIR__/cache/object_0/objectTest_0.1.bgeo.sc';;0
2019-09-20 10:37:43: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:37:44: 0: 0.1 mps, avg=1.1ms, max=1.1ms
2019-09-20 10:37:47: Skipping pending job scan because it is not required at this time
2019-09-20 10:37:47: Skipping repository repair because it is not required at this time
2019-09-20 10:37:47: Skipping house cleaning because it is not required at this time
2019-09-20 10:37:48: 0: Start Job timeout is disabled.
2019-09-20 10:37:48: 0: Task timeout is disabled.
2019-09-20 10:37:48: 0: Plugin rendering frame(s): 1
2019-09-20 10:37:48: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:37:48: 0: INFO: StartFrame: 1
2019-09-20 10:37:48: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:37:48: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_97a61d673f064df983ef4aaf20fee9e0\task_1.txt
2019-09-20 10:37:48: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:37:48: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:37:48: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:37:48: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_28 -fs 1 -fe 1 -fi 1
2019-09-20 10:37:48: 0: INFO: Invoking: Run Process
2019-09-20 10:37:54: 0: 0.0 mps, avg=0.0ms, max=0.0ms
2019-09-20 10:37:54: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:37:58: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_28;-1;'__PDG_DIR__/cache/object_2/objectTest_2.1.bgeo.sc';;0
2019-09-20 10:37:58: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:38:03: 0: Start Job timeout is disabled.
2019-09-20 10:38:03: 0: Task timeout is disabled.
2019-09-20 10:38:03: 0: Plugin rendering frame(s): 2
2019-09-20 10:38:03: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:38:03: 0: INFO: StartFrame: 2
2019-09-20 10:38:03: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:38:03: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_97a61d673f064df983ef4aaf20fee9e0\task_2.txt
2019-09-20 10:38:03: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:38:03: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:38:03: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:38:03: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/rop.py -p P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip -n /obj/topnet1/objectTest/ropnet1/geometry1 -to /obj/topnet1/objectTest -i objectTest_ropfetch1_1_27 -fs 1 -fe 1 -fi 1
2019-09-20 10:38:03: 0: INFO: Invoking: Run Process
2019-09-20 10:38:04: 0: 0.1 mps, avg=1.2ms, max=1.2ms
2019-09-20 10:38:09: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:38:13: 0: STDOUT: PDG_RESULT: objectTest_ropfetch1_1_27;-1;'__PDG_DIR__/cache/object_1/objectTest_1.1.bgeo.sc';;0
2019-09-20 10:38:13: 0: Done executing plugin command of type ‘Render Task’
2019-09-20 10:38:14: 0: 0.1 mps, avg=5.9ms, max=5.9ms
2019-09-20 10:38:15: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:38:15: INFO: STORMBORN job frames: 0-2
2019-09-20 10:38:15: INFO: STORMBORN job isWedge: False
2019-09-20 10:38:15: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:38:15: INFO: STORMBORN job sceneFile:
2019-09-20 10:38:15: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:38:15: INFO: STORMBORN job 5d850e5129c0290a5843a173 finished. status: “Completed”
2019-09-20 10:38:15: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:38:15: INFO: STORMBORN SHOW:
2019-09-20 10:38:15: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:38:15: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:38:15: File “none”, line 107, in OnJobFinished
2019-09-20 10:38:15: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:38:15: return Collection(self, name)
2019-09-20 10:38:15: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:38:15: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:38:15: InvalidName: collection names cannot be empty
2019-09-20 10:38:15: INFO: STORMBORN onJobComplete finished Completed
2019-09-20 10:38:16: 0: ## Shutdown requested
2019-09-20 10:38:16: 0: ## Server shutdown
2019-09-20 10:38:17: 0: Executing plugin command of type ‘End Job’
2019-09-20 10:38:17: 0: Done executing plugin command of type ‘End Job’
2019-09-20 10:38:50: Skipping pending job scan because it is not required at this time
2019-09-20 10:38:50: Skipping repository repair because it is not required at this time
2019-09-20 10:38:50: Skipping house cleaning because it is not required at this time
2019-09-20 10:39:55: Skipping pending job scan because it is not required at this time
2019-09-20 10:39:55: Skipping repository repair because it is not required at this time
2019-09-20 10:39:55: Skipping house cleaning because it is not required at this time
2019-09-20 10:41:01: Skipping pending job scan because it is not required at this time
2019-09-20 10:41:01: Skipping repository repair because it is not required at this time
2019-09-20 10:41:01: Skipping house cleaning because it is not required at this time
2019-09-20 10:41:56: 0: Loading Job's Plugin timeout is Disabled
2019-09-20 10:41:58: 0: Executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:41:58: 0: All job files are already synchronized
2019-09-20 10:41:58: 0: Synchronizing Plugin PDGDeadline from P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/plugins\PDGDeadline took: 0 seconds
2019-09-20 10:41:58: 0: Done executing plugin command of type ‘Sync Files for Job’
2019-09-20 10:41:58: 0: Executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:41:59: 0: INFO: Executing plugin script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850f5f29c029276c3a6cbf\PDGDeadline.py’
2019-09-20 10:41:59: 0: INFO: *********** PDGDeadline InitializeProcess
2019-09-20 10:41:59: 0: INFO: About: PDG Plugin for Deadline
2019-09-20 10:41:59: 0: INFO: Render Job As User disabled, running as current user ‘Stormripper01’
2019-09-20 10:41:59: 0: INFO: The job's environment will be merged with the current environment before rendering
2019-09-20 10:41:59: 0: Done executing plugin command of type ‘Initialize Plugin’
2019-09-20 10:41:59: 0: Start Job timeout is disabled.
2019-09-20 10:41:59: 0: Task timeout is disabled.
2019-09-20 10:41:59: 0: Loaded job: PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 (5d850f5f29c029276c3a6cbf)
2019-09-20 10:41:59: 0: Executing plugin command of type ‘Start Job’
2019-09-20 10:41:59: 0: INFO: Executing global job preload script ‘C:\Users\Stormripper01\AppData\Local\Thinkbox\Deadline10\slave\stormripper01\plugins\5d850f5f29c029276c3a6cbf\GlobalJobPreLoad.py’
2019-09-20 10:41:59: 0: INFO: Looking for AWS Portal File Transfer…
2019-09-20 10:41:59: 0: INFO: Looking for File Transfer controller in C:/Program Files/Thinkbox/S3BackedCache/bin/task.py…
2019-09-20 10:41:59: 0: INFO: Could not find AWS Portal File Transfer.
2019-09-20 10:41:59: 0: INFO: AWS Portal File Transfer is not installed on the system.
2019-09-20 10:41:59: 0: Done executing plugin command of type ‘Start Job’
2019-09-20 10:41:59: 0: Plugin rendering frame(s): 0
2019-09-20 10:41:59: 0: Executing plugin command of type ‘Render Task’
2019-09-20 10:41:59: 0: INFO: StartFrame: 0
2019-09-20 10:41:59: 0: INFO: Startup Directory: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368
2019-09-20 10:41:59: 0: INFO: Looking for task file: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/job_2d166801a3d748babe2bcfad45395d5b\task_0.txt
2019-09-20 10:41:59: 0: INFO: Setting PATH: C:\Program Files\Thinkbox\Deadline10\bin\;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\Python27;C:\python27\lib\site-packages;C:\Python27\Scripts;C:\Program Files\MongoDB\Server\3.4\bin;C:\Program Files\Sublime Text 3;C:\Program Files\Git\cmd;C:\WINDOWS\System32\OpenSSH\;C:\Program Files (x86)\QuickTime\QTSystem\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Users\Stormripper01\AppData\Local\Microsoft\WindowsApps;C:\Users\Stormripper01\AppData\Local\GitHubDesktop\bin;%USERPROFILE%\AppData\Local\Microsoft\WindowsApps;;C:/houdini/17.5.384/bin
2019-09-20 10:41:59: 0: INFO: $HYTHON mapped to: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:41:59: 0: INFO: Task Executable: C:/houdini/17.5.384/bin/hython.exe
2019-09-20 10:41:59: 0: INFO: Task Arguments: P:/stormborn/tst/wow/wow_0050/houdini/pdgtemp/17368/scripts/top.py –report none –hip P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip –toppath /obj/topnet1
2019-09-20 10:41:59: 0: INFO: Invoking: Run Process
2019-09-20 10:42:12: 0: STDOUT: Running Houdini 17.5.384
2019-09-20 10:42:12: 0: STDOUT: Loading .hip file P:/stormborn/tst/wow/wow_0050/houdini/tst_wow_0050_wrk_pdgDeadlineTest_v001.hip.
2019-09-20 10:42:16: 0: STDOUT: Given Node ‘topnet1’, Cooking Node ‘objectTest’
Success
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
In the documentation of the “Tasks Menu” there's a “Dirty All” option which I can find in when right-clicking on a TOP node.
Currently the only way to recook everything (when making changes to let's say the SOP graph) is to click on “Delete Selected Node Results From Disk” and then click again on “Dirty and cook selected Node”. Is that the correct workflow or am I missing something?
Yes, if you want to recook everything, you'll have to “Delete Selected Node Results From Disk”, then can cook the output node or a specific node. Note that once you delete the results, it also dirties the node.
Here's where it breaks again:
- when I click on “Submit Graph as Job” on the Deadline Scheduler. In this case I'm trying to cache 3 simple wedges, but rather then showing me 3 job items under 1 task in Deadline, I see 2 tasks, that hold 1 job item each. The first task never completes due to an error.
So the Submit Graph As Job is a special case. What it does is it runs a job in Deadline with a single task. That task is to open the hip file and cook the TOP graph. When the TOP graph is cooking, it could be cooking locally or on a farm. In your case, it is using Deadline, so now it schedules all the work items to be run as another separate job. The second job is the one actually containing the PDG work items. The first job is just your hip file.
To summarize:
> A PDG cook is scheduled as a Deadline Job.
> A Deadline Job will have PDG work items as Deadline Tasks.
> A Submit Graph As Job using Deadline will run 2 jobs (1 for cooking the hip, another for the actual PDG work items).
From your log, I am seeing just this error, which seems to be a OnJobComplete callback script you are running? Is that your own script?
019-09-20 10:11:08: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:11:08: INFO: STORMBORN job frames: 0
2019-09-20 10:11:08: INFO: STORMBORN job isWedge: False
2019-09-20 10:11:08: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:11:08: INFO: STORMBORN job sceneFile:
2019-09-20 10:11:08: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:11:08: INFO: STORMBORN job 5d85081b29c0292674b5d9e2 finished. status: “Completed”
2019-09-20 10:11:08: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:11:08: INFO: STORMBORN SHOW:
2019-09-20 10:11:08: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:11:08: File “none”, line 107, in OnJobFinished
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:11:08: return Collection(self, name)
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:11:08: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:11:08: InvalidName: collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN onJobComplete finished Completed
Currently the only way to recook everything (when making changes to let's say the SOP graph) is to click on “Delete Selected Node Results From Disk” and then click again on “Dirty and cook selected Node”. Is that the correct workflow or am I missing something?
Yes, if you want to recook everything, you'll have to “Delete Selected Node Results From Disk”, then can cook the output node or a specific node. Note that once you delete the results, it also dirties the node.
Here's where it breaks again:
- when I click on “Submit Graph as Job” on the Deadline Scheduler. In this case I'm trying to cache 3 simple wedges, but rather then showing me 3 job items under 1 task in Deadline, I see 2 tasks, that hold 1 job item each. The first task never completes due to an error.
So the Submit Graph As Job is a special case. What it does is it runs a job in Deadline with a single task. That task is to open the hip file and cook the TOP graph. When the TOP graph is cooking, it could be cooking locally or on a farm. In your case, it is using Deadline, so now it schedules all the work items to be run as another separate job. The second job is the one actually containing the PDG work items. The first job is just your hip file.
To summarize:
> A PDG cook is scheduled as a Deadline Job.
> A Deadline Job will have PDG work items as Deadline Tasks.
> A Submit Graph As Job using Deadline will run 2 jobs (1 for cooking the hip, another for the actual PDG work items).
From your log, I am seeing just this error, which seems to be a OnJobComplete callback script you are running? Is that your own script?
019-09-20 10:11:08: INFO: STORMBORN PDG tst_wow_0050_wrk_pdgDeadlineTest_v001 job finished. Attempting db add
2019-09-20 10:11:08: INFO: STORMBORN job frames: 0
2019-09-20 10:11:08: INFO: STORMBORN job isWedge: False
2019-09-20 10:11:08: INFO: STORMBORN job wedgeNumber: -1
2019-09-20 10:11:08: INFO: STORMBORN job sceneFile:
2019-09-20 10:11:08: INFO: STORMBORN JobPluginInfoKey EXCEPT: local variable ‘ext’ referenced before assignment
2019-09-20 10:11:08: INFO: STORMBORN job 5d85081b29c0292674b5d9e2 finished. status: “Completed”
2019-09-20 10:11:08: INFO: STORMBORN wedgeNumber: “-1”
2019-09-20 10:11:08: INFO: STORMBORN SHOW:
2019-09-20 10:11:08: INFO: STORMBORN: ERROR adding to db collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN: traceback : Traceback (most recent call last):
2019-09-20 10:11:08: File “none”, line 107, in OnJobFinished
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\database.py”, line 255, in __getitem__
2019-09-20 10:11:08: return Collection(self, name)
2019-09-20 10:11:08: File “Z:\tools\python\pymongo\collection.py”, line 156, in __init__
2019-09-20 10:11:08: raise InvalidName(“collection names cannot be empty”)
2019-09-20 10:11:08: InvalidName: collection names cannot be empty
2019-09-20 10:11:08: INFO: STORMBORN onJobComplete finished Completed
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
Note that Submit Graph As Job is meant to be used for the case where you want to fire and forget a job (such as running a render job overnight, where you submit the graph then close down Houdini). On the other hand, if you want to use it in an interactive way, where you want to see the cook progress and results in Houdini, you should use the normal Cook Output Node, Cook Selected Node, Dirty & Cook Output Node, and Dirty & Cook Selected Node options from the Tasks menu or RMB menu.
- asnowcappedromance
- Member
- 512 posts
- Joined: July 2009
- Offline
seelanI'm aware of that. A very common way of working in Houdini when dealing with multiple shots is to submit a job to the farm, close the local Houdini session and then move on to another task. This feature is absolutely needed.
Note that Submit Graph As Job is meant to be used for the case where you want to fire and forget a job (such as running a render job overnight, where you submit the graph then close down Houdini)
Regarding the log, thanks for spotting that. I'll look into it and get back to you soon!
-
- Quick Links