Hi there,
We've begun using PDG/TOP Nets for some tractor scheduling and have run into an issue where submitting work items via the built in tractor scheduler causes our tractor to be flooded with separate jobs when run.
Is there a reason that each PDG work item gets submitted as its own job? It would seem to make more sense to group all work items under the one job as tasks. Perhaps there is PDG concept I'm not familiar with yet. Just wondering if there was anyone else experiencing this.
Thanks,
Ben
Tractor Scheduler floods farm with separate jobs per work item
4233 10 3- vochsel
- Member
- 12 posts
- Joined: April 2017
- Offline
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
- vochsel
- Member
- 12 posts
- Joined: April 2017
- Offline
- mestela
- Member
- 1798 posts
- Joined: May 2006
- Offline
- seelan
- Member
- 571 posts
- Joined: May 2017
- Offline
- protozoan
- Member
- 1705 posts
- Joined: March 2009
- Offline
- chrisgreb
- Member
- 603 posts
- Joined: Sept. 2016
- Offline
No progress yet, but it's still on the radar. Some background:
The problem with fixing this is that Tractor doesn't allow child tasks to be attached to running parent jobs through the API, instead the parent job must write new task specs to it's stdout. This implies that the PDG scheduler itself or some proxy process must be running on the farm for the duration of the cook so that PDG's dynamic workitem generation will work. This is a fairly major change.
The problem with fixing this is that Tractor doesn't allow child tasks to be attached to running parent jobs through the API, instead the parent job must write new task specs to it's stdout. This implies that the PDG scheduler itself or some proxy process must be running on the farm for the duration of the cook so that PDG's dynamic workitem generation will work. This is a fairly major change.
- protozoan
- Member
- 1705 posts
- Joined: March 2009
- Offline
- louis dunlevy
- Member
- 642 posts
- Joined: July 2005
- Offline
- chrisgreb
- Member
- 603 posts
- Joined: Sept. 2016
- Offline
- GraemePhillips
- Member
- 10 posts
- Joined: Oct. 2013
- Offline
-
- Quick Links