Hi there,
We've begun using PDG/TOP Nets for some tractor scheduling and have run into an issue where submitting work items via the built in tractor scheduler causes our tractor to be flooded with separate jobs when run.
Is there a reason that each PDG work item gets submitted as its own job? It would seem to make more sense to group all work items under the one job as tasks. Perhaps there is PDG concept I'm not familiar with yet. Just wondering if there was anyone else experiencing this.
Thanks,
Ben
Tractor Scheduler floods farm with separate jobs per work item
4298 10 3- vochsel
- Member
- 12 posts
- Joined: 4月 2017
- Offline
- seelan
- Member
- 571 posts
- Joined: 5月 2017
- Offline
- vochsel
- Member
- 12 posts
- Joined: 4月 2017
- Offline
- mestela
- Member
- 1803 posts
- Joined: 5月 2006
- Offline
- seelan
- Member
- 571 posts
- Joined: 5月 2017
- Offline
- protozoan
- Member
- 1719 posts
- Joined: 3月 2009
- Online
- chrisgreb
- Member
- 603 posts
- Joined: 9月 2016
- Offline
No progress yet, but it's still on the radar. Some background:
The problem with fixing this is that Tractor doesn't allow child tasks to be attached to running parent jobs through the API, instead the parent job must write new task specs to it's stdout. This implies that the PDG scheduler itself or some proxy process must be running on the farm for the duration of the cook so that PDG's dynamic workitem generation will work. This is a fairly major change.
The problem with fixing this is that Tractor doesn't allow child tasks to be attached to running parent jobs through the API, instead the parent job must write new task specs to it's stdout. This implies that the PDG scheduler itself or some proxy process must be running on the farm for the duration of the cook so that PDG's dynamic workitem generation will work. This is a fairly major change.
- protozoan
- Member
- 1719 posts
- Joined: 3月 2009
- Online
- louis dunlevy
- Member
- 642 posts
- Joined: 7月 2005
- Offline
- chrisgreb
- Member
- 603 posts
- Joined: 9月 2016
- Offline
- GraemePhillips
- Member
- 10 posts
- Joined: 10月 2013
- Offline
-
- Quick Links