pbowmar
Nov. 16, 2021 13:41:44
Hi,
I notice that after running a job through a Service (ROPfetch service in this case) that the RAM consumed by the Hython instances isn't cleared out.
Is there any way to have that happen? On high RAM jobs this is a bit crippling.
I took a look in the docs but couldn't find anything, though the PDG python docs are comprehensive and I might have missed it.
18.5.596 Win 10 Py 3
Cheers,
Peter B
BrookeA
Nov. 23, 2021 10:35:13
Hi Peter,
Currently there's no way to tell the service to reset and clear its cache. To work around this at the moment, you would need to restart the service whenever the memory needs to be freed up. We're looking into being able to issue a reset command to the services, however, which will provide a way to clear the contents of the scene file and empty out any caches that the service maintains without needing to restart it.
pbowmar
Nov. 23, 2021 13:10:04
OK thanks Brandon, no worries, I'm just not using services for now and eating the Hython startup cost, given the length of some of my processes it's bearable for now
Looking forward to the "clear scene" option for services though, sounds like what the doctor ordered for sure.
Cheers,
Peter B
neonjunkyards
May 17, 2022 03:49:42
BrandonA
Hi Peter,
Currently there's no way to tell the service to reset and clear its cache. To work around this at the moment, you would need to restart the service whenever the memory needs to be freed up. We're looking into being able to issue a reset command to the services, however, which will provide a way to clear the contents of the scene file and empty out any caches that the service maintains without needing to restart it.
Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc
vinyvince
Jan. 12, 2023 11:36:53
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
joostkonemann
July 27, 2023 14:46:48
vinyvince
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
Vince, did you find a solution? I think it should be possible now with the "Service Reset" node.
I'm trying a setup with a partition by range and custom priorities on the service reset to reset the services every n work items...
Latimerias
Aug. 21, 2024 13:58:49
joostkonemann
vinyvince
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
Vince, did you find a solution? I think it should be possible now with the "Service Reset" node.
I'm trying a setup with a partition by range and custom priorities on the service reset to reset the services every n work items...
Did you ever figure this out? Trying the same thing and getting extremely inconsistent results. Sometimes the service restart cooks properly based on the partition sometimes it doesnt... and it only is working on half of my hython instances.
SiRpRoHxO
Sept. 18, 2024 12:55:18
Any follow-up on this topic?
I'm running some wedge sims and every time the first runs through effortless and the second one crashing due to insufficient RAM.
I tried a service reset after the rop fetch but its nevertheless crashing