Hi,
I notice that after running a job through a Service (ROPfetch service in this case) that the RAM consumed by the Hython instances isn't cleared out.
Is there any way to have that happen? On high RAM jobs this is a bit crippling.
I took a look in the docs but couldn't find anything, though the PDG python docs are comprehensive and I might have missed it.
18.5.596 Win 10 Py 3
Cheers,
Peter B
Q: PDG Service holding RAM?
5023 7 2- pbowmar
- Member
- 7046 posts
- Joined: July 2005
- Offline
- BrookeA
- Staff
- 387 posts
- Joined: Aug. 2017
- Offline
Hi Peter,
Currently there's no way to tell the service to reset and clear its cache. To work around this at the moment, you would need to restart the service whenever the memory needs to be freed up. We're looking into being able to issue a reset command to the services, however, which will provide a way to clear the contents of the scene file and empty out any caches that the service maintains without needing to restart it.
Currently there's no way to tell the service to reset and clear its cache. To work around this at the moment, you would need to restart the service whenever the memory needs to be freed up. We're looking into being able to issue a reset command to the services, however, which will provide a way to clear the contents of the scene file and empty out any caches that the service maintains without needing to restart it.
- pbowmar
- Member
- 7046 posts
- Joined: July 2005
- Offline
OK thanks Brandon, no worries, I'm just not using services for now and eating the Hython startup cost, given the length of some of my processes it's bearable for now
Looking forward to the "clear scene" option for services though, sounds like what the doctor ordered for sure.
Cheers,
Peter B
Looking forward to the "clear scene" option for services though, sounds like what the doctor ordered for sure.
Cheers,
Peter B
Cheers,
Peter Bowmar
____________
Houdini 20.5.262 Win 10 Py 3.11
Peter Bowmar
____________
Houdini 20.5.262 Win 10 Py 3.11
- neonjunkyards
- Member
- 20 posts
- Joined: Sept. 2013
- Offline
BrandonA
Hi Peter,
Currently there's no way to tell the service to reset and clear its cache. To work around this at the moment, you would need to restart the service whenever the memory needs to be freed up. We're looking into being able to issue a reset command to the services, however, which will provide a way to clear the contents of the scene file and empty out any caches that the service maintains without needing to restart it.
Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc
- vinyvince
- Member
- 275 posts
- Joined: Sept. 2012
- Offline
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
Vincent Thomas (VFX and Art since 1998)
Senior Env and Lighting artist & Houdini generalist & Creative Concepts
http://fr.linkedin.com/in/vincentthomas [fr.linkedin.com]
Senior Env and Lighting artist & Houdini generalist & Creative Concepts
http://fr.linkedin.com/in/vincentthomas [fr.linkedin.com]
- joostkonemann
- Member
- 110 posts
- Joined: June 2017
- Offline
vinyvince
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
Vince, did you find a solution? I think it should be possible now with the "Service Reset" node.
I'm trying a setup with a partition by range and custom priorities on the service reset to reset the services every n work items...
- Latimerias
- Member
- 28 posts
- Joined: Aug. 2020
- Offline
joostkonemannvinyvince
Hello: Ping on this! we have the same issue and question! @Sidefx
"Are there any updates on this? I'm running into the same problem of quickly running out of RAM on a long-runing service processing lots of geometry/work items
Is there anything planned to be able to combine batching/services in some way, where you can respawn a service for every nth work item, or after a certain RAM percentage is hit etc etc "
Thanks!
Vince
Vince, did you find a solution? I think it should be possible now with the "Service Reset" node.
I'm trying a setup with a partition by range and custom priorities on the service reset to reset the services every n work items...
Did you ever figure this out? Trying the same thing and getting extremely inconsistent results. Sometimes the service restart cooks properly based on the partition sometimes it doesnt... and it only is working on half of my hython instances.
- SiRpRoHxO
- Member
- 98 posts
- Joined: Nov. 2017
- Offline
-
- Quick Links