Hi All,
As per usual I have left my uni project to the last minute, and was banking on using the HQueue Cloud service to get me over the line and… no dice.
Every time I try to roll the cloud render service the HQueue dialogue just hangs on the ‘Launching a computer in the cloud’ page. Have checked on my Amazon account and no instances are running. Tried on two different machines (OSX 10.6.8 and Windows 7) both running production build 12.0.634 with Apprentice HD licencing.
If anyone has a solution to this issue please help, pretty much you will be my hero.
FYI this issue has been raised recently by dgc289 on the amazon forums: https://forums.aws.amazon.com/thread.jspa?messageID=348890񕋚 [forums.aws.amazon.com]
Sorry if this is a duplicate topic - I cannot find his original post in this forum
HQueue Cloud Rendering - Anybody got it working?
19141 25 2- wooshum
- Member
- 6 posts
- Joined: 1月 2011
- Offline
- wooshum
- Member
- 6 posts
- Joined: 1月 2011
- Offline
- jopa79
- Member
- 13 posts
- Joined: 9月 2011
- Offline
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
jopa79
I have the same problem with hqueue cloud render.
When i launch the console the following line looks wrong to me.
hython: BUG in libdispatch client: Do not close random Unix descriptors
some suggestions ?
thx
Hello,
So what happens after you proceed with your cloud submission? Does a web page at least open up that says, “Launching a computer in the cloud”?
Cheers,
Rob
- jopa79
- Member
- 13 posts
- Joined: 9月 2011
- Offline
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
- jopa79
- Member
- 13 posts
- Joined: 9月 2011
- Offline
Hi Rob,
i'm running H12 1.125 on OS X 10.8.2. I can run hython from the houdini shell without getting errors. I checked all requirements, following the guide, file dependencies are all green but after hit “yes, procced” nothing happens.
cloudsubmit.log says “cloudsubmit starting up” but no web page coming up.
i'm running H12 1.125 on OS X 10.8.2. I can run hython from the houdini shell without getting errors. I checked all requirements, following the guide, file dependencies are all green but after hit “yes, procced” nothing happens.
cloudsubmit.log says “cloudsubmit starting up” but no web page coming up.
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
Ah. I had another user recently run into troubles with submitting cloud jobs from OSX >= 10.7. The problem had to do with a bug in Python >= 2.6.4 on OSX.
Try starting Houdini like so from the Houdini Shell.terminal app:
no_proxy=“ ” houdini
That temporarily sets $no_proxy to a non-empty value (i.e. a single whitespace character) and then starts Houdini.
See if this workaround helps. Otherwise, I'll probably have to send you a patch file that will help us track down the issue on your machine.
Let me know how that goes.
Cheers,
Rob
Try starting Houdini like so from the Houdini Shell.terminal app:
no_proxy=“ ” houdini
That temporarily sets $no_proxy to a non-empty value (i.e. a single whitespace character) and then starts Houdini.
See if this workaround helps. Otherwise, I'll probably have to send you a patch file that will help us track down the issue on your machine.
Let me know how that goes.
Cheers,
Rob
- jopa79
- Member
- 13 posts
- Joined: 9月 2011
- Offline
Hi Rob,
thanks for your help, now i'm one step closer :wink: i think.
I start houdini with your workaround and my browser appears.
After more than 20 minutes of waiting nothing happens (Launching a computer in the cloud).
The EC2 Instance would not start (my scene file is just 1,5M). I click on the amazon console link and the EC2 Dashboard tells me that i have 0 running instances.
thanks…
thanks for your help, now i'm one step closer :wink: i think.
I start houdini with your workaround and my browser appears.
After more than 20 minutes of waiting nothing happens (Launching a computer in the cloud).
The EC2 Instance would not start (my scene file is just 1,5M). I click on the amazon console link and the EC2 Dashboard tells me that i have 0 running instances.
thanks…
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
Awesome. We're getting there.
If you see the web page, then that means that Houdini was able to get to a point where it spawned a daemon process called ‘cloudsubmit’ which is responsible for starting EC2 instances and managing render jobs on the cloud.
So if the EC2 dashboard reports 0 instances, then the cloudsubmit daemon must have hit a glitch when trying to start the instances. This can happen for a variety of reasons such as a network firewall configuration setting or if the EC2 Amazon account that you are using is not subscribed to the Houdini Cloud Rendering service.
To find out what the problem is, we need to examine cloudsubmit's log file. On Mac OSX, the log file is stored in a temporary directory somewhere under /var/folders.
Open a Terminal.app, and run this command to find the log file:
find /var/folders -name “cloudsubmit.log”
Once you locate the log file, you can post it here or send it to me by email and I can help you from there.
Cheers,
Rob
If you see the web page, then that means that Houdini was able to get to a point where it spawned a daemon process called ‘cloudsubmit’ which is responsible for starting EC2 instances and managing render jobs on the cloud.
So if the EC2 dashboard reports 0 instances, then the cloudsubmit daemon must have hit a glitch when trying to start the instances. This can happen for a variety of reasons such as a network firewall configuration setting or if the EC2 Amazon account that you are using is not subscribed to the Houdini Cloud Rendering service.
To find out what the problem is, we need to examine cloudsubmit's log file. On Mac OSX, the log file is stored in a temporary directory somewhere under /var/folders.
Open a Terminal.app, and run this command to find the log file:
find /var/folders -name “cloudsubmit.log”
Once you locate the log file, you can post it here or send it to me by email and I can help you from there.
Cheers,
Rob
- jopa79
- Member
- 13 posts
- Joined: 9月 2011
- Offline
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
- rvinluan
- スタッフ
- 1283 posts
- Joined: 7月 2005
- Offline
Hello,
Have you followed the HQueue Cloud user guide? http://www.sidefx.com/images/stories/news/HQueue_Cloud/hqueue_cloud_guide_09nov12.pdf [sidefx.com]
Page 4 of the PDF talks about how to register for the cloud service.
Cheers,
Rob
Have you followed the HQueue Cloud user guide? http://www.sidefx.com/images/stories/news/HQueue_Cloud/hqueue_cloud_guide_09nov12.pdf [sidefx.com]
Page 4 of the PDF talks about how to register for the cloud service.
Cheers,
Rob
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
yes i followed the steps exactly…
every thing is fine but then i get that message in my log file.
"Please visit https://aws-portal.amazon.com/gp/aws/user/subscription/index.html?offeringCode=59D3AAF6 [aws-portal.amazon.com]
2012-12-22 03:03:50,473 ERROR: AuthFailure: Subscription to ProductCode 5D6864EE required."
i can go and lauch any instance of ubuntu or whatever, but i am not allowed to start manually a houdini instance, neither can i from houdini itself
i am using aprentice HD.
since i can lauch any other instance , i believe it isnt related to billing issues.
i have my shared key and secret etc, but it just wont work
every thing is fine but then i get that message in my log file.
"Please visit https://aws-portal.amazon.com/gp/aws/user/subscription/index.html?offeringCode=59D3AAF6 [aws-portal.amazon.com]
2012-12-22 03:03:50,473 ERROR: AuthFailure: Subscription to ProductCode 5D6864EE required."
i can go and lauch any instance of ubuntu or whatever, but i am not allowed to start manually a houdini instance, neither can i from houdini itself
i am using aprentice HD.
since i can lauch any other instance , i believe it isnt related to billing issues.
i have my shared key and secret etc, but it just wont work
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
- sami.tawil
- Member
- 172 posts
- Joined: 3月 2012
- Online
So it is rendering and downloading
but i ma quiet disappointed with the render time
i launched a simple scenes that takes 3 min for 100 frames on my
12 core machine (dual xeon 3.07ghz 48 mb ram)
hqueue with clouds tells me 45 min..with that setup:
10 machines 64 bit
min client per frame 10
max client per frame 10
frame per job 1
cpus per job 8.
anything i am doing wrong?
i apologise for beeing a bit pushy but i litterally lost all my night to figure out to make that work and the result is not what i expected.
but i ma quiet disappointed with the render time
i launched a simple scenes that takes 3 min for 100 frames on my
12 core machine (dual xeon 3.07ghz 48 mb ram)
hqueue with clouds tells me 45 min..with that setup:
10 machines 64 bit
min client per frame 10
max client per frame 10
frame per job 1
cpus per job 8.
anything i am doing wrong?
i apologise for beeing a bit pushy but i litterally lost all my night to figure out to make that work and the result is not what i expected.
- protozoan
- Member
- 1718 posts
- Joined: 3月 2009
- Offline
anything i am doing wrong?
In a way, you are.
Small jobs are not suitable for the Hcloud. amazon does not have a “persistent” renderfarm setup. When you send a job, they allocate arbitrary machines and roll out the software first. Then ifds are being generated and then the rendering is started. If you have for example a rendertime of 10 minutes per frame, then you will profit from it. For short rendertimes per frame the overhead is far too great.
You also have to be aware, that the EC2-machines are rather mediocre (even the XL-ones) compared to your rig. You will have to take that into account when calculating the frame rendertime in the first place.
Martin Winkler
money man at Alarmstart Germany
money man at Alarmstart Germany
-
- Quick Links