ML Terrain
Film/TV , Gamedev

This demo is intended to be a full walkthrough of the process from creating an ML model, and using this ML model directly in Houdini. But it is also built with exploration in mind. Plug in your own terrain erosion HDAs, or heightfield patterns. Use higher or lower resolution to compare results. Test against massive terrain, or work with small fine tune details. Train a moon crater ML model, or alien world. Or simply just use existing real world lidar data.

The ONNX Machine Learning Terrain demo comes in two parts.

Part One | Training: (ONNX_teraining_Terrain.hip)
 Walk through a simple setup of how to leverage PDG, and a handful of terrain HDAs processors, to create hundreds or thousands of unique terrain assets. Feeding those terrain files into COPs to export image pairs which will be used by the TrainPix2Pix HDA, which will create a custom ONNX file.

Part Two | Inference: (ONNX_Paint_Terrain.hip) Use the newly created ONNX file(or use the one provided), with Houdini 20's new ONNX SOP. With the hip files basic heightfield set up, edit its shape and design with a Paint Texture Mask directly in the viewport, and watch the ML model generate a final detailed heightfield.

(2 responses)

Asset Type
Scene File | HIP
Published
Nov. 2, 2023
Terms of Use
Standard License
Created in
Houdini 20.5
Categories
Machine Learning, Terrains
DOWNLOAD [193.2 MB]

CREATED BY

Cody Spahr
CODY SPAHR

Cody Spahr is a technical artist at SideFX, with a background in game dev.

More from Cody Spahr

COMMENTS

  • Vasilis Triantafyllou 1 year ago  | 

    This is incredibly helpful, Thank you!

  • 2danimm 11 months, 2 weeks ago  | 

    Thanks a lot

  • Ed B 9 months, 3 weeks ago  | 

    Why is no-one talking about this. What?!!!

  • alnh 8 months, 3 weeks ago  | 

    Where is the actual tutorial? I've downloaded the example files from this page (https://www.sidefx.com/contentlibrary/ml-terrain/) but I don't see a tutorial video.

  • jlapre 8 months, 1 week ago  | 

    alnh, it looks like the documentation is in the Houdini files themselves, in the form of sticky notes inside the various SOPs.

  • jlapre 8 months, 1 week ago  | 

    After looking at the sticky notes in the hip files, I have to agree with alnh. It would be really helpful if there was a step by step tutorial.
    I'm not able to get the example files to work for me.

  • Cody Spahr 7 months, 2 weeks ago  | 

    A new video has been uploaded. Hopefully it gives a bit more insight into both the Training and the Inference HIP files.

    • yakymoto 5 months, 1 week ago  | 

      Lovely, thank you! Where can I find a link to this video?

      • yakymoto 5 months, 1 week ago  | 

        Never mind! I found it between the slides on this page. Cheers!

  • yakymoto 5 months ago  | 

    FYI: Latest archive from this page "Onnx_ML_Terrain2.zip" throwing errors in Houdini 20.0.688.
    But previous archive "Onnx_ML_Terrain.zip", which is still available with the next link https://www.sidefx.com/contentlibrary/download/ml-terrain/ works perfectly!

    • George Rolfe 4 months, 1 week ago  | 

      I confirmed the above works, and the original doesn't.

  • Cody Spahr 3 weeks, 2 days ago  | 

    New update to the project. The parameters have been adjusted on the training TOP network to work out of the box again. It looks like the default value of generated heightfields was dropped to a number where the split wasn't working. Then it would error out. This is fixed now.

Please log in to leave a comment.