Feature request: Cheetah3D as a Viewer for Gaussian Splats

Wellenbrett

Member
Messages
6
I would love it if Cheetah3D could handle existing Gaussian Splats. Cheetah3D 8 has been converted to Metal. There is an open source project for this very purpose: MetalSplatter by Sean Cier: https://github.com/scier/MetalSplatter. I compiled it yesterday with Xcode, and it works. Unfortunately, the demo app included is extremely rudimentary, but it displays a Gaussian Splat at breathtaking speed. Wouldn't it be a reasonable effort to implement this as a viewer in Cheetah3D 9 (or even 8)? It would also be great to be able to import the Colmap file format (essentially a text file that describes the file structure of the additional resources: ply-3DGS file, images, point cloud, camera positions), as exported by Metashape, for example.
 
Last edited:
I just started working with Gaussian splats on Octane Render in OctanBlender. They are great In certain circumstances for compositing individual mesh assets into a large world environment, offering rendering speed and file size savings. But I think they would not be suitable for Cheetah3D since to effectively work with them requires real-time viewport rendering preview.
 
I just started working with Gaussian splats on Octane Render in OctanBlender. They are great In certain circumstances for compositing individual mesh assets into a large world environment, offering rendering speed and file size savings. But I think they would not be suitable for Cheetah3D since to effectively work with them requires real-time viewport rendering preview.
I had suggested using Cheetah3D as a viewer for existing splats rather than editing them. That said, splats can even be edited in the browser, see: https://superspl.at/editor
 
In working with them I ment compositing traditional 3D elements into / on them. Not editing the splats themselves.
 
In working with them I ment compositing traditional 3D elements into / on them. Not editing the splats themselves.
You said, “But I think they would not be suitable for Cheetah3D since to effectively work with them requires real-time viewport rendering preview.” However, fully trained Gaussian splats are actually suitable for real-time previews. Cheetah3D is not a real-time rendering system at all and has managed without real-time previews of the render results so far. Splats could be visualized in Cheetah3D as a point cloud and visualized and edited together with classic mesh objects, etc. However, my initial post was simply about quick integration for the visualization of fully trained Gaussian splats.
 
Back
Top