Skip to content

Convert a mesh (or multiple!) to an SDF for the Visual Effect Graph (Unity) in realtime

License

Notifications You must be signed in to change notification settings

rorygames/MeshToSDF

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

22 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

MeshToSDF

Convert a mesh to an signed distance field for the VFX Graph in realtime. See the MeshToSDF/Demo.unity scene to see how to use.

How to use

  1. Drag the MeshToSDF prefab into your scene.
  2. Either set a mesh for the Mesh field or set a SkinnedMeshRenderer for the Skinned Mesh Renderer field
  3. Enter play-mode and set the offset and scale such that the mesh is placed within the SDF where you want it to be. Copy these values into edit-mode
  4. Outputs:
    1. VFX graph output - set the Vfx Output field to a VFX graph and the Vfx Property to an exposed Texture3D parameter of the VFX graph
    2. Material output - same as vfx graph output, but with a material. There's a Slice Texture 3D material in the Editor folder that can be used to debug the SDF. Put it on a plane and put it in to the Material output property to see a slice of the SDF.
    3. Script output - the SDF is available on the outputRenderTexture field of the component. The distance is stored in a RGBAFloat texture, in the RGB channels. Note that if you update the offset or scale or sdfResolution fields in a build, you also have to set meshToSdfComponent.fieldsChanged = true

How it works

  1. Convert the triangle mesh into voxels
  2. There are many "correct" ways to do this, for instance by iterating over the voxels that each triangle might intersect with and testing if it does intersect with any of them.
  3. But it's faster to just sample a bunch of quasi-randomly distributed points on each triangle and marking them as filled in the voxels texture, hoping we sample enough to get a good surface. I use the R_2 sequence for this.
  4. This would also be possible with a geometery or tesselation shader to split the triangles to be below the voxel resolution followed by marking the location of each vertex in the voxel texture as filled
  5. Flood fill the voxel texture using Jump Flood Assignment. This creates a voroni diagram with each voxel acting as a seed, AKA an unsigned distance field of the voxels.
  6. Subtract some constant from the unsigned distance field to thicken the surface a little bit.

How to use Multi Mesh

This tutorial is primarily for the VFX graph.

  1. Add the MultiMeshToSDF script to an object.
  2. Assign the default parameters of compute shaders (see MeshToSDF prefab).
  3. Assign your VFX Property (the SDF) and VFX Transform Property (the center and scale of the bounding box)
  4. Assign your skinned meshes in the Skinned Meshes parameter.

How Multi Mesh works

Multi mesh builds off the core but generates a dynamically scaling 3D SDF based upon the number of skinned mesh renderers (SMR) present in the parameters. Each currently active SMR is combined into a single mesh and a single combined bounding box is created. The bounding box gives you the scale information that is then passed through to the VFX graph through the transform parameter (rotation is not needed as the bounding box is world space, a gizmo is drawn to show you the current bounding box being created). The bounding box is then scaled down slightly to ensure that it sits within the full SDF region (this is user modifiable).

It can be easily expanded to include static meshes however I had no such need for them, feel free to add them if you wish.

Limitations & Improvements to make

  • Currently SDFs are hollow, however the VFX treats all SDFs as hollow anyway.
  • The same sample count is used for all triangles, but smaller triangles can get away with fewer samples.
    • Should benchmark to see if a dynamic length loop that samples & writes to fewer locations is faster than fixed length, unrolled by the compiler loop that samples and writes to too many.
  • Since we know the vertex normals, we could write this into the voxels and have the vfx graph use the flood-filled SDF normals, rather than recomputing them per particle per timestep. However, this would require reimplementing the Conform To SDF block in the VFX graph to sample the sdf gradient, rather than computing it with a 3-tap approximation.
  • Instead of each thread writing numSamples times into the voxel array, spawn numTriangles * numSamples threads and each thread writes 1 sample into the array. Maybe this is faster?
  • Try the geometry shader technique. It used to be annoying to do this, but apparently is easier in HDRP.
  • There's no need for the dependency on the VFX graph except for the demo scene.
  • The above statement is slightly less true for multi mesh.

About

Convert a mesh (or multiple!) to an SDF for the Visual Effect Graph (Unity) in realtime

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • C# 100.0%