Gaussian Splatting for CosmoScout VR

A CosmoScout VR plugin which uses the code provided for the paper 3D Gaussian Splatting for Real-Time Radiance Field Rendering to visualize radiance fields. The code comes from two repositories:

• https://github.com/graphdeco-inria/diff-gaussian-rasterization contains the Cuda rasterizer. A fork of this repository is included in this plugin as a submodule.
• https://gitlab.inria.fr/sibr/sibr_core contains the glue-code for loading the radiance fields from disk. Our loading code is based on this repository in large parts.

License Information

The original code from MPI and Inri published alongside the paper 3D Gaussian Splatting for Real-Time Radiance Field Rendering which is used in this plugin, is only to be used for research and other non-commercial use-cases.

Hence, this plugin for CosmoScout VR contains code which is only available under a more restrictive license than the rest of CosmoScout VR. See the LICENSES directory and the SPDX tags of the individual files for more information.

Installation

This plugin requires CUDA 11 to be installed on the system. To add this plugin to CosmoScout VR, clone the repository recursively to the plugins directory:

cd cosmoscout-vr/plugins
git clone https://github.com/cosmoscout/csp-gaussian-splatting.git --recursive

CosmoScout VR will pick this up automatically, a simple ./make.sh or .\make.bat as usual will build Cosmocout VR together with the plugin.

Configuration

This plugin can be enabled with a configuration like this in your settings.json:

{
  ...
  "plugins": {
    ...
    "csp-gaussian-splatting": {
      "radianceFields": [
        {
          "ply": "<path to .ply file>",
          "object": "Earth",
          "lnglat": [11.082730297100255, 51.75784551320601],
          "rotation": [0.047756, 0.013452, -0.998744, 0.00692],
          "scale": 9,
          "altitude": 180.0
        }
      ]
    },
  }
}