• Skip navigation
  • Skip to navigation
  • Skip to the bottom
Simulate organization breadcrumb open Simulate organization breadcrumb close
Chair of Visual Computing
  • FAUTo the central FAU website
  1. Friedrich-Alexander-Universität
  2. Technische Fakultät
  3. Department Informatik
Suche öffnen
  • Campo
  • StudOn
  • FAUdir
  • Jobs
  • Map
  • Help
  1. Friedrich-Alexander-Universität
  2. Technische Fakultät
  3. Department Informatik

Chair of Visual Computing

Navigation Navigation close
  • Research
    • Rendering and Visualization
    • Geometric Modeling and 3D Reconstruction
    • Virtual, Mixed, and Augmented Reality
    • Visual Computing for Digital Humanities and Social Sciences
    • Visual Healthcare Computing
    Research
  • Publications
  • Teaching
    • Vertiefungsrichtung Visual Computing
    • Summer Term 2025
    • Winter Term 2024/25
    • Theses
    Teaching
  • Staff
  • Arrival and Contact
  1. Home
  2. Publications
  3. Publications 2020
  4. Neural Denoising for Path Tracing of Medical Volumetric Data

Neural Denoising for Path Tracing of Medical Volumetric Data

In page navigation: Publications
  • Publications 2020
    • BASH: Biomechanical Animated Skinned Human for Visualization of Kinematics and Muscle Activity
    • BRDF-Reconstruction in Photogrammetry Studio Setups
    • Learning Kinematic Machine Models from Videos for VR/AR Training
    • Neural Denoising for Path Tracing of Medical Volumetric Data
    • NRMVS: Non-Rigid Multi View Stereo
    • Proxy Painting
    • Real-Time Adaptive Color Correction in Dynamic Projection Mapping
    • Time‐Warped Foveated Rendering for Virtual Reality Headsets
  • Publications 2021
  • Publications 2022

Neural Denoising for Path Tracing of Medical Volumetric Data

Nikolai Hofmann

Nikolai Hofmann, M. Sc.

Department of Computer Science
Chair of Computer Science 9 (Computer Graphics)

Room: Room 01.118-128
Cauerstraße 11
91058 Erlangen
  • Phone number: +49 9131 85-25257
  • Email: nikolai.hofmann@fau.de
  • Website: http://lgdv.cs.fau.de/
Jana Martschinke

M.Sc. Jana Martschinke

Department of Computer Science
Chair of Computer Science 9 (Computer Graphics)

Cauerstraße 11
91058 Erlangen
  • Email: jana.martschinke@fau.de
  • Website: http://lgdv.cs.fau.de/

Paper

  • Hofmann N., Martschinke J., Engel K., Stamminger M.:
    Neural Denoising for Path Tracing of Medical Volumetric Data
    High-Performance Graphics 2020 (Online, July 13, 2020 - July 16, 2020)
    In: ACM (ed.): Proceedings of the ACM on Computer Graphics and Interactive Techniques 2020
    DOI: 10.1145/3406181
    URL: https://www.lgdv.tf.fau.de/?p=2278
    BibTeX: Download

Abstract

In this paper, we transfer machine learning techniques previously applied to denoising surface-only Monte Carlo renderings to path-traced visualizations of medical volumetric data. In the domain of medical imaging, path-traced videos turned out to be an efficient means to visualize and understand internal structures, in particular for less experienced viewers such as students or patients. However, the computational demands for the rendering of high-quality path-traced videos are very high due to the large number of samples necessary for each pixel. To accelerate the process, we present a learning-based technique for denoising path-traced videos of volumetric data by increasing the sample count per pixel; both through spatial (integrating neighboring samples) and temporal filtering (reusing samples over time). Our approach uses a set of additional features and a loss function both specifically designed for the volumetric case. Furthermore, we present a novel network architecture tailored for our purpose, and introduce reprojection of samples to improve temporal stability and reuse samples over frames. As a result, we achieve good image quality even from severely undersampled input images, as visible in the teaser image.

Video

Chair of Visual Computing
(Lehrstuhl für Graphische Datenverarbeitung)

Cauerstraße 11
91058 Erlangen
Deutschland
  • Imprint
  • Privacy
  • Facebook
  • RSS Feed
  • Xing
Up