• Skip navigation
  • Skip to navigation
  • Skip to the bottom
Simulate organization breadcrumb open Simulate organization breadcrumb close
Chair of Visual Computing
  • FAUTo the central FAU website
  1. Friedrich-Alexander-Universität
  2. Technische Fakultät
  3. Department Informatik
Suche öffnen
  • Campo
  • StudOn
  • FAUdir
  • Jobs
  • Map
  • Help
  1. Friedrich-Alexander-Universität
  2. Technische Fakultät
  3. Department Informatik

Chair of Visual Computing

Navigation Navigation close
  • Research
    • Rendering and Visualization
    • Geometric Modeling and 3D Reconstruction
    • Virtual, Mixed, and Augmented Reality
    • Visual Computing for Digital Humanities and Social Sciences
    • Visual Healthcare Computing
    Research
  • Publications
  • Teaching
    • Vertiefungsrichtung Visual Computing
    • Summer Term 2025
    • Winter Term 2024/25
    • Theses
    Teaching
  • Staff
  • Arrival and Contact
  1. Home
  2. Publications
  3. Publications 2022
  4. Real-Time 3D Reconstruction of Human Vocal Folds via High-Speed Laser-Endoscopy

Real-Time 3D Reconstruction of Human Vocal Folds via High-Speed Laser-Endoscopy

In page navigation: Publications
  • Publications 2020
  • Publications 2021
  • Publications 2022
    • Content-Aware Brightness Solving and Error Mitigation in Large-Scale Multi-Projection Mapping
    • Real-Time 3D Reconstruction of Human Vocal Folds via High-Speed Laser-Endoscopy

Real-Time 3D Reconstruction of Human Vocal Folds via High-Speed Laser-Endoscopy

Jann-Ole Henningson

Jann-Ole Henningson, M. Sc.

Department of Computer Science
Chair of Computer Science 9 (Computer Graphics)

Room: Room 01.127-128
Cauerstraße 11
91058 Erlangen
  • Phone number: +49 9131 85-67276
  • Email: jann-ole.henningson@fau.de
  • Website: http://lgdv.cs.fau.de/

Paper

  • Henningson JO., Stamminger M., Döllinger M., Semmler M.:
    Real-Time 3D Reconstruction of Human Vocal Folds via High-Speed Laser-Endoscopy
    Medical Image Computing and Computer Assisted Intervention – MICCAI 2022 (Singapore, September 18, 2022 - October 22, 2022)
    In: MICCAI (ed.): Medical Image Computing and Computer Assisted Intervention – MICCAI, Singapore: 2022
    DOI: 10.1007/978-3-031-16449-1_1
    URL: https://henningson.github.io/Vocal3D/
    BibTeX: Download

Abstract

Conventional video endoscopy and high-speed video endosc-opy of the human larynx solely provides practitioners with information about the two-dimensional lateral and longitudinal deformation of vocal folds. However, experiments have shown that vibrating human vocal folds have a significant vertical component. Based upon an endoscopic laser projection unit (LPU) connected to a high-speed camera, we propose a fully-automatic and real-time capable approach for the robust 3D reconstruction of human vocal folds. We achieve this by estimating laser ray correspondences by taking epipolar constraints of the LPU into account. Unlike previous approaches only reconstructing the superior area of the vocal folds, our pipeline is based on a parametric reinterpretation of the M5 vocal fold model as a tensor product surface. Not only are we able to generate visually authentic deformations of a dense vibrating vocal fold model, but we are also able to easily generate metric measurements of points of interest on the reconstruced surfaces. Furthermore, we drastically lower the effort needed for visualizing and measuring the dynamics of the human laryngeal area during phonation. Additionally, we publish the first publicly available labeled in-vivo dataset of laser-based high-speed laryngoscopy videos.

Code

Code is available on github

 

Chair of Visual Computing
(Lehrstuhl für Graphische Datenverarbeitung)

Cauerstraße 11
91058 Erlangen
Deutschland
  • Imprint
  • Privacy
  • Facebook
  • RSS Feed
  • Xing
Up