CT2Hair: High-Fidelity 3D Hair Modeling using Computed Tomography

被引:6
|
作者
Shen, Yuefan [1 ,2 ]
Saito, Shunsuke [2 ]
Wang, Ziyan [3 ]
Maury, Olivier [2 ]
Wu, Chenglei [2 ]
Hodgins, Jessica [4 ]
Zheng, Youyi [1 ]
Nam, Giljoo [2 ]
机构
[1] Zhejiang Univ, State Key Lab CAD&CG, Hangzhou, Peoples R China
[2] Meta Real Labs, Redmond, WA 98052 USA
[3] Carnegie Mellon Univ, Meta Real Labs, Pittsburgh, PA 15213 USA
[4] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
来源
ACM TRANSACTIONS ON GRAPHICS | 2023年 / 42卷 / 04期
关键词
3D modeling; hair modeling; computed tomography; SIMULATION; CAPTURE; IMAGE;
D O I
10.1145/3592106
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce CT2Hair, a fully automatic framework for creating high-fidelity 3D hair models that are suitable for use in downstream graphics applications. Our approach utilizes real-world hair wigs as input, and is able to reconstruct hair strands for a wide range of hair styles. Our method leverages computed tomography (CT) to create density volumes of the hair regions, allowing us to see through the hair unlike image-based approaches which are limited to reconstructing the visible surface. To address the noise and limited resolution of the input density volumes, we employ a coarse-to-fine approach. This process first recovers guide strands with estimated 3D orientation fields, and then populates dense strands through a novel neural interpolation of the guide strands. The generated strands are then refined to conform to the input density volumes. We demonstrate the robustness of our approach by presenting results on a wide variety of hair styles and conducting thorough evaluations on both real-world and synthetic datasets. Code and data for this paper are at github.com/facebookresearch/CT2Hair.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] ScanNet plus plus : A High-Fidelity Dataset of 3D Indoor Scenes
    Yeshwanth, Chandan
    Liu, Yueh-Cheng
    Niessner, Matthias
    Dai, Angela
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 12 - 22
  • [42] High-fidelity 3D face reconstruction with multi-scale details
    Jin, Yiwei
    Li, Qingyu
    Jiang, Diqiong
    Tong, Ruofeng
    PATTERN RECOGNITION LETTERS, 2022, 153 : 51 - 58
  • [43] SurgicalGaussian: Deformable 3D Gaussians for High-Fidelity Surgical Scene Reconstruction
    Xie, Weixing
    Yao, Junfeng
    Cao, Xianpeng
    Lin, Qiqin
    Tang, Zerui
    Dong, Xiao
    Guo, Xiaohu
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT VI, 2024, 15006 : 617 - 627
  • [44] AvatarStudio: High-Fidelity and Animatable 3D Avatar Creation from Text
    Zhang, Xuanmeng
    Zhang, Jianfeng
    Zhang, Chenxu
    Liew, Jun Hao
    Zhang, Huichao
    Yang, Yi
    Feng, Jiashi
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2025,
  • [45] Accuracy of individualized 3D modeling of ossicles using high-resolution computed tomography imaging data
    Zhao, Danheng
    Lu, Qiaohui
    Zou, Shizhen
    Sun, Jianjun
    Hu, Fazong
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2021, 11 (06) : 2406 - 2414
  • [46] High-fidelity Image Restoration of Large 3D Electron Microscopy Volume
    Kreinin, Yuri
    Gunn, Pat
    Chklovskii, Dmitri
    Wu, Jingpeng
    MICROSCOPY AND MICROANALYSIS, 2024, 30 (05) : 889 - 902
  • [47] 3D Mapping for high-fidelity unmanned ground vehicle lidar simulation
    Browning, Brett
    Deschaud, Jean-Emmanuel
    Prasser, David
    Rander, Peter
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2012, 31 (12): : 1349 - 1376
  • [48] High-fidelity 3D Face Generation from Natural Language Descriptions
    Wu, Menghua
    Zhu, Hao
    Huang, Linjia
    Zhuang, Yiyu
    Lu, Yuanxun
    Cao, Xun
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 4521 - 4530
  • [49] High-fidelity and fast 3D imaging of subcellular dynamics in native states
    Lu, Zhi
    Dai, Qionghai
    NATURE BIOTECHNOLOGY, 2024, : 504 - 505
  • [50] Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction
    Yang, Ziyi
    Gao, Xinyu
    Zhou, Wen
    Jiao, Shaohui
    Zhang, Yuqing
    Jin, Xiaogang
    2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2024, : 20331 - 20341