Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI

被引:2
|
作者
Faruqi, Faraz [1 ]
Katary, Ahmed [1 ]
Hasic, Tarik [1 ]
Abdel-Rahman, Amira [2 ]
Rahman, Nayeemur [1 ]
Tejedor, Leandra [1 ]
Leake, Mackenzie [1 ]
Hofmann, Megan [3 ]
Mueller, Stefanie [1 ]
机构
[1] MIT, CSAIL, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] MIT, Ctr Bits & Atoms, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
来源
ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT | 2023年
关键词
personal fabrication; digital fabrication; 3d printing; generative AI;
D O I
10.1145/3586182.3615769
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce Style2Fab, a system for automatically segmenting 3D models into functional and aesthetic elements, and selectively modifying the aesthetic segments, without affecting the functional segments. Style2Fab uses a semi-automatic classification method to decompose 3D models into functional and aesthetic elements, and differentiable rendering to selectively stylize the functional segments. We demonstrate the functionality of this tool with six application examples across domains of Home Interior Design, Medical Applications, and Personal Accessories.
引用
收藏
页数:5
相关论文
共 44 条
  • [21] 3D lumbar spine intervertebral disc segmentation and compression simulation from MRI using shape-aware models
    Haq, Rabia
    Aras, Rifat
    Besachio, David A.
    Borgie, Roderick C.
    Audette, Michel A.
    INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2015, 10 (01) : 45 - 54
  • [22] Microstructure reconstruction of 2D/3D random materials via diffusion-based deep generative models
    Xianrui Lyu
    Xiaodan Ren
    Scientific Reports, 14
  • [23] Viewset Diffusion: (0-)Image-Conditioned 3D Generative Models from 2D Data
    Szymanowicz, Stanislaw
    Rupprecht, Christian
    Vedaldi, Andrea
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 8829 - 8839
  • [24] Microstructure reconstruction of 2D/3D random materials via diffusion-based deep generative models
    Lyu, Xianrui
    Ren, Xiaodan
    SCIENTIFIC REPORTS, 2024, 14 (01)
  • [25] 3D prostate boundary segmentation from ultrasound rmages using 2D active shape models
    Hodge, Adam C.
    Ladak, Hanif M.
    2006 28TH ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY, VOLS 1-15, 2006, : 1662 - +
  • [26] 3D Knee Structure Reconstruction from 2D X-rays Based on Generative Deep Learning Models
    Hwang, Siwon
    Lee, Jae-Joon
    Shin, Jitae
    2024 INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS, AND COMMUNICATIONS, ITC-CSCC 2024, 2024,
  • [27] Comparison of 2D and 3D Region-based Deformable Models and Random Walker Methods for PET Segmentation
    Gosse, Kevin
    Jehan-Besson, Stephanie
    Lecellier, Francois
    Ruan, Su
    2016 SIXTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2016,
  • [28] Evaluating Transferability for Covid 3D Localization Using CT SARS-CoV-2 segmentation models
    Maganaris, Constantine
    Protopapadakis, Eftychios
    Bakalos, Nikolaos
    Doulamis, Nikolaos
    Kalogeras, Dimitris
    Angeli, Aikaterini
    PROCEEDINGS OF THE 15TH INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2022, 2022, : 615 - 621
  • [29] Prostate boundary segmentation from ultrasound images using 2D active shape models: Optimisation and extension to 3D
    Hodge, Adam C.
    Fenster, Aaron
    Downey, Donal B.
    Ladak, Hanif M.
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2006, 84 (2-3) : 99 - 113
  • [30] A cooperative framework for segmentation using 2D active contours and 3D hybrid models as applied to branching cylindrical structures
    O'Donnell, T
    Dubuisson-Jolly, MP
    Gupta, A
    SIXTH INTERNATIONAL CONFERENCE ON COMPUTER VISION, 1998, : 454 - 459