Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI

被引:2
|
作者
Faruqi, Faraz [1 ]
Katary, Ahmed [1 ]
Hasic, Tarik [1 ]
Abdel-Rahman, Amira [2 ]
Rahman, Nayeemur [1 ]
Tejedor, Leandra [1 ]
Leake, Mackenzie [1 ]
Hofmann, Megan [3 ]
Mueller, Stefanie [1 ]
机构
[1] MIT, CSAIL, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] MIT, Ctr Bits & Atoms, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
来源
ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT | 2023年
关键词
personal fabrication; digital fabrication; 3d printing; generative AI;
D O I
10.1145/3586182.3615769
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce Style2Fab, a system for automatically segmenting 3D models into functional and aesthetic elements, and selectively modifying the aesthetic segments, without affecting the functional segments. Style2Fab uses a semi-automatic classification method to decompose 3D models into functional and aesthetic elements, and differentiable rendering to selectively stylize the functional segments. We demonstrate the functionality of this tool with six application examples across domains of Home Interior Design, Medical Applications, and Personal Accessories.
引用
收藏
页数:5
相关论文
共 44 条
  • [41] 3D Graph-S2Net: Shape-Aware Self-ensembling Network for Semi-supervised Segmentation with Bilateral Graph Convolution
    Huang, Huimin
    Zhou, Nan
    Lin, Lanfen
    Hu, Hongjie
    Iwamoto, Yutaro
    Han, Xian-Hua
    Chen, Yen-Wei
    Tong, Ruofeng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT II, 2021, 12902 : 416 - 427
  • [42] Comparing the performance of 2D vs. 3D nnU-Net models in automatic segmentation of differentiated thyroid carcinoma on FDG-PET/CT
    Li, Yingtong
    Hirata, Kenji
    Takenaka, Junki
    Endo, Hiroki
    Tang, Minghui
    Watanabe, Shiro
    Kimura, Rina
    Kudo, Kohsuke
    JOURNAL OF NUCLEAR MEDICINE, 2024, 65
  • [43] Slow H2S-Releasing Donors and 3D Printable Arrays Cellular Models in Osteo-Differentiation of Mesenchymal Stem Cells for Personalized Therapies
    Arciero, Ilaria
    Buonvino, Silvia
    Melino, Sonia
    BIOMOLECULES, 2024, 14 (11)
  • [44] 3D MRI Volume Segmentation Using 2D U-Net Models: A Focus on Deep Brain Structures of the Striatum for Parkinson's Disease early diagnosis
    Baalbaki, Jad
    Soubra, Racha
    El Zein, Mohamad
    Diab, Mohamad O.
    Chkeir, Aly
    2024 IEEE INTERNATIONAL SYMPOSIUM ON MEDICAL MEASUREMENTS AND APPLICATIONS, MEMEA 2024, 2024,