Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI

被引:2
|
作者
Faruqi, Faraz [1 ]
Katary, Ahmed [1 ]
Hasic, Tarik [1 ]
Abdel-Rahman, Amira [2 ]
Rahman, Nayeemur [1 ]
Tejedor, Leandra [1 ]
Leake, Mackenzie [1 ]
Hofmann, Megan [3 ]
Mueller, Stefanie [1 ]
机构
[1] MIT, CSAIL, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] MIT, Ctr Bits & Atoms, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
关键词
personal fabrication; digital fabrication; 3d printing; generative AI;
D O I
10.1145/3586182.3615769
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce Style2Fab, a system for automatically segmenting 3D models into functional and aesthetic elements, and selectively modifying the aesthetic segments, without affecting the functional segments. Style2Fab uses a semi-automatic classification method to decompose 3D models into functional and aesthetic elements, and differentiable rendering to selectively stylize the functional segments. We demonstrate the functionality of this tool with six application examples across domains of Home Interior Design, Medical Applications, and Personal Accessories.
引用
收藏
页数:5
相关论文
共 44 条
  • [1] Functionality-aware Retargeting of Mechanisms to 3D Shapes
    Zhang, Ran
    Auzinger, Thomas
    Ceylan, Duygu
    Li, Wilmot
    Bickel, Bernd
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [2] FAME: 3D Shape Generation via Functionality-Aware Model Evolution
    Guan, Yanran
    Liu, Han
    Liu, Kun
    Yin, Kangxue
    Hu, Ruizhen
    van Kaick, Oliver
    Zhang, Yan
    Yumer, Ersin
    Carr, Nathan
    Mech, Radomir
    Zhang, Hao
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (04) : 1758 - 1772
  • [3] VRCopilot: Authoring 3D Layouts with Generative AI Models in VR
    Gettig, Jacob
    Pan, Jin
    Oney, Steve
    Zhang, Lei
    Guo, Anhong
    PROCEEDINGS OF THE 37TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, USIT 2024, 2024,
  • [4] Supervised, Geometry-aware segmentation of 3D mesh Models
    Bamba, Keisuke
    Ohbuchi, Ryutarou
    2012 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2012, : 49 - 54
  • [5] 3D Segmentation Guided Style-Based Generative Adversarial Networks for PET Synthesis
    Zhou, Yang
    Yang, Zhiwen
    Zhang, Hui
    Chang, Eric I-Chao
    Fan, Yubo
    Xu, Yan
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2022, 41 (08) : 2092 - 2104
  • [6] 3D EAGAN: 3D edge-aware attention generative adversarial network for prostate segmentation in transrectal ultrasound images
    Liu, Mengqing
    Shao, Xiao
    Jiang, Liping
    Wu, Kaizhi
    QUANTITATIVE IMAGING IN MEDICINE AND SURGERY, 2024, 14 (06) : 4067 - 4085
  • [7] Semantic Segmentation of 3D Facial Models Using 2D Annotations
    Tonchev, Krasimir
    Petkova, Radostina
    Neshov, Nikolay
    Manolova, Agata
    PROCEEDINGS OF THE 11TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS'2021), VOL 2, 2021, : 736 - 740
  • [8] 2D and 3D shape based segmentation using deformable models
    El-Baz, A
    Yuksel, SE
    Shi, HJ
    Farag, AA
    El-Ghar, MA
    Eldiasty, T
    Ghoneim, MA
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2005, PT 2, 2005, 3750 : 821 - 829
  • [9] Advanced AI Framework for Enhanced Detection and Assessment of Abdominal Trauma: Integrating 3D Segmentation with 2D CNN and RNN Models
    Jiang, Liheng
    Wu, Zhizhong
    Yang, Xuechun
    Wang, Yuting
    Yu, Chang
    2024 3RD INTERNATIONAL CONFERENCE ON ROBOTICS, ARTIFICIAL INTELLIGENCE AND INTELLIGENT CONTROL, RAIIC 2024, 2024, : 337 - 340
  • [10] CoExplorer: Generative AI Powered 2D and 3D Adaptive Interfaces to Support Intentionality in Video Meetings
    Park, Gun Woo
    Panda, Payod
    Tankelevitch, Lev
    Rintel, Sean
    EXTENDED ABSTRACTS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2024, 2024,