Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI

被引:2
|
作者
Faruqi, Faraz [1 ]
Katary, Ahmed [1 ]
Hasic, Tarik [1 ]
Abdel-Rahman, Amira [2 ]
Rahman, Nayeemur [1 ]
Tejedor, Leandra [1 ]
Leake, Mackenzie [1 ]
Hofmann, Megan [3 ]
Mueller, Stefanie [1 ]
机构
[1] MIT, CSAIL, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[2] MIT, Ctr Bits & Atoms, 77 Massachusetts Ave, Cambridge, MA 02139 USA
[3] Northeastern Univ, Khoury Coll Comp Sci, Boston, MA 02115 USA
来源
ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT | 2023年
关键词
personal fabrication; digital fabrication; 3d printing; generative AI;
D O I
10.1145/3586182.3615769
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
With recent advances in Generative AI, it is becoming easier to automatically manipulate 3D models. However, current methods tend to apply edits to models globally, which risks compromising the intended functionality of the 3D model when fabricated in the physical world. For example, modifying functional segments in 3D models, such as the base of a vase, could break the original functionality of the model, thus causing the vase to fall over. We introduce Style2Fab, a system for automatically segmenting 3D models into functional and aesthetic elements, and selectively modifying the aesthetic segments, without affecting the functional segments. Style2Fab uses a semi-automatic classification method to decompose 3D models into functional and aesthetic elements, and differentiable rendering to selectively stylize the functional segments. We demonstrate the functionality of this tool with six application examples across domains of Home Interior Design, Medical Applications, and Personal Accessories.
引用
收藏
页数:5
相关论文
共 44 条
  • [31] How to Segment in 3D Using 2D Models: Automated 3D Segmentation of Prostate Cancer Metastatic Lesions on PET Volumes Using Multi-angle Maximum Intensity Projections and Diffusion Models
    Toosi, Amirhosein
    Harsini, Sara
    Benard, Francois
    Uribe, Carlos
    Rahmim, Arman
    DEEP GENERATIVE MODELS, DGM4MICCAI 2024, 2025, 15224 : 212 - 221
  • [32] Leveraging generative AI for urban digital twins: a scoping review on the autonomous generation of urban data, scenarios, designs, and 3D city models for smart city advancement
    Haowen Xu
    Femi Omitaomu
    Soheil Sabri
    Sisi Zlatanova
    Xiao Li
    Yongze Song
    Urban Informatics, 3 (1):
  • [33] Learning Geometric-aware Properties in 2D Representation Using Lightweight CAD Models, or Zero Real 3D Pairs
    Arsomngern, Pattaramanee
    Nutanong, Sarana
    Suwajanakorn, Supasorn
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 21371 - 21381
  • [34] Breast lesion segmentation and characterization using the Small Tumor-Aware Network (STAN) and 2D/3D shape descriptors in ultrasound images
    Bass, Vivian
    Mateos, Maria-Julieta
    Rosado-Mendez, Ivan M.
    Marquez, Jorge A.
    17TH INTERNATIONAL SYMPOSIUM ON MEDICAL INFORMATION PROCESSING AND ANALYSIS, 2021, 12088
  • [35] Transferability Limitations for Covid 3D Localization Using SARS-CoV-2 Segmentation Models in 4D CT Images
    Maganaris, Constantine
    Protopapadakis, Eftychios
    Bakalos, Nikolaos
    Doulamis, Nikolaos
    Kalogeras, Dimitris
    Angeli, Aikaterini
    ADVANCES IN VISUAL COMPUTING, ISVC 2022, PT II, 2022, 13599 : 320 - 331
  • [36] Particulate matter 10 exposure affects intestinal functionality in both inflamed 2D intestinal epithelial cell and 3D intestinal organoid models
    Son, Ye Seul
    Son, Naeun
    Yu, Won Dong
    Baek, Aruem
    Park, Young-Jun
    Lee, Moo-Seung
    Lee, Seon-Jin
    Kim, Dae-Soo
    Son, Mi-Young
    FRONTIERS IN IMMUNOLOGY, 2023, 14
  • [37] Scale- and Slice-aware Net (S2aNet) for 3D segmentation of organs and musculoskeletal structures in pelvic MRI
    Yan, Chaoyang
    Lu, Jing-Jing
    Chen, Kang
    Wang, Lei
    Lu, Haoda
    Yu, Li
    Sun, Mengyan
    Xu, Jun
    MAGNETIC RESONANCE IN MEDICINE, 2022, 87 (01) : 431 - 445
  • [38] 2D/3D reconstruction of the distal femur using statistical shape models addressing personalized surgical instruments in knee arthroplasty: A feasibility analysis
    Cerveri, Pietro
    Sacco, Costanza
    Olgiati, Gianluca
    Manzotti, Alfonso
    Baroni, Guido
    INTERNATIONAL JOURNAL OF MEDICAL ROBOTICS AND COMPUTER ASSISTED SURGERY, 2017, 13 (04):
  • [39] SLOD2+WIN: semantics-aware addition and LoD of 3D window details for LoD2 CityGML models with textures
    Zhang, Xingzi
    Chen, Kan
    Johan, Henry
    Erdt, Marius
    VISUAL COMPUTER, 2024, 40 (11): : 7507 - 7525
  • [40] Segmentation of cortical bone, trabecular bone, and medullary pores from micro-CT images using 2D and 3D deep learning models
    Lee, Andrew H.
    Moore, Julian M.
    Covarrubias, Brandon Vera
    Lynch, Leigha M.
    ANATOMICAL RECORD-ADVANCES IN INTEGRATIVE ANATOMY AND EVOLUTIONARY BIOLOGY, 2025,