FoodChangeLens: CNN-based Food Transformation on HoloLens

被引:6
|
作者
Naritomi, Shu [1 ]
Tanno, Ryosuke [2 ]
Ege, Takumi [1 ]
Yanai, Keiji [1 ]
机构
[1] Univ Electrocommun, Dept Informat, Tokyo, Japan
[2] NTT Commun Corp, Technol Dev, Tokyo, Japan
关键词
Deep Learning; Convolutional Neural Network; Generative Adversarial Networks; HoloLens; Food Image Transfer;
D O I
10.1109/AIVR.2018.00046
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this demonstration, we implemented food category transformation in mixed reality using both image generation and HoloLens. Our system overlays transformed food images to food objects in the AR space, so that it is possible to convert in consideration of real shape. This system has the potential to make meals more enjoyable. In this work, we use the Conditional CycleGAN trained with a large-scale food image data collected from the Twitter Stream for food category transformation which can transform among ten kinds of foods mutually keeping the shape of a given food. We show the virtual meal experience which is food category transformation among ten kinds of typical Japanese foods: ramen noodle, curry rice, fried rice, beef rice bowl, chilled noodle, spaghetti with meat source, white rice, eel bowl, and fried noodle. Note that additional results including demo videos can be see at https://negi111111.github.io/FoodChangeLensProjectHP/
引用
收藏
页码:197 / 199
页数:3
相关论文
共 50 条
  • [1] Learning CNN-based Features for Retrieval of Food Images
    Ciocca, Gianluigi
    Napoletano, Paolo
    Schettini, Raimondo
    NEW TRENDS IN IMAGE ANALYSIS AND PROCESSING - ICIAP 2017, 2017, 10590 : 426 - 434
  • [2] CNN-based features for retrieval and classification of food images
    Ciocca, Gianluigi
    Napoletano, Paolo
    Schettini, Raimondo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 176 : 70 - 77
  • [3] Evaluating CNN-Based Semantic Food Segmentation Across Illuminants
    Ciocca, Gianluigi
    Mazzini, Davide
    Schettini, Raimondo
    COMPUTATIONAL COLOR IMAGING, CCIW 2019, 2019, 11418 : 247 - 259
  • [4] Data Transformation Schemes for CNN-Based Network Traffic Analysis: A Survey
    Krupski, Jacek
    Graniszewski, Waldemar
    Iwanowski, Marcin
    ELECTRONICS, 2021, 10 (16)
  • [5] A CNN-Based Mosquito Classification Using Image Transformation of Wingbeat Features
    Alvaro Luna-Gonzalez, Jose
    Robles-Camarillo, Daniel
    Nakano-Miyatake, Mariko
    Lanz-Mendoza, Humberto
    Perez-Meana, Hector
    KNOWLEDGE INNOVATION THROUGH INTELLIGENT SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES (SOMET_20), 2020, 327 : 127 - 137
  • [6] Pole Transformation of Magnetic Data Using CNN-Based Deep Learning Models
    Jia, Zhuo
    Huang, Meijia
    Xu, Hong
    Du, Wei
    Li, Yabin
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [7] CNN-based UGS method using Cartesian-to-polar coordinate transformation
    Kim, B. -S.
    Sun, J. -Y.
    Kim, S. -W.
    Kang, M. -C.
    Ko, S. -J.
    ELECTRONICS LETTERS, 2018, 54 (23) : 1321 - +
  • [8] CNN-Based Food Image Segmentation Without Pixel-Wise Annotation
    Shimoda, Wataru
    Yanai, Keiji
    NEW TRENDS IN IMAGE ANALYSIS AND PROCESSING - ICIAP 2015 WORKSHOPS, 2015, 9281 : 449 - 457
  • [9] CNN-Based Growth Prediction of Field Crops for Optimizing Food Supply Chain
    Iitsuka, Shunsuke
    Fujii, Nobutada
    Kokuryo, Daisuke
    Kaihara, Toshiya
    Nakano, Shinichi
    IFIP Advances in Information and Communication Technology, 2019, 566 : 148 - 154
  • [10] CNN-Based Growth Prediction of Field Crops for Optimizing Food Supply Chain
    Iitsuka, Shunsuke
    Fujii, Nobutada
    Kokuryo, Daisuke
    Kaihara, Toshiya
    Nakano, Shinichi
    ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: PRODUCTION MANAGEMENT FOR THE FACTORY OF THE FUTURE, PT I, 2019, : 148 - 154