Skip to content

Latest commit

 

History

History
101 lines (69 loc) · 4.71 KB

README.md

File metadata and controls

101 lines (69 loc) · 4.71 KB
Raw

Magical Rice Bowl: A Real-time Food Category Changer
(ACM MM2018)

The proposed system based on a StarGAN enables us to change the appearance of a given food photo according to the given category keeping the shape of the given food but exchanging its textures. For training, we used two hundred and thirty thousand food images which achieved very natural food category change among ten kinds of typical Japanese foods: ramen noodle, curry rice, fried rice, beef rice bowl, chilled noodle, spaghetti with meat source, white rice, eel bowl, and fried noodle.

Ms. Koizumi Loves Ramen Noodles（Japanese Famous Anime）

Ms. Koizumi Loves Ramen Noodles (ラーメン大好き小泉さん Rāmen Daisuki Koizumi-san) is a Japanese manga series by Naru Narumi. It began serialization in Takeshobo's Manga Life Storia magazine in September 2013. A live-action drama series adaptation aired from June 2015 to December 2016. A 12-episode anime television series adaptation co-animated by Studio Gokumi and AXsiZ aired in Japan between January 4 and March 22, 2018. (by wikipedia)

Paper

Magical Rice Bowl: A Real-time Food Category Changer
Ryosuke Tanno, Daichi Horita, Takumi Ege, and Keiji Yanai   
Department of Informatics, The University of Electro-Communication
ACM International Conference Multimedia (ACM MM), 2018 (Demo)


Dependencies


Usage

Pretrained model

This Repository contains the pretrained model in the ./outputs/models directory.

To translate images using the pretrained model, run the Google Colaboratory. The translated images will be saved into ./outputs/results directory.


Results

Note that additional results can be see at FoodTransformation Project HP and HoloLens Version


Art Works

  • Ryosuke Tanno: Japanese Anime Food Image Transformation, Proc. of NeurIPS Workshop on Machine Learning for Creativity and Design, art works, Motreal, Canada (2018/12).
    • Please visit AI Art Gallery → here !!.
  • Ryosuke Tanno: Food Image Transformation, Proc. of ECCV Workshop on Computer Vision for Fashion, Art and Design, art works, Munich, Germany (2018/9). (longlist) .
    • Please visit Computer Vision Art Gallery Site → here !!.
    • My first visual art with computer vision techniques is here !!.

Mobile Application

MagicalRiceBowl This application was Developed by Yuki Izumi. The technology of this applicationu ses the following papers. If this work is useful for your research, please cite our papers. 




@InProceedings{izumi18,
  author="Izumi, Y. and Horita, D. and Tanno, R. and Yanai, K.",
  title="Real-Time Image Classification and Transformation Apps on iOS by "Chainer2MPSNNGraph"",
  booktitle="Proc. of NIPS WS on Machine Learning on the Phone and other Consumer Devices (MLPCD)",
  year="2018"
}

Citation

If this work is useful for your research, please cite our paper:

@InProceedings{tann18,
  author={Tanno, R. and Horita, D. and Shimoda, W. and Yanai, K.},
  title={Magical Rice Bowl: Real-time Food Category Changer},
  booktitle={Proc. of ACM International Conference Multimedia},
  year="2018"
}

Thanks

This repository is largely based on StarGAN. So, please also cite their paper.

@InProceedings{StarGAN2018,
author = {Choi, Yunjey and Choi, Minje and Kim, Munyoung and Ha, Jung-Woo and Kim, Sunghun and Choo, Jaegul},
title = {StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation},
booktitle = {The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2018}
}