Profile

Jotaro Shigeyama (born in 1993) is currently a Ph.D candidate in Hasso Plattner Institute in University of Potsdam, with Prof. Patrick Baudisch. He earned Bachelor & Master degree in Cyber Interface Lab with Prof. Michitaka Hirose in the University of Tokyo. He is a scholar of Funai Fountation for Information Technology scholarship since 2019. His project was presented in various top-tier international conference including _ACM SIGGRAPH / CHI / UIST. His work has been awarded in such venue such as CHI Best Paper Nomination or SIGGRAPH SRC Semi-Finalist.


|Twitter | Github | e-mail : jotaro.shigeyama[ at ]hpi.de |
| Curriculum Vitæ (pdf) | | Google Scholar |

jotaro.jpg

My research focus is on virtual reality (VR) interactions and haptic devices.
My Ph.D agenda especially focusing on VR interaction in a small space.


VR hardware became very cheap and accessible for everyone, but the space become the most expensive resource on the other hand. While the actual tracking space is limited, there are many ways left to interact virtual objects at “off-tracking space”. This includes such as throwing object, using tools, talking to somebody far away and even being able to see far away. I investigate how this “off-space interaction” effects user’s perception on space, and aim to maximize the value of minimum space in real world. I conduct a psychological experiment of how such interaction affects the sence of spaciousness to build a percpetion profile.

My research interest also goes for haptic device. I developed Transcalibur: a weight-shifting haptic device that presents the sense of holding objects of virtual shape. I investigated an effects of visual feedback and developed perception profile which optimizes weight movement. I also developed haptic gaming device called DualPanto, which allows blind people to play real-time games using two pantograph haptic devices.

Research Field / Interests
  • Virtual Reality
  • Human Interface
  • Human Computer Interaction
  • Haptic Device and Haptics Design
  • Hacking 3D Printer for Novel Use
Education
  • Ph.D candidate at HCI group in Hasso Plattner Institute, 2018

    Hasso Plattner Institute, with Prof. Patrick Baudisch

  • Master of Interdiscplinary Informatics, 2020

    Graduate School of the University of Tokyo with Prof. Michitaka Hirose, Thesis: Shape Display with Transforming VR Controller based on Computational Perception Model

  • Bachelor of Mechano-Informatics, 2017

    The University of Tokyo, Faculty of Engineering (2014-2017), with Prof. Michitaka Hirose

  • Associate degree in Mechanical and Electrical Engineering, 2014

    Tokuyama National College of Technology, The top on the list (2009-2014), with Prof. Kurt Fischer

Awards and honors
  • CHI2019 Best Paper Honorable Mention, 2019

    Project Transcalibur

  • Fellowship of Funai Foundation of Information Technology, 2019

    Scholarship of 2500USD / month

  • HATAKEYAMA award, 2014

    Japan Society of Mechanical Engineering, the Best Student Award

Projects

Trusscillator

a System for Fabricating Human-Scale Human-Powered Oscillating Devices





[Best Demo Honorable Mention Award at UIST2022]


SpeechIOForUnity

A ready-to-use Unity plugin for Speech Input/Output using native Speech API of both Apple macOS and MS Windows.


Kerf-Canceling Mechanisms: Making Laser-Cut Mechanisms Operate Across Different Laser Cutters

Kerf-canceling mechanisms achieve this by adding an additional wedge element per mechanism. We have created a software tool Kerf-Canceler that locates traditional mechanisms in cutting plans and replaces them with their kerf-canceling counterparts.


springFit: Joints and Mounts that Fabricate on Any Laser-Cutter

SpringFit converts models in the form of 2D cutting plans by replacing all contained mounts, notch joints, finger joints, and t-joints.

Full-Paper presented in UIST 2019, New Orleans, LA, US


Project Transcalibur

Weight Moving VR Controller for Dynamic Rendering of 2D Shape Using Haptic Shape Illusion





[Full-paper got awarded Honorable Mention at CHI2019]


DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds

We present a new haptic device that enables blind users to continuously track the absolute position of moving objects in spatial virtual environments, as is the case in sports or shooter games.

Full-Paper presented in UIST 2018, Berlin, Germany



Swinging 3D Lamps

2D images turn into 3D parallax motion by illusion. Collaborated work with Nami Ogawa


AgIC Workshop Collection installation design

An installation showed how conductive ink can design to be flexible.


JTRWatch

Smart watch prototype using Intel Edison


Lighting Coaster:AgIC Workshop design

AgIC tutorial designed for FAB10 Barcelona.


Project CoPRO

Optimization of condominium renovation based on reinforcement learning. Collaborated work with Takato Ishida and Chisato Hayakawa


Dokimakura:Hugging pillow with realistic haptic feedback

Designing physiological SNS, awarded 1st prize on hackathon by Yahoo!.


Farmbot

CNC agricultural robot for IoT farming.


Remote aerobotics project

Remote controlled and automatic attitude controlled airplane project.

Publications,Awards

My papers are presented in various top-tier conferences in the field of Human-Computer Interaction (HCI) such as ACM CHI, UIST.

Publications / Journals (Peer Reviewed)

  • Robert Kovacs, Lukas Rambold, Lukas Fritzsche, Dominik Meier, Jotaro Shigeyama, Shohei Katakura, Ran Zhang, Patrick Baudisch, Trusscillator: a System for Fabricating Human-Scale Human-Powered Oscillating Devices, In Proceedings of UIST’21, October, 2020, Virtual. [UIST2021 Best Demo Award Honorable Mention]

  • Muhammad Abdullah, Martin Taraz, Yannis Kommana, Shohei Katakura, Robert Kovacs, Jotaro Shigeyama, Thijs Roumen , and Patrick Baudisch: Fastforce: Real-Time Reinforcement of Laser-Cut Structures, in Proceedings of CHI’21.

  • Thijs Roumen, Ingo Apel, Jotaro Shigeyama, Abdullah Muhammad, and Patrick Baudisch: Kerf-Canceling Mechanisms: Making Laser-Cut Mechanisms Operate Across Different Laser Cutters, In Proceedings of UIST’20, October, 2020, Minneapolis, MN, US.

  • Thijs Roumen, Jotaro Shigeyama, Julius Romeo Cosmo Rudolph, Felix Grzelka, and Patrick Baudisch: SpringFit: Joints and Mounts that Fabricate on Any Laser Cutter, In Proceedings of UIST’19, October, 2019, New Orleans, LA, US.

  • Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose: Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model, In Proceedings of CHI2019, Glasgow, Scotland, UK. [Acceptance Rate: 23.8%] [CHI2019 Best Paper Honorable Mention(TOP 5%)]

  • Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel-Amadeus Gloeckner, Jonas Bounama and Patrick Baudisch, DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds, In Proceedings of UIST’18, October, 2018 [Acceptance Rate: 21.3%]

  • Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Presenting resistive force by modifying joint angles of an avatar, VRSJ Jounal Special Issue, Vol.22, No.3, 2017

Publications / Journals (No Review)

  • Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Basic study of presenting pseudo-haptic feedback by modifying body posture, ITE technical report, June 2017

Poster / Demo (Peer Reviewed)

  • Thijs Roumen, Jotaro Shigeyama, Julius Romeo Cosmo Rudolph, Felix Grzelka, and Patrick Baudisch: SpringFit: Joints and Mounts that Fabricate on Any Laser Cutter, In Proceedings of UIST’19, October, 2019, New Orleans, LA, US.

  • Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Demonstration of Transcalibur: A VR Controller that Presents Various Shapes of Handheld Objects. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA

  • Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel-Amadeus Gloeckner, Jonas Bounama and Patrick Baudisch, DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds, In Proceedings of UIST’18, October, 2018

  • Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Weight Moving VR Controller for Dynamic Rendering of 2D Shape using Haptic Shape Illusion, SIGGRAPH 2018 Emerging Technologies, August 2018

  • Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Dynamic 2D Haptic Shape Illusion of Virtual Object by Weight Moving VR Controller, SIGGRAPH 2018 Poster, August 2018, [SIGGRAPH Student Research Competition Semi-Finalist]

  • Yuji Suzuki, Jotaro Shigeyama, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Food Texture Manipulation by Face Deformation, SIGGRAPH 2018 Poster, August 2018

  • Nami Ogawa, Jotaro Shigeyama, Takuji Narumi and Michitaka Hirose: Swinging 3D Lamps: A Projection Technique to Create 3D Illusions on a Static 2D Image, SIGGRAPH Asia 2017 Emerging Technologies, November 2017

  • Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Presenting a pseudo-haptic feedback in immersive VR environment by modifying avatar’s joint angle, IEEE World Haptics 2017, June 2017

  • Jotaro Shigeyama, Designing of English Education Supporting System using Multitouch System, Creative Engineering Design Competition, Kokura, Dec.2011 The Best Aesthetic Award

Poster / Demo (No Review)

  • 小川奈美,茂山丈太郎,鳴海拓志,谷川智洋,廣瀬通孝.ゆらゆら立体灯:平面画像​に奥行きを付加するプロジェクション手法​.第22回日本バーチャルリアリティ学会大会.2017年9月​

Exhibitions / Invited Exhibitions

  • Transcalibur, 東京大学バーチャルリアリティ教育研究センター設立記念式典-東京大学が挑戦するバーチャルリアリティの未来-

  • bryophytes.io, iiiExhibition 2017, The University of Tokyo

  • ゆらゆら立体灯,マジカリアル~VR・ARが作り出す不思議体験~,SKIPシティ 彩の国ビジュアルプラザ 映像ミュージアム

  • Cyber Interface Lab Exhibition “Cybernetic Minds”, the University of Tokyo, 2017

  • Agricultural Revolution 3.0 “第三の農業革命 もう一つの未来に映る 希望的な世界”, Farmbot, 山形県鶴岡市, http://agri-revolution3.com/, collaborated project with http://eugene-kangawa.com/

Talks

  • アカデミックナイト Unityを学術研究に使用する気鋭の若手研究者によるパネルトーク, Unity Japan.

  • 米国大学院学生会 コンピューターサイエンス海外大学院留学オンライン説明会

  • CHI2019勉強会 Guest talk

  • Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Weight Moving VR Controller for Dynamic Rendering of 2D Shape using Haptic Shape Illusion, SIGGRAPH 2018 Experience Presentations, August 2018.

  • 小川奈美,茂山丈太郎,鳴海拓志,谷川智洋,廣瀬通孝.ゆらゆら立体灯:平面画像​に奥行きを付加するプロジェクション手法​.第22回日本バーチャルリアリティ学会大会.2017年9月​

Articles

  • ACM UIST2019 参加報告, 日本バーチャルリアリティ学会 ニューズレター, 201911

  • ワクワク留学体験記, 日本バーチャルリアリティ学会 学会誌, 201903

  • 徳山高専だより 2017年度 No.71, 2017 link

  • 手描き回路がそのまま動く!RCローパス・フィルタも紙カード上に「表面実装」:描いて貼って出来上がり!電子メッセージ。カード作り, 茂山丈太郎, 清水信哉, トラ技Jr. 23号, 2015

Patents

  • (TO APPEAR)

Media

Awards and honors

  • UIST2021 Best Demo Award Honorable Mention, 2021

  • CHI2019 Best Paper Honorable Mention, 2019

  • SIGGRAPH Student Research Competition (SRC) Semi-Finalist for Transcalibur, 2018

  • HackU 2015 UTxTama-art Grand Prize for Dokimakura

  • HATAKEYAMA Award (JSME Best student award ), Mar,2014

Fellowship and Grants

Teaching

Academic Services

Organizing Committees

  • ACM UIST2022 Discord Chair
  • ACM UIST2021 Digital Participation Sub-Chair
  • ACM UIST2019 Registration Chair
  • ACM UIST2018 Registration Co-Chair

Program Committees

  • ACM CHI2022 LBW

Reviewer

  • ACM SIGGRAPH Asia 2021 E-tech
  • 情報処理学会
  • MobileHCI 2021
  • ACM CHI2021
  • ACM UIST2020
  • IEEE Transaction on Haptics 2020
  • ACM CHI2020
  • ACM SIGGRAPH Asia 2018 E-tech

Student Volunteer

  • ACM CHI2018 Student Volunteer

Skills

  • Mechanical Engineering (CAD, CAM, CNC, Mechatronics)
  • Electrical Engineering (Microcontroller, PCB Design, Opamp)
  • Programming
    • C | C++ | Objective-C, Swift | Unity-C#
    • Python
    • HTML | JS | CSS | React
  • Deep Learning / ML
    • SKLearn
    • Keras

Others

  • Japan Olympiad in Informatics 2010-2011, Finalist
    • GNU C++