Profile

Jotaro Shigeyama (born in 1993) is currently a Ph.D candidate in Hasso Plattner Institute in University of Potsdam, with Prof. Patrick Baudisch. He earned Bachelor & Master degree in Cyber Interface Lab with Prof. Michitaka Hirose in the University of Tokyo. He is a scholar of Funai Fountation for Information Technology scholarship since 2019. His project was presented in various top-tier international conference including _ACM SIGGRAPH / CHI / UIST. His work has been awarded in such venue such as CHI Best Paper Nomination or SIGGRAPH SRC Semi-Finalist.

|Twitter | Github | e-mail : jotaro.shigeyama[ at ]hpi.de |
| Curriculum Vitæ (pdf) | | Google Scholar |

My research focus is on virtual reality (VR) interactions and haptic devices.
My Ph.D agenda especially focusing on VR interaction in a small space.

VR hardware became very cheap and accessible for everyone, but the space become the most expensive resource on the other hand. While the actual tracking space is limited, there are many ways left to interact virtual objects at “off-tracking space”. This includes such as throwing object, using tools, talking to somebody far away and even being able to see far away. I investigate how this “off-space interaction” effects user’s perception on space, and aim to maximize the value of minimum space in real world. I conduct a psychological experiment of how such interaction affects the sence of spaciousness to build a percpetion profile.

My research interest also goes for haptic device. I developed Transcalibur: a weight-shifting haptic device that presents the sense of holding objects of virtual shape. I investigated an effects of visual feedback and developed perception profile which optimizes weight movement. I also developed haptic gaming device called DualPanto, which allows blind people to play real-time games using two pantograph haptic devices.

Research Field / Interests

• Virtual Reality
• Human Interface
• Human Computer Interaction
• Haptic Device and Haptics Design
• Hacking 3D Printer for Novel Use

Education

• Ph.D candidate at HCI group in Hasso Plattner Institute, 2018

  Hasso Plattner Institute, with Prof. Patrick Baudisch

• Master of Interdiscplinary Informatics, 2020

  Graduate School of the University of Tokyo with Prof. Michitaka Hirose, Thesis: Shape Display with Transforming VR Controller based on Computational Perception Model

• Bachelor of Mechano-Informatics, 2017

  The University of Tokyo, Faculty of Engineering (2014-2017), with Prof. Michitaka Hirose

• Associate degree in Mechanical and Electrical Engineering, 2014

  Tokuyama National College of Technology, The top on the list (2009-2014), with Prof. Kurt Fischer

Awards and honors

• CHI2019 Best Paper Honorable Mention, 2019

  Project Transcalibur

• Fellowship of Funai Foundation of Information Technology, 2019

  Scholarship of 2500USD / month

• HATAKEYAMA award, 2014

  Japan Society of Mechanical Engineering, the Best Student Award

My papers are presented in various top-tier conferences in the field of Human-Computer Interaction (HCI) such as ACM CHI, UIST.

Publications / Journals (Peer Reviewed)

• Robert Kovacs, Lukas Rambold, Lukas Fritzsche, Dominik Meier, Jotaro Shigeyama, Shohei Katakura, Ran Zhang, Patrick Baudisch, Trusscillator: a System for Fabricating Human-Scale Human-Powered Oscillating Devices, In Proceedings of UIST’21, October, 2020, Virtual. [UIST2021 Best Demo Award Honorable Mention]

• Muhammad Abdullah, Martin Taraz, Yannis Kommana, Shohei Katakura, Robert Kovacs, Jotaro Shigeyama, Thijs Roumen , and Patrick Baudisch: Fastforce: Real-Time Reinforcement of Laser-Cut Structures, in Proceedings of CHI’21.

• Thijs Roumen, Ingo Apel, Jotaro Shigeyama, Abdullah Muhammad, and Patrick Baudisch: Kerf-Canceling Mechanisms: Making Laser-Cut Mechanisms Operate Across Different Laser Cutters, In Proceedings of UIST’20, October, 2020, Minneapolis, MN, US.

• Thijs Roumen, Jotaro Shigeyama, Julius Romeo Cosmo Rudolph, Felix Grzelka, and Patrick Baudisch: SpringFit: Joints and Mounts that Fabricate on Any Laser Cutter, In Proceedings of UIST’19, October, 2019, New Orleans, LA, US.

• Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose: Transcalibur: A Weight Shifting Virtual Reality Controller for 2D Shape Rendering based on Computational Perception Model, In Proceedings of CHI2019, Glasgow, Scotland, UK. [Acceptance Rate: 23.8%] [CHI2019 Best Paper Honorable Mention(TOP 5%)]

• Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel-Amadeus Gloeckner, Jonas Bounama and Patrick Baudisch, DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds, In Proceedings of UIST’18, October, 2018 [Acceptance Rate: 21.3%]

• Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Presenting resistive force by modifying joint angles of an avatar, VRSJ Jounal Special Issue, Vol.22, No.3, 2017

Publications / Journals (No Review)

• Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Basic study of presenting pseudo-haptic feedback by modifying body posture, ITE technical report, June 2017

Poster / Demo (Peer Reviewed)

• Thijs Roumen, Jotaro Shigeyama, Julius Romeo Cosmo Rudolph, Felix Grzelka, and Patrick Baudisch: SpringFit: Joints and Mounts that Fabricate on Any Laser Cutter, In Proceedings of UIST’19, October, 2019, New Orleans, LA, US.

• Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2019. Demonstration of Transcalibur: A VR Controller that Presents Various Shapes of Handheld Objects. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA ’19). Association for Computing Machinery, New York, NY, USA

• Oliver Schneider, Jotaro Shigeyama, Robert Kovacs, Thijs Roumen, Sebastian Marwecki, Nico Boeckhoff, Daniel-Amadeus Gloeckner, Jonas Bounama and Patrick Baudisch, DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds, In Proceedings of UIST’18, October, 2018

• Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Weight Moving VR Controller for Dynamic Rendering of 2D Shape using Haptic Shape Illusion, SIGGRAPH 2018 Emerging Technologies, August 2018

• Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Dynamic 2D Haptic Shape Illusion of Virtual Object by Weight Moving VR Controller, SIGGRAPH 2018 Poster, August 2018, [SIGGRAPH Student Research Competition Semi-Finalist]

• Yuji Suzuki, Jotaro Shigeyama, Shigeo Yoshida, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Food Texture Manipulation by Face Deformation, SIGGRAPH 2018 Poster, August 2018

• Nami Ogawa, Jotaro Shigeyama, Takuji Narumi and Michitaka Hirose: Swinging 3D Lamps: A Projection Technique to Create 3D Illusions on a Static 2D Image, SIGGRAPH Asia 2017 Emerging Technologies, November 2017

• Jotaro Shigeyama, Nami Ogawa, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Presenting a pseudo-haptic feedback in immersive VR environment by modifying avatar’s joint angle, IEEE World Haptics 2017, June 2017

• Jotaro Shigeyama, Designing of English Education Supporting System using Multitouch System, Creative Engineering Design Competition, Kokura, Dec.2011 The Best Aesthetic Award

Poster / Demo (No Review)

• 小川奈美，茂山丈太郎，鳴海拓志，谷川智洋，廣瀬通孝．ゆらゆら立体灯：平面画像​に奥行きを付加するプロジェクション手法​．第22回日本バーチャルリアリティ学会大会．2017年9月​

Exhibitions / Invited Exhibitions

• Transcalibur, 東京大学バーチャルリアリティ教育研究センター設立記念式典-東京大学が挑戦するバーチャルリアリティの未来-

• bryophytes.io, iiiExhibition 2017, The University of Tokyo

• ゆらゆら立体灯，マジカリアル～ＶＲ・ＡＲが作り出す不思議体験～，SKIPシティ 彩の国ビジュアルプラザ　映像ミュージアム

• Cyber Interface Lab Exhibition “Cybernetic Minds”, the University of Tokyo, 2017

• Agricultural Revolution 3.0 “第三の農業革命 もう一つの未来に映る 希望的な世界”, Farmbot, 山形県鶴岡市, http://agri-revolution3.com/, collaborated project with http://eugene-kangawa.com/

Talks

• アカデミックナイト　Unityを学術研究に使用する気鋭の若手研究者によるパネルトーク, Unity Japan.

• 米国大学院学生会　コンピューターサイエンス海外大学院留学オンライン説明会

• CHI2019勉強会 Guest talk

• Jotaro Shigeyama, Takeru Hashimoto, Shigeo Yoshida, Taiju Aoki, Takuji Narumi, Tomohiro Tanikawa and Michitaka Hirose: Transcalibur : Weight Moving VR Controller for Dynamic Rendering of 2D Shape using Haptic Shape Illusion, SIGGRAPH 2018 Experience Presentations, August 2018.

• 小川奈美，茂山丈太郎，鳴海拓志，谷川智洋，廣瀬通孝．ゆらゆら立体灯：平面画像​に奥行きを付加するプロジェクション手法​．第22回日本バーチャルリアリティ学会大会．2017年9月​

Articles

• ACM UIST2019 参加報告, 日本バーチャルリアリティ学会 ニューズレター, ²⁰¹⁹⁄₁₁

• ワクワク留学体験記, 日本バーチャルリアリティ学会　学会誌, ²⁰¹⁹⁄₀₃

• 徳山高専だより 2017年度 No.71, 2017 link

• 手描き回路がそのまま動く！RCローパス・フィルタも紙カード上に「表面実装」:描いて貼って出来上がり！電子メッセージ。カード作り, 茂山丈太郎, 清水信哉, トラ技Jr. 23号, 2015

Patents

• (TO APPEAR)

Media

• HPIなど、視覚障害者向けのVR触覚デバイスを発表。上部ハンドルで自身のアバターを動かし、下部ハンドルで他の物体の動きを知覚, Seamless, 2019

• DualPanto is a non-visual gaming interface for the blind, Arduino Blog, 2018

• 東京大学、1台のハンドヘルドコントローラでVR内の様々な形状の触覚を再現できるVRデバイスを発表 ,Seamless, 2018

Awards and honors

• UIST2021 Best Demo Award Honorable Mention, 2021

• CHI2019 Best Paper Honorable Mention, 2019

• SIGGRAPH Student Research Competition (SRC) Semi-Finalist for Transcalibur, 2018

• HackU 2015 UTxTama-art Grand Prize for Dokimakura

• HATAKEYAMA Award (JSME Best student award ), Mar,2014

Fellowship and Grants

• Fellowship of Funai Foundation for Information Technology (2019-, top <10% Ph.D applicants for abroad in Japan, 2500USD per month)

• Grant of scholarship from Hasso Plattner Institute

Teaching

• Building Interactive Devices and Computer Vision, WS2021/22, Hasso Plattner Institute.
• Building Interactive Devices and Computer Vision, WS2020/21, Hasso Plattner Institute.
• Building Interactive Devices and Computer Vision, WS2019/20, Hasso Plattner Institute.

Academic Services

Organizing Committees

• ACM UIST2022 Discord Chair
• ACM UIST2021 Digital Participation Sub-Chair
• ACM UIST2019 Registration Chair
• ACM UIST2018 Registration Co-Chair

Program Committees

• ACM CHI2022 LBW

Reviewer

• ACM SIGGRAPH Asia 2021 E-tech
• 情報処理学会
• MobileHCI 2021
• ACM CHI2021
• ACM UIST2020
• IEEE Transaction on Haptics 2020
• ACM CHI2020
• ACM SIGGRAPH Asia 2018 E-tech

Student Volunteer

• ACM CHI2018 Student Volunteer

Skills

• Mechanical Engineering (CAD, CAM, CNC, Mechatronics)
• Electrical Engineering (Microcontroller, PCB Design, Opamp)
• Programming
  • C | C++ | Objective-C, Swift | Unity-C#
  • Python
  • HTML | JS | CSS | React
• Deep Learning / ML
  • SKLearn
  • Keras

Others

• Japan Olympiad in Informatics 2010-2011, Finalist
  • GNU C++