Cybernetics

Technology

Human Information Laboratories aim to create user experiences that take advantage of the unique characteristics of remote work. We are researching technologies that extend human capabilities to enhance the remote work experience. We aim to connect real space with cyberspace and create new user experiences through the fusion of real and cyber. We are focusing on remote education for playing musical instruments and remote education for sports. Instruction has generally been conducted in the real world, where skills and physical techniques are transmitted directly from person to person. We extend human capabilities by making it possible to transfer skills independent of time and place.

We are researching two technologies in this area. First, we are collecting objectively observable information such as surface electromyography and electroencephalography to digitize the skills of professional athletes and craftspeople. Based on this information, we are studying "Motor-skill-transfer technology," in which electrical stimulation is applied to muscles and transmitted directly to the person; in the second, we are studying "Embodied-knowledge technology," which extracts characteristic physical movements to digitize the person's senses.

Our Human Information Laboratories aim to create user experiences that take advantage of the unique characteristics of remote work. We are researching technologies that extend human capabilities to enhance the remote work experience. In addition, we aim to connect real space with cyberspace to create new user experiences, focusing on remote education for musical instruments and sports. Instruction is generally conducted in the real world, where skills and physical techniques are taught directly from person to person. Our goal is to extend human capabilities by making it possible to transfer skills regardless of time and place.

Toward this end, we are researching methods of transferring motor skills and embodied knowledge. For the former, we are collecting objectively observable information using techniques such as surface electromyography and electroencephalography to digitize the skills of professional athletes and experts. On the basis of this information, we are investigating the application of electrical stimulation to the muscles as a technology for motor skill transfer. For embodied-knowledge technology, we are studying ways of extracting characteristics of physical movements to digitize a person's sensations.



Research

  1. Motor-skill-transfer technology
  2. Embodied-knowledge technology

Publications

2023

2022

2021

2023

Journal Papers

-Motor-skill-transfer technology-

  1. Arinobu Niijima, Mana Sasagawa, Texture Profile Analysis of Pseudo Food Texture Display by Jamming, Transactions of the Virtual Reality Society of Japan, 2023, Vol. 28, Issue 1, p. 3-10
  2. K. Eguchi and R. Aoki, "Practical R-R Interval Editing for Heart Rate Variability Analysis Using Single-Channel Wearable ECG Devices," in IEEE Access, vol. 11, pp. 25543-25582, 2023, doi: 10.1109/ACCESS.2023.3253933.
  3. Shindo M, Isezaki T, Koike Y, Aoki R (2023) Induced effects of electrical muscle stimulation and visual stimulation on visual sensory reweighting dynamics during standing on a balance board. PLoS ONE 18(5): e0285831. https://doi.org/10.1371/journal.pone.0285831

Conference Papers

-Motor-skill-transfer technology-

  1. Arinobu Niijima and Yuki Kubo. 2023. Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle Stimulation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI '23). Association for Computing Machinery, New York, NY, USA, Article 743, 1–13. https://doi.org/10.1145/3544548.3581192
  2. Masato Shindo and Arinobu Niijima. 2023. Standing Balance Improved by Electrical Muscle Stimulation to Popliteus Muscles. In Proceedings of the Augmented Humans International Conference 2023 (AHs '23). Association for Computing Machinery, New York, NY, USA, 27–34. https://doi.org/10.1145/3582700.3582711

2022

Journal Papers

-Motor-skill-transfer technology-

  1. Arinobu Niijima, Ryosuke Aoki, Diminished Grip Force from Superimposed Electrical Stimulation on Muscle Coordination, Transactions of the Virtual Reality Society of Japan, 2022, Vol. 27, Issue 3, p. 167-172

Conference Papers

-Motor-skill-transfer technology-

  1. Arinobu Niijima, Toki Takeda, Ryosuke Aoki, and Shinji Miyahara. 2022. Muscle Synergies Learning with Electrical Muscle Stimulation for Playing the Piano. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22). Association for Computing Machinery, New York, NY, USA, Article 54, 1-10. https://doi.org/10.1145/3526113.3545666
  2. Shiina Takano and Arinobu Niijima. 2022. Involuntary Exhalation Control by Facial Vibration. In Adjunct Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology (UIST ’22 Adjunct). Association for Computing Machinery, New York, NY, USA, Article 7, 1-3.https://doi.org/10.1145/3526114.3558693
  3. Yuki Kubo. 2022. Ring-type Indirect Pointing Device for Large Displays using Three-axis Pressure Sensor. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 33, 1-2. https://doi.org/10.1145/3565970.3568185

-Embodied-knowledge technology-

  1. Shoichiro Takeda, Kenta Niwa, Mariko Isogawa, Shinya Shimizu, Kazuki Okami, Yushi Aono, Bilateral Video Magnification Filter, The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 17369-17378

Awards

  1. Best Poster Award, Yuki Kubo. 2022. Ring-type Indirect Pointing Device for Large Displays using Three-axis Pressure Sensor. In Proceedings of the 2022 ACM Symposium on Spatial User Interaction (SUI ’22). Association for Computing Machinery, New York, NY, USA, Article 33, 1–2. https://doi.org/10.1145/3565970.3568185

2021

Journal Papers

-Motor-skill-transfer technology-

  1. Arinobu Niijima, Toki Takeda, Kentaro Tanaka, Ryosuke Aoki, and Yukio Koike. 2021. Reducing Muscle Activity when Playing Tremolo by Using Electrical Muscle Stimulation to Learn Efficient Motor Skills. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 3, Article 123 (Sept 2021), 17 pages. https://doi.org/10.1145/3478110

Conference Papers

-Motor-skill-transfer technology-

  1. A. Niijima, “Posture Feedback System with Wearable Speaker,” 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mexico, 2021, pp. 7007-7010, doi: 10.1109/EMBC46164.2021.9630687.
  2. T. Isezaki, R. Aoki and Y. Koike, “Correction of Electrodes ID Configuration based on the Distribution of Surface EMG Features,” 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mexico, 2021, pp. 7083-7086, doi: 10.1109/EMBC46164.2021.9629817.
  3. M. Shindo, T. Isezaki, R. Aoki and Y. Koike, “Force Control on Fingertip Using EMS to Maintain Light Touch,” 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), Mexico, 2021, pp. 4641-4644, doi: 10.1109/EMBC46164.2021.9630237.
  4. Arinobu Niijima and Yuki Kubo. 2021. Assisting with Voluntary Pinch Force Control by Using Electrical Muscle Stimulation and Active Bio-Acoustic Sensing. In Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST ’21 Adjunct). Association for Computing Machinery, New York, NY, USA, 11-13. https://doi.org/10.1145/3474349.3480214