Movatterモバイル変換

[0]ホーム
URL:

Skip to main content

Advertisement

Springer Nature Link
Log in

Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR

  • Conference paper
  • First Online:
Haptic Interaction(AsiaHaptics 2022)

Part of the book series:Lecture Notes in Computer Science ((LNCS,volume 14063))

Included in the following conference series:

  • 278Accesses

Abstract

Haptic interaction is a fundamental approach to our perception surrounding people; at this stage, haptic interaction is mainly used in virtual reality (VR) and remote medical procedures (teleoperation). The traditional large volume, complex operation seriously affects the function of immersive. This paper develops a multi-modal sensing interactive glove system for teleoperation and VR/AR. The device is small in size and convenient to wear; we integrate temperature sensing and tactile sensing into our glove system and deliver real-time and accurate environmental signals to the wearer through the acquisition and processing of information and program-controlled regulation to better realize the fusion of virtual and real. This paper first introduces the structure and working principle of the system and analyzes its performance. Then a sensory experiment based on human hand skin was designed, and volunteers were selected to experience it.

This paper is supported by the National Key Research and Development Program of China (2021YFF0600203); the Zhejiang Provincial Natural Science Foundation (LY20F020019, LQ19F020012, LQ20F020001); the Zhejiang Basic Public Welfare Research Project (LGF19E050005); the Major Scientific Research Project of the Zhejiang Laboratory (2019MC0AD01, 2022MG0AC04).

This is a preview of subscription content,log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 7435
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 9294
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Similar content being viewed by others

References

  1. Wang, D., Guo, Y., Liu, S., Zhang, Y., Xiao, J.: Haptic display for virtual reality: progress and challenges. Virtual Real. Intell. Hardware1(2), 136–162 (2019)

    Article  Google Scholar 

  2. Niedenthal, S., P Lundén, Ehrndal, M., Olofsson, J.: A handheld olfactory display for smell-enabled VR games. In: IEEE International Symposium on Olfaction and Electronic Nose, pp. 1–4 (2019)

    Google Scholar 

  3. Narumi, T., Kajinami, T., Nishizaka, S., Tanikawa, T., Hirose, M.: Pseudo-gustatory display system based on cross-modal integration of vision, olfaction and gustation. In: 2011 IEEE Virtual Reality Conference (VR), pp. 127–130 (2011)

    Google Scholar 

  4. Cheng-jun, D., Ping, D., Ming-lu, Z., Yan-fang, Z.: Design of mobile robot teleoperation system based on virtual reality. In: 2009 IEEE International Conference on Automation and Logistics, pp. 2024–2029 (2009)

    Google Scholar 

  5. Verna, D.: Virtual reality and tele-operation: a common framework. In: World Multiconference on Systemics, Cybernetics and Informatics (SCI 2001) v.3: Emergent Computing and Virtual Engineering, pp. 499–504 (2001)

    Google Scholar 

  6. Tamura, Y., Fujiwara, S., Umetani, T., Nakamura, H.: Bracelet-shaped thermal display for representing numerical data. J. Electron. Mater.40(5), 823–829 (2011)

    Article  Google Scholar 

  7. Ho, H. N., Jones, L. A.: Thermal model for hand-object interactions. Haptic interfaces for virtual environment and teleoperator systems, pp. 461–467(2006)

    Google Scholar 

  8. Simon, G., Giulio, R., Laura, S. C., Tristan, V., Olaf, B., Hannes, B.: Encoded and crossmodal thermal stimulation through a fingertip-sized haptic display. Front. Robot. AI2(25) (2015)

    Google Scholar 

  9. Kato, F., Inoue, Y., Tachi, S.: Haptic display glove capable of force/vibration/temperature. In: 2019 IEEE International Symposium on Measurement and Control in Robotics (ISMCR), D2–2 (2019)

    Google Scholar 

  10. Tachi, S., Mlnamlzawa, K., Furukawa, M., Fernando, C.L.: Haptic media construction and utilization of human-harmonized “tangible” information environment. In: International Conference on Artificial Reality & Telexistence, pp. 145–150 (2013)

    Google Scholar 

  11. Gabardi, M., Leonardis, D., Solazzi, M., Frisoli, A.: Development of a miniaturized thermal module designed for integration in a wearable haptic device. In: 2018 IEEE Haptics Symposium (HAPTICS), pp. 100–105 (2018)

    Google Scholar 

  12. Murakami, T., Person, T., Fernando, C.L., Minamizawa, K.: Altered touch: miniature haptic display with force, thermal and tactile feedback for augmented haptics. In: ACM SIGGRAPH 2017 Emerging Technologies, pp. 1–2 (2017)

    Google Scholar 

  13. Watanabe, T., Fukui, S.: A method for controlling tactile sensation of surface roughness using ultrasonic vibration. In: Proceedings of 1995 IEEE International Conference on Robotics and Automation, pp. 1134–1139 (1995)

    Google Scholar 

  14. Elhajj, I., et al.: Haptic information in internet-based teleoperation. Trans. Mechatron. IEEE/ASME6(3), 295–304 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Faculty of Mechanical Engineering and Automation, Zhejiang Sci-Tech University, Hangzhou, 310018, China

    Xinwei Yao & Ming Chen

  2. Research Center for Humanoid Sensing, Zhejiang Lab, Hangzhou, 311121, China

    Chuan Cao, Lei Zhang & Wenzhen Yang

  3. School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, 210044, China

    Mukherjee Mithun

  4. The State Key Laboratory of CAD & CG, Zhejiang University, Hangzhou, 310027, China

    Hujun Bao

Authors
  1. Xinwei Yao

    You can also search for this author inPubMed Google Scholar

  2. Ming Chen

    You can also search for this author inPubMed Google Scholar

  3. Chuan Cao

    You can also search for this author inPubMed Google Scholar

  4. Lei Zhang

    You can also search for this author inPubMed Google Scholar

  5. Wenzhen Yang

    You can also search for this author inPubMed Google Scholar

  6. Mukherjee Mithun

    You can also search for this author inPubMed Google Scholar

  7. Hujun Bao

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence toWenzhen Yang.

Editor information

Editors and Affiliations

  1. Beihang University, Beijing, China

    Dangxiao Wang

  2. Southeast University, Nanjing, China

    Aiguo Song

  3. Dalian University of Technology, Dalian, China

    Qian Liu

  4. Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Ki-Uk Kyung

  5. Tohoku University, Sendai, Japan

    Masashi Konyo

  6. The University of Electro-Communications, Tokyo, Tokyo, Japan

    Hiroyuki Kajimoto

  7. Peking University, Beijing, China

    Lihan Chen

  8. Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Korea (Republic of)

    Jee-Hwan Ryu

Rights and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yao, X.et al. (2023). Multi-modal Sensing-Based Interactive Glove System for Teleoperation and VR/AR. In: Wang, D.,et al. Haptic Interaction. AsiaHaptics 2022. Lecture Notes in Computer Science, vol 14063. Springer, Cham. https://doi.org/10.1007/978-3-031-46839-1_15

Download citation

Publish with us

Access this chapter

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
JPY 3498
Price includes VAT (Japan)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
JPY 7435
Price includes VAT (Japan)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
JPY 9294
Price includes VAT (Japan)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide -see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

[8]ページ先頭
©2009-2025 Movatter.jp