Publications

Conference Paper

2022

1. Haptics

   HeadWind: Enhancing Teleportation Experience in VR by Simulating Air Drag during Rapid Motion

   Chun-Miao Tseng, Po-Yu Chen, Shih Chin Lin, Yu-Wei Wang,  Yu-Hsin Lin, Mu-An Kuo, Neng-Hao Yu, and Mike Y. Chen

   In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

   Abs Open Access

   Teleportation, which instantly moves users from their current location to the target location, has become the most popular locomotion technique in VR games. It enables fast navigation with reduced VR sickness but results in significantly reduced immersion. We present HeadWind, a novel approach to improve the experience of teleportation by simulating the haptic sensation of air drag when rapidly moving through the air in real life. Specifically, HeadWind modulates bursts of compressed air to the face and uses multiple nozzles to provide directional cues. To design the wearable device and to model airflow speed and duration for teleportation, we conducted three formative studies and a design session. User experience evaluation with 24 participants showed that HeadWind significantly improved realism, immersion, and enjoyment of teleportation in VR (p<.01) with large effect sizes (r>0.5), and was preferred by 96% of participants.

2. CMC

   Because I’m Restricted, 2 – 4 PM Unable to See Messages: Exploring Users’ Perceptions and Likely Practices around Exposing Attention Management Use on IM Online Status

   Yu-Ling Chou, Yu-Ling Chien,  Yu-Hsin Lin, Kung-Pai Lin, Faye Shih, and Yung-Ju Chang

   In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

   Abs Open Access

   Attention-management tools can restrict online communication, but may cause collateral damage to their users’ fulfillment of communication expectations. This paper explores the idea of integrating attention management into instant messaging (IM), by 1) disclosing restriction status via an online status indicator (OSI) to manage contacts’ expectations, and 2) imposing communication limits to reduce communication distraction. We used a speed-dating design method to allow 43 participants to rapidly compare 48 types of OSI restriction in various conversational contexts. We identified two “tug-of-wars” that take place when attention management is integrated into IM apps: one between fulfilling one’s contacts’ expectations and protecting one’s own attention, and the other, between protecting one’s privacy and asserting the justifiability of using communication restrictions. We also highlighted the participants’ desire to be diplomatic for sustaining their positive images and maintaining relational connectedness. Finally, we provide design recommendations for integrating attention management into IM apps.

2021

1. DevTools

   HapticSeer: A Multi-Channel, Black-Box, Platform-Agnostic Approach to Detecting Video Game Events for Real-Time Haptic Feedback

   Yu-Hsin Lin, Yu-Wei Wang, Pin-Sung Ku, Yun-Ting Cheng, Yuan-Chih Hsu, Ching-Yi Tsai, and Mike Y. Chen

   In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

   Abs Open Access

   Haptic feedback significantly enhances virtual experiences. However, supporting haptics currently requires modifying the codebase, making it impractical to add haptics to popular, high-quality experiences such as best selling games, which are typically closed-source. We present HapticSeer, a multi-channel, black-box, platform-agnostic approach to detecting game events for real-time haptic feedback. The approach is based on two key insights: 1) all games have 3 types of data streams: video, audio, and controller I/O, that can be analyzed in real-time to detect game events, and 2) a small number of user interface design patterns are reused across most games, so that event detectors can be reused effectively. We developed an open-source HapticSeer framework and implemented several real-time event detectors for commercial PC and VR games. We validated system correctness and real-time performance, and discuss feedback from several haptics developers that used the HapticSeer framework to integrate research and commercial haptic devices.

   🏆 Honorable Mention Award
2. Haptics

   JetController: High-Speed Ungrounded 3-DoF Force Feedback Controllers Using Air Propulsion Jets

   Yu-Wei Wang,  Yu-Hsin Lin, Pin-Sung Ku, Yōko Miyatake, Yi-Hsuan Mao, Po Yu Chen, Chun-Miao Tseng, and Mike Y. Chen

   In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

   Abs Open Access

   JetController is a novel haptic technology capable of supporting high-speed and persistent 3-DoF ungrounded force feedback. It uses high-speed pneumatic solenoid valves to modulate compressed air to achieve 20-50Hz of full impulses at 4.0-1.0N, and combines multiple air propulsion jets to generate 3-DoF force feedback. Compared to propeller-based approaches, JetController supports 10-30 times faster impulse frequency, and its handheld device is significantly lighter and more compact. JetController supports a wide range of haptic events in games and VR experiences, from firing automatic weapons in games like Halo (15Hz) to slicing fruits in Fruit Ninja (up to 45Hz). To evaluate JetController, we integrated our prototype with two popular VR games, Half-life: Alyx and Beat Saber, to support a variety of 3D interactions. Study results showed that JetController significantly improved realism, enjoyment, and overall experience compared to commercial vibrating controllers, and was preferred by most participants.

3. DevTools

   Game Illusionization: A Workflow for Applying Optical Illusions to Video Games

   Po-Yao (Cosmos) Wang, Cong-He Xu, Ping-Yi Wang, Hsin-Yu Huang, Yu-Wei Chang, Jen-Hao Cheng,  Yu-Hsin Lin, and Lung-Pan Cheng

   In The 34th Annual ACM Symposium on User Interface Software and Technology

   Abs Open Access

   Optical illusions have been brought into recent video games to enhance gaming experiences. However, a large corpus of optical illusions remains unused, while few games incorporate illusions seamlessly. To mitigate the gap, we propose a workflow to guide game designers in applying optical illusions to their video games, i.e., in making more illusion games. In particular, our workflow consists of 5 stages: (1) choosing a game object, (2) searching for a matching illusion, (3) selecting an illusion mechanic, (4) integrating the selected illusion into the game, and (5) optionally revealing the illusion. To facilitate our workflow, we provide a tag database with 163 illusions that are labeled by their in-game visual elements and desired effects. We also provide example editing interfaces of 6 illusions for game designers. We walk through our workflow and showcase 6 resulting illusion games. We implemented these 6 games (with and without illusion) and conducted a 12-participant study to gain a preliminary understanding of how illusions enhance gaming experiences. To evaluate our workflow, we invited 6 game designers and 6 experienced players to follow our workflow and design their own illusion games, where 3 experienced game designers completed 2-week in-depth developments. We report their games, qualitative feedback and discuss reflection on our workflow, database and editing interfaces.

2020

1. Haptics

   HeadBlaster: A Wearable Approach to Simulating Motion Perception Using Head-Mounted Air Propulsion Jets

   Shi-Hong Liu, Pai-Chien Yen, Yi-Hsuan Mao,  Yu-Hsin Lin, Erick Chandra, and Mike Y. Chen

   ACM Trans. Graph.

   Abs Open Access

   We present HeadBlaster, a novel wearable technology that creates motion perception by applying ungrounded force to the head to stimulate the vestibular and proprioception sensory systems. Compared to motion platforms that tilt the body, HeadBlaster more closely approximates how lateral inertial and centrifugal forces are felt during real motion to provide more persistent motion perception. In addition, because HeadBlaster only actuates the head rather than the entire body, it eliminates the mechanical motion platforms that users must be constrained to, which improves user mobility and enables room-scale VR experiences. We designed a wearable HeadBlaster system with 6 air nozzles integrated into a VR headset, using compressed air jets to provide persistent, lateral propulsion forces. By controlling multiple air jets, it is able to create the perception of lateral acceleration in 360 degrees. We conducted a series of perception and human-factor studies to quantify the head movement, the persistence of perceived acceleration, and the minimal level of detectable forces. We then explored the user experience of HeadBlaster through two VR applications: a custom surfing game, and a commercial driving simulator together with a commercial motion platform. Study results showed that HeadBlaster provided significantly longer perceived duration of acceleration than motion platforms. It also significantly improved realism and immersion, and was preferred by users compared to using VR alone. In addition, it can be used in conjunction with motion platforms to further augment the user experience.

2. Ubicomp

   StrengthGaming: Enabling Dynamic Repetition Tempo in Strength Training-Based Exergame Design

   Sih-Pin Lai, Cheng-An Hsieh,  Yu-Hsin Lin, Teepob Harutaipree, Shih-Chin Lin, Yi-Hao Peng, Lung-Pan Cheng, and Mike Y. Chen

   In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

   Abs Open Access

   Strength training improves overall health, well-being, physical appearance, and sports performance, with training programs specifying variables such as sets, repetitions, rest time, weight, and tempo. The repetitive nature of strength training, typically performed at fixed tempo, has made it challenging to develop entertaining exergames for common strength training exercises. We present StrengthGaming, which uses scaling and shuffling technique to provide tempo variations to strength training while preserving the training volume and training goals. It affords game designers more flexibility in designing strength training-based exergames. We developed a prototype game, inspired by FlappyBird, that uses a wearable orientation sensor to track the repetition tempo to control a flying character, using both fixed tempo design and dynamic tempo design. Results from our 24-person user study showed that dynamic tempo was significantly more entertaining than fixed tempo (p<0.01), and was preferred by participants.

Demo & EA

2021

1. Haptics

   Demonstration of JetController: High-Speed Ungrounded Force Feedback Controllers Using Air Propulsion Jets

   Yu-Wei Wang,  Yu-Hsin Lin, Pin-Sung Ku, Yōko Miyatake, Po-Yu Chen, Chun-Miao Tseng, Ching-Yi Tsai, and Mike Y. Chen

   In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems

   Abs Open Access

   JetController is a novel haptic technology capable of supporting high-speed and persistent 3-DoF ungrounded force feedback. It uses high-speed pneumatic solenoid valves to modulate compressed air to achieve 20-50Hz of full impulses at 4.0-1.0N and combines multiple air propulsion jets to generate 3-DoF force feedback. Compared to propeller-based approaches, JetController is more than 10 times faster in impulse frequency, and its handheld device is significantly lighter and more compact. JetController supports a wide range of haptic events in games and VR experiences, from firing automatic weapons in games like Halo to cutting fruits in Fruit Ninja. To discuss the differences between JetController and vibrotactile feedback approaches, we designed a new prototype based on PS5 Controller, DualSense [1]. There are three haptic approaches in our demonstration, JetController, Adaptive Trigger, and regular vibration feedback. We provide two scenarios, driving with tactile (surface texture) feedback and shooting with recoil feedback.

2. Haptics

   JetController: High-Speed Ungrounded 3-DoF Force Feedback Controllers Using Air Propulsion Jets

   Yu-Wei Wang,  Yu-Hsin Lin, Yoko Miyatake, Ching-Yi Tsai, Pin-Sung Ku, and Mike Y. Chen

   In ACM SIGGRAPH 2021 Labs

   Abs Open Access

   JetController is a novel high-speed, persistent 3-DoF ungrounded force feedback controller. It uses high-speed pneumatic solenoid valves to modulate compressed air to achieve full impulses of 50Hz at 1.0N (20Hz at 4.0N), and combines multiple air propulsion jets to generate 3-DoF ungrounded force feedback. Compared to propeller-based approaches, JetController supports 10-30 times faster impulse frequency, and its handheld device is significantly lighter and more compact. JetController enables a wide range of haptic events in games and VR experiences, from firing automatic weapons in games like Halo (15Hz) to slicing fruits in Fruit Ninja in 3-DoF (up to 45Hz). To demonstrate JetController, we integrated our prototype with two best-selling VR games, Half-life: Alyx and Fruit Ninja VR, to highlight a variety of 3-DoF interactions that were not possible before.

2020

1. Haptics

   StrengthGaming: Enabling Dynamic Repetition Tempo in Strength Training-Based Exergame Design

   Sih-Pin Lai, Cheng-An Hsieh,  Yu-Hsin Lin, Teepob Harutaipree, Shih Chin Lin, Yi-Hao Peng, Lung-Pan Cheng, and Mike Y. Chen

   In 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services

   Abs Open Access

   Strength training improves overall health, well-being, physical appearance, and sports performance, with training programs specifying variables such as sets, repetitions, rest time, weight, and tempo. The repetitive nature of strength training, typically performed at fixed tempo, has made it challenging to develop entertaining exergames for common strength training exercises. We present StrengthGaming, which uses scaling and shuffling technique to provide tempo variations to strength training while preserving the training volume and training goals. We developed a prototype game, inspired by FlappyBird, that uses a wearable orientation sensor to track the repetition tempo to control a flying character, using both fixed tempo design and dynamic tempo design.