{"id":428876,"date":"2025-12-06T13:39:22","date_gmt":"2025-12-06T13:39:22","guid":{"rendered":"https:\/\/www.europesays.com\/us\/428876\/"},"modified":"2025-12-06T13:39:22","modified_gmt":"2025-12-06T13:39:22","slug":"ut-dallas-researchers-turn-everyday-objects-into-augmented-reality-keyboards-dallas-innovates","status":"publish","type":"post","link":"https:\/\/www.europesays.com\/us\/428876\/","title":{"rendered":"UT Dallas Researchers Turn Everyday Objects into Augmented Reality Keyboards \u00bb Dallas Innovates"},"content":{"rendered":"

\"\"<\/p>\n

Computer science doctoral student Daniel Honrales demonstrates PropType, a patent-pending technology that overlays an augmented keyboard surface onto handheld objects. [Photo: UTD]<\/p>\n

Virtual keyboards are one of the biggest pain points in augmented reality. They\u2019re slow, they\u2019re awkward, and holding your arm up to type in midair gets tiring fast. A UT Dallas team thinks they\u2019ve found a better way. The researchers said improving text input could help make AR more practical for everyday and professional use.<\/strong><\/p>\n

Researchers in the Erik Jonsson School of Engineering and Computer Science have developed a new AR interface called PropType that lets users turn everyday objects, like a coffee mug, book, or water bottle, into typing surfaces. The patent-pending technology overlays an augmented keyboard onto a handheld object and adapts to different shapes, including curved ones.<\/p>\n

\u201cBy integrating objects already present in the user\u2019s surroundings, PropType reimagines text input in AR, creating a seamless connection between the physical and virtual worlds,\u201d said Jin Ryong Kim, assistant professor of computer science. \u201cPropType capitalizes on the tactile feedback provided by the objects themselves, offering better key confirmation and reducing reliance on visual cues.\u201d<\/p>\n

A more natural way to type in AR<\/strong><\/p>\n

Student researchers in Kim\u2019s Multimodal Interaction Lab created a video showing PropType in action across several objects. The team said the goal is to offer an option that feels more intuitive than virtual keyboards or external physical ones, which can break the immersive experience.<\/p>\n

\u201cPropType leverages the familiarity of handheld objects to offer a more intuitive and accessible alternative to traditional keyboards, particularly in mobile or hands-free scenarios where conventional input methods are impractical,\u201d Kim said.<\/p>\n

The team studied how people naturally hold and interact with different objects. They observed 16 participants to understand grab postures and typing gestures, then designed custom keyboard layouts for each object type. The prototype also includes an editing tool so users can adjust layouts and visual effects.<\/p>\n

PropType earned a Best Paper<\/a> Honorable Mention Award in April at the ACM CHI Conference on Human Factors in Computing Systems in Yokohama, Japan, and was later featured at the ACM Symposium on User Interface Software and Technology in Busan, South Korea.<\/p>\n

Touch in virtual worlds<\/strong><\/p>\n

PropType builds on Kim\u2019s broader research in haptics, a field that examines how touch, temperature, and physical feedback can make digital systems feel more lifelike. His team has earned national and international recognition for work ranging from thermal-tactile integration to thermal masking, a phenomenon that tricks the brain into feeling heat or cold in a different location than where the sensation is produced.<\/p>\n

\u201cTouch carries a lot of information; it\u2019s another form of communication that is underexplored in virtual and augmented reality,\u201d Kim said.<\/p>\n

The lab\u2019s work on thermal masking, presented at the 2024 ACM CHI Conference, demonstrates how vibrations and heat can be combined to influence sensation. Kim said the research could eventually support more immersive interfaces for virtual reality, medical simulation, and other applications.<\/p>\n

Kim\u2019s co-authors on the PropType project include Hyunjae Gil, former UTD postdoctoral researcher and now assistant professor at the Daegu Gyeongbuk Institute of Science and Technology; Iniyan Joseph; and Ashish Pratap, a computer science doctoral student. The work was supported by a grant from the Institute of Information & Communications Technology Planning & Evaluation of South Korea.<\/p>\n

Don\u2019t miss what\u2019s next. Subscribe\u00a0to\u00a0Dallas\u00a0Innovates.<\/p>\n

Track Dallas-Fort Worth\u2019s business and innovation landscape with our curated news in your inbox Tuesday-Thursday.<\/p>\n

\u00a0<\/p>\n

\tR E A D\u00a0\u00a0 N E X T\t<\/p>\n