Zoom: https://illinois.zoom.us/j/89460855251?pwd=1WmjMXGRIfUBPcgIHwbyZLA066ofnb.1
Abstract:
Extended Reality (XR) technologies, demonstrated by advanced devices like Meta Quest and Apple Vision Pro, hold immense potential to redefine the ultimate computing device. However, its widespread adoption faces significant challenges, including high equipment costs, complex and inaccurate input methods, poor integration with other devices, challenges in producing high-quality content, and a lack of clear core application scenarios.
In this presentation, I will outline my research efforts aimed at overcoming these challenges in XR technologies. This presentation will begin with the Holokit project, which leverages open-source tools to reduce equipment costs and has made notable social impacts. I will then discuss my research on enhancing the integration of mobile devices with XR,covering advancements in integration technologies, design frameworks, and digital context understanding for real-world applications. Lastly, this talk will provide a brief overview of several ongoing research projects that investigate the role of LLMs in supporting the development of XR technologies in production settings and broadening the scope of ubiquitous computing.
Bio:
Fengyuan Zhu is a Ph.D. candidate in Computer Science at the University of Toronto, supervised by Tovi Grossman. His doctoral research focuses on integrating mobile devices with Extended Reality to enrich digital experiences and improve input precision, and applying Generative AI within spatial environments. He has conducted research at Google, NVIDIA, and is an alumnus of Tsinghua’s Future Lab. Prior to his doctoral studies, he earned a master’s degree in Interactive Arts from New York University, and a bachelors’ degree in Physics from Peking University. His academic contributions have appeared in ACM SIGCHI, ACM UIST, IEEE ISMAR, and IEEE VR, and his artworks have been featured in media outlets such as TechCrunch, Forbes, and The New York Times.
Faculty Host: Ranjitha Kumar/Eric Shaffer
Meeting ID: 894 6085 5251; Password: csillinois