Seamless Avatar Sync for Immersive Metaverse Experiences
Smooth Avatar-User Synchronization for the Metaverse
Tags: Singapore University of Technology and Design, Singapore, Consumer Goods & Services, Computing Technology
SUTD researchers have developed a framework to optimize avatar-user synchronization for the metaverse, ensuring smooth, real-time interaction by using semantic communications and contest theory. By focusing on human pose estimation (HPE), the system reduces data payloads from megabytes to bytes, allowing efficient motion encoding without unnecessary background data. Applications include virtual reality environments in fields like healthcare, education, and marketing. A deep Q-network (DQN) algorithm minimizes latency across all users, achieving a 66% improvement in lag. The result is a highly immersive experience, with adaptive resource allocation based on user activity levels.
IP Type or Form Factor: Software & Algorithm
TRL: 3 - proof of concept with needs validated
Industry or Tech Area: Virtual & Augmented Reality; Computing Databases & Storage
