[go: up one dir, main page]

Buldu et al., 2025 - Google Patents

Cuify the xr: An open-source package to embed llm-powered conversational agents in xr

Buldu et al., 2025

View PDF
Document ID
1447370911497472434
Author
Buldu K
Özdel S
Lau K
Wang M
Saad D
Schönborn S
Boch A
Kasneci E
Bozkir E
Publication year
Publication venue
2025 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)

External Links

Snippet

Recent developments in computer graphics, machine learning, and sensor technologies enable numerous opportunities for extended reality (XR) setups for everyday life, from skills training to entertainment. With large corporations offering affordable consumer-grade head …
Continue reading at arxiv.org (PDF) (other versions)

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for programme control, e.g. control unit
    • G06F9/06Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/44Arrangements for executing specific programmes
    • G06F9/4443Execution mechanisms for user interfaces
    • G06F9/4445Remote windowing, e.g. X-Window System, desktop virtualisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for programme control, e.g. control unit
    • G06F9/06Arrangements for programme control, e.g. control unit using stored programme, i.e. using internal store of processing equipment to receive and retain programme
    • G06F9/44Arrangements for executing specific programmes
    • G06F9/455Emulation; Software simulation, i.e. virtualisation or emulation of application or operating system execution engines
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B23/00Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
    • G09B23/28Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
    • G09B23/285Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F17/00Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/20Handling natural language data
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/38Implementation of user interfaces
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00Electrically-operated educational appliances
    • G09B5/02Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Preventing errors by testing or debugging software
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06QDATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for a specific business sector, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education

Similar Documents

Publication Publication Date Title
Hepperle et al. 2D, 3D or speech? A case study on which user interface is preferable for what kind of object interaction in immersive virtual reality
Dünser et al. Evaluating augmented reality systems
Hartholt et al. All together now: Introducing the virtual human toolkit
Giunchi et al. Dreamcodevr: Towards democratizing behavior design in virtual reality with speech-driven programming
CN111429907B (en) Voice service mode switching method, device, equipment and storage medium
KR20220129989A (en) Avatar-based interaction service method and device
US20220301250A1 (en) Avatar-based interaction service method and apparatus
Buldu et al. Cuify the xr: An open-source package to embed llm-powered conversational agents in xr
Hartholt et al. Ubiquitous virtual humans: A multi-platform framework for embodied ai agents in xr
Marini et al. A natural interaction system for medical training through VR technology
Huang et al. Design dimensions for holographic intelligent agents: A comparative analysis
Hameed et al. A holistic quality taxonomy for virtual reality experiences
Rahimi et al. Generative AI Meets Virtual Reality: A Comprehensive Survey on Applications, Challenges, and Future Direction
Inamura et al. Competition design to evaluate cognitive functions in human-robot interaction based on immersive VR
Xing et al. sMoRe: Enhancing Object Manipulation and Organization in Mixed Reality Spaces with LLMs and Generative AI
Zhang Immersive AI-Powered Language Learning Experience in Virtual Reality: A Gamified Environment for Japanese Learning
Hasan et al. Smart virtual dental learning environment
Martens Virtually usable: A review of virtual reality usability evaluation methods
Stedmon et al. Developing speech input for virtual reality applications: A reality based interaction approach
Dongas Special Session—Designing Virtual Learning Experiences: Iterating Immersive Environments
Lorenzoni et al. Virtual Reality and Conversational Agents for Cultural Heritage Engagement
Pratama et al. Increasing the effectiveness of electronic physics learning by utilizing extended reality and smart virtual technology assistant as interactive media
Panëels et al. HITPROTO: a tool for the rapid prototyping of haptic interactions for haptic data visualization
Cai et al. AtomXR: Streamlined XR Prototyping with Natural Language and Immersive Physical Interaction
Jaya Sudha et al. VR Classroom for Interactive and Immersive Learning with Assessment of Students Comprehension