WO2025255689A1 - Immersive simulation system for assessing hearing loss - Google Patents

Abstract

The present invention relates to an immersive simulation system for assessing a user or patient's level of hearing loss, comprising: a) an element for transmitting 3D spatial sound for the simulation/immersion; b) an element for neutralising external sound; c) a head-tracking element; d) an immersive simulation element, to recreate live scenarios; e) a viewing element; and f) an eye-tracking system.

Description

IMMERSIVE SIMULATION SYSTEM FOR HEARING LOSS ASSESSMENT

DESCRIPTIVE MEMORANDUM

TECHNICAL FIELD OF THE INVENTION

The present invention relates to the field of virtual reality (VR) and augmented reality (AR) devices, and in general, refers to a simulated immersive system. Additionally, the immersive system of the present invention relates to an electronic transaction system and, more specifically, to an automated, self-guided point-of-sale kiosk to facilitate secure and efficient end-to-end interactions. These interactions encompass end-user registration, assessment of a user's condition or disability and recommended corrective alternatives, comparison of potential devices/alternatives, simulated use of potential devices/alternatives, selection of the optimal device/solution, and purchase transaction for the selected device/alternatives. In particular, this simulated immersive system allows for a self-guided immersion experience, enabling the user to assess their condition, receive technical advice regarding their condition, try out, and purchase, all in one place, the device that best suits their needs.

BACKGROUND OF THE INVENTION

Today, there has been an increase in the incidence of people with visual, motor, and hearing disabilities, among others, due to lifestyle, diet, genetic predispositions, and environmental factors. Therefore, it is increasingly common to see people who, at an early age, have hearing or vision problems (which were formerly associated with older people).

This last point is also related to the growing market for online games and gaming accessories, where new generations spend a lot of time playing games online, with an excessive number of hours spent in front of a screen and connected with headphones at high volumes, therefore, the The accumulation of years of these practices deteriorates their vision and hearing, and therefore there is a greater incidence of increasingly younger people with vision and hearing problems.

In the case of people with hearing problems or disabilities, approximately 1.5 billion people worldwide live with hearing loss, and this number is expected to rise to 2.5 billion by 2050. And among young people, figures indicate that more than 1 billion young adults (between 12 and 35 years old) are at risk of hearing loss due to recreational exposure to loud noises. This corresponds to an estimated loss of $980 billion annually due to untreated hearing loss globally.

In this case, these individuals need to use some type of amplifier or hearing aid; or a medical hearing aid (coupled or not with a cochlear implant). Of these devices available on the market, some are: 1) over-the-counter; and 2) prescription (the same applies to vision devices, such as eyeglasses). However, obtaining or purchasing a hearing aid for a person with a hearing impairment often does not solve the problem, because:

• More than 40% of over-the-counter hearing aids are returned;

• More than 30% of over-the-counter hearing aids never activate; or

• The sound amplification is not enough and the customer prefers to keep something that "is bad", rather than have nothing.

In this sense, the market for over-the-counter devices is declining because:

• End users are buying the wrong device (people are confused and need guidance on what their specific need is and the ideal product that solves that need);

• The current end user cannot self-assess their condition (most conditions do not require medical intervention);

• The devices available on the market cannot be easily compared;

• The necessary solutions cannot be simulated in a real-world environment; • Retail channels do not have the expertise to help customers with complex needs;

• The solutions are expensive and difficult to differentiate;

• There is a limited selection of devices at a single point of purchase.

On the other hand, the traditional market for hearing aids (prescription required) for people with hearing disabilities also does not fully meet these needs, since:

• More than 50% of end users of prescription hearing aids for deafness do not seek hearing aid solutions.

• The traditional market focuses on elderly people (because this type of disability is associated with elderly people).

• There is an organic growth of between 5-7% age-related hearing loss.

• Comparing devices from one device to another is cumbersome and inconvenient for the user.

• The medical model is time-consuming, expensive, and unnecessary in 80% of cases.

• The average age of hearing aid candidates decreased from 71 to 62 years.

• Each year, the average age of a candidate with hearing loss is getting younger.

Another current solution, where users of these devices test their hearing aids, is through the use of "isolation booths" or "quiet rooms." However, these are outdated and obsolete testing methods, since the patient/user is not testing their hearing aids in a real-world environment (where there is a lot of ambient noise); they do not interact with other people or objects within a quiet room; and the way they hear stimuli in a room or booth conditioned for these tests differs greatly from the daily tasks faced by a person with a hearing impairment, who must be able to discriminate between different stimuli to know if the chosen hearing aid truly fits their daily life. However, each person with hearing loss has unique needs, requiring guidance to identify the right device. Purchasing a hearing aid off the market without the opportunity to test or experience its features is a significant problem. Consequently, a considerable proportion of hearing aids purchased this way are later returned.

Furthermore, traditional point-of-sale systems often focus on purchasing a product or device without understanding its inherent performance or benefits. There is a need for a system that guides the end user through a personalized requirements assessment, a comparison of devices/solutions compatible with their individual needs, and the ability to simulate performance before purchase.

Traditional disease assessments rely on manual, inconsistent (varying significantly from operator to operator and location to location), and time-consuming methods, processes, and human interactions. There is a need for a consistent, automated assessment system that eliminates operator variability, efficiently evaluates end-user ailments, streamlines the purchasing process, enhances the user experience, and provides secure transaction capabilities. Currently, no technology exists that allows end users to test the results produced by medical solutions in a real-life setting beforehand.

As previously stated, the growing market for online games and streaming platforms has given way to a growing industry of immersive experiences, virtual reality (VR) games, augmented reality (AR), which use artificial intelligence (AI) to simulate increasingly realistic experiences for users, through the use of gamer accessories and the internet of things (IoT), so that the user experiences the game in the most realistic way possible. However, this growing online gaming industry, which poses a health risk, has also become a great opportunity to use technology to help people. This can be achieved by developing new technologies that assist individuals with illnesses or disabilities, using simulated real-life environments to test products for these conditions.

Furthermore, these online video game platforms or systems have a buying and selling component (of video games), which represents another opportunity to develop a system that allows connecting several of these providers with patients who want to try different devices for their disability, without the need for the patient to go to each establishment, or each provider, one by one.

Systems that use virtual reality for disease simulation

The "Walk Through Dementia" app is a virtual reality application for Android smartphones that allows you to view everyday life through a new lens. The experience, which can also be viewed through the app or on YouTube, uses a combination of computer-generated environments and 360-degree video footage to illustrate in great detail how even the most mundane task of making a cup of tea can become a challenge for someone with dementia. Developed by Alzheimer's Research UK, guided by people living with different forms of dementia, the app allows users to experience everyday scenarios (via virtual reality), such as being in the supermarket, while experiencing the symptoms of the disease. From sensory overload to changes in food preferences, the app effectively highlights the reality of living with dementia. (Alzheimer's Research UK). However, this app does not represent a system; nor does it indicate that it allows multiple providers to connect with a patient to test medical devices for clinical conditions or disabilities.

The granted patent ES 2928091 T3 discloses methods and/or systems for the diagnosis, monitoring and/or treatment of people at risk of falls and/or other pathological conditions. In an exemplary embodiment of the invention, individuals are diagnosed before they actually begin to fall. Optionally, the diagnosis includes testing and identifying one or more fall triggers using virtual reality tools. Optionally or alternatively, the treatment includes training individuals using situations and/or triggers determined to be relevant to that individual. However, this document does not disclose a system that allows multiple providers to connect with a patient for the purpose of testing or purchasing medical devices.

Shopping systems with Virtual Reality

In granted patent US 10872322 B2, a method of online collaborative purchasing is disclosed comprising: initiating, by means of a first computing device, an online collaborative event through an application on a remote server, wherein the remote server provides a multimedia sharing environment to the first computing device and other remote computing devices, the multimedia sharing environment enabling real-time synchronized display of data on the first computing device and the other remote computing devices; displaying in response to the initiation by the first computing device, a collaborative display window, a communication tool that enables a first user of the first computing device to selectively communicate with other users of the respective other remote computing devices, and a display tool that enables the first user to selectively switch between a plurality of views in the collaborative display window, wherein each of the plurality of views is controlled by different components of the first computing device and the other remote computing devices of the multimedia sharing environment; to receive, by the first computing device, a selection of a first view from the plurality of views, wherein the first view is controlled by one of the other remote computing devices; to display, by means of the first computing device, a transmission of the first view from one of the other remote computing devices from the remote server in the display window in response to the selection of the first view, wherein the changes to the first view implemented by one of the other remote computing devices are displayed in the real-time display window. Virtual environments can be static images, dynamic backgrounds, three-dimensional or multidimensional environments, or any suitable combination thereof. In an exemplary embodiment, a dynamic background could include an animated sequence, a video, or a virtual reality experience. The entertainment module encompasses activities that allow the user to interact with and manipulate their model, animating it to perform various activities such as singing, dancing, etc., and using it to participate in games, augmented reality environments, and other activities. However, this patent does not include the same interaction as a system that connects multiple providers with a patient to test medical devices for conditions or disabilities.

Patent application WO 20077148248 A2 discloses a retail environment design system comprising: a computer environment; a virtual reality system operationally associated with the computer environment and configured to produce a virtual reality shopping environment based on at least one three-dimensional image of a shopping environment, including the three-dimensional image selected design elements from one or more store layouts, aisle configuration, aisle appearance, shelf arrangement, product display, and product placement on shelves; wherein the shopping environment includes a themed area and an activity-based product grouping; a design element modification tool configured to modify the design elements, thereby changing the virtual reality shopping environment; and a consumer response measurement tool configured to measure the responses of a user interacting with the virtual reality shopping environment. However, this application does not disclose a system that allows multiple providers to connect with a patient to test medical devices for conditions or disabilities.

There is also IN:SHOP technology, which uses blue-c 3D video technology to implement distributed shopping in a shared virtual world. IN:SHOP combines traditional purchasing and marketing structures with 3D computer graphics. Telepresence, spatially immersive displays, and online shopping paradigms are used to create a flexible and adaptable retail environment. The application enhances traditional physical shopping and the store itself. It redefines the experience and architecture of retail spaces. We implemented the concept of a high-end fashion boutique and a car dealership using two interconnected virtual reality rooms. However, IN:SHOP does not disclose the form of the device of the present invention, and while it allows for virtual reality shopping environments, IN:SHOP does not allow for connecting multiple providers with a patient to test medical devices for conditions or disabilities (Silke Lang et al. 2003).

However, all the aforementioned virtual reality technologies (both for simulating illnesses and as sales platforms) fall into the same problem as current virtual reality gaming systems: they are all for testing or selling their own products, and they do not allow for a triangulation between: being a space for diagnosis and testing; a sales platform; and a space for connection between different users, suppliers, and relevant actors for the diagnosis and advice of a patient in the purchase of a medical device (hearing aids, implants, prostheses, among others) for a person with a disability.

Other types of virtual reality devices for simulating sensory situations

Patent application CL 2022001356 discloses a system for performing virtual reality simulations of multiple surgeries for the training of healthcare professionals. The system comprises a mechanical interface housed in a suitcase for portability, which connects to a screen for simulating a surgical procedure. This mechanical interface includes two handles that simulate surgical forceps to enhance the user's sensory experience. The mechanical interface also contains an electronic system that connects to a screen to generate a visual interface. This visual interface includes graphics developed with motor skills exercises, cameras, and sensors that provide real-time information on the user's position and movement orientation. These cameras are housed in a virtual reality headset, and the sensors are integrated into the wristbands. These cameras and sensors are connected to software that generates a stereoscopic representation from the images captured by the cameras. This visual interface features three-dimensional objects with geometries similar to biological and surgical instruments. Furthermore, this system allows multiple providers to connect with a single patient for testing and purchasing medical devices.

The UltRASim device is an immersive simulator for ultrasound-guided regional anesthesia. Its development began with task and skill analysis conducted with domain experts to build a task model of the procedure and determine the simulator's learning objectives and design constraints. A face and content validity study was then conducted with eighteen anesthesiologists to evaluate the simulator prototype. However, UltRASim does not offer the same level of interaction as the system of the invention and does not allow multiple providers to connect with a single patient for testing medical devices for various conditions or disabilities (Simon et al. 2024).

Patent application WO 2022212906 A1 discloses a system for running on an augmented reality olfactory delivery engine for simulating odors, wherein the system comprises: a memory for storing instructions; an array of one or more processors; a machine-readable, non-transient storage medium providing instructions that, when executed by the array of one or more processors, are configurable to cause the system to perform operations comprising: acquiring data from a virtual scene through a data acquisition API based on one or more of: (i) positional information for an occupant, (ii) positional information for a virtual odor object, (iii) a desired odor index, and (iv) other environmental factors; determining an odor recipe for mixing one or more odors by means of an odor composer running on the olfactory delivery system; to issue instructions to an interconnected olfactometer to produce a mixture of odors by specifying a valve duty cycle and one or more odors to be dispersed according to the odor recipe determined by the composer of odors and an odor concentration; produce the odor mixture in the interconnected olfactometer by commanding the pneumatically connected valves through a manifold assembly to actuate according to the specified valve duty cycle; pressurize the odor mixture to form gas-phase molecules; direct the gas-phase molecules to separate channels by setting flow rates using a mass flow controller; combine the gas-phase molecules from the separate channels into a combined flow for dispensing from an olfactory mask; and dispense the gas-phase molecules into the olfactory mask, wherein the olfactory mask is configured to be attached to a human user participating as an occupant within the virtual scene through which the gas-phase molecules are dispensed through the olfactory mask to represent the human user's olfactory sensations corresponding to the virtual olfactory object within the virtual scene. However, this system does not have the same interaction as the system of the invention and does not allow connecting multiple providers with a patient to test/purchase medical devices.

Therefore, there is a need to develop new technologies that allow users with disabilities or medical conditions to test medical devices that help with their conditions in simulated environments. Furthermore, it is necessary to develop technologies that triangulate the user/patient experience, connecting different medical device providers/vendors in a single location, and developing an interactive buying/selling platform that allows the user/patient to test all these medical devices in simulated AR/VR environments. This would allow the user to try and purchase, in one place, the medical device that best suits their condition or disability, without having to go to different locations to test and purchase these devices. This avoids the expense of time and money and exposes the patient to real-world risks (given the degree of illness or disability they may have), whereas the traditional method of purchasing requires going to all these different locations to test the alternatives available on the market.

SUMMARY OF THE INVENTION Considering that virtual and immersive reality systems have been developed for video games, surgical training devices, and other shopping platforms, the present invention takes a turn from existing systems to generate a new type of immersive experience for people with medical conditions or disabilities, allowing them to try out and purchase different medical devices.

The present invention seeks to generate an immersive AR/VR system and software that allows triangulation and bringing together in one place a user/patient with a disability, vendors/suppliers of medical devices for different disabilities; and generate a testing platform for said devices (in simulated environments of said disability) but also for buying/selling said medical devices.

This is why the invention refers to a self-guided system and an end-to-end solution that, through immersive and simulated virtual experiences (3D spatial computing and related technologies), assists the end user in their decision-making process.

Accordingly, the present invention solves this problem by means of an immersive simulation system for the evaluation, comparison, testing, and purchase of devices, which uses augmented reality (AR) and virtual reality (VR) for immersive user interaction and to recreate live scenarios, comprising: a) A 3D Spatial Sound transmission element for simulation/immersion; b) An external sound neutralization element; c) A head tracking element; d) An immersive simulation element for recreating live scenarios; e) A vision/camera element used both inside and outside the system; and f) An eye tracking element.

Additionally, the present invention solves the previously described technical problem by means of a computer-implemented immersive simulation method for the evaluation, comparison, testing, and purchase of devices, which uses augmented reality (AR) and virtual reality (VR) for immersive user interaction and to recreate live scenarios, which This includes: an auditory triage assessment using software (SW), which consists of: a) An assessment (hearing test); b) Communication needs; and c) Treatment objectives. This assessment comprises the following sub-steps: I. The user enters the immersive simulation system; II. The software, coupled with the system, starts up and begins the process; III. The user activates the system; IV. The user-system interaction leverages natural language processing (NLP) and the immersive simulated environment to begin the triage assessment; V. Artificial intelligence selects the commercial devices that would best address the user's needs; VI. The user individually tests each of the offered devices using the touchscreen or voice commands, testing the performance profile of each hearing aid with the sound projected directly into the patient's ears.

BRIEF DESCRIPTION OF THE FIGURES

A detailed description of the invention will be provided in conjunction with the figure that forms part of this application. It is important to note that the figures serve only as supporting elements to facilitate a better understanding of the invention and the components used in the development of the immersive system.

Figure 1: Immersive system, packaged in a capsule-shaped device. In A, the design of the system of the invention in an immersive virtual and augmented reality capsule format is shown. In B, another configuration of the system is shown.

Figure 2: System development diagram. A conceptual map is shown with the main activities that were developed to generate the final system and software of the invention, in order to develop an immersive AR/VR system.

Figure 3: 3D Audio System. In A, it is shown how the system recognizes the user and the distance between their ears and the speakers. In B, it is shown how the system sends sound to create a sound bubble directly to the patient's ear without the need for standard headphones to direct the sound. Figure 4: Graphical interface of the platform. A shows the facial recognition interface. B shows the home screen with the 3-minute sound test. C shows the screen with the different medical hearing aids available for testing. D shows the selection of different simulation environments. E shows a test scenario (inside an airplane). F shows the payment platform for purchasing the medical hearing aid that best fits the patient.

Figure 5: Time comparison diagram between the traditional method and the SIMPOD system of the present invention. A comparative diagram between the traditional method and SIMPOD is shown, where each of the activities comprising the evaluation, simulation, device comparison, and purchase is broken down in color. A longer total time is observed with the traditional method, compared to a shorter time with the new method of the present invention.

Figure 6: Comparison chart of the time required at each stage of the process. The chart shows the breakdown of times for each task in color, where the traditional method takes 1 hour and 40 minutes. Meanwhile, the new SIMPOD method takes 27 minutes to complete the entire process of testing, evaluation, simulation, comparison, and purchase.

DETAILED DESCRIPTION OF THE INVENTION

For a better understanding of the present invention, it is necessary to provide the following definitions, which should only be understood as elements that help in understanding the particular technical characteristics in this technical field.

As used in the present invention, the term "Artificial Intelligence (AI)" refers to an information science focused on creating systems that can perform tasks that normally require human intelligence, such as learning, reasoning, and perception. AI is also the combination of algorithms designed to create machines that exhibit the same capabilities as humans. As used in the present invention, the term "Virtual Reality (VR)" refers to the creation of a fictional or simulated environment or scenario with a completely realistic appearance. The most common meaning refers to an environment generated using computer technology, which creates in the user the sensation of being immersed in it. This environment is viewed through a device known as virtual reality glasses or a headset. Virtual reality allows interaction with virtual objects using gestures, movements, or voice commands, facilitating an intuitive and natural experience. It allows for the display of additional and contextual information in real time.

As used in the present invention, the term "Augmented Reality (AR)" refers to the set of technologies that allow a user to view a portion of the real world through a technological device with added graphical information. The device, or set of devices, adds virtual information to the existing physical information; that is, a virtual part appears in reality. AR corresponds to an interactive experience that enhances the real world with computer-generated perceptual information. Using software, applications, and hardware such as AR headsets, augmented reality overlays digital content onto real-life environments and objects.

As used in the present invention, the term "Mixed Reality (MR)" is a blend of virtual reality and augmented reality. It therefore offers an environment that combines the best aspects of both.

As used in the present invention, the term "Spatial Computing (SC)" refers to the processing of information in a three-dimensional context. This technology enables devices to understand and react to physical space, facilitating more natural and intuitive interactions between the user and the digital environment. This type of technology allows the user to interact with any three-dimensional space by combining VR, AR, and MR techniques. As used in the present invention, the term "Metaverse" refers to a digital environment in which people can interact with each other and with virtual elements in a three-dimensional space. Users can explore, socialize, and perform various activities within this environment. It refers to how users interact with each other and with the virtual environment. This is achieved through customizable avatars, communication via text, voice, and video chat, collaboration on projects and tasks, exploration of different virtual environments, and participation in a virtual economy.

As used in the present invention, the term "immersive simulated environments" refers to technology that attempts to imitate a real-life experience through a digital or simulated replica. This technology strives to be increasingly realistic, where art, science, and technology blend to create a multisensory experience that immerses the client/user in a parallel virtual environment capable of engaging them visually, mentally, and even physically in different scenarios.

As used in the present invention, the term "Internet of Things (IoT)" refers to the collective network of connected devices and the technology that facilitates communication between devices and the cloud. It describes physical objects (things) with sensors, processing power, software, and other capabilities that connect and exchange data with other devices and systems via the internet or other communication networks. The IoT is a process that enables the connection of everyday physical elements to the internet: from common household objects to healthcare resources such as medical devices; smart clothing and personal accessories; and even smart city systems.

It is important to differentiate between the concepts defined above, as virtual reality technologies are often confused or equated with augmented reality, or metaverse technologies with spatial computing, which are not the same; they involve different challenges and developments, and therefore, offer different solutions depending on the type of system or device that one or the other implements.

The metaverse resides in the immersive technologies offered by spatial computing and so-called "extended reality." In this sense, VR allows users to immerse themselves in a completely digital world, while AR is an alternative type of experience that combines computer-generated content with the real environment. This means that the real world is complemented by the real environment around you. On the other hand, MR combines elements of both, creating a hybrid where the digital and the physical coexist.

For example, when using VR glasses, they hide your surroundings to transport you to a completely virtual environment. However, AR glasses are usually transparent, so you can still see your surroundings but overlay related information.

On the other hand, the metaverse is a platform that could replace or improve the internet, while VR is a technology that allows you to experience virtual worlds. Regarding AR and the metaverse, in the metaverse, you are completely immersed in a digital environment, while in AR, you can still interact with the physical world around you. Finally, spatial computing allows computers to understand and interpret the 3D spatial dimension, enabling dynamic interaction between people and the digital world; therefore, spatial computing is just one piece of the larger metaverse.

Therefore, the present invention is based on solving the problem of providing a simulated immersive system that allows the evaluation, in a single location, of the different options of commercial devices that are on the market (whether over-the-counter or prescription), and allows testing them in a simulated environment, to determine which is the best available option that fits the particular needs of each user. To this end, one objective of the present invention is to improve the end-user experience by simplifying and demystifying the process, allowing users to effortlessly access and personalize healthcare solutions. The system of the present invention facilitates collaboration between industry professionals, manufacturers, medical practices, and end-user groups to ensure seamless alignment and a superior end-user experience, whether in traditional medical practices, over-the-counter environments, self-service kiosks, or other settings.

This seeks a paradigm shift in the current methods of "HOW" and "WHERE" patients or users with some type of disability receive service, aiming to provide the following benefits to the end user with the immersive system of the present invention:

• Better level of service.

• More options where you can access different solutions.

• Faster service.

• Less expensive service.

• Wider range of options (full range of solutions).

• Easier.

• Better experience.

• More realistic testing.

This will create immersive experiences that allow end users to easily access and obtain healthcare-related solutions, as well as point-of-sale solutions specifically designed to provide end users with an immersive, self-guided experience.

This is relevant to the present invention, since the current sales method generated a high risk of dissatisfaction and returns, because patients cannot try the hearing aids in real-life situations before purchasing them, and the system of the present invention manages to overcome this gap.

Based on the above, one of the advantages of the invention is that, during a single visit, the end user can efficiently and accurately assess the cause of their condition or disease, exploring and comparing personalized device recommendations that allow them to improve their condition or disease, within various immersive simulated environments, with spatial visual and audio elements.

Another advantage is that this immersive system allows for the adaptation, programming, and purchase of optimal devices for the needs of the patient/client.

Furthermore, this system has the advantage that it is not limited to evaluating/testing devices to alleviate one type of condition or disability (for example, hearing difficulties), but has been designed as a modular system that allows incorporating and updating advances in component technologies as needed, thus incorporating other types of devices, such as virtual reality glasses for other medical disorders (such as people with reduced vision, color blindness); or attaching other olfactory devices (for people with olfactory difficulties), or tactile devices (for people with motor problems), among others.

Thus, the aim is to explain the technical advantages of the invention through the description, examples, and figure that accompany this reinvention. For example, in a non-limiting embodiment, the system of the present invention can be mounted in an immersive capsule format, as shown in Figure 1, where this circular capsule structure is coupled to a touch screen, speakers, and a chair. The user can position themselves in this chair to interact with the immersive evaluation system, which is coupled to software that allows the user to test different device options available on the market and immerse themselves in various simulated environments that replicate the user's medical problems or conditions (such as visual or hearing impairments, among others). The user can choose and try different medical devices that help with their condition or disability and see which one best suits their needs, to try all they want in one place, choose and buy the one that suits them best.

However, the invention should not be limited to the design of Figure 1, since the operation of the system can be applied to various physical constructions or structures, it can be applied in a capsule-like environment, it could be deployed as a wall-mounted device, or it could also be deployed in an AR/VR headset system.

In another embodiment, the system of the present invention is broken down into the following component parts:

Spatial sound (3D immersion)

3D spatial sound will be used to orient (place) sound around the end user's ears with the precision necessary to (1) perform diagnostic tests, (2) compare devices (hearing aids or others), including the filter activation/deactivation mode, and (3) create immersive sound environments needed to simulate real-life situations (location, places, experiences, etc.) so that the end user can identify, compare, and select the hearing aid profile that best suits their needs in their specific environments.

Each industry/market (vertical) will have a unique physical architecture to create the necessary immersive sound experience. Soundscapes will be created using a combination of software and hardware to optimize the sound experience.

Head tracking technology

We use head-tracking technology to: (1) identify and understand the position of end users in relation to the physical architecture (modified as needed for the target industry/vertical), (2) move and position the special 3D sound in the optimal position to perform (a) evaluation/diagnostic tests (b) comparison devices/solutions, and (c) evaluate the solution in simulated immersive environments. This will allow the system to automatically adapt to the user's physical attributes, including but not limited to height, head shape, and position, (3) understand the direction the end user is facing in order to then direct the necessary visual and auditory experiences to ensure that the simulated immersive experience is as true to life as possible.

End user interaction with the system

The system's interactions and inputs will be multimodal, allowing the end user to interact with the system in the most natural way. The systems will be indifferent to which input method is used. The "natural user interface" created by the combination of gesture, voice, and touch control will ensure a natural interaction with the system.

1. Voice Recognition: Voice recognition systems allow the end user's voice to interact with the system simply by speaking to it, enabling hands-free requests, reminders, and other simple tasks. The system supports different input languages, accents, idioms, and regionalizations. Voice recognition will be used in conjunction with NLP, eLLM, and LLM to create a natural, voice-driven interaction.

2. Voice Recognition: Voice recognition allows the system to identify and distinguish individual speakers. Voice recognition is a biometric alternative for user registration.

3. Natural Language Processing (NLP): We develop and train NLP models that combine computational linguistics—the rule-based modeling of human language—with statistical and machine learning models to ensure the system recognizes, understands, and generates text and speech relevant to the specific industry or product. For example, NLP model training differs significantly between hearing-related solutions and vision-based solutions. 4. Gesture Control: We have the ability to recognize and interpret end-user movements to simplify their interaction with the immersive system and control it without direct physical contact. The architecture of the immersive system will be adjusted in terms of the number of vision systems (cameras) based on industry interaction and technological advancements. For example, we currently use three cameras to track the exact position of end-users' hands relative to the screen. As technology advances, we will use individual stereoscopic cameras to achieve the same level of tracking and precision.

5. Touch Interaction/Touchscreen: The touchscreen allows end users to interact directly with what is displayed on the screen.

6. Eye Tracking: We use eye tracking to convert eye movements into data streams, helping us simplify the end-user experience. By determining what the end user is looking at, we can facilitate the "selection" component of the system interface. This system is also used to assess other feelings and reactions of the end user. It is also used to evaluate the end user's state during the testing, evaluation, and comparison of the process/system interaction.

Vision system/cameras

Vision systems will be used both inside and outside the POD. The vision systems are used for

(1) Vision systems inside and outside the POD to view, evaluate, and track the end user. From an evaluation perspective, we determine the end user's age, gender, height, race, etc. This information will be used to inform and assist in: a. end user registration b. building the end user's history c. targeting and adjusting the user experience and user interface. d. Evaluate and assess the end user's reaction to interactions with the systems (happiness, sadness, confusion, excitement). This allows the system to adjust the interaction to create the most natural experience for the end user.

(2) External vision systems are used to evaluate pedestrian traffic patterns, reactions to the system, and other related information necessary for feedback that will allow continuous improvement of the system.

(3) Internal vision systems are used to accurately track the position of end users within the systems, in order to ensure that 3D spatial sound can be properly/optimally placed to guarantee: a. A viable and accurate diagnostic evaluation, b. A precise and technically accurate comparison of alternative solutions, c. A simulated, truly immersive experience that accurately creates an experience similar to the target experience.

(4) Internal vision systems will be used to track and react to the end user's gestures and movements. Specifically, the system will track hand position so the end user can input information by pointing at stimuli.

(5) The vision systems inside the capsule will selectively use eye-tracking technology to allow the end user to select and/or input information throughout the interaction.

Eye tracking

Eye tracking is used to select elements in the visual interface. This allows the end user to look at the elements on the screen and select them. The eye tracking system will be used in conjunction with gesture control so that eye tracking highlights the element to be selected, and the gesture activates the intended selection.

Hearing assessment Immersive systems employ a hybrid hearing assessment that utilizes a combination of case history, demographic probability and predictability, sounds and tones, and bone conduction as needed. The system is specifically configured to meet the requirements of a particular market. For example, a prescription drug market may have regulatory requirements for an assessment, while an over-the-counter (OTC) market may have no testing or assessment requirements.

Therefore, the present invention is intended to be protected in the different non-limiting embodiments indicated below:

1. An immersive simulation system for evaluating, comparing, testing, and purchasing devices, which uses augmented reality (AR) and virtual reality (VR) for immersive user interaction and recreating live scenarios, comprises: a) A 3D Spatial Sound transmission element for simulation/immersion; b) An external sound neutralization element; c) A head tracking element; d) An immersive simulation element for recreating live scenarios; e) A vision/camera element, used both inside and outside the system; and f) An eye tracking element.

2 The immersive simulation system of realization 1, because the 3D spatial sound element, from point a), is used to orient the sound around the end user's ears with the precision required to: i Perform diagnostic tests;

i Compare devices, including the filter activation/deactivation mode; and iii Create immersive sound environments necessary to simulate real-life situations (location, places, experiences, etc.) so that the end user can identify, compare and select the hearing aid profile that best suits their needs in their specific environments.

3 The immersive simulation system of embodiment 2, because the 3D spatial sound element, of point a), comprises: a device; for creating a specific and controlled sound environment around the user's ears (sound bubble), and aligning the sound with the ear regardless of the head position.

4 The immersive simulation system of realization 1, because the External Sound Neutralization element, from point b), uses special filters, to create an almost total cancellation of the noise heard by the end user, and thus (1) eliminate unwanted external sound, (2) improve the listening experience and (3) ensure accurate acoustic fidelity for the operation of the system.

5 The immersive simulation system of realization 4, because the element of External Sound Neutralization, from point b), is carried out by Active Noise Cancellation (ANC), for which microphones are used to capture external ambient noise, and then generate sound waves (anti-noise) to cancel unwanted sounds/noises.

6 The immersive simulation system of realization 4, because the element of External Sound Neutralization, from point b), is carried out by Passive Noise Cancellation (PNC), for which the physical architecture of the system creates barriers to external sound, and/or absorbs extraneous sound.

7 The immersive simulation system of implementation 1-3, because the Head Tracking element, from point c), allows: i Identifying and understanding the position of end users in relation to the physical architecture (modified as necessary for the target industry/vertical), ii Move and position the 3D spatial sound in the optimal position for diagnostic testing, to compare devices/solutions, and to evaluate the solution in simulated immersive environments. iii Adapt the system to automatically adjust to the user's physical attributes, including but not limited to height, head shape, and position. iv Understand the direction the end user is facing in order to then direct the necessary visual and auditory experiences to ensure the simulated immersive experience is as true to life as possible.

8 The immersive simulation system of embodiment 1, because the Immersive Simulation element of point d), comprises: a touch screen and voice command elements, to test the performance profile of each of the hearing aids with the sound projected directly into the user's/patient's ears.

9. The immersive simulation system of implementation 1, because the Vision/Cameras element, from point e), is used to view, evaluate, and track the end user, and determine age, sex, height, race, among other parameters. This information is used for: i. End user registration;

i) Build the end-user story; iii) Guide and adjust the user experience and user interface (UI); and iv) Evaluate and assess the end-user's reaction to interactions with the systems (happiness, sadness, confusion, excitement). This allows the system to adjust the interaction to create the most natural experience for the end user.

10 The immersive simulation system of implementation 9, because the Vision/Cameras element, from point e), are used to evaluate pedestrian traffic patterns, reactions to the system and other related information necessary for feedback that allows continuous improvement of the system. 11 The immersive simulation system of realization 9, because the Vision/Cameras element, from point e), are used to follow the gestures and movements of the end user and react to them, where, the system follows the position of the hand so that the end user can input information by pointing at stimuli.

12 The immersive simulation system of realization 9, because the Vision/Cameras element, from point e), which is inside the system, selectively uses eye-tracking technology f) to allow the end user to select and/or input information throughout the interaction.

13 The immersive simulation system of embodiment 1, because the Eye Tracking element (from point f) is used to select elements in the visual interface, allowing the end user to look at the elements on the screen and select them. The eye tracking system is used in conjunction with gesture control so that eye tracking highlights the element to be selected and the gesture activates the intended selection.

14 The immersive simulation system of realization 13, because the Eye Tracking element, from point f), serves to convert eye movement into data streams that help simplify the end user experience, since, by determining what the end user is looking at, it facilitates the "selection" component of the system interface.

15 A computer-immersive simulation method implemented for the evaluation, comparison, testing, and purchase of devices, according to embodiment 1, because it uses augmented reality (AR) and virtual reality (VR) for immersive user interaction and to recreate live scenarios, comprising: an auditory triage assessment, consisting of: a) An assessment (hearing test); b) Communication needs; and c) Treatment objectives.

Where, said evaluation comprises the following sub-steps: i The user enters the immersive simulation system;

The software coupled to the system starts up and the process begins; iii The user activates the system; iv The user-system interaction leverages natural language processing (NLP) and an immersive simulated environment to begin the classification evaluation. v Artificial intelligence selects the commercial devices that would best solve the user's problem; vi The user individually tests each of the offered devices, using the touchscreen or voice commands, testing the performance profile of each hearing aid one by one with the sound projected directly into the patient's ears.

16 The computer-implemented method according to realization 15, because it comprises:

Step 1. User entry into the facial scanning capsule, via a sensor;

Step 2. Entering the user's data and history into the platform for the hearing test, using the 4K HD screen and the 3D spatial audio system;

Step 3. The user compares and selects devices available on the interactive platform;

Step 4. The user chooses the different real-life environment scenarios on the platform;

Step 5. The user is immersed in the chosen realistic scene, interacting with the platform, screen, 3D audio system and capsule; and

Step 6. The customer makes the (optional) payment for the chosen device, through the online payment platform.

The following examples demonstrate how the system of the present invention is interconnected, the parts of the system, and how it allows the patient to connect with different providers of medical devices for the conditions or disabilities that the user may have.

EXAMPLES The description of the rigorous tests for the system's operation, as well as the process for the interaction of each of the system's components, can be seen in the following application examples.

Example 1: Initial prototype.

Conception of the idea

The idea originated in 2022 when it became clear that the target audience for over-the-counter hearing aids wasn't receiving adequate support during the selection process. The original concept was to create an accessible retail space featuring a "RealismExperience Room." This room included a large monitor and a surround sound system. The goal was for end users to evaluate over-the-counter hearing aids through an auditory and visual simulation.

Several prototypes were tested, and as shown in Figure 2, an alpha version of the system revealed several shortcomings in this approach. The open-ended environment did not allow for a hearing assessment. Furthermore, headphones were required for an assessment, which would not accurately represent the sound of an over-the-counter hearing aid and would create hygiene issues.

The hardware used wasn't fully integrated, requiring several different devices. The process involved a person moving parts around to support the end-user experience. The experience itself wasn't great, offering little immersion. Furthermore, the cost of establishing a single point of sale was prohibitively high and couldn't be scaled sufficiently to materially improve end-user accessibility and address the fundamental issues that exist today.

This led to the conclusion that a more limited simulation "POD," both visually and acoustically, would offer a better overall user experience. In other words, it would be It is preferable to offer a fully integrated solution (both hardware and software). Using a POD would also provide the end user with a sufficiently quiet environment for a hearing assessment, in addition to offering a truly immersive demonstration experience. The cost associated with building a POD allows for faster implementation and, therefore, significantly improves end-user access. Furthermore, a POD can be configured to the needs of different retail formats, and an integrated solution better controls the entire process and reduces the time from assessment to transaction.

Example 2: System development process (SIMPOD design and platform).

As shown in FIGURE 2, the system design includes both the physical design stage of the capsule components, as well as the technological development of the software platform and the graphical interface that allows the different actors within the capsule to connect.

This involved the design and architecture of the capsule, as well as several iterative processes for developing the accompanying software and platform. The process began with alpha and beta prototype versions of both the capsule design and the software (as shown in the diagram in FIGURE 2).

SIMPOD Design

Capsule

The SIMPOD pod combines a large 4K HD display with a shallow desktop and seat, to create a secure module setup, giving you privacy from others, with the versatility to be accessible by a third party or hearing health professional (FIGURE 1).

3D Simulator

It immerses the user in a multitude of authentic real-life scenarios, allowing them to be heard directly through the actual hearing devices they intend to purchase. It utilizes realistic three-dimensional sound complemented by high-resolution 4K visuals. Invisible sound bubble

It is worth noting that the SIMPOD system uses i3DS audio technology, which is essentially a third way of listening. i3DS emits an invisible bubble of sound just outside the ears (FIGURE 3), creating a personal 3D sensory auditory experience without disturbing others; no speakers or headphones are required.

This technology allows customers to comfortably experience their chosen hearing aids with a simple touch of the screen. Our system facilitates live comparisons of various hearing aids within numerous natural soundscapes, ensuring an authentic evaluation process. The device features a state-of-the-art aluminum housing that accommodates a total of 12 simulated ear canals, enabling optimal demonstration of in-the-canal (ITC), completely in-the-canal (CIC), and receiver-in-the-ear (RITE) hearing aids.

Platform

Step 1. Facial Scan

Create the sound bubble: Once the user is scanned, the system emits an invisible bubble of sound just outside the ears, creating a personal 3D sensory auditory experience without disturbing others; no speakers or headphones are required.

Step 2. Hearing test

Quick and effective assessment: The platform then performs a quick but effective 3-minute hearing assessment. Once this is done, the user receives complete test results and recommendations for various hearing aids.

Step 3. Select your device

Device Menu: The SimPod can accommodate up to 12 hearing aids, all of which can be charged effortlessly. Our user-friendly Control Panel It allows customers to conveniently select the specific device they wish to have demonstrated.

Step 4. Select your environment

Scene menu selection: With the ability to test over 30 different real-life environments, you can listen to any device you choose in real time, allowing you to gain an authentic understanding of its functionality.

Step 5. Realistic scene (for example, of passengers)

Real-world environment simulation: In this part of the platform, you can experience a demonstration of the exact hearing aid you have chosen. You can experience realistic sounds in 3D, for example, by sitting on an airplane and listening as the flight attendant asks you what you would like to hear.

Step 6. Make the payment (optional)

User interface for payment: Once you have finalized your device selection, you can proceed to make a purchase and receive it conveniently at your doorstep.

All the steps described are accompanied by a specific graphical interface, on the system's software platform (FIGURE 4).

Example 3: Immersive user experience and interaction within the system.

The first thing that happens is that the user enters the system (for this non-limiting example, the system is in an interactive capsule format, as shown in Figure 1). Once seated in the capsule, the system software starts up and the process begins. The process starts as soon as the client activates the system. The interaction with the patient leverages NLP and SIMmersive technology to begin the classification assessment. That is, the assessment initiates a concurrent action, not a separate and discrete process. Leaving aside the software interaction, let's look at the technology within the SIMPOD. Sound transmission technology allows us to create a specific and controlled sound environment around the user's ears (FIGURE 3). This enables us to project sound around the client's ears and directly into their ear canal. When the patient turns their head left and right, facial tracking systems (FIGURE 4A) allow us to align the sound with the ear regardless of head position. We do this during hearing assessments and hearing aid comparisons.

Once we have completed the hearing test (FIGURE 4B), our software selects the three or four hearing aids (FIGURE 4C) that would best address the client's hearing problem. From there, the client can individually test each of the offered hearing aids. Using the touchscreen or voice commands, the user tests the performance profile of each hearing aid one by one, with the sound projected directly into the patient's ears. (This is powered by SIMmersive's Digital Comparator.) The patient can select from multiple real-life scenarios (FIGURE 4D) to evaluate how each hearing aid performs in those environments. For example, if the person has hearing difficulties in a restaurant, they could simulate a restaurant experience. If the client's problem occurs in a movie theater, an airport (FIGURE 4E), or any other location, they could simulate that as well. Our goal is to have a large number of simulations that follow the various scenarios that people with hearing problems may encounter. Thus, after testing the different devices, the customer can select and purchase (FIGURE 4F) the one that best suits their needs.

From a practical standpoint, our live simulation scenarios are essentially 3D, allowing the patient to hear and see the real-life scenario in an immersive way. This means that when they turn their head left or right, the head-tracking system will track their movement and adjust the audio and 3D visual experience accordingly. What does this mean? When a patient hears the waiter say something and turns to look at him, the visual and audio simulation adjusts accordingly in real time. In combination with the technologies mentioned above, we placed multiple speakers, microphones, and vision systems around the interior of the SIMPOD to ensure the ability to: 1) create an accurate hearing test; 2) eliminate unnecessary external noise that could corrupt the tests and simulation; 3) track movement and synchronize immersive content (sound and visual) with the patient's natural movements; and 4) facilitate interactions with clients.

Example 4: Internal functioning and decisions of the methodology implemented by computer, on the platform (Software).

The way the software designed for the immersive platform of the system of the present invention operates is presented as a step-by-step process, which allows understanding the method implemented by computer, within a list of decisions that are developed as the client interacts, chooses, tests and buys a medical device.

• Implementation decision tree. Preliminary design of the computer-implemented method. Evaluation of hearing triage (software (SW)). o Provide user documentation and data to the system to demonstrate that a demographic profile/classification can add speed, accuracy, and consistency to the HEARING TEST. o YES: presentation required as part of the demonstration walkthrough. o NO: no functional demonstration required.

• 3D audio transmission (simulation/immersion). o Demonstrate the transmission: Use a mobile standalone demonstrator (single audio source). o YES: A live demonstration is required. The sound must be transmitted to the target user's ears and adjust to the user's head movements. o NO: We do not need to have a fully functional hearing aid comparator. or NO: we do not need to have a fully functioning HEARING TEST.

• 3D audio streaming (hearing test). o Provide documentation and data demonstrating the existence of a verified 10-minute hearing test with headphones. o Explain that we will be:

■ Layers of auditory classification assessment data to shorten test time and increase confidence in hearing test results.

■ Adapt the existing solution to leverage directional sound technology to create a headphone-free hearing test. Show data that we use broadcast technology to identify and alert the user to a potential earwax buildup that would need to be addressed before proceeding. NO: We do not need to present a working sound beam hearing test. YES: We must show a 10-minute hearing test.

• Sound neutralization. o Sound insulation will be used to block ambient noise and related sounds that may interfere with effective

■ Hearing test

■ Hearing aid comparator or SI: A live demonstration of the necessary signal identification and sound isolation/neutralization capabilities demonstrates the ability to create the appropriate sound environment for hearing tests and sound comparison. or NO: we do not need to submit a hearing test or a soundproof immersion comparison.

• Immersive simulation: Live scenarios will be used to create the necessary immersive experiences, allowing customers to test and compare the audio in environments as close to real-world settings as possible. YES: It would be good to show some typical scenarios. NO: We don't need to show a synchronized immersive visual and audio experience.

More specifically, the system of the present invention can be specified through the following software, which allows the development of the platform that accompanies the capsule:

SIMPOD Software Platform:

1) SIMmersive SW (software): The comprehensive experience guides the end user throughout the entire process involving: (1) registration, (2) case history, (3) evaluation, (4) results report, (5) solution comparison, (6) solution simulation, (7) solution selection, (8) solution acquisition/purchase, (9) training, (10) follow-up, (11) referral to a higher level of care, (12) back-end AI optimization.

2) Triage and evaluation (on the platform). An initial sound test and preliminary evaluation are performed to determine the degree of disability or impairment of the user in order to adjust the capsule and ensure that it operates under conditions tailored to the user in the different simulations.

3) SIMfinder Digital Comparator - The software-based immersive hearing aid comparator (1) will allow the system to display the specific sound characteristics (digitally and virtually) of the hearing aids the end user is evaluating and considering, (2) will provide the end user with relevant product information to inform their final selection. Relevant product information would include, but is not limited to: a) price, b) fit, c) warranty, d) fit differences, e) performance differences, f) etc. 4) Immersive experiences: To enable the end user to fully understand and experience the advantages of the possible solutions, they will be able to experience and interact with simulated immersive experiences that emulate (are similar to) their primary problem state scenarios.

5) Artificial Intelligence (AI and Generative AI)

1) LLMs - Sector-specific LLMs will be developed (trained) to: a) Ensure that end-user interaction is robust, accurate, and capable of processing, responding to, and communicating domain-specific content. b) Provide end-users with diagnosis-based guidance, including, but not limited to, (1) an explanation of the end-user's condition/limitation, (2) an explanation of corrective and alternative actions to address the immediate condition, (3) strategies to limit further losses or impairments related to the condition, (4) general educational materials. c) The LLMs will be continuously updated in real time with end-user data, SIMmersive system interaction data, primary research data, secondary research data, UI/UX-related information, diagnostic data, manufacturer product data, and other data sources.

2) AI-based algorithms will be used to inform, incorporate feedback, and optimize the end-user experience and the overall accuracy of the system and its components: a) Triage: In triage, we will use the end-user's demographic data, such as case history, gender, and age, to assess and determine potential conditions that may affect them. This will form the basis of the detailed diagnoses necessary for a complete patient evaluation. Triage aims to shorten the overall evaluation cycle, similar to how a doctor or expert would interact with the end-user or patient. The system will prioritize testing/assessment by focusing on the most likely causes of the condition while also checking for borderline/marginal conditions to ensure a comprehensive evaluation of the end-user's ailment. b) Testing Protocols: Testing protocols will be developed specifically for our system, for example, in the case of a hearing assessment or hearing test. We will use 3D spatial sound to direct specific tones to the patient's ears. Since this is a virtual simulated test without headphones or a special sound booth, our testing protocols must be custom-developed for this application. c) Selection Protocols: Based on the end user's assessment, their preference for the style or fit of the solution, and the performance of the corrective solution, the SIMmersive system will recommend the optimal corrective solution options for the end user to test and compare. The system will be able to rank and prioritize the corrective action options. Depending on the requirements and channel configuration, the system will display a number of solutions for the end user to test, evaluate, and compare. d) Education: Materials will be generated to provide information, guidance, and strategies for maintaining, mitigating, or preventing further progression of the condition while improving quality of life. Informational materials play a crucial role in mitigation and prevention by raising awareness and providing practical information to the end user/patient. For example, individuals undergoing hearing assessments who have or are concerned about hearing loss could receive newsletters, emails, text messages, and other communications with information specific to their situation, guiding them on how to prevent further loss related to their condition or illness. These materials often contain critical information on how and when to use hearing protection, how to use headphones safely, and/or how unaided hearing loss correlates with cognitive decline, thereby reducing the risk of further injury and hearing or cognitive loss. Beyond risk reduction, general informational materials can significantly improve quality of life by disseminating knowledge that promotes the personal well-being of the end user/patient. This could include information that directly helps the end user or information that could be provided to family and friends so they can understand and support the end user/patient. For example, an end user with a vision-related condition, such as age-related macular degeneration, benefits greatly from specific diets, assistive devices, and other resources. By providing accessible and identifiable content, these resources help people lead more informed, engaged, and enriching lives. e) Empathetic Voice Interface: We will deploy an AI-powered interface capable of measuring the nuances of vocal modulations and responding to the end user using an Empathetic Large Language Model (eLLM), which guides language and speech generation. Language modeling and text-to-speech conversion with improved equalization, prosody (sound rhythm such as stress), turn-end detection, interruptibility, and alignment will be used to ensure the most natural interaction possible between the end user and the SIMmersive system.

3) Live Data Analysis: Live data processing and analysis are used to strengthen, provide feedback on, and optimize the entire system. More specifically, the system will learn from each end-user interaction to: (1) adjust and improve the end-user UX, (2) continuously improve end-user evaluation, (3) offer the end user optimal corrective alternatives for evaluation and comparison, (4) understand, identify, and update immersive test environments, (5) identify system-level trends that can be used to optimize the system, and (6) identify data trends that can be shared with solution vendors and channel partners.

4) Product Performance Profiles: We will develop product- and model-specific digital profiles for all devices used in our system. These digital profiles will allow us to accurately represent device performance without needing to use or deploy the physical device. They will be used during the system's evaluation/testing, monitoring, benchmarking, and simulation phases. The profiles will be deployed in the system leveraging the various technologies described in the technology stack.

5) Noise Cancellation: We will use several different approaches to create near-total noise cancellation (the noise cancellation the end user hears): (1) eliminating unwanted external sound, (2) enhancing the listening experience, and (3) ensuring accurate acoustic fidelity for system operation. We use special filters to ensure the soundscape The necessary elements for a satisfactory experience should not be negatively affected by the ANC and PNC approaches used. a) Active Noise Cancellation (ANC): Using microphones to capture external ambient noise, we will generate sound waves (anti-noise) to cancel unwanted sounds/noises. b) Passive Noise Cancellation (PNC): The physical architecture of the system will (1) create barriers to external sound, and/or (2) absorb extraneous sound.

Example 5: Comparison of a patient/customer with hearing problems, who buys using the current method and in the SIMmersive POP system.

In this example, the time it takes a user to complete the entire process of evaluating, comparing, simulating, and purchasing a medical hearing device using the current sales method was measured and compared to the time it takes the user to perform the same procedure using the SIMPOD Capsule of the present invention.

As shown in FIGURE 5, the total time a user spends on the current system is 1 hour and 40 minutes; whereas the same process was executed in a time of 30 minutes with the capsule of the present invention.

Therefore, the system of the present invention reduces by 70% the time required to compare, simulate and purchase a hearing aid.

Furthermore, FIGURE 6 shows a graph with the breakdown of the time required for each stage of the process in the current purchasing method, compared to the new method of the present invention. It can be observed that in the old method, 80% of the visit is dedicated to evaluation and sales; while with the new system, 64% of the visits are dedicated to product simulation and testing. This is not only a time benefit for the user, but also a benefit for professionals and owners in the audiology industry, including greater efficiency and shorter experiences for patients, which could lead to a paradigm shift in the industry.

Claims

1. An immersive simulation system for evaluating, comparing, testing, and purchasing devices, CHARACTERIZED by its use of augmented reality (AR) and virtual reality (VR) for immersive user interaction and to recreate live scenarios, comprises: a) A 3D Spatial Sound transmission element for simulation/immersion; b) An external sound cancellation element; c) A head tracking element; d) An immersive simulation element for recreating live scenarios; e) A vision/camera element used both inside and outside the system; and f) An eye tracking element. 2. The immersive simulation system of claim 1 CHARACTERIZED in that the 3D spatial sound element of point a) is used to orient sound around the end user's ears with the accuracy necessary to: i) Perform diagnostic tests; ii) Compare devices, including the filter activation/deactivation mode; and iii) Create immersive sound environments necessary to simulate real-life situations (location, places, experiences, etc.) so that the end user can identify, compare, and select the hearing aid profile that best suits their needs in their specific environments. 3. The immersive simulation system of claim 2, CHARACTERIZED in that the 3D spatial sound element of point a) comprises: a device; for creating a specific and controlled sound environment around the user's ears (sound bubble), and aligning the sound with the ear regardless of head position. 4. The immersive simulation system of claim 1, CHARACTERIZED in that the External Sound Neutralization element of point b) uses special filters, to to create almost total cancellation of the noise heard by the end user, and thus (1) eliminate unwanted outside sound, (2) improve the listening experience and (3) ensure accurate acoustic fidelity for the operation of the system. 5. The immersive simulation system of claim 4, CHARACTERIZED in that the External Sound Neutralization element of point b) is carried out by means of Active Noise Cancellation (ANC), for which microphones are used to capture external ambient noise, and then generate sound waves (anti-noise) to cancel unwanted sounds/noises. 6. The immersive simulation system of claim 4, CHARACTERIZED in that the External Sound Neutralization element of point b) is achieved by Passive Noise Cancellation (PNC), for which the physical architecture of the system creates barriers to external sound, and/or absorbs extraneous sound. 7. The immersive simulation system of claims 1-3, CHARACTERIZED in that the Head Tracking element of point c) enables: i) Identifying and understanding the position of end users in relation to the physical architecture (modified as required for the target industry/vertical), ii) Moving and positioning 3D spatial sound in the optimal position for diagnostic testing, comparing devices/solutions, and evaluating the solution in simulated immersive environments, iii) Adapting the system to automatically adjust to the user's physical attributes, including, but not limited to, height, head shape, and position, iv) Understanding the direction in which the end user is facing in order to then direct the necessary visual and auditory experiences to ensure that the simulated immersive experience is as true to life as possible. 8. The immersive simulation system of claim 1, CHARACTERIZED in that the immersive simulation element of point d) comprises: a touch screen and elements of voice commands, to test the performance profile of each of the hearing aids with the sound projected directly into the user's/patient's ears. 9. The immersive simulation system of claim 1, CHARACTERIZED in that the Vision/Cameras element of point e) is used to view, evaluate, and track the end user, and determine their age, sex, height, race, and other parameters. This information is used for: i) registering end users; ii) building the end user's history; iii) guiding and adjusting the user experience and user interface (UI); and iv) evaluating and assessing the end user's reaction to interactions with the systems (happiness, sadness, confusion, excitement). This allows the system to adjust the interaction to create the most natural experience for the end user. 10. The immersive simulation system of claim 9, CHARACTERIZED in that the Vision/Cameras element of point e) is used to evaluate pedestrian traffic patterns, reactions to the system, and other related information necessary for feedback that enables continuous improvement of the system. 11. The immersive simulation system of claim 9, CHARACTERIZED in that the Vision/Cameras element of point e) is used to follow the gestures and movements of the end user and react to them, wherein the system follows the position of the hand so that the end user can input information by pointing at stimuli. 12. The immersive simulation system of claim 9, CHARACTERIZED in that the Vision/Cameras element, of point e), which is inside the system, selectively uses eye-tracking technology f) to allow the end user to select and/or input information throughout the interaction. 13. The immersive simulation system of claim 1, CHARACTERIZED in that the Eye Tracking element of point f) is used to select elements in the visual interface, enabling the end user to view and select elements on the screen. The eye tracking system is used in conjunction with gesture control, such that eye tracking highlights the element to be selected and the gesture activates the intended selection. 14. The immersive simulation system of claim 13, CHARACTERIZED in that the Eye Tracking element, of point f), serves to convert eye movement into data streams that help simplify the end user experience, since, by determining what the end user is looking at, it facilitates the "selection" component of the system interface. 15. A computer-immersive simulation method for evaluating, comparing, testing, and purchasing devices, according to claim 1, CHARACTERIZED in that it uses augmented reality (AR) and virtual reality (VR) for immersive user interaction and to recreate live scenarios, comprising: an auditory triage assessment, which consists of: a) An assessment (hearing test); b) Definition of communication needs; and c) Definition of treatment objectives. Where, said evaluation comprises the following sub-steps: I. The user enters the immersive simulation system; II. The software coupled to the system is started and the process begins; III. The user activates the system; IV. The user-system interaction leverages natural language processing (NLP) and an immersive simulated environment to begin the classification evaluation. V. Artificial intelligence selects the commercial devices that would best solve the user's problem; VI. The user individually tests each of the devices offered, using the touch screen, or voice commands, the user tests one by one the performance profile of each of the hearing aids with the sound projected directly into the patient's ears. 16. The computer-implemented method according to claim 15, CHARACTERIZED in that it comprises: • Step 1. User entry into the facial scanning capsule, via a sensor; • Step 2. Entering the user's data and history into the platform for the hearing test, using the 4K HD screen and the 3D spatial audio system; • Step 3. The user compares and selects devices available on the interactive platform; • Step 4. The user chooses the different real-life environment scenarios on the platform; • Step 5. The user is immersed in the chosen realistic scene, interacting with the platform, screen, 3D audio system and capsule; and • Step 6. The user makes the (optional) payment for the chosen device through the online payment platform.