DE102024100301A1 - Intertragal earphone device and associated operating procedure - Google Patents

Abstract

The invention relates to an earphone device comprising at least one output device to be worn on a respective ear and having a loudspeaker device for generating output sound with audio content. In the respective output device, the loudspeaker device comprises a loudspeaker which, when the holding device holds the output device in the intended wearing position on the ear, is arranged in front of, in, or behind an intercostal notch of the ear, as viewed from the surroundings.

Description

The invention described here relates to an earphone device that provides an output device (earphone, earpiece) for one or both ears of a user, which can be worn on the ear. The output device can emit an output sound with audio content to the ear, e.g., to an auditory canal and/or to a concha of the ear. The earphone device can be configured as a headset, also with a wireless connection to a portable device, such as a smartphone.

The earphone device is characterized by the fact that it leaves the ear canal free when worn, meaning it does not provide any components for placement in the ear canal. This is referred to as an open connection. This allows ambient sound to enter the ear canal unhindered or without blockages, which can promote natural auditory perception of the environment. The loudspeaker device outputs a predetermined audio content into the ear canal, which is superimposed over the direct ambient sound. The audio content can be an amplified portion of a part of the ambient sound (hearing assistance) or media content, e.g., music or a voice recording, or a telephone conversation, to name just a few examples. The wirelessly connected device can also serve as the source of the audio content.

The loudspeaker device provides a loudspeaker that can be positioned in front of, in or behind an intertragal notch (medically: incisura intertragica) of the ear. The intertragal notch is the depression or gap between the tragus and the antitragus of the ear. The loudspeaker is correspondingly small; its beam or membrane has, in particular, a maximum external dimension of less than 20 millimeters, in particular less than 15 millimeters. From the perspective of the ear canal opening, the loudspeaker radiates its sound from the direction of the notch, i.e., viewed from the area in front of the ear, the loudspeaker is positioned in front of, in or behind the notch, and the actual or imaginary extended center axis of the loudspeaker therefore runs through the notch.

Listening tests have demonstrated the particular advantage that radiation from the intertragal notch produces a sweet spot effect, i.e., a particularly favorable presentation of the output sound, which on average resulted in a perceived or perceived increase in volume among the test subjects compared to other loudspeaker positions with the same loudspeaker and distance from the ear canal. Radiating output sound from the intertragal notch into the ear is therefore considered a method according to the invention.

Features and further developments of the earphone device according to the invention are specified in the claims and this description and the figure.

In order for the loudspeaker to stay in place at the notch, a holding device is provided in the respective output device, which, through shaping and/or e.g. by means of a clip, allows the output device to be brought into a corresponding wearing position on the ear and/or held there.

The further development, in which the loudspeaker is arranged in front of, in or behind the notch, i.e. between the notch and the ear canal, can be designed particularly advantageously in such a way that the complete holding device or part of the holding device can also be integrated there. The loudspeaker or a socket for the loudspeaker is designed as a ring, partial ring or bulge, which is referred to here as a "collar" or rear grip. The respective output device therefore has a housing body which, when worn, is arranged in front of the ear as seen from the surroundings thanks to the holding device. It has a housing extension (e.g. a tube or a nozzle) which, when worn, projects through the notch to behind the notch (i.e. towards the ear canal), where the loudspeaker can be held behind the notch in the housing extension. The housing extension has a collar in the area behind the notch and/or in the area of the loudspeaker, which makes the outer diameter of the housing extension larger than in an area of the housing extension that is to be arranged in the notch when worn. In the worn position, the collar thus engages behind an edge of the notch formed by the tragus and antitragus of the ear. This holds the output device to the ear because the collar cannot slip out through the notch (when the ear is held upright). The collar can serve as a socket for the loudspeaker or be formed by the loudspeaker. If the loudspeaker is arranged in the notch or even in front of the notch, the housing extension can be designed as an acoustic horn or sound funnel to direct the portion of the loudspeaker's output sound behind the notch.

In particular, no retaining bracket for the earpiece is provided on the output device. The respective output device is designed, in particular, as a single earpiece.

An additional speaker (auxiliary speaker) of the output device can be placed on the antitragus and/or an additional speaker can be placed in the concha. Frequency components of the speaker signal can be distributed between the speakers and additional speakers of an output device using a crossover.

The ear can be provided as a human ear of a person or as an ear model, such as one made of silicone that can be obtained as an imitation of a human ear.

1 shows a schematic representation of an ear 10 with an output device 11 of an earphone device 12 held thereon. A housing 13 of the output device 11 (earphone) can have a loudspeaker device 14 with a loudspeaker S1 and a loudspeaker S2, which can jointly radiate an output sound 15 towards a side of the housing 13 facing the ear. In particular, a loudspeaker S1 can be arranged in an intertragal notch between the tragus and antitragus or behind the notch in the ear or in front of the notch, in order to radiate the corresponding portion of the loudspeaker S1 of the output sound 15 towards the auditory canal from the direction of the notch. The loudspeaker S2 can be held on the antitragus, for example by a saddle element, or can rest there.

Ambient sound from an environment 16 can penetrate directly into a free auditory canal. Furthermore, the ambient sound can be captured by a microphone device 17 and signaled as at least one microphone signal, which can be processed by a signal processing device in the housing 13 or in a wirelessly connected external device (not shown), e.g., a smartphone, to extract and process the audio content for the auxiliary sound.

The output device 11 can be held on the ear 10 by a holding device 18. The holding device 18 can be implemented by means of a clip for an earlobe of the ear 10 and/or by means of a clip or a cuff for a helix of the ear 10.

A further advantage arises if the earphone device is configured to apply a predefined and/or variably adjustable phase shift to the respective loudspeaker signal for the loudspeaker and for the respective additional loudspeaker. By selectively shifting the phase of the loudspeaker signals S1, S2, and any additional loudspeaker signals, different spatial perceptions can be simulated. The variable adjustability can refer to the user being able to choose between different, pre-programmed hearing programs, e.g., different spatial sounds.

2 shows a schematic representation of an alternative embodiment of an output device 11 of the earphone device 12. A housing extension 20 can be arranged for placement in the intertragal notch (see 1 ) may be provided. At one end 21 of the housing extension 20, which in the intended wearing position is arranged behind the notch (viewed from the surrounding area 16 towards the ear 10), i.e. between the notch and the auditory canal, a collar 22 may be formed in which the loudspeaker S1 can be held.

3 shows the design of 2 in the intended wearing position. The housing extension 20 also represents a holding device 18 in that the housing extension 20 is arranged in the intertragal notch and the collar 22 the tragus and the antitragus (in 3 concealed by the housing 13) or forms a positive connection with them to prevent slipping out. The diameter of the housing extension 20 can be selected to be so large (greater than 7 mm) that it is clamped by the tragus and antitragus.

4 shows the design of 2 once again from a different perspective, showing loudspeaker S1 and loudspeaker S2.

5 shows a schematic representation of an alternative embodiment of an output device 11 of the earphone device 12.

The respective output device (one per ear) is generally positioned outside the ear on or near the earlobe (can be defined as a piece of jewelry) and has at least one speaker positioned above/inside/in front of the intertragal notch.

• - Es kann als kabelloses Headset-Gerät mit Bluetooth-Verbindung für Streaming und Telefonate ausgestaltet werden.
• - Es kann im Standalone-Modus als PSA (personal sound amplifier) oder medizinisches Hörgerät betrieben werden.
• - Die Lautsprecheröffnung (bzw. deren Einfassung oder Umrahmung) in der intertragalen Kerbe kann als mechanischer Anker oder Kragen oder Hintergriff für das Gerät ausgestaltet werden.
• - Zusätzlich kann in der Halteeinrichtung ein Clip-Mechanismus hinzugefügt werden, um das Gerät am Ohr zu befestigen, z. B. am Ohrläppchen.
• - Zusätzlich kann eine Manschette über der Helix des Ohres verwendet werden, um das Gerät am Ohr zu fixieren.
• - Durch die Platzierung des Lautsprechers in oder im Bereich der intertragalen Kerbe können drei Funktionen erreicht werden:
  1. 1. Akustisch - Optimierung der Klangqualität aufgrund der kürzeren Entfernung und der Reflektionen.
  2. 2. Mechanische Verankerung/Haftung des Geräts am Ohr mittels Halteeinrichtung.
  3. 3. Ermöglicht eine bessere räumliche Trennung der Mikrofone zum Sprecher, wodurch Echo und Rückkopplung bei Telefonie oder PSA/Hörgerätefunktionalität reduziert werden.

The output device sits on the earlobe, preferably above or at the antitragus, with part of the device sitting in the pinna like a saddle. From the outside, one or more speakers and other components such as electronics and batteries may be located behind the antitragus and within the intertragal notch.

• - It can be designed as a wireless headset device with Bluetooth connection for streaming and phone calls.
• - It can be operated in standalone mode as a PSA (personal sound amplifier) or medical hearing aid.
• - The speaker opening (or its surround or frame) in the intertragal notch can be designed as a mechanical anchor or collar or rear grip for the device.
• - Additionally, a clip mechanism can be added to the holder to attach the device to the ear, e.g., to the earlobe.
• - Additionally, a cuff can be used over the helix of the ear to secure the device to the ear.
• - By placing the speaker in or near the intertragal notch, three functions can be achieved:
  1. 1. Acoustic - Optimization of sound quality due to shorter distance and reflections.
  2. 2. Mechanical anchoring/adhesion of the device to the ear using a holding device.
  3. 3. Allows better spatial separation of the microphones from the speaker, reducing echo and feedback during telephony or PSA/hearing aid functionality.

In particular, output devices can operate independently, either individually or in pairs, meaning no additional processor device is required that the user would have to carry with them for actual operation. Coupling two output devices can be achieved via a wireless connection, particularly via Bluetooth.

The respective output device can be designed, in particular, as a piece of jewelry, i.e., as ear jewelry, such as an earring. This advantageously prevents it from being recognized as a hearing aid, but rather allows all jewelry to be used fully. In particular, the free auditory canal allows this impression. In particular, there is no retaining arch on the auricle and no retaining bar across the head (from one ear to the other). The respective output device is designed, in particular, as a single earpiece (earphone). In particular, the earphone device consists of only one or two output devices to provide the described functionality of generating output sound, i.e., without an additional processor device, e.g., for the belt.

All electronic components in the piece of jewelry can be arranged in a way that is not visible from the outside, so that the function as an earphone device is not recognizable to an observer when worn. For this purpose, the device can be removed from the EP3466107A1 be trained with the ideas described here or the headset functionality of this device is replaced by the ideas described here. The information regarding appearance and microphone setup from the EP3466107A1 are to be regarded as possible embodiments of the present idea.

Overall, this results in a new form factor for an out-of-the-ear headset device (output device) that can also be equipped with PSA (personal sound assistant - hearing support) and/or hearing aid features.

In this context, examples of further developments are described below that are encompassed by the invention and that allow the earphone device to be used as a hearing assistance device. Accordingly, the output device is referred to as an assistance device in this context, and the output sound represents a support sound.

The invention described here relates to a hearing assistance device that provides an assistance device for one or both ears of a user, which can be worn on the ear. The assistance device can output ambient sound in an amplified manner, for which purpose it has a microphone device and a loudspeaker device that are coupled via a signal processing device. The microphone device detects the ambient sound, and the signal processing device processes the at least one microphone signal of the microphone device in order to extract a predetermined audio content therefrom and thus controls the loudspeaker device so that it emits the extracted audio content as support sound. The audio content can be, for example, speech (voice with speech content) or music, or a frequency component in which the user has a hearing impairment, the latter being able to be specified using hearing curve data.

The hearing aid device is characterized by the fact that it leaves the ear canal free when worn, meaning it does not require any components to be positioned in the ear canal. This is referred to as an open connection. This allows ambient sound to enter the ear canal unhindered or without blockages, which can promote a natural auditory perception of the environment. The loudspeaker device emits a predetermined portion of the captured ambient sound (here referred to as "audio content") as auxiliary sound into the ear canal, where it is superimposed on the direct ambient sound and thus presents the specified audio content with greater sound power. Supportive sound therefore provides support in perceiving the audio content, which is why it is called that.

The auxiliary sound does not have to simply output the audio content as an amplified signal component of the ambient sound. To avoid feedback and/or to utilize other frequency bands in which the user hears better, further developments of the invention can, for example, involve voice distortion and/or frequency modulation by the signal processing device. The audio content in the auxiliary sound does not have to be represented by the same signal as in the ambient sound; rather, distortion, filtering, or modulation may have been applied. Nevertheless, what is meant here is a superposition of the audio content from the ambient sound with the same audio content (in amplified or even alienated, distorted, or modulated form) in the ear canal. This means that this is not a paraphrased reproduction, which could, for example, be based on speech recognition and reproduce the audio content after it has already passed. Rather, it is a simultaneous reproduction of the audio content by auxiliary sound, or with a maximum delay of 50 ms, while the audio content is also present in the ear canal via ambient sound.

Features and further developments of the assistance device according to the invention are specified in the claims and this description and the figure.

One advantage of the invention is that the hearing assistance device can be worn permanently due to its open connection, thus compensating for hearing loss in the respective ear. Unlike a hearing aid, however, the speaker system additionally provides sound levels of less than 85 dB, particularly less than 80 dB, in the eardrum area of the affected ear. This is referred to as a hearing assistance device or PSA (personal sound amplifier).

For holding the device on the ear, the respective assistance device can have a clip or clamp in a manner known per se. The signal processing device can be implemented, for example, using a DSP (digital signal processor) and/or an ASIC (application specific integrated circuit). The loudspeaker device can be implemented using one or more loudspeakers. The control signal of the signal processing device can be the already amplified driver signal or power signal or loudspeaker signal for the respective loudspeaker, i.e. the amplifier circuit is then part of the signal processing device. Alternatively, the control signal can be the input signal of an amplifier circuit if the amplifier circuit is provided in the loudspeaker device.

1. a) im Verhältnis leisere, den Audioinhalt signalisierende Nutzsignale mehr verstärkt werden als im Verhältnis dazu lautere Nutzsignale, sodass nach der Überlagerung mit dem Umgebungsschall im Gehörgang insbesondere eine geringere Lautstärkedynamik der überlagerten Schalle vorliegt als beim Umgebungsschall alleine (Funktion eines Kompressors), und/oder
2. b) ein Rauschpegel eines Rauschens der Umgebung, das in dem zumindest einen Mikrofonsignal als ein von dem Audioinhalt verschiedener Rauschanteil ist, ermittelt wird, und eine Lautstärke des Unterstützungsschalls abhängig von dem ermittelten Rauschpegel eingestellt wird, sodass sich nach der Überlagerung mit dem Umgebungsschall im Gehörgang der Audioinhalt mit einem Lautstärkepegel größer als der Geräuschpegel ergibt.

An additional advantage arises if the signal processing device is designed to carry out an adaptive, dynamic amplification of the support signal, in which

1. a) relatively quieter useful signals signalling the audio content are amplified more than relatively louder useful signals, so that after superimposition with the ambient sound in the ear canal, the volume dynamics of the superimposed sounds are lower than with the ambient sound alone (function of a compressor), and/or
2. b) a noise level of an ambient noise which is present in the at least one microphone signal as a noise component different from the audio content is determined, and a volume of the support sound is adjusted depending on the determined noise level, so that after superimposition with the ambient sound in the ear canal, the audio content results with a volume level greater than the noise level.

With adaptive, dynamic amplification of the support signal, quiet signals are amplified more strongly than loud signals, so that after superimposing the direct sound, a constant, easily intelligible level is achieved as far as possible. Additional or alternatively, signals are adaptively amplified so that they are significantly (externally configurable) above the ambient noise level.

This allows the open (openly connected) assistive device to be configured to dynamically amplify a specific signal component (useful signal) more or less depending on the configuration/needs/ambient noise level. The main advantages, in addition to the improved user experience, are energy consumption optimization and a minimization of the likelihood that a third person nearby will find the amplified loudspeaker signal disturbing.

The wanted signal can be the audio content signal resulting from filtering (beamforming, signal processing, AI - machine learning model). It can be configured or selected differently via an external device (e.g., smartphone). It can be speech, for example, but also a specific sound or musical instrument. In general, the wanted signal can signal the specified audio content, especially specifically just this one. The control signal for the loudspeaker system can be generated from the adaptively amplified wanted signal. Overall, this is a PSA (personal sound amplifier) that amplifies ambient sound locally for the user at each ear. The amplification can be applied across the board for the entire bandwidth of the detected ambient sound or selectively for a specific signal component, e.g., a voice, which in each case results in the specified audio content. A voice can be extracted, for example, using a machine learning model, such as one implemented using a signal processor from Greenwaves Technologies™.

Positive feedback between the loudspeaker and microphone systems can be avoided by signal alienation (distortion and/or voice change) by making the signal profile of the ambient sound different from the underlying microphone signal.

The assistance device located outside the ear and on or near the earlobe should be able to work in stand-alone mode as a PSA (Personal Sound Amplifier) or as a medical hearing aid, amplify the respective microphone signal, process it analogue/digitally, amplify the signal thus processed beyond the natural or given sound pressure (totalling the control signal) and reproduce it via the integrated loudspeaker(s) of the loudspeaker device located outside the ear canal.

• - Das jeweilige oder ein Assistenzgerät kann gemäß einer Weiterbildung extern über einen PC oder ein Smartphone und eine BT-Verbindung (BT - Bluetooth) gesteuert und abgestimmt werden.
• - Der Lautsprecher kann auch hinter, auf oder vor der intertragalen Kerbe platziert werden, um die Klangqualität zu verbessern und eine bessere räumliche Entkopplung zwischen Mikrofon und Lautsprecher zu ermöglichen.
• - Zur Verbesserung des Klangerlebnisses kann ein System mit mehreren Lautsprechern verwendet werden. Die Lautsprecher können innerhalb der Ohrmuschel verteilt werden, wie dies am Beispiel des Lautsprechers S2 veranschaulicht ist.
• - Mehrere Mikrofone und die Kopplung von Links-/Rechts-Gerätesignalen können verwendet werden, um die zu verstärkende Stimme im Vordergrund zu erkennen. Die Kombination der Mikrofonsignale kann z.B. mittels Beamforming und/oder einer Auswertung des Angle of Arrival - AoA erfolgen und/oder es kann eine MIMO-Stimmextraktion mittels eines maschinellen Lernmodells genutzt werden (MIMO - multiple input, multiple output).
• - Künstliche Intelligenz kann eingesetzt werden (eine geringe Latenz kleiner als 30 ms konnte erreicht werden), um die Stimme der sprechenden Person für die weitere Verarbeitung und Verstärkung herauszufiltern oder zu extrahieren, um insbesondere nur die extrahiere Stimme über den Lautsprecher / die Lautsprecher verstärkt auszugeben.
• - Modifikationen und Veränderungen des Sprachsignals können vorgenommen werden, um ein Feedback zu vermeiden, z.B. mittels Frequenzmodulation und/oder Stimmverfremdung / Stimmänderung.

There are the following advantageous further training courses:

• - The respective or an assistance device can be controlled and adjusted externally via a PC or a smartphone and a BT connection (BT - Bluetooth) according to further training.
• - The speaker can also be placed behind, on or in front of the intertragal notch to improve sound quality and allow better spatial decoupling between microphone and speaker.
• - To enhance the sound experience, a multi-speaker system can be used. The speakers can be distributed within the ear cup, as illustrated with the S2 speaker.
• - Multiple microphones and the coupling of left/right device signals can be used to detect the foreground voice to be amplified. The microphone signals can be combined using beamforming and/or Angle of Arrival (AoA) analysis, and/or MIMO (multiple input, multiple output) voice extraction using a machine learning model.
• - Artificial intelligence can be used (a low latency of less than 30 ms could be achieved) to filter or extract the voice of the speaking person for further processing and amplification, in particular to output only the extracted voice amplified through the loudspeaker(s).
• - Modifications and changes to the speech signal can be made to avoid feedback, e.g. by means of frequency modulation and/or voice distortion / voice change.

1. 1. Hörassistenzvorrichtung, aufweisend zumindest ein Assistenzgerät (Ohrhörer), das an einem jeweiligen Ohr eines Nutzers zu tragen ist und das eine Mikrofoneinrichtung zum Erfassen von Umgebungsschall einer Umgebung des Nutzers sowie eine Lautsprechereinrichtung zum Erzeugen von Unterstützungsschall, der den Nutzer dabei unterstützt, mit dem jeweiligen Ohr einen vorgegebenen Audioinhalt, der in dem Umgebungsschall enthalten ist, wahrzunehmen, dadurch gekennzeichnet, dass das jeweilige Assistenzgerät eine Halteeinrichtung aufweist, die dazu eingerichtet ist, das Assistenzgerät an dem jeweiligen Ohr in einer Tragestellung zu halten,
   • • in welcher das Assistenzgerät außerhalb eines Gehörgangs des Ohrs angeordnet ist und der Gehörgang vollständig frei von der Hörassistenzvorrichtung bleibt, sodass der Umgebungsschall aus der Umgebung blockadefrei in den Gehörgang dringt, und
   • • in welcher eine Hauptausgaberichtung der Lautsprechereinrichtung, entlang welcher die Lautsprechereinrichtung den Unterstützungsschall mit größter Lautstärke abstrahlt, zu dem Ohr hin ausgerichtet ist, wodurch der Unterstützungsschall dem Umgebungsschall im Gehörgang überlagert ist, und
   eine elektronische Signalverarbeitungseinrichtung der Hörassistenzvorrichtung dazu einrichtet ist, zumindest ein Mikrofonsignal der Mikrofoneinrichtung, welches den erfassten Umgebungsschall signalisiert, zu empfangen und daraus ein Steuersignal zu erzeugen, durch welches die Lautsprechereinrichtung den Unterstützungsschall mit dem Audioinhalt erzeugt.
2. 2. Hörassistenzvorrichtung nach Aspekt 1, wobei die Signalverarbeitungseinrichtung dazu eingerichtet ist, mittels eines maschinellen Lernmodells aus dem zumindest einen Mikrofonsignal ein Stimmensignal einer Stimme als den Audioinhalt zu extrahieren und das Steuersignal nur mit dem extrahierten Stimmensignal ohne jedes übrige Mikrofonsignal zu erzeugen.
3. 3. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei das jeweilige Assistenzgerät eine Rückkopplungsunterdrückungseinrichtung aufweist, welche dazu eingerichtet ist, einen Rückkopplungsanteil des Unterstützungsschalls, welcher von der Lautsprechereinrichtung über eine Luftstrecke und/oder als Körperschall zu der Mikrofoneinrichtung rückkoppelt, und/oder in dem zumindest eine Mikrofonsignal einen Signalanteil des Unterstützungsschalls, der in dem zumindest einen Mikrofonsignal als Rückkopplung enthalten ist, zu dämpfen.
4. 4. Hörassistenzvorrichtung nach Aspekt 3, wobei die Rückkopplungsunterdrückungseinrichtung eine Modulation umfasst, die eingerichtet ist, einen Signalanteil des zumindest einen Mikrofonsignals, welcher den Audioinhalt signalisiert und dabei einen ersten Frequenzbereich einnimmt, in einen von dem ersten Frequenzbereich ganz oder teilweise verschiedenen zweiten Frequenzbereich zu verschieben (z.B. mittels Einseitenbankmodulation), und das Steuersignal in dem zweiten Frequenzbereich zu erzeugen.
5. 5. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei die Signalverarbeitungseinrichtung eine Sprecheränderung, die ein maschinelles Lernmodell umfasst, und/oder eine Stimmverfremdung, die eine Verzerrungsprozedur umfasst, aufweist, welche jeweils dazu eingerichtet ist, den Audioinhalt in dem Unterstützungsschall mit einer anderen Stimme und/oder mit einer verfremdeten Stimme im Vergleich zu einer in dem zumindest einen Mikrofonsignal enthaltenen Stimme, welche den Audioinhalt mitteilt, zu erzeugen.
6. 6. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei die Signalverarbeitungseinrichtung dazu eingerichtet ist, das Steuersignal mit einem Phasenversatz bezüglich des Mikrofonsignals zu erzeugen, welcher in der Tragestellung eine konstruktive Interferenz des Umgebungsschalls einerseits und des Unterstützungsschalls andererseits im Gehörgang (in einem vorbestimmten Abstand, z.B. im Bereich 1 cm bis 7 cm zur Lautsprechereinrichtung) erzeugt, wobei der Phasenversatz eine frequenzabhängige Phasenverschiebung umfasst, die für unterschiedliche Frequenzen eine andere Phasenwinkel anwendet, um für mehrere der Frequenzen die konstruktive Interferenz im selben Abstand zur Mikrofoneinrichtung zu bewirken. (insbesondere am Trommelfell des Ohres, kann individuell vermessen werden oder mittels Kalibrierroutine ermittelt werden, entsprechende Kalibrierdaten können im Assistenzgerät gespeichert gehalten werden)
7. 7. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei in dem jeweiligen Assistenzgerät die Lautsprechereinrichtung einen Lautsprecher umfasst, der in dem Fall, dass die Halteeinrichtung das Assistenzgerät in der Tragestellung am Ohr hält, von der Umgebung aus gesehen vor oder in oder hinter einer intertragalen Kerbe des Ohrs angeordnet ist. (Durchmesser des Lautsprechers insbesondere kleiner als 15 mm, insbesondere kleiner als 12 mm)
8. 8. Hörassistenzvorrichtung nach Aspekt 7, wobei eine Geometrie des Assistenzgeräts und die Halteeinrichtung dazu eingerichtet sind, dass in der Tragestellung eine Schalleinlassöffnung der Mikrofoneinrichtung, durch welche hindurch der Umgebungsschall zum Erfassen in die Mikrofoneinrichtung eindringt, in einem Abstand von mindestens 5 Millimeter von der Kerbe und außerhalb einer Ohrmuschel des Ohrs angeordnet gehalten ist.
9. 9. Hörassistenzvorrichtung nach Aspekt 7 oder 8, wobei bei dem jeweiligen Assistenzgerät die jeweilige Lautsprechereinrichtung zumindest einen Zusatzlautsprecher umfasst, wobei in der Tragestellung einer davon innerhalb einer Ohrmuschel des Ohrs und/oder einer davon an einem Antitragus des Ohres angeordnet ist. (Halteeinrichtung und/oder Gehäuse des Assistenzgeräts entsprechend geformt; Durchmesser Lautsprecher und/oder Zusatzlautsprecher dabei insbesondere kleiner als 12 mm)
10. 10. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei bei dem jeweiligen Assistenzgerät die Mikrofoneinrichtung mehrere Mikrofone aufweist und dazu eingerichtet ist, damit mehrere Mikrofonsignale zu erzeugen, und/oder die Hörassistenzvorrichtung mehrere Assistenzgeräte aufweist und mittels deren Mikrofoneinrichtungen mehrere Mikrofonsignale zu erzeugen, und die Signalverarbeitungseinrichtung eine Verarbeitungslogik aufweist, die aus den mehreren Mikrofonsignalen einen Schallsignalanteil, der aus einer vorgegebenen Raumrichtung (insbesondere von vorne ins Gesicht des Nutzers) auf die Hörassistenzeinrichtung auftrifft und in den Mikrofonsignalen mit einer der Raumrichtung entsprechenden relativen Phasenlage zueinander enthalten ist, selektiv als den Audioinhalt zu verstärken. (Beamforming, Delay-and-Sum, spektrale Auswertung der Phase)
11. 11. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei eine Funkeinrichtung der Hörassistenzvorrichtung dazu eingerichtet ist, über eine Funkverbindung aus einem externen Bediengerät zumindest einen Konfigurationsbefehl zu empfangen. (z.B. für Lautstärke, Hörprogramm)
12. 12. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei die Signalverarbeitungseinrichtung dazu eingerichtet ist, nutzerspezifische Hörkurvendaten, welche mit einem frequenzspezifischen Hörvermögen des Nutzers korrelieren oder das Hörvermögen beschreiben, gespeichert zu halten und für das Erzeugen des Unterstützungsschalls eine relative Verstärkung unterschiedlicher Frequenzen mittels des Steuersignals gemäß den Hörkurvendaten einzustellen.
13. 13. Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei die Signalverarbeitungseinrichtung dazu eingerichtet ist, eine adaptive, dynamische Verstärkung des Unterstützungssignals durchzuführen, bei welcher
    • c) im Verhältnis leisere, den Audioinhalt signalisierende Nutzsignale mehr verstärkt werden als im Verhältnis dazu lautere Nutzsignale, sodass nach der Überlagerung mit dem Umgebungsschall im Gehörgang eine geringere relative Lautstärkedynamik der überlagerten Schalle vorliegt als beim Umgebungsschall alleine, und/oder
    • d) ein Rauschpegel eines Rauschens der Umgebung, das in dem zumindest einen Mikrofonsignal ein von dem Audioinhalt verschiedener Rauschanteil ist, ermittelt wird, und eine Lautstärke des Unterstützungsschalls abhängig von dem ermittelten Rauschpegel eingestellt wird, sodass sich nach der Überlagerung mit dem Umgebungsschall im Gehörgang der Audioinhalt mit einem Lautstärkepegel größer als der Geräuschpegel ergibt.
14. 14. Verfahren zum Betreiben einer Hörassistenzvorrichtung nach einem der vorhergehenden Aspekte, wobei an zumindest einem Ohr eines Nutzers jeweils durch ein Assistenzgerät der Hörassistenzvorrichtung mittels einer Mikrofoneinrichtung ein Umgebungsschall erfasst und der erfasste Umgebungsschall als zumindest ein Mikrofonsignal signalisiert wird, und durch eine Signalverarbeitungseinrichtung der Assistenzvorrichtung aus dem zumindest einen Mikrofonsignal ein Steuersignal für eine Lautsprechereinrichtung ein Steuersignal erzeugt wird, welches einen in dem zumindest einen Mikrofonsignal signalisierten Audioinhalt, insbesondere nur diesen, enthält, und die Lautsprechereinrichtung einen Unterstützungsschall zu dem Ohr hin abgibt, wobei der Unterstützungsschall einen Audioinhalt enthält, der auch in dem Umgebungsschall enthalten ist, wobei durch die Hörassistenzvorrichtung ein Gehörgang des Ohres freigelassen wird.

The following lists further aspects of the hearing assistance device as they are part of the invention:

1. 1. Hearing assistance device, comprising at least one assistance device (earphone) which is to be worn on a respective ear of a user and which has a microphone device for detecting ambient sound of an environment of the user and a loudspeaker device for generating support sound which supports the user in perceiving with the respective ear a predetermined audio content which is contained in the ambient sound, characterized in that the respective assistance device has a holding device which is configured to hold the assistance device on the respective ear in a wearing position,
   • • in which the assistive device is positioned outside the ear canal and the ear canal remains completely free of the hearing assistance device, so that ambient sound from the environment penetrates the ear canal without blockage, and
   • • in which a main output direction of the loudspeaker device, along which the loudspeaker device radiates the support sound with the greatest volume, is directed towards the ear, whereby the support sound is superimposed on the ambient sound in the ear canal, and
   an electronic signal processing device of the hearing assistance device is configured to receive at least one microphone signal of the microphone device, which signals the detected ambient sound, and to generate a control signal therefrom, through which the loudspeaker device generates the support sound with the audio content.
2. 2. Hearing assistance device according to aspect 1, wherein the signal processing device is configured to extract a voice signal of a voice as the audio content from the at least one microphone signal by means of a machine learning model and to generate the control signal only with the extracted voice signal without any remaining microphone signal.
3. 3. Hearing assistance device according to one of the preceding aspects, wherein the respective assistance device has a feedback suppression device which is configured to dampen a feedback component of the support sound which feeds back from the loudspeaker device via an air path and/or as structure-borne sound to the microphone device, and/or in the at least one microphone signal a signal component of the support sound which is contained in the at least one microphone signal as feedback.
4. 4. Hearing assistance device according to aspect 3, wherein the feedback suppression device comprises a modulation which is configured to shift a signal component of the at least one microphone signal, which signals the audio content and thereby occupies a first frequency range, into a second frequency range which is completely or partially different from the first frequency range (e.g. by means of single-side bank modulation), and to generate the control signal in the second frequency range.
5. 5. Hearing assistance device according to one of the preceding aspects, wherein the signal processing device has a speaker change comprising a machine learning model and/or a voice alienation comprising a distortion procedure, which is each configured to generate the audio content in the support sound with a different voice and/or with an alienated voice compared to a voice contained in the at least one microphone signal which communicates the audio content.
6. 6. Hearing assistance device according to one of the preceding aspects, wherein the signal processing device is configured to generate the control signal with a phase offset with respect to the microphone signal, which, in the wearing position, generates constructive interference of the ambient sound on the one hand and the support sound on the other hand in the ear canal (at a predetermined distance, e.g., in the range of 1 cm to 7 cm from the loudspeaker device). The phase offset comprises a frequency-dependent phase shift that applies a different phase angle for different frequencies in order to effect constructive interference for several of the frequencies at the same distance from the microphone device. (In particular, at the eardrum of the ear, this can be individually measured or determined using a calibration routine; corresponding calibration data can be stored in the assistance device)
7. 7. Hearing assistance device according to one of the preceding aspects, wherein in the respective assistance device, the loudspeaker device comprises a loudspeaker which, when the holding device holds the assistance device in the wearing position against the ear, is arranged in front of, in, or behind an intercostal notch of the ear, as seen from the surroundings. (Diameter of the loudspeaker in particular less than 15 mm, in particular less than 12 mm)
8. 8. Hearing assistance device according to aspect 7, wherein a geometry of the assistance device and the holding device are configured such that, in the wearing position, a sound inlet opening of the microphone device, through which the ambient sound penetrates into the microphone device for detection, is arranged at a distance of at least 5 millimeters from the notch and outside an auricle of the ear.
9. 9. Hearing assistance device according to aspect 7 or 8, wherein in the respective assistance device, the respective loudspeaker device comprises at least one additional loudspeaker, wherein, in the wearing position, one of these is arranged within an auricle of the ear and/or one of these is arranged on an antitragus of the ear. (Holding device and/or housing of the assistance device shaped accordingly; diameter of the loudspeaker and/or additional loudspeaker is in particular less than 12 mm)
10. 10. Hearing assistance device according to one of the preceding aspects, wherein in the respective assistance device the microphone device has a plurality of microphones and is configured to generate a plurality of microphone signals therewith, and/or the hearing assistance device has a plurality of assistance devices and to generate a plurality of microphone signals by means of their microphone devices, and the signal processing device has a processing logic which, from the plurality of microphone signals, a sound signal component which is emitted from a predetermined spatial direction (in particular from the front into the face of the user) onto The hearing aid device is impinged upon and contained in the microphone signals with a relative phase position corresponding to the spatial direction, selectively amplifying the audio content. (Beamforming, delay-and-sum, spectral phase evaluation)
11. 11. Hearing assistance device according to one of the preceding aspects, wherein a radio device of the hearing assistance device is configured to receive at least one configuration command (e.g., for volume, hearing program) from an external control device via a radio connection.
12. 12. Hearing assistance device according to one of the preceding aspects, wherein the signal processing device is configured to store user-specific hearing curve data which correlate with a frequency-specific hearing ability of the user or describe the hearing ability, and to adjust a relative amplification of different frequencies by means of the control signal in accordance with the hearing curve data for generating the support sound.
13. 13. Hearing assistance device according to one of the preceding aspects, wherein the signal processing device is configured to carry out an adaptive, dynamic amplification of the assistance signal, in which
    • c) relatively quieter useful signals signalling the audio content are amplified more than relatively louder useful signals, so that after superimposition with the ambient sound in the ear canal, the relative volume dynamics of the superimposed sounds are lower than with the ambient sound alone, and/or
    • d) a noise level of an ambient noise which in the at least one microphone signal is a noise component different from the audio content is determined, and a volume of the support sound is adjusted depending on the determined noise level, so that after superimposition with the ambient sound in the ear canal the audio content results with a volume level greater than the noise level.
14. 14. A method for operating a hearing assistance device according to one of the preceding aspects, wherein an ambient sound is detected at at least one ear of a user by an assistance device of the hearing assistance device by means of a microphone device and the detected ambient sound is signaled as at least one microphone signal, and a signal processing device of the assistance device generates a control signal for a loudspeaker device from the at least one microphone signal, which control signal contains an audio content signaled in the at least one microphone signal, in particular only this, and the loudspeaker device emits a support sound to the ear, wherein the support sound contains audio content that is also contained in the ambient sound, wherein an auditory canal of the ear is left free by the hearing assistance device.

QUOTES CONTAINED IN THE DESCRIPTION

This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions.

Cited patent literature

• EP 3466107A1 [0023]

Claims (13)

An earphone device comprising at least one output device (earphone) to be worn on a respective ear and comprising a loudspeaker device for generating output sound with audio content, wherein the respective output device comprises a holding device configured to hold the output device on the respective ear in a wearing position, • in which the output device is arranged outside an auditory canal of the ear and the auditory canal remains completely free of the earphone device, so that ambient sound from the environment penetrates directly into the auditory canal (open connection), and • in which a main output direction of the loudspeaker device, along which the loudspeaker device emits the output sound with the greatest volume, is directed towards the ear, whereby the output sound is superimposed on the ambient sound in the auditory canal, characterized in that in the respective output device, the loudspeaker device comprises a loudspeaker which, when the holding device holds the output device in the wearing position on the ear, is arranged in front of, in or behind an inter-ear notch of the ear, as seen from the surroundings, wherein a sound radiation surface of the loudspeaker has a maximum external dimensions less than 20 millimeters. Earphone device according to Claim 1 , wherein the respective output device has a housing body which, in the carrying position, is arranged in front of the ear and thereby on the ear as seen from the surroundings by the holding device and which has a housing extension which, in the carrying position, projects through the notch to behind the notch, where the loudspeaker is held behind the notch in the housing extension or which is designed as a sound funnel for the loudspeaker arranged in or in front of the notch. Earphone device according to Claim 2 , wherein the housing extension in the area of the loudspeaker (behind the notch) has a collar (ring or partial ring or a thickening) by means of which an outer diameter of the housing extension is larger than in an area of the housing extension which is to be arranged in the notch in the wearing position, and the collar in the wearing position engages behind an edge of the notch which is formed by a tragus of the ear and an antitragus of the ear and thereby holds the output device on the ear. Earphone device according to Claim 1 , wherein the respective output device has a housing body which, as seen from the surroundings in the carrying position, is arranged in front of the ear and thereby on the ear by the holding device and which has a housing extension which only projects into the notch, where in the housing extension the loudspeaker is held in the notch and is designed to radiate its share of the output sound towards the ear, or where the housing extension serves as a sound funnel for the loudspeaker held in front of the notch. Earphone device according to Claim 1 , wherein the respective output device is held in front of the notch when the loudspeakers are in the carrying position, as seen from the surroundings, and is designed to radiate its share of the output sound with its main output direction directly into the notch and/or through the notch. An earphone device according to one of the preceding claims, wherein, in the respective output device, the respective loudspeaker device comprises at least one additional loudspeaker for generating a respective additional portion of the output sound, wherein, in the wearing position, one of these is arranged within an auricle of the ear, in particular in the concha, and/or one of these is arranged on an antitragus of the ear. (Holding device and/or housing of the output device shaped accordingly, in particular diameter of the additional loudspeaker less than 12 mm) Earphone device according to Claim 6 , wherein at least one of the at least one additional loudspeaker is arranged in a saddle part of the holding device, wherein the saddle part is configured to rest on the antitragus as a saddle in the wearing position and, for this purpose, has a recess for inserting the antitragus. (Shape can be customized to the user) Earphone device according to Claim 6 or 7 , wherein the respective output device has a crossover which is configured to output a low-pass range of the output sound exclusively by means of the loudspeaker and a high-pass range which is higher in frequency than the low-pass range exclusively by means of the at least one additional loudspeaker (tweeter). Earphone device according to one of the Claims 6 until 8 , wherein the earphone device is configured to apply a predetermined and/or variably adjustable phase shift to a respective loudspeaker signal for the loudspeaker and for the respective additional loudspeaker (in addition to a processing-related overall delay), wherein in particular different phase shifts are applied for at least two loudspeaker signals. Earphone device according to one of the preceding claims, wherein the respective output device comprises a microphone device for detecting ambient sound of a user's environment, wherein the loudspeaker device is configured to assist the user in perceiving with the respective ear a predetermined audio content contained in the ambient sound (audio content can be speech and/or music and/or it can come from a predetermined direction of incidence, e.g. frontally from the front in relation to a face of the user), in that an electronic signal processing device of the earphone device is configured to receive at least one microphone signal from the microphone device, which signals the detected ambient sound and/or the audio content extracted therefrom (predefined frequency range and/or a voice signal), and to generate therefrom a control signal by means of which the loudspeaker device generates the output sound with the audio content. Earphone device according to Claim 10 , wherein the signal processing device is configured to extract a voice signal of a voice as the audio content from the at least one microphone signal using a machine learning model and to generate the control signal using only the extracted voice signal without any remaining microphone signal. (Low-latency artificial intelligence, Greenwave™ offers a corresponding processor) Earphone device according to one of the preceding claims, wherein a radio device of the earphone device is configured to receive at least one configuration command and/or an audio signal for the loudspeaker device from an external operating device via a radio connection. Method for operating an earphone device according to one of the preceding claims, wherein at least one ear in each case by an output device of the earphone device by means of a loudspeaker device an output sound is generated in an intertragal notch or, as seen from a surrounding of the ear, behind the intertragal notch or generated immediately in front of the intertragal notch and is radiated with a main radiation direction into the intertragal notch.

Images