[go: up one dir, main page]

CN114302296A - Sound automatic adjustment method, device, equipment and storage medium - Google Patents

Sound automatic adjustment method, device, equipment and storage medium Download PDF

Info

Publication number
CN114302296A
CN114302296A CN202111610446.2A CN202111610446A CN114302296A CN 114302296 A CN114302296 A CN 114302296A CN 202111610446 A CN202111610446 A CN 202111610446A CN 114302296 A CN114302296 A CN 114302296A
Authority
CN
China
Prior art keywords
sound
emotional
user
mental state
playback device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111610446.2A
Other languages
Chinese (zh)
Inventor
奚晓钰
陆彦良
周苏建
李东晓
移金圣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
MIGU Culture Technology Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
MIGU Culture Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, MIGU Culture Technology Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202111610446.2A priority Critical patent/CN114302296A/en
Publication of CN114302296A publication Critical patent/CN114302296A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

The embodiment of the invention relates to the technical field of sound regulation, and discloses a sound automatic regulation method, a device, equipment and a storage medium, wherein the method comprises the following steps: acquiring the current physiological index of a user in real time; confirming target sound attribute data corresponding to the current physiological index based on a corresponding relation between a pre-stored physiological index and sound attribute data; and adjusting parameters of the sound playing equipment worn by the user according to the target sound attribute data. According to the embodiment of the invention, the current physiological indexes of the user are collected in real time during sound playing, and the parameters of the sound playing equipment are adjusted according to the current physiological indexes, so that the sound played by the sound playing equipment is most suitable for the user, and the hearing experience of the user is improved.

Description

声音自动调节方法、装置、设备及存储介质Sound automatic adjustment method, device, equipment and storage medium

技术领域technical field

本发明实施例涉及声音调节技术领域,具体涉及一种声音自动调节方法、装置、设备及存储介质。Embodiments of the present invention relate to the technical field of sound adjustment, and in particular, to a method, apparatus, device, and storage medium for automatic sound adjustment.

背景技术Background technique

目前电影院、演唱会等现场音效都是采用专业设备,环绕音效,是很多年轻人闲暇时光不错的娱乐选择。但与此同时,这样的特殊音效虽然在年轻人感知里很嗨、很劲爆、很减压、很有现场感,但对于年幼的小孩和年纪稍大的老人就不友好了,首先老年人的感官体验无法承受过于激情的特殊音效,其次对小孩的会担心伤害听觉系统,所以这些地方几乎很少看见有年幼或年纪稍大的消费者。并且对于年轻消费者,时长两三小时的电影、演唱会,视听过程中也会出现听觉疲劳等生理不适,导致视听体验降低。At present, on-site sound effects such as cinemas and concerts use professional equipment and surround sound, which is a good entertainment choice for many young people in their spare time. But at the same time, although such special sound effects are very exciting, explosive, stress-relieving and lively in the perception of young people, they are not friendly to young children and older people. First of all, the elderly The sensory experience of the people can't bear the special sound effects that are too passionate, and secondly, the children's will worry about hurting the auditory system, so there are few young or older consumers in these places. And for young consumers, two or three hours of movies and concerts will also experience physical discomfort such as auditory fatigue during the audio-visual process, resulting in a reduced audio-visual experience.

发明内容SUMMARY OF THE INVENTION

鉴于上述问题,本发明实施例提供了一种声音自动调节方法、装置、设备及存储介质,用于解决现有的声音播放设备无法适应不同年龄段用户需求的问题。In view of the above problems, the embodiments of the present invention provide an automatic sound adjustment method, device, device and storage medium, which are used to solve the problem that the existing sound playback device cannot meet the needs of users of different ages.

根据本发明实施例的一个方面,提供了一种声音自动调节方法,所述方法包括:实时采集用户的当前生理指标;基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。According to an aspect of the embodiments of the present invention, an automatic sound adjustment method is provided. The method includes: collecting a user's current physiological index in real time; The target sound attribute data corresponding to the physiological index; the parameters of the sound playback device worn by the user are adjusted according to the target sound attribute data.

在一种可选的方式中,所述方法还包括:确认所述声音播放设备当前播放的声音内容包含的情感信息;根据所述情感信息进行预测,得到所述用户的预测精神状态;基于预设情感算法,结合所述当前生理指标对用户的精神状态进行判断,确认所述用户的实际精神状态;对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节。In an optional manner, the method further includes: confirming emotional information contained in the sound content currently played by the sound playback device; making predictions according to the emotional information to obtain the predicted mental state of the user; Suppose an emotion algorithm to judge the mental state of the user in combination with the current physiological indicators, and confirm the actual mental state of the user; compare the predicted mental state and the actual mental state, and perform the sound playback device according to the comparison result. parameters to adjust.

在一种可选的方式中,所述对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节,包括:基于预先设定的情绪级别和情绪方向确认所述预测精神状态对应的第一情绪类别集和所述实际精神状态对应的第二情绪类别集;判断所述第一情绪类别集和所述第二情绪类别集是否相同;若是,则确认所述用户出现有效正向共情,维持所述声音播放设备当前的参数;若否,则确认所述用户出现无效或负向共情,调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间。In an optional manner, the comparing the predicted mental state and the actual mental state, and adjusting the parameters of the sound playback device according to the comparison result, including: based on preset emotional levels and emotions The direction confirms the first emotional category set corresponding to the predicted mental state and the second emotional category set corresponding to the actual mental state; judges whether the first emotional category set and the second emotional category set are the same; if so, then Confirm that the user has valid positive empathy, and maintain the current parameters of the sound playback device; if not, confirm that the user has invalid or negative empathy, and adjust the parameters of the sound playback device to reduce the invalidity or emotional impact and emotional duration of negative empathy.

在一种可选的方式中,所述调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间,包括:获取预先采集的所述用户的初始生理指标;根据所述初始生理指标和所述预设情感算法确认所述用户的初始精神状态,并基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第三情绪类别集;确认所述第一情绪类别集和所述第二情绪类别集之间的不同情绪类别所组成的区别情绪类别集;从所述区别情绪类别集中剔除所述第三情绪类别集中出现的情绪类别,将剩余的情绪类别作为无效或负向共情的目标情绪类别;调节所述声音播放设备的参数,以将所述目标情绪类别的情绪影响力和情绪持续时间降低至相应预设情绪阈值以下。In an optional manner, the adjusting the parameters of the sound playback device to reduce the emotional influence and emotional duration of the invalid or negative empathy includes: acquiring pre-collected initial physiological parameters of the user index; confirm the initial mental state of the user according to the initial physiological index and the preset emotional algorithm, and confirm the third emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction; confirm A distinct emotional category set composed of different emotional categories between the first emotional category set and the second emotional category set; remove the emotional categories that appear in the third emotional category set from the differential emotional category set, and set the The remaining emotional categories are used as target emotional categories for invalid or negative empathy; the parameters of the sound playback device are adjusted to reduce the emotional influence and emotional duration of the target emotional categories to below the corresponding preset emotional threshold.

在一种可选的方式中,所述实时采集用户的当前生理指标之前,还包括:采集所述用户的初始生理指标;根据所述初始生理指标和预设情感算法确认所述用户的初始精神状态;基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第四情绪类别集;当所述第四情绪类别集中的情绪类别的情绪影响力超过预设感知阈值时,提示所述用户调节自身情绪。In an optional manner, before the real-time collection of the current physiological index of the user, the method further includes: collecting the initial physiological index of the user; confirming the initial mental state of the user according to the initial physiological index and a preset emotion algorithm Confirm the fourth emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction; when the emotional influence of the emotional category in the fourth emotional category set exceeds the preset perception threshold, prompt the users to regulate their emotions.

在一种可选的方式中,所述方法还包括:根据所述用户的当前生理指标获取所述用户的心率变化趋势和呼吸频率数据变化趋势;根据所述心率变化趋势和所述呼吸频率数据变化趋势确认所述用户进入疲劳状态时,调节所述声音播放设备的参数以提高声音对所述用户的情绪影响力。In an optional manner, the method further includes: acquiring the heart rate variation trend and the breathing frequency data variation trend of the user according to the current physiological index of the user; according to the heart rate variation trend and the breathing frequency data When the change trend confirms that the user is in a fatigued state, the parameters of the sound playback device are adjusted to improve the emotional influence of the sound on the user.

在一种可选的方式中,所述方法还包括:接收所述用户输入的声音调节请求;根据所述声音调节请求调节所述声音播放设备的参数。In an optional manner, the method further includes: receiving a sound adjustment request input by the user; and adjusting parameters of the sound playback device according to the sound adjustment request.

根据本发明实施例的另一方面,提供了一种声音自动调节装置,所述装置包括:采集模块,用于实时采集用户的当前生理指标;确认模块,用于基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;调节模块,用于根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。According to another aspect of the embodiments of the present invention, an apparatus for automatic sound adjustment is provided, the apparatus includes: a collection module for collecting current physiological indicators of a user in real time; a confirmation module for based on pre-stored physiological indicators and sounds The corresponding relationship of the attribute data confirms the target sound attribute data corresponding to the current physiological index; the adjustment module is configured to adjust the parameters of the sound playback device worn by the user according to the target sound attribute data.

根据本发明实施例的另一方面,提供了一种声音自动调节设备,包括:处理器、存储器、通信接口和通信总线,处理器、存储器和通信接口通过通信总线完成相互间的通信;存储器用于存放至少一可执行指令,可执行指令使处理器执行如上述任意一项的声音自动调节方法的操作。According to another aspect of the embodiments of the present invention, an automatic sound adjustment device is provided, including: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other through the communication bus; At least one executable instruction is stored, and the executable instruction causes the processor to perform the operation of any one of the above-mentioned automatic sound adjustment methods.

根据本发明实施例的又一方面,提供了一种计算机可读存储介质,存储介质中存储有至少一可执行指令,可执行指令在声音自动调节设备/装置上运行时,使得声音自动调节设备/装置执行如上述任意一项的声音自动调节方法的操作。According to yet another aspect of the embodiments of the present invention, a computer-readable storage medium is provided, and the storage medium stores at least one executable instruction. When the executable instruction is run on the automatic sound adjustment device/device, the automatic sound adjustment device / The apparatus performs the operations of the automatic sound adjustment method as described in any of the above.

本发明实施例通过实时获取用户的当前生理指标,根据用户的当前生理指标查询最适合该用户的声音属性数据,再根据该声音属性数据对该用户的声音播放设备的参数进行调节,从而能够让不同年龄段的用户享受到与自身生理指标相应的听觉体验,实现了对不同生理指标的用户进行个性化的听觉设定,提高了用户体验。The embodiment of the present invention obtains the current physiological index of the user in real time, queries the sound attribute data most suitable for the user according to the current physiological index of the user, and then adjusts the parameters of the user's sound playback device according to the sound attribute data, so as to make Users of different age groups can enjoy an auditory experience corresponding to their own physiological indicators, which realizes personalized auditory settings for users with different physiological indicators, and improves the user experience.

上述说明仅是本发明实施例技术方案的概述,为了能够更清楚了解本发明实施例的技术手段,而可依照说明书的内容予以实施,并且为了让本发明实施例的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to understand the technical means of the embodiments of the present invention more clearly, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and The advantages can be more clearly understood, and the following specific embodiments of the present invention are given.

附图说明Description of drawings

附图仅用于示出实施方式,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:The drawings are only used to illustrate the embodiments and are not considered to be limiting of the present invention. Also, the same components are denoted by the same reference numerals throughout the drawings. In the attached image:

图1示出了本发明第一实施例提供的声音自动调节方法的流程示意图;FIG. 1 shows a schematic flowchart of a method for automatic sound adjustment provided by a first embodiment of the present invention;

图2示出了本发明第二实施例提供的声音自动调节方法的流程示意图;2 shows a schematic flowchart of a method for automatic sound adjustment provided by a second embodiment of the present invention;

图3示出了本发明实施例提供的声音自动调节装置的结构示意图;FIG. 3 shows a schematic structural diagram of a sound automatic adjustment device provided by an embodiment of the present invention;

图4示出了本发明实施例提供的声音自动调节设备的结构示意图。FIG. 4 shows a schematic structural diagram of a sound automatic adjustment device provided by an embodiment of the present invention.

具体实施方式Detailed ways

下面将参照附图更详细地描述本发明的示例性实施例。虽然附图中显示了本发明的示例性实施例,然而应当理解,可以以各种形式实现本发明而不应被这里阐述的实施例所限制。Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be embodied in various forms and should not be limited by the embodiments set forth herein.

图1示出了本发明声音自动调节方法第一实施例的流程图,该方法由声音自动调节设备执行。如图1所示,该方法包括以下步骤:Fig. 1 shows a flow chart of the first embodiment of the method for automatic sound adjustment of the present invention, and the method is executed by an automatic sound adjustment device. As shown in Figure 1, the method includes the following steps:

步骤101:实时采集用户的当前生理指标。Step 101: Collect the current physiological indicators of the user in real time.

需要说明的是,本申请的声音自动调节方法可以适用于各种不同的场景,例如,电影院、演唱会现场、音乐厅等场所,其次,其同样适用于音乐播放设备,如耳机,家庭音响,车载播放设备等。It should be noted that the automatic sound adjustment method of the present application can be applied to various scenarios, such as movie theaters, concert sites, concert halls and other places. Car playback equipment, etc.

本实施例中,为了适用于不同年龄段的用户,需要采集用户的生理指标信息以方便根据用户的生理指标来调节声音播放设备的参数,其中该生理指标通过预先设定的生理指标采集器进行采集得到,例如,当用户佩戴耳机设备时,则该生理指标采集器可以设置在耳机上,用户佩戴该耳机时,即可通过生理指标采集器采集到用户的生理指标。In this embodiment, in order to be suitable for users of different ages, it is necessary to collect the physiological index information of the user to facilitate adjusting the parameters of the sound playback device according to the physiological index of the user, wherein the physiological index is collected by a preset physiological index collector. The acquisition is obtained, for example, when the user wears the headset device, the physiological index collector can be set on the headset, and when the user wears the headset, the physiological index collector of the user can collect the physiological index of the user.

在步骤101中,为了实现对用户所听到的声音进行有效调节,其需要实时采集用户的当前生理指标,根据实时采集的指标数据实现对用户听到的声音的实时调节。In step 101, in order to effectively adjust the sound heard by the user, it is necessary to collect the current physiological index of the user in real time, and realize the real-time adjustment of the sound heard by the user according to the index data collected in real time.

步骤102:基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据。Step 102: Confirm the target sound attribute data corresponding to the current physiological index based on the pre-stored correspondence between the physiological index and the sound attribute data.

需要说明的是,本实施例中的生理指标和声音属性数据的对应关系是通过预先获取的历史样本数据设定得到。其中,该生理指标和声音属性数据的对应关系可以预先存储至用户佩戴的声音播放设备的存储器中。It should be noted that the corresponding relationship between the physiological index and the sound attribute data in this embodiment is obtained by setting the historical sample data acquired in advance. The corresponding relationship between the physiological index and the sound attribute data may be pre-stored in the memory of the sound playback device worn by the user.

在步骤102中,在获取到用户的当前生理指标后,通过查询该生理指标和声音属性数据的对应关系即可确认与当前生理指标对应的目标声音属性数据,该目标声音属性数据即当前生理指标下,最适合用户的声音属性。In step 102, after obtaining the current physiological index of the user, the target sound attribute data corresponding to the current physiological index can be confirmed by querying the corresponding relationship between the physiological index and the sound attribute data, and the target sound attribute data is the current physiological index Next, the sound properties that best suit the user.

步骤103:根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。Step 103: Adjust parameters of the sound playback device worn by the user according to the target sound attribute data.

通常地,用户舒适音效是从用户心理觉知到响度、音调、音色三个属性指标来衡量,对声音的调节通常包括对声音的声响、音频和音波进行调节。Generally, the user's comfortable sound effects are measured from the user's psychological perception to three attribute indicators of loudness, pitch, and timbre.

在步骤103中,在得到目标声音属性数据后,即可根据该目标声音属性数据对用户佩戴的声音播放设备的声音播放参数进行调整,实现对声音的声响、音频和音波三个参数进行调节,以使得用户听到听觉体验较佳的声音。In step 103, after obtaining the target sound attribute data, the sound playback parameters of the sound playback device worn by the user can be adjusted according to the target sound attribute data, so as to adjust the three parameters of sound, audio and sound waves, So that the user can hear the sound with better listening experience.

本发明第一实施例通过实时获取用户的当前生理指标,根据用户的当前生理指标查询最适合该用户的声音属性数据,再根据该声音属性数据对该用户的声音播放设备的参数进行调节,从而能够让不同年龄段的用户享受到与自身生理指标相应的听觉体验,实现了对不同生理指标的用户进行个性化的听觉设定,提高了用户体验。The first embodiment of the present invention obtains the current physiological index of the user in real time, inquires about the sound attribute data most suitable for the user according to the current physiological index of the user, and then adjusts the parameters of the user's sound playback device according to the sound attribute data, thereby It enables users of different age groups to enjoy an auditory experience corresponding to their own physiological indicators, realizes personalized auditory settings for users with different physiological indicators, and improves user experience.

图2示出了本发明声音自动调节方法第二实施例的流程图,该方法由声音自动调节设备执行。如图2所示,该方法包括以下步骤:Fig. 2 shows a flow chart of the second embodiment of the method for automatic sound adjustment of the present invention, and the method is executed by an automatic sound adjustment device. As shown in Figure 2, the method includes the following steps:

步骤201:确认所述声音播放设备当前播放的声音内容包含的情感信息。Step 201: Confirm emotional information contained in the sound content currently played by the sound playback device.

需要理解的是,有效的情感共鸣能够大幅度提升用户的体验,例如,观看电影时,通过声音中所蕴含的情绪来调动用户的情绪,以与电影中的情绪进行共鸣,能够大幅度提升用户的观影体验。因此,本实施例中,为了提高用户的听觉体验,还可从声音播放设备播放的声音内容中所蕴含的情感与用户发声共鸣以提升使用体验。需要说明的是,该声音内容是指文本内容,而不是声音信息,通过解析该声音内容,即可获得该声音内容包含的情感信息。It should be understood that effective emotional resonance can greatly improve the user's experience. For example, when watching a movie, using the emotions contained in the sound to mobilize the user's emotions to resonate with the emotions in the movie can greatly improve the user's emotions. movie viewing experience. Therefore, in this embodiment, in order to improve the user's listening experience, the emotion contained in the sound content played by the sound playback device can also resonate with the user's voice to improve the user experience. It should be noted that the audio content refers to text content, not audio information, and emotional information contained in the audio content can be obtained by analyzing the audio content.

在步骤201中,当声音播放设备播放声音时,根据播放的声音内容来计算其中包含的情感信息。该情感信息即播放的声音中所携带的期望用户能够体验到的情感。In step 201, when the sound playing device plays the sound, the emotional information contained in the sound is calculated according to the content of the played sound. The emotion information is the emotion that the user is expected to experience in the played sound.

步骤202:根据所述情感信息进行预测,得到所述用户的预测精神状态。Step 202: Predict according to the emotional information to obtain the predicted mental state of the user.

在步骤S202中,利用该情感信息对用户应该产生的精神状态进行预测,例如,当声音中的情感信息是幸福时,则预测用户的精神状态的反应应该为兴奋、高兴、开心等。In step S202, use the emotional information to predict the mental state that the user should have. For example, when the emotional information in the voice is happiness, the predicted response of the user's mental state should be excited, happy, happy, etc.

步骤203:基于预设情感算法,结合所述当前生理指标对用户的精神状态进行判断,确认所述用户的实际精神状态。Step 203 : Judging the user's mental state based on the preset emotion algorithm in combination with the current physiological index, and confirming the user's actual mental state.

需要说明的是,该预设情感算法预先设定。目前,“情感计算”理论已得到较为广泛的研究,其可通过多种不同的算法来实现精神状态与生理指标的关系映射,如粒子群算法、K近邻算法、判别函数分析法、Marquardt反向传播以及支持向量机算法等。本实施例中,该预设情感算法可以基于上述算法中的任一种来实现。It should be noted that the preset emotion algorithm is preset. At present, the theory of "affective computing" has been widely studied, which can realize the relationship mapping between mental state and physiological indicators through a variety of different algorithms, such as particle swarm algorithm, K-nearest neighbor algorithm, discriminant function analysis method, Marquardt reverse Propagation and support vector machine algorithms, etc. In this embodiment, the preset emotion algorithm may be implemented based on any one of the above algorithms.

在步骤203中,在得到用户的预测精神状态后,利用采集的用户的当前生理指标,结合预先设定的预设情感算法来计算得到用户的实际精神状态。In step 203, after the predicted mental state of the user is obtained, the actual mental state of the user is calculated by using the collected current physiological index of the user in combination with a preset preset emotion algorithm.

步骤204:对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节。Step 204: Compare the predicted mental state with the actual mental state, and adjust the parameters of the sound playback device according to the comparison result.

在步骤204中,预测精神状态为期望用户听到当前播放的声音后所产生的精神状态,通过将预测精神状态与用户当前的实际精神状态进行对比,从而可以确认用户在听到声音播放设备播放的声音后,是否有产生相应的情绪,当用户未产生相应情绪时,说明用户的情绪并未得到良好的调动,未与声音内容产生共鸣,此时,则可通过调节声音播放设备的参数,提高播放的声音对用户情绪的感染力。In step 204, the predicted mental state is the mental state expected after the user hears the currently playing sound. By comparing the predicted mental state with the current actual mental state of the user, it can be confirmed that the user is listening to the sound playing device playing After the sound, whether there is a corresponding emotion, when the user does not generate the corresponding emotion, it means that the user's emotion has not been well mobilized and does not resonate with the content of the sound. At this time, you can adjust the parameters of the sound playback device. Improve the emotional appeal of the sound played to the user.

本实施例中,为了提升用户的体验,还需要考虑用户情感与声音内容情感的共鸣,在通过生理指标对声音播放设备的参数进行调整的方式在一些场景上具有良好的使用体验,例如话务员、学生学习场景等,但该种调节方式时未能有效地针对于情感进行多样化的调整,无法进一步提升用户的使用体验。有效的情感共鸣取决于从听觉刺激中识别情绪并做出适当反应的能力,研究发现,声音所传达的情感信息参与了大脑区域,但是,表达某些情绪的声音的某些声学特性会随产生声音的变化而显著变化,不管声源如何,这些大脑区域对不同的情绪在特定情况下会以相同的方式做出反应,通过生理指标传感器分析显示,主要和次要听觉皮层,后岛和顶盖的活动模式可以预测不同声音内容声音的情感信息,此外,有实验表明,前岛绝缘内的分类准确性与共情的行为测量相关,这些大脑区域带有特定于情绪的模式,这些模式在具有不同声学特性的声音中普遍存在,同样,具有较高共情能力的人具有与感知情绪有关的更独特的神经模式,这扩展了有关人脑如何从听觉刺激中提取情感含义的先前知识,并使我们能够有效地理解他人并与他人建立联系,同样对每个独立的个体,其共情能力、情感体验都是不一样的,需要在不破坏其正常共情情绪的基础上,有效调节其过度的泛化情绪以与声音内容产生共情是本实施例需要解决的问题。因此,本实施例在此基础上,结合用户的主要和次要听觉皮层,后岛和顶盖等的数据来综合确定用户的情感。其中,用户的主要和次要听觉皮层,后岛和顶盖等的数据可以使用生理指标传感器监测得到。在得到用户的情感后,将其与根据声音内容预测得到的预测情感进行比较,并根据比较结果来修改声音播放舍得参数,提高要用户与声音内容共情的可能性。In this embodiment, in order to improve the user's experience, it is also necessary to consider the resonance of the user's emotion and the emotion of the sound content, and the method of adjusting the parameters of the sound playback device through physiological indicators has a good use experience in some scenarios, such as operator, However, this adjustment method fails to effectively adjust the emotions in a variety of ways, and cannot further improve the user experience. Effective emotional resonance depends on the ability to recognize emotions from auditory stimuli and to respond appropriately These brain regions respond to different emotions in the same way in a given situation, regardless of the sound source, as shown by sensor analysis of physiological indicators, primary and secondary auditory cortex, posterior insula and parietal Activity patterns of lids can predict emotional information from sounds of different sound content, and in addition, experiments have shown that classification accuracy within anterior insula insulation correlates with behavioral measures of empathy, brain regions with emotion-specific patterns that are Prevalent in sounds of different acoustic properties, likewise, people with higher empathy have more distinct neural patterns related to perceived emotion, extending previous knowledge about how the human brain extracts emotional meaning from auditory stimuli, and It enables us to effectively understand and connect with others. Similarly, each individual has different empathy abilities and emotional experiences. It is necessary to effectively adjust their empathy on the basis of not destroying their normal empathy. Excessive generalization of emotions to empathize with sound content is a problem to be solved by this embodiment. Therefore, on this basis, the present embodiment comprehensively determines the user's emotion by combining the data of the user's primary and secondary auditory cortex, the posterior island and the roof. Among them, the user's primary and secondary auditory cortex, posterior insula and tectum, etc. data can be monitored using physiological indicators sensors. After the user's emotion is obtained, it is compared with the predicted emotion predicted according to the sound content, and the sound playback willingness parameter is modified according to the comparison result, so as to improve the possibility of asking the user to empathize with the sound content.

进一步的,步骤204具体包括:Further, step 204 specifically includes:

1、基于预先设定的情绪级别和情绪方向确认所述预测精神状态对应的第一情绪类别集和所述实际精神状态对应的第二情绪类别集。1. Confirm the first emotional category set corresponding to the predicted mental state and the second emotional category set corresponding to the actual mental state based on the preset emotional level and emotional direction.

为了方便理解,可以将其中的情感信息划分为至少两个情绪级别,其中一级情绪定义为基本情绪或直接情绪,例如幸福、悲伤和恐惧等情绪,二级情绪定义为间接情绪,如惊讶、震撼、哀叹、压抑、紧张、烦躁等。情绪级别旨在区分情绪的影响力,一级情绪影响力大于二级情绪,不同用户的情绪承受力预先设置为平均水平。进一步的,其还可通过多样本前期训练使得获得的情绪承受力因人而异,并且,当情绪影响力超出其情绪承受力,可触发声音属性调节操作。情绪方向包括积极情绪、中立情绪和消极情绪。情绪方向旨在区分情绪的可持续时间,即允许用户在不同方向上的情绪所持续的时间,中立情绪长于积极情绪长于消极情绪,同上,假设不同用户的情绪承受时间先设置为平均水平,同样其还可通过多样本前期训练使得获得的情绪承受时间因人而异,实际检测到其情绪持续时间超出其情绪承受时间,可触发声音属性调节操作。当情绪级别和情绪方向进行组合时,即可得到6种情绪类别,包括一级积极情绪、一级消极情绪、一级中立情绪、二级积极情绪、二级消极情绪和二级中立情绪。In order to facilitate understanding, the emotional information can be divided into at least two emotional levels, where the first-level emotion is defined as basic emotion or direct emotion, such as happiness, sadness and fear, and the second-level emotion is defined as indirect emotion, such as surprise, Shocked, lamented, depressed, nervous, irritable, etc. Emotion levels are designed to distinguish the influence of emotions. The influence of first-level emotions is greater than that of second-level emotions, and the emotional tolerance of different users is preset to an average level. Further, the multi-sample pre-training can also make the acquired emotional tolerance vary from person to person, and when the emotional influence exceeds the emotional tolerance, the sound attribute adjustment operation can be triggered. Emotional directions include positive emotions, neutral emotions, and negative emotions. Emotional direction is designed to distinguish the sustainable time of emotions, that is, the time that users’ emotions in different directions are allowed to last. Neutral emotions are longer than positive emotions and longer than negative emotions. Same as above, assuming that the emotional endurance time of different users is set to the average level first, the same It can also use multi-sample pre-training to make the obtained emotional endurance time vary from person to person. The actual detection of its emotional duration exceeds its emotional endurance time, which can trigger the sound attribute adjustment operation. When the emotion level and emotion direction are combined, six emotion categories can be obtained, including primary positive emotion, primary negative emotion, primary neutral emotion, secondary positive emotion, secondary negative emotion, and secondary neutral emotion.

具体地,在得到预测精神状态和实际精神状态后,对该预测精神状态和实际精神状态进行确认,从而得到预测精神状态对应的第一情绪类别集和实际精神状态对应的第二情绪类别集。需要理解的是,该第一情绪类别集和第二情绪类别集中均包含至少一种情绪类别。Specifically, after the predicted mental state and the actual mental state are obtained, the predicted mental state and the actual mental state are confirmed, thereby obtaining a first emotional category set corresponding to the predicted mental state and a second emotional category set corresponding to the actual mental state. It should be understood that both the first emotion category set and the second emotion category set include at least one emotion category.

2、判断所述第一情绪类别集和所述第二情绪类别集是否相同。2. Determine whether the first emotion category set and the second emotion category set are the same.

具体地,在得到第一情绪类别集和第二情绪类别集后,将第一情绪类别集和第二情绪类别集中的情绪类别进行一一比对,从而确认两者是否相同。Specifically, after the first emotional category set and the second emotional category set are obtained, the emotional categories in the first emotional category set and the second emotional category set are compared one-to-one, so as to confirm whether the two are the same.

3、若是,则确认所述用户出现有效正向共情,维持所述声音播放设备当前的参数。3. If yes, confirm that the user has valid positive empathy, and maintain the current parameters of the sound playback device.

具体地,当第一情绪类别集和第二情绪类别集完全相同时,则说明此时用户已经与声音内容产生了有效的正向共情,不再需要对声音进行调节,因此,维持声音播放设备当前的参数不进行调节。Specifically, when the first emotional category set and the second emotional category set are exactly the same, it means that the user has developed effective positive empathy with the sound content at this time, and it is no longer necessary to adjust the sound. Therefore, the sound playback is maintained. The current parameters of the device are not adjusted.

4、若否,则确认所述用户出现无效或负向共情,调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间。4. If not, confirm that the user has invalid or negative empathy, and adjust the parameters of the sound playback device to reduce the emotional influence and emotional duration of the invalid or negative empathy.

具体地,当第一情绪类别集和第二情绪类别集不相同或只有部分相同时,则说明此时用户与声音内容产生了无效或负向共情,此时则需要对声音播放设备的参数进行调节,从而使用户听到声音后,对用户的大脑形成正向刺激,以降低无效或负向共情的情绪影响力和情绪持续时间,使得用户能够逐渐产生正向共情,提升用户的体验。Specifically, when the first emotion category set and the second emotion category set are different or only partially the same, it means that the user has invalid or negative empathy with the sound content at this time, and at this time, it is necessary to adjust the parameters of the sound playback device. Adjust, so that after the user hears the sound, it will stimulate the user's brain positively, so as to reduce the emotional influence and emotional duration of invalid or negative empathy, so that the user can gradually develop positive empathy and improve the user's experience.

进一步的,在一些实施例中,当用户在使用声音播放设备进行声音播放之前,其已经具备一定的情绪状态,会导致调整用户情绪时产生影响,因此,该确认所述用户出现无效或负向共情,调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间的步骤,具体包括:Further, in some embodiments, before the user uses the sound playback device to play sound, the user already has a certain emotional state, which will cause an impact when adjusting the user's emotion. Therefore, the confirmation of the user is invalid or negative. Empathy, the steps of adjusting the parameters of the sound playback device to reduce the emotional influence and emotional duration of the invalid or negative empathy, specifically including:

4.1、获取预先采集的所述用户的初始生理指标。4.1. Acquire the pre-collected initial physiological indicators of the user.

具体地,在用户开始使用声音播放设备时,采集用户的初始生理指标。Specifically, when the user starts to use the sound playing device, the initial physiological index of the user is collected.

4.2、根据所述初始生理指标和所述预设情感算法确认所述用户的初始精神状态,并基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第三情绪类别集。4.2. Confirm the initial mental state of the user according to the initial physiological index and the preset emotional algorithm, and confirm the third emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction.

具体地,在获取到初始生理指标后,利用预设情感算法即可确认用户的初始精神状态,并结合预先设定的情绪级别和情绪方向确认其对应的第三情绪类别集。Specifically, after obtaining the initial physiological index, the user's initial mental state can be confirmed by using a preset emotional algorithm, and the corresponding third emotional category set can be confirmed in combination with the preset emotional level and emotional direction.

4.3、确认所述第一情绪类别集和所述第二情绪类别集之间的不同情绪类别所组成的区别情绪类别集。4.3. Confirm the differentiated emotional category set composed of different emotional categories between the first emotional category set and the second emotional category set.

具体地,通过比对第一情绪类别集和第二情绪类别集,从而得到由两者之间不同的情绪类别所组成的区别情绪类别集,例如,第一情绪类别集包括:一级积极情绪、二级积极情绪,第二情绪类别集包括:一级中立情绪、二级中立情绪、二级积极情绪,则区别情绪类别集包括:一级积极情绪、一级中立情绪、二级中立情绪。Specifically, by comparing the first emotional category set and the second emotional category set, a differentiated emotional category set composed of different emotional categories between the two is obtained. For example, the first emotional category set includes: first-level positive emotions , second-level positive emotions, the second emotion category set includes: first-level neutral emotions, second-level neutral emotions, and second-level positive emotions, and the distinguishing emotion category sets include: first-level positive emotions, first-level neutral emotions, and second-level neutral emotions.

4.4、从所述区别情绪类别集中剔除所述第三情绪类别集中出现的情绪类别,将剩余的情绪类别作为无效或负向共情的目标情绪类别。4.4. Eliminate the emotion categories that appear in the third emotion category set from the differentiated emotion category set, and use the remaining emotion categories as the target emotion categories for invalid or negative empathy.

具体地,在得到区别情绪类别集后,将其与第三情绪类别集进行比对,将区别情绪类别集中在第三情绪类别集中出现的情绪类别剔除,得到的剩余的情绪类别即用户在声音播放过程中所产生的无效或负向共情的目标情绪类别。Specifically, after obtaining the set of distinct emotional categories, compare it with the third emotional category set, and remove the emotional categories that appear in the third emotional category set, and the remaining emotional categories obtained are the user’s voice Target emotion categories for ineffective or negative empathy generated during playback.

4.5、调节所述声音播放设备的参数,以将所述目标情绪类别的情绪影响力和情绪持续时间降低至相应预设情绪阈值以下。4.5. Adjust the parameters of the sound playback device to reduce the emotional influence and emotional duration of the target emotional category to below the corresponding preset emotional threshold.

需要说明的是,该预设情绪阈值包括预设影响力阈值和预设持续时间阈值。其中,调整声音播放设备的参数的目的在于使得目标情绪类别的情绪影响力低于预设影响力阈值、使得情绪持续时间低于预设持续时间阈值。It should be noted that the preset emotion threshold includes a preset influence threshold and a preset duration threshold. The purpose of adjusting the parameters of the sound playback device is to make the emotional influence of the target emotion category lower than the preset influence threshold, and to make the emotional duration lower than the preset duration threshold.

具体地,针对于得到的目标情绪类别进行声音播放设备的参数调节,从而使得目标情绪类别的情绪影响力和情绪持续时间降低至相应预设情绪阈值以下,减少该类情绪类别对用户的情绪的影响。Specifically, the parameters of the sound playback device are adjusted for the obtained target emotional category, so that the emotional influence and emotional duration of the target emotional category are reduced to below the corresponding preset emotional threshold, and the effect of this emotional category on the user's emotions is reduced. influences.

本发明第二实施例在第一实施例的基础上,通过声音内容中的情感信息来预测与用户理应产生的预测精神状态,再与根据用户生理指标得到的实际精神状态进行比对,当两者不同时,调节声音播放设的参数,从而使得调节后播放的声音能够更大程度上带动用户的情绪,使得用户在情感上的感受更为强烈,进一步提高用户的听觉体验。On the basis of the first embodiment, the second embodiment of the present invention uses the emotional information in the audio content to predict the predicted mental state that the user should generate, and then compares it with the actual mental state obtained according to the user's physiological indicators. If the user is different, adjust the parameters of the sound playback device, so that the adjusted sound can drive the user's emotions to a greater extent, make the user's emotional feeling stronger, and further improve the user's listening experience.

进一步的,在第一实施例的基础上,其他实施例中,为了避免用户的初始情绪状态对用户造成的情绪影响过大,在步骤101之前,还包括:Further, on the basis of the first embodiment, in other embodiments, in order to prevent the user's initial emotional state from having too great an emotional impact on the user, before step 101, the method further includes:

1、采集所述用户的初始生理指标。1. Collect the initial physiological index of the user.

2、根据所述初始生理指标和预设情感算法确认所述用户的初始精神状态。2. Confirm the initial mental state of the user according to the initial physiological index and a preset emotional algorithm.

3、基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第四情绪类别集。3. Confirm the fourth emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction.

4、当所述第四情绪类别集中的情绪类别的情绪影响力超过预设感知阈值时,提示所述用户调节自身情绪。4. When the emotional influence of the emotional categories in the fourth emotional category set exceeds a preset perception threshold, prompt the user to adjust his emotions.

本实施例通过在用户使用声音播放设备进行声音播放之前,根据用户的初始生理指标来确认用户的初始情绪,并在与用户的初始情绪过于强烈时,提示用户调节自身的情绪,以方便后续用户能够快速与声音内容形成共情。In this embodiment, the user's initial emotion is confirmed according to the user's initial physiological index before the user uses the audio playback device to play the sound, and when the user's initial emotion is too strong, the user is prompted to adjust his own emotion, so as to facilitate subsequent users Ability to quickly develop empathy with sound content.

进一步的,在第一实施例的基础上,其他实施例中,为了避免用户出现听觉疲劳而降低使用体验,其还包括:Further, on the basis of the first embodiment, in other embodiments, in order to avoid the user's auditory fatigue and reduce the use experience, it further includes:

1、根据所述用户的当前生理指标获取所述用户的心率变化趋势和呼吸频率数据变化趋势。1. Acquire the change trend of the user's heart rate and respiratory rate data according to the current physiological index of the user.

2、根据所述心率变化趋势和所述呼吸频率数据变化趋势确认所述用户进入疲劳状态时,调节所述声音播放设备的参数以提高声音对所述用户的情绪影响力。2. When it is confirmed that the user is in a fatigued state according to the change trend of the heart rate and the change trend of the breathing frequency data, adjust the parameters of the sound playback device to improve the emotional influence of the sound on the user.

具体地,在获取到用户的当前生理指标后,从中提取得到用户的心率变化趋势和呼吸频率数据变化趋势,当心率变化趋势和呼吸频率数据变化趋势均持续处于平稳状态时,说明用户对当前声音播放器播放的声音产生的反馈较少,可能进入了疲劳状态,此时,则可调节所述声音播放设备的参数以提高声音对所述用户的情绪影响力,从而使得用户体验更佳。本实施例通过实时采集的用户的生理指标来确认用户的心率变化趋势和呼吸频率数据变化趋势,并根据心率变化趋势和呼吸频率数据变化趋势确认用户是否进入疲劳状态,若是,则调整声音播放设备的参数,进而调动用户的情绪,使得用户能够持续保持较高质量的听觉体验。Specifically, after obtaining the user's current physiological indicators, the user's heart rate change trend and respiratory frequency data change trend are extracted from it. When the heart rate change trend and the respiratory frequency data change trend are both in a steady state, it indicates that the user is not aware of the current sound. The sound played by the player produces less feedback and may be in a state of fatigue. In this case, the parameters of the sound playing device can be adjusted to improve the emotional influence of the sound on the user, thereby making the user experience better. In this embodiment, the change trend of the user's heart rate and the change trend of the breathing frequency data are confirmed by the real-time collected physiological indicators of the user, and whether the user is in a fatigued state is confirmed according to the change trend of the heart rate and the change trend of the breathing frequency data, and if so, the sound playback device is adjusted. parameters, and then mobilize the user's emotions, so that the user can continue to maintain a high-quality listening experience.

进一步的,在第一实施例的基础上,其他实施例中,为了进一步提升用户体验,还包括:Further, on the basis of the first embodiment, in order to further improve the user experience, other embodiments further include:

1、接收所述用户输入的声音调节请求;1. Receive a voice adjustment request input by the user;

2、根据所述声音调节请求调节所述声音播放设备的参数。2. Adjust the parameters of the sound playback device according to the sound adjustment request.

本实施例通过根据用户自身提出的个性化需求,对声音播放设备的参数进行调节,以适应用户的个性化追求,进而提升用户体验。In this embodiment, the parameters of the sound playback device are adjusted according to the personalized requirements put forward by the user to adapt to the personalized pursuit of the user, thereby improving the user experience.

图3示出了本发明声音自动调节装置实施例的结构示意图。如图3所示,该装置300包括:采集模块301、确认模块302和调节模块303。FIG. 3 shows a schematic structural diagram of an embodiment of the sound automatic adjustment device of the present invention. As shown in FIG. 3 , the apparatus 300 includes: a collection module 301 , a confirmation module 302 and an adjustment module 303 .

采集模块301,用于实时采集用户的当前生理指标;The collection module 301 is used to collect the current physiological index of the user in real time;

确认模块302,用于基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;A confirmation module 302, configured to confirm the target sound attribute data corresponding to the current physiological index based on the pre-stored correspondence between the physiological index and the sound attribute data;

调节模块303,用于根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。The adjustment module 303 is configured to adjust parameters of the sound playback device worn by the user according to the target sound attribute data.

在一种可选的方式中,调节模块303还用于:确认所述声音播放设备当前播放的声音内容包含的情感信息;根据所述情感信息进行预测,得到所述用户的预测精神状态;基于预设情感算法,结合所述当前生理指标对用户的精神状态进行判断,确认所述用户的实际精神状态;对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节。In an optional manner, the adjustment module 303 is further configured to: confirm the emotional information contained in the sound content currently played by the sound playback device; perform prediction according to the emotional information to obtain the predicted mental state of the user; Preset emotional algorithms, judge the user's mental state in combination with the current physiological index, and confirm the user's actual mental state; compare the predicted mental state and the actual mental state, and play the sound according to the comparison result Adjust the parameters of the device.

在一种可选的方式中,调节模块303执行对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节的操作具体包括:基于预先设定的情绪级别和情绪方向确认所述预测精神状态对应的第一情绪类别集和所述实际精神状态对应的第二情绪类别集;判断所述第一情绪类别集和所述第二情绪类别集是否相同;若是,则确认所述用户出现有效正向共情,维持所述声音播放设备当前的参数;若否,则确认所述用户出现无效或负向共情,调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间。In an optional manner, the operation of comparing the predicted mental state with the actual mental state by the adjustment module 303, and adjusting the parameters of the sound playback device according to the comparison result specifically includes: based on a preset Emotion level and emotional direction confirm the first emotional category set corresponding to the predicted mental state and the second emotional category set corresponding to the actual mental state; determine whether the first emotional category set and the second emotional category set are the same If it is, then confirm that the user has valid positive empathy, and maintain the current parameters of the sound playback device; if not, then confirm that the user has invalid or negative empathy, and adjust the parameters of the sound playback device to Reduce the emotional impact and emotional duration of the ineffective or negative empathy.

在一种可选的方式中,调节模块303执行调节所述声音播放设备的参数以降低所述无效或负向共情的情绪影响力和情绪持续时间的操作,具体包括:获取预先采集的所述用户的初始生理指标;根据所述初始生理指标和所述预设情感算法确认所述用户的初始精神状态,并确认所述初始精神状态对应的第三情绪类别集;确认所述第一情绪类别集和所述第二情绪类别集之间的不同情绪类别所组成的区别情绪类别集;从所述区别情绪类别集中剔除所述第三情绪类别集中出现的情绪类别,将剩余的情绪类别作为无效或负向共情的目标情绪类别;调节所述声音播放设备的参数,以将所述目标情绪类别的情绪影响力和情绪持续时间降低至相应预设情绪阈值以下。In an optional manner, the adjustment module 303 performs an operation of adjusting parameters of the sound playback device to reduce the emotional influence and emotional duration of the invalid or negative empathy, specifically including: obtaining pre-collected data the initial physiological index of the user; confirm the initial mental state of the user according to the initial physiological index and the preset emotion algorithm, and confirm the third emotional category set corresponding to the initial mental state; confirm the first emotion A distinct emotional category set composed of different emotional categories between the category set and the second emotional category set; remove the emotional categories that appear in the third emotional category set from the differential emotional category set, and use the remaining emotional categories as The target emotion category of invalid or negative empathy; adjust the parameters of the sound playback device to reduce the emotional influence and emotional duration of the target emotion category below the corresponding preset emotional threshold.

在一种可选的方式中,采集模块301执行实时采集用户的当前生理指标的操作之前,还用于:采集所述用户的初始生理指标;根据所述初始生理指标和预设情感算法确认所述用户的初始精神状态;基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第四情绪类别集;当所述第四情绪类别集中的情绪类别的情绪影响力超过预设感知阈值时,提示所述用户调节自身情绪。In an optional manner, before the collection module 301 performs the operation of collecting the current physiological index of the user in real time, it is further configured to: collect the initial physiological index of the user; the initial mental state of the user; confirm the fourth emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction; when the emotional influence of the emotional category in the fourth emotional category set exceeds the preset perception When the threshold is reached, the user is prompted to adjust his emotions.

在一种可选的方式中,调节模块303还用于:根据所述用户的当前生理指标获取所述用户的心率变化趋势和呼吸频率数据变化趋势;根据所述心率变化趋势和所述呼吸频率数据变化趋势确认所述用户进入疲劳状态时,调节所述声音播放设备的参数以提高声音对所述用户的情绪影响力。In an optional manner, the adjustment module 303 is further configured to: acquire the heart rate variation trend and the breathing frequency data variation trend of the user according to the current physiological index of the user; according to the heart rate variation trend and the breathing frequency When the data change trend confirms that the user is in a fatigued state, the parameters of the sound playback device are adjusted to improve the emotional influence of the sound on the user.

在一种可选的方式中,调节模块303还用于:接收所述用户输入的声音调节请求;根据所述声音调节请求调节所述声音播放设备的参数。In an optional manner, the adjustment module 303 is further configured to: receive a sound adjustment request input by the user; and adjust parameters of the sound playback device according to the sound adjustment request.

图4示出了本发明声音自动调节设备实施例的结构示意图,本发明具体实施例并不对声音自动调节设备的具体实现做限定。FIG. 4 shows a schematic structural diagram of an embodiment of an automatic sound adjustment device according to the present invention. The specific embodiment of the present invention does not limit the specific implementation of the automatic sound adjustment device.

如图4所示,该声音自动调节设备可以包括:处理器(processor)402、通信接口(Communications Interface)404、存储器(memory)406、以及通信总线408。As shown in FIG. 4 , the sound automatic adjustment device may include: a processor (processor) 402 , a communication interface (Communications Interface) 404 , a memory (memory) 406 , and a communication bus 408 .

其中:处理器402、通信接口404、以及存储器406通过通信总线408完成相互间的通信。通信接口404,用于与其它设备比如客户端或其它服务器等的网元通信。处理器402,用于执行程序410,具体可以执行上述用于声音自动调节方法实施例中的相关步骤。The processor 402 , the communication interface 404 , and the memory 406 communicate with each other through the communication bus 408 . The communication interface 404 is used for communicating with network elements of other devices such as clients or other servers. The processor 402, configured to execute the program 410, may specifically execute the relevant steps in the above-mentioned embodiments of the method for automatic sound adjustment.

具体地,程序410可以包括程序代码,该程序代码包括计算机可执行指令。Specifically, program 410 may include program code, which includes computer-executable instructions.

处理器402可能是中央处理器CPU,或者是特定集成电路ASIC(ApplicationSpecific Integrated Circuit),或者是被配置成实施本发明实施例的一个或多个集成电路。声音自动调节设备包括的一个或多个处理器,可以是同一类型的处理器,如一个或多个CPU;也可以是不同类型的处理器,如一个或多个CPU以及一个或多个ASIC。The processor 402 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention. The one or more processors included in the sound automatic adjustment device may be the same type of processors, such as one or more CPUs; or may be different types of processors, such as one or more CPUs and one or more ASICs.

存储器406,用于存放程序410。存储器406可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 406 is used to store the program 410 . Memory 406 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

程序410具体可以被处理器402调用使声音自动调节设备执行以下操作:The program 410 can be specifically called by the processor 402 to make the sound automatic adjustment device perform the following operations:

实时采集用户的当前生理指标;Real-time collection of the user's current physiological indicators;

基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;Confirming the target sound attribute data corresponding to the current physiological index based on the correspondence between the pre-stored physiological index and the sound attribute data;

根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。The parameters of the sound playback device worn by the user are adjusted according to the target sound attribute data.

本发明实施例通过实时获取用户的当前生理指标,根据用户的当前生理指标查询最适合该用户的声音属性数据,再根据该声音属性数据对该用户的声音播放设备的参数进行调节,从而能够让不同年龄段的用户享受到与自身生理指标相应的听觉体验,实现了对不同生理指标的用户进行个性化的听觉设定,提高了用户体验。The embodiment of the present invention obtains the current physiological index of the user in real time, queries the sound attribute data most suitable for the user according to the current physiological index of the user, and then adjusts the parameters of the user's sound playback device according to the sound attribute data, so as to make Users of different age groups can enjoy an auditory experience corresponding to their own physiological indicators, which realizes personalized auditory settings for users with different physiological indicators, and improves the user experience.

本发明实施例提供了一种计算机可读存储介质,所述存储介质存储有至少一可执行指令,该可执行指令在声音自动调节设备/装置上运行时,使得所述声音自动调节设备/装置执行上述任意方法实施例中的声音自动调节方法。An embodiment of the present invention provides a computer-readable storage medium, where the storage medium stores at least one executable instruction, when the executable instruction runs on the automatic sound adjustment device/apparatus, the automatic sound adjustment apparatus/apparatus causes the automatic sound adjustment device/apparatus Execute the automatic sound adjustment method in any of the above method embodiments.

可执行指令具体可以用于使得声音自动调节设备/装置执行以下操作:Specifically, the executable instructions can be used to cause the sound automatic adjustment device/device to perform the following operations:

实时采集用户的当前生理指标;Real-time collection of the user's current physiological indicators;

基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;Confirming the target sound attribute data corresponding to the current physiological index based on the correspondence between the pre-stored physiological index and the sound attribute data;

根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。The parameters of the sound playback device worn by the user are adjusted according to the target sound attribute data.

本发明实施例通过实时获取用户的当前生理指标,根据用户的当前生理指标查询最适合该用户的声音属性数据,再根据该声音属性数据对该用户的声音播放设备的参数进行调节,从而能够让不同年龄段的用户享受到与自身生理指标相应的听觉体验,实现了对不同生理指标的用户进行个性化的听觉设定,提高了用户体验。The embodiment of the present invention obtains the current physiological index of the user in real time, queries the sound attribute data most suitable for the user according to the current physiological index of the user, and then adjusts the parameters of the user's sound playback device according to the sound attribute data, so as to make Users of different age groups can enjoy an auditory experience corresponding to their own physiological indicators, which realizes personalized auditory settings for users with different physiological indicators, and improves the user experience.

在此提供的算法或显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造这类系统所要求的结构是显而易见的。此外,本发明实施例也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other device. Various general-purpose systems can also be used with teaching based on this. The structure required to construct such a system is apparent from the above description. Furthermore, embodiments of the present invention are not directed to any particular programming language. It is to be understood that various programming languages may be used to implement the inventions described herein, and that the descriptions of specific languages above are intended to disclose the best mode for carrying out the invention.

在此处所提供的说明书中,说明了大量具体细节。然而,能够理解,本发明的实施例可以在没有这些具体细节的情况下实践。在一些实例中,并未详细示出公知的方法、结构和技术,以便不模糊对本说明书的理解。In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

类似地,应当理解,为了精简本发明并帮助理解各个发明方面中的一个或多个,在上面对本发明的示例性实施例的描述中,本发明实施例的各个特征有时被一起分组到单个实施例、图、或者对其的描述中。然而,并不应将该公开的方法解释成反映如下意图:即所要求保护的本发明要求比在每个权利要求中所明确记载的特征更多的特征。更确切地说,如下面的权利要求书所反映的那样,发明方面在于少于前面公开的单个实施例的所有特征。因此,遵循具体实施方式的权利要求书由此明确地并入该具体实施方式,其中每个权利要求本身都作为本发明的单独实施例。Similarly, it is to be understood that, in the above description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together into a single implementation in order to simplify the invention and to aid in the understanding of one or more of the various aspects of the invention. examples, figures, or descriptions thereof. This disclosure, however, should not be construed as reflecting an intention that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description are hereby expressly incorporated into this Detailed Description, with each claim standing on its own as a separate embodiment of this invention.

本领域那些技术人员可以理解,可以对实施例中的设备中的模块进行自适应性地改变并且把它们设置在与该实施例不同的一个或多个设备中。可以把实施例中的模块或单元或组件组合成一个模块或单元或组件,以及此外可以把它们分成多个子模块或子单元或子组件。除了这样的特征和/或过程或者单元中的至少一些是相互排斥之外,可以采用任何组合对本说明书(包括伴随的权利要求、摘要和附图)中公开的所有特征以及如此公开的任何方法或者设备的所有过程或单元进行组合。除非另外明确陈述,本说明书(包括伴随的权利要求、摘要和附图)中公开的每个特征可以由提供相同、等同或相似目的的替代特征来代替。Those skilled in the art will understand that the modules in the device in the embodiment can be adaptively changed and arranged in one or more devices different from the embodiment. The modules or units or components in the embodiments may be combined into one module or unit or component, and further they may be divided into multiple sub-modules or sub-units or sub-assemblies. All features disclosed in this specification (including accompanying claims, abstract and drawings) and any method so disclosed may be employed in any combination, unless at least some of such features and/or procedures or elements are mutually exclusive. All processes or units of equipment are combined. Each feature disclosed in this specification (including accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

此外,本领域的技术人员能够理解,尽管在此的一些实施例包括其它实施例中所包括的某些特征而不是其它特征,但是不同实施例的特征的组合意味着处于本发明的范围之内并且形成不同的实施例。例如,在下面的权利要求书中,所要求保护的实施例的任意之一都可以以任意的组合方式来使用。Furthermore, it will be understood by those skilled in the art that although some of the embodiments herein include certain features, but not others, included in other embodiments, that combinations of features of the different embodiments are intended to be within the scope of the present invention And form different embodiments. For example, in the following claims, any of the claimed embodiments may be used in any combination.

应该注意的是上述实施例对本发明进行说明而不是对本发明进行限制,并且本领域技术人员在不脱离所附权利要求的范围的情况下可设计出替换实施例。在权利要求中,不应将位于括号之间的任何参考符号构造成对权利要求的限制。单词“包含”不排除存在未列在权利要求中的元件或步骤。位于元件之前的单词“一”或“一个”不排除存在多个这样的元件。本发明可以借助于包括有若干不同元件的硬件以及借助于适当编程的计算机来实现。在列举了若干装置的单元权利要求中,这些装置中的若干个可以是通过同一个硬件项来具体体现。单词第一、第二、以及第三等的使用不表示任何顺序。可将这些单词解释为名称。上述实施例中的步骤,除有特殊说明外,不应理解为对执行顺序的限定。It should be noted that the above-described embodiments illustrate rather than limit the invention, and that alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The use of the words first, second, and third, etc. do not denote any order. These words can be interpreted as names. The steps in the above embodiments should not be construed as limitations on the execution order unless otherwise specified.

Claims (10)

1.一种声音自动调节方法,其特征在于,所述方法包括:1. a sound automatic adjustment method, is characterized in that, described method comprises: 实时采集用户的当前生理指标;Real-time collection of the user's current physiological indicators; 基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;Confirming the target sound attribute data corresponding to the current physiological index based on the correspondence between the pre-stored physiological index and the sound attribute data; 根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。The parameters of the sound playback device worn by the user are adjusted according to the target sound attribute data. 2.根据权利要求1所述的声音自动调节方法,其特征在于,所述方法还包括:2. The method for automatically adjusting sound according to claim 1, wherein the method further comprises: 确认所述声音播放设备当前播放的声音内容包含的情感信息;Confirm the emotional information contained in the sound content currently played by the sound playback device; 根据所述情感信息进行预测,得到所述用户的预测精神状态;Predicting according to the emotional information to obtain the predicted mental state of the user; 基于预设情感算法,结合所述当前生理指标对用户的精神状态进行判断,确认所述用户的实际精神状态;Judging the user's mental state in combination with the current physiological index based on a preset emotional algorithm, and confirming the user's actual mental state; 对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节。The predicted mental state and the actual mental state are compared, and the parameters of the sound playback device are adjusted according to the comparison result. 3.根据权利要求2所述的声音自动调节方法,其特征在于,所述对比所述预测精神状态和所述实际精神状态,并根据对比结果对所述声音播放设备的参数进行调节,包括:3. The method for automatically adjusting sound according to claim 2, wherein the comparison of the predicted mental state and the actual mental state, and the adjustment of the parameters of the sound playback device according to the comparison result, comprises: 基于预先设定的情绪级别和情绪方向确认所述预测精神状态对应的第一情绪类别集和所述实际精神状态对应的第二情绪类别集;Confirming the first emotional category set corresponding to the predicted mental state and the second emotional category set corresponding to the actual mental state based on the preset emotional level and emotional direction; 判断所述第一情绪类别集和所述第二情绪类别集是否相同;judging whether the first emotion category set and the second emotion category set are the same; 若是,则确认所述用户出现有效正向共情,维持所述声音播放设备当前的参数;If so, confirm that the user has valid positive empathy, and maintain the current parameters of the sound playback device; 若否,则确认所述用户出现无效或负向共情,调节所述声音播放设备的参数以降低无效或负向共情的情绪影响力和情绪持续时间。If not, it is confirmed that the user has invalid or negative empathy, and the parameters of the sound playback device are adjusted to reduce the emotional influence and emotional duration of the invalid or negative empathy. 4.根据权利要求3所述的声音自动调节方法,其特征在于,所述调节所述声音播放设备的参数以降低无效或负向共情的情绪影响力和情绪持续时间,包括:4. The method for automatic adjustment of sound according to claim 3, wherein the parameter of the adjustment of the sound playback device is to reduce the emotional influence and emotional duration of invalid or negative empathy, comprising: 获取预先采集的所述用户的初始生理指标;acquiring the pre-collected initial physiological indicators of the user; 根据所述初始生理指标和所述预设情感算法确认所述用户的初始精神状态,并基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第三情绪类别集;Confirm the initial mental state of the user according to the initial physiological index and the preset emotional algorithm, and confirm the third emotional category set corresponding to the initial mental state based on a preset emotional level and emotional direction; 确认所述第一情绪类别集和所述第二情绪类别集之间的不同情绪类别所组成的区别情绪类别集;confirming a set of distinct emotional categories composed of different emotional categories between the first emotional category set and the second emotional category set; 从所述区别情绪类别集中剔除所述第三情绪类别集中出现的情绪类别,将剩余的情绪类别作为无效或负向共情的目标情绪类别;Eliminate the emotion categories that appear in the third emotion category set from the distinguishing emotion category set, and use the remaining emotion categories as the target emotion categories of invalid or negative empathy; 调节所述声音播放设备的参数,以将所述目标情绪类别的情绪影响力和情绪持续时间降低至相应预设情绪阈值以下。The parameters of the sound playback device are adjusted to reduce the emotional influence and the emotional duration of the target emotional category below corresponding preset emotional thresholds. 5.根据权利要求1所述的声音自动调节方法,其特征在于,所述实时采集用户的当前生理指标之前,还包括:5. The method for automatically adjusting sound according to claim 1, wherein before the real-time collection of the current physiological index of the user, the method further comprises: 采集所述用户的初始生理指标;collecting initial physiological indicators of the user; 根据所述初始生理指标和预设情感算法确认所述用户的初始精神状态;Confirm the initial mental state of the user according to the initial physiological index and a preset emotion algorithm; 基于预先设定的情绪级别和情绪方向确认所述初始精神状态对应的第四情绪类别集;Confirming the fourth emotional category set corresponding to the initial mental state based on the preset emotional level and emotional direction; 当所述第四情绪类别集中的情绪类别的情绪影响力超过预设感知阈值时,提示所述用户调节自身情绪。When the emotional influence of the emotional categories in the fourth emotional category set exceeds a preset perception threshold, the user is prompted to adjust his emotions. 6.根据权利要求2所述的声音自动调节方法,其特征在于,所述方法还包括:6. The method for automatically adjusting sound according to claim 2, wherein the method further comprises: 根据所述用户的当前生理指标获取所述用户的心率变化趋势和呼吸频率数据变化趋势;Obtain the change trend of the heart rate and the change trend of the respiratory rate data of the user according to the current physiological index of the user; 根据所述心率变化趋势和所述呼吸频率数据变化趋势确认所述用户进入疲劳状态时,调节所述声音播放设备的参数以提高声音对所述用户的情绪影响力。When it is confirmed that the user is in a fatigued state according to the change trend of the heart rate and the change trend of the breathing frequency data, the parameters of the sound playback device are adjusted to improve the emotional influence of the sound on the user. 7.根据权利要求1所述的声音自动调节方法,其特征在于,所述方法还包括:7. The method for automatically adjusting sound according to claim 1, wherein the method further comprises: 接收所述用户输入的声音调节请求;receiving a voice adjustment request input by the user; 根据所述声音调节请求调节所述声音播放设备的参数。The parameters of the sound playback device are adjusted according to the sound adjustment request. 8.一种声音自动调节装置,其特征在于,所述装置包括:8. A sound automatic adjustment device, characterized in that the device comprises: 采集模块,用于实时采集用户的当前生理指标;The acquisition module is used to collect the current physiological indicators of the user in real time; 确认模块,用于基于预先存储的生理指标和声音属性数据的对应关系,确认与所述当前生理指标对应的目标声音属性数据;A confirmation module, configured to confirm the target sound attribute data corresponding to the current physiological index based on the pre-stored correspondence between the physiological index and the sound attribute data; 调节模块,用于根据所述目标声音属性数据调节所述用户佩戴的声音播放设备的参数。An adjustment module, configured to adjust parameters of the sound playback device worn by the user according to the target sound attribute data. 9.一种声音自动调节设备,其特征在于,包括:处理器、存储器、通信接口和通信总线,所述处理器、所述存储器和所述通信接口通过所述通信总线完成相互间的通信;9. A sound automatic adjustment device, characterized in that it comprises: a processor, a memory, a communication interface and a communication bus, and the processor, the memory and the communication interface complete mutual communication through the communication bus; 所述存储器用于存放至少一可执行指令,所述可执行指令使所述处理器执行如权利要求1-7任意一项所述的声音自动调节方法的操作。The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the automatic sound adjustment method according to any one of claims 1-7. 10.一种计算机可读存储介质,其特征在于,所述存储介质中存储有至少一可执行指令,所述可执行指令在声音自动调节设备/装置上运行时,使得声音自动调节设备/装置执行如权利要求1-7任意一项所述的声音自动调节方法的操作。10. A computer-readable storage medium, characterized in that, the storage medium stores at least one executable instruction, and when the executable instruction runs on the sound automatic adjustment device/device, the sound automatic adjustment device/device is The operation of the automatic sound adjustment method according to any one of claims 1-7 is performed.
CN202111610446.2A 2021-12-27 2021-12-27 Sound automatic adjustment method, device, equipment and storage medium Pending CN114302296A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111610446.2A CN114302296A (en) 2021-12-27 2021-12-27 Sound automatic adjustment method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111610446.2A CN114302296A (en) 2021-12-27 2021-12-27 Sound automatic adjustment method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN114302296A true CN114302296A (en) 2022-04-08

Family

ID=80968749

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111610446.2A Pending CN114302296A (en) 2021-12-27 2021-12-27 Sound automatic adjustment method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN114302296A (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060111621A1 (en) * 2004-11-03 2006-05-25 Andreas Coppi Musical personal trainer
US20100191037A1 (en) * 2007-06-01 2010-07-29 Lorenzo Cohen Iso music therapy program and methods of using the same
CN103890838A (en) * 2011-06-10 2014-06-25 X-系统有限公司 Method and system for analyzing sound
CN105268080A (en) * 2014-06-04 2016-01-27 王振兴 Emotion regulation and control system and method
CN106599057A (en) * 2016-11-18 2017-04-26 上海斐讯数据通信技术有限公司 Music rhythm control terminal and method adaptive to user emotion
CN108404274A (en) * 2018-02-09 2018-08-17 上海康斐信息技术有限公司 A kind of automatic sound regulating method and equipment
US20190269345A1 (en) * 2019-05-21 2019-09-05 Roshan Narayan Sriram Methods and systems for decoding, inducing, and training peak mind/body states via multi-modal technologies

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060111621A1 (en) * 2004-11-03 2006-05-25 Andreas Coppi Musical personal trainer
US20100191037A1 (en) * 2007-06-01 2010-07-29 Lorenzo Cohen Iso music therapy program and methods of using the same
CN103890838A (en) * 2011-06-10 2014-06-25 X-系统有限公司 Method and system for analyzing sound
CN105268080A (en) * 2014-06-04 2016-01-27 王振兴 Emotion regulation and control system and method
CN106599057A (en) * 2016-11-18 2017-04-26 上海斐讯数据通信技术有限公司 Music rhythm control terminal and method adaptive to user emotion
CN108404274A (en) * 2018-02-09 2018-08-17 上海康斐信息技术有限公司 A kind of automatic sound regulating method and equipment
US20190269345A1 (en) * 2019-05-21 2019-09-05 Roshan Narayan Sriram Methods and systems for decoding, inducing, and training peak mind/body states via multi-modal technologies

Similar Documents

Publication Publication Date Title
CN106992013B (en) Speech emotion modification
CN110853605B (en) Music generation method and device and electronic equipment
US9288593B2 (en) Visually-based fitting of hearing devices
CN107683399A (en) Sound output device, electronic device, and control method thereof
US20220295196A1 (en) Advanced artificial sound hearing training
US20180344968A1 (en) Context-sensitive soundscape generation
CN105930480B (en) The generation method and managing irritating auditory phenomena system of managing irritating auditory phenomena music
US20230412995A1 (en) Advanced hearing prosthesis recipient habilitation and/or rehabilitation
CN110598611A (en) Nursing system, patient nursing method based on nursing system and readable storage medium
TWI823055B (en) Electronic resource pushing method and system
JP7437703B2 (en) Mental control system and program
CN115553760A (en) Music synthesis method for tinnitus rehabilitation and online tinnitus diagnosis and rehabilitation system
CN114302296A (en) Sound automatic adjustment method, device, equipment and storage medium
US20230321392A1 (en) Audio-Based Operant Conditioning for Brain Training
Draper et al. Development of a virtual reality treatment for tinnitus-a user study
JP2023175380A (en) Feeling estimation program
Shimomura et al. Presenting sense of loud vocalization using vibratory stimuli to the larynx and auditory stimuli
KR102495725B1 (en) Self-talk device and method therefor
CN108563322B (en) Control method and device for VR/AR equipment
KR102355182B1 (en) Voice interacting method of hearing assisting apparatus using interactive process
CN118859791B (en) User awakening method and system for intelligent electric bed of Internet of things
CN119889582B (en) A sound coordination method and system based on tinnitus
KR102794201B1 (en) Device for providing customized dance content for the user using biometric information
KR102786414B1 (en) Apparatus for treatment of tinnitus and operating method for the same
JP2025048917A (en) system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination