WO2023116502A1 - Speech interaction method and apparatus, and vehicle and storage medium - Google Patents

Abstract

Disclosed in the present application is a speech interaction method. The method comprises: receiving a speech request for adjusting a preset function of a vehicle; executing an operation corresponding to the speech request; and in response to a feedback instruction, which is determined according to a preset mapping relationship between the speech request and a feedback frequency, giving feedback to a user according to the feedback frequency in the feedback instruction while executing the operation. In the present application, for a speech request of a user for parts that can be subjected to scale adjustment in a vehicle, a feedback instruction for the speech request can be determined according to a mapping relationship between the speech request and a feedback frequency, and the vehicle gives feedback to the user according to the feedback frequency in the feedback instruction while executing an operation corresponding to an intention in the speech request, such that the user can vividly and visually perceive, by means of the feedback frequency, that the operation executed by the vehicle matches the speech request of the user for scale adjustment of the parts, and the feedback is simple and clear. Further disclosed in the present application are a speech interaction apparatus, and a vehicle and a computer-readable storage medium.

Description

Voice interaction method and device, vehicle and storage medium

This application claims the priority of a Chinese patent application filed with the State Intellectual Property Office on December 23, 2021, with application number 202111585509.3, and application title "Voice Interaction Method and Device, Vehicle and Storage Medium", the entire contents of which are incorporated by reference in this application.

technical field

The present application relates to the technical field of voice recognition, and in particular to a voice interaction method, a voice interaction device, a vehicle, and a computer-readable storage medium.

Background technique

With the development of smart cars, voice interaction can provide more and more convenience for users in the process of driving vehicles. Generally, in a voice interaction scenario, after the vehicle performs an operation corresponding to the user's voice request, it will broadcast relevant information about the completion of the operation through tts (text to speech, from text to voice) to provide feedback to the user. For example, the user sends out a voice request: "Volume is louder", and the vehicle gives feedback through the tts voice broadcast "The volume has been adjusted to x scale" after the vehicle performs the volume increase three scales. However, the content of the tts broadcast feedback is lengthy and the user is The number of adjustment times in the voice request failed to obtain intuitive feedback, and the user experience was poor.

Contents of the invention

In order to solve or partially solve the problems existing in the related technologies, the present application provides a voice interaction method, a voice interaction device, a vehicle and a computer-readable storage medium, which enable the user to intuitively perceive the voice of the operation performed by the vehicle and the scale adjustment Match requests to improve user experience.

This application provides a voice interaction method, including:

receiving a voice request for the adjustment of a preset function of the vehicle, the preset function can be scaled and adjusted through components of the vehicle;

Execute the operation corresponding to the voice request;

In response to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, while the operation is being executed, feedback is given to the user according to the feedback frequency in the feedback instruction.

In this way, in this application, for the user's voice request for preset function adjustment, the feedback instruction for the voice request can be determined according to the mapping relationship between the voice request and the feedback frequency, and the vehicle will perform the operation corresponding to the voice request. The feedback frequency in the instruction is used to provide feedback to the user, so that the user can vividly and intuitively perceive that the operation performed by the vehicle matches the voice request for scale adjustment through the frequency of the feedback, and the feedback is concise and clear.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

Feedback is given to the user in a corresponding continuous state and duration according to the adjusted speed of the vehicle component and the feedback frequency in the feedback instruction.

In this way, according to the adjustment speed and feedback frequency of the vehicle components, the continuous state and duration of the feedback to the user are confirmed, so that the user can obtain intuitive and clear feedback.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

Giving feedback to the user with a corresponding feedback intensity according to the feedback frequency in the feedback instruction.

In this way, when performing user feedback, different feedback frequencies are used to provide feedback with different feedback intensities, so that different feedback frequencies correspond to different levels of feedback intensities that users can perceive.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

determining the number of times the sound effect is played according to the feedback frequency in the feedback instruction;

Play a sound effect to the user based on the determined number of times the sound effect is played.

In this way, feedback is given to the user through the auditory dimension, and the number of times the sound effect is played is determined according to the frequency of the feedback. The user's perception of the frequency of vehicle feedback execution is more direct.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

determining the number of vibrations according to the feedback frequency in the feedback instruction;

Vibration feedback is provided to the user according to the determined number of vibrations.

In this way, the user is given feedback through the tactile dimension, and the frequency of vibration is determined according to the frequency of the feedback. The user's perception of the frequency of vehicle feedback execution is more direct.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

Determining the number of scents to be released according to the feedback frequency in the feedback instruction;

Feedback is based on the release of fragrance based on the determined number of flavors.

In this way, the user is given feedback through the olfactory dimension, and the number of scents released by the fragrance is determined according to the frequency of the feedback. The user's perception of the frequency of vehicle feedback execution is more direct.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

Provide interface display feedback to the user according to the feedback frequency in the feedback instruction.

In this way, the feedback on the user's visual dimension is formed through the display elements in the UI interface, and the feedback methods are enriched.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

In the case that the operation is aimed at a preset vehicle component, the target of the operation is controlled to provide vibration feedback to the user.

In this way, when the operation object requested by the voice itself can generate vibration, the object is controlled to give vibration feedback to the user, so that the operation and feedback are more integrated and the user's perception is improved.

While performing the operation, giving feedback to the user according to the feedback frequency in the feedback instruction includes:

Obtain the location information of the user;

Controlling the seat corresponding to the position information to provide vibration feedback to the user.

In this way, combined with the determination of the user's orientation, the corresponding seat is selected for vibration feedback, so that the feedback is more targeted for the user, which is convenient for the user to judge and improves the user's perception.

The present application also provides a voice interaction device, including:

A receiving module, configured to receive a voice request for adjusting a preset function of the vehicle, and the preset function can be scaled and adjusted through components of the vehicle;

An execution module, configured to execute an operation corresponding to the voice request;

The feedback module is configured to respond to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, and give feedback to the user according to the feedback frequency in the feedback instruction while the operation is being executed.

In this way, in this application, for the user's voice request for the parts in the vehicle that can be adjusted in scale, the feedback instruction for the voice request can be determined according to the mapping relationship between the voice request and the feedback frequency, and the vehicle intends to perform the corresponding operation during the voice request. At the same time, feedback will be given to the user according to the feedback frequency in the feedback command, so that the user can vividly and intuitively perceive the operation performed by the vehicle to match the voice request for scale adjustment with the parts and components through the frequency of the feedback, and the feedback is concise and clear.

The present application also provides a vehicle. The vehicle includes a memory and a processor. The memory stores a computer program. When the computer program is executed by the processor, the voice interaction method is realized.

In this way, in this application, for the user's voice request for the parts in the vehicle that can be adjusted in scale, the feedback instruction for the voice request can be determined according to the mapping relationship between the voice request and the feedback frequency, and the vehicle intends to perform the corresponding operation during the voice request. At the same time, feedback will be given to the user according to the feedback frequency in the feedback command, so that the user can vividly and intuitively perceive the operation performed by the vehicle to match the voice request for scale adjustment with the parts and components through the frequency of the feedback, and the feedback is concise and clear.

The present application also provides a non-volatile computer-readable storage medium of a computer program. When the computer program is executed by one or more processors, the voice interaction method is realized.

In this way, in this application, for the voice request of the user for the parts in the vehicle that can be adjusted in scale, the server or the vehicle can determine the feedback instruction for the voice request according to the mapping relationship between the voice request and the feedback frequency. At the same time of operation, feedback will be given to the user according to the feedback frequency in the feedback command, so that the user can vividly and intuitively perceive the operation performed by the vehicle through the frequency of the feedback to match the voice request for scale adjustment between himself and the parts, and the feedback is concise and clear.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the application.

Description of drawings

The above and other objects, features and advantages of the present application will become more apparent by describing the exemplary embodiments of the present application in more detail with reference to the accompanying drawings, wherein, in the exemplary embodiments of the present application, the same reference numerals generally represent same parts.

Fig. 1 is one of the schematic flow charts of the voice interaction method of the present application;

Fig. 2 is a schematic diagram of modules of the voice interaction device of the present application;

FIG. 3 is the second schematic flow diagram of the voice interaction method of the present application;

Fig. 4 is the third schematic flow diagram of the voice interaction method of the present application;

FIG. 5 is the fourth schematic flow diagram of the voice interaction method of the present application;

Fig. 6 is the fifth schematic flow diagram of the voice interaction method of the present application;

FIG. 7 is the sixth schematic flow diagram of the voice interaction method of the present application;

FIG. 8 is the seventh schematic flow diagram of the voice interaction method of the present application;

FIG. 9 is a schematic diagram of a scene of the voice interaction method of the present application;

FIG. 10 is the eighth schematic flow diagram of the voice interaction method of the present application;

FIG. 11 is a ninth schematic flowchart of the voice interaction method of the present application.

Detailed ways

Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of this application to those skilled in the art.

The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and/or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items.

The present application is described in detail below, and examples of the present application are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary, are only for explaining the present application, and should not be construed as limiting the present application.

Please refer to Figure 1, this application provides a voice interaction method, including:

01: Receive a voice request for the adjustment of the vehicle's preset function, and the preset function can be adjusted by the scale of the vehicle's parts;

02: Execute the operation corresponding to the voice request;

03: Responding to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, while performing the operation, give feedback to the user according to the feedback frequency in the feedback instruction.

Correspondingly, referring to FIG. 2 , the present application also provides a voice interaction device 100 , and the voice interaction method of the present application can be realized by the voice interaction device 100 . The voice interaction device 100 includes a receiving module 110 , an executing module 120 and a feedback module 130 . Step 01 can be realized by the receiving module 110 , step 02 can be realized by the execution module 120 , and step 03 can be realized by the feedback module 130 . In other words, the receiving module 110 is configured to receive a voice request for adjusting preset functions of the vehicle. The executing module 120 is configured to execute the operation corresponding to the voice request. The feedback module 130 is configured to respond to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, and give feedback to the user according to the feedback frequency in the feedback instruction while performing operations.

The present application also provides a vehicle. A vehicle includes memory and a processor. A computer program is stored in the memory, and the processor is used to receive a voice request for adjusting the preset function of the vehicle; to execute the operation corresponding to the voice request; and to respond to the feedback instruction determined according to the mapping relationship between the preset voice request and the feedback frequency , while performing the operation, give feedback to the user according to the feedback frequency in the feedback instruction.

The vehicle includes some vehicle components such as buttons and knobs that can be used for scale adjustment. With the application of voice technology in vehicle interaction, in some related scenarios, the scale adjustment of the above-mentioned vehicle parts can be simulated through voice interaction. Scale adjustment, turn up the volume three scales. After the vehicle completes the corresponding operation, it will broadcast "the volume has been adjusted to the x scale" through tts voice to remind the user. However, the form of the voice broadcast is single, the content is relatively complicated and lengthy, and the feedback on the number of adjustments in the voice request is not clear, and the user cannot obtain intuitive feedback.

In this application, for the user's voice request for preset function adjustment, the feedback command for the voice request is determined according to the mapping relationship between the voice request and the feedback frequency. Feedback is given to the user with a high frequency of feedback, so that the user can vividly and intuitively perceive that the operation performed by the vehicle matches the voice request for scale adjustment through the frequency of the feedback, and the feedback is concise and clear.

In this application, the user uses voice interaction to simulate the process of adjusting the scale of vehicle parts, and the corresponding voice requests may include but are not limited to "the screen is bright and bright", "the volume is louder", and "the seat is back and back". Among them, the preset function refers to the function of adjusting the scale through vehicle parts, wherein the vehicle parts may refer to physical components such as mechanical knobs or buttons, which are parts that can adjust the scale.

For the voice request received by the vehicle, the server communicating with the vehicle performs voice recognition, semantic recognition and other processing to identify the intention of the voice request and the scale value to be adjusted, and then combine it into a control command and issue it. The vehicle executes the server to issue The control instruction to complete the operation corresponding to the voice request. At the same time, the server also issues feedback instructions according to the preset mapping relationship between voice requests and feedback frequencies.

According to the load of the vehicle processor, the mapping relationship between the voice request and the feedback frequency can also be arranged in the vehicle, that is, the server sends the control command, and the vehicle generates the feedback command according to the mapping relationship between the voice request and the feedback frequency.

Establish a mapping relationship between voice requests and feedback frequencies, that is, the corresponding relationship between voice requests for users with adjustment accuracy requirements and vehicle feedback times. For example, for the voice request of "very loud", there is a need to perform three scale adjustments, and a mapping relationship is formed between the voice request and the three feedback frequencies.

Please refer to Figure 3, step 03 includes:

031: Feedback to the user in the corresponding continuous state and duration according to the speed adjusted by the vehicle components and the feedback frequency in the feedback command.

Step 031 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to give feedback to the user in a corresponding continuous state and duration according to the speed adjusted by the vehicle components and the feedback frequency in the feedback instruction.

The processor is used to give feedback to the user in a corresponding continuous state and duration according to the speed adjusted by the vehicle components and the feedback frequency in the feedback instruction.

The duration and duration are determined according to the adjustment speed of the corresponding vehicle component. For example, for volume adjustment, the adjustment speed is faster and the process lasts shorter, and the corresponding feedback can be given once after the adjustment is completed. For the voice request of "very louder", the adjustment process is completed after the volume is increased three times. After that, give feedback to the user with a frequency of 3 at one time.

As another example, for seat adjustment, the adjustment speed is relatively slow, and the process lasts for a long time. The corresponding feedback can be carried out during the adjustment process. Every time a scale adjustment is completed, a feedback is provided to the user. For the voice request of "seat forward and forward", the feedback to the user with a frequency of 3 will be performed during the forward adjustment of the seat, and the feedback will be given once every time the adjustment of a scale is completed. The adjustment is complete and the feedback is complete.

In this way, according to the adjustment speed and feedback frequency of vehicle components, the continuous state and duration of the feedback to the user are confirmed, so that the user can receive intuitive and clear feedback.

Please refer to Figure 4, step 03 includes:

032: Provide feedback to the user with the corresponding feedback intensity according to the feedback frequency in the feedback instruction.

Step 032 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to provide feedback to the user with a corresponding feedback intensity according to the feedback frequency in the feedback instruction.

The processor is configured to provide feedback to the user with a corresponding feedback intensity according to the feedback frequency in the feedback instruction.

The feedback frequency is associated with the feedback intensity, and different feedback frequencies provide feedback with different intensities, so that different feedback frequencies correspond to different degrees of feedback intensity that users can perceive. That is to say, corresponding to the same vehicle parts and different adjustment scales, feedback is performed with different degrees of feedback intensity, so that the user can feel the adjustment scale more intuitively.

For example, for the two voice requests "Volume Up" and "Volume Up", the feedback intensity of the former is stronger than that of the latter, and the user can directly feel the difference between turning up the volume three times and turning up the volume twice according to the feedback level .

The feedback intensity may correspond to the overall feedback frequency, that is, the feedback intensity of each feedback frequency in the feedback frequency is the same, and the feedback intensity of each frequency increases as the overall feedback frequency increases. That is, the feedback intensity of each feedback in the feedback with frequency 3 is higher than the feedback intensity of each feedback in the feedback with frequency 2.

The feedback intensity can also correspond to each frequency, that is, in each feedback, as the frequency in the overall feedback frequency increases, the feedback intensity of each frequency increases, that is, for "Volume is very loud", in the feedback, The three "large" feedback strengths increase successively.

It can be understood that the feedback intensity corresponds to different feedback methods. For the feedback method of the auditory dimension, the feedback intensity is the volume level, and for the feedback method of the tactile dimension, the feedback method is the vibration intensity.

Please refer to Figure 5, step 03 includes:

0331: Determine the number of times the sound effect is played according to the feedback frequency in the feedback command;

0332: Play the sound effect to the user according to the determined number of times the sound effect is played.

Referring to FIG. 5 , steps 0331 and 0332 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to determine the number of times to play the sound effect according to the feedback frequency in the feedback instruction, and to play the sound effect to the user according to the determined number of times to play the sound effect.

The processor is used to determine the number of times to play the sound effect according to the feedback frequency in the feedback instruction, and to play the sound effect to the user according to the determined number of times to play the sound effect.

In this application, feedback can be given to the user through the auditory dimension, and the frequency of sound effect playback can be determined according to the feedback frequency, so that the user's perception of the frequency of vehicle feedback execution is more direct.

There is a mapping relationship between the feedback frequency and the voice request, and the frequency of feedback can be determined according to the voice request.

For example, a voice request of "greater volume" is mapped to a feedback with a frequency of 3, so as to determine the number of times of feedback by playing sound effects.

The feedback content may be to synthesize a relatively simple sound effect and play it to the user for feedback. For example, for volume adjustment, the sound effects may include "bang", "dang", "deng" and so on. For adjusting the brightness of the screen, the sound effect of turning on the light bulb can be simulated for feedback, such as "ding", "咻", etc. The same sound effect can be used for the feedback of all preset functions, or different sound effects can be distinguished according to vehicle components, which is not limited here. For feedback with a frequency greater than 1, the corresponding sound effect is played repeatedly. That is, for the voice request of "very loud", according to the mapping relationship between the voice request and the feedback frequency, it is determined to perform the sound effect feedback with a frequency of 3, and then play the feedback with the sound effect of "thump thud thump". Established a link between voice requests for volume up and audio feedback.

Please refer to Figure 6, step 03 includes:

0341: Determine the number of vibrations according to the feedback frequency in the feedback command;

0342: Provide vibration feedback to the user according to the determined number of vibrations.

Referring to FIG. 5 , steps 0341 and 0342 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to determine the number of vibrations according to the feedback frequency in the feedback instruction, and to provide vibration feedback to the user according to the determined number of vibrations.

The processor is used for determining the number of vibrations according to the feedback frequency in the feedback instruction, and for providing vibration feedback to the user according to the determined number of vibrations.

In this application, feedback can be given to the user through the tactile dimension, and the frequency of vibrations can be determined according to the frequency of the feedback. The user's perception of the frequency of vehicle feedback execution is more direct.

There is a mapping relationship between the feedback frequency and the voice request, and the frequency of feedback can be determined according to the voice request.

For example, a voice request of "loud volume" is mapped to a feedback with a frequency of 3, thereby determining the number of times of feedback through vibration.

In order to simplify the form of feedback, some hardware vibrations of the vehicle are used to provide feedback prompts. For the feedback whose frequency is greater than 1, perform vibration corresponding to the frequency. For example, for the voice request of "very loud", according to the mapping relationship between the voice request and the feedback frequency, it is determined to perform vibration feedback with a frequency of 3, and the steering wheel vibration is used for feedback, and then the steering wheel vibrates three times. A link is established between the voice request to increase the volume and the vibration feedback.

Please refer to Figure 7, step 03 includes:

0351: According to the feedback frequency in the feedback command, determine the number of flavors to release fragrance;

0352: Feedback by releasing fragrance based on defined flavor quantities.

Referring to FIG. 5 , steps 0351 and 0352 can be implemented by the feedback module 130 . In other words, the feedback module 130 is used to determine the quantity of fragrance to be released according to the feedback frequency in the feedback instruction, and to determine the quantity of fragrance to be released according to the feedback frequency in the feedback instruction, and to release fragrance for feedback according to the determined quantity of taste. .

The processor is used for determining the quantity of scent to be released according to the feedback frequency in the feedback instruction, and for releasing the fragrance for feedback according to the determined quantity of scent.

In this application, feedback can be given to the user through the olfactory dimension, and the amount of scent released by the fragrance can be determined according to the frequency of the feedback. The user's perception of the frequency of vehicle feedback execution is more direct.

There is a mapping relationship between the feedback frequency and the voice request, and the frequency of feedback can be determined according to the voice request.

For example, a voice request for "loud volume louder" is mapped to a feedback with a frequency of 3, thereby determining the amount of flavor feedback through the release of fragrance.

In order to simplify the form of feedback, the feedback prompt is performed by releasing fragrance. For the feedback whose frequency is greater than 1, release the fragrance with the number of flavors corresponding to the frequency. For example, for the voice request of "very loud", according to the mapping relationship between the voice request and the feedback frequency, it is determined to perform olfactory feedback with a frequency of 3, and then release three flavors of fragrance for feedback. A link was established between the voice request to increase the volume and the feedback of the fragrance release.

It is understandable that olfactory feedback is less obvious and direct than auditory feedback and tactile feedback, and the feedback cycle is longer, and the olfactory sensitivity of different users is different. Therefore, in actual interaction, feedback in the olfactory dimension can be combined with tactile feedback, Auditory feedback goes hand in hand.

Please refer to Figure 8, step 03 includes:

036: Provide interface display feedback to the user according to the feedback frequency in the feedback command.

Step 036 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to provide interface display feedback to the user according to the feedback frequency in the feedback instruction.

The processor is configured to provide interface display feedback to the user according to the feedback frequency in the feedback instruction.

Please refer to Figure 9. In this application, the user can be given feedback through the visual dimension, and the visual display effect of the corresponding controls in the UI (User Interface, user interface) interface can be used to provide feedback corresponding to the frequency of the feedback. The user's feedback on the vehicle The perception of execution frequency is more direct.

There is a mapping relationship between the feedback frequency and the voice request, and the frequency of feedback can be determined according to the voice request.

For example, the voice request of "Volume is greatly increased" is mapped to the feedback with a frequency of 3, so that it is determined to increase the volume by 3 scales through the volume adjustment control on the central control display.

For feedback with a frequency greater than 1, the corresponding control displays the interface changes corresponding to the frequency. For example, for the voice request of "very loud", according to the mapping relationship between the voice request and the feedback frequency, it is determined to perform visual feedback with a frequency of 3, and then the volume control display is increased by 3 scales for feedback. Linked voice requests for volume up to display UI element feedback.

It is understandable that during the driving process, the user needs to concentrate on observing the road conditions, and try to avoid focusing on other places. In this case, the feedback in the visual dimension can be combined with tactile feedback, auditory feedback and olfactory feedback.

It should be noted that in actual interaction, feedback is not limited to a certain dimensional feedback method, and any combination of the above-mentioned multiple dimensional feedback methods can be used according to actual needs and user feedback.

In order to simplify the content of the tts broadcast, the text content of the broadcast can be streamlined, for example, the broadcast content can be simplified to "enlarged", "adjusted", etc. The user can fully perceive that the vehicle has performed corresponding operations.

Please refer to Figure 10, step 03 includes:

037: In the case where the operation is aimed at a preset vehicle component, the target of the control operation provides vibration feedback to the user.

Step 037 can be implemented by the feedback module 130 . In other words, the feedback module 130 is configured to control the target of the operation to provide vibration feedback to the user when the operation is aimed at a preset vehicle component.

The processor is used for performing vibration feedback to the user on the target of the control operation when the operation is directed to a preset vehicle component.

It can be understood that, generally speaking, the control instructions executed by the vehicle can be fed back through the auditory dimension, and for some objects, the feedback can also be given through the tactile dimension. Or on the basis of the auditory dimension, provide auxiliary feedback of the tactile dimension.

According to the hardware information of the vehicle, confirm that the user's voice request includes adjustment accuracy requirements, and confirm which of them can receive vibration feedback commands. The target itself gains vibration feedback. For example, if the voice request is to adjust the seat, the operation is aimed at the seat adjustment knob, the target is the seat, and the user can receive vibration feedback through the seat. In this way, when the operation target corresponding to the voice request can generate vibration, vibration feedback can be provided to the user, so that the operation and feedback are more integrated, and the user's perception can be improved.

For example, for the voice request of "seat forward and forward", according to the mapping relationship between voice request and feedback frequency, it is determined to perform feedback with a frequency of 3, and the seat can vibrate, and the seat is controlled to perform three vibration feedbacks. Vibration feedback can be done alone or in combination with feedback from other dimensions.

Please refer to Figure 11, step 03 includes:

0381: Obtain the user's location information;

0382: Control the seat corresponding to the position information to provide vibration feedback to the user.

Steps 0381 and 0382 can be implemented by the feedback module 130 . In other words, the feedback module 130 is used to obtain the location information of the user, and is used to control the seat corresponding to the location information to perform vibration feedback to the user.

The processor is used to obtain the position information of the user, and is used to control the seat corresponding to the position information to provide vibration feedback to the user.

For example, sound source localization is used to determine the location of the voice request, and then the seat at the corresponding position is controlled to provide vibration feedback to the user, making the feedback more targeted to the user. The voice request sent by the user will provide vibration feedback at the co-pilot's seat, which is convenient for the user to judge and enhance the user's perception. The vibration feedback after positioning can be used as a single feedback method, or it can be combined with other dimensional reminder methods to give user feedback.

The present application also provides a computer-readable storage medium. One or more non-volatile computer-readable storage media storing a computer program, when the computer program is executed by one or more processors, the voice interaction method in any of the above-mentioned embodiments is realized. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing related software through computer programs. The program can be stored in a non-volatile computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) and the like.

In the description of this specification, reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" etc. The specific features, structures, materials or features described in the manner or example are included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other. At the same time, descriptions referring to the terms "first", "second", etc. are intended to distinguish the same or similar operations, and there is a logical relationship between "first" and "second" in , which is not necessarily There is a logical or contextual relationship, which needs to be judged according to the actual embodiment, and should not be judged only by the literal meaning.

Any process or method descriptions in flowcharts or otherwise described herein may be understood to represent modules, segments or portions of code comprising one or more executable instructions for implementing specific logical functions or steps of the process , and the scope of preferred embodiments of the present application includes additional implementations in which functions may be performed out of the order shown or discussed, including in substantially simultaneous fashion or in reverse order depending on the functions involved, which shall It should be understood by those skilled in the art to which the embodiments of the present application belong.

Having described various embodiments of the present application above, the foregoing description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and alterations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principle of each embodiment, practical application or improvement of technology in the market, or to enable other ordinary skilled in the art to understand each embodiment disclosed herein.

Claims (15)

A voice interaction method, characterized in that, comprising: receiving a voice request for adjustment of a preset function of the vehicle, the preset function refers to a function of simulating the scale adjustment of the operation of the vehicle components; Execute the operation corresponding to the voice request; In response to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, while the operation is being executed, feedback is given to the user according to the feedback frequency in the feedback instruction. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: Feedback is given to the user in a corresponding continuous state and duration according to the adjusted speed of the vehicle component and the feedback frequency in the feedback instruction. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: Giving feedback to the user with a corresponding feedback intensity according to the feedback frequency in the feedback instruction. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: determining the number of times the sound effect is played according to the feedback frequency in the feedback instruction; Play a sound effect to the user based on the determined number of times the sound effect is played. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: determining the number of vibrations according to the feedback frequency in the feedback instruction; Vibration feedback is provided to the user according to the determined number of vibrations. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: Determining the number of scents to be released according to the feedback frequency in the feedback instruction; Feedback is based on the release of fragrance based on the determined number of flavors. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: Provide interface display feedback to the user according to the feedback frequency in the feedback instruction. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: In the case that the operation is aimed at a preset vehicle component, the target of the operation is controlled to provide vibration feedback to the user. The voice interaction method according to claim 1, wherein, while performing the operation, giving feedback to the user according to the frequency of feedback in the feedback instruction includes: Obtain the location information of the user; Controlling the seat corresponding to the position information to provide vibration feedback to the user. The voice interaction method according to any one of claims 1 to 9, characterized in that: When giving feedback to the user, it also includes simplifying the broadcast content. A voice interaction device is characterized in that it comprises: The receiving module is used to receive a voice request for the adjustment of the preset function of the vehicle, and the preset function refers to the function of simulating the scale adjustment of the operation of the vehicle parts; An execution module, configured to execute an operation corresponding to the voice request; The feedback module is configured to respond to the feedback instruction determined according to the preset mapping relationship between the voice request and the feedback frequency, and give feedback to the user according to the feedback frequency in the feedback instruction while the operation is being executed. The voice interaction device according to claim 11, wherein the feedback module provides feedback to the user according to the feedback frequency in the feedback instruction while the operation is being performed, including: The feedback module provides feedback to the user in a corresponding continuous state and duration according to the adjusted speed of the vehicle component and the feedback frequency in the feedback instruction; or, The feedback module provides feedback to the user with a corresponding feedback intensity according to the feedback frequency in the feedback instruction; or, The feedback module determines the number of times the sound effect is played according to the feedback frequency in the feedback instruction; plays the sound effect to the user according to the determined number of times; or, The feedback module determines the number of vibrations according to the feedback frequency in the feedback instruction; provides vibration feedback to the user according to the determined number of times; or, The feedback module determines the quantity of fragrance to be released according to the feedback frequency in the feedback instruction; releases fragrance according to the determined quantity of taste for feedback; or, The feedback module provides interface display feedback to the user according to the feedback frequency in the feedback instruction; or, The feedback module controls the target of the operation to provide vibration feedback to the user when the operation is for a preset vehicle component. The voice interaction device according to claim 11, wherein the feedback module provides feedback to the user according to the feedback frequency in the feedback instruction while the operation is being performed, including: The feedback module acquires the position information of the user; controls the seat corresponding to the position information to provide vibration feedback to the user. A vehicle, characterized in that the vehicle includes a memory and a processor, and a computer program is stored in the memory, and when the computer program is executed by the processor, the method described in any one of claims 1-10 is realized. voice interaction method. A non-volatile computer-readable storage medium of a computer program, characterized in that, when the computer program is executed by one or more processors, the voice interaction method described in any one of claims 1-10 is implemented.

Images