CN116036575B - Handle control method, electronic device and computer-readable storage medium - Google Patents
Handle control method, electronic device and computer-readable storage mediumInfo
- Publication number
- CN116036575B CN116036575B CN202310142382.0A CN202310142382A CN116036575B CN 116036575 B CN116036575 B CN 116036575B CN 202310142382 A CN202310142382 A CN 202310142382A CN 116036575 B CN116036575 B CN 116036575B
- Authority
- CN
- China
- Prior art keywords
- handle
- audio
- vibration
- determining
- trigger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a control method of a handle, electronic equipment and a computer readable storage medium, wherein the method comprises the steps of obtaining a triggering process corresponding to a control action received by the handle on the handle, determining a corresponding audio fragment from audio to be played corresponding to the control action according to the triggering process, and controlling a vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio fragment. The invention aims to improve the operational reality experience.
Description
Technical Field
The present invention relates to the field of electronic devices, and in particular, to a method for controlling a handle, an electronic device, and a computer readable storage medium.
Background
The virtual reality device is typically provided with a handle, and after pairing the two, the user can interact with the virtual reality device through the handle. The handle typically provides a way of interaction that is unidirectionally transferred by the user to the virtual scene, such as by the handle controlling objects such as game props, cursors, etc. in the virtual scene. The handle generally does not feed back operation touch feeling in a virtual scene of a user singly, for example, when a real shooting is performed, the holding hand feeling is different when different guns shoot. Under scene such as experience shooting, the handle can only vibrate singly, can't provide different jolt, leads to the operation authenticity user experience that the handle provided is poor.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a control method of a handle, electronic equipment and a computer readable storage medium, and aims to achieve the effect of improving operation authenticity.
To achieve the above object, the present invention provides a control method of a handle, the method comprising:
acquiring a triggering process corresponding to the control action received by the handle on the handle at present;
Determining a corresponding audio fragment from the audio to be played corresponding to the control action according to the triggering process;
and controlling the vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio frequency fragments.
Optionally, the vibration module includes a plurality of vibration elements mounted at different positions of the handle, and the step of controlling the vibration module of the handle to vibrate according to the spectral characteristics of the audio clip includes:
determining the spectral features to determine a channel of the audio segment;
and controlling the target vibration element corresponding to the sound channel to vibrate according to the frequency spectrum characteristics.
Optionally, the step of determining the spectral feature to determine the channel of the audio piece comprises:
Acquiring the equipment identifier of the handle;
And determining the sound channel according to the equipment identification and the frequency spectrum characteristic.
Optionally, the step of acquiring the triggering process corresponding to the control action received by the handle currently on the handle includes:
acquiring pressure data of a trigger key on the handle;
And determining the triggering process according to the pressure data.
Optionally, the step of determining the triggering process according to the pressure data includes:
Determining a pressure change value of the trigger key in a preset period and a compression direction of the trigger key according to the pressure data;
And determining the triggering process according to the pressure change value and the compression direction.
Optionally, before the step of controlling the vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio piece, determining a pressure change rate according to the pressure change value when the pressure value is smaller than a preset value, determining a playing speed of the audio piece according to the pressure change rate, and adjusting the frequency spectrum characteristics of the audio piece according to the playing speed.
Optionally, after the step of determining the corresponding audio clip from the audio to be played corresponding to the control action according to the triggering process, the method further includes:
and synchronously controlling associated equipment of the handle and/or a loudspeaker of the handle to play the audio clip when the vibration module is controlled to vibrate.
Optionally, the step of controlling the vibration of the vibration module of the handle according to the spectral characteristics of the audio clip comprises:
And when the handle receives the audio fragment, controlling the vibration module to vibrate according to the frequency spectrum characteristics.
In addition, in order to achieve the above object, the present invention also provides an electronic device including a memory, a processor, and a control program of a handle stored on the memory and executable on the processor, the control program of the handle implementing the steps of the control method of the handle as described above when executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a control program of a handle, which when executed by a processor, implements the steps of the control method of a handle as described above.
The embodiment of the invention provides a control method of a handle, electronic equipment and a computer readable storage medium, wherein a triggering process corresponding to a control action received by the handle on the handle is firstly obtained, a corresponding audio fragment is determined from audio to be played corresponding to the control action according to the triggering process, and a vibration module of the handle is controlled to vibrate according to the frequency spectrum characteristics of the audio fragment. After the control action is received by the handle, the process is triggered on the handle according to the control action, a corresponding audio clip is selected from audio to be played corresponding to the control action, and then the vibration module of the handle is controlled to vibrate according to the frequency spectrum characteristics of the audio clip, so that the control action can be split into different stages, and the touch sense of the control action is provided for users in different trigger periods, thereby improving the operation authenticity experience.
Drawings
FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flow chart of an embodiment of a method for controlling a handle according to the present invention;
FIG. 3 is a flow chart of another embodiment of a control method of the handle of the present invention;
FIG. 4 is a schematic view of a handle according to an embodiment of the present invention;
fig. 5 is a schematic diagram of preset correspondence between audio clips, channels and vibration elements according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Because in the related art, the handle generally provides an interactive experience which is transmitted to the virtual scene in a unidirectional way by the user, but the handle generally does not feed back a real operation touch in the virtual scene of the user, the handle can only vibrate singly, different shock sensations cannot be provided, and the operation reality provided by the handle is poor.
In order to improve the operation authenticity, the embodiment of the invention provides a control method of a handle, electronic equipment and a computer readable storage medium, wherein the method mainly comprises the following steps:
acquiring a triggering process corresponding to the control action received by the handle on the handle at present;
Determining a corresponding audio fragment from the audio to be played corresponding to the control action according to the triggering process;
and controlling the vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio frequency fragments.
Therefore, the control action can be split into different trigger processes, the different trigger processes correspond to the audio to be played corresponding to the control action, and when different triggers are carried out, the vibration module of the handle is controlled according to different audio fragments to vibrate, so that the touch feeling of a user in different trigger periods is provided, and the operation authenticity experience is improved.
The invention as claimed is described in detail below with reference to the attached drawing figures.
As shown in fig. 1, fig. 1 is a schematic diagram of a terminal structure of a hardware running environment according to an embodiment of the present invention.
The terminal of the embodiment of the invention can be an electronic device.
As shown in fig. 1, the terminal may include a processor 1001, such as a CPU, a memory 1003, and a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The memory 1003 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1003 may alternatively be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the terminal structure shown in fig. 1 is not limiting of the terminal and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, a control program of an operating system and a handle may be included in a memory 1003 as one type of computer storage medium.
In the terminal shown in fig. 1, the processor 1001 may be used to call a control program of the handle stored in the memory 1003, and perform the following operations:
acquiring a triggering process corresponding to the control action received by the handle on the handle at present;
Determining a corresponding audio fragment from the audio to be played corresponding to the control action according to the triggering process;
and controlling the vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio frequency fragments.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
determining the spectral features to determine a channel of the audio segment;
and controlling the target vibration element corresponding to the sound channel to vibrate according to the frequency spectrum characteristics.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
Acquiring the equipment identifier of the handle;
And determining the sound channel according to the equipment identification and the frequency spectrum characteristic.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
acquiring pressure data of a trigger key on the handle;
And determining the triggering process according to the pressure data.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
Determining a pressure change value of the trigger key in a preset period and a compression direction of the trigger key according to the pressure data;
And determining the triggering process according to the pressure change value and the compression direction.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
When the pressure value is smaller than a preset value, determining a pressure change rate according to the pressure change value;
determining the playing speed of the audio clip according to the pressure change rate;
and adjusting the frequency spectrum characteristics of the audio frequency fragments according to the playing speed.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
and synchronously controlling associated equipment of the handle and/or a loudspeaker of the handle to play the audio clip when the vibration module is controlled to vibrate.
Further, the processor 1001 may call a control program of the handle stored in the memory 1003, and also perform the following operations:
And when the handle receives the audio fragment, controlling the vibration module to vibrate according to the frequency spectrum characteristics.
The following is a description of what is claimed in the claims of the present invention by means of specific exemplary embodiments, so that those skilled in the art can better understand the scope of the claims of the present invention. It should be understood that the following exemplary embodiments do not limit the scope of the present invention, but are only used to illustrate the present invention.
Illustratively, referring to FIG. 2, in one embodiment of the control method of the handle of the present invention, the control method of the handle comprises the steps of:
step S10, acquiring a triggering process corresponding to the control action received by the handle on the handle at present;
In this embodiment, the control method of the handle may be applied to an electronic device, which may be the handle or an associated device of the handle. The associated device may be a virtual reality device, such as VR glasses, or other electronic devices, such as a game console. The associated device is mainly used for providing the operation scene, such as a game scene and the like, for the user, and has the requirement of restoring the authenticity of the operation scene and immersing the user therein. The user controls the associated equipment through the handle to interact with the operation scene of the associated equipment, and the immersion of the user in the operation scene is influenced by the improved operation reality of the handle.
When interacting with the operation scene, the user triggers the control action by means of a key, a moving handle and the like, wherein the control action is a preset action requiring the user to actively trigger in the operation scene, for example, in a shooting game, the control action of triggering the gun by triggering the trigger is preset, and then the user triggers the control action of triggering the gun by triggering the trigger. The time from the control action received by the handle to the control action ending is required, different time periods or different control actions are corresponding to different trigger processes, and the trigger processes can be divided according to time, handle moving distance, pressing degree of the handle trigger key and the like.
In the long jump game, a user presses a trigger key for a long time when accumulating force in the long jump, different pressing times correspond to different pressing degrees, touch feeling which needs a handle to feed back to the user is also different, and the trigger process of the control action can be determined according to the time after the received control action.
In the fruit cutting game, a user cleaves fruits by waving the handle, and the moving distance of the handle corresponds to different completion degrees of the cleaving operation in the process from the beginning of waving to the ending of waving, so that the triggering process of the control action can be determined according to the moving data of the handle.
In the shooting game, the user pulls the trigger once to be regarded as shooting once, the pressure data received by the trigger is changed continuously from the beginning of pulling the trigger to the complete release of the trigger, and the triggering process of the control action can be determined according to the pressure data of the trigger on the handle.
Optionally, acquiring pressure data of a trigger key on the handle, and determining the trigger process according to the pressure data.
Most control actions are triggered by the trigger key of the handle, for example, in shooting scenarios, the trigger key 1 needs to be used as a trigger, see fig. 4. The pressure data received by the trigger key on the handle can be monitored in real time, and the trigger process is determined through the pressure data. In the process that the user completes the control action by triggering the key, the pressure value gradually becomes larger, and then the user releases the trigger, so that the pressure value becomes smaller in a short time. The triggering course of the control action can thus be determined from the pressure data.
When the control action received by the handle is the start of the triggering process of the control action, for example, when the user starts pulling the trigger, the handle receives the control action of the gun to start the triggering process of shooting. When the user releases the trigger completely, the handle ends the control action. Each node corresponds to different trigger processes, the whole trigger process of the control action can be segmented according to certain characteristics, each segment corresponds to one trigger process, so that the calculation power consumption is reduced, and the operation authenticity experience is brought to a user.
Taking a shooting scene of a garlin as an example, a triggering process 1, wherein when a player slowly pulls a garlin trigger key, the garlin turnplate rotates in an accelerating way, and no bullet is ejected, the player only can feel the vibration feeling caused by the rotation of the turnplate, the recoil vibration caused by the bullet is not experienced, the corresponding vibration feeling and sound are mild, the turnplate can rotate at a uniform speed until the player pulls a certain pressure, the player can feel the vibration feeling caused by the rotation of the turnplate, the bullet is ejected, the player can feel the vibration feeling caused by the rotation of the turnplate, the player can also experience the recoil vibration caused by the bullet ejection, and a triggering process 3, when the trigger key is slowly released, the turnplate can rotate in a decelerating way, and no bullet is output, and the player only can feel the vibration feeling caused by the rotation of the turnplate, and the recoil vibration caused by the bullet ejection cannot be experienced.
Specifically, the whole process of the control action can be divided into a plurality of trigger processes, the pressure range corresponding to each process is determined, the pressure range where the pressure value received by the current trigger key is located is determined according to the pressure data, and the corresponding trigger process is determined according to the located pressure range. If the pressure range is unchanged from the previous one, it is determined that the previous trigger process is not ended and the next step is not continued.
Optionally, determining a pressure change value of the trigger key in a preset period and a compression direction of the trigger key according to the pressure data, and determining the trigger process according to the pressure change value and the compression direction.
Most trigger keys are provided with an automatic rebound feature, and the direction of compression of the trigger key also includes both the compression and release directions throughout the process of completing a control action by the trigger key. The trigger key may change over time throughout the process. In the preset time period, even if the pressure change values are the same, the compression direction of the trigger key in the preset time period is distinguished, and the trigger process can be better determined according to the compression direction and the pressure change values. For example, in a preset period, the pressure change value during the rebound of the trigger key is larger than the pressure change value during the pressing of the trigger key, and the compression direction is opposite. The compression direction may be determined by a difference between an initial pressure value at the start of the predicted period and a final pressure value after the end of the preset period. If the difference is positive, the compression direction is compression, and if the difference is negative, the direction is release.
Further, when the pressure value is smaller than a preset value, determining a pressure change rate according to the pressure change value, determining the playing speed of the audio clip according to the pressure change rate, and adjusting the frequency spectrum characteristics of the audio clip according to the playing speed.
The current pressure value of the trigger key is determined according to the pressure data of the trigger key on the handle, when the pressure value is larger than a preset value, the user presses the trigger key basically to touch the bottom, but the pressure value can be continuously increased, to the extent that the playing speed of the audio clip cannot be adjusted according to the pressure value, and the corresponding audio clip is high enough, and does not need to be adjusted according to the pressure value. When the pressure value is smaller than a preset value, for example, the trigger process 1 and the trigger process 3 of the shooting scene generally only rotate the turntable, the faster the turntable rotates along with the increase of the pressure value in the trigger process 1, the faster the corresponding audio playing speed should be, and the slower the turntable rotates along with the decrease of the pressure value in the trigger process 2, the slower the corresponding audio playing speed should be. For the audio to be played, the control action can set the sound effect of the corresponding content according to different trigger processes, for example, the sound effect of the whole turntable is that the turntable rotates faster and slower. For some played audio, the audio is a uniform-speed audio, so that the playing speed of the audio needs to be adjusted, the corresponding pressure change rate can be determined according to the pressure change value in a preset time period, the playing speed of the audio clip can be adjusted according to the pressure change rate, and the preset time period is short in duration, so that the playing speed of the audio clip can be controlled in real time. And then adjusting the frequency spectrum characteristics of the audio clips according to the audio playing speed, namely compressing the frequency spectrum of the audio clips in the time domain. And controlling the vibration module to vibrate according to the adjusted frequency spectrum characteristics of the audio piece, or synchronously controlling associated equipment of the handle and/or a loudspeaker of the handle to play the audio piece according to the adjusted frequency spectrum characteristics when controlling the vibration module to vibrate.
Step S20, determining a corresponding audio fragment from the audio to be played corresponding to the control action according to the triggering process;
In this embodiment, better operation experience is given to the user, and the control action is accomplished in the process of completing the control action, such as the audio of the game sound effect. The audio is determined from the control action when the control action is initiated. But the audio needs a certain time to be played, so the audio is the audio to be played. In most scenes, the audio will correspond to control actions, and in order to simulate different scenes or provide a better experience, the content of the audio etc. will change, corresponding to different audio frequencies. Taking the garlin shooting scene as an example, in a real scene, the shooting sound of garlin after a user pulls a trigger gradually reaches the high-frequency audio when the bullet is released from the low-frequency audio when the turntable starts to rotate, and the pressing degree of the corresponding trigger is different. It follows that the corresponding audio clips of the audio to be played are different in different trigger processes. The corresponding audio clip may be determined from the audio to be played according to the current trigger procedure.
Optionally, dividing the audio to be played into a plurality of continuous audio fragments according to the frequency spectrum characteristics of the audio to be played, and corresponding the audio fragments to the triggering process of the control action according to the sequence of the audio fragments to obtain the preset corresponding relation of the triggering process and the audio fragments.
The audio to be played can be an audio effect corresponding to the triggering process of the whole control action, and the waveform of the audio fragment can be greatly changed in the time domain and the frequency domain in the whole process. But the spectral characteristics do not change much over a period of time, indicating that the control action does not progress much over this period of time. In order to save power consumption, the audio to be played can be divided into a plurality of continuous audio segments according to the frequency spectrum characteristics of the audio to be played, and the duration of the audio segments can be different, but in the same audio segment, the difference between the maximum value and the minimum value of the audio frequency is not greater than a preset value, and the audio segments are continuous in time. Determining the sequence of the audio fragments according to the time interval of the audio fragments in the audio to be played, and determining the preset corresponding relation between the triggering process and the audio fragments according to the sequence of the audio fragments in the audio to be played and the sequence of the triggering process in the whole control action triggering process. The step S20 includes determining an audio clip corresponding to the current triggering process according to a preset correspondence between the triggering process and the audio clip.
And step S30, controlling the vibration module of the handle to vibrate according to the frequency spectrum characteristics of the audio frequency segment.
In this embodiment, the vibration module is disposed on the handle, and is configured to provide vibration feedback to the user, including simulating vibration of the corresponding object of the handle in the operation scene. The audio to be played is to match with the sound effect set by the control action, the audio to be played is to dub the control action, the intensity of the control action in the scene is indicated, the real scene is restored, and the user experience can be improved. When the audio to be played is relatively low, the fact that the handles in the scene do not make high sound and violent vibration corresponding to the objects such as guns is indicated, and the vibration fed back to the user by the handles is not excessive. Because the audio to be played generally uses sounds generated when the items in the scene vibrate, the vibration frequency of the scene is the same as the audio frequency of the audio to be played. The audio clip is the audio which is selected by the audio to be played in the triggering process, the audio frequency of the audio clip at each time can be determined according to the frequency spectrum characteristics of the audio clip, the vibration frequency of the vibration module of the handle at each time in the triggering process is further determined, and then the vibration of the vibration module is controlled to vibrate according to the vibration frequency in the triggering process.
Optionally, when controlling the vibration module to vibrate, the associated device of the handle and/or the speaker of the handle are synchronously controlled to play the audio clip.
After the current triggering process of the control action is determined, determining an audio fragment corresponding to the triggering process, and determining the vibration frequency of the vibration module of the handle in the triggering process according to the audio fragment. The vibration of the handle can be controlled according to the vibration frequency in the triggering process, a more real touch experience is provided for a user, and the user can distinguish different control actions according to the touch. In addition, in order to improve the immersive performance, the touch feeling, the hearing and the like of the user are fused, the vibration module is controlled to vibrate at the determined vibration frequency in the triggering process, and simultaneously, the audio clips are played through the associated equipment of the handle and/or the loudspeaker of the handle, so that the operation authenticity experience is further improved.
If the handle is provided with the loudspeaker, the audio fragment can be played based on the loudspeaker of the handle, so that the user can recognize the directionality of the audio fragment and the scene is more favorable to be restored.
In this embodiment, the control of the handle may be applied to the handle or the associated device of the handle, and if the control is applied to the handle, after determining the audio segment, the handle may directly determine the vibration parameter of the vibration module according to the spectral feature of the audio segment, and then directly control the vibration module to vibrate according to the vibration parameter. If applied to the associated device of the handle, step S10 includes receiving pressure data of a trigger key on the handle sent by the handle, and determining a trigger process according to the pressure data. When executing step S30, the control operation of the handle is to send the determined audio segment or the vibration parameter determined according to the audio segment to the handle, when the handle receives the audio segment, the handle is required to determine the vibration parameter of the vibration module according to the audio segment, and the vibration module is controlled to vibrate according to the vibration parameter, or when receiving the vibration parameter, the vibration module is controlled to vibrate according to the vibration parameter. This allows control of the handle by the associated device.
In the technical scheme disclosed by the embodiment, a triggering process corresponding to a control action received by the handle on the handle is firstly obtained, a corresponding audio fragment is determined from audio to be played corresponding to the control action according to the triggering process, and vibration of a vibration module of the handle is controlled according to the frequency spectrum characteristics of the audio fragment. After the control action is received by the handle, the process is triggered on the handle according to the control action, a corresponding audio clip is selected from audio to be played corresponding to the control action, and then the vibration module of the handle is controlled to vibrate according to the frequency spectrum characteristics of the audio clip, so that the control action can be split into different stages and provided for users in different trigger periods, the operation authenticity provided by the handle and associated equipment for the users is improved, and the users are immersed in an operation scene.
Optionally, referring to fig. 3, in another embodiment of the control method of the handle according to the present invention, based on any one of the above embodiments, the control method of the handle further includes:
Step S31, determining the frequency spectrum characteristics and determining the sound channel of the audio fragment;
and step S32, controlling the target vibration element corresponding to the sound channel to vibrate according to the frequency spectrum characteristics.
In this embodiment, the handle of the control includes a plurality of vibration elements mounted at different positions of the handle, and when the different vibration elements vibrate at different positions, vibration feedback at different positions can be provided to the user. In many scenarios, the vibrations of the user holding the article at different positions are different, so that the vibrating elements at different positions may vibrate according to different sizes of vibration frequencies, i.e. the vibrating elements at different positions may be controlled to vibrate only according to the audio segments in their corresponding audio frequency ranges. When the vibration elements at the corresponding positions are controlled to vibrate according to the audio frequency of the audio frequency fragment, the vibration frequency does not exceed the preset range, different vibration experiences at different positions are realized, and the operation authenticity experience is further restored.
Optionally, referring to fig. 4, the handle includes a trigger key 1 and a grip part, the trigger key 1 is connected with a pressure sensor for collecting pressure data of the trigger key, a narrow-frequency vibration element 2 is arranged between the grip part and the trigger key 1, and a broadband vibration element 3 is arranged on the grip part. The narrow-band vibration element 2 is used for vibrating according to the audio piece with the audio frequency smaller than the preset value, and the broadband vibration element 3 is used for vibrating according to the audio piece with the audio frequency larger than or equal to the preset value. In shooting scenes, vibration caused by rotation of a turntable exists in a triggering process corresponding to an audio frequency segment with the audio frequency smaller than a preset value, the audio frequency segment belongs to low frequency, a user can feel forward micro vibration according to control of the low-frequency audio segment, the power accumulation of a gun before shooting is simulated, recoil vibration caused by bullet shooting is generated in the triggering process corresponding to the audio frequency segment with the audio frequency larger than or equal to the preset value, the audio frequency segment belongs to high frequency, and the user can feel backward severe vibration according to control of the broadband vibration element 3 of the high-frequency audio segment, so that the recoil of shooting is simulated.
Specifically, in order to distinguish different vibrating elements, the vibration frequency range of the vibrating element is determined according to the position of the vibrating element, the corresponding audio frequency range is determined according to the vibration frequency range of the vibrating element, the audio frequency range of the audio frequency segment is determined according to the frequency spectrum characteristics of the audio frequency segment, whether the audio frequency range is within the vibration range of the vibrating element is determined, and if so, the vibrating element is controlled to vibrate according to the frequency spectrum characteristics of the audio frequency segment. In the actual implementation process, in order to realize the diversion of the audio segment in advance, the pressure of the processor is reduced, and especially when the control method of the handle is applied to the associated equipment of the handle, the computational power consumption of the handle needs to be reduced, the target vibration element can be determined according to the sound channel of the audio segment by changing the sound channel of the audio segment, and the target vibration element is controlled to vibrate according to the frequency spectrum characteristics of the audio segment.
Before that, the corresponding audio frequency ranges are determined according to the positions of the vibrating elements, and the corresponding vibrating elements, the corresponding sound channels and the corresponding audio frequency ranges are obtained, so that the preset corresponding relation among the vibrating elements, the corresponding sound channels and the corresponding audio frequency ranges is obtained. And determining an audio frequency range in which the audio fragment is positioned and a corresponding sound channel according to the frequency spectrum characteristics of the audio fragment and a preset corresponding relation, and then determining a corresponding target vibrating element.
Optionally, obtaining a device identification of the handle, and determining the sound channel according to the device identification and the spectral features.
The handle association device may associate other handles in addition to the handle. There are typically two handles, a left and a right handle. If the control method of the handle is applied to the associated equipment of the handle, different handles and different vibrating elements on the handles can be distinguished through sound channels when the control method of the handle is realized. Recording the transmitted pressure data or equipment identification of a handle triggering the process, determining a sound channel corresponding to the audio fragment according to the equipment identification and the frequency spectrum characteristics of the audio fragment, transmitting the audio fragment to operation equipment based on the sound channel, determining whether a target vibration element corresponding to the sound channel is included in a vibration element of the operation equipment according to the sound channel of the audio fragment, and if the target vibration element is included, controlling the vibration of the target vibration element according to the frequency spectrum characteristics of the audio fragment.
It should be noted that, the number of the audio to be played corresponding to the control action may be one or more, in the whole triggering process of the control action, there may be a plurality of overlapping of the audio to be played, for example, in a shooting scene, only the sound of rotating the turntable may occur, the sound of rotating the turntable and dropping the cartridge case may simultaneously exist, and the audio clip corresponding to the triggering process of the control action may also be one or more. If a plurality of audio to be played corresponding to the control action exist, a plurality of corresponding audio fragments are respectively determined from the plurality of audio to be played corresponding to the control action according to the triggering process, and different vibration modules of the vibration module are respectively controlled to vibrate according to the frequency spectrum characteristics of the audio frequency band.
For better understanding, a specific application scenario is provided:
The virtual reality device is associated with two handles, a left handle and a right handle, which are required to be provided with two vibrating elements (a narrow-frequency motor and a wide-frequency motor) respectively. The left handle is provided with a left handle narrow-frequency motor and a left handle wide-frequency motor, and the right handle is provided with a right handle narrow-frequency motor and a right handle wide-frequency motor. Referring to fig. 4, taking a right-hand handle as an example, the Trigger button (Trigger button 1) has a pressure sensor, and can feed back a pressure value in real time. The right handle narrow frequency motor (narrow frequency vibration element 2) is positioned at the front section of the handle, the right handle wide frequency motor (wide frequency vibration element 3) is positioned at the holding part, and the holding part is a hand holding area. The trigger keys of the left handle and the right handle have the same functions, are provided with pressure sensors, can feed back pressure values in real time, and have the same relative positions of the narrow-frequency motor and the wide-frequency motor. Different audio clips are sent to different motors according to corresponding sound channels, the handle outputs motor vibration waveforms according to waveforms (frequency spectrum characteristics) of the audio clips by analyzing the audio, and the larger the waveform vibration of the audio clips is, the larger the motor vibration waveform is output. Therefore, the handle motor can vibrate according to the waveform of the audio frequency fragment, the larger the waveform vibration is, the larger the handle vibration is, and the smaller the waveform vibration is, the smaller the handle vibration is.
Referring to fig. 5, the audio clip 1 is fed to the left-hand grip narrow-band motor, the audio clip 2 is fed to the right-hand grip narrow-band motor, the audio clip 3 is fed to the left-hand grip wide-band motor, and the audio clip 4 is fed to the right-hand grip wide-band motor. When shooting a virtual scene, a user wants to make which motor vibrate according to a desired waveform, and then the waveform audio fragment can be transmitted to the motor.
Taking a garlin shooting scene as an example, in order to simulate a garlin real shooting scene, according to a pressure value of a Trigger key of a real-time monitoring handle, dividing the Trigger key process into 0-100%, and according to a conventional gun taking method, placing a right hand at a Trigger key (Trigger key 1) position to take charge of shooting according to fig. 4, wherein the specific shooting is as follows:
When the shooting control action of the garellin is triggered, the shooting control action is divided into a front section, a middle section and a rear section, the triggering process of each triggering process is determined, the audio frequency fragments of each triggering process comprise sound effects such as gunshot, shell case landing sound and the like, the sound effects are short audio frequencies, and the length is generally about tens of milliseconds.
And acquiring a Trigger key pressure value to obtain a Trigger key process, wherein the Trigger key process is below 10%, and no audio operation and motor vibration operation are performed.
When the Trigger key process is 10% -80%, the turntable is accelerated to rotate, the audio playing frequency of the front section of the gatelin is dynamically controlled, the larger the process is, the faster the music playing frequency is, the stronger the corresponding right-hand-handle narrow-frequency motor vibrates, and the feeling of accelerated rotation is given to people.
When the Trigger key process is greater than 80%, the turntable rotates at a constant speed, and at the same time, bullet shooting actions are performed, the audio playing speed of the front section of the gateline is dynamically accelerated and controlled, the audio playing frequency of the middle section of the gateline and the audio playing frequency of the bullet shooting sound are kept unchanged, the corresponding handle narrowband motor and the broadband motor vibrate in the same rule, and the shell landing sound is played at the same playing speed, but is delayed from the bullet shooting sound, and the delay time can be adjusted according to the actual effect.
When the Trigger key process is from 80% -0, the rotary table is decelerated and rotated, bullets cannot shoot, the audio playing speed of the front section of the gateline is dynamically controlled, the smaller the process is, the slower the playing music frequency is, the weaker the vibration of the corresponding right-handle narrow-frequency motor is, and a deceleration rotating feel is provided.
In the technical scheme disclosed by the embodiment, the frequency spectrum characteristics are determined, the sound channel of the audio fragment is determined, and the target vibration element corresponding to the sound channel is controlled to vibrate according to the frequency spectrum characteristics. Therefore, the audio clips are split, the calculation consumption is saved, the vibrating elements at different positions can be controlled, and the operation authenticity experience is further improved.
In addition, the embodiment of the invention also provides an electronic device, which comprises a memory, a processor and a control program of a handle, wherein the control program of the handle is stored in the memory and can run on the processor, and the control program of the handle realizes the steps of the control method of the handle in each embodiment when being executed by the processor.
In addition, the embodiment of the invention also provides a computer readable storage medium, wherein the computer readable storage medium stores a control program of the handle, and the control program of the handle realizes the steps of the control method of the handle according to each embodiment when being executed by a processor.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising several instructions for causing an electronic device to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310142382.0A CN116036575B (en) | 2023-02-17 | 2023-02-17 | Handle control method, electronic device and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310142382.0A CN116036575B (en) | 2023-02-17 | 2023-02-17 | Handle control method, electronic device and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116036575A CN116036575A (en) | 2023-05-02 |
| CN116036575B true CN116036575B (en) | 2025-10-28 |
Family
ID=86124020
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310142382.0A Active CN116036575B (en) | 2023-02-17 | 2023-02-17 | Handle control method, electronic device and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116036575B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104423592A (en) * | 2013-09-06 | 2015-03-18 | 意美森公司 | Systems and methods for generating haptic effects associated with envelopes in audio signals |
| CN106547393A (en) * | 2016-09-26 | 2017-03-29 | 宇龙计算机通信科技(深圳)有限公司 | Based on the key configurations method of pressure touch, device and key control method |
| CN115586830A (en) * | 2022-09-28 | 2023-01-10 | 上海艾为电子技术股份有限公司 | Terminal, handle and vibration control method |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101610599A (en) * | 2008-06-19 | 2009-12-23 | 深圳富泰宏精密工业有限公司 | Hand-hold mobile electronic device controllable vibration system and method |
| CN106265019A (en) * | 2016-08-20 | 2017-01-04 | 北京云艾科技有限公司 | A kind of vibrations apparatus control method and device |
| WO2020258225A1 (en) * | 2019-06-28 | 2020-12-30 | 瑞声声学科技(深圳)有限公司 | Gamepad and gamepad vibration method and apparatus |
| CN114984566B (en) * | 2022-06-16 | 2025-05-09 | 歌尔股份有限公司 | Handle control method, device and handheld device |
-
2023
- 2023-02-17 CN CN202310142382.0A patent/CN116036575B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104423592A (en) * | 2013-09-06 | 2015-03-18 | 意美森公司 | Systems and methods for generating haptic effects associated with envelopes in audio signals |
| CN106547393A (en) * | 2016-09-26 | 2017-03-29 | 宇龙计算机通信科技(深圳)有限公司 | Based on the key configurations method of pressure touch, device and key control method |
| CN115586830A (en) * | 2022-09-28 | 2023-01-10 | 上海艾为电子技术股份有限公司 | Terminal, handle and vibration control method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116036575A (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11731045B2 (en) | Pre-set audio profiles for graphical user interface and parametric equalizer in gaming systems | |
| US10416770B2 (en) | Haptic trigger control system | |
| US10532279B2 (en) | Video gameplay haptics | |
| US20230063912A1 (en) | System and method for use in haptic signal generation | |
| CN109144464A (en) | A kind of method, apparatus and Android device of audio output | |
| CN106028119B (en) | The customizing method and device of multimedia special efficacy | |
| JP2016168339A (en) | Asynchronous audio for network games | |
| EP3261737B1 (en) | Modifying haptic effects for slow motion | |
| CN109999488A (en) | A kind of method for oscillating, terminal and storage medium | |
| CN116036575B (en) | Handle control method, electronic device and computer-readable storage medium | |
| CN113856199A (en) | Game data processing method and device and game control system | |
| CN114870396A (en) | Motor driving method and system, and electronic device | |
| JP7277777B2 (en) | Sound reproduction program, sound reproduction device and sound generation method | |
| EP4358084A1 (en) | Audio cancellation system and method | |
| CN108404410A (en) | The control method and device of object, storage medium, electronic device | |
| KR20140112131A (en) | Method of haptic game implementation, and computer-readable recording medium for th same | |
| JP2023001105A (en) | Voice cancellation system and method | |
| CN112803828A (en) | Motor control method, control system and control chip | |
| CN115869618B (en) | Voice data processing method, device, equipment and storage medium | |
| JPWO2022120051A5 (en) | ||
| CN119633362A (en) | Control method, chip and electronic device | |
| GB2639939A (en) | A device, computer program and method | |
| CN119496474A (en) | EQ equalization coefficient switching method, device, storage medium and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |