[go: up one dir, main page]

WO2019220495A1 - Information processing device - Google Patents

Information processing device Download PDF

Info

Publication number
WO2019220495A1
WO2019220495A1 PCT/JP2018/018524 JP2018018524W WO2019220495A1 WO 2019220495 A1 WO2019220495 A1 WO 2019220495A1 JP 2018018524 W JP2018018524 W JP 2018018524W WO 2019220495 A1 WO2019220495 A1 WO 2019220495A1
Authority
WO
WIPO (PCT)
Prior art keywords
vibration
instruction
notification
sound
voice
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/018524
Other languages
French (fr)
Japanese (ja)
Inventor
佑輔 中川
由香理 小西
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Original Assignee
Sony Interactive Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Interactive Entertainment Inc filed Critical Sony Interactive Entertainment Inc
Priority to PCT/JP2018/018524 priority Critical patent/WO2019220495A1/en
Priority to PCT/JP2019/010669 priority patent/WO2019220758A1/en
Publication of WO2019220495A1 publication Critical patent/WO2019220495A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to an information processing apparatus, an information processing method, and a program for presenting voice and vibration to a user.
  • an information processing apparatus such as a home game machine is connected to an audio reproduction apparatus, and is presented to the user by reproducing audio such as various BGMs and sound effects from the audio reproduction apparatus.
  • vibration may be presented to the user by operating a vibrating device that is used by being worn on or held by the user's body.
  • the present invention has been made in view of such circumstances, and one of its purposes is to provide an information processing apparatus, an information processing method, and a program that are easy to use for those who are difficult to detect voice. .
  • An information processing apparatus is an information processing apparatus connected to a sound reproduction apparatus and a vibration device, and a sound reception unit that receives a sound reproduction instruction that specifies the content of sound to be reproduced from the sound reproduction apparatus;
  • a vibration control unit that causes the vibration device to generate a notification vibration corresponding to the sound instead of or in addition to the sound reproduction when the sound reproduction instruction is received;
  • the sound A setting reception unit that receives in advance setting information for designating whether to generate the notification vibration for each type, and the voice reception unit generates the notification vibration according to the setting information It is an information processing apparatus characterized by determining whether or not to perform.
  • An information processing method includes a step of receiving a sound reproduction instruction that specifies the content of sound to be reproduced from a sound reproduction device, and, when the sound reproduction instruction is received, instead of reproducing the sound, or In addition to the reproduction of the sound, a step of outputting a control signal for causing the vibration device to generate a notification vibration corresponding to the sound, and setting information for designating whether to generate the notification vibration for each type of the sound Is received from a user in advance, and a step of determining whether or not to generate the notification vibration is determined according to the setting information.
  • the program according to the present invention includes a step of accepting an audio reproduction instruction that specifies the content of audio to be reproduced from an audio reproduction device, and, when the audio reproduction instruction is accepted, instead of reproducing the audio or the audio
  • a step for determining whether to generate the notification vibration in accordance with the setting information may be provided by being stored in a computer-readable non-transitory information storage medium.
  • FIG. 1 It is a block diagram showing the example of a structure of the information processing system containing the information processing apparatus which concerns on embodiment of this invention. It is a functional block diagram showing the function of the information processing apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the flow of the process which the information processing apparatus which concerns on embodiment of this invention performs. It is a figure which shows an example of the left vibration and right vibration before a synthesis
  • the information processing system 1 includes an information processing device 10, a display device 21, a sound reproduction device 22, and a vibration device 23.
  • the information processing apparatus 10 is a home game machine, a portable game machine, a personal computer, or the like, and includes a control unit 11, a storage unit 12, and an interface unit 13, as shown in FIG. ing.
  • the control unit 11 includes a program control device such as a CPU, and executes various types of information processing according to programs stored in the storage unit 12. A specific example of processing executed by the control unit 11 will be described in detail later.
  • the storage unit 12 is a memory device or the like and holds a program executed by the control unit 11. This program may be provided by being stored in a computer-readable non-transitory storage medium and copied to the storage unit 12.
  • the storage unit 12 also operates as a work memory for the control unit 11.
  • the interface unit 13 is an interface for transmitting and receiving data to and from the display device 21, the sound reproduction device 22, and the vibration device 23.
  • the interface unit 13 may include a wired communication interface such as USB (Universal Serial Bus) or a wireless communication interface such as Bluetooth (registered trademark).
  • the display device 21 is a liquid crystal display, an organic EL display, or the like, and displays an image based on the video signal received from the information processing device 10 via the interface unit 13 on the screen.
  • the display device 21 may be a head-mounted display device that is used by the user wearing the head.
  • the audio reproduction device 22 is a speaker, headphones, or the like, and sounds a sound based on the audio signal received from the information processing device 10.
  • the vibration device 23 is a device that is used by being held by the user's hand or worn on the user's body.
  • the vibration device 23 includes two vibration mechanisms 24.
  • the housing of the vibration device 23 includes a grip portion 25L for a user to hold with a left hand and a grip portion 25R for a user to hold with a right hand.
  • Each of the vibration mechanisms 24R is built in the grip portion 25R.
  • the vibration device 23 operates the vibration mechanism 24 based on the control signal received from the information processing apparatus 10, thereby presenting vibration to the left and right hands of the user.
  • the vibration mechanism 24 may be various types of vibration generating elements such as a linear resonance actuator, a voice coil motor, and an eccentric motor. Further, the vibration device 23 may include various operation members such as operation buttons and levers to be operated by the user.
  • the information processing apparatus 10 is functionally configured to include a voice / vibration instruction unit 31, a voice reproduction unit 32, a vibration control unit 33, and a setting reception unit 34. These functions are realized by the control unit 11 executing a program stored in the storage unit 12. This program may be provided to the information processing apparatus 10 via a communication network such as the Internet, or may be provided by being stored in a computer-readable non-transitory information storage medium such as an optical disk.
  • the voice / vibration instruction unit 31 may be realized, for example, when the control unit 11 executes an application program such as a game. Further, the present invention may be realized by a system program that performs various notifications to the user. The voice / vibration instruction unit 31 executes various processes according to user operation inputs and the like, and displays the processing results on the screen of the display device 21.
  • the voice / vibration instruction unit 31 outputs a voice reproduction instruction for causing the voice reproduction device 22 to reproduce the voice according to the processing content.
  • This audio reproduction instruction includes data for specifying the content of the reproduced audio (for example, data obtained by encoding an audio waveform of music, etc., data indicating the type of sound effect prepared in advance).
  • the voice / vibration instruction unit 31 may output a vibration instruction for causing the vibration device 23 to generate vibration according to the processing content.
  • This vibration instruction includes contents for designating what kind of waveform vibration is generated.
  • the vibration instruction may be an instruction for generating vibrations having different contents for each of the two vibration mechanisms 24 included in the vibration device 23.
  • the voice reproduction unit 32 receives a voice reproduction instruction output from the voice / vibration instruction unit 31. Then, an audio signal for reproducing the audio corresponding to the content of the received audio reproduction instruction from the audio reproduction device 22 is generated and output to the audio reproduction device 22. Furthermore, in the present embodiment, the sound reproducing unit 32 may output a vibration instruction for causing the vibration device 23 to generate vibrations according to the content of the sound reproduction instruction. A specific example of the process in which the sound reproduction unit 32 outputs a vibration instruction will be described later.
  • the vibration control unit 33 outputs a control signal for operating each vibration mechanism 24 built in the vibration device 23 according to the contents of the vibration instruction output from the sound / vibration instruction unit 31 and the sound reproduction unit 32. Output to 23.
  • the vibration control unit 33 may output a sound reproduction instruction for causing the sound reproduction device 22 to reproduce sound according to the content of the vibration instruction. A specific example of the process in which the vibration control unit 33 outputs an audio reproduction instruction will be described later.
  • the setting receiving unit 34 receives setting information for designating operation contents of the sound reproducing unit 32 and the vibration control unit 33 from the user.
  • the setting reception unit 34 stores the specified setting information in the storage unit 12 and holds it.
  • the sound reproduction unit 32 and the vibration control unit 33 refer to the setting information held in the storage unit 12 and determine the operation content of itself.
  • the user can input a setting for generating vibration corresponding to sound.
  • the setting accepting unit 34 accepts such a setting, the audio reproducing unit 32 sends a vibration instruction for generating vibration corresponding to the audio reproducing instruction received from the audio / vibration instructing unit 31 to the vibration control unit 33.
  • the vibration corresponding to the voice reproduction instruction is referred to as notification vibration.
  • the vibration control unit 33 When the vibration control unit 33 generates the notification vibration, the information processing apparatus 10 can present vibration corresponding to the sound to the user instead of the sound reproduced from the sound reproducing device 22.
  • the audio reproduction unit 32 when the notification vibration is generated, the audio reproduction unit 32 does not perform audio reproduction control according to the audio reproduction instruction. As a result, when a sound reproduction instruction is accepted, only the notification vibration is generated without reproducing the sound. However, the sound reproducing unit 32 may output a vibration instruction for generating a notification vibration at the same time as performing sound reproduction control according to the sound reproduction instruction. In this case, when the voice / vibration instruction unit 31 outputs a voice reproduction instruction, in addition to the reproduction of the voice according to the instruction content, a notification vibration is also generated at the same time.
  • the sound reproducing unit 32 determines whether to generate the notification vibration according to the type of sound instructed by the sound reproduction instruction, instead of generating the notification vibration for all the sound reproduction instructions. .
  • tag information indicating the type of the sound is added to the sound reproduction instruction.
  • the sound reproduction unit 32 refers to the tag information added to the sound reproduction instruction and reproduces the instructed sound as it is from the sound reproduction device 22 or generates vibration to generate notification vibration. Determine whether to output instructions.
  • the tag information indicates whether the sound instructed by the sound reproduction instruction is a music such as BGM, a sound effect generated according to the content of the game, or a notification sound that notifies the occurrence of some event. It may be a thing.
  • the setting reception unit 34 receives in advance setting information for designating which type of sound is targeted for notification vibration, and holds the setting information. In response to this setting information, for example, when the tag information indicates that the tag information is a piece of music, the sound reproducing unit 32 does not generate a notification vibration, and in response to the sound reproduction instruction of the sound effect or the notification sound, A notification vibration corresponding to the instruction is generated. In this way, it is possible to exclude the sound of music or the like that continues to ring continuously from the target of notification vibration, and set only the sound that is reproduced in a short time as the target of notification vibration.
  • the voice reproduction unit 32 may determine the content of the notification vibration (vibration waveform amplitude, waveform shape, etc.) based on the voice waveform included in the voice reproduction instruction. Specifically, the voice reproduction unit 32 generates vibration waveform data by using the voice waveform data indicating the contents of the voice as it is or by performing given conversion on the voice waveform data. In this case, given conversion of the audio waveform data is a process that shifts or compresses the frequency so that the waveform has a frequency that is easy to detect as vibration, and a band-pass filter that cuts a frequency that is difficult to detect as vibration. Etc. may be included. Thus, by determining the vibration waveform of the notification vibration based on the voice waveform data, it is possible to present to the user vibration similar to the voice that would have been played in response to the voice playback instruction.
  • the voice reproducing unit 32 may generate a vibration instruction for notification vibration using a vibration waveform prepared in advance according to the type of voice.
  • tag information indicating what the notification sound indicates (notification sound type) is added to the sound reproduction instruction of the notification sound.
  • Examples of the type of notification sound include the arrival of an email, the login of a friend, the achievement of a predetermined target by the progress of a game, and the like.
  • a vibration pattern may be determined in advance for each type of notification sound. In this way, the user can grasp what event has occurred according to the vibration pattern.
  • the voice / vibration instruction unit 31 when the voice / vibration instruction unit 31 generates a notification sound, the notification content may be displayed on the screen of the display device 21 at the same time.
  • the voice reproduction unit 32 When the voice reproduction unit 32 generates a notification vibration in response to the voice reproduction instruction instead of the voice reproduction, the voice / vibration instruction unit 31 may suppress the screen display of such notification contents.
  • vibration control for generating a notification vibration for the vibration device 23 possessed by the specific user may be performed. In this way, only the user related to the event can be notified of the occurrence of the event.
  • the vibration control unit 33 When the vibration control unit 33 receives the vibration instruction of the notification vibration from the sound reproduction unit 32, the vibration control unit 33 transmits the vibration corresponding to the vibration instruction to the vibration device in the same manner as when the vibration instruction of the direct vibration is received from the sound / vibration instruction unit 31. A control signal to be generated by the control device 23 is generated and output to the vibration device 23.
  • the vibration control unit 33 when a vibration instruction for notification vibration is received from the voice reproduction unit 32, a vibration instruction from the voice / vibration instruction unit 31 may be received at the same time.
  • the vibration control unit 33 generates a control signal for the vibration device 23 by synthesizing both vibration contents. Specifically, the vibration control unit 33 combines the vibration waveforms of both at a given ratio and determines the vibration waveform to be generated.
  • the composition ratio may be 1: 1, or may be determined according to the user's designation. Further, in order to make it easier for the user to notice the notification vibration, processing such as ducking may be performed when the notification vibration is presented.
  • FIG. 3 is a flowchart showing an example of processing executed by the information processing apparatus 10 when the voice playback unit 32 receives a voice playback instruction.
  • the voice reproduction unit 32 When receiving the voice reproduction instruction output from the voice / vibration instruction unit 31 (S1), the voice reproduction unit 32 first acquires tag information added to the received voice reproduction instruction (S2).
  • the audio reproduction unit 32 refers to the acquired tag information and determines whether or not the audio reproduction instruction is a target for generating notification vibration (S3). If it is determined not to be the target of the notification vibration, the audio reproduction unit 32 executes audio reproduction control for reproducing audio from the audio reproduction device 22 in accordance with the audio reproduction instruction received in S1 (S4), and ends the process. .
  • the sound reproducing unit 32 determines whether it is a target of the notification vibration. If it is determined in S3 that it is a target of the notification vibration, the sound reproducing unit 32 generates vibration waveform data of the notification vibration based on the sound waveform data included in the sound reproduction instruction received in S1 (S5). . And the vibration instruction
  • the vibration control unit 33 that has received the vibration instruction in S6 synthesizes the vibration instruction output in S6 and the vibration instruction that has been separately received if there is a vibration instruction that has been separately received from the voice / vibration instruction unit 31. Then, vibration waveform data of vibration to be actually generated in the vibration mechanism 24 is generated (S7). Then, vibration control for causing the vibration device 23 to generate vibration according to the generated waveform data is executed (S8). Thereby, the vibration device 23 can generate both the notification vibration corresponding to the voice and the vibration based on the direct vibration instruction from the voice / vibration instruction unit 31 at the same time.
  • the vibration control unit 33 receives a vibration instruction
  • the content of the vibration instruction is converted according to the setting information received by the setting reception unit 34, and the vibration of the converted content is generated.
  • the vibration device 23 includes the two vibration mechanisms 24, each of which independently generates vibration.
  • the vibration instruction also includes information specifying the content of vibration to be generated by each of the left and right vibration mechanisms 24.
  • vibration can be transmitted only to one of the user's hands.
  • a user who has difficulty in grasping the vibration device 23 with one of the left and right hands or hardly feels vibration may use the information processing apparatus 10.
  • the vibration control unit 33 may synthesize the left and right vibration contents according to setting information designated in advance, and output control signals for causing the two vibration mechanisms 24 to generate the same vibrations. .
  • the vibration control unit 33 includes the content of the vibration to be generated by the vibration mechanism 24L (hereinafter referred to as left vibration) and the content of the vibration to be generated by the vibration mechanism 24R (hereinafter referred to as right vibration). Accept vibration instructions. Then, a combined vibration obtained by combining the left vibration and the right vibration according to the setting information is generated, and a control signal for generating the combined vibration in both the vibration mechanisms 24L and 24R is output to the vibration device 23. As a result, the user can sense both left and right vibration contents with only one hand.
  • the combined vibration in this example may be a combination of left vibration and right vibration 1: 1.
  • 4 and 5 are diagrams for explaining the vibration waveform of the combined vibration in this case.
  • FIG. 4 shows an example of left vibration and right vibration before synthesis.
  • FIG. 5 shows a vibration waveform of a combined vibration obtained by combining the left vibration and the right vibration shown in FIG.
  • the vibration waveform data of the combined vibration generated by adding each of the left vibration and the right vibration after being halved is output to both the vibration mechanisms 24L and 24R.
  • the vibration control unit 33 may output control signals for generating different vibrations to the vibration mechanisms 24L and 24R.
  • both the vibration mechanisms 24L and 24R can output the control signals generated based on both the left vibration and the right vibration included in the vibration instruction to the vibration mechanisms 24L and 24R, respectively.
  • Left vibration and right vibration can be presented.
  • FIG. 6 is a diagram for explaining the vibration waveform of the combined vibration in this case.
  • the vibration waveform for the vibration mechanism 24L in FIG. 6 represents a combined vibration generated by adding the left vibration shown in FIG.
  • the vibration waveform for the vibration mechanism 24R represents a combined vibration generated by adding the left vibration shown in FIG.
  • the vibration control unit 33 is not limited to such a vibration synthesis process, and may perform various correction processes for the received vibration instruction.
  • the vibration control unit 33 may correct the vibration waveform so as to increase the vibration of a frequency with good sensitivity of a human hand. Or you may correct
  • the vibration control unit 33 may perform correction to change the vibration pattern.
  • the vibration control unit 33 may perform a correction for increasing a waveform having a large amplitude or a correction for extending the duration of vibration in order to sharpen the vibration.
  • an envelope of a vibration waveform may be specified, and a simple waveform such as a sine wave whose amplitude changes according to the envelope may be generated as a corrected vibration waveform.
  • the vibration control unit 33 may output a sound reproduction instruction for reproducing the vibration content corresponding to the received vibration instruction as a notification sound, contrary to the above-described notification vibration example.
  • the audio reproduction unit 32 that has received the audio reproduction instruction causes the audio reproduction device 22 to reproduce the audio corresponding to the accepted audio reproduction instruction, as in the case where the normal audio reproduction instruction is accepted. As a result, it is possible to hear the vibration content as a sound instead of feeling it by hand.
  • correction processing that makes it easy to hear as sound, such as shift pitch processing for shifting to a frequency in the audible range, may be executed on the vibration waveform representing the vibration content.
  • the vibration control unit 33 may display an effect having a content corresponding to the vibration instruction on the screen of the display device 21. Specifically, when a vibration instruction is received, the vibration control unit 33 performs an effect of shaking the image displayed on the screen instead of generating vibration according to the vibration instruction or in addition to generating vibration. Add effects or display effects that change the color of the screen at the timing of vibration. Thereby, the user can visually sense that vibration is presented.
  • the audio reproduction unit 32 and the vibration control unit 33 may execute various controls for the audio reproduction instruction and the vibration instruction as described above in an arbitrary combination according to the setting information.
  • FIG. 7 shows an example of a setting screen for receiving setting information for designating various control contents described so far from the user.
  • the first input item “vibration emphasis output setting” is setting information for selecting the correction contents to be performed for the vibration instruction. “Off”, “Mono”, “Longer output”, “Easy to understand” The value such as can be entered.
  • the vibration control unit 33 does not correct the vibration instruction, and operates the vibration mechanism 24 according to the instructed contents.
  • “monaural” is specified, as described above, control is performed to synthesize left and right vibrations and convert them to monaural vibration (vibration common to both left and right).
  • output longer is designated, correction is performed to increase the duration of the instructed vibration.
  • a correction is made to make it easier for the user to feel the vibration by increasing a predetermined frequency of the vibration waveform or changing the vibration pattern.
  • the second input item “notify vibration with sound or video” is setting information for executing control to reproduce sound or add an effect to the video in response to the vibration instruction. Values such as “sound”, “video”, “sound and video” can be input.
  • the vibration control unit 33 When “sound” is designated for this item, the vibration control unit 33 generates and outputs a sound reproduction instruction for reproducing the notification sound in response to the vibration instruction.
  • “video” When “video” is designated, an effect indicating that there has been a vibration instruction is displayed on the screen of the display device 21.
  • “sound and video” both notification sound reproduction and effect display are executed.
  • the third input item “output sound by vibration” is setting information for generating a notification vibration in response to the voice playback instruction, and is “off”, “all”, “notification only”, “sound effect and Values such as “notification” and “other than music” can be input.
  • the audio reproduction unit 32 compares the value specified as the setting information with the tag information added to the audio reproduction instruction, and determines whether to generate a notification vibration corresponding to each audio reproduction instruction. Specifically, when “off” is designated, notification vibration is not generated for all audio playback instructions, and when “all” is specified, notification vibration is generated for all audio playback instructions. generate.
  • a notification vibration is generated in response to an audio playback instruction with a “notification sound” tag, and when “sound effect and notification” is specified, “notification sound” Alternatively, a notification vibration is generated in response to an audio reproduction instruction to which a tag indicating “sound effect” is added. When “other than music” is designated, a notification vibration is generated in response to an audio reproduction instruction other than the audio reproduction instruction to which a tag indicating “music” is added.
  • the fourth input item “priority when sound is output by vibration” is setting information for designating the control content when the vibration instruction of the notification vibration and the vibration instruction from the voice / vibration instruction unit 31 are combined. , “Default”, “Notification priority”, and other values can be entered.
  • the vibration control unit 33 synthesizes the vibration instruction of the notification vibration received from the sound reproduction unit 32 and the vibration instruction received from the sound / vibration instruction unit 31, the vibration control unit 33 refers to the value of the setting information and sets the composition ratio. decide. Specifically, when notification priority is designated, the proportion of notification vibration is made larger than when default is designated. Instead of this input item, setting information that specifies the value of the composition ratio as a numerical value may be received.
  • the fifth input item “vibration intensity” is setting information for designating the vibration intensity itself generated according to the vibration instruction.
  • the input items and their setting values shown here are only examples, and other various items may be specified independently, or an input item that specifies a plurality of setting values collectively. There may be.
  • the setting reception unit 34 may receive designation of whether to generate notification vibration individually for each of “sound effect”, “notification sound”, and the like. You may receive designation
  • the user can perceive the reproduction of the sound by the vibration by generating the notification vibration corresponding to the sound reproduction instruction. Further, by correcting the vibration instruction, it is possible to present vibration that is easily perceived by a user who does not feel vibration.
  • the vibration device 23 is an operation device that receives a user's operation input.
  • the vibration device 23 is not limited to such a device, and is used only to present a tactile sensation to the user. It may be a device used for other purposes.
  • the audio reproduction device 22 is a separate device from the vibration device 23, but the audio reproduction device 22 may be incorporated in the vibration device 23.
  • Information processing system 10 Information processing device, 11 Control unit, 12 Storage unit, 13 Interface unit, 21 Display device, 22 Audio playback device, 23 Vibration device, 24L, 24R vibration mechanism, 25L, 25R gripping unit, 31 Audio / Vibration instruction unit, 32 voice playback unit, 33 vibration control unit, 34 setting reception unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

An information processing device (10) is configured as follows: when an audio playback instruction that indicates the content of audio to be played back is received from an audio playback device (22), the information processing device causes a vibration device (23) to generate notification vibrations corresponding to the audio, such vibrations generated instead of generating the audio, or in addition to generating the audio. For each type of audio, the information processing device (10) receives beforehand, from a user, setting information that indicates whether to generate the notification vibrations, and in accordance with the setting information, determines whether to generate the notification vibrations.

Description

情報処理装置Information processing device

 本発明は、ユーザーに音声や振動を提示する情報処理装置、情報処理方法、及びプログラムに関する。 The present invention relates to an information processing apparatus, an information processing method, and a program for presenting voice and vibration to a user.

 一般的に、家庭用ゲーム機などの情報処理装置は、音声再生装置と接続され、当該音声再生装置から各種のBGMや効果音などの音声を再生させることで、ユーザーに提示している。また、ユーザーが自身の体に装着したり保持したりして使用する振動デバイスを動作させることによって、振動をユーザーに提示することもある。 Generally, an information processing apparatus such as a home game machine is connected to an audio reproduction apparatus, and is presented to the user by reproducing audio such as various BGMs and sound effects from the audio reproduction apparatus. In addition, vibration may be presented to the user by operating a vibrating device that is used by being worn on or held by the user's body.

 これらの音声や振動は、人によって感知しにくい場合がある。本発明はこのような事情を考慮してなされたものであって、その目的の一つは、音声を感知しにくい人にとって使いやすい情報処理装置、情報処理方法、及びプログラムを提供することにある。 These sounds and vibrations may be difficult to detect by humans. The present invention has been made in view of such circumstances, and one of its purposes is to provide an information processing apparatus, an information processing method, and a program that are easy to use for those who are difficult to detect voice. .

 本発明に係る情報処理装置は、音声再生装置、及び振動デバイスと接続される情報処理装置であって、前記音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付ける音声受付部と、前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を前記振動デバイスに発生させる振動制御部と、前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付ける設定受付部と、を含み、前記音声受付部は、前記設定情報に応じて、前記通知振動を発生させるか否か決定することを特徴とする情報処理装置である。 An information processing apparatus according to the present invention is an information processing apparatus connected to a sound reproduction apparatus and a vibration device, and a sound reception unit that receives a sound reproduction instruction that specifies the content of sound to be reproduced from the sound reproduction apparatus; A vibration control unit that causes the vibration device to generate a notification vibration corresponding to the sound instead of or in addition to the sound reproduction when the sound reproduction instruction is received; and the sound A setting reception unit that receives in advance setting information for designating whether to generate the notification vibration for each type, and the voice reception unit generates the notification vibration according to the setting information It is an information processing apparatus characterized by determining whether or not to perform.

 本発明に係る情報処理方法は、音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付けるステップと、前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を振動デバイスに発生させる制御信号を出力するステップと、前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付けるステップと、前記設定情報に応じて、前記通知振動を発生させるか否か決定するステップと、を含むことを特徴とする情報処理方法である。 An information processing method according to the present invention includes a step of receiving a sound reproduction instruction that specifies the content of sound to be reproduced from a sound reproduction device, and, when the sound reproduction instruction is received, instead of reproducing the sound, or In addition to the reproduction of the sound, a step of outputting a control signal for causing the vibration device to generate a notification vibration corresponding to the sound, and setting information for designating whether to generate the notification vibration for each type of the sound Is received from a user in advance, and a step of determining whether or not to generate the notification vibration is determined according to the setting information.

 本発明に係るプログラムは、音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付けるステップと、前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を振動デバイスに発生させる制御信号を出力するステップと、前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付けるステップと、前記設定情報に応じて、前記通知振動を発生させるか否か決定するステップと、をコンピュータに実行させるためのプログラムである。このプログラムは、コンピュータ読み取り可能で非一時的な情報記憶媒体に格納されて提供されてよい。 The program according to the present invention includes a step of accepting an audio reproduction instruction that specifies the content of audio to be reproduced from an audio reproduction device, and, when the audio reproduction instruction is accepted, instead of reproducing the audio or the audio In addition to the reproduction of the above, a step of outputting a control signal for causing the vibration device to generate a notification vibration corresponding to the sound, and setting information for designating whether to generate the notification vibration for each type of the sound And a step for determining whether to generate the notification vibration in accordance with the setting information. This program may be provided by being stored in a computer-readable non-transitory information storage medium.

本発明の実施の形態に係る情報処理装置を含む情報処理システムの構成例を表すブロック図である。It is a block diagram showing the example of a structure of the information processing system containing the information processing apparatus which concerns on embodiment of this invention. 本発明の実施の形態に係る情報処理装置の機能を表す機能ブロック図である。It is a functional block diagram showing the function of the information processing apparatus which concerns on embodiment of this invention. 本発明の実施の形態に係る情報処理装置が実行する処理の流れの一例を示す図である。It is a figure which shows an example of the flow of the process which the information processing apparatus which concerns on embodiment of this invention performs. 合成前の左振動と右振動の一例を示す図である。It is a figure which shows an example of the left vibration and right vibration before a synthesis | combination. 図4に示す振動を合成した合成振動の振動波形の一例を示す図である。It is a figure which shows an example of the vibration waveform of the synthetic | combination vibration which synthesize | combined the vibration shown in FIG. 図4に示す振動を合成した合成振動の振動波形の別の例を示す図である。It is a figure which shows another example of the vibration waveform of the synthetic | combination vibration which synthesize | combined the vibration shown in FIG. 本発明の実施の形態に係る情報処理装置が表示する設定画面の一例を示す図である。It is a figure which shows an example of the setting screen which the information processing apparatus which concerns on embodiment of this invention displays.

 以下、本発明の実施の形態について図面を参照しながら説明する。 Hereinafter, embodiments of the present invention will be described with reference to the drawings.

 本発明の一実施形態に係る情報処理システム1は、情報処理装置10と、表示装置21と、音声再生装置22と、振動デバイス23とを含んで構成されている。 The information processing system 1 according to an embodiment of the present invention includes an information processing device 10, a display device 21, a sound reproduction device 22, and a vibration device 23.

 情報処理装置10は、家庭用ゲーム機や携帯型ゲーム機、パーソナルコンピュータ等であって、図1に示すように、制御部11と、記憶部12と、インタフェース部13と、を含んで構成されている。 The information processing apparatus 10 is a home game machine, a portable game machine, a personal computer, or the like, and includes a control unit 11, a storage unit 12, and an interface unit 13, as shown in FIG. ing.

 制御部11は、CPU等のプログラム制御デバイスを含み、記憶部12に格納されたプログラムに従って各種の情報処理を実行する。この制御部11が実行する処理の具体例については、後に詳しく述べる。 The control unit 11 includes a program control device such as a CPU, and executes various types of information processing according to programs stored in the storage unit 12. A specific example of processing executed by the control unit 11 will be described in detail later.

 記憶部12は、メモリデバイス等であり、制御部11によって実行されるプログラムを保持する。このプログラムは、コンピュータ可読かつ、非一時的な記憶媒体に格納されて提供され、この記憶部12に複写されたものであってもよい。またこの記憶部12は、制御部11のワークメモリとしても動作する。 The storage unit 12 is a memory device or the like and holds a program executed by the control unit 11. This program may be provided by being stored in a computer-readable non-transitory storage medium and copied to the storage unit 12. The storage unit 12 also operates as a work memory for the control unit 11.

 インタフェース部13は、表示装置21、音声再生装置22、及び振動デバイス23との間でデータを送受信するためのインタフェースである。インタフェース部13は、USB(Universal Serial Bus)等の有線通信用のインタフェースや、ブルートゥース(登録商標)等の無線通信インタフェースを含んでよい。 The interface unit 13 is an interface for transmitting and receiving data to and from the display device 21, the sound reproduction device 22, and the vibration device 23. The interface unit 13 may include a wired communication interface such as USB (Universal Serial Bus) or a wireless communication interface such as Bluetooth (registered trademark).

 表示装置21は、液晶ディスプレイや有機ELディスプレイ等であって、インタフェース部13経由で情報処理装置10から受信した映像信号に基づく映像を、画面内に表示する。なお、表示装置21はユーザーが頭部に装着して使用する頭部装着型の表示装置であってもよい。音声再生装置22は、スピーカーやヘッドホン等であって、情報処理装置10から受信した音声信号に基づく音声を鳴動させる。 The display device 21 is a liquid crystal display, an organic EL display, or the like, and displays an image based on the video signal received from the information processing device 10 via the interface unit 13 on the screen. The display device 21 may be a head-mounted display device that is used by the user wearing the head. The audio reproduction device 22 is a speaker, headphones, or the like, and sounds a sound based on the audio signal received from the information processing device 10.

 振動デバイス23は、ユーザーが手で保持したり、ユーザーの身体に装着したりして使用するデバイスである。本実施形態において振動デバイス23は、2個の振動機構24を内蔵するものとする。具体的に、振動デバイス23の筐体は、ユーザーが左手で把持するための把持部25L、及び右手で把持するための把持部25Rを有しており、把持部25L内に振動機構24Lが、把持部25R内に振動機構24Rが、それぞれ内蔵されている。振動デバイス23は、情報処理装置10から受信した制御信号に基づいてこれらの振動機構24を動作させることにより、ユーザーの左右それぞれの手に振動を提示する。振動機構24は、リニア共振アクチュエータやボイスコイルモーター、偏心モーターなど、各種の振動発生素子であってよい。また、振動デバイス23は、ユーザーによる操作の対象となる操作ボタンやレバーなど、各種の操作部材を備えてもよい。 The vibration device 23 is a device that is used by being held by the user's hand or worn on the user's body. In the present embodiment, the vibration device 23 includes two vibration mechanisms 24. Specifically, the housing of the vibration device 23 includes a grip portion 25L for a user to hold with a left hand and a grip portion 25R for a user to hold with a right hand. Each of the vibration mechanisms 24R is built in the grip portion 25R. The vibration device 23 operates the vibration mechanism 24 based on the control signal received from the information processing apparatus 10, thereby presenting vibration to the left and right hands of the user. The vibration mechanism 24 may be various types of vibration generating elements such as a linear resonance actuator, a voice coil motor, and an eccentric motor. Further, the vibration device 23 may include various operation members such as operation buttons and levers to be operated by the user.

 以下、情報処理装置10が実現する機能について、図2を用いて説明する。情報処理装置10は、機能的に、音声・振動指示部31と、音声再生部32と、振動制御部33と、設定受付部34と、を含んで構成されている。これらの機能は、制御部11が記憶部12に格納されているプログラムを実行することにより、実現される。このプログラムは、インターネット等の通信ネットワークを介して情報処理装置10に提供されてもよいし、光ディスク等のコンピュータ読み取り可能で非一時的な情報記憶媒体に格納されて提供されてもよい。 Hereinafter, functions realized by the information processing apparatus 10 will be described with reference to FIG. The information processing apparatus 10 is functionally configured to include a voice / vibration instruction unit 31, a voice reproduction unit 32, a vibration control unit 33, and a setting reception unit 34. These functions are realized by the control unit 11 executing a program stored in the storage unit 12. This program may be provided to the information processing apparatus 10 via a communication network such as the Internet, or may be provided by being stored in a computer-readable non-transitory information storage medium such as an optical disk.

 音声・振動指示部31は、例えば制御部11がゲーム等のアプリケーションプログラムを実行することにより実現されてよい。また、ユーザーに対して各種の通知を行うシステムプログラムによって実現されてもよい。音声・振動指示部31は、ユーザーの操作入力等に応じて各種の処理を実行し、その処理結果を表示装置21の画面に表示させる。 The voice / vibration instruction unit 31 may be realized, for example, when the control unit 11 executes an application program such as a game. Further, the present invention may be realized by a system program that performs various notifications to the user. The voice / vibration instruction unit 31 executes various processes according to user operation inputs and the like, and displays the processing results on the screen of the display device 21.

 さらに音声・振動指示部31は、その処理内容に応じて、音声再生装置22に音声を再生させるための音声再生指示を出力する。この音声再生指示には、再生される音声の内容を特定するデータ(例えば楽曲等の音声波形を符号化したデータや、予め用意された効果音の種別を示すデータなど)が含まれる。 Further, the voice / vibration instruction unit 31 outputs a voice reproduction instruction for causing the voice reproduction device 22 to reproduce the voice according to the processing content. This audio reproduction instruction includes data for specifying the content of the reproduced audio (for example, data obtained by encoding an audio waveform of music, etc., data indicating the type of sound effect prepared in advance).

 また、音声・振動指示部31は、処理内容に応じて、振動デバイス23に振動を発生させるための振動指示を出力してもよい。この振動指示には、どのような波形の振動を発生させるかを指定する内容が含まれる。また、振動指示は、振動デバイス23に含まれる2個の振動機構24のそれぞれに対して異なる内容の振動を発生させるための指示であってよい。 Further, the voice / vibration instruction unit 31 may output a vibration instruction for causing the vibration device 23 to generate vibration according to the processing content. This vibration instruction includes contents for designating what kind of waveform vibration is generated. The vibration instruction may be an instruction for generating vibrations having different contents for each of the two vibration mechanisms 24 included in the vibration device 23.

 音声再生部32は、音声・振動指示部31が出力する音声再生指示を受け付ける。そして、受け付けた音声再生指示の内容に応じた音声を音声再生装置22から再生させるための音声信号を生成し、音声再生装置22に対して出力する。さらに、本実施形態において音声再生部32は、音声再生指示の内容に応じて、振動デバイス23に振動を発生させるための振動指示を出力する場合がある。音声再生部32が振動指示を出力する処理の具体例については、後述する。 The voice reproduction unit 32 receives a voice reproduction instruction output from the voice / vibration instruction unit 31. Then, an audio signal for reproducing the audio corresponding to the content of the received audio reproduction instruction from the audio reproduction device 22 is generated and output to the audio reproduction device 22. Furthermore, in the present embodiment, the sound reproducing unit 32 may output a vibration instruction for causing the vibration device 23 to generate vibrations according to the content of the sound reproduction instruction. A specific example of the process in which the sound reproduction unit 32 outputs a vibration instruction will be described later.

 振動制御部33は、音声・振動指示部31、及び音声再生部32が出力する振動指示の内容に応じて、振動デバイス23に内蔵された各振動機構24を動作させるための制御信号を振動デバイス23に対して出力する。なお、振動制御部33は、振動指示の内容に応じて、音声再生装置22に音声を再生させるための音声再生指示を出力する場合がある。振動制御部33が音声再生指示を出力する処理の具体例については、後述する。 The vibration control unit 33 outputs a control signal for operating each vibration mechanism 24 built in the vibration device 23 according to the contents of the vibration instruction output from the sound / vibration instruction unit 31 and the sound reproduction unit 32. Output to 23. The vibration control unit 33 may output a sound reproduction instruction for causing the sound reproduction device 22 to reproduce sound according to the content of the vibration instruction. A specific example of the process in which the vibration control unit 33 outputs an audio reproduction instruction will be described later.

 設定受付部34は、音声再生部32、及び振動制御部33の動作内容を指定するための設定情報を、ユーザーから受け付ける。設定受付部34は、指定された設定情報を記憶部12内に格納して保持する。音声再生部32、及び振動制御部33は、記憶部12に保持されている設定情報を参照して、自身の動作内容を決定する。 The setting receiving unit 34 receives setting information for designating operation contents of the sound reproducing unit 32 and the vibration control unit 33 from the user. The setting reception unit 34 stores the specified setting information in the storage unit 12 and holds it. The sound reproduction unit 32 and the vibration control unit 33 refer to the setting information held in the storage unit 12 and determine the operation content of itself.

 以下では、設定受付部34が受け付けた設定情報に応じて音声再生部32及び振動制御部33が実現する制御内容の具体例について、説明する。 Hereinafter, a specific example of the control content realized by the sound reproduction unit 32 and the vibration control unit 33 according to the setting information received by the setting receiving unit 34 will be described.

 まず、音声再生部32が音声再生指示を受け付けた場合に、当該音声再生指示の内容に対応した振動を発生させる制御について、説明する。 First, the control for generating the vibration corresponding to the content of the voice reproduction instruction when the voice reproduction unit 32 receives the voice reproduction instruction will be described.

 音を聞き取りにくいユーザーが情報処理装置10を使用する場合や、夜間など音を発生させたくない場合などにおいて、ユーザーは、音声に対応した振動を発生させる設定を入力することができる。このような設定を設定受付部34が受け付けた場合、音声再生部32は、音声・振動指示部31から受け付けた音声再生指示に対応した振動を発生させる振動指示を、振動制御部33に対して出力する。以下では、この音声再生指示に対応した振動を、通知振動という。振動制御部33が通知振動を発生させることで、情報処理装置10は、音声再生装置22から再生される音声の代わりに、音声に対応する振動をユーザーに提示することができる。 When a user who is difficult to hear sound uses the information processing apparatus 10 or does not want to generate sound such as at night, the user can input a setting for generating vibration corresponding to sound. When the setting accepting unit 34 accepts such a setting, the audio reproducing unit 32 sends a vibration instruction for generating vibration corresponding to the audio reproducing instruction received from the audio / vibration instructing unit 31 to the vibration control unit 33. Output. Hereinafter, the vibration corresponding to the voice reproduction instruction is referred to as notification vibration. When the vibration control unit 33 generates the notification vibration, the information processing apparatus 10 can present vibration corresponding to the sound to the user instead of the sound reproduced from the sound reproducing device 22.

 なお、ここでは通知振動を発生させる場合、音声再生部32は、音声再生指示に応じた音声の再生制御を行わないこととする。これにより、音声再生指示が受け付けられた場合に、音声は再生させずに、通知振動のみを発生させることになる。ただし、音声再生部32は、音声再生指示に応じた音声の再生制御を行うと同時に、通知振動を発生させる振動指示を出力してもよい。この場合、音声・振動指示部31が音声再生指示を出力すると、その指示内容に応じた音声の再生に加えて、同時期に通知振動も発生することになる。 Note that, here, when the notification vibration is generated, the audio reproduction unit 32 does not perform audio reproduction control according to the audio reproduction instruction. As a result, when a sound reproduction instruction is accepted, only the notification vibration is generated without reproducing the sound. However, the sound reproducing unit 32 may output a vibration instruction for generating a notification vibration at the same time as performing sound reproduction control according to the sound reproduction instruction. In this case, when the voice / vibration instruction unit 31 outputs a voice reproduction instruction, in addition to the reproduction of the voice according to the instruction content, a notification vibration is also generated at the same time.

 音声再生部32は、全ての音声再生指示に対して通知振動を発生させるのではなく、音声再生指示によって指示される音声の種別に応じて、通知振動を発生させるか否か判定することとする。このような判定を行うため、音声再生指示には、その音声の種別を示すタグ情報が付加されるものとする。音声再生部32は、音声再生指示を受け付けると、当該音声再生指示に付加されたタグ情報を参照して、指示された音声をそのまま音声再生装置22から再生させるか、あるいは通知振動を発生させる振動指示を出力するかを判定する。 The sound reproducing unit 32 determines whether to generate the notification vibration according to the type of sound instructed by the sound reproduction instruction, instead of generating the notification vibration for all the sound reproduction instructions. . In order to make such a determination, tag information indicating the type of the sound is added to the sound reproduction instruction. When receiving the sound reproduction instruction, the sound reproduction unit 32 refers to the tag information added to the sound reproduction instruction and reproduces the instructed sound as it is from the sound reproduction device 22 or generates vibration to generate notification vibration. Determine whether to output instructions.

 具体例として、タグ情報は、その音声再生指示が指示する音声が、BGM等の楽曲か、ゲーム等の内容に応じて発生する効果音か、あるいは何らかのイベントの発生を知らせる通知音か、を示すものであってよい。設定受付部34は、予め、どの種別の音声を通知振動の対象とするかを指定する設定情報を受け付けて、その設定情報を保持しておく。この設定情報に応じて、例えば音声再生部32は、タグ情報が楽曲であることを示すものである場合、通知振動は発生させないこととし、効果音又は通知音の音声再生指示に対しては、その指示に対応する通知振動を発生させることとする。こうすれば、継続的に鳴り続ける楽曲等の音声については通知振動の対象から除外し、短時間に再生される音声だけを通知振動の対象とすることができる。 As a specific example, the tag information indicates whether the sound instructed by the sound reproduction instruction is a music such as BGM, a sound effect generated according to the content of the game, or a notification sound that notifies the occurrence of some event. It may be a thing. The setting reception unit 34 receives in advance setting information for designating which type of sound is targeted for notification vibration, and holds the setting information. In response to this setting information, for example, when the tag information indicates that the tag information is a piece of music, the sound reproducing unit 32 does not generate a notification vibration, and in response to the sound reproduction instruction of the sound effect or the notification sound, A notification vibration corresponding to the instruction is generated. In this way, it is possible to exclude the sound of music or the like that continues to ring continuously from the target of notification vibration, and set only the sound that is reproduced in a short time as the target of notification vibration.

 音声再生部32は、通知振動の内容(振動波形の振幅や波形形状など)を、音声再生指示に含まれる音声波形に基づいて決定してもよい。具体的に、音声再生部32は、音声の内容を示す音声波形データをそのまま使用して、あるいは音声波形データに対して所与の変換を行って、振動の波形データを生成する。この場合の音声波形データに対する所与の変換は、振動として感知しやすい周波数の波形になるように周波数をシフトさせたり圧縮したりする処理や、振動として感知しにくい周波数をカットするバンドパスフィルタ処理などを含んでよい。このように、音声波形データに基づいて通知振動の振動波形を決定することで、音声再生指示に応じて再生されたであろう音声に類似した振動を、ユーザーに提示することができる。 The voice reproduction unit 32 may determine the content of the notification vibration (vibration waveform amplitude, waveform shape, etc.) based on the voice waveform included in the voice reproduction instruction. Specifically, the voice reproduction unit 32 generates vibration waveform data by using the voice waveform data indicating the contents of the voice as it is or by performing given conversion on the voice waveform data. In this case, given conversion of the audio waveform data is a process that shifts or compresses the frequency so that the waveform has a frequency that is easy to detect as vibration, and a band-pass filter that cuts a frequency that is difficult to detect as vibration. Etc. may be included. Thus, by determining the vibration waveform of the notification vibration based on the voice waveform data, it is possible to present to the user vibration similar to the voice that would have been played in response to the voice playback instruction.

 あるいは音声再生部32は、音声の種類に応じて予め用意された振動波形を用いて通知振動の振動指示を生成してもよい。一例として、通知音の音声再生指示に対して、その通知音が何を知らせる通知音か(通知音の種類)を示すタグ情報が付加されているものとする。通知音の種類としては、例えば、メールの着信やフレンドのログイン、ゲームの進行によって所定の目標を達成したことなどが挙げられる。このような通知音の種類ごとに、振動のパターンが予め定められていてもよい。こうすれば、ユーザーは、振動のパターンによって何のイベントが発生したかを把握することができる。 Alternatively, the voice reproducing unit 32 may generate a vibration instruction for notification vibration using a vibration waveform prepared in advance according to the type of voice. As an example, it is assumed that tag information indicating what the notification sound indicates (notification sound type) is added to the sound reproduction instruction of the notification sound. Examples of the type of notification sound include the arrival of an email, the login of a friend, the achievement of a predetermined target by the progress of a game, and the like. A vibration pattern may be determined in advance for each type of notification sound. In this way, the user can grasp what event has occurred according to the vibration pattern.

 また、音声・振動指示部31が通知音を発生させる際には、同時に通知内容を表示装置21の画面に表示することがある。音声再生部32が音声再生指示に対して音声再生の代わりに通知振動を発生させる場合、音声・振動指示部31は、このような通知内容の画面表示を抑制してもよい。特に、複数ユーザーがそれぞれ振動デバイス23を所持して同時に情報処理装置10を利用している場合において、特定ユーザーのみに関するイベントの発生を画面表示及び通知音の再生によって通知しようとする際には、これらの画面表示及び通知音の再生に代えて、当該特定ユーザーが所持している振動デバイス23に対して通知振動を発生させる振動制御を行ってもよい。こうすれば、イベントの発生をそのイベントに関係するユーザーだけに通知することができる。 Further, when the voice / vibration instruction unit 31 generates a notification sound, the notification content may be displayed on the screen of the display device 21 at the same time. When the voice reproduction unit 32 generates a notification vibration in response to the voice reproduction instruction instead of the voice reproduction, the voice / vibration instruction unit 31 may suppress the screen display of such notification contents. In particular, when a plurality of users each have the vibration device 23 and use the information processing apparatus 10 at the same time, when trying to notify the occurrence of an event relating to only a specific user by screen display and notification sound reproduction, Instead of reproducing the screen display and the notification sound, vibration control for generating a notification vibration for the vibration device 23 possessed by the specific user may be performed. In this way, only the user related to the event can be notified of the occurrence of the event.

 振動制御部33は、音声再生部32から通知振動の振動指示を受け付けた場合、音声・振動指示部31から直接の振動指示を受け付けた場合と同様に、その振動指示に応じた振動を振動デバイス23に発生させるための制御信号を生成し、振動デバイス23に対して出力する。 When the vibration control unit 33 receives the vibration instruction of the notification vibration from the sound reproduction unit 32, the vibration control unit 33 transmits the vibration corresponding to the vibration instruction to the vibration device in the same manner as when the vibration instruction of the direct vibration is received from the sound / vibration instruction unit 31. A control signal to be generated by the control device 23 is generated and output to the vibration device 23.

 なお、音声再生部32から通知振動の振動指示を受け付けた際に、同時期に音声・振動指示部31からの振動指示も受け付ける場合もあり得る。このような場合、振動制御部33は、両者の振動内容を合成して、振動デバイス23に対する制御信号を生成する。具体的に振動制御部33は、両者の振動波形を所与の割合で合成して、発生させる振動波形を決定する。この場合における合成の割合は、1:1であってもよいし、ユーザーの指定に応じて決定されてもよい。また、ユーザーが通知振動に気づきやすくするため、通知振動を提示する際にはダッキング等の処理を行ってもよい。 Note that when a vibration instruction for notification vibration is received from the voice reproduction unit 32, a vibration instruction from the voice / vibration instruction unit 31 may be received at the same time. In such a case, the vibration control unit 33 generates a control signal for the vibration device 23 by synthesizing both vibration contents. Specifically, the vibration control unit 33 combines the vibration waveforms of both at a given ratio and determines the vibration waveform to be generated. In this case, the composition ratio may be 1: 1, or may be determined according to the user's designation. Further, in order to make it easier for the user to notice the notification vibration, processing such as ducking may be performed when the notification vibration is presented.

 図3は、音声再生部32が音声再生指示を受け付けた際に情報処理装置10が実行する処理の一例を示すフロー図である。音声再生部32は、音声・振動指示部31が出力する音声再生指示を受け付けると(S1)、まず受け付けた音声再生指示に付加されたタグ情報を取得する(S2)。 FIG. 3 is a flowchart showing an example of processing executed by the information processing apparatus 10 when the voice playback unit 32 receives a voice playback instruction. When receiving the voice reproduction instruction output from the voice / vibration instruction unit 31 (S1), the voice reproduction unit 32 first acquires tag information added to the received voice reproduction instruction (S2).

 次に音声再生部32は、取得したタグ情報を参照して、音声再生指示が通知振動を発生させる対象か否かを判定する(S3)。通知振動の対象にならないと判定された場合、音声再生部32は、S1で受け付けた音声再生指示に従って、音声再生装置22から音声を再生させる音声再生制御を実行し(S4)、処理を終了する。 Next, the audio reproduction unit 32 refers to the acquired tag information and determines whether or not the audio reproduction instruction is a target for generating notification vibration (S3). If it is determined not to be the target of the notification vibration, the audio reproduction unit 32 executes audio reproduction control for reproducing audio from the audio reproduction device 22 in accordance with the audio reproduction instruction received in S1 (S4), and ends the process. .

 一方、S3で通知振動の対象になると判定された場合、音声再生部32は、S1で受け付けた音声再生指示に含まれる音声波形データに基づいて、通知振動の振動波形データを生成する(S5)。そして、生成した振動波形データを含む通知振動の振動指示を、振動制御部33に対して出力する(S6)。 On the other hand, if it is determined in S3 that it is a target of the notification vibration, the sound reproducing unit 32 generates vibration waveform data of the notification vibration based on the sound waveform data included in the sound reproduction instruction received in S1 (S5). . And the vibration instruction | indication of the notification vibration containing the produced | generated vibration waveform data is output with respect to the vibration control part 33 (S6).

 S6の振動指示を受け付けた振動制御部33は、もし別途音声・振動指示部31から受け付けられた振動指示があれば、S6で出力された振動指示と、別途受け付けられた振動指示とを合成し、実際に振動機構24に発生させるべき振動の振動波形データを生成する(S7)。そして、生成した波形データに応じた振動を振動デバイス23に発生させる振動制御を実行する(S8)。これにより、振動デバイス23は、音声に対応する通知振動、及び音声・振動指示部31からの直接の振動指示に基づく振動の双方を同時期に発生させることができる。 The vibration control unit 33 that has received the vibration instruction in S6 synthesizes the vibration instruction output in S6 and the vibration instruction that has been separately received if there is a vibration instruction that has been separately received from the voice / vibration instruction unit 31. Then, vibration waveform data of vibration to be actually generated in the vibration mechanism 24 is generated (S7). Then, vibration control for causing the vibration device 23 to generate vibration according to the generated waveform data is executed (S8). Thereby, the vibration device 23 can generate both the notification vibration corresponding to the voice and the vibration based on the direct vibration instruction from the voice / vibration instruction unit 31 at the same time.

 次に、振動制御部33が振動指示を受け付けた場合に、当該振動指示の内容を設定受付部34が受け付けた設定情報に応じて変換し、変換された内容の振動を発生させる場合の例について、説明する。 Next, when the vibration control unit 33 receives a vibration instruction, the content of the vibration instruction is converted according to the setting information received by the setting reception unit 34, and the vibration of the converted content is generated. ,explain.

 前述した通り、本実施形態では振動デバイス23には2個の振動機構24が内蔵されており、そのそれぞれが独立に振動を発生させる。そのため、振動指示にも、左右の振動機構24のそれぞれが発生させるべき振動の内容を指定する情報が含まれる。これにより、ユーザーの片方の手のみに振動を伝達したりすることが可能となる。しかしながら、左右いずれかの手で振動デバイス23を把持しにくかったり、振動を感じにくかったりするユーザーが、情報処理装置10を使用することもあり得る。このような場合、左右の振動機構24が互いに異なる振動を提示しても、ユーザーに伝わりにくくなってしまう。そこで、振動制御部33は、予め指定された設定情報に応じて、左右それぞれの振動内容を合成し、2個の振動機構24に対して互いに同じ振動を発生させる制御信号を出力してもよい。 As described above, in the present embodiment, the vibration device 23 includes the two vibration mechanisms 24, each of which independently generates vibration. For this reason, the vibration instruction also includes information specifying the content of vibration to be generated by each of the left and right vibration mechanisms 24. As a result, vibration can be transmitted only to one of the user's hands. However, a user who has difficulty in grasping the vibration device 23 with one of the left and right hands or hardly feels vibration may use the information processing apparatus 10. In such a case, even if the left and right vibration mechanisms 24 present different vibrations, it is difficult to transmit to the user. Therefore, the vibration control unit 33 may synthesize the left and right vibration contents according to setting information designated in advance, and output control signals for causing the two vibration mechanisms 24 to generate the same vibrations. .

 具体的に、振動制御部33は、振動機構24Lが発生すべき振動(以下、左振動という)の内容と、振動機構24Rが発生すべき振動(以下、右振動という)の内容とを含んだ振動指示を受け付ける。そして、設定情報に従って左振動と右振動とを合成した合成振動を生成し、その合成振動を振動機構24L及び24Rの双方に発生させるための制御信号を、振動デバイス23に対して出力する。これにより、ユーザーは片方の手だけでも左右双方の振動内容を感知することができるようになる。 Specifically, the vibration control unit 33 includes the content of the vibration to be generated by the vibration mechanism 24L (hereinafter referred to as left vibration) and the content of the vibration to be generated by the vibration mechanism 24R (hereinafter referred to as right vibration). Accept vibration instructions. Then, a combined vibration obtained by combining the left vibration and the right vibration according to the setting information is generated, and a control signal for generating the combined vibration in both the vibration mechanisms 24L and 24R is output to the vibration device 23. As a result, the user can sense both left and right vibration contents with only one hand.

 この例における合成振動は、左振動と右振動とを1:1で合成したものであってもよい。図4及び図5は、この場合の合成振動の振動波形を説明するための図である。図4は、合成前の左振動、及び右振動の例を示している。また、図5は、図4で示した左振動と右振動とを合成した合成振動の振動波形を示している。この例では、左振動と右振動のそれぞれを1/2にしてから加算して生成した合成振動の振動波形データを、振動機構24L及び24Rの双方に対して出力する。 The combined vibration in this example may be a combination of left vibration and right vibration 1: 1. 4 and 5 are diagrams for explaining the vibration waveform of the combined vibration in this case. FIG. 4 shows an example of left vibration and right vibration before synthesis. FIG. 5 shows a vibration waveform of a combined vibration obtained by combining the left vibration and the right vibration shown in FIG. In this example, the vibration waveform data of the combined vibration generated by adding each of the left vibration and the right vibration after being halved is output to both the vibration mechanisms 24L and 24R.

 あるいは振動制御部33は、振動機構24L及び24Rのそれぞれに対して、互いに異なる振動を発生させる制御信号を出力してもよい。この場合にも、各振動機構24L及び24Rに対して、振動指示に含まれる左振動、及び右振動の双方に基づいて生成した制御信号を出力することで、振動機構24L及び24Rの双方がそれぞれ左振動、及び右振動を提示することができる。図6は、この場合の合成振動の振動波形を説明するための図である。図6の振動機構24Lに対する振動波形は、図4に示す左振動を0.8倍、右振動を0.2倍してから加算して生成した合成振動を表している。また、振動機構24Rに対する振動波形は、図4に示す左振動を0.2倍、右振動を0.8倍してから加算して生成した合成振動を表している。このような振動波形に基づく合成振動を発生させることで、元の振動指示の内容を大きく変更せず、それぞれの振動機構24が単独で左振動、及び右振動の成分を含む振動を提示することができる。 Alternatively, the vibration control unit 33 may output control signals for generating different vibrations to the vibration mechanisms 24L and 24R. Also in this case, both the vibration mechanisms 24L and 24R can output the control signals generated based on both the left vibration and the right vibration included in the vibration instruction to the vibration mechanisms 24L and 24R, respectively. Left vibration and right vibration can be presented. FIG. 6 is a diagram for explaining the vibration waveform of the combined vibration in this case. The vibration waveform for the vibration mechanism 24L in FIG. 6 represents a combined vibration generated by adding the left vibration shown in FIG. The vibration waveform for the vibration mechanism 24R represents a combined vibration generated by adding the left vibration shown in FIG. By generating a composite vibration based on such a vibration waveform, the contents of the original vibration instruction are not greatly changed, and each vibration mechanism 24 independently presents vibration including left vibration component and right vibration component. Can do.

 また、振動制御部33は、このような振動の合成処理に限らず、受け付けた振動指示に対して各種の補正処理を行ってよい。一例として、振動制御部33は、振動波形に対して、人の手の感度がよい周波数の振動を強める補正を行ってもよい。あるいは、ピッチシフト処理によって、このような周波数の振幅が大きくなるように補正してもよい。 Further, the vibration control unit 33 is not limited to such a vibration synthesis process, and may perform various correction processes for the received vibration instruction. As an example, the vibration control unit 33 may correct the vibration waveform so as to increase the vibration of a frequency with good sensitivity of a human hand. Or you may correct | amend so that the amplitude of such a frequency may become large by a pitch shift process.

 また、振動制御部33は、振動のパターンを変化させる補正を行ってもよい。一例として、振動制御部33は、振動にメリハリをつけるために、振幅の大きな波形をより大きくしたりする補正を行ってもよいし、振動の継続時間を長くする補正を行ってもよい。あるいは、振動波形のエンベロープを特定し、そのエンベロープに従って振幅が変化する正弦波などの単純な波形を、補正後の振動波形として生成してもよい。 Further, the vibration control unit 33 may perform correction to change the vibration pattern. As an example, the vibration control unit 33 may perform a correction for increasing a waveform having a large amplitude or a correction for extending the duration of vibration in order to sharpen the vibration. Alternatively, an envelope of a vibration waveform may be specified, and a simple waveform such as a sine wave whose amplitude changes according to the envelope may be generated as a corrected vibration waveform.

 また、振動制御部33は、前述した通知振動の例と逆に、受け付けた振動指示に応じた振動の内容を、通知音声として再生させる音声再生指示を出力してもよい。この音声再生指示を受け付けた音声再生部32は、通常の音声再生指示が受け付けられた場合と同様に、受け付けた音声再生指示に応じた音声を音声再生装置22から再生させる。これにより、振動の内容を手で感じる代わりに音として聞くことができる。 Also, the vibration control unit 33 may output a sound reproduction instruction for reproducing the vibration content corresponding to the received vibration instruction as a notification sound, contrary to the above-described notification vibration example. The audio reproduction unit 32 that has received the audio reproduction instruction causes the audio reproduction device 22 to reproduce the audio corresponding to the accepted audio reproduction instruction, as in the case where the normal audio reproduction instruction is accepted. As a result, it is possible to hear the vibration content as a sound instead of feeling it by hand.

 このように通知音声を再生する場合、振動の内容を表す振動波形に対して、可聴域の周波数にシフトさせるシフトピッチ処理など、音声として聞き取りやすくする補正処理を実行してもよい。 When the notification sound is reproduced in this way, correction processing that makes it easy to hear as sound, such as shift pitch processing for shifting to a frequency in the audible range, may be executed on the vibration waveform representing the vibration content.

 また、振動制御部33は、表示装置21の画面に、振動指示に応じた内容のエフェクトを表示してもよい。具体的に、振動制御部33は、振動指示が受け付けられた場合に、当該振動指示に応じた振動を発生させる代わりに、又は振動の発生に加えて、画面に表示中の映像が揺れるエフェクトを加えたり、振動の発生タイミングで画面の色調が変化するようなエフェクトを表示したりする。これにより、ユーザーは振動が提示されることを視覚的に感知することができる。 Further, the vibration control unit 33 may display an effect having a content corresponding to the vibration instruction on the screen of the display device 21. Specifically, when a vibration instruction is received, the vibration control unit 33 performs an effect of shaking the image displayed on the screen instead of generating vibration according to the vibration instruction or in addition to generating vibration. Add effects or display effects that change the color of the screen at the timing of vibration. Thereby, the user can visually sense that vibration is presented.

 音声再生部32及び振動制御部33は、これまで説明したような音声再生指示及び振動指示に対する各種の制御を、設定情報に応じて任意に組み合わせて実行してもよい。図7は、これまで説明した各種の制御内容を指定する設定情報をユーザーから受け付けるための設定画面の一例を示している。 The audio reproduction unit 32 and the vibration control unit 33 may execute various controls for the audio reproduction instruction and the vibration instruction as described above in an arbitrary combination according to the setting information. FIG. 7 shows an example of a setting screen for receiving setting information for designating various control contents described so far from the user.

 最初の入力項目「振動の強調出力設定」は、振動指示に対して行う補正内容を選択する設定情報であって、「オフ」、「モノラル」、「長めに出力」、「分かりやすさ優先」などの値を入力可能になっている。振動制御部33は、この項目に対して「オフ」が指定された場合、振動指示に対して補正を行わず、そのまま指示された内容に応じて振動機構24を動作させる。「モノラル」が指定された場合、前述したように、左右の振動を合成してモノラル振動(左右共通の振動)に変換する制御を行う。「長めに出力」が指定された場合、指示された振動の継続時間を長くする補正を行う。「分かりやすさ優先」が指定された場合、振動波形の所定の周波数を強めたり振動のパターンを変化させたりして、ユーザーが振動を感じやすくする補正を行う。 The first input item “vibration emphasis output setting” is setting information for selecting the correction contents to be performed for the vibration instruction. “Off”, “Mono”, “Longer output”, “Easy to understand” The value such as can be entered. When “OFF” is designated for this item, the vibration control unit 33 does not correct the vibration instruction, and operates the vibration mechanism 24 according to the instructed contents. When “monaural” is specified, as described above, control is performed to synthesize left and right vibrations and convert them to monaural vibration (vibration common to both left and right). When “output longer” is designated, correction is performed to increase the duration of the instructed vibration. When “easy to understand” is designated, a correction is made to make it easier for the user to feel the vibration by increasing a predetermined frequency of the vibration waveform or changing the vibration pattern.

 2番目の入力項目「振動を音や映像で通知」は、振動指示に対して音声を再生したり映像にエフェクトを追加したりする制御を実行させるための設定情報であって、「オフ」、「音」、「映像」、「音と映像」などの値を入力可能になっている。振動制御部33は、この項目に対して「音」が指定された場合、振動指示に対して通知音声を再生させるための音声再生指示を生成し、出力する。「映像」が指定された場合、表示装置21の画面に振動指示があったことを示すエフェクトを表示する。また、「音と映像」が指定された場合、通知音声の再生、及びエフェクト表示の双方を実行する。 The second input item “notify vibration with sound or video” is setting information for executing control to reproduce sound or add an effect to the video in response to the vibration instruction. Values such as “sound”, “video”, “sound and video” can be input. When “sound” is designated for this item, the vibration control unit 33 generates and outputs a sound reproduction instruction for reproducing the notification sound in response to the vibration instruction. When “video” is designated, an effect indicating that there has been a vibration instruction is displayed on the screen of the display device 21. When “sound and video” is designated, both notification sound reproduction and effect display are executed.

 3番目の入力項目「音を振動で出力」は、音声再生指示に対して通知振動を発生させるための設定情報であって、「オフ」、「全部」、「通知のみ」、「効果音と通知」、「楽曲以外」などの値を入力可能になっている。音声再生部32は、この設定情報として指定された値と、音声再生指示に付加されたタグ情報とを照合して、各音声再生指示に対応する通知振動を発生させるか否か決定する。具体的に、「オフ」が指定された場合には全ての音声再生指示に対して通知振動を発生させず、「全部」が指定された場合には全ての音声再生指示に対して通知振動を発生させる。「通知のみ」が指定された場合には「通知音」のタグが付加された音声再生指示に対して通知振動を発生させ、「効果音と通知」が指定された場合には「通知音」又は「効果音」であることを示すタグが付加された音声再生指示に対して通知振動を発生させる。「楽曲以外」が指定された場合には「楽曲」であることを示すタグが付加された音声再生指示以外の音声再生指示に対して、通知振動を発生させる。 The third input item “output sound by vibration” is setting information for generating a notification vibration in response to the voice playback instruction, and is “off”, “all”, “notification only”, “sound effect and Values such as “notification” and “other than music” can be input. The audio reproduction unit 32 compares the value specified as the setting information with the tag information added to the audio reproduction instruction, and determines whether to generate a notification vibration corresponding to each audio reproduction instruction. Specifically, when “off” is designated, notification vibration is not generated for all audio playback instructions, and when “all” is specified, notification vibration is generated for all audio playback instructions. generate. When “notification only” is specified, a notification vibration is generated in response to an audio playback instruction with a “notification sound” tag, and when “sound effect and notification” is specified, “notification sound” Alternatively, a notification vibration is generated in response to an audio reproduction instruction to which a tag indicating “sound effect” is added. When “other than music” is designated, a notification vibration is generated in response to an audio reproduction instruction other than the audio reproduction instruction to which a tag indicating “music” is added.

 4番目の入力項目「音を振動で出力するときの優先度」は、通知振動の振動指示と音声・振動指示部31からの振動指示を合成する際の制御内容を指定する設定情報であって、「デフォルト」、「通知優先」などの値を入力可能になっている。振動制御部33は、音声再生部32から受け付けた通知振動の振動指示と、音声・振動指示部31から受け付けた振動指示とを合成する際に、この設定情報の値を参照して合成比率を決定する。具体的に、通知優先が指定された場合には、デフォルトが指定された場合よりも通知振動の割合を大きくする。なお、この入力項目に代えて、合成比率の値を数値として指定する設定情報を受け付けてもよい。 The fourth input item “priority when sound is output by vibration” is setting information for designating the control content when the vibration instruction of the notification vibration and the vibration instruction from the voice / vibration instruction unit 31 are combined. , “Default”, “Notification priority”, and other values can be entered. When the vibration control unit 33 synthesizes the vibration instruction of the notification vibration received from the sound reproduction unit 32 and the vibration instruction received from the sound / vibration instruction unit 31, the vibration control unit 33 refers to the value of the setting information and sets the composition ratio. decide. Specifically, when notification priority is designated, the proportion of notification vibration is made larger than when default is designated. Instead of this input item, setting information that specifies the value of the composition ratio as a numerical value may be received.

 5番目の入力項目「振動の強さ」は、振動指示に応じて発生させる振動の強さそのものを指定する設定情報である。なお、ここで示した入力項目及びその設定値は、いずれも例示に過ぎず、これ以外にも各種の項目をそれぞれ独立に指定できることとしてもよいし、複数の設定値をまとめて指定する入力項目があってもよい。例えば設定受付部34は、3番目の入力項目の代わりに、「効果音」「通知音」などのそれぞれに対して、個別に通知振動を発生させるか否かの指定を受け付けてもよいし、効果音や通知音の種類(例えば通知するイベントの内容)ごとに通知振動を発生させるか否かの指定を受け付けてもよい。 The fifth input item “vibration intensity” is setting information for designating the vibration intensity itself generated according to the vibration instruction. The input items and their setting values shown here are only examples, and other various items may be specified independently, or an input item that specifies a plurality of setting values collectively. There may be. For example, instead of the third input item, the setting reception unit 34 may receive designation of whether to generate notification vibration individually for each of “sound effect”, “notification sound”, and the like. You may receive designation | designated of whether a notification vibration is generated for every kind of sound effect or a notification sound (for example, the content of the event to notify).

 以上説明した本実施形態に係る情報処理システム1によれば、音声再生指示に対して対応する通知振動を発生させることで、ユーザーは音声の再生を振動によって知覚することができる。また、振動指示に対して補正を行うことで、振動を感じにくいユーザーにも知覚しやすい振動を提示することができる。 According to the information processing system 1 according to the present embodiment described above, the user can perceive the reproduction of the sound by the vibration by generating the notification vibration corresponding to the sound reproduction instruction. Further, by correcting the vibration instruction, it is possible to present vibration that is easily perceived by a user who does not feel vibration.

 なお、本発明の実施の形態は、以上説明したものに限られない。例えば以上の説明では、振動デバイス23はユーザーの操作入力を受け付ける操作デバイスであることとしたが、振動デバイス23はこのようなものに限られず、もっぱらユーザーに触感を提示するためにのみ用いられるものであってもよいし、その他の用途で使用されるデバイスであってもよい。 Note that the embodiments of the present invention are not limited to those described above. For example, in the above description, the vibration device 23 is an operation device that receives a user's operation input. However, the vibration device 23 is not limited to such a device, and is used only to present a tactile sensation to the user. It may be a device used for other purposes.

 また、以上の説明では音声再生装置22は振動デバイス23とは別体の装置であることとしたが、音声再生装置22は振動デバイス23内に内蔵されてもよい。 In the above description, the audio reproduction device 22 is a separate device from the vibration device 23, but the audio reproduction device 22 may be incorporated in the vibration device 23.

 1 情報処理システム、10 情報処理装置、11 制御部、12 記憶部、13 インタフェース部、21 表示装置、22 音声再生装置、23 振動デバイス、24L,24R 振動機構、25L,25R 把持部、31 音声・振動指示部、32 音声再生部、33 振動制御部、34 設定受付部。 1 Information processing system, 10 Information processing device, 11 Control unit, 12 Storage unit, 13 Interface unit, 21 Display device, 22 Audio playback device, 23 Vibration device, 24L, 24R vibration mechanism, 25L, 25R gripping unit, 31 Audio / Vibration instruction unit, 32 voice playback unit, 33 vibration control unit, 34 setting reception unit.

Claims (8)

 音声再生装置、及び振動デバイスと接続される情報処理装置であって、
 前記音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付ける音声受付部と、
 前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を前記振動デバイスに発生させる振動制御部と、
 前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付ける設定受付部と、
 を含み、
 前記音声受付部は、前記設定情報に応じて、前記通知振動を発生させるか否か決定する
 ことを特徴とする情報処理装置。
An information processing apparatus connected to an audio reproduction device and a vibration device,
A voice receiving unit that receives a voice playback instruction that specifies the content of the voice to be played back from the voice playback device;
A vibration control unit that causes the vibration device to generate a notification vibration corresponding to the sound instead of the sound reproduction or in addition to the sound reproduction when the sound reproduction instruction is received;
A setting accepting unit that accepts in advance from a user setting information for designating whether to generate the notification vibration for each type of sound;
Including
The information processing apparatus according to claim 1, wherein the voice reception unit determines whether to generate the notification vibration according to the setting information.
 請求項1に記載の情報処理装置において、
 前記音声受付部は、前記音声再生指示とともに、当該音声再生指示が指定する音声の種別を示すタグ情報を受け付け、当該タグ情報と、前記設定情報とに応じて、前記通知振動を発生させるか否か決定する
 ことを特徴とする情報処理装置。
The information processing apparatus according to claim 1,
The voice receiving unit receives tag information indicating a type of voice specified by the voice playback instruction together with the voice playback instruction, and generates the notification vibration according to the tag information and the setting information. An information processing apparatus characterized by determining whether or not.
 請求項1又は2に記載の情報処理装置において、
 前記振動制御部は、前記通知振動の振動指示、及び、前記通知振動とは別の振動を前記振動デバイスに発生させる振動指示を同時期に受け付けた場合、前記通知振動と前記別の振動とを合成した合成振動を前記振動デバイスに発生させる
 ことを特徴とする情報処理装置。
The information processing apparatus according to claim 1 or 2,
When the vibration control unit receives a vibration instruction for the notification vibration and a vibration instruction for causing the vibration device to generate a vibration different from the notification vibration, the notification vibration and the separate vibration are received. An information processing apparatus characterized by causing the vibration device to generate a combined vibration.
 請求項3に記載の情報処理装置において、
 前記設定受付部は、前記合成振動を生成する際の合成比率に関する設定情報を前記ユーザーから受け付け、
 前記振動制御部は、前記合成比率に関する設定情報に応じて前記通知振動と前記別の振動とを合成する
 ことを特徴とする情報処理装置。
The information processing apparatus according to claim 3.
The setting accepting unit accepts setting information related to a composition ratio when generating the composite vibration from the user,
The vibration control unit synthesizes the notification vibration and the another vibration in accordance with setting information related to the combination ratio.
 請求項1から4のいずれか一項に記載の情報処理装置において、
 前記振動デバイスは、複数の振動機構を備え、
 前記設定受付部は、前記複数の振動機構に対する振動を合成するか否かを指定する設定情報をユーザーから予め受け付け、
 前記振動制御部は、前記複数の振動機構のそれぞれに対して異なる振動を発生させる振動指示を受け付けた場合に、前記設定情報に応じて、当該振動指示に含まれる複数の振動を合成した合成振動を前記複数の振動機構のそれぞれに発生させる
 ことを特徴とする情報処理装置。
In the information processing apparatus according to any one of claims 1 to 4,
The vibration device includes a plurality of vibration mechanisms,
The setting receiving unit receives in advance setting information for specifying whether to synthesize vibrations for the plurality of vibration mechanisms from a user,
When the vibration control unit receives a vibration instruction for generating different vibrations for each of the plurality of vibration mechanisms, the combined vibration is obtained by combining the plurality of vibrations included in the vibration instruction according to the setting information. Is generated in each of the plurality of vibration mechanisms.
 請求項1から5のいずれか一項に記載の情報処理装置において、
 前記振動制御部は、前記振動デバイスに発生させる振動の内容を指定する振動指示を受け付け、
 前記設定受付部は、前記振動指示で指定される振動に対応する通知音声を前記音声再生装置から再生させるか否かを指定する設定情報をユーザーから予め受け付け、
 前記振動制御部は、前記振動指示が受け付けられた場合に、前記設定情報に応じて、前記通知音声を再生させるか否か決定する
 ことを特徴とする情報処理装置。
In the information processing apparatus according to any one of claims 1 to 5,
The vibration control unit receives a vibration instruction that specifies a content of vibration to be generated in the vibration device,
The setting reception unit receives in advance setting information for designating whether or not to reproduce the notification sound corresponding to the vibration specified by the vibration instruction from the sound reproduction device,
The said vibration control part determines whether the said notification sound is reproduced | regenerated according to the said setting information, when the said vibration instruction | indication is received. The information processing apparatus characterized by the above-mentioned.
 音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付けるステップと、
 前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を振動デバイスに発生させる制御信号を出力するステップと、
 前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付けるステップと、
 前記設定情報に応じて、前記通知振動を発生させるか否か決定するステップと、
 を含むことを特徴とする情報処理方法。
Receiving a voice playback instruction for designating the content of the voice to be played from the voice playback device;
Outputting a control signal for causing the vibration device to generate a notification vibration corresponding to the sound instead of or in addition to the sound reproduction when the sound reproduction instruction is received; and
For each type of audio, receiving in advance from a user setting information that specifies whether to generate the notification vibration;
Determining whether to generate the notification vibration in accordance with the setting information;
An information processing method comprising:
 音声再生装置から再生すべき音声の内容を指定する音声再生指示を受け付けるステップと、
 前記音声再生指示が受け付けられた際に、前記音声の再生に代えて、又は前記音声の再生に加えて、当該音声に対応する通知振動を振動デバイスに発生させる制御信号を出力するステップと、
 前記音声の種別ごとに、前記通知振動を発生させるか否かを指定する設定情報をユーザーから予め受け付けるステップと、
 前記設定情報に応じて、前記通知振動を発生させるか否か決定するステップと、
 をコンピュータに実行させるためのプログラム。
Receiving a voice playback instruction for designating the content of the voice to be played from the voice playback device;
Outputting a control signal for causing the vibration device to generate a notification vibration corresponding to the sound instead of or in addition to the sound reproduction when the sound reproduction instruction is received; and
For each type of audio, receiving in advance from a user setting information that specifies whether to generate the notification vibration;
Determining whether to generate the notification vibration in accordance with the setting information;
A program that causes a computer to execute.
PCT/JP2018/018524 2018-05-14 2018-05-14 Information processing device Ceased WO2019220495A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2018/018524 WO2019220495A1 (en) 2018-05-14 2018-05-14 Information processing device
PCT/JP2019/010669 WO2019220758A1 (en) 2018-05-14 2019-03-14 Information processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2018/018524 WO2019220495A1 (en) 2018-05-14 2018-05-14 Information processing device

Publications (1)

Publication Number Publication Date
WO2019220495A1 true WO2019220495A1 (en) 2019-11-21

Family

ID=68539695

Family Applications (2)

Application Number Title Priority Date Filing Date
PCT/JP2018/018524 Ceased WO2019220495A1 (en) 2018-05-14 2018-05-14 Information processing device
PCT/JP2019/010669 Ceased WO2019220758A1 (en) 2018-05-14 2019-03-14 Information processing device

Family Applications After (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/010669 Ceased WO2019220758A1 (en) 2018-05-14 2019-03-14 Information processing device

Country Status (1)

Country Link
WO (2) WO2019220495A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7571782B2 (en) * 2020-02-25 2024-10-23 ソニーグループ株式会社 Information processing device and information processing method
CN115671712B (en) * 2021-07-27 2023-09-22 腾讯科技(深圳)有限公司 Vibration control method, device, equipment and storage medium
WO2025238778A1 (en) * 2024-05-15 2025-11-20 株式会社ソニー・インタラクティブエンタテインメント Information processing device, method for controlling information processing device, and program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007075419A (en) * 2005-09-15 2007-03-29 Sony Computer Entertainment Inc Information processor and controller device
WO2013051662A1 (en) * 2011-10-04 2013-04-11 株式会社ニコン Electronic device
JP2015007836A (en) * 2013-06-24 2015-01-15 シャープ株式会社 Information processing apparatus and information processing program
JP2015053054A (en) * 2013-09-06 2015-03-19 イマージョン コーポレーションImmersion Corporation Systems and methods for generating haptic effects associated with audio signals
WO2016136934A1 (en) * 2015-02-27 2016-09-01 ソニー株式会社 Information processing device, information processing method, information processing system
JP2017091433A (en) * 2015-11-17 2017-05-25 セイコーエプソン株式会社 Head-mounted display device, method for controlling head-mounted display device, computer program

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002027705A1 (en) * 2000-09-28 2002-04-04 Immersion Corporation Directional tactile feedback for haptic feedback interface devices
JP2006157642A (en) * 2004-11-30 2006-06-15 Matsushita Electric Ind Co Ltd Mobile terminal device
JP2015231098A (en) * 2014-06-04 2015-12-21 ソニー株式会社 Vibration device and vibration method
JP6977312B2 (en) * 2016-10-07 2021-12-08 ソニーグループ株式会社 Information processing equipment, information processing methods and programs

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007075419A (en) * 2005-09-15 2007-03-29 Sony Computer Entertainment Inc Information processor and controller device
WO2013051662A1 (en) * 2011-10-04 2013-04-11 株式会社ニコン Electronic device
JP2015007836A (en) * 2013-06-24 2015-01-15 シャープ株式会社 Information processing apparatus and information processing program
JP2015053054A (en) * 2013-09-06 2015-03-19 イマージョン コーポレーションImmersion Corporation Systems and methods for generating haptic effects associated with audio signals
WO2016136934A1 (en) * 2015-02-27 2016-09-01 ソニー株式会社 Information processing device, information processing method, information processing system
JP2017091433A (en) * 2015-11-17 2017-05-25 セイコーエプソン株式会社 Head-mounted display device, method for controlling head-mounted display device, computer program

Also Published As

Publication number Publication date
WO2019220758A1 (en) 2019-11-21

Similar Documents

Publication Publication Date Title
WO2019138867A1 (en) Information processing device, method, and program
CN113318432B (en) Music control method in game, nonvolatile storage medium and electronic device
WO2019220495A1 (en) Information processing device
WO2019043781A1 (en) Vibration control device, vibration control method, and program
WO2018193557A1 (en) Vibration control device
US20220295184A1 (en) Voice processing system and voice processing method
JPWO2019038888A1 (en) Vibration control device
WO2007032173A1 (en) Information processor and controller device
JP7647571B2 (en) CONTROL DEVICE, SIGNAL PROCESSING METHOD, AND SPEAKER DEVICE
Chelladurai et al. SoundHapticVR: Head-Based Spatial Haptic Feedback for Accessible Sounds in Virtual Reality for Deaf and Hard of Hearing Users
Okazaki et al. The effect of frequency shifting on audio–tactile conversion for enriching musical experience
CN108140370B (en) Signal processing equipment, signal processing methods and computer programs
WO2021024788A1 (en) Generation apparatus, generation method, program, and tactile presentation device
US9277340B2 (en) Sound output system, information processing apparatus, computer-readable non-transitory storage medium having information processing program stored therein, and sound output control method
JP6897565B2 (en) Signal processing equipment, signal processing methods and computer programs
WO2021111965A1 (en) Sound field generation system, sound processing apparatus, and sound processing method
JP6159515B2 (en) GAME SYSTEM, GAME DEVICE, GAME PROGRAM, AND GAME PROCESSING CONTROL METHOD
JP5349535B2 (en) Controller device
JP2007093921A (en) Information distribution device
JP4171012B2 (en) Information processing apparatus and controller device
JP2022052798A (en) Sound processing device, sound processing method, and sound processing program
WO2022168547A1 (en) Control device that applies tactile stimulus
TW202106051A (en) Sound adjustment method and sound adjustment device
WO2014104007A1 (en) Data processing device and data processing program
MIZUTANI Myoelectric Stimulation Silent Subwoofer Which Presents the Deep Bass-Induced Body-Sensory Acoustic Sensation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18918480

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18918480

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP