WO2017163513A1 - Information processing terminal, wristwatch terminal, and control method and control program for said information processing terminal and said wristwatch terminal - Google Patents

Abstract

Provided is a user-friendly information processing terminal or wristwatch terminal provided with: a first videophone means including a display, a camera, a speaker, and a mike; a communication means for carrying out bidirectional communication with a wristwatch terminal having a second videophone means including a display, a camera, a speaker, and a mike; a control means for switching a means for activating between the first videophone means and the second videophone means; and an image generation means for generating a videophone image. When switching the means for activating between the first videophone means and the second videophone means, the image generation means changes the display configuration of the videophone image.

Description

Information processing terminal, wristwatch type terminal, control method thereof, control program thereof

The present invention relates to an information processing terminal, a wristwatch type terminal, a control method thereof, and a control program thereof.

In the above technical field, Patent Document 1 discloses a technique for detecting a rise or fall of a wristwatch-type terminal and switching a camera or the like between the wristwatch-type terminal and the handheld terminal. Patent Documents 2 and 3 disclose a picture-in-picture display technique.

Japanese Patent Laid-Open No. 2015-099974 JP 2004-101708 A Japanese Patent Application Laid-Open No. 08-195943

However, in the technique described in the above-mentioned document, the display is not changed when switching between the wristwatch type terminal and the handheld type terminal, so that it is not really convenient for the user.
The objective of this invention is providing the technique which solves the above-mentioned subject.

In order to achieve the above object, an apparatus according to the present invention provides:
First videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with a wristwatch type terminal provided with second videophone means including a display, a camera, a speaker and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
Screen generation means for generating a screen for a video phone;
With
The screen generation means is an information processing terminal that changes a display configuration of a videophone screen when switching the operation means between the first videophone means and the second videophone means.

In order to achieve the above object, the method according to the present invention comprises:
A control method for an information processing terminal that performs bidirectional communication with a wristwatch type terminal including a first videophone means including a display, a camera, a speaker, and a microphone,
The information processing terminal includes a second videophone means including a display, a camera, a speaker, and a microphone,
And an image control step of switching a screen display configuration when switching the operation means between the first videophone means and the second videophone means.

In order to achieve the above object, a program according to the present invention provides:
A control program for an information processing terminal that performs bidirectional communication with a wristwatch type terminal including a first videophone means including a display, a camera, a speaker, and a microphone,
The information processing terminal includes a second videophone means including a display, a camera, a speaker, and a microphone,
A control program for causing an information processing terminal to execute an image control step for switching a display configuration of a screen when switching a means to be operated between the first videophone means and the second videophone means.

In order to achieve the above object, another apparatus according to the present invention provides:
A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
Screen generation means for generating a screen for a video phone;
With
The screen generation means is a wristwatch type terminal that changes a display configuration of a videophone screen when the means to be operated is switched between the first videophone means and the second videophone means.

In order to achieve the above object, another method according to the present invention includes:
A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
A method for controlling a wristwatch-type terminal comprising:
A method for controlling a wristwatch-type terminal, including a step of generating a screen while changing a display configuration of a screen for a video phone when switching the operating unit between the first video phone unit and the second video phone unit It is.

In order to achieve the above object, another program according to the present invention provides:
A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
A control program for a wristwatch-type terminal comprising:
Control for causing the wristwatch-type terminal to execute a step of generating a screen while changing the display configuration of the screen for videophone when switching the means to be operated between the first videophone means and the second videophone means It is a program.

According to the present invention, it is possible to provide an information processing terminal and a wristwatch type terminal that are truly user-friendly.

It is a block diagram which shows the structure of the information processing system which concerns on 1st Embodiment of this invention. It is a figure which shows the screen transition of the information processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the function structure of the information processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the table used with the information processing system which concerns on 2nd Embodiment of this invention. It is a flowchart which shows the flow of a process of the information processing system which concerns on 2nd Embodiment of this invention. It is a figure which shows the function structure of the information processing system which concerns on 3rd Embodiment of this invention. It is a flowchart which shows the flow of a process of the information processing system which concerns on 3rd Embodiment of this invention. It is a figure which shows the function structure of the information processing system which concerns on 4th Embodiment of this invention. It is a figure which shows the table used with the information processing system which concerns on 4th Embodiment of this invention. It is a flowchart which shows the flow of a process of the information processing system which concerns on 3rd Embodiment of this invention. It is a figure which shows the function structure of the information processing system which concerns on 5th Embodiment of this invention. It is a figure which shows the table used with the information processing system which concerns on 5th Embodiment of this invention. It is a flowchart which shows the flow of a process of the information processing system which concerns on 5th Embodiment of this invention. It is a figure which shows the function structure of the information processing system which concerns on 6th Embodiment of this invention. It is a flowchart which shows the flow of a process of the information processing system which concerns on 6th Embodiment of this invention. It is a figure which shows the table used with the information processing system which concerns on 6th Embodiment of this invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. However, the components described in the following embodiments are merely examples, and are not intended to limit the technical scope of the present invention only to them.

[First Embodiment]
An information processing terminal 100 as a first embodiment of the present invention will be described with reference to FIG. As shown in FIG. 1, the information processing terminal 100 is a device that includes a videophone unit 101, a communication unit 102, a switching unit 103, and a screen generation unit 104.

The video phone unit 101 includes a display, a camera, a speaker, and a microphone.
The communication unit 102 performs two-way communication with a wristwatch type terminal 110 including a video phone unit 111 including a display, a camera, a speaker, and a microphone.

The switching unit 103 switches means to be operated between the video phone unit 101 and the video phone unit 111. The switching unit 103 may switch only the display to be operated between the video phone unit 101 and the video phone unit 111.

The screen generation unit 104 generates a screen for videophone. When the switching unit 103 switches the operation unit between the video phone unit 101 and the video phone unit 111, the screen generation unit 104 changes the display configuration of the video phone screen.
With the above configuration, since it is possible to provide a screen configuration corresponding to a difference in terminals used when making a telephone call with a videophone, an information processing terminal that is truly user-friendly can be provided.

[Second Embodiment]
Next, an information processing system 200 according to the second embodiment of the present invention will be described with reference to FIGS. FIG. 2 is a diagram for explaining a videophone use scene and screen transition using the information processing system 200.

In FIG. 2, the smart watch 201, the smartphone 202, and the television 203 are used by the same user. This figure shows a situation where a graphical user interface of a videophone is transferred between a smartwatch 201 as a wristwatch-type terminal, a smartphone 202, and a stationary television 203 as an image output device.

For example, when the user A is making a videophone call using the smart watch 201, only the face of the partner user B is displayed. After that, the information processing system 200 automatically detects a trigger such as returning home, and switches the videophone call terminal to the smartphone 202. At this time, since the display area becomes large, the smartphone 202 changes the display configuration of the videophone screen and displays a picture-in-picture image in which the image of the user A is displayed together with the image of the user B.

Furthermore, when the user A operates the smartphone 202 to change the output destination of the videophone image from the smartphone 202 to the stationary TV 203, this time, in addition to the image of the other party user B and the image of the user A, the exchange is performed. The contents are displayed in characters. The characters displayed here may be, for example, text messages exchanged with each other in SNS (Social Networking Service) before or during a videophone call. Moreover, the text display as a result of carrying out the speech recognition in real time about the conversation in the video telephone input from the microphone may be sufficient.

As described above, by changing the display mode according to the image output destination, it is possible to provide a user-friendly information processing terminal or wristwatch type terminal. In particular, by displaying the content of the conversation during a videophone call, it becomes possible to use the videophone even for people who are in a situation where they cannot speak, such as in a train, or who are deaf. . For example, a videophone call using characters is established between Mr. A who speaks toward the device and Mr. B who inputs characters using the touch panel.

FIG. 3 is a diagram showing a functional configuration of the information processing system 200 realizing FIG. As illustrated in FIG. 3, the smart watch 201 includes a display 311, a camera 312, a speaker 313, a microphone 314, a communication unit 315, a control unit 316, and a storage unit 317. The smartphone 202 includes a display 321, a camera 322, a speaker 323, a microphone 324, a communication unit 325, a control unit 326, a storage unit 327, a position detection unit 328, and a screen generation unit 329.

When the videophone application stored in the storage unit 327 is executed on the smartphone 202, the display 321, the camera 322, the speaker 323, and the microphone 324 function as the videophone unit 320. The communication unit 325 can communicate with a wide area network and can enjoy a videophone call with a remote party. On the other hand, when the smart watch 201 is used as an input / output terminal for a videophone application using a technology such as Bluetooth (registered trademark) via the communication units 325 and 315, the display 311, the camera 312, the speaker 313, and the microphone 314. Functions as the videophone unit 310. In other words, through the smartphone 202, it is possible to enjoy videophone calls with other users using the smartwatch 201.

The control unit 326 performs switching according to the table 400 as shown in FIG. 4 stored in the storage unit 327 based on the position information of the smartphone 202 detected by the position detection unit 328. Specifically, the control unit 326 switches the video phone unit from the smart watch 201 to the smartphone 202 when it is determined that the position of the smartphone 202 has arrived at a pre-registered location (house or company). At this time, only the screen display may be switched from the smart watch 201 to the smartphone 202. For example, when talking with a Bluetooth (registered trademark) earphone & microphone, only the screen display is switched from the smart watch 201 to the smartphone 202 while the voice communication of the earphone & microphone is continued.

On the other hand, when the control unit 326 determines that the position of the smartphone 202 is away from a location (house or company) registered in advance, the control unit 326 switches the video phone unit from the smartphone 202 to the smart watch 201.

The screen generation unit 329 changes the display configuration of the video phone screen as shown in FIG. 2 when switching the means to be operated between the video phone unit 310 and the video phone unit 320. That is, the display is switched from the display of only the image of the other party to the picture-in-picture display in which the image display area is provided in the image of the other party.

Furthermore, when the user A operates the smartphone 202 to change the output destination of the videophone image from the smartphone 202 to the stationary television 203, the screen generation unit 329 displays the image of the call partner user B and the image of the user A as follows: Generate a screen with the character images of the exchanged contents added. The text image may be, for example, a text message exchanged with each other in an SNS (Social Networking Service) before or during a videophone call, or a text as a result of voice recognition of a conversation during a videophone call input from a microphone. It may be a display.

FIG. 5 is a flowchart for explaining the processing flow of the smartphone 202. First, the position detection unit 328 detects the position of the smartphone 202. In step S503, the detected position is analyzed to determine whether or not it has arrived at a registered place (such as a house or work place). If it has arrived, the process proceeds to step S505, and the videophone unit is moved from the smart watch 201. Switch to smartphone 202. On the other hand, if the user is away from the registered place, the process proceeds from step S503 to step S507 and step S509, and the videophone unit is switched from the smartphone 202 to the smartwatch 201. If there is a switch, the process proceeds to step S511 to change the screen configuration.

As described above, according to this embodiment, the videophone unit and its display mode are automatically switched according to the situation, and the usability is improved.

[Third Embodiment]
Next, an information processing system according to a third embodiment of the present invention will be described with reference to FIG. FIG. 6 is a diagram for explaining a functional configuration of the information processing system 600 according to the present embodiment. The information processing system 600 according to the present embodiment is greatly different from the second embodiment in that the smart watch 601 includes an attachment / detachment detection unit 617 and a screen generation unit 618. Another difference is that the communication unit 615 of the smart watch 601 enables communication with a wide area network independently. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

The attachment / detachment detection unit 617 detects whether the smart watch 601 is attached or not by the user A.

When the control unit 316 determines that the smart watch 601 has changed from the wearing state to the non-wearing state, the control unit 316 switches the operation of the video phone unit 310 to the operation of the video phone unit 320.

When the control unit 316 determines that the smart watch 601 has changed from the non-wearing state to the wearing state, the control unit 316 switches the operation of the video phone unit 320 to the operation of the video phone unit 310. At this time, only the screen display may be switched from the smartphone 602 to the smart watch 601. For example, when talking with a Bluetooth (registered trademark) earphone and microphone, only the screen display is switched from the smartphone 602 to the smartwatch 601 while the earphone and microphone voice communication continues.

The screen generation unit 618 changes the display configuration of the video phone screen as shown in FIG. 2 when switching from the video phone unit 320 to the video phone unit 310. That is, the display is switched from the picture-in-picture display to only the image of the other party.

Further, when the user A operates the smart watch 601 and changes the output destination of the videophone image to the stationary television 203, the screen generation unit 618 exchanges the image exchanged with the call partner user B image and the user A image. Generate a screen with the character image added. The text image may be, for example, a text message exchanged with each other in an SNS (Social Networking Service) before or during a videophone call, or a text as a result of voice recognition of a conversation during a videophone call input from a microphone. It may be a display.

FIG. 7 is a flowchart for explaining the flow of processing in the smart watch 601. In step S <b> 701, the attachment / detachment detection unit 617 determines attachment / detachment of the smart watch 601. When the smart watch 601 is removed from the arm, the process proceeds from step S703 to step S505, and the operating videophone unit is switched from the smart watch 201 to the smartphone 202. On the other hand, when the smart watch 601 is worn on the wrist, the process proceeds from step S707 to step S509, and the videophone unit is switched from the smartphone 202 to the smart watch 201. If there is a switch, the process proceeds to step S511 to change the screen configuration.

As described above, according to this embodiment, the videophone unit and its display mode are automatically switched according to the situation, and the usability is improved.

[Fourth Embodiment]
Next, an information processing system according to a fourth embodiment of the present invention will be described with reference to FIG. FIG. 6 is a diagram for explaining a functional configuration of the information processing system 800 according to the present embodiment. The information processing system 800 according to the present embodiment is different from the third embodiment in that the smart watch 801 includes a posture detection unit 817 instead of the attachment / detachment detection unit 617. Since other configurations and operations are the same as those of the third embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

The posture detection unit 817 detects the posture of the user A of the smart watch 801. For example, it is possible to detect a change in posture such as lifting an arm or sitting.

The control unit 316 switches from the operation of the video phone unit 310 to the operation of the video phone unit 320 when it is determined that the user A has lowered his arm or is seated using the table 900 shown in FIG. At this time, only the screen display may be switched from the smart watch 801 to the smartphone 802. For example, when talking with a Bluetooth (registered trademark) earphone & microphone, only the screen display is switched from the smart watch 801 to the display 802 while the voice communication of the earphone & microphone is continued.

FIG. 10 is a flowchart for explaining the flow of processing in the smart watch 801. In step S <b> 1001, the posture detection unit 817 detects the posture of the user A of the smart watch 601. When it is determined that the user A has lowered his arm or is seated, the process proceeds from step S1005 or step S1007 to step S505, and the control unit 316 switches the operating videophone unit from the smart watch 201 to the smartphone 202.

On the other hand, if it is determined that the user A has raised his arm or has stood up, the process proceeds from step S1013 or step S1015 to step S509, and the control unit 316 switches the operating videophone unit from the smartphone 202 to the smartwatch 201. If there is a switch, the process proceeds to step S511 to change the screen configuration.

As described above, according to this embodiment, the videophone unit and its display mode are automatically switched according to the situation, and the usability is improved.

[Fifth Embodiment]
Next, an information processing system according to a fifth embodiment of the present invention will be described with reference to FIG. FIG. 11 is a diagram for explaining a functional configuration of the information processing system 1100 according to the present embodiment. The information processing system 1100 according to the present embodiment is different from the second embodiment in that the smartphone 1102 includes a distance detection unit 1128 instead of the position detection unit 328. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

The distance detection unit 1128 detects the distance between the smart watch 201 and the smartphone 1102.

When the control unit 326 determines that the distance between the smart watch 201 and the smartphone 1102 is equal to or greater than a predetermined value using the table 1200 illustrated in FIG. 12, the operation of the video phone unit 320 is changed from the operation of the video phone unit 310. Switch to. At this time, only the screen display may be switched from the smart watch 1101 to the smartphone 202. For example, when talking with a Bluetooth (registered trademark) earphone and microphone, only the screen display is switched from the smart watch 201 to the smartphone 1102 while the voice communication of the earphone and microphone is continued.

FIG. 13 is a flowchart for explaining the flow of processing in the smartphone 1102. In step S1301, the distance detection unit 1128 detects the distance between the smart watch 201 and the smartphone 1102. If it is determined that the distance between the smart watch 201 and the smartphone 1102 has become a predetermined value or more, the process proceeds from step S1303 to step S505, and the control unit 316 switches the operating videophone unit from the smart watch 201 to the smartphone 202.

On the other hand, if it is determined that the distance between the smart watch 201 and the smartphone 1102 is smaller than the predetermined value, the process proceeds to step S509, and the control unit 316 switches the operating videophone unit from the smartphone 202 to the smart watch 201. If there is a switch, the process proceeds to step S511 to change the screen configuration.

As described above, according to this embodiment, the videophone unit and its display mode are automatically switched according to the situation, and the usability is improved.

[Sixth Embodiment]
Next, an information processing system according to a sixth embodiment of the present invention will be described with reference to FIG. FIG. 14 is a diagram for explaining a functional configuration of the information processing system 1400 according to the present embodiment. The information processing system 1400 according to the present embodiment is different from the second embodiment in that the smartphone 1402 includes an image analysis unit 1427 and an audio analysis unit 1428. Since other configurations and operations are the same as those of the second embodiment, the same configurations and operations are denoted by the same reference numerals, and detailed description thereof is omitted.

The image analysis unit 1427 and the audio analysis unit 1428 analyze input from the camera 322 and the microphone 324 and detect whether or not the user A is holding the smartphone 1402.

FIG. 15 is a flowchart for explaining the flow of processing in the smartphone 1402. In step S1501, the image analysis unit 1427 and the sound analysis unit 1428 analyze input from the camera 322 and the microphone 324. When the user's face or voice is recognized and it is determined that the user A is picking up the smartphone 1402, the process proceeds from step S1503 or step S1505 to step S505, and the control unit 316 sets the operating videophone unit to the smart watch 201. To smartphone 202. At this time, only the screen display may be switched from the smart watch 201 to the smartphone 202. For example, when talking with a Bluetooth (registered trademark) earphone & microphone, only the screen display is switched from the smart watch 201 to the smartphone 202 while the voice communication of the earphone & microphone is continued.

If there is a switch, the process proceeds to step S511, and the screen generation unit 329 changes the screen configuration. At this time, the image configuration may be changed by using each image output device and a table 1600 in which the display mode is associated with the attribute as shown in FIG.

As described above, according to this embodiment, the videophone unit and its display mode are automatically switched according to the situation, and the usability is improved.

[Other Embodiments]
While the present invention has been described with reference to the embodiments, the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. In addition, a system or an apparatus in which different features included in each embodiment are combined in any way is also included in the scope of the present invention.

Further, the present invention may be applied to a system composed of a plurality of devices, or may be applied to a single device. Furthermore, the present invention can also be applied to a case where an information processing program that implements the functions of the embodiments is supplied directly or remotely to a system or apparatus. Therefore, in order to realize the functions of the present invention on a computer, a program installed on the computer, a medium storing the program, and a WWW (World Wide Web) server that downloads the program are also included in the scope of the present invention. . In particular, at least a non-transitory computer readable medium storing a program for causing a computer to execute the processing steps included in the above-described embodiments is included in the scope of the present invention.

This application claims priority based on Japanese Patent Application No. 2016-058024 filed on Mar. 23, 2016, the entire disclosure of which is incorporated herein.

Claims (9)

First videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with a wristwatch type terminal provided with second videophone means including a display, a camera, a speaker and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
Screen generation means for generating a screen for a video phone;
With
An information processing terminal for changing a display configuration of a screen for a videophone when the screen generating unit switches a unit to be operated between the first videophone unit and the second videophone unit. The information processing terminal according to claim 1, wherein the display of the first videophone means is larger than the display of the second videophone means. When the screen generating means switches the means to be operated from the first videophone means to the second videophone means, the screen generating means provides its own image display area in the image of the call partner from the display of only the image of the call partner. The information processing terminal according to claim 1, wherein the information processing terminal is switched to picture-in-picture display. The control means further switches the output destination of the videophone screen from the second videophone means to another image output device,
The screen generation means further changes the display configuration of the videophone screen when the output destination of the videophone screen is switched from the first videophone means to another image output device. Information processing terminal described in 1. A control method for an information processing terminal that performs bidirectional communication with a wristwatch type terminal including a first videophone means including a display, a camera, a speaker, and a microphone,
The information processing terminal includes a second videophone means including a display, a camera, a speaker, and a microphone,
An information processing terminal control method including an image control step of switching a screen display configuration when switching a means to be operated between the first videophone means and the second videophone means. A control program for an information processing terminal that performs bidirectional communication with a wristwatch type terminal including a first videophone means including a display, a camera, a speaker, and a microphone,
The information processing terminal includes a second videophone means including a display, a camera, a speaker, and a microphone,
A control program for causing an information processing terminal to execute an image control step of switching a screen display configuration when switching a means to be operated between the first videophone means and the second videophone means. A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
Screen generation means for generating a screen for a video phone;
With
The wristwatch type terminal that changes a display configuration of a screen for a videophone when the screen generating means switches a means to be operated between the first videophone means and the second videophone means. A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
A method for controlling a wristwatch-type terminal comprising:
A method for controlling a wristwatch-type terminal, including a step of generating a screen while changing a display configuration of a screen for a video phone when switching the operating unit between the first video phone unit and the second video phone unit . A second videophone means including a display, a camera, a speaker and a microphone;
Communication means for performing bidirectional communication with an information processing terminal including first videophone means including a display, a camera, a speaker, and a microphone;
Control means for switching means for operating between the first videophone means and the second videophone means;
A control program for a wristwatch-type terminal comprising:
Control for causing the wristwatch-type terminal to execute a step of generating a screen while changing the display configuration of the screen for videophone when switching the means to be operated between the first videophone means and the second videophone means program.

Images