WO2010050473A1 - Electronic equipment, communication system, communication method and communication program - Google Patents

Abstract

Electronic equipment, a communication system, a communication method and a communication program are provided in which all the users of a handwriting-based chat system can smoothly share data other than handwritten data. A communication system (1) is provided with: electronic equipment (100) having liquid-crystal panels (140, 240), electronic equipment (100#) having liquid-crystal panels (140#, 240#), electronic equipment (10) having a liquid crystal panel (12), and electronic equipment (20) having a monitor (22). The electronic equipment (100) sends to the electronic equipment (100#) or electronic equipment (10) a command including appended data and an input pattern to the liquid-crystal panel (240). The electronic equipment (100#) that receives the command displays the input pattern on the liquid-crystal panel (140#) and displays an image corresponding to the appended data on the liquid-crystal panel (240#). The electronic equipment (10) that receives the command displays the input pattern on the liquid-crystal panel (12) and transmits the appended data to the electronic equipment (20).

Description

Electronic device, communication system, communication method, and communication program

The present invention relates to an electronic device, a communication system including a plurality of electronic devices, a communication method using the electronic device, and a communication program.

Currently, electronic devices such as personal computers are widely distributed. JP 2004-005105 A (Patent Document 1), JP 2004-005212 A (Patent Document 2), JP 2004-234504 A (Patent Document 3), JP 2000-339097 A (Patent Document 4). ) Discloses an information processing apparatus including a touch pad combined with a display device.

In recent years, handwritten chat systems using a plurality of electronic devices are becoming widespread. Each electronic device included in the handwritten chat system has a handwritten display surface (for example, a whiteboard). All electronic devices included in the system bidirectionally send photographs and input patterns (handwritten patterns) to the whiteboard of each electronic device via the Internet.

Therefore, users of the handwritten chat system can share one virtual whiteboard even when they are away from each other. Users can communicate with each other by writing on the whiteboard.

In addition, in the above Japanese Patent Application Laid-Open No. 2004-005105 (Patent Document 1), Japanese Patent Application Laid-Open No. 2004-005212 (Patent Document 2), and Japanese Patent Application Laid-Open No. 2004-234504 (Patent Document 3), two display devices are provided. An information processing apparatus provided is disclosed. Japanese Unexamined Patent Publication No. 2000-339097 (Patent Document 4) discloses an information processing apparatus including a display unit and a detachable PC (Personal Computer) card. The display unit and the PC card include an LCD (Liquid Crystal Display). The LCD of the PC card is provided on the back surface of the touch pad.

Furthermore, “http://dynabook.com/pc/catalog/dynabook/030512g8/index_j.htm” (Non-Patent Document 1) discloses a notebook personal computer in which the touchpad is a liquid crystal display. Yes. Conventionally, a liquid crystal panel with a built-in optical sensor is known.

JP 2004-005105 A JP 2004-005212 A JP 2004-234504 A JP 2000-339097 A

Toshiba Notebook PC Dynabook (registered trademark) G8 Series Product Catalog Internet <URL: http://dynabook.com/pc/catalog/dynabook/030512g8/index_j.htm>

However, the conventional handwritten chat system can only handle data such as documents and photographs other than handwritten patterns as part of handwritten data. When an electronic device in the system sends such data, the whiteboard displays a screen in which data other than the handwritten pattern and handwritten data are mixed.

Therefore, it has been difficult for users of conventional handwritten chat systems to smoothly share data other than handwritten patterns. This is because sending such data makes the display of the whiteboard complicated.

The present invention has been made in order to solve the above-described problems, and enables an electronic device, a communication system, and a communication method to enable each user of a handwritten chat system to smoothly share data other than handwritten data. It is another object of the present invention to provide a communication program.

According to one aspect of the present invention, an electronic device includes a communication unit that communicates with an external device, a monitor, and a display-integrated tablet. The display-integrated tablet has an input pattern to the display-integrated tablet. A control unit that outputs and controls the operation of the electronic device. The control unit controls the attached data creation unit that creates attached data and the communication unit, and includes an input pattern and attached data. A transfer control unit that transmits a command for requesting the external device to display on the body-shaped tablet and to reproduce the attached data on the monitor to the external device.

Preferably, the external device includes a first device having a display-integrated tablet and a second device having a monitor, and the command inputs an input pattern to the first device, the display-integrated tablet of the first device. And request that the attached data be transferred to the second device.

Preferably, the external device includes a third device having a monitor and a display-integrated tablet, and the command displays an input pattern on the display-integrated tablet of the third device for the third device, and the attached data It is requested to display a screen corresponding to the item on the monitor of the third device.

Preferably, the attached data relates to a display screen of a monitor of the electronic device.
More preferably, the attached data includes display data serving as a basis of the display screen.

More preferably, the attached data includes a file serving as a basis of the display screen.
More preferably, the attached data includes a link to the display screen.

More preferably, the display screen includes a web screen, and the link is an address of the web screen.

Preferably, the monitor is a liquid crystal panel with a built-in optical sensor.
More preferably, the attached data includes image data acquired by the optical sensor built-in liquid crystal panel.

Preferably, the display-integrated tablet of the electronic device is a liquid crystal panel with a built-in optical sensor.
According to another aspect of the present invention, there is provided a communication unit that communicates with a first device having a monitor and a display-integrated tablet and a second device having a monitor, a display-integrated tablet, and an electronic device. A control unit that controls operation of the device, and the control unit displays the input pattern on the display-integrated tablet when the communication unit receives a command including an input pattern and attached data from the first device; When the communication unit receives the command, the communication unit controls the communication unit, and the re-transfer control unit transmits the attached data to the second device.

According to still another aspect of the present invention, the electronic device includes a communication unit that communicates with an external device, a monitor, a display-integrated tablet, and a control unit that controls the operation of the electronic device. When the communication unit receives a command including an input pattern and attached data from an external device, the first display control unit displays the input pattern on the display-integrated tablet. When the communication unit receives the command, the monitor displays the attached data on the monitor. And a second display control unit that displays a corresponding screen.

According to still another aspect of the present invention, a communication system including a first device, a second device, and a third device, wherein the first device communicates with the second device. Unit, a first monitor, and a first display-integrated tablet, the first display-integrated tablet outputs an input pattern to the first display-integrated tablet, and the operation of the first device And a first control unit that controls the attached data creation unit that creates monitor-related data as attached data and the first communication unit, and represents an input pattern and attached data. A transfer control unit that transmits a command to the second device, wherein the second device includes a second communication unit that communicates with the first device and the third device, a second display-integrated tablet, A second control unit that controls the operation of the second device, When the second communication unit receives the command, the second control unit displays the input pattern on the second display-integrated tablet, and when the second communication unit receives the command, the second communication unit And a re-transfer control unit that transmits the attached data to the third device. The third device displays the second monitor and a screen corresponding to the attached data on the second monitor. And a control unit.

According to still another aspect of the present invention, a communication system including a first device and a second device, wherein the first device communicates with the second device, the first communication unit, And a first display-integrated tablet, the first display-integrated tablet outputs a first input pattern to the first display-integrated tablet, and controls the operation of the first device. The first control unit controls the first communication unit and generates a command including an input pattern and attached data. The attached data creation unit creates data related to the first monitor as attached data. A second control unit that transmits to the second device, the second device includes a second communication unit that communicates with the first device, a second monitor, a second display-integrated tablet, And a second control unit that controls the operation of the second device, When the second communication unit receives a command, the control unit displays a first display control unit that displays an input pattern on the second display-integrated tablet, and when the second communication unit receives the command, And a second display control unit that displays a screen corresponding to the attached data on the monitor.

According to still another aspect of the present invention, a communication method using an electronic device having a monitor and a display-integrated tablet, the electronic device creating attached data, and the electronic device into a display-integrated tablet Transmitting a command for requesting the external device to display the input pattern on the display-integrated tablet and to reproduce the attached data on the monitor.

According to still another aspect of the present invention, there is provided a communication program for causing an electronic device having a monitor and a display-integrated tablet to communicate, the step of causing the electronic device to create attached data; And a step of transmitting to the external device a command for requesting the external device to display the input pattern on the display-integrated tablet and to reproduce the attached data on the monitor.

According to the present invention, the electronic device transmits a command requesting the external device to reproduce the input pattern to the display-integrated tablet and the attached data. The external device that receives the command displays the input pattern on the display-integrated tablet and displays a screen corresponding to the attached data on the monitor. As a result, according to the present invention, each user of the handwritten chat system can smoothly share data other than the handwritten data.

1 is a diagram illustrating a configuration of a communication system 1. FIG. It is a block diagram showing the hardware constitutions of an electronic device. It is the figure which showed the structure of the display panel, and the peripheral circuit of the said display panel. It is sectional drawing of a display panel and a backlight. It is the figure which showed the timing chart at the time of operating an optical sensor circuit. It is sectional drawing which showed the structure which a photodiode receives the light from a backlight in the case of a scan. It is the figure which showed schematic structure of the command. It is a figure for demonstrating the command of classification "000". FIG. 10 is a diagram for explaining a command of type “001”. It is a figure for demonstrating the command of classification "010". FIG. 10 is a diagram for explaining a command of type “011”. It is a figure for demonstrating the command of classification "100". FIG. 10 is a diagram for explaining a command of type “101”. It is the figure which showed schematic structure of the response data. It is the figure which showed the image (scanned image) obtained by scanning a finger | toe. It is a circuit diagram of liquid crystal panel 140A with a built-in optical sensor. It is sectional drawing which showed the structure which a photodiode receives external light in the case of a scan. It is a block diagram showing the hardware constitutions of the modification of an electronic device. It is a block diagram which shows the functional structure of the communication system 1 in a 1st specific implementation example. It is a figure explaining operation | movement of the electronic device 100 and the electronic device 100 #, (A) is a display screen of the electronic device 100 and the electronic device 100 # before the electronic device 100 transfers data to the electronic device 100 #. (B) is a figure which shows the display screen of electronic device 100 and electronic device 100 # after electronic device 100 transfers data to electronic device 100 #. It is a figure which shows the outline of the data structure of a command. It is a figure which shows the detail of the data structure of a command. It is a figure which shows the flow of the process which the electronic devices 100 and 100 # perform in handwritten chat in a flowchart format. FIG. 7 is a diagram illustrating operations of the electronic device 100, the electronic device 10, and the electronic device 20, and FIG. 6A is a display screen of the electronic device 100 and the electronic device 10 before the electronic device 100 transfers data to the electronic device 10. (B) is a figure which shows operation | movement of the electronic device 10 and the electronic device 20 at the time of the electronic device 100 sending the command to the electronic device 10. FIG. It is a figure which shows the flow of the process which the electronic devices 100, 10, and 20 perform in handwritten chat in a flowchart format. It is the figure which showed schematic structure of the communication system in a 2nd specific implementation example. It is the figure which showed the external appearance of the other electronic device. It is the figure which showed the hardware constitutions of the other electronic device. It is a functional block diagram of an electronic device. It is a functional block diagram of another electronic device. It is the figure which showed the case where an electronic device displayed the 1st image on the liquid crystal panel. It is the figure which showed the image displayed on the liquid crystal panel of an electronic device after an electronic device receives property data from a server apparatus. FIG. 33 is a diagram illustrating an image displayed on the electronic device when the user of the electronic device performs handwriting input via the liquid crystal panel in the state of FIG. 32. It is the figure which showed the image displayed on the liquid crystal panel of another electronic device, when other electronic devices receive the handwritten input data based on a character and a figure, and produced | generated synthetic image data. FIG. 35 is a diagram showing an image displayed on another electronic device when a user of the other electronic device further performs handwriting input via the liquid crystal panel in the state of FIG. 34. It is the figure which showed the image displayed on the liquid crystal panel of an electronic device, when the electronic device receives the handwriting input data based on a figure and a character, and produced | generated synthetic image data. It is the figure which showed the sequence between an electronic device, another electronic device, and a server apparatus. It is the flowchart which showed the flow of the data processing in an electronic device. It is the flowchart which showed the flow of the data processing in another electronic device. It is the figure which showed the functional block of another electronic device. It is the figure which showed the functional block of another electronic device. It is the figure which showed the state which displayed the image which showed the floor plan, and the 1st check box group and the 2nd check box group on the liquid crystal panel of the electronic device shown in FIG. It is the figure which showed the state in which the item of the kitchen of a 1st check box group is a check state. It is the figure which showed the display screen of the liquid crystal panel after changing the check box of the item of the wall in a 2nd check box group into a check state. It is the figure which showed the state which displayed the image which showed the floor plan, and each check box group for refinement | retrieval search on the liquid crystal panel of the electronic device shown in FIG. It is the figure which showed schematic structure of the communication system in the 3rd concrete implementation example. It is the figure which showed the external appearance of the other electronic device contained in a communication system. It is the figure which showed the hardware constitutions of the other electronic device. It is a functional block diagram of an electronic device. It is a functional block diagram of another electronic device. It is the figure which showed the image displayed on the liquid crystal panel of another electronic device, when a motorcycle is image | photographed with the camera of another electronic device. It is the figure which showed the image displayed on another electronic device and an electronic device after another electronic device transmits the image data of Audubai to an electronic device. It is the figure which showed the image displayed on the liquid crystal panel of an electronic device after a search was performed in the electronic device. FIG. 56 is a diagram illustrating images displayed on another electronic device and the electronic device when the user of the electronic device performs handwriting input via the liquid crystal panel in the state of FIG. 53. It is the figure which showed typically the 2nd image data transmitted to another electronic device from an electronic device. It is the figure which showed the image displayed on the liquid crystal panel of another electronic device, when another electronic device receives handwritten input data and position information from an electronic device, and also produces | generates synthetic | combination image data. After the image shown in FIG. 56 is displayed on the liquid crystal panel of another electronic device, the third image data generated in the other electronic device is transmitted to the electronic device. It is the figure which showed the image displayed. FIG. 58 is a diagram showing images displayed on the electronic device and the other electronic device when the second image data is transmitted from the electronic device to another electronic device after the image shown in FIG. 57 is displayed. It is the figure which showed the sequence between an electronic device and another electronic device. It is the flowchart which showed the flow of the data processing in an electronic device. It is the flowchart which showed the flow of the data processing in another electronic device. It is the figure which showed the functional block of the modification of an electronic device. It is the figure which showed schematic structure of the communication system in a 4th specific implementation example. It is the figure which showed the external appearance of the other electronic device. It is the figure which showed the hardware constitutions of the other electronic device. It is a functional block diagram of an electronic device. It is a functional block diagram of another electronic device. It is the figure which showed the case where another electronic device displayed the 2nd map image on the liquid crystal panel. It is the figure which showed the image displayed on another electronic device and an electronic device after another electronic device transmitted map display information to an electronic device. FIG. 70 is a diagram illustrating an image displayed on the electronic device when the user of the electronic device performs handwriting input via the liquid crystal panel in the state of FIG. 69. It is the figure which showed the image displayed on the liquid crystal panel of another electronic device, when another electronic device receives the image data produced | generated based on the figure, and also produced | generated the composite image data mentioned above. In the state of FIG. 70, it is the figure which showed the image displayed on an electronic device when the user of an electronic device further performs handwriting input via a liquid crystal panel. It is the figure which showed the image displayed on the liquid crystal panel of another electronic device, when another electronic device receives the image data produced | generated based on the figure and the character, and also produced | generated the composite image data mentioned above. It is the figure which showed the sequence between an electronic device, another electronic device, a GPS satellite, and a server apparatus. It is the flowchart which showed the flow of the data processing in an electronic device. It is the flowchart which showed the flow of the data processing in an electronic device.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

FIG. 1 is a diagram showing a configuration of a communication system 1 for handwritten chat according to the present invention. With reference to FIG. 1, the communication system 1 includes an electronic device 100, an electronic device 100 #, an electronic device 10, and an electronic device 20.

Electronic device 100 includes a first housing 100A and a second housing 100B.
The first casing 100A and the second casing 100B are foldably connected by a hinge 100C. The first housing 100A includes a liquid crystal panel 140 with a built-in optical sensor. The second housing 100B includes an optical sensor built-in liquid crystal panel 240. As described above, the electronic device 100 includes two optical sensor built-in liquid crystal panels.

Note that the electronic device 100 is configured as a portable device having a display function such as a PDA (Personal Digital Assistant), a notebook personal computer, a portable telephone, and an electronic dictionary.

The electronic device 100 # has the same configuration as the electronic device 100. Electronic device 100 # includes two optical sensor built-in liquid crystal panels 140 # and 240 #.

The electronic device 10 includes an optical sensor built-in liquid crystal panel 12. However, unlike the electronic device 100 and the electronic device 100 #, the electronic device 10 has only one monitor that displays an image. In the present embodiment, it is assumed that electronic device 10 is a portable device such as a smartphone. However, the electronic device 10 is not limited to a portable device, and may be any device including a monitor (display integrated tablet) that can accept handwritten input.

The electronic device 20 includes a monitor 22. In the present embodiment, it is assumed that electronic device 20 is a notebook computer. However, the electronic device 20 is not limited to a notebook computer, and may be a device including a monitor 22, such as a television. The monitor 22 may be a display device that does not accept handwritten input, or may be a display-integrated tablet.

Each electronic device in the communication system 1 can communicate with each other. For example, electronic device 100 communicates with electronic device 100 # and electronic device 10. The electronic device 10 communicates with the electronic device 100 and the electronic device 20.

The communication system 1 may include electronic devices other than those shown in FIG. Further, the communication system 1 may not include all of the electronic devices 100, 100 #, 10, and 20.

<About hardware configuration>
Next, an aspect of a specific configuration of the electronic device 100 will be described with reference to FIG. FIG. 2 is a block diagram illustrating a hardware configuration of electronic device 100.

The electronic device 100 includes a first unit 1001 and a second unit 1002. The second unit 1002 is detachably connected to the first unit 1001 from the electronic device 100. The first unit 1001 includes a main body device 101 and a display device 102. The second unit 1002 includes a display device 103 and a main device 104.

The first housing 100A includes a display device 102. Second housing 100B includes main device 101. The second housing 100B includes a second unit 1002.

(About the first unit)
The main unit 101 includes a CPU (Central Processing Unit) 110, a RAM (Random Access Memory) 171, a ROM (Read-Only Memory) 172, a memory card reader / writer 173, an external communication unit 174, a microphone 175, A speaker 176, an operation key 177, a power switch 191, a power circuit 192, a power detection unit 193, a USB (Universal Serial Bus) connector 194, an antenna 195, and a LAN (Local Area Network) connector 196 are included. . Each component (110, 171 to 177, 193) is connected to each other by a data bus DB1. A memory card 1731 is attached to the memory card reader / writer 173.

CPU 110 executes the program. The operation key 177 receives an instruction input from the user of the electronic device 100. The RAM 171 stores data generated by the execution of the program by the CPU 110 or data input via the operation keys 177 in a volatile manner. The ROM 172 stores data in a nonvolatile manner. The ROM 172 is a ROM capable of writing and erasing data such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory.

External communication unit 174 communicates with other electronic devices. Specifically, the external communication unit 174 communicates with, for example, the second unit 1002 via the USB connector 194. The external communication unit 174 performs wireless communication with the second unit 1002 via the antenna 195, for example. Further, the external communication unit 174 performs wired communication with other electronic devices via the LAN connector 196.

The main device 101 may communicate with other electronic devices by wireless communication other than Bluetooth (registered trademark). For example, the external communication unit 174 may perform wireless communication with other electronic devices connected to the LAN via a wireless LAN antenna (not shown). Alternatively, wireless communication may be performed with another electronic device via an infrared port (not shown).

The power switch 191 is a switch for starting up the electronic device 100.
When the power switch 191 is turned on, the power supply circuit 192 supplies power to each component connected to the data bus DB1 and the display device 102 via the power detection unit 193. When the power switch 191 is turned on, the power circuit 192 supplies power to the external communication unit 174 without going through the power detection unit 193.

The power supply detection unit 193 detects the output from the power supply circuit 192. In addition, the power supply detection unit 193 sends information (for example, a voltage value and a current value) regarding the detected output to the CPU 110.

The USB connector 194 is used to connect the first unit 1001 to the second unit 1002. Note that the main device 101 may include other USB connectors in addition to the USB connector 194.

The first unit 1001 transmits data to the second unit 1002 via the USB connector 194. The first unit 1001 receives data from the second unit 1002 via the USB connector 194. Further, the first unit 1001 supplies power to the second unit 1002 via the USB connector 194.

The antenna 195 is used for communication in accordance with the Bluetooth (registered trademark) standard between the first unit 1001 and another communication device (for example, the second unit 1002). The LAN connector 196 is used to connect the electronic device 100 to the LAN.

The display device 102 includes a driver 130, an optical sensor built-in liquid crystal panel 140 (hereinafter referred to as a liquid crystal panel 140), an internal IF 178, a backlight 179, and an image processing engine 180.

The driver 130 is a drive circuit for driving the liquid crystal panel 140 and the backlight 179. Various drive circuits included in the driver 130 will be described later.

The liquid crystal panel 140 is a device having a liquid crystal display function and an optical sensor function. That is, the liquid crystal panel 140 can perform image display using liquid crystal and sensing using an optical sensor. Details of the liquid crystal panel 140 will be described later.

The internal IF (Interface) 178 mediates exchange of data between the main device 101 and the display device 102.

The backlight 179 is a light source disposed on the back surface of the liquid crystal panel 140. The backlight 179 irradiates the back surface with uniform light.

The image processing engine 180 controls the operation of the liquid crystal panel 140 via the driver 130. Here, the control is performed based on various data sent from the main apparatus 101 via the internal IF 178. Note that the various data includes commands to be described later. Further, the image processing engine 180 processes data output from the liquid crystal panel 140 and sends the processed data to the main apparatus 101 via the internal IF 178. Further, the image processing engine 180 includes a driver control unit 181, a timer 182, and a signal processing unit 183.

The driver control unit 181 controls the operation of the driver 130 by sending a control signal to the driver 130. In addition, the driver control unit 181 analyzes a command transmitted from the main device 101. Then, the driver control unit 181 sends a control signal based on the analysis result to the driver 130. Details of the operation of the driver 130 will be described later.

The timer 182 generates time information and sends the time information to the signal processing unit 183.
The signal processing unit 183 receives data output from the optical sensor. Here, since the data output from the optical sensor is analog data, the signal processing unit 183 first converts the analog data into digital data. Further, the signal processing unit 183 performs data processing on the digital data according to the content of the command sent from the main device 101. Then, the signal processing unit 183 sends data (hereinafter referred to as response data) including data after the above data processing and time information acquired from the timer 182 to the main unit 101. The signal processing unit 183 includes a RAM (not shown) that can store a plurality of scan data, which will be described later, continuously.

The command includes a sensing command for instructing sensing by the optical sensor. Details of the sensing command and the response data will be described later (FIGS. 7, 8, and 14).

Note that the timer 182 is not necessarily provided in the image processing engine 180. For example, the timer 182 may be provided outside the image processing engine 180 in the display device 102. Alternatively, the timer 182 may be provided in the main body device 101. Further, the microphone 175 and the speaker 176 are not always provided in the electronic device 100, and may be configured so as not to include either or both of the microphone 175 and the speaker 176 depending on the embodiment of the electronic device 100.

Here, the display device 102 includes a system liquid crystal. The system liquid crystal is a device obtained by integrally forming peripheral devices of the liquid crystal panel 140 on the glass substrate of the liquid crystal panel 140. In the present embodiment, the driver 130 (excluding the circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are integrally formed on the glass substrate of the liquid crystal panel 140. Note that the display device 102 is not necessarily configured using the system liquid crystal, and the driver 130 (excluding a circuit that drives the backlight 179), the internal IF 178, and the image processing engine 180 are included in the glass substrate. Other substrates may be configured.

(About the second unit)
The second unit 1002 receives power supply from the first unit 1001. Specifically, the second unit 1002 is supplied with power from the power supply circuit 192 of the first unit 1001 by connecting a USB connector 294 described later and the USB connector 194 of the first unit 1001.

The main body device 104 includes a CPU 210, a RAM 271, a ROM 272, an external communication unit 274, a power supply detection unit 293, a USB connector 294, an antenna 295, and a signal strength detection unit 297. Each component (210, 271, 272, 274, 293) is connected to each other by a data bus DB2.

CPU 210 executes a program. The RAM 271 stores data generated by the execution of the program by the CPU 210 in a volatile manner. The ROM 272 stores data in a nonvolatile manner. The ROM 272 is a ROM capable of writing and erasing data such as an EPROM (Erasable Programmable Read-Only Memory) and a flash memory.

The external communication unit 274 communicates with other electronic devices. Specifically, the external communication unit 274 communicates with, for example, the first unit 1001 via the USB connector 294. The external communication unit 274 communicates with the first unit 1001 through the antenna 295, for example.

The main device 104 may communicate with another electronic device (for example, the first unit 1001) by wireless communication other than Bluetooth (registered trademark). For example, the external communication unit 274 may perform wireless communication with other electronic devices via an infrared port (not shown).

The signal strength detection unit 297 detects the strength of the signal received via the antenna 295. Then, the signal strength detection unit 297 sends the detected strength to the external communication unit 274.

The USB connector 294 is used to connect the second unit 1002 to the first unit 1001.

The second unit 1002 transmits data to the first unit 1001 via the USB connector 294. The second unit 1002 receives data from the first unit 1001 via the USB connector 294. Furthermore, the second unit 1002 receives power supply from the first unit 1001 via the USB connector 294 as described above. The second unit 1002 stores the electric power supplied from the first unit 1001 in a battery (not shown).

The antenna 295 is used for communication according to the Bluetooth (registered trademark) standard between the second unit 1002 and the first unit 1001, for example.

The power detection unit 293 detects the power supplied via the USB connector 294. In addition, the power supply detection unit 293 sends information about the detected power to the CPU 210.

Further, the main device 104 may have a function of performing infrared communication.
The display device 103 includes a driver 230, an optical sensor built-in liquid crystal panel 240 (hereinafter referred to as “liquid crystal panel 240”), an internal IF 278, a backlight 279, and an image processing engine 280. The image processing engine 280 includes a driver control unit 281, a timer 282, and a signal processing unit 283.

The display device 103 has the same configuration as the display device 102. That is, the driver 230, the liquid crystal panel 240, the internal IF 278, the backlight 279, and the image processing engine 280 have the same configuration as the driver 130, the liquid crystal panel 140, the internal IF 178, the backlight 179, and the image processing engine 180 in the display device 102. Have each. The driver control unit 281, the timer 282, and the signal processing unit 283 have the same configurations as the driver control unit 181, the timer 182, and the signal processing unit 183 in the display device 102, respectively. Therefore, description of each functional block included in display device 103 will not be repeated.

Incidentally, the processing in the electronic device 100 is realized by software executed by each hardware and the CPU 110. Such software may be stored in the ROM 172 in advance. The software may be stored in a memory card 1731 or other storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium by the memory card reader / writer 173 or other reading device, or downloaded via the communication unit 174 or communication IF (not shown), and then temporarily stored in the ROM 172. The The software is read from the ROM 172 by the CPU 110 and stored in the RAM 171 in the form of an executable program. CPU 110 executes the program.

Each component constituting the main device 101 of the electronic device 100 shown in FIG. 2 is a general one. Therefore, it can be said that the essential part of the present invention is the software stored in the RAM 171, the ROM 172, the memory card 1731 and other storage media, or the software downloadable via the network. Since the hardware operation of main device 101 of electronic device 100 is well known, detailed description will not be repeated.

The storage medium is not limited to a memory card, but is a CD-ROM, FD (Flexible Disk), hard disk, magnetic tape, cassette tape, optical disk (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile). Disc)), IC (Integrated Circuit) card (excluding memory card), optical card, mask ROM, EPROM, EEPROM (Electronically Erasable Programmable Read-Only Memory), semiconductor memory such as flash ROM, etc. It may be a medium to be used.

The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<Configuration and drive of liquid crystal panel with built-in optical sensor>
Next, the configuration of the liquid crystal panel 140 and the configuration of peripheral circuits of the liquid crystal panel 140 will be described. FIG. 3 is a diagram showing a configuration of the liquid crystal panel 140 and peripheral circuits of the liquid crystal panel 140.

Referring to FIG. 3, the liquid crystal panel 140 includes a pixel circuit 141, an optical sensor circuit 144, a scanning signal line Gi, a data signal line SRj, a data signal line SGj, a data signal line SBj, and a sensor signal line. SSj, sensor signal line SDj, read signal line RWi, and reset signal line RSi are included. Note that i is a natural number satisfying 1 ≦ i ≦ m, and j is a natural number satisfying 1 ≦ j ≦ n.

2 includes a scanning signal line driving circuit 131, a data signal line driving circuit 132, an optical sensor driving circuit 133, a switch 134, as peripheral circuits of the liquid crystal panel 140. And an amplifier 135.

The scanning signal line drive circuit 131 receives the control signal TC1 from the driver control unit 181 shown in FIG. The scanning signal line drive circuit 131 applies a predetermined voltage in order from the scanning signal line G1 to each scanning signal line (G1 to Gm) based on the control signal TC1. More specifically, the scanning signal line driving circuit 131 sequentially selects one scanning signal line from the scanning signal lines (G1 to Gm) per unit time, and a TFT (to be described later) with respect to the selected scanning signal line. A voltage that can turn on the gate of the thin film transistor 142 (hereinafter referred to as a high level voltage) is applied. Note that a low level voltage is applied to a scanning signal line that is not selected without applying a high level voltage.

The data signal line drive circuit 132 receives image data (DR, DG, DB) from the driver control unit 181 shown in FIG. The data signal line driving circuit 132 applies a voltage corresponding to one row of image data to the 3n data signal lines (SR1 to SRn, SG1 to SGn, SB1 to SBn) for each unit time. Apply sequentially.

In addition, although it demonstrated using the drive system called what is called a line sequential system here, a drive system is not limited to this.

The pixel circuit 141 is a circuit for setting the luminance (transmittance) of one pixel. Further, m × n pixel circuits 141 are arranged in a matrix. More specifically, m pixel circuits 141 are arranged in the vertical direction in FIG. 3 and n pixel circuits in the horizontal direction.

The pixel circuit 141 includes an R subpixel circuit 141r, a G subpixel circuit 141g, and a B subpixel circuit 141b. Each of these three circuits (141r, 141g, 141b) includes a TFT 142, a pair of electrode pairs 143 including a pixel electrode and a counter electrode, and a capacitor (not shown).

In addition, CMOS (Complementary Metal Oxide Semiconductor) that can make n-type transistors and p-type transistors can be realized, and the movement speed of carriers (electrons or holes) is several hundreds compared to amorphous silicon thin film transistors (a-Si TFTs). For example, a polycrystalline silicon thin film transistor (p-Si TFT) is used as the TFT 142 in the display device 102 because it is twice as fast. Note that the TFT 142 will be described as an n-channel field effect transistor. However, the TFT 142 may be a p-type channel field effect transistor.

The source of the TFT 142 in the R subpixel circuit 141r is connected to the data signal line SRj. The gate of the TFT 142 is connected to the scanning signal line Gi. Further, the drain of the TFT 142 is connected to the pixel electrode of the electrode pair 143. A liquid crystal is disposed between the pixel electrode and the counter electrode. The G sub-pixel circuit 141g and the B sub-pixel circuit 141b have the same configuration as the R sub-pixel circuit 141r except that the data signal line to which the source of each TFT 142 is connected is different. Therefore, description of these two circuits (141g, 141b) will not be repeated.

Here, the setting of the luminance in the pixel circuit 141 will be described. First, the high level voltage is applied to the scanning signal line Gi. By the application of the high level voltage, the gate of the TFT 142 is turned on. In this manner, with the gate of the TFT 142 turned on, a specified voltage (voltage corresponding to image data for one pixel) is applied to each data signal line (SRj, SGj, SBj). Thereby, a voltage based on the designated voltage is applied to the pixel electrode. As a result, a potential difference is generated between the pixel electrode and the counter electrode. Based on this potential difference, the liquid crystal responds and the luminance of the pixel is set to a predetermined luminance. Note that the potential difference is held by the capacitor (auxiliary capacitor) (not shown) until the scanning signal line Gi is selected in the next frame period.

The optical sensor driving circuit 133 receives the control signal TC2 from the driver control unit 181 shown in FIG.

Then, the optical sensor drive circuit 133 sequentially selects one signal line from the reset signal lines (RS1 to RSm) for each unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, the voltage VDDR that is higher than usual is applied. Note that a voltage VSSR lower than the voltage applied to the selected reset signal line is kept applied to the unselected reset signal line. For example, the voltage VDDR may be set to 0V and the voltage VSSR may be set to −5V.

In addition, the photosensor driving circuit 133 sequentially selects one signal line from the readout signal lines (RW1 to RWm) per unit time based on the control signal TC2, and determines in advance for the selected signal line. At a given timing, a voltage VDD higher than usual is applied. Note that the voltage VSSR is applied to the read signal line that is not selected. For example, the value of VDD may be set to 8V.

The timing for applying the voltage VDDR and the timing for applying the voltage VDD will be described later.

The optical sensor circuit 144 includes a photodiode 145, a capacitor 146, and a TFT 147. In the following description, it is assumed that the TFT 147 is an n-type channel field effect transistor. However, the TFT 147 may be a p-type channel field effect transistor.

The anode of the photodiode 145 is connected to the reset signal line RSi. On the other hand, the cathode of the photodiode 145 is connected to one electrode of the capacitor 146. The other electrode of the capacitor 146 is connected to the read signal line RWi. Hereinafter, a connection point between the photodiode 145 and the capacitor 146 is referred to as a node N.

The gate of the TFT 147 is connected to the node N. The drain of the TFT 147 is connected to the sensor signal line SDj. Further, the source of the TFT 147 is connected to the sensor signal line SSj. Details of sensing using the optical sensor circuit 144 will be described later.

The switch 134 is a switch provided for switching whether or not to apply a predetermined voltage to the sensor signal lines (SD1 to SDn). The switching operation of the switch 134 is performed by the optical sensor driving circuit 133. The voltage applied to the sensor signal lines (SD1 to SDn) when the switch 134 is turned on will be described later.

The amplifier 135 amplifies the voltage output from each sensor signal line (SS1 to SSn). The amplified voltage is sent to the signal processing unit 183 shown in FIG.

Note that the image processing engine 180 controls the timing at which an image is displayed on the liquid crystal panel 140 using the pixel circuit 141 and the timing at which sensing is performed using the optical sensor circuit 144.

FIG. 4 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179. Referring to FIG. 4, liquid crystal panel 140 includes an active matrix substrate 151A, a counter substrate 151B, and a liquid crystal layer 152. The counter substrate 151B is disposed to face the active matrix substrate 151A. The liquid crystal layer 152 is sandwiched between the active matrix substrate 151A and the counter substrate 151B. The backlight 179 is disposed on the opposite side of the liquid crystal layer 152 with respect to the active matrix substrate 151A.

The active matrix substrate 151A includes a polarizing filter 161, a glass substrate 162, a pixel electrode 143a constituting an electrode pair 143, a photodiode 145, a data signal line 157, and an alignment film 164. Further, although not shown in FIG. 4, the active matrix substrate 151A includes the capacitor 146, the TFT 147, the TFT 142, and the scanning signal line Gi shown in FIG.

In the active matrix substrate 151A, the polarizing filter 161, the glass substrate 162, the pixel electrode 143a, and the alignment film 164 are arranged in this order from the backlight 179 side. The photodiode 145 and the data signal line 157 are formed on the liquid crystal layer 152 side of the glass substrate 162.

The counter substrate 151B includes a polarizing filter 161, a glass substrate 162, a light shielding film 163, color filters (153r, 153g, 153b), a counter electrode 143b constituting an electrode pair 143, and an alignment film 164.

In the counter substrate 151B, the alignment film 164, the counter electrode 143b, the color filters (153r, 153g, 153b), the glass substrate 162, and the polarizing filter 161 are arranged in this order from the liquid crystal layer 152 side. The light shielding film 163 is formed in the same layer as the color filters (153r, 153g, 153b).

The color filter 153r is a filter that transmits light having a red wavelength. The color filter 153g is a filter that transmits light having a green wavelength. The color filter 153b is a filter that transmits light having a blue wavelength. Here, the photodiode 145 is arranged at a position facing the color filter 153b.

The liquid crystal panel 140 displays an image by blocking or transmitting light emitted by a light source such as external light or a backlight 179. Specifically, the liquid crystal panel 140 changes the direction of liquid crystal molecules in the liquid crystal layer 152 by applying a voltage between the pixel electrode 143a and the counter electrode 143b, thereby blocking or transmitting the light. However, since the light cannot be completely blocked by the liquid crystal alone, a polarizing filter 161 that transmits only light having a specific polarization direction is provided.

Note that the position of the photodiode 145 is not limited to the above position, and may be provided at a position facing the color filter 153r or a position facing the color filter 153g.

Here, the operation of the optical sensor circuit 144 will be described. FIG. 5 is a diagram showing a timing chart when the optical sensor circuit 144 is operated. In FIG. 5, a voltage VINT indicates a potential at the node N in the photosensor circuit 144. A voltage VPIX is an output voltage from the sensor signal line SSj shown in FIG. 3 and is a voltage before being amplified by the amplifier 135.

Hereinafter, the description will be divided into a reset period for resetting the optical sensor circuit 144, a sensing period for sensing light using the optical sensor circuit 144, and a readout period for reading the sensing result.

First, the reset period will be described. In the reset period, the voltage applied to the reset signal line RSi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDDR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR). As described above, by applying the high-level voltage to the reset signal line RSi, a current starts to flow in the forward direction (from the anode side to the cathode side) of the photodiode 145. As a result, the voltage VINT which is the potential of the node N has a value represented by the following expression (1). In Equation (1), the forward voltage drop amount in the photodiode 145 is Vf.

VINT = VSSR + | VDDR−VSSR | −Vf (1)
Therefore, the potential of the node N is a value smaller by Vf than the voltage VDDR as shown in FIG.

Here, since the voltage VINT is not more than the threshold value for turning on the gate of the TFT 147, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change. Further, a difference corresponding to the voltage VINT occurs between the electrodes of the capacitor 146. For this reason, the capacitor 146 accumulates charges corresponding to the difference.

Next, the sensing period will be described. In the sensing period following the reset period, the voltage applied to the reset signal line RSi instantaneously switches from the high level (voltage VDDR) to the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is kept at the low level (voltage VSSR).

Thus, by changing the voltage applied to the reset signal line RSi to the low level, the potential of the node N becomes higher than the voltage of the reset signal line RSi and the voltage of the read signal line RWi. For this reason, in the photodiode 145, the voltage on the cathode side becomes higher than the voltage on the anode side. That is, the photodiode 145 is in a reverse bias state. In such a reverse bias state, when the photodiode 145 receives light from the light source, current starts to flow from the cathode side to the anode side of the photodiode 145. As a result, as shown in FIG. 5, the potential of the node N (that is, the voltage VINT) becomes lower with the passage of time.

Note that since the voltage VINT continues to decrease in this way, the gate of the TFT 147 does not turn on. Therefore, there is no output from the sensor signal line SSj. For this reason, the voltage VPIX does not change.

Next, the reading period will be described. In the readout period following the sensing period, the voltage applied to the reset signal line RSi is kept at the low level (voltage VSSR). On the other hand, the voltage applied to the read signal line RWi is instantaneously switched from the low level (voltage VSSR) to the high level (voltage VDD). Here, the voltage VDD is higher than the voltage VDDR.

As described above, by instantaneously applying a high level voltage to the read signal line RWi, the potential of the node N is raised through the capacitor 146 as shown in FIG. Note that the increase width of the potential of the node N is a value corresponding to the voltage applied to the read signal line RWi. Here, since the potential of the node N (that is, the voltage VINT) is raised to a threshold value that turns on the gate of the TFT 147, the gate of the TFT 147 is turned on.

At this time, if a constant voltage is applied in advance to the sensor signal line SDj (see FIG. 3) connected to the drain side of the TFT 147, the sensor signal line SSj connected to the source side of the TFT 147 will cause the VPIX in FIG. As shown in the graph, a voltage corresponding to the potential of the node N is output.

Here, when the amount of light received by the photodiode 145 (hereinafter referred to as the amount of received light) is small, the slope of the straight line shown in the VINT graph of FIG. 5 becomes gentle. As a result, the voltage VPIX is higher than when the amount of received light is large. As described above, the optical sensor circuit 144 changes the value of the voltage output to the sensor signal line SSj in accordance with the amount of light received by the photodiode 145.

By the way, in the above description, the operation has been described focusing on one optical sensor circuit 144 among the m × n optical sensor circuits. Below, operation | movement of each photosensor circuit in the liquid crystal panel 140 is demonstrated.

First, the optical sensor driving circuit 133 applies a predetermined voltage to all n sensor signal lines (SD1 to SDn). Next, the photosensor drive circuit 133 applies a voltage VDDR that is higher than normal to the reset signal line RS1. The other reset signal lines (RS2 to RSm) and read signal lines (RW1 to RWm) are kept in a state where a low level voltage is applied. As a result, the n photosensor circuits in the first row in FIG. 3 enter the reset period described above. Thereafter, the n photosensor circuits in the first row enter a sensing period. Further, thereafter, the n photosensor circuits in the first row enter a reading period.

Note that the timing for applying a predetermined voltage to all n sensor signal lines (SD1 to SDn) is not limited to the above timing, and may be any timing that is applied at least before the readout period. .

When the reading period of the n photosensor circuits in the first row is completed, the photosensor drive circuit 133 applies a voltage VDDR that is higher than usual to the reset signal line RS2. That is, the reset period of the n photosensor circuits in the second row starts. When the reset period ends, the n photosensor circuits in the second row enter a sensing period, and thereafter enter a reading period.

Thereafter, the above-described processing is sequentially performed on the n photosensor circuits in the third row, the n photosensor circuits in the fourth row,..., The n photosensor circuits in the m row. As a result, the sensor signal lines (SS1 to SSn) output the first row sensing result, the second row sensing result,..., The mth row sensing result in this order.

In the display device 102, sensing is performed for each row as described above, and a sensing result is output from the liquid crystal panel 140 for each row. For this reason, hereinafter, the data after the signal processing unit 183 performs the above-described data processing on the data regarding the voltage for m rows from the first row to the m-th row output from the liquid crystal panel 140, This is called “scan data”. That is, scan data refers to image data obtained by scanning a scan target (for example, a user's finger). An image displayed based on the scan data is referred to as a “scanned image”. Further, in the following, sensing is referred to as “scan”.

In the above description, the scan is performed using all m × n photosensor circuits as an example, but the present invention is not limited to this. Scanning may be performed on a partial area of the surface of the liquid crystal panel 140 using a photosensor circuit selected in advance.

In the following, it is assumed that the electronic device 100 can take either configuration. Further, switching between the components is assumed to be performed by a command sent from the main device 101 based on an input via the operation key 177 or the like. Note that when scanning is performed on a partial area on the surface of the liquid crystal panel 140, the image processing engine 180 sets a scan target area. The setting of the area may be configured to be specified by the user via the operation key 177.

As described above, when scanning is performed on a part of the surface of the liquid crystal panel 140, there are the following modes of use for displaying an image. The first is a mode in which an image is displayed in a surface area other than the partial area (hereinafter referred to as a scan area). The second is a mode in which no image is displayed in the surface area other than the scan area. Which mode is used is based on a command sent from the main apparatus 101 to the image processing engine 180.

FIG. 6 is a cross-sectional view of the liquid crystal panel 140 and the backlight 179, and shows a configuration in which the photodiode 145 receives light from the backlight 179 during scanning.

Referring to FIG. 6, when the user's finger 900 is in contact with the surface of the liquid crystal panel 140, a part of the light emitted from the backlight 179 is part of the user's finger 900 (abbreviated in the contacted area). Reflected on the plane). The photodiode 145 receives the reflected light.

Further, even in a region where the finger 900 is not in contact, a part of the light emitted from the backlight 179 is reflected by the user's finger 900. Even in this case, the photodiode 145 receives the reflected light. However, since the finger 900 is not in contact with the surface of the liquid crystal panel 140 in the region, the amount of light received by the photodiode 145 is smaller than the region in which the finger 900 is in contact. Note that the photodiode 145 cannot receive most of the light emitted from the backlight 179 that does not reach the user's finger 900.

Here, by turning on the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the amount of light reflected by the user's finger 900 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140. The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

As described above, the display device 102 can scan an image (hereinafter also referred to as a reflected image) obtained by reflecting light with the finger 900.

Note that examples of the scan object other than the finger 900 include a stylus.
By the way, in the present embodiment, a liquid crystal panel is described as an example of the display device of electronic device 100, but another panel such as an organic EL (Electro-Luminescence) panel is used instead of the liquid crystal panel. Also good.

<About data>
Next, commands exchanged between the first unit 1001 and the second unit 1002 and commands exchanged between the main device 101 and the display device 102 in the first unit 1001 will be described.

FIG. 7 is a diagram showing a schematic configuration of a command. Referring to FIG. 7, the command includes header DA01, first field DA02, second field DA03, third field DA04, fourth field DA05, fifth field DA06, and spare data area DA07. including.

FIG. 8 is a diagram for explaining a command of type “000” (that is, a sensing command). The CPU 110 sends a command of type “000” (hereinafter referred to as “first command”) from the main unit 101 of the first unit 1001 to the second unit 1002. Alternatively, the CPU 110 sends the first command from the main body device 101 to the display device 102. In the following, the case where the CPU 110 sends the first command from the main unit 101 of the first unit 1001 to the second unit 1002 will be described as an example.

The CPU 110 writes the command type (“000”), the command transmission destination, and the like in the header DA01. The CPU 110 writes the value of the timing whose number is “1” in the first field DA02. The CPU 110 writes the value of the data type with the number “2” in the second field DA03. The CPU 110 writes the value of the reading method whose number is “3” in the third field DA04. The CPU 110 writes the value of the image gradation number “4” in the fourth field DA05. The CPU 110 writes the value of the resolution with the number “5” in the fifth field DA06.

The first command in which “00” is set in the first field DA02 requests the image processing engine 280 to transmit scan data at that time. That is, the sensing first command requests transmission of scan data obtained by scanning using the optical sensor circuit of the liquid crystal panel 240 after the image processing engine 280 receives the first command. Further, the first command in which “01” is set in the first field DA02 requests transmission of scan data when the scan result is changed. Further, the first command in which “10” is set in the first field DA02 requests transmission of scan data at regular intervals.

The first command in which “001” is set in the second field DA03 requests transmission of the coordinate value of the center coordinate in the partial image. In addition, the first command in which “010” is set in the second field DA03 requests transmission of only the partial image whose scan result has changed. Note that the change in the scan result indicates that the previous scan result is different from the current scan result. Furthermore, the first command in which “100” is set in the second field DA03 requests transmission of the entire image.

Here, the “whole image” is an image generated by the image processing engine 280 based on the voltage output from each optical sensor circuit when scanning using m × n optical sensor circuits. . The “partial image” is a part of the entire image. The reason why the partial image is requested to transmit only the partial image whose scan result has changed will be described later.

Note that the coordinate value and the partial image or the entire image may be requested at the same time. Further, in the case of a configuration in which a partial area on the surface of the liquid crystal panel 240 is scanned, the entire image is an image corresponding to the area to be scanned.

The first sensing command in which “00” is set in the third field DA04 requests that the backlight 279 be turned on to scan. In addition, the first command in which “01” is set in the third field DA04 requests that the backlight 279 be turned off to perform scanning. Note that the configuration for scanning with the backlight 279 off is described later (FIG. 17). Furthermore, the first command in which “10” is set in the third field DA04 requests scanning using both reflection and transmission. Note that using both reflection and transmission refers to scanning the scanning object by switching between a method of scanning with the backlight 279 turned on and a method of scanning with the backlight turned off.

The first command in which “00” is set in the fourth field DA05 requests black and white binary image data. Further, the first command in which “01” is set in the fourth field DA05 requests multi-gradation image data. Further, the first command in which “10” is set in the fourth field DA05 requests RGB color image data.

The first command in which “0” is set in the fifth field DA06 requests image data with high resolution. The first command in which “1” is set in the fifth field DA06 requests image data with a low resolution.

In addition to the data shown in FIG. 8, the first command includes designation of a region to be scanned (region of pixels driving the optical sensor circuit 144), timing for scanning, timing for lighting the backlight 179, and the like. Is described.

Note that the image processing engine 280 analyzes the content of the first command, and sends back data (that is, response data) according to the result of the analysis to the main unit 101.

FIG. 9 is a diagram for explaining a command of type “001” (hereinafter referred to as “second command”). The CPU 110 sends a second command from the main unit 101 of the first unit 1001 to the second unit 1002.

The CPU 110 writes the command type (“001”), the command transmission destination, and the like in the header DA01. The CPU 110 writes the value of the display request with the number “1” in the first field DA02. CPU 110 writes information on the number / type of number “2” in second field DA03. The CPU 110 writes the value of the display range whose number is “3” in the third field DA04. The CPU 110 writes information related to the image data with the number “4” in the fourth field DA05.

The second command in which “001” is set in the first field DA02 requests the image processing engine 280 to display an image on the liquid crystal panel 240 (sub-screen). The second command in which “010” is set in the first field DA02 requests the image processing engine 280 to display an icon on the liquid crystal panel 240. Further, the second command in which “011” is set in the first field DA02 requests the image processing engine 280 to display the handwriting area on the liquid crystal panel 240.

The second field DA03 stores the number of images to be displayed on the liquid crystal panel 240 and a number for designating the type of handwriting language. The image processing engine 280 performs processing according to the number of images or the type of language.

The second command in which “01” is set in the third field DA04 requests the image processing engine 280 to designate the display range on the liquid crystal panel 240 by coordinates. Further, the second command in which “10” is set in the third field DA04 requests the image processing engine 280 to set the display range on the liquid crystal panel 240 to the entire display area.

The fourth field DA05 stores image data to be displayed on the liquid crystal panel 240 and position information for displaying the image data. The image processing engine 280 performs processing for displaying the image data at a position specified by the position information.

FIG. 10 is a diagram for explaining a command of type “010” (hereinafter referred to as “third command”). The CPU 110 sends the third command from the main unit 101 of the first unit 1001 to the second unit 1002. Alternatively, the CPU 210 sends a third command from the main body device 104 of the second unit 1002 to the first unit 1001.

The CPUs 110 and 210 write the command type (“010”), the command transmission destination, and the like in the header DA01. The CPUs 110 and 210 write the value of the OS (Operating System) processing request with the number “1” in the first field DA02. The CPUs 110 and 210 write the value of the OS information with the number “2” in the second field DA03.

The third command in which “01” or “10” is set in the first field DA02 is transmitted from the second unit 1002 to the first unit 1001.

The third command in which “01” is set in the first field DA02 requests the first unit 1001 to transmit information indicating the type of OS of the first unit 1001 (main device). The third command in which “10” is set in the first field DA02 requests the first unit 1001 to start the OS specified by the OS information.

The third command in which “000”, “001”, or “010” is set in the second field DA03 is transmitted from the second unit 1002 to the first unit 1001.

The third command in which “000” is set in the second field DA03 does not request the activation of the OS in the first unit 1001. The third command in which “001” is set in the second field DA03 indicates that the second unit 1002 has selected to start the first OS. Furthermore, the third command in which “010” is set in the second field DA03 indicates that the second unit 1002 has selected to start the second OS.

FIG. 11 is a diagram for explaining a command of type “011” (hereinafter referred to as “fourth command”). The CPU 210 sends a fourth command from the main body device 104 of the second unit 1002 to the first unit 1001.

The CPU 210 writes the command type (“011”), the command transmission destination, and the like in the header DA01. The CPU 210 writes information related to the activated application with the number “1” in the first field DA02. The CPU 210 writes the startup information with the number “2” in the second field DA03.

In the first field DA02, information specifying an application to be activated in the first unit 1001 is stored. The second field DA03 stores information used at the time of activation setting and information used after activation.

FIG. 12 is a diagram for explaining a command of type “100” (hereinafter referred to as “fifth command”). The CPU 210 sends the fifth command from the main body device 104 of the second unit 1002 to the first unit 1001.

The CPU 210 writes the command type (“100”), the command transmission destination, and the like in the header DA01. The CPU 210 writes information related to the reception request with the number “1” in the first field DA02. The CPU 210 writes information relating to the number “2” in the second field DA03. The CPU 210 writes information related to the file with the number “3” in the third field DA04.

The fifth command in which “01” is set in the first field DA02 requests the first unit 1001 to receive a file. In the second field DA03, the number of files transmitted from the second unit 1002 to the first unit 1001 is stored. Further, a file transmitted from the second unit 1002 to the first unit 1001 is stored in the third field DA04.

FIG. 13 is a diagram for explaining a command of type “101” (hereinafter referred to as “sixth command”). The CPU 110 sends the sixth command from the main unit 101 of the first unit 1001 to the second unit 1002. Alternatively, the CPU 210 sends the sixth command from the main body device 104 of the second unit 1002 to the first unit 1001.

The CPUs 110 and 210 write the command type (“101”), the command transmission destination, and the like in the header DA01. The CPUs 110 and 210 write the value of the communication type with the number “1” in the first field DA02. The CPUs 110 and 210 write the value of the connection destination with the number “2” in the second field DA03. The CPUs 110 and 210 write the value of the transfer destination with the number “3” in the third field DA04. The CPUs 110 and 210 write the value of the signal strength acquisition timing number “4” in the fourth field DA05.

The sixth command in which “001” is set in the first field DA02 requests the counterpart device to perform infrared communication. The sixth command in which “010” is set in the first field DA02 requests the counterpart device to perform wireless communication by Bluetooth (registered trademark). Furthermore, the sixth command in which “011” is set in the first field DA02 requests the counterpart device to perform LAN communication.

The sixth command in which “000” is set in the second field DA03 indicates that it does not have information specifying the communication connection destination.

In addition, the sixth command in which “001” is set in the second field DA03 is transmitted by the first unit 1001 to the device to which the first unit 1001 is connected. Such a sixth command requests transmission of information related to a device to which the first unit 1001 is connected.

Furthermore, the sixth command in which “010” is set in the second field DA03 is transmitted by the second unit 1002 to the first unit 1001 to which the second unit 1002 is connected. Such a sixth command requests transmission of information regarding the first unit 1001 to which the second unit 1002 is connected.

The sixth command in which “011” is set in the second field DA03 is transmitted by the second unit 1002 to the first unit 1001 to which the second unit 1002 is connected. Such a sixth command requests that information regarding the second unit 1002 be set as connection destination device information.

Further, the sixth command in which “100” is set in the second field DA03 is transmitted by the first unit 1001 to the device to which the first unit 1001 is connected (for example, the second unit 1002). Such a sixth command requests that information regarding the first unit 1001 be set as connection destination device information.

The sixth command in which “000” is set in the third field DA04 indicates that it does not have information specifying the transfer destination of data (for example, a file).

The sixth command in which “001” is set in the third field DA04 is transmitted by the first unit 1001 to the data transfer destination device. Such a sixth command requests transmission of information relating to the data transfer destination device.

Furthermore, the sixth command in which “010” is set in the third field DA04 is transmitted by the second unit 1002 to the first unit 1001 that is the data transfer destination. Such a sixth command requests transmission of information related to the first unit 1001 of the data transfer destination.

Further, the sixth command in which “011” is set in the third field DA04 is transmitted by the second unit 1002 to the first unit 1001 that is the data transfer destination. Such a sixth command requests that information regarding the second unit 1002 be set as device information of the data transfer source.

Further, the sixth command in which “100” is set in the third field DA04 is transmitted by the first unit 1001 to the data transfer destination device (for example, the second unit 1002). Such a sixth command requests that information regarding the first unit 1001 be set as device information of the data transfer source.

The sixth command in which “00”, “01”, “10”, or “11” is set in the fourth field DA05 is transmitted by the first unit 1001 to the second unit 1002.

The sixth command in which “00” is set in the fourth field DA05 does not request the second unit 1002 to transmit data indicating the signal strength. Also, the sixth command in which “01” is set in the fourth field DA05 requests the signal strength detection unit 297 to transmit data indicating the signal strength at that time. Furthermore, the sixth command in which “10” is set in the fourth field DA05 requests transmission of data indicating the signal strength when the signal strength is changed. Further, the sixth command in which “11” is set in the fourth field DA05 requests the transmission of data indicating the signal strength at regular intervals.

FIG. 14 is a diagram showing a schematic configuration of response data. The response data is data corresponding to the content of the first command (sensing command).

When the first command is transmitted from the main device 101 to the second unit 1002, the CPU 210 transmits response data from the display device 103 to the first unit 1001. When the first command is transmitted from the main device 101 to the display device 102 of the first unit 1001, the image processing engine 180 transmits response data from the image processing engine 180 to the main device 101. Hereinafter, a case where the first command is transmitted from the main device 101 to the second unit 1002 will be described as an example.

Referring to FIG. 14, the response data includes a header data area DA11, a coordinate data area DA12, a time data area DA13, and an image data area DA14. Here, the value of the center coordinates of the partial image is written in the data area DA12 indicating the coordinates. The time information acquired from the timer 282 of the image processing engine 280 is written in the data area indicating the time. Further, image data (that is, scan data) after being processed by the image processing engine 280 is written in the data area indicating the image.

FIG. 15 is a diagram showing an image obtained by scanning the finger 900 (that is, a scanned image). Referring to FIG. 15, an image of a region W1 surrounded by a thick solid line is an entire image, and an image of a region P1 surrounded by a broken line is a partial image. The center point C1 of the cross indicated by a thick line is the center coordinate.

In the present embodiment, a pixel (that is, a predetermined gradation or a pixel having a photosensor circuit which is a rectangular region and whose output voltage from the sensor signal line SSj is equal to or higher than a predetermined value). An area including all of the pixels having a luminance equal to or higher than a predetermined luminance is set as a partial image area.

Also, the center coordinates are coordinates determined in consideration of the gradation of each pixel in the partial image area. Specifically, for each pixel in the partial image, the center coordinates are determined by performing weighting processing based on the gradation of the pixel and the distance between the pixel and the rectangular center point (that is, the centroid). Is done. That is, the center coordinates do not necessarily match the centroid of the partial image.

However, the position of the center coordinates is not necessarily limited to the above, and the center coordinates may be the coordinates of the centroid or the coordinates near the centroid.

When “001” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the central coordinate in the data area DA12 indicating the coordinate. In this case, the image processing engine 280 does not write image data in the data area DA14 indicating an image. After writing the value of the center coordinate, the image processing engine 280 sends response data including the value of the center coordinate to the main body device 104. The main device 104 sends response data including the value of the center coordinate to the main device 101 of the first unit 1001. As described above, when “001” is set in the data area indicating the data type, the first command does not request output of the image data but requests output of the value of the center coordinate.

When “010” is set in the data area indicating the data type of the first command, the image processing engine 280 stores the image data of the partial image whose scan result has changed in the data area DA14 indicating the image. Write. In this case, the image processing engine 280 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. The image processing engine 280 writes the image data of the partial image whose scan result has changed, and then sends response data including the image data of the partial image to the main body device 104. The main device 104 sends response data including image data of the partial image to the main device 101 of the first unit 1001. Thus, when “010” is set in the data area indicating the data type, the first command does not request the output of the value of the center coordinate, and the image data of the partial image whose scan result has changed. Request output.

As described above, the reason for requesting transmission of only the partial image whose scan result has changed is that the scan data of the partial image area of the scan data is more important than the scan data of the other area. This is because the data is high, and the scan data in the region corresponding to the region of the partial image in the scan data is likely to change due to the contact state with the scan object such as the finger 900.

When “011” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the center coordinate in the data area DA12 indicating the coordinate and also indicates the data indicating the image. The image data of the partial image whose scan result has changed is written in the area DA14. Thereafter, the image processing engine 280 sends response data including the value of the center coordinate and the image data of the partial image to the main body device 104. The main device 104 sends response data including the value of the center coordinate and the image data of the partial image to the main device 101 of the first unit 1001. Thus, when “011” is set in the data area indicating the data type, the first command outputs the value of the center coordinate and the output of the image data of the partial image whose scan result has changed. Request.

Further, when “100” is set in the data area indicating the data type of the first command, the image processing engine 280 displays the entire image in the data area DA14 indicating the image of the response data shown in FIG. Write image data. In this case, the image processing engine 280 does not write the value of the center coordinate in the data area DA12 indicating the coordinate. The image processing engine 280 writes the image data of the entire image, and then sends response data including the image data of the entire image to the main body device 104. The main device 104 sends response data including image data of the entire image to the main device 101 of the first unit 1001. As described above, when “100” is set in the data area indicating the data type, the first command requests the output of the image data of the entire image without requesting the output of the center coordinate value. .

When “101” is set in the data area indicating the data type of the first command, the image processing engine 280 writes the value of the central coordinate in the data area DA12 indicating the coordinate and the data indicating the image. The image data of the entire image is written in the area DA14. Thereafter, the image processing engine 280 sends response data including the value of the center coordinate and the image data of the entire image to the main body device 104. The main device 104 sends response data including the value of the center coordinate and the image data of the entire image to the main device 101 of the first unit 1001. Thus, when “101” is set in the data area indicating the data type, the first command requests the output of the value of the center coordinate and the output of the image data of the entire image.

<Regarding First Modification of Configuration>
By the way, the structure of the liquid crystal panel 140 is not limited to the structure shown in FIG. Hereinafter, a liquid crystal panel having a mode different from that in FIG. 3 will be described.

FIG. 16 is a circuit diagram of the photosensor built-in liquid crystal panel 140A according to the different embodiment. Referring to FIG. 16, photosensor built-in liquid crystal panel 140A (hereinafter referred to as liquid crystal panel 140A) includes three photosensor circuits (144r, 144g, 144b) in one pixel. Thus, the liquid crystal panel 140A is different from the liquid crystal panel 140 including one photosensor circuit in one pixel in that the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, and 144b) in one pixel. The configuration of the optical sensor circuit 144 is the same as that of each of the three optical sensor circuits (144r, 144g, 144b).

In addition, the three photodiodes (145r, 145g, 145b) in one pixel are arranged at positions facing the color filter 153r, the color filter 153g, and the color filter 153b, respectively. Therefore, the photodiode 145r receives red light, the photodiode 145g receives green light, and the photodiode 145b receives blue light.

In addition, since the liquid crystal panel 140 includes only one photosensor circuit 144 in one pixel, two data signal lines for the TFT 147 disposed in one pixel are a sensor signal line SSj and a sensor signal line SDj. Met. However, since the liquid crystal panel 140A includes three photosensor circuits (144r, 144g, 144b) in one pixel, there are six data signal lines for TFTs (147r, 147g, 147b) arranged in one pixel. It becomes.

Specifically, the sensor signal line SSRj and the sensor signal line SDRj are arranged corresponding to the TFT 147r connected to the cathode of the photodiode 145r arranged at a position facing the color filter 153r. A sensor signal line SSGj and a sensor signal line SDGj are arranged corresponding to the TFT 147g connected to the cathode of the photodiode 145g arranged at a position facing the color filter 153g. Further, a sensor signal line SSBj and a sensor signal line SDBj are disposed corresponding to the TFT 147b connected to the cathode of the photodiode 145b disposed at a position facing the color filter 153b.

In such a liquid crystal panel 140A, the white light emitted from the backlight 179 passes through the three color filters (153r, 153g, 153b), and red, green, and blue are displayed on the surface of the liquid crystal panel 140A. It mixes and becomes white light. Here, when white light is reflected by the scan object, a part of the white light is absorbed by the pigment on the surface of the scan object, and a part is reflected. And the reflected light permeate | transmits three color filters (153r, 153g, 153b) again.

At this time, the color filter 153r transmits light having a red wavelength, and the photodiode 145r receives light having the red wavelength. The color filter 153g transmits light having a green wavelength, and the photodiode 145g receives light having the green wavelength. The color filter 153b transmits light having a blue wavelength, and the photodiode 145b receives light having the blue wavelength. That is, the light reflected by the scan object is separated into three primary colors (R, G, B) by three color filters (153r, 153g, 153b), and each photodiode (145r, 145g, 145b) The light of the color corresponding to is received.

When a part of white light is absorbed by the pigment on the surface of the scan target, the amount of light received by each photodiode (145r, 145g, 145b) is different for each photodiode (145r, 145g, 145b). For this reason, the output voltages of the sensor signal line SSRj, the sensor signal line SSGj, and the sensor signal line SSBj are different from each other.

Therefore, the image processing engine 180 determines the R gradation, the G gradation, and the B gradation according to each output voltage, so that the image processing engine 180 sends the RGB color image to the main body device 101. Can send.

As described above, when the electronic apparatus 100 includes the liquid crystal panel 140A, the scan object can be scanned in color.

Next, a scanning method different from the above-described scanning method (that is, the method of scanning the reflected image in FIG. 6) will be described with reference to FIG.

FIG. 17 is a cross-sectional view showing a configuration in which a photodiode receives external light during scanning. As shown in the figure, part of the external light is blocked by the finger 900. Therefore, the photodiode disposed under the surface region of the liquid crystal panel 140 that is in contact with the finger 900 can hardly receive external light. In addition, although the photodiodes disposed under the surface area where the shadow of the finger 900 is formed can receive a certain amount of external light, the amount of external light received is small compared to the surface area where no shadow is formed.

Here, by turning off the backlight 179 at least during the sensing period, the optical sensor circuit 144 can output a voltage corresponding to the position of the finger 900 with respect to the surface of the liquid crystal panel 140 from the sensor signal line SSj. it can. In this manner, by controlling the backlight 179 to be turned on and off, the liquid crystal panel 140 has a contact position of the finger 900, a range in which the finger 900 is in contact (determined by the pressing force of the finger 900), and the liquid crystal panel 140. The voltage output from the sensor signal lines (SS1 to SSn) varies depending on the direction of the finger 900 with respect to the surface of the sensor.

As described above, the display device 102 can scan an image (hereinafter also referred to as a shadow image) obtained by blocking external light by the finger 900.

Furthermore, the display device 102 may be configured to perform scanning by turning on the backlight 179 and then performing scanning again by turning off the backlight 179. Alternatively, the display device 102 may be configured to perform scanning by turning off the backlight 179 and then performing scanning again by turning on the backlight 179.

In this case, since two scanning methods are used together, two scan data can be obtained. Therefore, it is possible to obtain a highly accurate result as compared with the case of scanning using only one scanning method.

<About display devices>
The operation of the display device 103 is controlled in accordance with a command (for example, a first command) from the main body device 101 as in the operation of the display device 102. The display device 103 has the same configuration as the display device 102. Therefore, when the display device 103 receives the same command as the display device 102 from the main body device 101, the display device 103 performs the same operation as the display device 102. For this reason, description of the configuration and operation of the display device 103 will not be repeated.

Note that the main device 101 can send commands having different commands to the display device 102 and the display device 103. In this case, the display device 102 and the display device 103 perform different operations. Further, the main device 101 may send a command to either the display device 102 or the display device 103. In this case, only one display device performs an operation according to the command. Further, the main device 101 may send a command having the same command to the display device 102 and the display device 103. In this case, the display device 102 and the display device 103 perform the same operation.

Note that the size of the liquid crystal panel 140 of the display device 102 and the size of the liquid crystal panel 240 of the display device 103 may be the same or different. Further, the resolution of the liquid crystal panel 140 and the resolution of the liquid crystal panel 240 may be the same or different.

<About Second Modification of Configuration>
In the present embodiment, a configuration in which electronic device 100 includes a liquid crystal panel with a built-in optical sensor such as liquid crystal panel 140 and liquid crystal panel 240 will be described. However, only one liquid crystal panel has a built-in photosensor. It may be.

FIG. 18 is a block diagram illustrating a hardware configuration of the electronic device 1300. Similar to the electronic device 100, the electronic device 1300 includes a first housing 100A and a second housing 100B. Referring to FIG. 18, electronic device 1300 includes a first unit 1001A and a second unit 1002. The first unit 1001A includes a main body device 101 and a display device 102A. The second unit 1002 includes a main device 104 and a display device 103.

The display device 102A includes a liquid crystal panel that does not incorporate a photosensor (that is, a liquid crystal panel having only a display function). The electronic device 1300 is different from the electronic device 100 in which the first unit 1001A includes a liquid crystal panel that does not include a photosensor, and the first unit 1001 includes a liquid crystal panel 240 that includes a photosensor. Such an electronic device 1300 performs the above-described sensing using the display device 103 of the second unit 1002.

Further, the first unit 1001 may be provided with, for example, a resistive film type or capacitive type touch panel instead of the liquid crystal panel 140 incorporating the optical sensor.

In this embodiment, the display device 102 includes the timer 182 and the display device 103 includes the timer 282. However, the display device 102 and the display device 103 may share one timer. .

In this embodiment, the electronic device 100 is described as a foldable device, but the electronic device 100 is not necessarily limited to the foldable device. For example, the electronic device 100 may be a sliding device configured such that the first housing 100A slides with respect to the second housing 100B.

Since the electronic device 100 according to the present embodiment is configured as described above, the second unit 1002 is detachable from the first unit 1001 via the USB connectors 194 and 294.

And the electronic device 100 which concerns on this Embodiment can exhibit the following functions, for example at the time of power activation. First, when the user depresses the power switch 191 of the first unit 1001, the first unit 1001 activates a BIOS (Basic Input / Output System) by using power from the power supply circuit 192.

The second unit 1002 acquires power from the first unit 1001 via the USB connectors 194 and 294. The second unit 1002 can transmit and receive data to and from the first unit 1001 by using the power. At this time, the CPU 210 of the second unit 1002 can display the OS type in a selectable manner on the liquid crystal panel 240 by using the power from the USB connectors 194 and 294.

The user selects an OS to be started up via the liquid crystal panel 240. The CPU 210 transmits a command (for example, a “first OS” command shown in FIG. 10) specifying the OS to be activated to the first unit 1001 via the USB connectors 194 and 294 according to the user's selection. . The first unit 1001 starts the OS in response to the command.

Further, for example, the second unit 1002 transmits and receives data to and from an external mobile phone or the like via the antenna 295. The CPU 210 of the second unit 1002 acquires photographic image data and corresponding thumbnail data from an external mobile phone via the antenna 295, and stores the photographic image data and corresponding thumbnail data in the RAM 271 or the like. The CPU 210 reads the thumbnail data from the RAM 271 and causes the liquid crystal panel 240 to display a thumbnail image of the photo in a selectable manner.

Then, the CPU 210 causes the liquid crystal panel 240 to display a photographic image in response to an external selection command. Alternatively, the CPU 210 displays a photographic image on the liquid crystal panel 140 or the display device 102A via the USB connector 294.

<< First Specific Realization Example >>
<Functional configuration>
FIG. 19 is a block diagram showing a functional configuration of the communication system 1 according to the present embodiment. Hereinafter, a functional configuration of the communication system 1 will be described with reference to FIG. As described above, the communication system 1 includes the electronic devices 100, 100 #, 10, and 20.

(Electronic device 100, 100 #)
As described above, the electronic apparatus 100 includes the first unit 1001 and the second unit 1002.

The first unit 1001 includes an input unit 310, a display unit 320, a storage unit 330, an external communication unit 174, an internal interface (I / F) unit 340, and a control unit 350.

The input unit 310 receives an instruction from the outside. In the present embodiment, the operation key 177 functions as the input unit 310. In addition, the liquid crystal panel 140 with a built-in optical sensor also functions as the input unit 310.

The display unit 320 outputs information inside the first unit 1001 to the outside. In the present embodiment, the liquid crystal panel 140 functions as the display unit 320. However, as the display unit 320, another display device, for example, a display such as an LCD (Liquid Crystal Display) may be used.

The storage unit 330 stores information such as display data 332. In addition, the storage unit 330 stores a program for the operation of the first unit 1001 and the like.

External communication unit 174 exchanges information with other electronic devices. Since external communication unit 174 has already been described, detailed description thereof will not be repeated.

The internal I / F unit 340 exchanges information with the internal I / F unit 440 on the second unit 1002 side. In the present embodiment, when the first unit 1001 and the second unit 1002 are directly connected, the USB connector 194 functions as the internal I / F unit 340. When the first unit 1001 and the second unit 1002 are not directly connected, the antenna 195 functions as the internal I / F unit 340. However, the method of exchanging information by the internal I / F unit 340 is not limited to this.

The control unit 350 controls operations of the display unit 320, the storage unit 330, the external communication unit 174, and the internal I / F unit 340 based on an instruction received by the input unit 310 and the like.

The control unit 350 includes a display control unit 352 and an attached data creation unit 354. The display control unit 352 causes the display unit 320 to display an image based on the display data 332. The attached data creation unit 354 creates attached data in accordance with an instruction received by the input unit 310 or the like. Details of the attached data will be described later. The attached data creation unit 354 controls the internal I / F unit 340 and sends the attached data to the second unit 1002.

The second unit 1002 includes an input unit 410, a display unit 420, a storage unit 430, an external communication unit 274, an internal I / F unit 440, and a control unit 450.

The input unit 410 receives an instruction from the outside. The display unit 420 displays information inside the second unit 1002 to the outside. In the present embodiment, the optical sensor built-in liquid crystal panel 240 and the backlight 279 serve as the input unit 410 and the display unit 420. However, another display device, for example, a combination of a display such as an LCD (Liquid Crystal Display) and an input device capable of multipoint input can be used instead of the optical sensor built-in liquid crystal panel 240. The optical sensor built-in liquid crystal panel 240 is an example of a display-integrated tablet.

The storage unit 430 stores information such as display data 432 displayed on the optical sensor built-in liquid crystal panel 240 and attached data 434 created by the attached data creating unit 354. The display data 432 includes an input pattern 433 corresponding to the input received by the optical sensor built-in liquid crystal panel 240. The input pattern 433 includes, for example, user handwritten characters and handwritten graphics.

The external communication unit 274 exchanges information with other electronic devices. Since external communication unit 274 has already been described, detailed description thereof will not be repeated.

The internal I / F unit 440 exchanges information with the internal I / F unit 340 on the first unit 1001 side. In the present embodiment, when the first unit 1001 and the second unit 1002 are directly connected, the USB connector 294 functions as the internal I / F unit 440. When the first unit 1001 and the second unit 1002 are not directly connected, the antenna 295 functions as the internal I / F unit 440. However, the method of exchanging information by the internal I / F unit 440 is not limited to this.

The control unit 450 controls operations of the display unit 420, the storage unit 430, the external communication unit 274, and the internal I / F unit 440 based on an instruction received by the input unit 410 and the like. The control unit 450 includes a display control unit 452 and a transfer control unit 454.

The display control unit 452 controls the liquid crystal panel 240 and the backlight 279, and displays an image based on the display data 432 on the liquid crystal panel 240.

The transfer control unit 454 creates a command including the input pattern 433 and the attached data 434. The transfer control unit 454 controls the external communication unit 274 and transmits the created command to other electronic devices (electronic devices 100 #, 10, 20). Here, the transfer control unit 454 may transmit the command to another electronic device by controlling the external communication unit 174 on the first unit 1001 side instead of the external communication unit 274.

Since the functional configuration of electronic device 100 # is similar to that of electronic device 100, it will not be repeated. In FIG. 19 and the following description, it is assumed that each part of the electronic device 100 # corresponding to each part of the electronic device 100 has “#” appended to the name of each part of the electronic device 100.

(Electronic device 10)
Electronic device 10 includes an input unit 510, a display unit 520, a storage unit 530, a communication unit 540, and a control unit 550.

The input unit 510 receives an instruction from the outside. The display unit 520 displays information inside the electronic device 10 to the outside. In the present embodiment, the optical sensor built-in liquid crystal panel 12 functions as the input unit 510 and the display unit 520. However, the optical sensor built-in liquid crystal panel 240 is an example of a display-integrated tablet, and a display-integrated tablet having a configuration different from that of the optical sensor-embedded liquid crystal panel 240 may be used. In addition, a part of the function of the input unit 510 may be realized by another input device such as an input key provided in the electronic apparatus 10.

The storage unit 530 stores information such as display data 532 displayed on the optical sensor built-in liquid crystal panel 12. The display data 532 includes an input pattern 533 corresponding to the input received by the optical sensor built-in liquid crystal panel 12.

The communication unit 540 exchanges information with other electronic devices. The communication unit 540 communicates with other electronic devices using wireless communication in accordance with standards such as Bluetooth (registered trademark) and IrDA (Infrared Data Association), for example.

The control unit 550 controls operations of the display unit 520, the storage unit 530, and the communication unit 540 based on the instruction received by the input unit 510 and the like. The control unit 550 includes a display control unit 552 and a retransfer control unit 554. The display control unit 552 controls the liquid crystal panel 12 with a built-in optical sensor and displays an image based on the display data 532 on the liquid crystal panel 12 with a built-in optical sensor. The transfer control unit 454 controls the communication unit 540 based on the command from the electronic device 100 and transmits a command including the attached data 434 included in the command to the electronic device 20. Details of the operation of the transfer control unit 454 will be described later.

(Electronic device 20)
The electronic device 20 includes an input unit 610, a display unit 620, a storage unit 630, a communication unit 640, and a control unit 650.

The input unit 610 receives an instruction from the outside. A part of the function of the input unit 610 is realized by an input device such as an input key or a touch pad provided in the electronic device 20. The display unit 620 displays information inside the electronic device 10 to the outside. In the present embodiment, the monitor 22 functions as the display unit 520.

The storage unit 630 stores information such as display data to be displayed on the monitor 22.
The communication unit 640 exchanges information with other electronic devices. The communication unit 540 communicates with other electronic devices using, for example, wireless communication in accordance with standards such as Bluetooth (registered trademark) and IrDA. It is assumed that the communication standards used by each electronic device in the system are unified.

The control unit 650 controls operations of the display unit 620, the storage unit 630, and the communication unit 640 based on an instruction received by the input unit 610. Control unit 650 includes a display control unit 652. The display control unit 652 controls the monitor 22 and displays an image based on the display data on the monitor 22.

In addition, each electronic device included in the communication system 1 according to the present embodiment can directly transmit and receive data via a network by using an IP address assigned to itself. . That is, the electronic devices 100, 100 #, 10, 20 included in the communication system 1 according to the present embodiment can constitute a so-called P2P (Pear to Pear) type network.

<Operation (Part 1): Chat between electronic devices with two screens>
With reference to FIG. 20, the handwritten chat using the electronic device 100 and the electronic device 100 # will be described. FIG. 20 is a diagram for explaining operations of the electronic device 100 and the electronic device 100 #.

FIG. 20 (A) is a diagram showing a display screen of electronic device 100 and electronic device 100 # before electronic device 100 transfers data to electronic device 100 #. Referring to FIG. 20A, liquid crystal panel 240 of electronic device 100 displays an image of a personal computer and an input pattern (in the figure, this ↓) input to liquid crystal panel 240. The liquid crystal panel 140 displays an image different from the image displayed on the liquid crystal panel 240. Here, it is assumed that the image on the liquid crystal panel 140 is a web page including detailed data regarding the personal computer displayed on the liquid crystal panel 240.

On the other hand, the liquid crystal panel 240 # of the electronic device 100 # displays a personal computer image that is the same as the image displayed on the liquid crystal panel 240. However, liquid crystal panel 240 # does not display the input pattern input to liquid crystal panel 240 of electronic device 100. Liquid crystal panel 140 # is not displaying an image at this point.

Based on an instruction to input unit 310 or input unit 410, electronic device 100 transmits a command including input pattern 433 and attached data 434 to electronic device 100 # via external communication unit 174 or external communication unit 274. To do. Details of the command will be described later.

Here, it is assumed that the attached data 434 is a URL (Uniform Resource Locator) of a web page displayed on the liquid crystal panel 140 when the attached data creating unit 354 receives an instruction to create attached data. That is, when the attached data creation unit 354 receives an attachment data creation instruction, the attached data creation unit 354 reads the URL of the web page displayed from the storage unit 330 and sets the read URL as the attached data 434.

Note that the attached data 434 is not limited to the URL of the web page. More generally, the attached data 434 may be a link to a display screen. For example, the attached data 434 may be an address on a data server accessible by each electronic device.

Alternatively, the attached data creation unit 354 may use a file (for example, image data or document data) being displayed on the liquid crystal panel 140 as the attached data 434. Alternatively, the attached data creation unit 354 may use the display data 432 itself that is the basis of the display screen as the attached data 434. However, when there is a link to the display screen, it is preferable that the link is attached data 434 because the amount of transfer data can be reduced.

FIG. 20B is a diagram showing a display screen of electronic device 100 and electronic device 100 # after electronic device 100 transfers data to electronic device 100 #. Referring to FIG. 20B, the display screen of electronic device 100 does not change before and after data transfer.

On the other hand, when receiving a command from electronic device 100, display control unit 452 of electronic device 100 # causes liquid crystal panel 240 # to display a display corresponding to input pattern 433 included in the command. In addition, when receiving a command from electronic device 100, display control unit 352 # displays a screen corresponding to attached data 434 on liquid crystal panel 140 #.

Here, in response to attachment data 434 being a URL, control unit 350 # activates the browser. The browser creates web page display data corresponding to the URL. Display control unit 352 # causes liquid crystal panel 140 # to display a screen based on the generated display data. If attached data 434 is a file, control unit 350 # activates an application corresponding to the file format. The application creates display data. When the attached data 434 # is the display data 432 itself, the display control unit 352 # displays a screen based on the display data 432 on the display panel 140 #.

Thus, electronic device 100 and electronic device 100 # share image data for handwritten chat by means of liquid crystal panels 240 and 240 #. In addition, electronic device 100 # displays a screen corresponding to attached data 434 on liquid crystal panel 140 # in accordance with a command from electronic device 100. Therefore, according to the communication system 1 according to the present embodiment, it is possible to smoothly share the attached data without making it difficult to see the screen for handwritten chat.

In particular, since the electronic device 100 creates data related to the display screen of the liquid crystal panel 140 as the attached data 434, the user of the electronic device 100 can check the content of the attached data 434 on the liquid crystal panel 140. That is, the user can confirm the content of the attached data 434 without changing the display on the liquid crystal panel 240. Therefore, according to this system 1, the user can create attachment data without interrupting the flow of handwritten chat.

In the above, an example in which data related to the display screen of the attached data creation unit 354 is created as the attached data 434 has been shown. As another example of the operation of the attached data creation unit 354, the attached data creation unit 354 may use the image data acquired by the liquid crystal panel 140 by the optical sensor as the attached data 434. In this case, the user causes the liquid crystal panel 140 to read a document or photograph at hand close to the liquid crystal panel 140. In this way, the user can transfer documents and photos to electronic device 100 #.

(command)
From here, the command which the electronic device 100 produces is demonstrated. The command requests each electronic device in the communication system 1 to execute a predetermined operation. The command is described in a predetermined standard, and each electronic device performs a predetermined operation according to the command when receiving the command.

More specifically, referring to FIG. 21, the command includes a header DA110, input pattern data DA120, and attached data DA130. The command requests the electronic device that is the destination of the command to display the input pattern corresponding to the input pattern data DA120 on the display-integrated tablet and to reproduce the attached data DA130 on a monitor different from the display-integrated tablet. .

The command indicates that the input pattern is displayed on the display-integrated tablet of the device, and the attached data DA130 is reproduced on the monitor of the device, such as the electronic device 100 #, which includes the display-integrated tablet and the monitor. Request that. That is, as described in the above operation example, when a device including a display-integrated tablet and a monitor receives a command, the device displays an input pattern on the display-integrated tablet and displays an image corresponding to the attached data on the monitor. To do.

The command format according to this embodiment will be described with reference to FIG. In FIG. 22, the header DA110 is omitted and only the input pattern data DA120 and the attached data DA130 are shown. However, the command format is not limited to that shown here. The command may be described in a standard common to each electronic device in the communication system 1.

As shown in FIG. 22, the input pattern data DA120 includes a plurality of data representing input patterns to the liquid crystal panel, that is, line (START, END, COLOR). This data connects the START coordinates and the END coordinates, and corresponds to a line segment having a color specified by COLOR. Line (p, q, R) in FIG. 22 represents a red line segment from coordinates p to coordinates q. line (r, s, B) represents a blue line segment from the coordinate r to the coordinate s.

The transfer control unit 454 adds data representing an input pattern to the input pattern data DA120 each time a pattern is input by chat exchange or the like. Transfer control unit 454 adds data representing a new input pattern to the bottom of input pattern data DA120.

Attachment data DA130 includes an attach (URL; [character string representing URL]) representing attachment of a URL and a File (data) representing attachment of a file. The electronic device that has received the command performs an operation according to the type of attached data. That is, the electronic device activates a browser when the attached data is a URL. When the attached data is a file, an application corresponding to the file format is activated.

(Process flow)
A flow of processing performed by electronic devices 100 and 100 # for handwritten chat will be described with reference to FIG.

In step S101, the attached data creation unit 354 of the electronic device 100 creates the attached data 434 in response to the attached data creation instruction received by the input unit 310. The attached data creation unit 354 stores the created attached data 434 in the storage unit 430.

In step S103, the transfer control unit 454 creates a command including the input pattern 433 and the attached data 434 according to the data transfer instruction received by the input unit 310. Transfer control unit 454 controls external communication unit 274 (or external communication unit 174), and transmits the created command to electronic device 100 #.

In step S201, external communication unit 274 # of electronic device 100 # receives a command including input pattern 433 and attached data 434.

In step S203, the display control unit 452 # displays the input pattern included in the command on the liquid crystal panel 240 # (display integrated tablet).

In step S205, the display control unit 352 # displays the attached data included in the command on the liquid crystal panel 140 # (monitor).

Note that, here, transfer of data from the electronic device 100 to the electronic device 100 # has been described. However, transfer of data from the electronic device 100 # to the electronic device 100 is similarly realized. Users of electronic device 100 and electronic device 100 # can perform handwritten chat by repeating such data transfer.

<Operation (Part 2): Chat between an electronic device having two screens and an electronic device having only one screen>
As described above, the command indicates that the input pattern is displayed on the display integrated tablet of the device and the attached data is reproduced on the monitor of the device on the device including the display integrated tablet and the monitor. Request.

On the other hand, the command has a display-integrated tablet but does not have a monitor (referred to as a single-screen device) to display the input pattern on the display-integrated tablet of the device and to have attached data as a monitor. Request transfer to device. That is, when the one-screen device receives the command, it displays the input pattern on the display-integrated tablet of the device, and transfers the attached data to the device having the monitor.

The operation including the one-screen device will be described with reference to FIG. FIG. 24 is a diagram illustrating operations of the electronic device 100, the electronic device 10, and the electronic device 20.

FIG. 24A is a diagram illustrating a display screen of the electronic device 100 and the electronic device 10 before the electronic device 100 transfers data to the electronic device 10. Referring to FIG. 24A, liquid crystal panel 240 of electronic device 100 displays an image of a personal computer and an input pattern (in the figure, this ↓) input to liquid crystal panel 240. The liquid crystal panel 140 displays an image different from the image displayed on the liquid crystal panel 240. Here, it is assumed that the image on the liquid crystal panel 140 is a web page including detailed data regarding the personal computer displayed on the liquid crystal panel 240.

On the other hand, the optical sensor built-in liquid crystal panel 12 of the electronic device 10 displays an image of a personal computer that is common to the image displayed on the liquid crystal panel 240. However, the optical sensor built-in liquid crystal panel 12 does not display the input pattern input to the liquid crystal panel 240 of the electronic device 100.

FIG. 24B is a diagram illustrating operations of the electronic device 10 and the electronic device 20 when the electronic device 100 sends a command to the electronic device 10. The electronic device 10 that has received the command displays a display corresponding to the input pattern 433 included in the command on the liquid crystal panel 12 with a built-in optical sensor. In addition, the electronic device 10 transmits the attached data included in the command to the electronic device 20 having the monitor 22.

Here, it is assumed that the transfer destination of the attached data is registered in advance in the electronic device 10. However, the electronic device 10 may determine the transfer destination by another method. For example, when the electronic device 10 receives the command, the electronic device 10 may inquire of the surrounding electronic devices whether the attached data can be received and may transmit the attached data to the electronic device that has replied that the attached data can be received.

The single-screen device in the communication system 1 operates as described above. Therefore, the user of the one-screen device can check the attached data with another electronic device.

Referring to FIG. 25, the flow of processing performed by electronic devices 100, 10, and 20 for handwritten chat will be described.

In step S301, the attached data creation unit 354 of the electronic device 100 creates the attached data 434 according to the attached data creation instruction received by the input unit 310. The attached data creation unit 354 stores the created attached data 434 in the storage unit 430.

In step S303, the transfer control unit 454 creates a command including the input pattern 433 and the attached data 434 according to the data transfer instruction received by the input unit 310. The transfer control unit 454 controls the external communication unit 274 (or the external communication unit 174) and transmits the created command to the electronic device 10.

In step S401, the communication unit 540 of the electronic device 10 receives a command including the input pattern 433 and the attached data 434.

In step S403, the display control unit 552 displays the input pattern included in the command on the optical sensor built-in liquid crystal panel 12 (display-integrated tablet).

In step S405, the retransfer control unit 554 controls the communication unit 540 and transmits the attached data included in the command to the electronic device 20.

In step S501, the communication unit 640 of the electronic device 20 receives the attached data. In step S503, the control unit 650 activates an application according to the format of the attached data, and creates display data corresponding to the attached data. The display control unit 652 displays display data corresponding to the attached data on the monitor 22.

Note that, here, transfer of data from the electronic device 100 to the electronic device 10 has been described, but the electronic device 10 can also transfer data to the electronic device 100. In this case, the electronic device 10 transmits the input pattern 533 input to the optical sensor built-in liquid crystal panel 12 to the electronic device 100. Users of the electronic device 100 and the electronic device 10 can perform handwritten chat by repeating such data transfer.

<< Second Specific Implementation Example >>
The purpose of this implementation example is to acquire an object related data from an external device by designating an object displayed via one display panel and display an image based on the data via the other display panel. An object of the present invention is to provide an electronic device, a communication system, a display control method, a data communication method, and a program.

<Outline of communication system>
FIG. 26 is a diagram showing a schematic configuration of the communication system 1A. Referring to FIG. 26, communication system 1A includes electronic device 100α, electronic device 2000, and server device 9000. The electronic device 2000 is configured as a portable device having a communication function and a display function, such as a portable telephone, a PDA, and a notebook personal computer. In the following, a case where the electronic device 100α is a notebook personal computer and the electronic device 2000 is a mobile phone will be described as an example.

Like the electronic device 100, the electronic device 100α has the configuration and functions shown in FIGS. Therefore, the contents described with reference to FIGS. 2 to 18 are not repeated here.

The electronic device 100α and the electronic device 2000 directly transmit / receive data to / from each other via a network by using an IP (Internet Protocol) address assigned to the electronic device 100α and the electronic device 2000. That is, the electronic devices 100α and 2000 included in the communication system 1A constitute a so-called P2P (Pear to Pear) type network.

In the following, in communication between the electronic device 100α and the electronic device 2000, transmission of image data to the counterpart device is performed using the operation key 177 of the electronic device 100α or the operation key of the electronic device 2000 (see FIG. 27). It is assumed that this is performed by pressing a predetermined key.

The server device 9000 stores property data and map data in association with each other. The “property data” is data indicating each piece of information (housing information) about the house, such as the location of the property, the floor plan of the property, the rent of the property, the appearance of the property, the age of the property, and the equipment of the property.

When the server device 9000 receives a map data transmission instruction, the server device 9000 transmits map data related to the instruction to the electronic device that issued the instruction. At the time of transmission of the map data, the server device 9000 displays data (hereinafter referred to as “data”) for displaying the property included in the map image area (hereinafter referred to as “map area”) based on the map data on the map image. "Accompanying data") is transmitted in association with the map data.

In the following, an image displayed when the electronic device 100α displays the map data and the accompanying data on the liquid crystal panel 140 is referred to as a “first image”. An image displayed on the map image based on the accompanying data is referred to as an “object”. That is, the first image includes an object. Further, as will be described in detail later, the object can be specified by an operation key 177 or a pointing device (not shown).

<Appearance of electronic device 2000>
FIG. 27 is a diagram illustrating an external appearance of the electronic device 2000. Referring to FIG. 27, electronic device 2000 includes a microphone 2105, operation keys 2107, a liquid crystal panel 2108, an earphone 2109, and a camera (not shown).

The electronic device 2000 includes a first casing 2000A and a second casing 2000B. The first housing 2000A and the second housing 2000B are foldably connected by a hinge 2000C. The first housing 2000A includes a liquid crystal panel 2108 and an earphone 2109. Second housing 2000B includes operation keys 2107, a microphone 2105, and a camera.

Note that the electronic device 2000 is not necessarily limited to a foldable device. For example, the electronic device 2000 may be a straight type device. Alternatively, the electronic device 2000 may be a slide type device.

<Hardware configuration of electronic device 2000>
FIG. 28 is a diagram illustrating a hardware configuration of the electronic device 2000. Referring to FIG. 28, electronic device 2000 includes CPU 2100, RAM 2101, ROM 2102, communication unit 2103, camera 2104, microphone 2105, speaker 2106, operation key 2107, liquid crystal panel 2108, and earphone 2109. Including. Each component is mutually connected by a data bus DB3.

CPU 2100 executes a program. The operation key 2107 receives an instruction input from the user of the electronic device 2000. The RAM 2101 volatilely stores data generated by execution of a program by the CPU 2100 or data input via the operation keys 2107. The ROM 2102 stores data in a nonvolatile manner. The ROM 2102 is a ROM capable of writing and erasing such as an EPROM and a flash memory. The communication unit 2103 performs wireless communication with other electronic devices (not shown). Although not shown in FIG. 28, the electronic device 2000 may include an interface (IF) for connecting to another electronic device by wire.

The camera 2104 captures a subject according to the operation of the user's operation keys. The image data of the photographed subject is stored in the RAM 2102 or an external memory (for example, a memory card).

The microphone 2105 receives user's voice input. The electronic device 2000 digitizes the input voice (analog data). Then, electronic device 2000 sends the digitized voice to a communication partner (for example, another mobile phone).

Speaker 2106 outputs sound based on music data stored in RAM 2101, for example. Earphone 2109 outputs the voice transmitted from the communication partner.

The liquid crystal panel 2108 displays an image stored in the ROM 2102 or the RAM 2101. The liquid crystal panel 2108 displays an image taken by the camera 2104, for example. Further, the liquid crystal panel 2108 displays an image transmitted from the electronic device 100α. The contents displayed on the liquid crystal panel 2108 will be described later.

The liquid crystal panel 2108 is a liquid crystal pen tablet in which a liquid crystal display is integrated with the pen tablet. Therefore, electronic device 2000 can accept handwritten input data of line images via liquid crystal panel 2108. The electronic device 2000 displays handwriting input data on the liquid crystal panel 2108.

Note that the electronic device 2000 may include a device in which a display panel other than the liquid crystal panel (for example, an organic EL) and a tablet are integrated instead of the liquid crystal panel 2108. Alternatively, the electronic device 2000 may be configured to include an optical sensor liquid crystal panel instead of the liquid crystal panel 2108.

By the way, the processing in the electronic device 2000 is realized by each hardware and software executed by the CPU 2100. Such software may be stored in the ROM 2102 in advance. The software may be stored in a storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium or downloaded via the communication unit 2103 or the communication IF (not shown) and then temporarily stored in the ROM 2102. The software is read from the ROM 2102 by the CPU 2100 and stored in the RAM 2101 in the form of an executable program. CPU 2100 executes the program.

Each component constituting the electronic device 2000 shown in FIG. Therefore, it can be said that the essential part of the present invention is RAM 2101, ROM 2102, software stored in the storage medium, or software that can be downloaded via a network. Since the hardware operation of electronic device 2000 is well known, detailed description will not be repeated.

The storage medium is not limited to a memory card, but is a CD-ROM, FD, hard disk, magnetic tape, cassette tape, optical disk (MO / MD / DVD), IC card (excluding a memory card), optical card, mask ROM Further, a medium for storing a program in a fixed manner such as a semiconductor memory such as an EPROM, an EEPROM, or a flash ROM may be used.

The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<Functional Block of Electronic Device 100α>
FIG. 29 is a functional block diagram of the electronic device 100α. Referring to FIG. 29, electronic device 100α includes a control unit 1010, liquid crystal panels 140 and 240, and a storage device 90. The storage device 90 is built in the electronic device 100α. The storage device 90 includes a VRAM 91. The storage device 90 is composed of, for example, RAMs 171 and 271.

The control unit 1010 includes a reception unit 1011, a display control unit 1012, a first reception unit 1013, a transmission unit 1014, and a second reception unit 1015.

The receiving unit 1011 receives the map data and accompanying data from the server device 9000. The receiving unit 1011 receives map data and accompanying data as a response signal to the request signal from the electronic device 100α. The request signal is transmitted by the transmission unit 1014. In addition, the receiving unit 1011 sends the map data and accompanying data to the display control unit 1012.

The display control unit 1012 displays an image on at least one of the liquid crystal panel 140 and the liquid crystal panel 240. The display control unit 1012 displays the first image described above on the liquid crystal panel 140 based on, for example, map data and accompanying data.

The first receiving unit 1013 receives an input for designating the object included in the first image in a state where the first image is displayed on the liquid crystal panel 140. Note that the input is performed via an input device such as an operation key 177 or a pointing device. When receiving an input designating an object, the first input unit 13 sends first information indicating the designated object to the transmission unit 1014.

When the transmission unit 1014 receives the first information from the first reception unit 1013, the transmission unit 1014 transmits the first information to the server device 9000.

After the transmitting unit 1014 transmits the first information to the server device 9000, the receiving unit 1011 receives the second information related to the first information from the server device 9000. The receiving unit 1011 receives the second information as a response signal to the request signal (first information) from the electronic device 100α. Moreover, in this Embodiment, 2nd information is the property data mentioned above. Below, 2nd information is demonstrated as property data.

When the receiving unit 1011 receives the property data, the display control unit 1012 causes the liquid crystal panel 240 to display the property data.

The second reception unit 1015 receives handwriting input data through the liquid crystal panel 240 in a state where the property data is displayed on the liquid crystal panel 240. The second reception unit sends the handwriting input data to the display control unit 1012 and the transmission unit 1014.

When the handwriting input data is received from the second receiving unit 1015, the display control unit 1012 receives the input image data of the image displayed on the liquid crystal panel 240 (image data stored in the VRAM 91), and Composite image data is generated by combining handwritten input data. The display control unit 1012 causes the liquid crystal panel 240 to display a composite image based on the composite image data.

In the following, the images displayed on the liquid crystal panels 140, 240, and 2108 are referred to as “display images”. The image data of the display image is referred to as “display data”.

When the transmission unit 1014 receives the handwriting input data from the second reception unit 1015, the transmission unit 1014 transmits the property data and the handwriting input data to the electronic device 2000. In addition, the transmission unit 1014 transmits handwriting input data to the electronic device 2000 when the property data has already been transmitted to the electronic device 2000.

The receiving unit 1011 further receives handwriting input data input in the electronic device 2000. The receiving unit 1011 sends the received handwritten input data to the display control unit 1012. The display control unit 1012 synthesizes the display data (that is, the property data and the handwritten input data transmitted to the electronic device 2000) and the received handwritten input data, and displays an image based on the combined image data on the liquid crystal panel 240. To display. The transmission unit 1014 transmits the combined image data to the server device 9000.

<Functional Block of Electronic Device 2000>
FIG. 30 is a functional block diagram of the electronic device 2000. Referring to FIG. 30, electronic device 2000 includes a control unit 2010, a liquid crystal panel 2108, and a storage device 2090. The storage device 2090 includes a VRAM 2091. Note that the storage device 2090 includes a RAM 2101.

The control unit 2010 includes a reception unit 2011, a display control unit 2012, a reception unit 2013, and a transmission unit 2014.

The receiving unit 2011 receives the property data and the handwriting input data transmitted by the transmitting unit 1014 of the electronic device 100α. The receiving unit 2011 sends the received property data and handwriting input data to the display control unit 2012.

The display control unit 2012 synthesizes the property data and the handwriting input data to generate composite image data. The display control unit 1012 causes the liquid crystal panel 2108 to display a composite image based on the composite image data.

The accepting unit 2013 accepts handwriting input data via the liquid crystal panel 2108. For example, the accepting unit 2013 accepts handwriting input data via the liquid crystal panel 2108 in a state where the composite image synthesized by the display control unit 2012 is displayed on the liquid crystal panel 2108. The accepting unit 2013 sends the accepted handwritten input data to the display control unit 2012 and the transmitting unit 2014.

When the handwriting input data is received from the receiving unit 2013, the display control unit 2012 receives the input image data of the image displayed on the liquid crystal panel 2018 (image data stored in the VRAM 2091) and the handwriting. Composite image data is generated by combining the input data. The display control unit 2012 causes the liquid crystal panel 2108 to display a composite image based on the composite image data.

The transmission unit 2014 transmits the handwriting input data sent from the reception unit 2013 to the electronic device 100α.

<About screen transition>
Next, contents displayed on the liquid crystal panels 140 and 240 of the electronic device 100α and contents displayed on the liquid crystal panel 2108 of the electronic device 2000 when communication is performed between the electronic device 100α and the electronic device 2000. ,explain.

FIG. 31 is a diagram showing a case where the electronic device 100α displays the first image on the liquid crystal panel 140. Referring to FIG. 31, electronic device 100α displays a map image and a plurality of objects on liquid crystal panel 140. The electronic device 100α displays each object superimposed on the map image. In the present embodiment, each object is configured using a character indicating a number and a figure surrounding the character.

FIG. 32 is a diagram illustrating an image displayed on the liquid crystal panel 240 of the electronic device 100α after the electronic device 100α receives the property data from the server device 9000. Referring to FIG. 32, electronic device 100α causes liquid crystal panel 240 to display the property data. The figure shows an example in which an image based on data indicating the floor plan of the property data is displayed on the liquid crystal panel 240.

FIG. 33 is a diagram showing an image displayed on the electronic device 100α when the user of the electronic device 100α performs handwriting input via the liquid crystal panel 240 in the state of FIG. It is assumed that the character C11 and the figures C12 and 13 are input to the electronic device 100α as handwriting input.

Referring to FIG. 33, electronic device 100α displays the input character C11 and figures C12, 13 in a superimposed manner on an image showing a floor plan (that is, a display image). The electronic device 100α sends handwriting input data based on the character C11 and the graphics C12 and 13 to the electronic device 2000.

34 shows a case where the electronic device 2000 receives handwriting input data based on the character C11 and the graphics C12 and 13, and the display control unit 2013 generates the above-described composite image data. It is the figure which showed the image displayed.

33 and FIG. 34, images having the same contents are displayed on the liquid crystal panel 240 of the electronic device 100α and the liquid crystal panel 2108 of the electronic device 2000. Thereby, the user of the electronic device 100α and the user of the electronic device 2000 can confirm images of the same content on the liquid crystal panels 240 and 2108 of each other.

FIG. 35 is a diagram showing an image displayed on electronic device 2000 when the user of electronic device 2000 further performs handwriting input via liquid crystal panel 2108 in the state of FIG. It is assumed that the figure C14 and the character C15 are input to the electronic device 2000 as handwriting input.

Referring to FIG. 35, electronic device 2000 displays the input graphic C14 and character C15 in a superimposed manner on a display image (an image showing a floor plan in which character C11 and graphic C12, 13 are superimposed). Electronic device 2000 sends handwriting input data of figure C14 and character C15 to electronic device 100α.

FIG. 36 shows a case where handwritten input data based on the figure C14 and the character C15 is received by the electronic device 100α and the display control unit 1012 generates the above-described composite image data, and the liquid crystal panels 140 and 240 of the electronic device 100α are displayed. It is the figure which showed the image displayed. Referring to FIG. 36, electronic device 100α displays handwritten input data based on graphic C14 and character C15 in a superimposed manner on a display image displayed on liquid crystal panel 240.

35 and 36, images having the same content are displayed on liquid crystal panel 240 of electronic device 100α and liquid crystal panel 2108 of electronic device 2000. Accordingly, even when the electronic device 2000 transmits handwriting input data to the electronic device 100α, the user of the electronic device 100α and the user of the electronic device 2000 display images having the same content on the liquid crystal panels 240 and 2108 of each other. Can be confirmed.

<About Sequence in Communication System 1A>
FIG. 37 is a diagram illustrating a sequence among the electronic device 100α, the electronic device 2000, and the server device 9000. Specifically, FIG. 37 is a diagram showing a sequence including the processing described based on FIGS.

In step S1, the electronic device 100α transmits a request signal to the server device 9000 in order to receive the map data and the accompanying data. In step S2, the server device 9000 transmits the map data and the accompanying data to the electronic device 100α. In step S3, the electronic device 100α transmits a request signal to the server device 9000 in order to receive the property data related to the specified object. In step S4, the server device 9000 transmits the property data to the electronic device 100α.

In step S5, the electronic device 100α transmits the property data and the handwriting input data to the electronic device 2000. In step S6, the electronic device 2000 transmits the handwriting input data input by the electronic device 2000 to the electronic device 100α.

In step S7, the electronic device 100α displays the display data related to the liquid crystal panel 240 (that is, image data obtained by combining the property data and the handwriting input data transmitted to the electronic device 2000) and the handwriting input data received from the electronic device 2000. And the combined image data is transmitted to the server device 9000.

<Processing Flow in Electronic Device 100α>
FIG. 38 is a flowchart showing a data processing flow in the electronic apparatus 100α. For convenience of explanation, the transmission processing of image data from the electronic device 100α to the server device 9000 shown in step S7 in FIG. 37 is not included in FIG.

Referring to FIG. 38, in step S11, electronic device 100α receives map data and accompanying data from server device 9000. In step S12, the electronic device 100α displays a first image, which is an image based on the map data and the accompanying data, on the liquid crystal panel 140. In step S13, the electronic device 100α accepts designation of an object included in the display image.

In step S14, the electronic device 100α transmits the first information indicating the designated object to the server device 9000. In step S15, the electronic device 100α receives the property data related to the first information from the server device 9000. In step S16, the electronic device 100α displays an image based on the received property data on the liquid crystal panel 240.

In step S17, the electronic device 100α determines whether or not handwriting input data is received via the liquid crystal panel 240. When it is determined that electronic device 100α has received the handwriting input data (YES in step S17), in step S18, electronic device 100α combines the property data and the handwriting input data. On the other hand, when electronic device 100α determines that handwriting input data is not received (NO in step S17), electronic device 100α transmits the property data to electronic device 2000 in step S21.

In step S19, the electronic device 100α displays an image based on the combined image data on the liquid crystal panel 240. In step S20, the electronic device 100α transmits the property data and the handwriting input data to the electronic device 2000.

In step S22, the electronic device 100α determines whether image data that is handwritten input data has been received from the electronic device 2000. When it is determined that electronic device 100α has received in step S22 (YES in step S22), in step S23, electronic device 100α displays the received image data superimposed on the display image on liquid crystal panel 240. On the other hand, when it is determined that electronic device 100α has not received (NO in step S22), CPU 110 advances the process to step S24.

In step S24, the electronic device 100α determines whether or not communication with the electronic device 2000 has ended. If it is determined that electronic device 100α has ended (YES in step S24), CPU 110 ends the series of processing. On the other hand, if it is determined that electronic device 100α has not ended (NO in step S24), CPU 110 returns the process to step S17.

<Processing Flow in Electronic Device 2000>
FIG. 39 is a flowchart showing a flow of data processing in the electronic device 2000. Referring to FIG. 39, in step S31, electronic device 2000 receives image data that is handwritten input data from electronic device 100α. In step S <b> 32, electronic device 2000 displays an image based on the received image data on liquid crystal panel 2108.

In step S33, electronic device 2000 determines whether or not handwriting input data is received via liquid crystal panel 2108. When it is determined that electronic device 2000 has received the handwriting input data (YES in step S33), in step S34, electronic device 2000 synthesizes the display data and the received handwriting input data. On the other hand, when it is determined that electronic device 2000 has not received handwriting input data (NO in step S33), CPU 2100 advances the process to step S38.

In step S35, the electronic device 2000 displays an image based on the combined image data on the liquid crystal panel 2108. In step S36, the electronic device 2000 transmits the handwriting input data input via the liquid crystal panel 2108 to the electronic device 100α.

In step S37, electronic device 2000 determines whether or not image data that is handwritten input data has been received from electronic device 100α. If it is determined that electronic device 2000 has received (YES in step S37), CPU 2100 returns the process to step S34. On the other hand, when CPU 2100 determines that electronic device 2000 is not receiving (NO in step S37), CPU 2100 advances the process to step S38.

In step S38, the electronic device 2000 determines whether or not communication with the electronic device 100α is completed. When it is determined that electronic device 2000 has ended (YES in step S38), CPU 2100 ends the series of processing. On the other hand, when it is determined that electronic device 2000 has not ended (NO in step S38), CPU 2100 returns the process to step S33.

<Summary>
As described above, electronic device 100α accepts an input for designating an object included in the first image in a state where the first image is displayed on display panel 140. Also, the electronic device 100α transmits first information indicating the designated object to the server device 9000. Furthermore, the electronic device 100α receives the second information related to the first information from the server device 9000. Then, the electronic device 100α causes the display panel 240 to display the received second information.

Therefore, the electronic device 100α can acquire the second information related to the object from the electronic device 2000 by designating the object displayed on the liquid crystal panel 140. Furthermore, the electronic device 100α can display an image based on the second information on the other liquid crystal panel 240.

Furthermore, since the electronic device 100α displays the second information on the liquid crystal panel 240 different from the liquid crystal panel 140, it is not necessary to change the display mode of the liquid crystal panel 140. Therefore, the electronic device 100α can prevent the display of part or all of the map image from being hindered by the display of the second information.

Also, the electronic device 100α accepts handwritten input data via the liquid crystal panel 240 in a state where the second information is displayed. Furthermore, the electronic device 100α transmits the second information and the accepted handwritten input data to the electronic device 2000.

Therefore, the electronic device 2000 can acquire the second information and the handwriting input data input by the electronic device 100α.

Further, the electronic device 100α receives the handwriting input data input in the electronic device 2000. Also, the electronic device 100α combines the image data included in the second information, the handwriting input data transmitted from the electronic device 100α to the electronic device 2000, and the handwriting input data received from the electronic device 2000. An image based on the image data obtained by the synthesis is displayed on the liquid crystal panel 240.

Therefore, the electronic device 100α can superimpose and display an image based on the handwriting input data received from the electronic device 2000 on the display image of the liquid crystal panel 240.

<Modification of Configuration of Communication System 1A>
Hereinafter, modified examples of the configuration of the communication system 1A will be described. Specifically, a configuration in which the communication system 1A uses a check box will be described. The communication system 1A includes an electronic device 3300 (see FIG. 40) described later instead of the electronic device 100α, and includes an electronic device 3400 (see FIG. 41) described later instead of the electronic device 2000. The check box is a kind of component of GUI (Guraphical User Interface). The check box is used by the user to select at least one item from a plurality of option items.

(About electronic equipment 3300)
FIG. 40 is a diagram illustrating functional blocks of the electronic device 3300. Referring to FIG. 40, electronic device 3300 includes a control unit 1010A, a storage device 90, a liquid crystal panel 140, and a liquid crystal panel 240. Further, the control unit 1010A includes a receiving unit 1011, a display control unit 1012, a first receiving unit 1013, a transmitting unit 1014, a second receiving unit 1015, and a changing unit 1016.

Note that regarding the electronic device 3300, members having the same functions as the members included in the electronic device 100α are assigned the same numbers as the members in the electronic device 100α. In the following description, the description of the same function for members having the same numbers will not be repeated.

Electronic device 3300 is different from electronic device 100α that does not include change unit 1016 in that change unit 1016 is included. Further, the second information exchanged between the devices in the communication system 1A includes data for displaying a check box for each item regarding a plurality of items related to the second information. Further, the second information includes at least data indicating the first check box group and data indicating the second check box group as data for displaying the check box (see FIGS. 42 to 45).

The display control unit 1012 displays a plurality of check boxes on the liquid crystal panel 240 together with an image showing the floor plan. The change unit 1016 changes the state of each check box to a check state or a non-check state according to an input from the operation key 177 or the like. More specifically, the changing unit 1016 changes the state of each check box included in the first check box group. The state of each check box included in the second check box group is changed by electronic device 2000.

The receiving unit 1011 receives state information indicating the state of each check box included in the second check box group from the electronic device 2000. For example, the receiving unit 1011 receives the status information from the electronic device 2000 together with the handwriting input data input via the liquid crystal panel 2108. The transmission unit 1014 transmits state information indicating the state of each check box in the first check box group and the state of each check box in the second check box group to the server device 9000.

The receiving unit 1011 receives related information related to the state information from the server device 9000. More specifically, the receiving unit 1011 includes, as the related information, first related information related to an item checked in the first check box group and second related to an item checked in the second check box group. Receive related information.

The display control unit 1012 displays the related information on the liquid crystal panel 240. More specifically, the display control unit 1012 displays the first related information on the liquid crystal panel 240. The transmission unit 1014 transmits the second related information to the electronic device 2000.

The related information is, for example, information (hereinafter referred to as “detailed information”) about a property that shows more detailed content than the above-described property data. As the detailed information, for example, information such as the manufacturer name of the kitchen system and the heat insulation structure of the wall is applicable.

In the above description, the check box is used for the purpose of acquiring detailed information on the property.

(About electronic equipment 3400)
FIG. 41 is a diagram illustrating functional blocks of the electronic device 3400. Referring to FIG. 41, electronic device 3400 includes a control unit 2010A, a storage device 2090, and a liquid crystal panel 2108. The control unit 2010 </ b> A includes a reception unit 2011, a display control unit 2012, a reception unit 2013, a transmission unit 2014, and a change unit 2015.

Note that regarding the electronic device 3400, members having the same functions as those included in the electronic device 2000 are assigned the same numbers as members in the electronic device 2000. In the following description, the description of the same function for members having the same numbers will not be repeated.

The changing unit 2015 changes the state of each check box displayed on the electronic device 2000 to a check state or a non-check state. More specifically, the changing unit 2015 changes the state of each check box included in the second check box group.

The transmission unit 2014 transmits the state information in the second check box group to the electronic device 100α. The receiving unit 2011 receives, from the server device 9000 via the electronic device 100α, the second related information related to the item checked in the second check box group. The display control unit 2012 displays the received second related information on the liquid crystal panel 2108.

(About check box display examples)
FIG. 42 is a diagram showing a state in which an image showing the floor plan and the first check box group J1 and the second check box group J2 are displayed on the liquid crystal panel 240 of the electronic apparatus 3300. Referring to FIG. 42, electronic device 3300 acquires various information such as kitchen information, wall information, bath information, toilet information, and floor information from server device 9000 as the detailed information described above. In addition, a check box is displayed corresponding to each item such as a kitchen. Also, electronic device 3300 accepts a check box status change for each check box included in first check box group J1.

FIG. 43 is a diagram showing a state where the kitchen items of the first check box group J1 are in a checked state. When the user of the electronic device 3300 selects the check box of the kitchen item in the first check box group J1 via the operation key 177 or the like, the changing unit 1016 changes the kitchen item from the unchecked state to the checked state. change.

The transmission unit 1014 transmits the state information in the first check box group to the electronic device 3400. As a result, the electronic 3400 displays the same content as in FIG. 43 on the liquid crystal panel 2108.

The electronic device 3400 receives a check box status change for each check box included in the second check box group J2. In the electronic device 3400, for example, when the user of the electronic device 3400 selects the check box of the wall item in the second check box group J2 via the operation key 2107 or the like, the changing unit 2015 changes the wall item. Change from unchecked state to checked state.

FIG. 44 is a diagram showing a display screen of the liquid crystal panel 2108 after the check box of the wall item in the second check box group J2 is changed to the check state. Referring to FIG. 44, electronic device 3400 displays on the liquid crystal panel 2108 the items checked by electronic device 3300 and the items checked by electronic device 3400.

The transmission unit 2014 transmits the state information in the second check box group J2 to the electronic device 3300. The electronic device 3300 that has received the state information displays a display screen having the same content as the display screen shown in FIG.

Note that, as described above, the electronic device 3300 transmits the state information in the first check box group J1 and the state information in the second check box group J2 to the server device 9000. Therefore, the electronic device 3300 can acquire detailed information regarding the kitchen from the server device 9000. In addition, the electronic device 3400 can acquire detailed information regarding the wall from the server device 9000 via the electronic device 3300.

Next, a configuration in which the check box is used for re-searching for property data will be described.
FIG. 45 is a diagram showing a state in which an image showing the floor plan and the check box groups J1 and J2 for narrowing search are displayed on the liquid crystal panel 240 of the electronic device 3300. Referring to FIG. 45, the state of each check box in first check box group J1 is changed in electronic device 3300 as described above. On the other hand, the state of each check box in the second check box group J2 is changed in the electronic device 3300 as described above.

The electronic device 3300 transmits the state information in the first check box group J1 and the state information in the second check box group J2 to the server device 9000.

The server device 9000 performs a search for property data based on the state information in each check box group J1, J2. Then, the server device 9000 transmits the search result (property data) to the electronic device 3300. The electronic device 3300 transmits the search result to the electronic device 3400.

Therefore, the electronic devices 3300 and 3400 can acquire property data that satisfies the wishes of the user of the electronic device 3300 and the users of the electronic device 3400.

By the way, in the above-described embodiment, the configuration in which the electronic device 100α acquires housing information (property data) from the server device 9000 and displays the housing information on the liquid crystal panel 240 has been described as an example. However, the information acquired by the electronic device 100α from the server device 9000 is not limited to the house information. For example, when the server device 9000 stores a car catalog, the electronic device 100α may acquire the car catalog from the server device 9000. Further, the communication system 1A may be applied to the processing of a digital photo print order using the server device 9000 as a photo shop device and the electronic device 100α as an ordering device.

<Variation of transmitted data>
By the way, in the above description, the configuration in which one electronic device transmits handwriting input data (image data) received via the liquid crystal panel to the other electronic device has been described as an example. The configuration of the electronic devices 100α and 2000 is not limited to such a configuration, and may be configured as follows.

The control unit 1010 of the electronic device 100α generates stroke data based on the handwriting input data received via the liquid crystal panel 240. The transmission unit 1014 transmits the generated stroke data to the electronic device 2000. The electronic device 2000 may receive the stroke data from the electronic device 100α and display an image based on the received stroke data on the liquid crystal panel 2108.

Also, the control unit 2010 of the electronic device 2000 generates stroke data based on the handwriting input data received via the liquid crystal panel 2108, as with the electronic device 100α. The transmission unit 2014 transmits the generated stroke data to the electronic device 100α. The electronic device 100α may receive the stroke data from the electronic device 2000 and display an image based on the received stroke data on the liquid crystal panel 240.

By adopting such a configuration, it is possible to reduce the amount of data to be transmitted compared to a configuration in which image data is transmitted to the electronic device 100α, 2000 of the communication partner.

Also, the electronic devices 3300 and 3400 may be configured to transmit and receive stroke data as described above.

<Appendix>
(1) The electronic device receives a first display panel, a second display panel, and an input for designating an object included in the first image in a state where the first image is displayed on the first display panel. A receiving unit; a transmitting unit that transmits first information indicating the specified object to the first external device; a receiving unit that receives second information related to the first information from the first external device; A display control unit that displays the two information on the second display panel.

The electronic device further includes a second reception unit that receives handwriting input data via the second display panel in a state where the second information is displayed, and the transmission unit includes the second information, the handwriting input data, Is preferably transmitted to the second external device.

The second information includes image data, the receiving unit receives handwritten input data input in the second external device, and the display control unit includes the image data of the second information, the transmitted handwritten input data, It is preferable to combine the received handwritten input data and display an image based on the combined image data on the second display panel.

The first image is preferably an image based on data received from the first external device.

The second information includes data for displaying a check box for each of the plurality of items related to the second information, and the electronic device changes the state of each check box to a check state or a non-check state. Each of the change units further includes a change unit, the transmission unit transmits state information indicating the state of each check box to the first external device, and the reception unit receives related information related to the state information from the first external device. The display control unit preferably displays the related information on the second display panel.

The second information includes data for displaying the first check box group and data for displaying the second check box group as data for displaying the check box, and the changing unit is included in the first check box group. It is preferable to change the state for each check box.

The receiving unit receives state information indicating the state of each check box included in the second check box group from the second external device, and the transmitting unit includes the first check box group, the second check box group, and the like. Is transmitted to the first external device, and the receiving unit includes, as related information, first related information related to an item checked in the first check box group, and check status in the second check box group. Preferably, the display control unit receives the second related information related to the item and causes the display control unit to display the first related information on the second display panel.

The transmitting unit preferably transmits the second related information to the second external device.
Moreover, it is preferable that 1st information is map information and 2nd information is housing information.

The second display panel includes a plurality of photosensor circuits that generate electrical signals in response to incident light and a plurality of pixel circuits that emit light in response to the electrical signals, and the reception unit includes a plurality of photosensor circuits. It is preferable that the handwriting input data is received based on the electrical signal from and the display control unit displays the second information and the handwriting input data on the plurality of pixel circuits.

(2) The electronic device includes a display unit, a receiving unit that receives information including the first image data and second image data based on the handwriting input data from the other electronic devices, the first image data, and the first image data. The display control unit that combines the two image data and displays the image based on the combined image data on the display panel, and the handwriting input via the display panel in a state where the image based on the combined image data is displayed A reception unit that receives data, and a transmission unit that transmits the received handwritten input data to another electronic device, and information displays a check box for each item regarding a plurality of items related to the information The electronic device further includes a change unit that changes a state of each check box to a check state or a non-check state, and the transmission unit includes each check box. The state information showing the state, to the other electronic devices.

In addition, the information includes data for displaying the first check box group and data for displaying the second check box group, and the changing unit includes one check box group of the first check box group and the second check box group. It is preferable that the state of each check box included in is changed, and the transmission unit transmits the state information in one check box group to another electronic device.

Further, it is preferable that the receiving unit receives related information related to an item checked in one check box group from another electronic device, and the display control unit displays the related information on the display panel.

Moreover, it is preferable that information is housing information.
(3) The communication system includes a first electronic device and a second electronic device, and the first electronic device includes an image based on the first image data in the first display panel, the second display panel, and the first display panel. Is displayed, a first receiving unit that receives an input that specifies an object included in the image, a first transmission unit that transmits first information indicating the specified object to an external device, and first information In a state in which the first information is received from the external device, the first display control unit that displays the received second information on the second display panel, and the second information is displayed. A second receiving unit that receives handwritten input data via the second display panel, and the first transmitting unit transmits the second information and the handwritten input data to the second electronic device. The first image from the third display panel and the first electronic device A second receiving unit that receives the information including the data and the second image data based on the handwriting input data, and combines the first image data and the second image data, and based on the combined image data A second display control unit that displays an image on the third display panel, a third reception unit that receives handwriting input data via the third display panel in a state where an image based on the composite image data is displayed, and A second transmission unit configured to transmit handwriting input data to the first electronic device.

(4) The display control method is a display control method in an electronic device, and in the state where an image is displayed on the first display panel, a step of receiving an input for specifying an object included in the image, and the specified object Transmitting the first information indicating to the external device, receiving the second information related to the first information from the external device, and displaying the received second information on the second display panel; including.

(5) The data communication method is a data communication method in an electronic device, and receives information including first image data and second image data based on handwriting input data from another electronic device. , Combining the first image data and the second image data, displaying an image based on the combined image data on the display panel, and displaying the image based on the combined image data. Receiving the handwriting input data via the network, and transmitting the received handwriting input data to another electronic device. The information is related to a plurality of items related to the information. The data communication method further includes a step of changing the state of each check box to a check state or a non-check state, respectively. When, further comprising a state information showing the state of each check box, and transmitting to the another electronic device.

(6) The program is a program for causing the electronic device to perform display control, and accepts an input for designating an object included in the image in a state where the image is displayed on the first display panel; Transmitting the first information indicating the designated object to the external device; receiving the second information related to the first information from the external device; and displaying the received second information on the second display panel Step to be executed.

(7) The program is a program for causing an electronic device to perform data communication, and receives information including first image data and second image data based on handwritten input data from another electronic device. A step of combining the first image data and the second image data, causing the display panel to display an image based on the combined image data, and displaying an image based on the combined image data. A step of accepting handwritten input data via the display panel, a step of transmitting the received handwritten input data to another electronic device, and information on a plurality of items related to the information, check boxes for each item And a step for changing the state of each check box to a checked state or an unchecked state, and The state information indicates the state of Kkubokkusu, and a step of transmitting to the another electronic device.

(8) By specifying an object displayed on one display device, the electronic device can acquire data related to the object from another electronic device and display an image based on the data on the other display device. The effect that becomes.

<< Third Specific Realization Example >>
The purpose of this implementation example is an electronic device, a communication system, a data communication method, a display control method, and a program capable of displaying handwritten input data input in an electronic device in at least an appropriate size in another electronic device Is to provide.

<Outline of communication system>
FIG. 46 is a diagram showing a schematic configuration of the communication system 1B. Referring to FIG. 46, communication system 1B includes electronic device 100β and electronic device 12000. Electronic device 12000 is configured as a portable device having a communication function and a display function, such as a portable phone, a PDA, and a notebook personal computer.

In the following description, the electronic device 100β is a laptop personal computer and the electronic device 12000 is a mobile phone. In the following, it is assumed that the electronic device 100β is disposed in an office or the like. On the other hand, the electronic device 12000 is assumed to be brought by the user to the destination.

The electronic device 100β has the configuration and functions shown in FIGS. 2 to 18 as with the electronic devices 100 and 100α. Therefore, the contents described with reference to FIGS. 2 to 18 are not repeated here.

The electronic device 100β and the electronic device 12000 perform bidirectional communication by executing a dedicated application. For example, the electronic device 100β is in a standby state with the application activated. On the other hand, when the electronic device 12000 needs to communicate with the electronic device 100β, the dedicated application stored in the electronic device 12000 is activated by the user.

In addition, the electronic device 100β and the electronic device 12000 directly transmit / receive data to / from each other via the network by using the IP address assigned to the electronic device 100β and the electronic device 12000. That is, the electronic devices 100β and 12000 included in the communication system 1B constitute a so-called P2P type network.

In the following, in the communication between the electronic device 100β and the electronic device 12000, transmission of image data to the counterpart device is performed using the operation key 177 of the electronic device 100β or the operation key of the electronic device 12000 (see FIG. 47). It is assumed that this is performed by pressing a predetermined key.

<Appearance of Electronic Device 12000>
FIG. 47 is a diagram illustrating an appearance of the electronic device 12000. Referring to FIG. 47, electronic device 12000 includes a microphone 2105, operation keys 2107, a liquid crystal panel 2108, an earphone 2109, and a camera (not shown).

The electronic device 12000 includes a first housing 2000A and a second housing 2000B. The first housing 2000A and the second housing 2000B are foldably connected by a hinge 2000C. The first housing 2000A includes a liquid crystal panel 2108 and an earphone 2109. Second housing 2000B includes operation keys 2107, a microphone 2105, and a camera.

Note that the electronic device 12000 is not necessarily limited to a foldable device. For example, the electronic device 12000 may be a straight type device. Alternatively, the electronic device 12000 may be a slide type device.

<Hardware Configuration of Electronic Device 12000>
FIG. 48 is a diagram illustrating a hardware configuration of the electronic device 12000. Referring to FIG. 48, electronic device 12000 includes CPU 2100, RAM 2101, ROM 2102, communication unit 2103, camera 2104, microphone 2105, speaker 2106, operation key 2107, liquid crystal panel 2108, and earphone 2109. Including. Each component is mutually connected by a data bus DB3.

CPU 2100 executes a program. The operation key 2107 receives an instruction input from the user of the electronic device 12000. The RAM 2101 volatilely stores data generated by execution of a program by the CPU 2100 or data input via the operation keys 2107. The ROM 2102 stores data in a nonvolatile manner. The ROM 2102 is a ROM capable of writing and erasing such as an EPROM and a flash memory. The communication unit 2103 performs wireless communication with other electronic devices (not shown). Although not shown in FIG. 48, the electronic device 12000 may include an interface (IF) for connecting to another electronic device by wire.

The camera 2104 captures a subject according to the operation of the user's operation keys. The image data of the photographed subject is stored in the RAM 2102 or an external memory (for example, a memory card).

The microphone 2105 receives user's voice input. The electronic device 12000 digitizes the input voice (analog data). Electronic device 12000 then sends the digitized voice to a communication partner (for example, another mobile phone).

Speaker 2106 outputs, for example, music data stored in RAM 2101. Earphone 2109 outputs the voice transmitted from the communication partner.

The liquid crystal panel 2108 displays an image stored in the ROM 2102 or the RAM 2101. The liquid crystal panel 2108 displays an image taken by the camera 2104, for example. Further, the liquid crystal panel 2108 displays an image transmitted from the electronic device 100β. The contents displayed on the liquid crystal panel 2108 will be described later.

The liquid crystal panel 2108 is a liquid crystal pen tablet in which a liquid crystal display is integrated with the pen tablet. Therefore, electronic device 12000 can accept handwritten input data of a line image via liquid crystal panel 2108. Electronic device 12000 displays the input handwritten input data via liquid crystal panel 2108.

Note that the electronic device 12000 may include a device in which a display panel other than the liquid crystal panel (for example, an organic EL) and a tablet are integrated instead of the liquid crystal panel 2108. Alternatively, the electronic device 12000 may be configured to include a photosensor liquid crystal panel instead of the liquid crystal panel 2108.

By the way, the processing in the electronic device 12000 is realized by each hardware and software executed by the CPU 2100. Such software may be stored in the ROM 2102 in advance. The software may be stored in a storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium or downloaded via the communication unit 2103 or the communication IF (not shown) and then temporarily stored in the ROM 2102. The software is read from the ROM 2102 by the CPU 2100 and stored in the RAM 2101 in the form of an executable program. CPU 2100 executes the program.

Each component constituting the electronic device 12000 shown in FIG. 48 is a general one. Therefore, it can be said that the essential part of the present invention is RAM 2101, ROM 2102, software stored in the storage medium, or software that can be downloaded via a network. Since the hardware operation of electronic device 12000 is well known, detailed description will not be repeated.

The storage medium is not limited to a memory card, but is a CD-ROM, FD, hard disk, magnetic tape, cassette tape, optical disk (MO / MD / DVD), IC card (excluding a memory card), optical card, mask ROM Further, a medium for storing a program in a fixed manner such as a semiconductor memory such as an EPROM, an EEPROM, or a flash ROM may be used.

The program here includes not only a program directly executable by the CPU but also a program in a source program format, a compressed program, an encrypted program, and the like.

<Functional Block of Electronic Device 100β>
FIG. 49 is a functional block diagram of the electronic device 100β. Referring to FIG. 49, electronic device 100β includes a control unit 4910, liquid crystal panels 140 and 240, and a storage device 90.

The storage device 90 is built in the electronic device 100β. The storage device 90 includes a VRAM 91 and a database 92. The storage device 90 is composed of, for example, RAMs 171 and 271. Note that the storage device 90 is not necessarily built in the electronic device 100β. The storage device 90 may be a device externally connected to the electronic device 100β.

The control unit 4910 includes a reception unit 4911, a search unit 4912, a display control unit 4913, a reception unit 4914, an image generation unit 4915, a position detection unit 4916, and a transmission unit 4917. The display control unit 4913 includes a range determination unit 4931. The image generation unit 4915 includes a ratio calculation unit 4951.

The receiving unit 4911 receives the image data transmitted from the electronic device 12000. For example, the receiving unit 4911 receives image data of a subject captured by the camera 2104 of the electronic device 12000. The receiving unit 4911 sends the received image data to the display control unit 4913. In addition, the reception unit 4911 receives first related information associated with the image data from the electronic device 12000. The reception unit 4911 sends the first related information to the search unit 4912.

In the following, the image data transmitted from the electronic device 12000 is referred to as “first image data”. In the present embodiment, the case where the first image data is motorcycle image data will be described as an example. The first related information is, for example, information for specifying a motorcycle model.

The search unit 4912 searches the database stored in the storage device 90 for the second related information associated with the first related information. The search unit 4912 sends the searched second related information to the display control unit 4913. The second related information is, for example, detailed information of the specified motorcycle model. The detailed information is, for example, information used when making a purchase assessment of the motorcycle. A specific example of the detailed information will be described later (FIG. 53).

Display control unit 4913 causes liquid crystal panel 140 and / or liquid crystal panel 240 to display an image. For example, the display control unit 4913 displays an image (hereinafter also referred to as “first image”) based on the first image data received by the receiving unit 4911 via the liquid crystal panel 240. The display control unit 4913 displays the second related information via the liquid crystal panel 140.

Note that the first image is an image displayed on the liquid crystal panel 240, and is a part or all of an entire image that is an image displaying the entire first image data.

The range determination unit 4931 determines the range of the first image in the entire image in accordance with an instruction from the user (for example, an instruction to enlarge or reduce the display image). That is, the range determination unit 4931 determines an image (that is, the first image) to be displayed on the liquid crystal panel 240 among the entire images. In addition, the range determination unit 4931 sends range information indicating the above range to the transmission unit 4917.

The display control unit 4913 causes the liquid crystal panel 240 to display the first image specified in the above range.

Note that image data to be displayed on the liquid crystal panel 140 and / or the liquid crystal panel 240 by the display control unit 4913 is stored in the VRAM 91 of the storage device 90.

The accepting unit 4914 accepts handwritten input data such as line image data via the liquid crystal panel 240. When the first image based on the received first image data is displayed on the liquid crystal panel 240, the reception unit 4914 displays the line image data or the like via the liquid crystal panel 240 while the first image is displayed. Accepts input data. The reception unit 4914 sends the received handwritten input data to the display control unit 4913, the image generation unit 4915, and the position detection unit 4916.

When the handwriting input data is received from the receiving unit 4914, the display control unit 4913 receives the input image data of the first image displayed on the liquid crystal panel 240 (image data stored in the VRAM 91), and Composite image data is generated by combining handwritten input data. The display control unit 4913 causes the liquid crystal panel 240 to display a composite image based on the composite image data.

Also, the display control unit 4913 sends information indicating the display position of the first image in the image display area of the liquid crystal panel 240 to the position detection unit 4916.

For example, when the first image is displayed in the upper half of the image display area (the area on the hinge 100C side), the display control unit 4913 sends information indicating the upper half to the position detection unit 4916. When the first image is displayed over the entire image display area, the display control unit 4913 sends information indicating the entire image to the position detection unit 4916.

The image generation unit 4915 generates second image data to be transmitted to the electronic device 12000 based on the handwriting input data. Hereinafter, the generation of the second image data will be described.

The ratio calculation unit 4951 calculates the ratio of the image size of the displayed first image to the image size of the received first image data.

For example, when the image size of the first image data is 1280 dots wide × 960 dots high and the image size of the first image is 480 dots wide × 320 dots high, the ratio calculation unit 4951 calculates the ratio in the horizontal direction. Is 3/8 and the ratio in the vertical direction is 1/3.

In addition, when the image size of the first image data is 1280 dots wide × 960 dots high and the image size of the first image is 640 dots wide × 480 dots high, the ratio calculation unit 4951 calculates the ratio in the horizontal direction. Is set to 1/2 and the ratio in the vertical direction is set to 1/2. In this case, assuming that the resolution of the liquid crystal panel 240 is 480 horizontal dots × 320 vertical dots, a part of the entire image of the first image data is displayed on the liquid crystal panel 240 as the first image.

The image generation unit 4915 changes the data amount of the handwriting input data based on the horizontal ratio and the vertical ratio obtained by the ratio calculation unit 4951. The image generation unit 4915 generates the second image data by changing the data amount. When the handwriting input data is image data in a bitmap format or the like, the image generation unit 4915 changes the image size by changing the data amount of the handwriting input data.

For example, when the ratio in the vertical direction and the ratio in the horizontal direction are doubled, the image generation unit 4915 doubles the data amount in the vertical direction and the data amount in the horizontal direction of the handwriting input data, respectively, thereby Generate image data. In order to increase the data amount, a known data interpolation technique is used.

Then, the image generation unit 4915 sends the generated second image data to the transmission unit 4917.
The position detector 4916 detects the input position of the handwriting input data with respect to the first image. Specifically, the position detection unit 4916 detects the input position of the handwriting input data with respect to the first image based on the information indicating the display position received from the display control unit 4913. That is, the position detection unit 4916 detects the relative positional relationship between the first image and an image based on the handwriting input data (hereinafter also referred to as “handwriting image”).

The position detection unit 4916 sends information indicating the detected input position (hereinafter also referred to as “position information”) to the transmission unit 4917.

The transmission unit 4917 transmits the second image data to the electronic device 12000. The transmission unit 4917 transmits the range information and the position information to the electronic device 12000 in association with the second image data.

<Functional Block of Electronic Device 12000>
FIG. 50 is a functional block diagram of the electronic device 12000. Referring to FIG. 50, electronic device 12000 includes a control unit 12010, a liquid crystal panel 2108, a camera 2104, and a storage device 2090. The storage device 2090 includes a VRAM 2091. Note that the storage device 2090 includes a RAM 2101.

The control unit 12010 includes a transmission unit 12011, a reception unit 12012, a display control unit 12013, a reception unit 12014, an image generation unit 12015, and a position detection unit 12016. The display control unit 12013 includes a range determination unit 12031. The image generation unit 12015 includes a ratio calculation unit 12051.

The transmission unit 12011 reads out the image data stored in the storage device 2090 from the storage device 2090. The transmission unit 12011 transmits the read image data (that is, first image data) to the electronic device 100β. The first image data is, for example, image data of a subject photographed by the camera 2104. Alternatively, the first image data is image data acquired from another electronic device.

The receiving unit 12012 receives the second image data transmitted from the electronic device 100β. The receiving unit 12012 receives the position information from the electronic device 100β. Furthermore, the receiving unit 12012 receives the range information from the electronic device 100β.

The receiving unit 12012 sends the second image data, the position information, and the range information to the display control unit 12013.

The display control unit 12013 causes the liquid crystal panel 2108 to display an image. The display control unit 12013 changes the image data captured by the camera to an image size suitable for the liquid crystal panel 2108, and displays the image having the changed image size on the liquid crystal panel 2108. For example, consider a case where image data taken by a camera is 1280 dots wide × 960 dots high and the resolution of the liquid crystal panel 2108 is 320 dots wide × 240 dots high. In this case, the display control unit 12013 changes the size of the image data captured by the camera to 320 × 240 dots and causes the liquid crystal panel 2108 to display the changed image data.

When the handwriting input data is received from the receiving unit 12014, the display control unit 12013 displays the image data (image data stored in the VRAM) of the image displayed on the liquid crystal panel that has received the input, and the hand The combined image data is generated by combining the input data. The display control unit 12013 causes the liquid crystal panel 2108 to display a composite image based on the composite image data.

Further, when the second image data, the position information, and the range information are sent from the receiving unit 12012, the display control unit 12013 performs the following processing. That is, the display control unit 12013 synthesizes the first image data transmitted from the electronic device 12000 and the second image data using the position information and the range information, thereby generating composite image data. The display control unit 12013 causes the liquid crystal panel 2108 to display a composite image based on the composite image data.

The accepting unit 12014 accepts handwriting input data via the liquid crystal panel 2108. The accepting unit 12014 accepts handwriting input data via the liquid crystal panel 2108 regardless of whether the composite image is displayed. Then, the received handwritten input data is sent to the display control unit 12013.

The ratio calculation unit 12051, the position detection unit 12016, and the range determination unit 12031 have the same functions as the ratio calculation unit 4951, the position detection unit 4916, and the range determination unit 4931 described based on FIG. 49, respectively. The description here will not be repeated.

The image generation unit 12015 generates third image data to be transmitted to the electronic device 100β based on the handwriting input data.

The image generation unit 12015 changes the data amount of the handwriting input data based on the vertical ratio and the horizontal ratio obtained by the ratio calculation unit 12051. The image generation unit 12015 generates the third image data by changing the data amount. When the handwriting input data is image data in a bitmap format or the like, the image generation unit 12015 changes the image size by changing the data amount of the handwriting input data.

The transmission unit 12011 transmits the third image data generated by the image generation unit 12015 to the electronic device 100β. The transmission unit 12011 transmits the position information transmitted from the position detection unit 12016 and the range information transmitted from the range determination unit 12031 to the electronic apparatus 100β in association with the third image data. .

<About screen transition>
Next, contents displayed on liquid crystal panels 140 and 240 of electronic device 100β and contents displayed on liquid crystal panel 2108 of electronic device 12000 when communication is performed between electronic device 100β and electronic device 12000. ,explain.

In the following description of screen transition, a case where the entire subject photographed by the camera 2104 is displayed on the electronic device 12000 will be described as an example. Further, the case where the first image is the entire image of the entire image will be described as an example. That is, the case where the entire subject is displayed on the electronic device 100β will be described as an example.

FIG. 51 is a diagram showing an image displayed on the liquid crystal panel 2108 of the electronic device 12000 when a camera 2104 is used to photograph a motorcycle. Electronic device 12000 transmits the image data of the motorcycle to electronic device 100β.

FIG. 52 is a diagram illustrating an image displayed on the electronic device 12000 and the electronic device 100β after the electronic device 12000 transmits the image data of the Dubai (that is, the first image data) to the electronic device 100β. Referring to FIG. 52, electronic device 100β displays a first image based on the first image data transmitted from electronic device 12000 on liquid crystal panel 240. Accordingly, the same image is displayed on the liquid crystal panel 240 of the electronic device 100β and the liquid crystal panel 2108 of the electronic device 12000. Note that the display size of the image depends on the resolution of the liquid crystal panel. Therefore, the image display size on the liquid crystal panel 240 does not necessarily match the image display size on the liquid crystal panel 2108.

FIG. 53 is a diagram showing an image displayed on the liquid crystal panels 140 and 240 of the electronic device 100β after the search by the search unit 4912 of the electronic device 100β is executed. Referring to FIG. 53, an image based on the second related information is displayed on liquid crystal panel 140. When the model name of the motorcycle is “XYZ400”, the electronic device 100β causes the liquid crystal panel 140 to display detailed information on “XYZ400”.

As described above, the electronic device 100β displays the image based on the second related information, so that the user of the electronic device 100β does not need to input a command for specifying the motorcycle model name to the electronic device 100β. Therefore, the convenience of the electronic device 100β is enhanced.

FIG. 54 is a diagram showing images displayed on electronic device 12000 and electronic device 100β when the user of electronic device 100β performs handwriting input via liquid crystal panel 240 in the state of FIG. . As handwriting input, an electronic device includes a figure E0 that specifies the position of a scratch, a character E2 such as “scratch”, a character E3 that indicates a reduction in assessment based on the scratch, and a graphic E4 that decorates the character E3. Suppose that it is input to 100β.

Referring to FIG. 54, electronic device 100β displays on LCD panel 240 the graphic E0, character E2, character E3, and graphic E4 that are input as described above, superimposed on the motorcycle image.

Note that the user of the electronic device 100β refers to the detailed information displayed on the liquid crystal panel 140 and inputs the character E3 indicating the reduction of the assessment into the electronic device 100β.

FIG. 55 is a diagram schematically showing second image data transmitted from the electronic device 100β to the electronic device 12000. Referring to FIG. 55, electronic device 100β transmits graphic E0, character E2, character E3, and graphic E4 to electronic device 12000. The electronic device 100β does not transmit motorcycle image data to the electronic device 12000.

56 shows a case where the electronic device 12000 receives the handwriting input data and the position information from the electronic device 100β, and the display control unit 12013 generates the above-described composite image data. It is the figure which showed the image displayed.

Referring to FIG. 56, electronic device 12000 uses the above position information to indicate the relative position of the second image data with respect to the motorcycle image shown on liquid crystal panel 2108 and the liquid crystal panel 240 shown in FIG. 54. The relative position of the handwriting input data with respect to the motorcycle image can be matched.

Thereby, the user of the electronic device 100β and the user of the electronic device 12000 can confirm images of the same content on each liquid crystal panel, although the display sizes are not necessarily the same.

57 shows the electronic device 100β when the third image data generated in the electronic device 12000 is transmitted to the electronic device 100β after the image shown in FIG. 56 is displayed on the liquid crystal panel 2108 of the electronic device 12000. FIG. 11 is a diagram showing an image displayed on electronic device 12000.

In electronic device 12000, when figure E0 that specifies the position of a crack and character E12 such as “crack” are input, electronic device 100β causes liquid crystal panel 240 to display a screen having the same content as liquid crystal panel 2108 of electronic device 12000. Is displayed. That is, electronic device 100β causes liquid crystal panel 240 to display an image in which graphic E11 and character E12 are combined with the image shown in FIG.

FIG. 58 shows the electronic device 100β and the electronic device 12000 when the second image data is transmitted from the electronic device 100β to the electronic device 12000 after the image shown in FIG. 57 is displayed on the liquid crystal panel 240 and the liquid crystal panel 2108. FIG.

In the electronic device 100β, when the character E21 indicating the reduction of the assessment based on the crack and the figure E22 decorating the character E21 are input, the electronic device 12000 displays the liquid crystal panel 240 of the electronic device 100β on the liquid crystal panel 2108. Display the same screen. That is, the electronic device 12000 displays on the liquid crystal panel 2108 an image obtained by combining the character E21 and the graphic 22 with the image shown in FIG.

As described above, the electronic device 100β and the electronic device 12000 can display images having the same contents on the liquid crystal panels 240 and 2108 by P2P communication. For this reason, when making a purchase evaluation of a motorcycle, a user of electronic device 12000 who actually determines the state of the actual product by visually observing the actual product (motorcycle) affects the assessed value for the user of electronic device 100β. I can contact you. On the other hand, the user of the electronic device 100β can transmit matters relating to the assessed amount to the user of the electronic device 12000 by confirming the detailed information.

As described above, the communication system 1B allows the user of the electronic device 12000 to make a purchase assessment in cooperation with the electronic device 100β in the office while viewing the actual product on the site.

In addition, the user who sees the actual product does not need to bring detailed information about the model of the Dubai to the site. For this reason, it is possible to make a purchase assessment with high accuracy without having to have detailed information on site.

In addition, detailed information will not be lost on the site or the route to the site. For this reason, security can be ensured by using the communication system 1B.

Also, the electronic device 100β displays the image data received from the electronic device 12000 on the liquid crystal panel 240. Furthermore, the electronic device 100β displays data in the database related to the image data on the liquid crystal panel 140. Therefore, even if the electronic device 100β displays the received image data, the visibility of the detailed information does not deteriorate. Therefore, purchase assessment can be performed efficiently.

<About Sequence in Communication System 1B>
FIG. 59 is a diagram showing a sequence between the electronic device 100β and the electronic device 12000 in the communication system 1B. Specifically, FIG. 59 is a diagram illustrating a sequence related to the processing described based on FIGS.

In step S41, the electronic device 12000 transmits the first image data to the electronic device 100β. In step S42, electronic device 12000 transmits the first related information (that is, information for specifying the model of motorcycle) to electronic device 100β.

In step S43, the electronic device 100β transmits the second image data to the electronic device 12000. As described above, electronic device 100β transmits position information and range information in association with the second image data. Specifically, electronic device 100β transmits graphic E0, character E2, character E3, and graphic E4 shown in FIG. 55 to electronic device 12000.

In step S44, the electronic device 12000 transmits the third image data to the electronic device 100β. Electronic device 12000 sends position information and range information in association with the third image data, as described above. Specifically, electronic device 12000 transmits the character and graphic (see FIG. 57) after the sizes of graphic E11 and character E12 are changed to electronic device 100β.

In step S45, the electronic device 100β transmits to the electronic device 12000 second image data having a content different from that of the second image data transmitted in step S43. As described above, electronic device 100β transmits position information and range information in association with the second image data. Specifically, electronic device 100β transmits to electronic device 12000 the characters and graphics after the sizes of character E21 and graphic E22 shown in FIG.

<Processing Flow in Electronic Device 100β>
FIG. 60 is a flowchart showing a data processing flow in electronic device 100β.

Referring to FIG. 60, in step S51, electronic device 100β receives first image data and first related information from electronic device 12000. In step S52, the electronic device 100β displays a first image based on the received first image data on the liquid crystal panel 240. In step S53, the electronic device 100β searches the database using the first related information. In step S54, the electronic device 100β displays the search result (that is, the second related information) on the liquid crystal panel 140.

In step S55, the electronic device 100β determines whether or not handwriting input data is received via the liquid crystal panel 240. When it is determined that the handwriting input data is received (Yes in step S55), in step S56, the electronic device 100β transmits the second image data, the position information, and the range information to the electronic device 12000. On the other hand, when it is determined that handwriting input data is not received (No in step S55), CPU 110 advances the process to step S59.

In step S57, the electronic device 100β determines whether the third image data is received from the electronic device 12000. If it is determined that the image has been received (Yes in step S57), in step S58, electronic device 100β superimposes and displays an image based on the received third image data on the image displayed on liquid crystal panel 240. That is, the electronic device 100β performs an image composition process. On the other hand, when determining that it has not been received (No in step S57), CPU 110 advances the process to step S59.

In step S59, the electronic device 100β determines whether or not communication with the electronic device 12000 has ended. When it is determined that the communication has ended (Yes in step S59), CPU 110 ends the series of processes. On the other hand, when it is determined that the communication has not ended (No in step S59), CPU 110 returns the process to step S55.

<Processing Flow in Electronic Device 12000>
FIG. 61 is a flowchart showing a flow of data processing in electronic device 12000.

Referring to FIG. 61, in step S61, electronic device 12000 uses a camera 2104 to photograph a motorcycle that is a subject. In step S <b> 62, electronic device 12000 accepts input of first related information via operation key 2107. In step S63, the electronic device 12000 transmits the first image data obtained by photographing and the first related information to the electronic device 100β.

In step S64, the electronic device 12000 determines whether the second image data, the position information, and the range information are received from the electronic device 100β. If it is determined that it has been received (Yes in step S64), the received second image data is superimposed on the image displayed on the liquid crystal panel 2108 in step S65. That is, the electronic device 12000 performs image composition processing. On the other hand, when it is determined that the data has not been received (No in step S64), CPU 2100 advances the process to step S68.

In step S66, electronic device 12000 determines whether or not handwriting input data is received via liquid crystal panel 2108. When it is determined that the handwriting input data is received (Yes in step S66), in step S67, the electronic device 12000 displays the third image data generated based on the handwriting input data, the position information, and the range information. Is transmitted to the electronic device 100β. On the other hand, when it is determined that the handwriting input data is not received (No in step S66), the process proceeds to step S68.

In step S68, electronic device 12000 determines whether or not communication with electronic device 100β has ended. If it is determined that the communication has ended (Yes in step S68), CPU 2100 ends the series of processes. On the other hand, when it is determined that communication has not ended (No in step S68), CPU 2100 returns the process to step S64.

<Modification of Configuration of Communication System 1B>
FIG. 62 is a diagram illustrating functional blocks of an electronic device 3500 that is a modified example of the electronic device 100β.

62, electronic device 3500 includes a control unit 4910A, liquid crystal panels 140 and 240, and a storage device 90. Control unit 4910A includes a reception unit 4911, a search unit 4912, a display control unit 4913A, a reception unit 4914A, an image generation unit 4915A, a transmission unit 4917A, and an image composition unit 4918. In the electronic device 3500, the same members as those of the electronic device 100β are denoted by the same member numbers, and the description of the members will not be repeated.

The display control unit 4913A is different from the display control unit 4913 that sends the range determined by the range determination unit 4931 to the transmission unit 4917 in that the range determined by the range determination unit 4931 is not sent to the transmission unit 4917A. In addition, since the electronic device 3500 does not include the position detection unit 4916, the display control unit 4913A does not send the information indicating the display position to the position detection unit 4916. Except for these differences, the display control unit 4913A has the same function as the display control unit 4913.

Further, as described above, since electronic device 3500 does not include position detection unit 4916, reception unit 4914A does not send the handwriting input data to position detection unit 4916. Except for this difference, the display control unit 4913A has the same function as the display control unit 4913.

The image generation unit 4915A differs from the image generation unit 4915 that sends the generated image to the transmission unit 4917 in that the generated image is sent to the image composition unit 4918. Except for this difference, the image generation unit 4915A has the same function as the image generation unit 4915.

Next, the image composition unit 4918 will be described. The image composition unit 4918 synthesizes the first image data received from the electronic device 12000 and the second image data generated by the image generation unit 4915A to generate composite image data. The image composition unit 4918 sends the composite image data to the transmission unit 4917A.

The transmission unit 4917A transmits the composite image data to the electronic device 12000.
On the other hand, similarly to the electronic device 100β, the electronic device 12000 is configured to transmit the composite image data synthesized by the electronic device 12000 to the electronic device 100β.

As described above, even when the electronic device 100β and the electronic device 12000 transmit the composite image data to each other, the same effect as that obtained by the communication system 1B can be obtained.

<Modification of Communication Method in Communication System 1B>
By the way, in the communication system 1B, P2P type communication was performed. In the communication system 1B, communication via electronic mail may be used instead of the P2P type communication.

When using e-mail, the electronic device 12000 may attach the image data of the subject photographed by the camera 2104 to the e-mail and transmit the e-mail to the electronic device 100β. The electronic device 12000 may store the first related information in the text field or the title data field of the electronic mail and transmit the electronic mail to the electronic device 100β. The electronic device 100β may transmit an electronic mail attached with the composite image data to the electronic device 12000.

<Appendix>
(1) The electronic device includes a first display panel, a receiving unit that receives first image data transmitted from another electronic device, and a first based on the first image data received via the first display panel. A display control unit for displaying an image, a reception unit for receiving handwritten input data via the first display panel in a state where the first image is displayed, and generating second image data based on the received handwritten input data And a transmission unit that transmits the generated second image data to another electronic device.

In addition, the generation unit includes a ratio calculation unit that calculates a ratio of the image size of the displayed first image to the image size of the received first image data, and calculates the data amount of the handwriting input data based on the calculated ratio. It is preferable to generate the second image data by changing.

Further, it is preferable that a position detection unit that detects an input position of handwritten input data with respect to the first image is further provided, and the transmission unit further transmits position information indicating the input position in association with the second image data.

Further, the first image is a part or all of the entire image that is an image displaying the entire first image data, and the display control unit determines a range of the first image in the entire image. Preferably, the transmission unit further transmits range information indicating the range in association with the second image data.

(2) The electronic device includes a first display panel, a receiving unit that receives first image data transmitted from another electronic device, and a first based on the first image data received via the first display panel. A display control unit for displaying an image, a reception unit for receiving handwritten input data via the first display panel in a state where the first image is displayed, and generating second image data based on the received handwritten input data A generating unit that combines the first image data and the second image data to generate combined image data, and a transmitting unit that transmits the generated combined image data to another electronic device.

The receiving unit further receives first related information associated with the first image data from another electronic device, and the electronic device is stored in a database stored in a storage device built in or externally connected to the electronic device. A search unit for searching for the second related information associated with the first related information, and a second display panel, wherein the display control unit displays the second related information via the second display panel. Is preferred.

The first display panel includes a plurality of photosensor circuits that generate electrical signals in response to incident light and a plurality of pixel circuits that emit light in response to the electrical signals, and the reception unit includes a plurality of photosensor circuits. Preferably, the handwriting input data is received based on the electric signal from the display, and the display control unit displays the first image and the handwriting image based on the handwriting input data on the plurality of pixel circuits.

(3) The electronic device includes a display panel, a storage device that stores the first image data, a transmission unit that reads the first image data from the storage device, and transmits the read first image data to another electronic device. The reception unit that receives the second image data based on the handwriting input data transmitted from another electronic device, and the read first image data and the received second image data are combined to generate the combined image. A display control unit that displays an image based on the data via the display panel.

(4) The communication system includes a first electronic device and a second electronic device. Each of the first electronic device and the second electronic device includes a display panel, and the first electronic device transmits from the second electronic device. A first reception unit that receives the first image data, a first display control unit that displays a first image based on the received first image data via a display panel of the first electronic device, and a first image Is displayed, a receiving unit that receives handwritten input data via the display panel of the first electronic device, a generating unit that generates second image data based on the received handwritten input data, and a generated second A first transmission unit configured to transmit image data to the second electronic device. The second electronic device reads out the first image data from the storage device that stores the first image data and stores the first image data in the first electronic device. The read first image data is transmitted. 2 transmitting unit, a second receiving unit that receives the second image data transmitted from the first electronic device, and the read first image data and the received second image data are combined, and the combined image data And a second display control unit that displays an image based on the display panel.

(5) The data communication method is a data communication method in an electronic device, the step of receiving first image data transmitted from another electronic device, and the first image data received via the display panel. A step of displaying the first image; a step of receiving handwriting input data via the display panel in a state where the first image is displayed; and a step of generating second image data based on the received handwriting input data And transmitting the generated second image data to another electronic device.

(6) The data communication method is a data communication method in an electronic device, the step of receiving first image data transmitted from another electronic device, and the first image data received via the display panel. A step of displaying the first image; a step of receiving handwriting input data via the display panel in a state where the first image is displayed; and a step of generating second image data based on the received handwriting input data The first image data and the second image data are combined to generate combined image data, and the generated combined image data is transmitted to another electronic device.

(7) The display control method is a display control method in an electronic device, and reads the first image data from the storage device, transmits the read first image data to another electronic device, and the other electronic device. Receiving the second image data based on the handwritten input data transmitted from the step, combining the read first image data and the received second image data to generate composite image data; Displaying a composite image based on the generated composite image data via a display panel.

(8) The program is a program for causing a computer to execute the above method.

(9) The handwriting input data input in a state where the image data is displayed on the electronic device can be displayed on other electronic devices.

<< Fourth Specific Implementation Example >>
The purpose of this implementation example is an electronic device, a communication system, a data communication method, and a display control method that allow handwriting input data input in a state where a map screen is displayed on the electronic device to be displayed on the other electronic device. , And to provide a program.

<Outline of communication system>
FIG. 63 is a diagram showing a schematic configuration of the communication system 1C. Referring to FIG. 63, communication system 1C includes electronic device 100γ, electronic device 22000, GPS (Global Positioning System) satellite 8000, and server device 19000. Electronic device 22000 is configured as a portable device having a communication function and a display function, such as a portable phone, a PDA, and a laptop personal computer. In the following description, the case where electronic device 100γ is a notebook personal computer and electronic device 22000 is a mobile phone will be described as an example.

The electronic device 100γ has the configuration and functions shown in FIGS. 2 to 18 in the same manner as the electronic devices 100, 100α, and 100β. Therefore, the contents described with reference to FIGS. 2 to 18 are not repeated here.

The electronic device 100γ and the electronic device 22000 directly transmit / receive data to / from each other via a network by using an IP address assigned to the electronic device 100γ and the electronic device 22000. That is, the electronic devices 100γ and 22000 included in the communication system 1C constitute a so-called P2P type network.

In the following, in communication between the electronic device 100γ and the electronic device 22000, transmission of image data to the counterpart device is performed using the operation key 177 of the electronic device 100γ or the operation key of the electronic device 22000 (see FIG. 64). It is assumed that this is performed by pressing a predetermined key.

GPS satellite 8000 transmits various signals including time information and orbit information to the ground. The server device 19000 stores map data. Upon receiving the map data transmission instruction, server apparatus 19000 transmits map data related to the instruction to the electronic device that issued the instruction. Note that the electronic device 22000 may be configured to receive various signals from the positioning satellite. That is, the positioning satellite used in the communication system 1C is not limited to the GPS satellite.

<Appearance of Electronic Device 22000>
FIG. 64 is a diagram illustrating an appearance of the electronic device 22000. Referring to FIG. 64, electronic device 22000 includes a microphone 2105, operation keys 2107, a liquid crystal panel 2108, an earphone 2109, and a camera (not shown).

The electronic device 22000 includes a first casing 2000A and a second casing 2000B. The first housing 2000A and the second housing 2000B are foldably connected by a hinge 2000C. The first housing 2000A includes a liquid crystal panel 2108 and an earphone 2109. Second housing 2000B includes operation keys 2107, a microphone 2105, and a camera.

Note that the electronic device 22000 is not necessarily limited to a foldable device. For example, the electronic device 22000 may be a straight type device. Alternatively, the electronic device 22000 may be a slide type device.

<Hardware Configuration of Electronic Device 22000>
FIG. 65 is a diagram illustrating a hardware configuration of the electronic device 22000. Referring to FIG. 65, electronic device 22000 includes CPU 2100, RAM 2101, ROM 2102, communication unit 2103, camera 2104, microphone 2105, speaker 2106, operation keys 2107, liquid crystal panel 2108, and earphone 2109. Including. Each component is mutually connected by a data bus DB3.

CPU 2100 executes a program. The operation key 2107 receives an instruction input from the user of the electronic device 22000. The RAM 2101 volatilely stores data generated by execution of a program by the CPU 2100 or data input via the operation keys 2107. The ROM 2102 stores data in a nonvolatile manner. The ROM 2102 is a ROM capable of writing and erasing such as an EPROM and a flash memory. The communication unit 2103 performs wireless communication with other electronic devices (not shown). Although not shown in FIG. 65, the electronic device 22000 may include an interface (IF) for connecting to another electronic device by wire.

The camera 2104 captures a subject according to the operation of the user's operation keys. The image data of the photographed subject is stored in the RAM 2102 or an external memory (for example, a memory card).

The microphone 2105 receives user's voice input. The electronic device 22000 digitizes the input voice (analog data). Electronic device 22000 then sends the digitized voice to a communication partner (for example, another mobile phone).

Speaker 2106 outputs, for example, music data stored in RAM 2101. Earphone 2109 outputs the voice transmitted from the communication partner.

The liquid crystal panel 2108 displays an image stored in the ROM 2102 or the RAM 2101. The liquid crystal panel 2108 displays an image taken by the camera 2104, for example. Further, the liquid crystal panel 2108 displays an image transmitted from the electronic device 100γ. The contents displayed on the liquid crystal panel 2108 will be described later.

The liquid crystal panel 2108 is a liquid crystal pen tablet in which a liquid crystal display is integrated with the pen tablet. Therefore, electronic device 22000 can accept line image handwriting input data via liquid crystal panel 2108. Electronic device 22000 displays handwriting input data on liquid crystal panel 2108.

Note that the electronic device 22000 may include a device in which a display panel other than the liquid crystal panel (for example, an organic EL) and a tablet are integrated instead of the liquid crystal panel 2108. Alternatively, the electronic device 22000 may have a configuration including an optical sensor liquid crystal panel instead of the liquid crystal panel 2108.

Incidentally, the processing in the electronic device 22000 is realized by each hardware and software executed by the CPU 2100. Such software may be stored in the ROM 2102 in advance. The software may be stored in a storage medium and distributed as a program product. Alternatively, the software may be provided as a program product that can be downloaded by an information provider connected to the so-called Internet. Such software is read from the storage medium or downloaded via the communication unit 2103 or the communication IF (not shown) and then temporarily stored in the ROM 2102. The software is read from the ROM 2102 by the CPU 2100 and stored in the RAM 2101 in the form of an executable program. CPU 2100 executes the program.

Each component constituting the electronic device 22000 shown in FIG. 65 is a general one. Therefore, it can be said that the essential part of the present invention is RAM 2101, ROM 2102, software stored in the storage medium, or software that can be downloaded via a network. Since the hardware operation of electronic device 22000 is well known, detailed description will not be repeated.

The storage medium is not limited to a memory card, but is a CD-ROM, FD, hard disk, magnetic tape, cassette tape, optical disk (MO / MD / DVD / Blu-ray (registered trademark) disk / HDDVD (registered trademark) ( High Definition Digital Versatile Disc)), IC card (excluding memory card), optical card, mask ROM, EPROM, EEPROM, flash ROM, and other media such as semiconductor memories may be stored in a fixed medium.

The program here includes not only a program directly executable by the CPU but also a source program format program, a platform-independent intermediate code, a compressed program, an encrypted program, and the like.

<Functional Block of Electronic Device 100γ>
FIG. 66 is a functional block diagram of the electronic device 100γ. Referring to FIG. 66, electronic device 100γ includes a control unit 6610, liquid crystal panels 140 and 240, and a storage device 90.

The storage device 90 is built in the electronic device 100γ. The storage device 90 includes a VRAM 91. The storage device 90 is composed of, for example, RAMs 171 and 271. Note that the storage device 90 is not necessarily built in the electronic device 100γ. The storage device 90 may be a device externally connected to the electronic device 100γ.

The control unit 6610 includes a reception unit 6611, a display control unit 6612, a first reception unit 6613, an image generation unit 6614, a transmission unit 6615, a second reception unit 6616, and an acquisition unit 6617. The image generation unit 6614 includes a ratio calculation unit 6641.

The receiving unit 6611 receives various data transmitted from the electronic device 22000.
For example, the receiving unit 6611 receives position information indicating the current position of the electronic device 22000 from the electronic device 22000. The receiving unit 6611 receives scale information indicating the scale of a map image (hereinafter referred to as “second map image”) including the current position displayed on the electronic device 22000 from the electronic device 22000. Furthermore, the reception unit 6611 receives size information indicating the size of the display area displaying the second map image on the electronic device 22000 from the electronic device 22000.

When receiving the position information, the scale information, and the size information, the receiving unit 6611 sends these pieces of information to the display control unit 6612. In addition, the reception unit 6611 sends the position information to the acquisition unit 6617. Further, the reception unit 6611 receives handwriting input data from the electronic device 22000. When receiving the handwriting input data, the receiving unit 6611 sends the handwriting input data to the display control unit 6612.

The acquisition unit 6617 acquires map data including the current position of the electronic device 22000 from the server device 19000 based on the position information. The acquisition unit 6617 sends the acquired map data to the display control unit 6612.

The display control unit 6612 displays an image on at least one of the liquid crystal panel 140 and the liquid crystal panel 240. The display control unit 6612 displays, for example, a map image (hereinafter referred to as “first map image”) that includes a map area indicated as the second map image based on the position information, the scale information, and the size information. 240 is displayed. In addition, the display control unit 6612 displays the current position of the electronic device 22000 on the first map image based on the position information. Further, the display control unit 6612 further causes the liquid crystal panel 140 to display a third map image including the map area indicated as the first map image based on the position information, the scale information, and the size information.

The first reception unit 6613 receives input of handwriting input data such as line image data via the liquid crystal panel 240 in a state where the first map image is displayed. The first reception unit 6613 sends the received handwritten input data to the display control unit 6612 and the image generation unit 6614.

When the handwriting input data is received from the first receiving unit 6613, the display control unit 6612 receives the input image data of the image displayed on the liquid crystal panel 240 (image data stored in the VRAM 91), and Composite image data is generated by combining handwritten input data. The display control unit 6612 causes the liquid crystal panel 240 to display a composite image based on the composite image data.

In the following, the data of the first map image is referred to as “first map data”. The data of the second map image is referred to as “second map data”. Furthermore, an image displayed on the liquid crystal panels 140, 240, and 2108 is referred to as a “display image”. The display image data is referred to as “display data”.

When the display control unit 6612 receives an instruction to scroll the display image via the operation key 177, the display control unit 6612 performs scrolling according to the instruction. Note that scroll information indicating the direction and amount of scrolling is transmitted to the electronic device 22000 by the transmission unit 6615.

The image generation unit 6614 generates image data to be transmitted to the electronic device 22000 based on the handwriting input data. Hereinafter, generation of the image data will be described.

The ratio calculation unit 6641 calculates the ratio of the size of the display area used for displaying the first map image on the liquid crystal panel 240 to the size of the display area indicated by the size information. For example, the size of the display area of the liquid crystal panel 2108 of the electronic device 22000 is 240 horizontal dots × 400 vertical dots. Further, the size of the display area indicated by the size information is assumed to be 240 horizontal dots × 320 vertical dots. On the other hand, the size of the display area used for displaying the first map image on the liquid crystal panel 240 is assumed to be 180 horizontal dots × 240 vertical dots. In this case, the ratio calculation unit 6641 calculates the horizontal ratio and the vertical ratio as 3/4, respectively.

The image generation unit 6614 changes the data amount of the handwriting input data based on the horizontal ratio and the vertical ratio obtained by the ratio calculation unit 6641. The image generation unit 6614 generates image data by changing the data amount. When the handwritten input data is image data such as a bitmap format, the image generation unit 6614 changes the image size by changing the data amount of the handwritten input data.

For example, when the ratio in the horizontal direction and the ratio in the vertical direction are 3/4 as described above, the image generation unit 6614 sets the data amount in the vertical direction and the data amount in the horizontal direction of the handwriting input data to 4/3, respectively. Image data is generated by doubling. In order to increase the data amount, a known data interpolation technique is used.

Then, the image generation unit 6614 sends the generated image data to the transmission unit 6615.
The transmission unit 6615 transmits the image data generated by the image generation unit 6614 to the electronic device 22000. When the display control unit 6612 receives an instruction to change the display target area of the map image displayed on the liquid crystal panel 240 by the user's operation of the operation key 177 or the like while the first map image is displayed. The transmission unit 6615 transmits area specifying information for specifying the display target area after the change to the electronic device 22000.

The second accepting unit 6616 accepts designation of a partial area in the map area shown as the third map image via an input device such as the operation key 177 or the liquid crystal panel 140. When the second reception unit 6616 receives the designation, the display control unit 6612 causes the liquid crystal panel 240 to display the designated partial area.

<Functional Block of Electronic Device 22000>
FIG. 67 is a functional block diagram of the electronic device 22000. Referring to FIG. 67, electronic device 22000 includes a control unit 22010, a liquid crystal panel 2108, and a storage device 2090. The storage device 2090 includes a VRAM 2091. Note that the storage device 2090 includes a RAM 2101.

The control unit 22010 includes a first acquisition unit 22011, a second acquisition unit 22012, a display control unit 22013, a transmission unit 22014, and a reception unit 22015.

The first acquisition unit 22011 acquires position information indicating the current position of the electronic device 22000 based on various signals received from the GPS satellite 8000. Specifically, the first acquisition unit 22011 calculates the current position of the electronic device 22000 based on various signals received from the plurality of GPS satellites 8000.

The first acquisition unit 22011 sends the acquired position information to the second acquisition unit 22012 and the transmission unit 22014.

Note that the first acquisition unit 22011 may acquire the current position from the base station of the mobile phone instead of acquiring the current position based on the signal from the GPS satellite 8000.

The second acquisition unit 22012 acquires second map data including the current position from the server device 19000 storing the map data based on the position information. The second acquisition unit 22012 sends the acquired second map data to the display control unit 22013.

The display control unit 22013 displays an image on the liquid crystal panel 2108. When receiving the second map data from the second acquisition unit 22012, the display control unit 22013 displays the second map image on the liquid crystal panel 2108 based on the second map data.

Also, the display control unit 22013 sends scale information indicating the scale of the second map image displayed on the liquid crystal panel 2108 to the transmission unit 22014. Furthermore, the display control unit 22013 sends size information indicating the size of the display area displaying the second map image (for example, 240 horizontal dots × 320 vertical dots) to the transmission unit 22014.

The transmission unit 22014 associates the position information, the scale information, and the size information with each other and transmits them to the electronic device 100γ. Hereinafter, the position information, the scale information, and the size information are collectively referred to as “map display information”.

The receiving unit 22015 receives the image data generated by the image generating unit 6614 of the electronic device 100γ. The receiving unit 22015 sends the image data to the display control unit 22013. The display control unit 22013 combines the image data of the second map image and the received image data, and causes the liquid crystal panel 2108 to display an image based on the combined image data.

Further, the receiving unit 22015 receives the scroll information from the electronic device 100γ. When the reception unit 22015 receives the scroll information, the display control unit 22013 scrolls the map image displayed on the liquid crystal panel 2108 according to the scroll information. If the electronic device 22000 determines that it is necessary to newly acquire map data from the server device 19000 as a result of scrolling, the electronic device 22000 acquires map data indicating a map in the scroll direction from the server device 19000. .

In the following description, it is assumed that the map area indicated by the second map image and the map area indicated by the first map image are the same area. That is, in the following, it is assumed that the map image displayed on the liquid crystal panel 240 of the electronic device 100γ and the map image displayed on the liquid crystal panel 2108 of the electronic device 22000 indicate the same area on the map.

<About screen transition>
Next, contents displayed on the liquid crystal panels 140 and 240 of the electronic device 100γ and contents displayed on the liquid crystal panel 2108 of the electronic device 22000 when communication is performed between the electronic device 100γ and the electronic device 22000. ,explain.

FIG. 68 is a diagram showing a case where the electronic device 22000 displays the second map image on the liquid crystal panel 2108. Referring to FIG. 68, on liquid crystal panel 2108, the second map image and information indicating the contents of the soft keys are displayed in separate areas. The figure H10 in the second map image indicates the current position of the electronic device 22000.

FIG. 69 is a diagram showing an image displayed on the electronic device 22000 and the electronic device 100γ after the electronic device 22000 transmits the map display information to the electronic device 100γ. Referring to FIG. 69, electronic device 100γ causes liquid crystal panel 240 to display the first map image. As a result, an image having the same content is displayed on the liquid crystal panel 240 of the electronic device 100γ and the liquid crystal panel 2108 of the electronic device 22000.

Also, the electronic device 100γ causes the liquid crystal panel 140 to display a third map image including the first map image.

FIG. 70 is a diagram showing an image displayed on the electronic device 100γ when the user of the electronic device 100γ performs handwriting input via the liquid crystal panel 240 in the state of FIG. 69. It is assumed that a figure H11 indicating a route is input to the electronic device 100γ as handwriting input.

Referring to FIG. 70, electronic device 100γ displays the input graphic H11 further superimposed on the first map image (that is, the display image) on which graphic H10 is superimposed. The electronic device 100γ sends the image data generated by the image generation unit 6614 based on the figure H11 to the electronic device 22000.

71 shows an image displayed on the liquid crystal panel 2108 of the electronic device 22000 when the electronic device 22000 receives the image data generated based on the figure H11 and the display control unit 22013 generates the above-described composite image data. FIG.

70 and 71, an image having the same content is displayed on the liquid crystal panel 240 of the electronic device 100γ and the liquid crystal panel 2108 of the electronic device 22000. As a result, the user of the electronic device 100γ and the user of the electronic device 22000 can confirm images having the same content on each other's liquid crystal panel.

FIG. 72 is a diagram showing an image displayed on electronic device 100γ when the user of electronic device 100γ further performs handwriting input via liquid crystal panel 240 in the state of FIG. It is assumed that a figure H12 and a character H13 indicating a target point are input to the electronic device 100γ as handwriting input.

72, electronic device 100γ displays the input figure H12 and character H13 further superimposed on the first map image on which figure H10 and figure H11 are superimposed. The electronic device 100γ sends the image data generated by the image generation unit 6614 to the electronic device 22000 based on the figure H12 and the character H13.

FIG. 73 shows the display on the liquid crystal panel 2108 of the electronic device 22000 when the electronic device 22000 receives the image data generated based on the graphic H12 and the character H13 and the display control unit 22013 generates the above-described composite image data. FIG.

72 and 73, the same content image is displayed on the liquid crystal panel 240 of the electronic device 100γ and the liquid crystal panel 2108 of the electronic device 22000. As a result, the user of the electronic device 100γ and the user of the electronic device 22000 can confirm images having the same content on each other's liquid crystal panel.

<About Sequence in Communication System 1C>
FIG. 74 is a diagram showing a sequence among the electronic device 100γ, the electronic device 22000, the GPS satellite 8000, and the server device 19000. Specifically, FIG. 74 is a diagram showing a sequence related to the processing described based on FIGS.

In step S71, the electronic device 22000 receives data such as time information and orbit information from the GPS satellite 8000. In step S72, the electronic device 22000 requests the server apparatus 19000 to transmit map data based on the acquired position information. In step S73, server apparatus 19000 transmits the second map data to electronic device 22000 in accordance with the request.

In step S74, the electronic device 22000 transmits the map display information described above to the electronic device 100γ. In step S75, the electronic device 100γ requests the server device 19000 to transmit map data based on the position information included in the map display information. In step S76, the server apparatus 19000 transmits the first map data to the electronic device 100γ according to the request.

In step S77, electronic device 100γ transmits image data generated based on the handwriting input data (figure H11 in FIG. 70) to electronic device 22000. In step S78, electronic device 100γ transmits image data generated based on the handwriting input data (figure H12 and character H13 in FIG. 72) to electronic device 22000.

Through the above processing, the electronic device 100γ and the electronic device 22000 can display images having the same contents on the liquid crystal panels 240 and 2108 as shown in FIGS.

<Processing Flow in Electronic Device 100γ>
FIG. 75 is a flowchart showing a data processing flow in the electronic device 100γ.

Referring to FIG. 75, in step S81, electronic device 100γ receives map display information related to the second map image from electronic device 22000. When the electronic device 100γ receives the map display information, the electronic device 100γ receives the first map data from the server device 19000 based on the position information included in the map display information. In step S82, the electronic device 100γ displays the first map image on the liquid crystal panel 240 based on the first map data. In step S83, the electronic device 100γ causes the liquid crystal panel 140 to display the third map image including the map area indicated as the first map image.

In step S84, the electronic device 100γ determines whether or not handwriting input data is received via the liquid crystal panel 240. When it is determined that electronic device 100γ has received the handwriting input data (YES in step S84), in step S85, electronic device 100γ displays the display data relating to the image displayed on liquid crystal panel 240, the handwriting input data, and the like. Is synthesized. On the other hand, when it is determined that electronic device 100γ has not received handwriting input data (NO in step S84), CPU 110 advances the process to step S89.

In step S86, the electronic device 100γ displays the synthesized image on the liquid crystal panel 240. In step S87, the electronic device 100γ generates image data to be transmitted to the electronic device 22000 based on the handwriting input data. In step S88, the electronic device 100γ transmits the generated image data to the electronic device 22000.

In step S89, the electronic device 100γ determines whether or not communication with the electronic device 22000 has ended. When it is determined that electronic device 100γ has ended (YES in step S89), CPU 110 ends the series of processes. On the other hand, when it is determined that electronic device 100γ has not ended (NO in step S89), CPU 110 returns the process to step S84.

<Processing Flow in Electronic Device 22000>
FIG. 76 is a flowchart showing a flow of data processing in electronic device 22000.

76, in step S91, electronic device 22000 acquires position information of electronic device 22000 based on various signals received from GPS satellite 8000. In step S92, the electronic device 22000 acquires the second map data from the server device 19000 based on the position information. In step S93, the electronic device 22000 displays a second map image on the liquid crystal panel 2108 based on the acquired second map data. In step S94, the electronic device 22000 transmits map display information to the electronic device 100γ.

In step S95, the electronic device 22000 determines whether image data has been received from the electronic device 100γ. When it is determined that electronic device 22000 has received the image data (YES in step S95), in step S96, electronic device 22000 displays the display data relating to the image displayed on liquid crystal panel 2108 and the received image data. Synthesize. On the other hand, when it is determined that electronic device 22000 has not received image data (NO in step S96), CPU 2100 advances the process to step S98.

In step S97, the electronic device 22000 displays the synthesized image on the liquid crystal panel 2108. In step S98, electronic device 22000 determines whether or not communication with electronic device 100γ has ended. If it is determined that electronic device 22000 has ended (YES in step S98), CPU 2100 ends the series of processing. On the other hand, when it is determined that electronic device 22000 has not ended (NO in step S98), CPU 2100 returns the process to step S95.

<Summary>
As described above, the electronic device 100γ sends the image data generated by the image generation unit 6614 to the electronic device 22000 based on the handwriting input data. Therefore, by displaying the image data superimposed on the liquid crystal panel 2108 in the electronic device 22000, the electronic devices 100γ and 2000 can display images having the same contents on the liquid crystal panels 240 and 2108. For this reason, the user of electronic device 100γ and the user of 2000 can share the same information. As a result, for example, the user of the electronic device 22000 can know the route to the target point described above.

Further, the electronic device 100γ receives the position information, the scale information, and the size information, and displays the first map image based on these information. Therefore, the map image displayed on the electronic device 22000 and the map image displayed on the electronic device 100γ can be substantially matched.

Also, the electronic device 100γ displays the current position of the electronic device 22000 on the first map image based on the position information. For this reason, the user of the electronic device 100γ can input a handwriting in accordance with the current position of the electronic device 22000.

Also, the electronic device 100γ generates an image to be transmitted to the electronic device 22000 based on the ratio calculated by the ratio calculation unit 6641, and transmits the generated image to the electronic device 22000. Therefore, as shown in FIGS. 72 and 73, electronic device 100γ and electronic device 22000 can superimpose handwritten images on the same point of the map image. For this reason, even when the electronic device 100γ inputs a figure indicating a route along the road or the like of the map image as handwritten input data, the electronic device 22000 superimposes the handwritten image along the road or the like. Can be made.

Further, when the electronic device 100γ changes the display target region of the map image, the electronic device 100γ transmits region specifying information for specifying the display target region after the change to the electronic device 22000. Therefore, the electronic device 22000 can display an image having the same content as the content displayed on the electronic device 100γ on the liquid crystal panel 2108 by changing the display target region of the map image based on the region specifying information.

Also, the map area indicated by the first map image and the map area indicated by the second map image are preferably the same area. As described above, the same area is displayed on the liquid crystal panel 240 of the electronic device 100γ and the liquid crystal panel 2108 of the electronic device 22000, so that the user of the electronic device 100γ and the user of the electronic device 22000 have the same content. The map images can be visually recognized by the electronic devices 100γ and 2000 possessing each other.

In addition, the electronic device 100γ displays a third map image including the map area indicated as the first map image on the liquid crystal panel 140. Therefore, the user of the electronic device 100γ can also check the map image around the map image displayed on the liquid crystal panel 240 on the liquid crystal panel 140.

When the second receiving unit 6616 receives designation of a partial area in the map area displayed as the third map image, the electronic device 100γ displays the designated area on the liquid crystal panel 240. Therefore, the user of the electronic device 100γ can designate a map area to be displayed on the liquid crystal panel 240 based on the surrounding map image displayed on the liquid crystal panel 140.

As described above, the electronic device 22000 combines the image data of the map image and the image data received from the electronic device 100γ, and displays an image based on the combined image data on the liquid crystal panel 2108. Therefore, the electronic devices 100γ and 2000 can display the same image on the liquid crystal panels 240 and 2108.

<Supplement>
(1) In the above description, the configuration in which the electronic device 100γ acquires map data from the server device 19000 based on the position information received from the electronic device 22000 has been described. However, the method of acquiring map data is not limited to this. For example, the electronic device 100γ may acquire map data from the electronic device 22000 instead of acquiring map data from the server device 19000.

Further, based on the position information received from the electronic device 22000, the map data acquired by the electronic device 100γ from the server device 19000 may be transmitted to the electronic device 22000. In this case, the electronic device 22000 does not need to acquire map data from the server device 19000.

(2) The server device 19000 that functions as a storage device for storing map data is not necessarily required. For example, the electronic device 100γ and the electronic device 22000 may be configured to store the map data in a storage device built in or externally attached to each electronic device 100γ, 2000.

(3) When the electronic device 100γ accepts handwriting input data, when the map image displayed on the liquid crystal panel 240 is scrolled, the display control unit 6612 displays the whole handwriting input data handwriting image and the above-mentioned handwriting image. The scale of the display image on the liquid crystal panel 240 may be reduced so that the current position is displayed on the liquid crystal panel 240.

(4) In the above description, the configuration in which the transmission unit 6615 transmits the image data generated by the image generation unit 6614 based on the handwriting input data to the electronic device 22000 has been described as an example. The configuration of the electronic device 100γ is not limited to such a configuration, and may be the following configuration.

A stroke data generation unit is provided instead of the image generation unit 6614. The stroke data generation unit generates stroke data based on the received handwritten input data. The transmission unit 6615 transmits the generated stroke data to the electronic device 22000. With such a configuration, it is possible to reduce the amount of data to be transmitted compared to a configuration in which image data is transmitted to the electronic device 22000.

The stroke data generation unit may generate the stroke data from the handwriting input data using the ratio calculated by the ratio calculation unit 6641. That is, the stroke data generation unit may perform coordinate conversion using the ratio and determine the coordinate values that constitute the stroke data.

On the other hand, the electronic device 22000 may receive the stroke data from the electronic device 100γ and display an image based on the received stroke data on the display panel 2108.

<Appendix>
(1) The electronic device includes a first display panel, a receiving unit that receives position information indicating the current position of the other electronic device from the other electronic device, and a storage device that stores map data based on the position information. From the acquisition unit for acquiring the map data including the current position, the display control unit for displaying the first map image based on the acquired map data on the first display panel, and the first map image being displayed. A first receiving unit that receives handwritten input data via the first display panel, a generating unit that generates image data based on the received handwritten input data, and transmits the generated image data to another electronic device A transmission unit.

The receiving unit also includes scale information indicating a scale of the second map image including the current position displayed on the other electronic device, and a display area displaying the second map image on the other electronic device. Size information indicating the size is further received from another electronic device, and the display control unit includes a map image including a map area indicated as the second map image based on the position information, the scale information, and the size information. Is preferably displayed as the first map image.

Further, it is preferable that the display control unit displays the current position on the first map image based on the position information.

The generation unit includes a ratio calculation unit that calculates a ratio of the size of the display area used for displaying the first map image on the first display panel to the size of the display area indicated by the size information. It is preferable to generate image data by changing the amount of handwritten input data based on the ratio.

When the display control unit receives an instruction to change the display target area of the map image displayed via the first display panel in a state where the first map image is displayed, the transmission unit displays the changed display. It is preferable that the area specifying information for specifying the target area is transmitted to another electronic device.

Also, the map area indicated by the first map image and the map area indicated by the second map image are preferably the same area.

The display control unit further includes a second display panel having a display area larger than that of the first display panel, and the display control unit displays the first map image on the second display panel based on the position information, the scale information, and the size information. It is preferable to further display a third map image including the mapped map area.

In addition, the image processing apparatus further includes a second reception unit that receives designation of a partial region in the map region indicated as the third map image, and when the second reception unit accepts the designation, the display control unit displays the designated partial region Is preferably displayed via the first display panel.

The first display panel includes a plurality of photosensor circuits that generate electrical signals in response to incident light and a plurality of pixel circuits that emit light in response to the electrical signals, and the reception unit includes a plurality of photosensor circuits. It is preferable that the handwriting input data is received based on the electrical signal from and the display control unit displays the first map image and the handwriting image based on the handwriting input data on the plurality of pixel circuits.

(2) The electronic device includes a first display panel, a receiving unit that receives position information indicating the current position of the other electronic device from the other electronic device, and a storage device that stores map data based on the position information. From the acquisition unit for acquiring the map data including the current position, the display control unit for displaying the first map image based on the acquired map data on the first display panel, and the first map image being displayed. A first receiving unit that receives handwritten input data via the first display panel, a generating unit that generates stroke data based on the received handwritten input data, and transmits the generated stroke data to another electronic device. A transmission unit.

The receiving unit also includes scale information indicating a scale of the second map image including the current position displayed on the other electronic device, and a display area displaying the second map image on the other electronic device. Size information indicating the size is further received from another electronic device, and the display control unit includes a map image including a map area indicated as the second map image based on the position information, the scale information, and the size information. Is preferably displayed as the first map image.

The electronic device further includes a second display panel having a display area wider than that of the first display panel, and the display control unit adds the first display panel to the first display panel based on the position information, the scale information, and the size information. It is preferable to further display a third map image including a map area indicated as a map image.

(3) The electronic device has a display panel, a first acquisition unit that acquires position information indicating the current position of the electronic device based on a signal received from an external device, and a memory that stores map data based on the position information. A second acquisition unit that acquires map data including the current position from the device, a display control unit that displays a map image based on the acquired map data on the display panel, and position information is transmitted to another electronic device. A transmission unit and a reception unit that receives image data based on handwritten input data transmitted from another electronic device, and the display control unit combines the image data of the map image with the received image data. Then, an image based on the synthesized image data is displayed via the display panel.

Further, the transmission unit may further transmit scale information indicating the scale of the displayed map image and size information indicating the size of the display area displaying the map image to another electronic device. preferable.

(4) The communication system includes a first electronic device and a second electronic device, and the first electronic device uses the first display panel and position information indicating the current position of the second electronic device as the second electronic device. Based on the first receiving unit, the first acquiring unit that acquires the first map data including the current position from the storage device that stores the map data based on the position information, and the acquired first map data A first display control unit that displays the first map image on the first display panel; a first reception unit that receives handwriting input data via the first display panel in a state where the first map image is displayed; A generation unit that generates image data based on the handwritten input data, and a first transmission unit that transmits the generated image data to the second electronic device. The second electronic device includes a second display panel, an external Location information based on the signal received from the device A second acquisition unit to acquire, a third acquisition unit to acquire second map data including the current position from the storage device based on the position information, and a second map image based on the acquired second map data to the second A second display control unit for displaying on the two display panel; a second transmission unit for transmitting position information to the first electronic device; and a second reception unit for receiving generated image data from the first electronic device. The second display control unit combines the second map data and the received image data, and displays an image based on the combined image data on the second display panel.

(5) The data communication method is a data communication method in an electronic device, the step of receiving position information indicating the current position of another electronic device from another electronic device, and map data based on the position information. A step of acquiring map data including the current position from the stored storage device, a step of displaying a map image based on the acquired map data on the display panel, and a state where the map image is displayed via the display panel Receiving handwritten input data, generating image data based on the received handwritten input data, and transmitting the generated image data to another electronic device.

(6) The data communication method is a data communication method in an electronic device, the step of receiving position information indicating the current position of another electronic device from another electronic device, and map data based on the position information. A step of acquiring map data including the current position from the stored storage device, a step of displaying a map image based on the acquired map data on the display panel, and a state where the map image is displayed via the display panel Receiving handwritten input data, generating stroke data based on the received handwritten input data, and transmitting the generated stroke data to another electronic device.

(7) The display control method is a display control method in an electronic device, the step of obtaining position information indicating the current position of the electronic device based on a signal received from an external device, and map data based on the position information. A step of acquiring map data including the current position from the storage device storing the step, a step of displaying a map image on the display panel based on the acquired map data, and a step of transmitting the position information to another electronic device. Receiving image data based on handwritten input data transmitted from another electronic device, combining the image data of the map image and the received image data, and an image based on the combined image data Displaying on the display panel.

(8) The program is a program for causing the electronic device to execute data communication, and receives the position information indicating the current position of the other electronic device from the other electronic device, based on the position information, A step of acquiring map data including the current position from the storage device storing the map data, a step of displaying a map image based on the acquired map data on the display panel, and a display of the map image are displayed. A step of receiving handwritten input data via the panel, a step of generating image data based on the received handwritten input data, and a step of transmitting the generated image data to another electronic device are executed.

(9) The program is a program for causing the electronic device to perform data communication, and receives the position information indicating the current position of the other electronic device from the other electronic device, and based on the position information, A step of acquiring map data including the current position from the storage device storing the map data, a step of displaying a map image based on the acquired map data on the display panel, and a display of the map image are displayed. A step of receiving handwritten input data via the panel, a step of generating stroke data based on the received handwritten input data, and a step of transmitting the generated stroke data to another electronic device are executed.

(10) The program is a program for causing the electronic device to execute display control, and based on the position information, a step of acquiring position information indicating the current position of the electronic device based on a signal received from the external device. The step of acquiring the map data including the current position from the storage device storing the map data, the step of displaying the map image on the display panel based on the acquired map data, and the position information to other electronic devices A step of transmitting, a step of receiving image data based on handwritten input data transmitted from another electronic device, a map image image data and the received image data, and the combined image data. Displaying an image based on the image on the display panel.

(11) The handwriting input data input in a state where the map screen is displayed on the electronic device can be displayed on other electronic devices.

The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1, 1A, 1B, 1C communication system, 10 electronic device, 20 electronic device, 90 storage device, 100, 100 #, 100α, 100β, 100γ electronic device, 100A first housing, 100B second housing, 100C Hinge, 101 body device, 102, 102A display device, 103 display device, 104 body device, 130 driver, 131 scanning signal line drive circuit, 132 data signal line drive circuit, 133 photosensor drive circuit, 134 switch, 135 amplifier, 140 , 140A Photosensor built-in liquid crystal panel, 141 pixel circuit, 141b subpixel circuit, 141g subpixel circuit, 141r subpixel circuit, 141r pixel circuit, 143 electrode pair, 143a pixel electrode, 143b counter electrode, 144 photosensor circuit, 1 5 photodiode, 145b photodiode, 145g photodiode, 145r photodiode, 146 capacitor, 151A active matrix substrate, 151B counter substrate, 152 liquid crystal layer, 153b color filter, 153g color filter, 153r color filter, 157 data signal line, 161 Polarizing filter, 162 glass substrate, 163 light shielding film, 164 alignment film, 173 memory card reader / writer, 174 external communication unit, 175 microphone, 176 speaker, 177 operation key, 179 backlight, 180 image processing engine, 181 driver control unit, 182 timer, 183 signal processor, 191 power switch, 192 power circuit, 193 power detector, 194 connector, 95 antenna, 196 connector, 230 driver, 240 optical sensor built-in liquid crystal panel, 240 liquid crystal panel, 274 external communication unit, 279 backlight, 280 image processing engine, 281 driver control unit, 282 timer, 283 signal processing unit, 293 power detection Section, 294 connector, 295 antenna, 297 signal strength detection section, 310 input section, 320 display section, 330 storage section, 332 display data, 340 internal I / F section, 350 control section, 352 display control section, 354 attached data creation Unit, 410 input unit, 420 display unit, 430 storage unit, 432 display data, 433 input pattern, 434 attached data, 440 internal I / F unit, 450 control unit, 452 display control unit, 454 transfer control unit, 510 input unit 520 display unit, 530 storage unit, 532 display data, 533 input pattern, 540 communication unit, 550 control unit, 552 display control unit, 554 retransfer control unit, 610 input unit, 620 display unit, 630 storage unit, 640 communication Unit, 650 control unit, 652 display control unit, 1001 first unit, 1002 second unit, 1010, 1010A control unit, 1011 reception unit, 1012 display control unit, 1013 first reception unit, 1014 transmission unit, 1015 second reception Unit, 1016 change unit, 1300 electronic device, 2000 electronic device, 2010, 2010A control unit, 2011 reception unit, 2012 display control unit, 2013 reception unit, 2014 transmission unit, 2015 change unit, 2090 storage device, 2103 communication unit, 2107 Operation key 2108 liquid crystal panel, 3300 electronic device, 3400 electronic device, 3500 electronic device, 4910, 4910A control unit, 4911 reception unit, 4912 search unit, 4913, 4913A display control unit, 4914, 4914A reception unit, 4915, 4915A image generation unit , 4916 position detection unit, 4917, 4917A transmission unit, 4951 ratio calculation unit, 6610 control unit, 6611 reception unit, 6612 display control unit, 6613 first reception unit, 6614 image generation unit, 6615 transmission unit, 6616 second reception unit , 6617 acquisition unit, 6641 ratio calculation unit, 8000 GPS satellite, 9000 server device, 12000 electronic device, 12010 control unit, 12011 transmission unit, 12012 reception unit, 12013 display control unit, 12014 Receiving unit, 19000 server, 22000 electronics, 22010 control unit, 22011 first acquisition unit, 22012 second acquisition unit, 22013 display controller, 22014 transmitting unit, 22015 receiver.

Claims (17)

An electronic device (100),
A communication unit (274) that communicates with an external device (10, 20, 100 #);
A monitor (320);
A tablet with integrated display (420),
The display-integrated tablet outputs an input pattern to the display-integrated tablet,
A control unit (350, 450) for controlling the operation of the electronic device;
The controller is
An attached data creation unit (354) for creating attached data;
A command for controlling the communication unit, including the input pattern and the attached data, and requesting the external device to display the input pattern on a display-integrated tablet and to reproduce the attached data on a monitor. An electronic device including a transfer control unit (454) for transmission. The external devices include a first device (10) having a display-integrated tablet (520) and a second device (20) having a monitor (620),
The command requests the first device to display the input pattern on the display-integrated tablet of the first device and to transfer the attached data to the second device. The electronic device according to the first item of the range. The external device includes a third device (100 #) having a monitor (320 #) and a display-integrated tablet (420 #),
The command displays the input pattern for the third device on the display-integrated tablet of the third device, and displays a screen corresponding to the attached data on the monitor of the third device. The electronic device according to claim 1, wherein the electronic device is requested. The electronic device according to claim 1, wherein the attached data relates to a display screen of the monitor of the electronic device. The electronic device according to claim 4, wherein the attached data includes display data serving as a basis of the display screen. The electronic device according to claim 4, wherein the attached data includes a file serving as a basis of the display screen. The electronic device according to claim 4, wherein the attached data includes a link to the display screen. The display screen includes a web screen,
The electronic device according to claim 7, wherein the link is an address of the web screen. The electronic device according to claim 1, wherein the monitor is a liquid crystal panel (140) with a built-in optical sensor. 10. The electronic apparatus according to claim 9, wherein the attached data includes image data acquired by the liquid crystal panel with a built-in optical sensor. The electronic device according to claim 1, wherein the display-integrated tablet of the electronic device is a photosensor built-in liquid crystal panel (240). An electronic device (10),
A communication unit (540) that communicates with a first device (100) having a monitor and a display-integrated tablet and a second device (20) having a monitor;
Display-integrated tablet (520);
A control unit (550) for controlling the operation of the electronic device,
The controller is
When the communication unit receives a command including an input pattern and attached data from the first device, a display control unit (552) that displays the input pattern on the display-integrated tablet;
When the communication unit receives the command, the electronic device includes a retransfer control unit (554) that controls the communication unit and transmits the attached data to the second device. An electronic device (100 #),
A communication unit (274 #) that communicates with the external device (100);
A monitor (320 #);
Display-integrated tablet (420 #),
A control unit (350 #, 450 #) for controlling the operation of the electronic device,
The controller is
When the communication unit receives a command including an input pattern and attached data from the external device, a first display control unit (452 #) that displays the input pattern on the display-integrated tablet;
An electronic apparatus comprising: a second display control unit (352 #) that displays a screen corresponding to the attached data on the monitor when the communication unit receives the command. A communication system (1) comprising a first device (100), a second device (10) and a third device (20),
The first device is:
A first communication unit (274) that communicates with the second device;
A first monitor (320);
A first display-integrated tablet (420),
The first display-integrated tablet outputs an input pattern to the first display-integrated tablet,
A first control unit (350, 450) for controlling the operation of the first device;
The first controller is
An attached data creation unit (354) for creating data relating to the monitor as attached data;
A transfer control unit (454) for controlling the first communication unit and transmitting a command representing the input pattern and the attached data to the second device;
The second device is:
A second communication unit (540) for communicating with the first device and the third device;
A second display-integrated tablet (520);
A second control unit (550) for controlling the operation of the second device,
The second controller is
When the second communication unit receives the command, a display control unit (552) that displays the input pattern on the second display-integrated tablet;
A re-transfer control unit (554) for controlling the second communication unit when the second communication unit receives the command and transmitting the attached data to the third device;
The third device is:
A second monitor (620);
And a display control unit (652) for displaying a screen corresponding to the attached data on the second monitor. A communication system (1) comprising a first device (100) and a second device (100 #),
The first device is:
A first communication unit (274) that communicates with the second device;
A first monitor (320);
A first display-integrated tablet (420),
The first display-integrated tablet outputs an input pattern to the first display-integrated tablet,
A first control unit (350, 450) for controlling the operation of the first device;
The first controller is
An attached data creation unit (354) for creating data relating to the first monitor as attached data;
A transfer control unit (454) for controlling the first communication unit and transmitting a command including the input pattern and the attached data to the second device;
The second device is:
A second communication unit (274 #) for communicating with the first device;
A second monitor (320 #);
A second display-integrated tablet (420 #);
A second control unit (350 #, 450 #) for controlling the operation of the second device,
The second controller is
When the second communication unit receives the command, a first display control unit (452 #) that displays the input pattern on the second display-integrated tablet;
When the second communication unit receives the command, the communication system includes a second display control unit (352 #) that displays a screen corresponding to the attached data on the second monitor. A communication method using an electronic device (100) having a monitor (320) and a display-integrated tablet (420),
The electronic device creating attachment data (S101);
The electronic device includes an input pattern to the display-integrated tablet and the attached data, and requests the external device (100 #) to display the input pattern on the display-integrated tablet and reproduce the attached data on the monitor. Transmitting a command to be performed to the external device (S103). A communication program for causing an electronic device (100) having a monitor (320) and a display-integrated tablet (420) to communicate,
Causing the electronic device to create attached data (S101);
The electronic device includes the input pattern to the display-integrated tablet and the attached data, and requests the external device (100 #) to display the input pattern on the display-integrated tablet and reproduce the attached data on the monitor. And a step (S103) of transmitting a command to be performed to the external device.

Images