JP2007025930A - Portable terminal device, electronic device, and monitor device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve a first problem that when mail received by the other electronic equipment is transferred to portable terminal equipment, the communication fee of the portable terminal is required, and financial waste is large and a second problem that it is difficult to immediately inform a user of the communication state of the portable terminal equipment by a monitor device which displays an image from the portable terminal equipment. <P>SOLUTION: This portable terminal equipment is provided with a function for receiving the incoming notification of mail received by the other electronic equipment such as a personal computer by radio communication, and informing a user of the mail incoming notification according to a melody output of a device body so that the first problem can be solved. Also, this portable terminal equipment is provided with a function for making a monitor device perform a voice output to inform the user of the mail incoming notification in the case of the mail incoming during the transmission of an imaged image to an external monitor device so that the second problem can be solved. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a technology for notifying a mobile terminal device of incoming mail at another electronic device by wireless communication, and when the mobile terminal device displays an image being captured on the monitor device, the mobile terminal device The present invention relates to a technique for notifying an incoming mail by a monitor device when an incoming mail is received.

  Conventionally, Patent Document 1 discloses the following technique as a technique for notifying a user who is away from his / her desk, for example, who is not in front of the personal computer when an incoming mail arrives at the personal computer. In other words, this is a technique for transferring an incoming mail as it is to a terminal designated by a user, for example, a portable terminal that is highly likely to be carried even while away from the desk.

Also, for example, when a mobile terminal device is fixed at a predetermined position to take an image, and the captured image is received and output by a monitor device at a remote location, an incoming mail such as an email is received at the mobile terminal device. If there is, a technique of applying the above technique and transferring mail from the mobile terminal device to the monitor device can be used in the opposite manner.
JP 2004-007222 A

  However, when a mail received by another electronic device is transferred to the mobile terminal device, there is a first problem that a communication fee for the mobile terminal is incurred and the cost is wasted. Further, depending on the amount of mail data such as the presence or absence of an attached file, not only the cost increases, but also all the contained data cannot be processed well by the mobile terminal.

  In addition, in order to transfer a mail received by the mobile terminal device to a monitor device receiving a video at a remote location, the monitor device needs to have a mail transmission / reception function. Also, even if a mail function is provided and a forwarded mail from a mobile terminal device is received, since the video from the mobile terminal device is being displayed on the monitor device, it is forwarded unless a special notification means is used. There is also a second problem that it is difficult to immediately notify the user of the presence of mail.

  As described above, in order to solve the first problem, according to the present invention, an incoming notification of an email received by another electronic device such as a personal computer is transmitted to a wireless PAN (personal area network, communication range 10 to 20 meters) or wireless. Provided is a mobile terminal device that has a function of receiving wireless mail such as a LAN (local area network; communication range to 100 meters) and notifying a user of the incoming mail notification by vibrating the device main body or outputting a melody. Specifically, a mobile terminal device is provided that includes a wireless reception unit that receives a mail arrival notification to another electronic device through wireless communication, and an incoming call alarm unit that notifies that the mail arrival notification has been received. .

  In addition, in the incoming call alert to notify that there has been an incoming mail notification, for example, important mail, spam mail, etc. are discriminated from the type of incoming mail notification such as the sender information of the mail, and according to the discrimination result A portable terminal device that changes the alarm means is also provided. In addition, according to the operation state of the mobile terminal device itself, a mobile terminal device is also provided in which, for example, during camera imaging, an alarm is not performed with the vibration function so that camera shake imaging is not performed, and another alarm unit is selected. .

  In addition, an electronic device having a function of transmitting an incoming notification of an email that has arrived to the mobile terminal device by wireless communication is also provided. Specifically, an incoming mail detection unit that detects an incoming mail, an incoming mail notification generation unit that generates an incoming mail notification in response to the detected incoming mail, and the generated incoming mail notification to the mobile terminal device And an electronic device having a wireless transmission unit for transmission. Also provided is an electronic device having attribute-dependent mail arrival notification generation means for acquiring attribute information of the detected mail and generating a mail arrival notification of a type corresponding to the attribute information.

  Further, in order to solve the second problem, the present invention provides, for example, a “mail arrives” in order to notify a mail arrival notification when a mail arrives while the captured image is being transmitted to an external monitor device. We will provide a portable terminal device that has the function of outputting sound output from the speaker of the monitor device. Specifically, an imaging unit having an imaging function, a communication unit, an image transmission unit that transmits an image captured by the imaging unit to a monitor device, and communication state information that indicates a communication state in the communication unit are generated. There is provided a portable terminal device including a communication state information generation unit that performs communication and a communication state information transmission unit that transmits the generated communication state information to the monitor device.

  In addition, in order to notify the arrival of e-mails, etc., the image is captured by the mobile terminal device, and a character image such as “Mail has arrived” is superimposed on the image transmitted to the external monitor device and displayed on the monitor device. A mobile terminal device having a function is also provided.

  There is also provided a monitor device that receives and displays a video from the mobile terminal device and displays an image indicating a communication state of the mobile terminal device superimposed on the video. Specifically, a captured image acquisition unit that acquires an image captured and transmitted by the mobile terminal device, a notification image superimposition information acquisition unit that acquires notification image superimposition information, and the acquired notification image superimposition information And a superimposition unit that performs superimposition based on.

  With the present invention configured as described above, even when the user is away from the desk or in front of an electronic device such as a personal computer, the user can receive an e-mail from the electronic device by wireless communication without incurring the communication cost of the portable terminal. I can know.

  In addition, since the type of incoming mail can be determined by identifying the sender, etc., and the means of alarm for notification of incoming mail can be changed. You can decide without checking. Also, since the alarm means can be changed depending on the state of the mobile terminal device, the vibration function that notifies the arrival of mail in another electronic device is activated during camera imaging with the mobile terminal device, resulting in a camera shake image. Can be avoided.

  In addition, even if an email arrives at the mobile terminal while taking an image with the mobile terminal device and viewing the captured image on the monitor device at a remote location, an "Email has arrived" from the speaker of the monitor device. So that you can know the incoming call immediately by displaying a text image such as “mail incoming” superimposed on the image captured by the mobile device and displayed on the monitor device. become.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited to these embodiments, and can be implemented in various modes without departing from the spirit of the present invention. The first embodiment will mainly describe claims 1, 2, 3, 6, 7, and 9. In the second embodiment, claims 4, 5, 6, 8, and 10 will be mainly described. In the third embodiment, claims 11, 12, and 13 will be mainly described. In the fourth embodiment, claims 14, 15, 16, and 17 will be mainly described.

  First Embodiment <Outline of First Embodiment> FIG. 1 is a diagram for explaining an example of a concept in a mobile terminal device of the present embodiment. As shown in this figure, a mail arrives at a personal computer in the living room, which is an electronic device different from the portable terminal device of this embodiment (1). At this time, however, the user is cooking in the kitchen and is unaware of the incoming mail on the computer in the living room. However, the user places a mobile phone, which is the mobile terminal device of this embodiment, near the mobile phone, and this mobile phone has received information notifying the arrival of an email on the personal computer by wireless communication from the personal computer (2). In response to the reception of this information, the mobile phone activates the vibration function and outputs a synthesized voice saying “mail has arrived” from the speaker (3). In this way, even if the user was not in front of the computer, the user could immediately know the incoming email on this computer, and could immediately check the content of the incoming email on the computer in the living room (4 ).

    Example 1 Configuration of Mobile Terminal Device FIG. 2 is a diagram illustrating an example of functional blocks in the mobile terminal device of this example. The “mobile terminal device” means a terminal that can be connected to a communication network such as the Internet network or a telephone line network and can be carried by a user. For example, in addition to a mobile phone, a PDA (Personal Digital Assistance) Examples include PHS (Personal Handyphone System) and mobile personal computers. The “portable terminal device” (0200) of the present embodiment includes a “wireless reception unit” (0201) and an “incoming alarm unit” (0202) as shown in FIG.

  In addition, functional blocks such as the mobile terminal device, the electronic device, and the monitor device described below can be realized as hardware, software, or both hardware and software. Specifically, if a computer is used, a CPU, a main memory, a bus, a storage device such as a hard disk or a non-volatile memory, a storage medium, a read drive for these media, a transmission / reception port for various communication and printing devices, Other hardware components such as peripheral devices, driver programs for controlling the hardware, other application programs, interfaces used for information input, and the like can be given. These hardware and software processes the programs developed on the memory in sequence by the CPU, and processes, stores, and outputs the data stored on the memory and hard disk and the data input via the interface. Or used to control each hardware component.

  The present invention can be realized not only as an apparatus but also as a method. In addition, a part of the invention can be configured as software. Furthermore, a software product used for causing a computer to execute such software, and a recording medium in which the product is fixed to a recording medium so as to be readable by a computer are naturally included in the technical scope of the present invention. The same throughout the book).

  The “wireless communication unit” (0201) has a function of receiving an incoming mail notification to another electronic device (0210) by wireless communication. “Notification of incoming mail” is information for notifying other electronic devices that mail has arrived. In addition to the information indicating the incoming mail, the data size and sender Information indicating a subject, a keyword in the text, and the like may be included. Examples of the “wireless communication” include infrared communication, visible light communication, and communication based on a standard established by the IEEE 802 Committee including Bluetooth (registered trademark). For example, in the case of Bluetooth, the communicable range is approximately 10 to 20 meters, which is a sufficient communication range for use in the home. Further, if it is possible to notify the arrival of a mail even if it is a little far away, for example, the wireless communication of the IEEE802.11 standard with a communicable range of 100 meters, and if the mail arrival notification is performed to a further distance, for example, the communicable range is It is recommended to use IEEE802.16 standard wireless communication of 100 kilometers. In this way, the wireless communication allows the user to know the arrival of mail to other electronic devices at another place without incurring communication costs. Moreover, since it is not necessary to use a public network like the transfer of the conventional mail itself, an effect of reducing traffic can be expected. In addition, the wireless communication unit, which is different from the connection unit to the communication network of the mobile terminal device, receives the incoming mail notification of the other electronic device, so the mail of the other electronic device is connected to the communication network of the mobile terminal device. An incoming call notification can be received.

  The “incoming alarm unit” (0202) has a function for notifying that the mail incoming notification has been received. This “incoming alarm unit” is constituted by alarm means such as a light and a device for controlling blinking of the light, a speaker and an output control device for the speaker, a vibration device and a vibration control device, a display and a display control device for the display. . Then, when such an incoming call alarm unit receives a mail incoming notice from another electronic device by wireless communication, the user can be notified of the incoming mail by, for example, the lamp of the mobile terminal device blinking. You can also send a voice or electronic sound from the speaker to notify you of incoming mail, vibrate the mobile device itself to notify you of incoming mail, or “Email has arrived” on the display. You may notify the arrival of mail by displaying the text and an icon indicating that.

  Further, as shown in FIG. 3, the “incoming alarm unit” (0302) is provided with “a plurality of types of alarm means” (0303) such as lamp blinking, voice output, main body vibration, display display and the like. May be. As described above, by providing a plurality of types of alarm means, for example, by operating a combination of a plurality of types to notify the arrival of an incoming mail, the possibility that the user notices the notification can be increased. Further, as will be described in the second embodiment, the type of alarm can be selected according to the type of mail or the operating state of the mobile terminal device, which can be used.

    <Embodiment 1: Configuration of Electronic Device> FIG. 4 is a diagram illustrating an example of functional blocks in an electronic device of the present embodiment. “Electronic device” refers to an electronic device that can be connected to a communication network and has an incoming mail function, and includes a personal computer, a mobile phone, a PDA, a PHS, a mobile personal computer, a digital TV, a satellite broadcast receiver, and the like. . As shown in this figure, the “electronic device” (0410) of the present embodiment includes a “mail incoming detection unit” (0411), a “mail incoming notification generation unit” (0412), and a “wireless transmission unit”. (0413).

  The “mail incoming detection unit” (0411) has a function of detecting incoming mail. This incoming mail detection may be detected by downloading mail data to the electronic device itself, or may be detected by accessing the mail server and receiving information that the mail data is stored in the mail server. Also good.

  The “mail arrival notification generation unit” (0412) has a function of generating a mail arrival notification in response to the incoming mail detected by the mail arrival detection unit (0411). “Mail arrival notification” generated here includes, for example, information for identifying mail arrival notification, date / time information acquired from the built-in clock of the electronic device, information indicating a serial number, other information, The structure is mentioned. In this way, by sending the incoming mail notification generated by the electronic device to the mobile terminal device by wireless communication, it is possible to notify the mobile terminal device of the incoming mail. Further, the information included in the other information may include information indicating the data size of the incoming mail, the sender, the subject, the keyword in the text, and the like. The case where other information is included will be described in the second embodiment.

  The “wireless transmission unit” (0413) has a function of transmitting the incoming mail notification generated by the incoming mail notification generation unit (0412) to the mobile terminal device (0400). Of course, like the above-described wireless reception unit of the mobile terminal device, this wireless transmission unit communicates with the mobile terminal device by communication according to a standard established by the IEEE 802 Committee including infrared communication, visible light communication, or Bluetooth. It is good to send an email notification. In this way, as with the mobile terminal device, the electronic device can also exhibit effects such as a reduction in traffic by sending a mail arrival notification by the wireless transmission unit.

  In this way, in order to send an incoming mail notification in another electronic device to the mobile terminal device by wireless communication and perform an incoming alarm, for example, hardware resources may be used as follows. First, a mail client program is developed in a work area of a memory constituting the electronic device, and the CPU processes and executes the program. This mail client program accesses a mail server on the network using a communication means using a protocol such as POP3, and performs a process for confirming whether a mail has arrived for a set account. At this time, if a mail has arrived for the setting account, information for identifying the incoming mail notification is generated and stored in a predetermined storage area in the memory. Further, the date / time information is acquired from the internal clock of the electronic device and stored in another predetermined storage area in the memory. In addition, information indicating a serial number, mail data size, information indicating a sender, a subject, a keyword in a text, and the like may be stored in different predetermined areas in the memory.

  Subsequently, a process for transmitting the information necessary for the mail arrival notification stored in the predetermined area in the memory to the mobile terminal device by wireless communication is performed. For this purpose, first, the mail notification is converted into a data format for wireless communication by the processing of the CPU, and is stored again in a predetermined area of the memory. In addition, a connection is established between the electronic device and the mobile terminal device, and a mail arrival notification is transmitted using a protocol such as IrLAP.

  Then, in the mobile terminal device that has received the mail arrival notification, the mail arrival notification in the wireless communication format received by the processing of the CPU or the like is decrypted, and the decrypted mail arrival notification is stored in the memory of the mobile terminal device. Stored in a predetermined area. In addition, a program for alerting an incoming mail is developed and executed in the work area of the memory of the portable terminal device. This mail incoming alarm program includes programs for voice reproduction, main body vibration, and text display, and these programs are executed in response to the mail incoming notification stored in the memory. For example, the audio data is stored in another predetermined area of the memory by the audio reproduction program, and the audio reproduction process is performed by the CPU. Then, the reproduced “mail has arrived” voice is output from the speaker, etc., so that the user can know the presence of the mail that has arrived at the electronic device by an incoming call alert on the mobile terminal device. it can.

    <Processing Flow of First Embodiment> FIG. 5 is a flowchart showing an example of a processing flow in the mobile terminal device of the present embodiment. As shown in this figure, first, when mail arrives at an electronic device different from the portable terminal device (step S0501), the electronic device detects the incoming call (step S0502). Next, an incoming mail notification is generated in response to the incoming mail detected in step S0502 (step S0503). Subsequently, the mail incoming notification generated in step S0503 is transmitted to the portable terminal device by wireless communication (step S0504). Next, the mobile terminal device receives the transmitted mail arrival notification by wireless communication (step S0505). Finally, an alarm means is activated to notify the incoming mail notification received in step S0505 (step S0506).

    <Simple Explanation of Effects of First Embodiment> As described above, the mobile terminal device according to the present embodiment enables the mobile terminal device to be connected by wireless communication even when the user is away from the desk or in front of an electronic device such as a personal computer. E-mail arrival of electronic devices can be known without incurring communication costs. Moreover, since it is not necessary to use a public network as in the prior art, an effect of reducing traffic can be expected. In addition, since the wireless receiver receives a mail arrival notification from another electronic device separately from the connection part of the mobile terminal device to the Internet network or the telephone line network, even if these connection functions of the mobile terminal device are in use. An incoming call notification can be received. In addition, as with the mobile terminal device, the electronic device of this embodiment can produce an effect such as a reduction in traffic by sending a mail arrival notification by the wireless transmission unit.

  <Example 2> <Outline of Example 2> This example is based on the mobile terminal device having a plurality of types of alarm means, particularly in the above example. This is a portable terminal device having a function of selecting an alarm means corresponding to a preset “urgent” upon receipt of an incoming mail notification indicating that the message is included. As a result, the user can know the outline and type of mail received by another electronic device without checking each type of alarm means according to the type of alarm means.

  Alternatively, the other portable terminal device of this embodiment, for example, if the camera is being imaged by the portable terminal device, the alarm is not performed with the vibration function so that the camera shake imaging is not performed, and another alarm means is selected. It is a portable terminal device having a function of selecting an alarm means according to various situations.

    Second Embodiment Configuration of Mobile Terminal Device FIG. 6 is a diagram illustrating an example of functional blocks in a mobile terminal device according to the present embodiment. As shown in this figure, the “portable terminal device” (0600) of the present embodiment is provided with a “wireless receiver” (0601) and an “incoming alarm unit” (0602) based on the first embodiment. The incoming call alarm unit further includes “plural types of alarm means” (0603). Since these “wireless reception unit”, “incoming alarm unit”, and “plural types of alarm means” have already been described in the first embodiment, description thereof will be omitted. And the feature point of the portable terminal device of the present embodiment is that the incoming call alarm unit further includes “alarm selection means” (0604).

  The “selective alarm means” (0604) has a function of selecting one or a combination of two or more kinds of alarm means (0603) and executing an alarm at the incoming alarm section (0602). This selection may be made based on the registration information that has been registered in advance by the user's settings. In addition, as described with reference to FIGS. 7 and 8, for example, the alarm means may be selected according to the type of incoming mail notification such as the mail size and the mail sender. Or you may select an alarm means according to the operation state of a portable terminal device so that it may explain using FIG.

    <Example 2: Configuration 1 of mobile terminal device> FIG. 7 shows an example of functional blocks in the mobile terminal device of this example having a function of selecting an alarm means according to the type of mail incoming notification. FIG. As shown in this figure, the “portable terminal device” (0700) includes the “wireless reception unit” (0701) and the “incoming alarm unit” (0702). “Alarm means” (0703) and “Selected alarm means” (0704). The feature point is that it further includes a “mail incoming notification type detection unit” (0705), and the selection alarm means includes an “incoming call dependent selection alarm device” (0706).

  The “mail arrival notification type detection unit” (0705) has a function of detecting the type of mail arrival notification. “Type of incoming mail notification” refers to the amount of data, including / excluding incoming mail attachments to other electronic devices, presence / absence of attached files, sending / receiving time of mails, originator / receiver of incoming mails First, the text included in the subject and body of the incoming mail, the importance flag set for the incoming mail from the sender, the file format of the incoming mail and the file format of the attached file, and the virus check software for the incoming mail There are different types depending on the check result and the communication path of the incoming mail.

  For example, if the type of the incoming mail notification is a data amount, a type such as “large size, medium size, small size” set in advance in the size range is determined based on the data amount information included in the mail incoming notification. The method of detecting is mentioned. Or, if it is a sender or receiver, the text of the email address is included in the email notification, the account or provider name is identified from the text, and “mail from friends” and “business mail” are identified accordingly. , “Advertising mail”, “spam mail”, and other methods for detecting the type of mail. Also, if the subject included in the incoming mail notification contains "Unapproved", it will detect "Advertisement mail" and its type, and if it contains "Emergency" in the subject and body text, the type will be "Emergency mail" Or, conversely, there is a method of detecting the type of “e-mail at risk of virus”. Further, there is a method of detecting “high importance mail, normal mail” from the importance flag given to the mail. In addition, there is a method of detecting from the information on the file format to a type of “virus danger mail” if it is a “self-execution format” file, and “advertisement mail” if it is an html format. In addition, when a virus is detected by the virus check, a method of identifying it as “virus dangerous mail” by including information to that effect in the mail arrival notification. Further, if the communication path information included in the header of the incoming mail is included in the mail incoming notification, the mail passing through the server that distributes the predetermined spam mail is identified from the communication path information, and “spam mail” is identified. And a method of identifying “ Thus, by identifying the type of mail received by another electronic device, it is possible to select an alarm means that matches that type.

  The “incoming call dependent selection alarm” (0706) has a function of performing selection by the selection alarm means (0704) in accordance with the type of incoming mail notification detected by the incoming mail notification type detection unit (0705). FIG. 8 is a diagram for explaining an example of selection according to the type of mail incoming notification. As shown in this figure, for example, when the data amount of mail received by another electronic device is as small as “1 to 100 kb” as a result of identification, an alarm based on “vibration 1” with no significant vibration is selected. In addition, when the amount of data is slightly larger as “101-1024 kb” as a result of identification, for example, in order to notify the possibility of attachment, the user is notified of mail arrival by “vibration 2” having a greater vibration than “vibration 1”. It is. Further, when “spam advertisement” is identified or “virus mail” is identified from the identification of the sender, the selection of “no warning” may be used. Further, if it is identified that the mail is from a lover, it may be selected to output a preset love song. In this way, a warning corresponding to the type of mail can be given to the user.

  Thus, the selection of the alarm means corresponding to the type of mail incoming notification may be performed using hardware resources as follows, for example. First, a program for selecting alarm means is developed in the work area of the memory and executed by the CPU. As a result of the processing of this program, information indicating the type included in the mail arrival notification stored in the predetermined storage area of the memory, such as information indicating the mail size, is acquired and stored in another storage area of the memory. The Then, by the processing of the CPU, the table data as shown in FIG. 8 stored in the storage device of the portable terminal device such as a hard disk drive or a non-volatile memory is referred to, and the mail type such as the data size stored in the memory Alarm means to be executed corresponding to is selected and determined. And according to the determination, the CPU generates an execution command for the corresponding alarm means, and for example, vibration 1 by the vibration function is executed.

    <Embodiment 2: Configuration 1 of Electronic Device> FIG. 9 is a diagram illustrating an example of functional blocks in an electronic device according to the present embodiment, which transmits a mail incoming notification to the mobile terminal device. As shown in this figure, the “electronic device” (0910) of the present embodiment is based on the first embodiment, the “mail incoming detection unit” (0911), the “mail incoming notification generation unit” (0912), "Wireless transmission unit" (0913). Since these “mail incoming detection unit”, “mail incoming notification generation unit”, and “wireless transmission unit” have already been described in the first embodiment, description thereof will be omitted. The feature of the electronic device of this embodiment is that it further has a “mail attribute information acquisition unit” (0914), and the mail incoming notification generation unit includes “attribute-dependent mail incoming notification generation means”. .

  The “mail attribute information acquisition unit” (0914) has a function of acquiring attribute information of a mail whose incoming mail is detected by the mail incoming detection unit (0911). “Mail attribute information” includes, for example, size attribute information indicating the mail data size, destination attribute information indicating the sender and receiver of the mail, subject attribute information indicating the mail subject and keywords in the text, and attached to the mail. Importance attribute information that indicates the flag of the importance level, format attribute information that indicates the file format of emails and email attachments, virus attribute information that indicates the presence and type of virus by virus check, and communication included in the header of incoming mail For example, route attribute information indicating route information.

  The “attribute-dependent mail arrival notification generation unit” (0915) has a function of generating a mail arrival notification of a type corresponding to the mail attribute information acquired by the mail attribute information acquisition unit (0914). For example, if the mail attribute information is the mail size, the mail arrival notification of the type corresponding to the mail attribute information may be a mail arrival notification including the numerical value of the mail size as it is, or the range of the numerical value Depending on the mail arrival notification, the mail arrival notification may include information indicating attributes such as large, medium, and small mail sizes. In this way, by including information indicating the type corresponding to such mail attribute information in the mail incoming notification, the mail incoming notification type detecting unit of the mobile terminal device can detect the type of mail incoming notification. It becomes possible.

    <Processing Flow 1 According to Second Embodiment> FIG. 10 is a flowchart showing an example of a processing flow according to the present embodiment. As shown in this figure, in this embodiment, first, when a mail arrives at an electronic device different from the portable terminal device (step S1001), the electronic device detects the incoming call (step S1002). Next, the attribute information of the mail detected in step S1002 is acquired (step S1003). Subsequently, a mail arrival notification of a type corresponding to the mail attribute information acquired in step S1003 is generated (step S1004). Subsequently, the incoming mail notification generated in step S1004 is transmitted to the portable terminal device by wireless communication (step S1005).

  Next, the mobile terminal device receives the transmitted mail arrival notification by wireless communication (step S1006). Next, the type of mail incoming notification received in step S1006 is detected (step S1007). Subsequently, one or more combinations are selected from a plurality of alarm means for notifying the incoming mail notification according to the type of incoming mail notification detected in step S1007 (step S1008). Finally, the alarm means selected in step S1008 notifies the received incoming mail notification in the other electronic device (step S1009).

    <Second Embodiment: Configuration 2 of Mobile Terminal Device> FIG. 11 shows an example of functional blocks in the mobile terminal device of this embodiment having a function of selecting an alarm means according to the operating state of the mobile terminal device. FIG. As shown in this figure, the “portable terminal device” (1100) includes the “wireless receiving unit” (1101) and the “incoming alarm unit” (1102). “Alarm means” (1103) and “Selected alarm means” (1104). The feature point is that a “state detection unit” (1105) is further provided, and the selection alarm means is provided with a “state-dependent selection alarm device” (1106).

  The “state detection unit” (1105) has a function of detecting its own operation state. “Operating state” means, for example, a state where the camera imaging function is activated, a state where the call function is activated, a state where the music playback function is activated, a state where the game function is activated, A state in which each function of the device is activated can be mentioned. Alternatively, the current moving state may be detected using an angular velocity sensor, GPS (global positioning system), or the like, or the moving speed is detected according to the moving time between two points, and the predetermined speed or more is detected. If so, it may be detected that the user is in a moving body. Further, information on the current location may be detected from street RF information or the like. In addition, it may be detected that the user is currently in a dark place / light place with a brightness sensor, or may be detected in a train or the like from analysis of surrounding voices. Thus, by detecting the operation state of the mobile terminal device itself, it is possible to select an alarm means according to the operation state.

  The “state-dependent selection alarm device” (1106) has a function of performing selection by the selection alarm means (1104) in accordance with the operation state detected by the state detection unit (1105). FIG. 12 is a diagram for explaining an example of selection according to the operation state of the mobile terminal device itself. As shown in this figure, for example, when it is detected that the camera is activated, an alarm based on, for example, audio output other than the vibration function is automatically selected in order to prevent the occurrence of camera shake. In addition, when it is detected that the mobile terminal device is in a call, a selection may be made to issue an alarm after detecting the end of the call so as not to interfere with the call by an audio alarm. Further, when it is detected that music is being played back by the mobile terminal device, it may be selected to issue an alarm other than melody output, for example, by vibration. Alternatively, it may be determined that the end of one song is determined by detecting the silent area of the music data or reading the next playback file, and an alarm is issued when the song ends. In addition, if it is detected that the user is currently moving, a warning based on melody output may be selected because it is difficult to notice vibration. Or, if it is detected that it is in a moving body from the moving speed, it will automatically select a vibration alarm so as not to disturb the surroundings if it is a train. You may choose to warn after the end of movement so as not to get in the way. If it is detected that it is in a dark place, an alarm may be selected based on the blinking of the light. If it is detected that the pressure is strong in combination with the pressure sensor, it is determined that it is in a pocket etc. An alarm may be selected. In this way, it is possible to give an alarm to the user according to the operating state of the mobile terminal device. Note that an alarm may be selected from both the type of detected mail incoming notification and the operating state. In addition, since the electronic device corresponding to this portable terminal device is the same as that already described in the first embodiment, description thereof is omitted here.

    <Processing Flow 2 of Second Embodiment> FIG. 13 is a flowchart showing an example of a processing flow in the mobile terminal device of the present embodiment. As shown in this figure, first, when a mail arrives at an electronic device different from the portable terminal device (step S1301), the electronic device detects the incoming call (step S1302). Next, an incoming mail notification is generated in response to the incoming mail detected in step S1302 (step S1303). Next, the incoming mail notification generated in step S1303 is transmitted to the portable terminal device by wireless communication (step S1304).

  Then, the incoming mail notification is received by wireless communication by the mobile terminal device (step S1305), and the operating state of the mobile terminal device itself is detected (step S1306). Subsequently, one or two or more combinations are selected from a plurality of alarm means for notifying the incoming mail notification according to the operation state detected in step S1306 (step S101307). Finally, the alarm means selected in step S1307 notifies the received mail arrival notification in the other electronic device (step S1308).

    <Simple Explanation of Effect of Second Embodiment> As described above, it is possible to select an alarm according to the type of incoming mail notification by the electronic device and the mobile terminal device of the present embodiment. In addition, for example, it is possible to know who came from the alarm according to the identification of the sender or the like, so that the response can be determined without checking the e-mail one by one, such as replying immediately. Also, the alarm means can be changed according to the state of the mobile terminal device. Therefore, for example, it is possible to avoid a situation in which, for example, a vibration function for notifying an incoming mail from another electronic device is activated during camera imaging, resulting in camera shake imaging.

  << Embodiment 3 >> <Concept of Embodiment 3> FIG. 14 is a diagram for explaining an example of a concept in the mobile terminal device of the present embodiment. As shown in this figure, the portable terminal device of this embodiment is installed in the living room on the first floor where the pet is present, and the state of the pet cat is imaged by the imaging function. The user observes the state of the pet by transmitting the image to the monitor device in the bedroom on the second floor and displaying it (1). Here, the portable terminal device in the living room that captures the appearance of the cat received the mail (2). Then, the mobile terminal device according to the present embodiment transmits command information to the bedroom monitor device that is displaying the video so as to output a voice message that “mail has arrived”, and the monitor device displays “ A voice output saying "I received an email" was made (3). In this way, the user can immediately know the arrival of an e-mail at a mobile terminal device that is being set up at a distant place and is in the process of image capture, by outputting information from the monitor device that is displaying the captured image.

    Example 3 Configuration of Mobile Terminal Device FIG. 15 is a diagram illustrating an example of functional blocks in the mobile terminal device of this example. As shown in this figure, the “portable terminal device” (1500) of this example includes an “imaging unit” (1501), a “communication unit” (1502), an “image transmission unit” (1503), and “ A "communication state information generation unit" (1504) and a "communication state information transmission unit" (1505).

  The “imaging unit” (1501) has a function of capturing an image, and can be realized by, for example, a camera provided in a mobile terminal device. Note that the imaging unit does not have to be a camera built in the mobile terminal device, and may be realized by an external camera device. Further, the image captured by the imaging unit may be a moving image or a still image. The image may be a compressed image.

  The “communication unit” (1502) has a function of transmitting / receiving information to / from an electronic device or network outside the mobile terminal device. This communication unit may be, for example, a wired communication unit or a wireless communication unit. In addition, information is transmitted / received in the communication unit by transmitting / receiving information using an e-mail protocol such as POP and SMTP, transmitting / receiving information using a call function such as CDMA, and information via the Internet network using TCP / IP or UDP / IP. Transmission / reception, etc.

  The “image transmission unit” (1503) has a function of transmitting the image captured by the imaging unit (1501) to the monitor device (1510). The image transmission by the image transmission unit may be performed by transmitting the image captured by the imaging unit in real time, or the captured image is temporarily stored in the storage unit, for example, compression or other processing processing is performed. You may send what was given. Further, the transmission means may be transmission using a communication network such as the Internet network, or may directly transmit / receive an image between the mobile terminal device and the monitor device by short-range wireless communication.

  The “communication state information generation unit” (1504) has a function of generating communication state information. “Communication status information” refers to information indicating the communication status in the communication unit (1502). For example, information indicating that communication is currently being performed, information indicating that communication has been disconnected, or communication has been established. For example, information indicating that it has not been performed. In addition, there is incoming information indicating an incoming of information in the mail function or the telephone function in the communication unit. The information format of the generated communication status information may be, for example, audio information for outputting the communication status information with a monitor device by voice, or the communication status information by displaying text or an icon on the monitor device. May be text or icon information for outputting a light, or may be light blinking rhythm control information for causing a light or the like provided in the monitor device to blink at a predetermined rhythm according to a communication state.

  The “communication state information transmission unit” (1505) has a function for transmitting the communication state information generated by the communication state information transmission unit (1504) to the monitor device (1510). This communication state information transmission unit may be, for example, wireless transmission or wired transmission. In addition, in the case of wireless communication, infrared communication, visible light communication, communication according to a standard established by the IEEE 802 committee including Bluetooth, and the like can be given. Further, the communication state information transmission unit may perform transmission including output timing information indicating the output timing of the communication state information at the monitoring device.

  In order to notify that there is (or was) any communication in the mobile terminal device while the image captured by the mobile terminal device is being displayed on the monitor device in this way, for example, the following hardware is used. Use hardware resources. First, image data captured by the imaging function of the mobile terminal device is stored in a predetermined storage area of the memory. In addition, a program for transmitting the image data is developed in the work area of the memory and executed by the CPU. This image data may be separately compressed by processing of an image compression program and stored in the memory. Then, the image data is transmitted to the monitor device by the transmission program.

  At this time, the mail client program is developed in another work area of the memory of the portable terminal device, and periodically checks the incoming mail by accessing the mail server. When the incoming mail is confirmed during the transmission of the image data, information for identifying the incoming mail notification is generated as communication state information and stored in a predetermined storage area in the memory. Further, voice information such as “mail has arrived” and image information including these characters may be acquired from a storage device that holds in advance and stored in a predetermined storage area in the memory as communication state information. Also, date / time information is acquired from the built-in clock and stored in another predetermined storage area in the memory, information indicating the serial number, mail data size, information indicating the sender, subject, keywords in the text, etc. May be stored in different predetermined areas in the memory.

  Subsequently, processing for transmitting the communication state information stored in the predetermined area in the memory in this way to the monitor device is performed. When the communication state information is transmitted by wireless communication, the communication state information is converted into a data format for wireless communication by the processing of the CPU, and is stored again in a predetermined area of the memory. In addition, a connection is established between the mobile terminal device and the monitor device, and communication status information is transmitted using a protocol such as IrLAP. Then, in the monitor device that has received this communication status information, a voice saying “mail has arrived” is output from a speaker or the like, so that the user can easily know the communication status of incoming mail in the mobile terminal device. it can.

  By transmitting the communication status information to the monitor device in this manner, for example, the monitor device that is displaying the video imaged by the mobile terminal device can be notified of an incoming mail or call. In the present embodiment, the monitor device does not perform a process that requires special explanation, and thus the description of the monitor device is omitted.

    <Processing Flow of Third Embodiment> FIG. 16 is a diagram illustrating an example of a processing flow in the present embodiment. As shown in this figure, in this embodiment, first, when imaging is started in the imaging unit (step S1601), the captured image is transmitted to an external monitor device (S1602). Here, the imaging is continued (step S1603), and when there is communication in the communication unit while the image is being transmitted to the monitor device (step S1604), communication state information is generated (step S1605). ). Then, the communication status information generated in step S1605 is transmitted to the monitor device (step S1606), and the communication status information is output by voice or the like in the monitor device.

    <Simple Explanation of Effect of Third Embodiment> As described above, while the video captured by the mobile terminal device of the present embodiment is being viewed on the monitor device located at a location distant from the mobile terminal device, Even when a mail arrives, for example, a sound such as “mail has arrived” can be output from the speaker of the monitor device, so that the incoming mail can be easily and immediately known.

  Embodiment 4 <Concept of Embodiment 4> FIG. 17 is a diagram for explaining an example of a concept in the present embodiment. As shown in this figure, in this embodiment, when a monitor device notifies a communication state such as an incoming call at a mobile terminal device being imaged, a character image or the like is superimposed on the image being displayed on the monitor device. It is characterized by doing.

    <Embodiment 4: Configuration 1 of mobile terminal device> FIG. 18 is a diagram illustrating an example of functional blocks in a mobile terminal device of the present embodiment. As shown in this figure, the “portable terminal device” (1800) of the present embodiment is based on the mobile terminal device of the third embodiment, and “imaging unit” (1801), “communication unit” (1802), “ An “image transmission unit” (1803), a “communication state information generation unit” (1804), and a “communication state information transmission unit” (1805). Since “imaging unit”, “communication unit”, “image transmission unit”, “communication state information generation unit”, and “communication state information transmission unit” have already been described in the third embodiment, description thereof will be omitted. A characteristic point of the mobile terminal device according to the present embodiment is that the communication state information transmission unit further includes a “notification image superimposing information transmission unit” (1806).

  The “notification image superimposition information transmission means” (1806) has a function of transmitting notification image superimposition information. “Notification image superimposition information” refers to information for superimposing an image based on communication state information on an image transmitted from the image transmission unit (1803) and displaying it on a monitor. For example, an image including text information indicating a communication state, an icon image, arrangement position information for combining the image with an image captured by a mobile terminal device, and the like can be given. Based on the notification image superimposition information transmitted in this manner, for example, a cat image captured by the mobile terminal device and image information including the text “mail incoming” are synthesized by the monitor device, and FIG. The display as shown in FIG. Of course, the method of superimposing and displaying the captured image and the image indicating the communication state on the monitor device is not limited to the method of combining the two images. For example, the notification image superimposing information may be information for dividing the display screen of the monitor. If it does so, the screen of a monitor apparatus can be divided | segmented into 2 screens, and the image of a cat and the character image of "mail arrival" can be displayed on each. Or you may display the character image which shows communication status information as a telop based on the information for notification image superimposition.

  In this way, for example, a character image indicating a communication state such as “call incoming” or “call disconnection” is superimposed and displayed on the monitor device, so that a captured image using a mobile terminal device can be displayed at a remote monitor device. Even during viewing, it is possible to easily know the communication state of the mobile terminal device.

    <Embodiment 4: Configuration 1 of Monitor Device> FIG. 19 is a diagram illustrating an example of functional blocks in the monitor device of this embodiment. The “monitor device” refers to a device having a display screen, and examples thereof include a CRT display device, a liquid crystal display device, a plasma display device, and an organic EL display device. Then, the “monitor device” (1910) of the present embodiment includes a “captured image acquisition unit” (1911), a “notification image superimposition information acquisition unit” (1912), and a “superimposition unit”. (1913).

  The “captured image acquisition unit” has a function of acquiring an image captured and transmitted by the mobile terminal device of the present embodiment. This acquisition includes a method of acquiring an image transmitted from the portable terminal device via, for example, the Internet network. In addition, an image captured by the mobile terminal device may be acquired in real time, or an image once stored in the storage device may be acquired.

  The “notification image superimposition information acquisition unit” (1912) has a function of acquiring the notification image superimposition information. The notification image superimposing information can be acquired by, for example, a method of acquiring via the Internet network in the same manner as the captured image acquisition unit. Alternatively, it may be acquired by wireless communication such as infrared communication, visible light communication, or communication based on a standard established by the IEEE 802 Committee including Bluetooth. If wireless communication is used in this way, communication costs can be reduced, and an effect of reducing traffic on the Internet network can be expected.

The “superimposing unit” (1913) has a function of performing the superimposing based on the acquired notification image superimposing information. For example, if the notification image superimposition information is information indicating a synthesis position for synthesizing two images or the like, the superimposition process may be performed by performing an image synthesis process.
Note that this image composition processing may be performed by, for example, performing superimposition processing by transmitting the background color of the notification image and superimposing it on the captured image when the image captured by the mobile terminal device and the notification image are the same size image. For example, the lower part of the captured image may be resized by the size of the notification image, and the superimposition process may be performed by synthesizing the notification image there. Alternatively, if the notification image superimposition information is information for dividing the display screen of the monitor, the image captured by the mobile terminal device and the notification image are superimposed and displayed by controlling the screen display to be divided into two. You may do it.

    <Processing Flow 1 of Embodiment 4> FIG. 20 is a diagram illustrating an example of a processing flow of the present embodiment. As shown in this figure, in this embodiment, first, when imaging is started in the imaging unit (step S2001), the captured image is transmitted to an external monitor device (S2002). When imaging is continued (step S2003) and communication is performed in the communication unit while the image is being transmitted to the monitor device (step S2004), an image based on the communication state information is generated. (Step S2005). Then, notification image superimposition information for superimposing the image generated in step S2005 on the transmitted image and displaying it on the monitor device is transmitted (step S2006).

  The monitor device acquires the image transmitted in step S2002 (step S2007), and acquires the notification image superimposing information transmitted in step S2006 (step S2008). Based on the image acquired in step S2007 and the notification image superimposition information acquired in step S2008, the captured image and the notification image are superimposed and displayed on the screen of the monitor device (step S2009).

    <Embodiment 4: Configuration 2 of mobile terminal device> Further, in addition to performing the superimposition processing of the image captured by the mobile terminal device and the notification image in the monitor device as described above, the superimposition processing is performed in the mobile terminal device, The superimposed image may be transmitted to the monitor device.

  FIG. 21 is a diagram illustrating an example of functional blocks in the mobile terminal device according to the present embodiment when the superimposition process is performed in the mobile terminal device. As shown in this figure, the “mobile terminal device” (2100) of the present embodiment is based on the mobile terminal device of the third embodiment, and “imaging unit” (2101), “communication unit” (2102), “ An "image transmission unit" (2103), a "communication state information generation unit" (2104), and a "communication state information transmission unit" (2105). Since “imaging unit”, “communication unit”, “image transmission unit”, “communication state information generation unit”, and “communication state information transmission unit” have already been described in the third embodiment, description thereof will be omitted. And the feature point of the portable terminal device of the present embodiment is that the communication state information generating unit further includes a “notification image generating unit” (2106), and the image transmitting unit includes “image superimposing unit” (2107) and “superimposed image”. Transmission means "(2108).

  The “notification image generation means” has a function of generating a notification image that is an image based on the communication state information. As described above, the notification image is generated, for example, by generating an image including characters such as “mail has arrived” if the communication state is incoming mail. Alternatively, a method of generating by selecting an icon image or the like indicating “mail incoming” that is held in advance may be used.

  The “image superimposing means” (2107) has a function of superimposing the generated notification image on the captured image. For example, in the same manner as the above-described superimposing unit, this superimposition is performed by, for example, transmitting the background color of the notification image and superimposing it on the captured image, or resizing a part of the captured image by the size of the notification image. And a method of synthesizing notification images.

  The “superimposed image transmission unit” has a function of transmitting the superimposed image. In this manner, the superimposition process may be performed in advance by the mobile terminal device, and the superimposed image may be transmitted to the monitor device.

    <Simple Explanation of Effects of Example 4> As described above, a character image indicating a communication state is superimposed and displayed on the screen of the monitor device by the mobile terminal device of the present embodiment. Even while viewing a captured image or the like on a remote monitor device, the communication state of the mobile terminal device can be more easily known.

The figure for demonstrating an example of the concept in the portable terminal device of Example 1. FIG. The figure showing an example of the functional block in the portable terminal device of Example 1. The figure showing another example of the functional block in the portable terminal device of Example 1. FIG. 6 is a diagram illustrating an example of functional blocks in the electronic apparatus according to the first embodiment. The flowchart showing an example of the flow of the process in Example 1. The figure showing an example of the functional block in the portable terminal device of Example 2. The figure showing another example of the functional block in the portable terminal device of Example 2. The figure for demonstrating an example of selection according to the kind of mail incoming notification in the incoming call dependence selection alarm in the portable terminal device of Example 2. FIG. 6 is a diagram illustrating an example of functional blocks in an electronic device according to a second embodiment. The flowchart showing an example of the flow of the process in Example 2. The figure showing another example of the functional block in the portable terminal device of Example 2. FIG. The figure for demonstrating an example of selection according to the own operation state in the state dependence selection alarm device in the portable terminal device of Example 2. The flowchart showing another example of the flow of processing in Example 2. The figure for demonstrating an example of the concept in the portable terminal device of Example 3. FIG. The figure showing an example of the functional block in the portable terminal device of Example 3. The flowchart showing an example of the flow of the process in Example 3. The figure for demonstrating an example of the concept in the portable terminal device of Example 4. FIG. The figure showing an example of the functional block in the portable terminal device of Example 4. FIG. 6 is a diagram illustrating an example of functional blocks in an electronic device according to a fourth embodiment. Flowchart showing an example of the flow of processing in the fourth embodiment The figure showing another example of the functional block in the portable terminal device of Example 4. FIG.

Explanation of symbols

0200 Mobile terminal device 0201 Wireless reception unit 0202 Incoming alarm unit 0410 Other electronic device 0411 Mail incoming detection unit 0412 Email incoming notification generation unit 0413 Wireless communication unit

Claims (24)

A wireless receiver for receiving an incoming mail notification to another electronic device by wireless communication;
An incoming call alarm unit for notifying that the mail incoming notification has been received;
A mobile terminal device.   The mobile terminal device according to claim 1, wherein the wireless reception unit is any one of infrared communication, visible light communication, and Bluetooth (registered trademark).   The portable terminal device according to claim 1, wherein the incoming call alarm unit includes a plurality of types of alarm means.   The portable terminal device according to claim 3, wherein the incoming call alarm unit includes a selection alarm unit that selects one or a combination of two or more alarm units and executes an alarm. An email incoming notification type detection unit for detecting the type of incoming email notification;
The portable terminal device according to claim 4, wherein the selection alarm unit includes an incoming call dependent selection alarm device that performs the selection according to the type of the detected incoming mail notification. It has a state detector that detects its own operating state,
The portable terminal device according to claim 4 or 5, wherein the selection alarm means includes an operation state-dependent selection alarm device that performs the selection according to the detected operation state. An incoming mail detector that detects incoming mail;
An incoming mail notification generation unit that generates an incoming mail notification in response to an incoming mail detected by the incoming mail detection unit;
A wireless transmission unit that transmits the incoming mail notification generated by the incoming mail notification generation unit to the mobile terminal device;
Electronic equipment having   The electronic device according to claim 6, wherein the wireless transmission unit is one of infrared communication, visible light communication, and Bluetooth. It has a mail attribute information acquisition unit that acquires attribute information of a mail whose incoming mail is detected by the mail incoming detection unit,
The electronic device according to claim 6 or 7, wherein the mail arrival notification generation unit includes attribute-dependent mail arrival notification generation means for generating a mail arrival notification of a type corresponding to the mail attribute information acquired by the mail attribute information acquisition unit. .   A mail arrival notification system comprising the mobile terminal device according to claim 1 and the electronic device according to claim 6.   A mail arrival notification system comprising the mobile terminal device according to claim 5 and the electronic device according to claim 8. An imaging unit having an imaging function;
A communication department;
An image transmission unit that transmits an image captured by the imaging unit to a monitor device;
A communication state information generation unit for generating communication state information indicating a communication state in the communication unit;
A communication state information transmitting unit for transmitting the generated communication state information to the monitor device;
A mobile terminal device.   The portable terminal device according to claim 11, wherein the communication state information is incoming information at the communication unit.   The portable terminal device according to claim 11 or 12, wherein the communication state information transmission unit is one of infrared communication, visible light communication, and Bluetooth.   The communication state information transmission unit transmits notification image superimposition information for superimposing a notification image, which is an image based on the communication state information, on the image transmitted from the image transmission unit and displaying the information on a monitor. The portable terminal device according to claim 11, further comprising an information transmission unit. The communication state information generation unit further includes notification image generation means for generating a notification image that is an image based on the communication state information,
The image transmission unit
Image superimposing means for superimposing the generated notification image on the captured image;
The portable terminal device according to claim 11, further comprising: a superimposed image transmission unit configured to transmit the superimposed image. A captured image acquisition unit that acquires an image captured and transmitted by the mobile terminal device according to claim 14;
A notification image superimposing information acquisition unit for acquiring the notification image superimposing information;
A superimposition unit that performs the superimposition based on the acquired notification image superimposition information;
Having a monitoring device.   The portable terminal device according to claim 16, wherein the notification image superimposing information acquisition unit is one of infrared communication, visible light communication, and Bluetooth. A wireless reception step of receiving an incoming mail notification to another electronic device by wireless communication with a mobile terminal;
An incoming call alarm step for notifying that there has been a mail incoming notification based on the reception of the wireless reception step;
A mobile terminal incoming alarm method. A mail incoming notification type detection step for detecting the type of the incoming mail notification;
In the incoming call alarm step, according to the type of incoming mail notification detected in the incoming call notification type detection step, one or two or more combinations are selected from a plurality of types of alarm means to perform an alarm. The mobile terminal incoming call alarm method described. It further has a state detection step for detecting the operation state of the mobile terminal itself,
21. The mobile phone according to claim 19 or 20, wherein the incoming alarm step performs alarm by selecting one or more combinations from a plurality of types of alarm means according to the operation state detected in the state detection step. Terminal incoming call alert method. An incoming mail detection step for detecting incoming mail on an electronic device;
A mail incoming notification generation step for generating a mail incoming notification in response to the incoming mail detected in the mail incoming detection step;
A wireless transmission step of transmitting the incoming mail notification generated in the incoming mail notification generation step to the mobile terminal device;
A wireless reception step of receiving the incoming mail notification transmitted in the wireless transmission step by wireless communication with the mobile terminal device;
An incoming call alarm step for notifying that there has been a mail incoming notification based on the reception of the wireless reception step;
A mobile terminal incoming alarm method. An imaging step of performing imaging with a mobile terminal device;
An image transmission step of transmitting the image captured in the imaging step to a monitor device;
A communication state information generating step for generating communication state information indicating a communication state in the mobile terminal device;
A communication state information transmission step for transmitting the generated communication state information to the monitor device;
A communication state information transmission method comprising:   The communication state information transmitting step includes a notification image superimposition for transmitting notification image superimposition information for superimposing a notification image, which is an image based on the communication state information, on the image transmitted from the image transmission step and displaying the information on a monitor. 24. The communication state information transmitting method according to claim 23, wherein the communication state information transmitting step is an information transmission step.

Images