JP2023124375A - Portable terminal and parking position determination system - Google Patents

Abstract

A mobile terminal and a parking position specifying system are provided that enable a mobile terminal to specify a parking position where a user has parked a vehicle without communicating with the vehicle.
A surrounding sound is picked up by a microphone 15 provided in a mobile terminal 1, and it is determined whether or not a user 5 carrying the mobile terminal 1 has gotten out of a vehicle based on the picked up sound. The position of the mobile terminal at the timing when it is determined that the user 5 got out of the vehicle is specified as the parking position where the user 5 parked the vehicle.
[Selection drawing] Fig. 5

Description

The present invention relates to a mobile terminal and a parking position specifying system for specifying a parking position where a user has parked a vehicle.

When the user travels to the destination by vehicle, the user generally drives the vehicle to a parking lot located within the site of the destination or in the vicinity of the destination, parks the vehicle, and then exits the vehicle. Walk to your destination. Then, when returning home from the destination, the vehicle is moved on foot to the parking position where the vehicle was parked, and then the vehicle is boarded to return home. Here, especially when the destination is a large facility or when the vehicle is parked at a location far from the destination, there is a problem that the user forgets where the vehicle is parked when returning home.

Therefore, for example, in Japanese Patent Application Laid-Open No. 2013-123097, a mobile terminal carried by a user and an on-vehicle device (for example, a navigation device) mounted on a vehicle are communicably connected, and when the ignition of the vehicle is turned off, the vehicle Disclosed is a technology that enables the user to grasp the position where the vehicle is parked after getting off the vehicle by detecting the position as the parking position of the vehicle on the vehicle side and transmitting the detected parking position to a mobile terminal to guide the user. ing.

JP 2013-123097 A (pages 13-15)

In Patent Literature 1, it is an essential condition that the portable terminal carried by the user and the vehicle-mounted device mounted on the vehicle are connected so as to be able to communicate with each other. However, it is not always the case that the vehicle in which the user rides is equipped with an on-board device equipped with a function to communicate with a mobile terminal, and a vehicle equipped with such an on-board device that does not have a communication function with a mobile terminal. There is a problem that the invention cannot be implemented when riding in a car. Moreover, even when the user rides in a vehicle that the user is not familiar with, such as a rental car or an acquaintance's car, the user may not know the operation method for communicating with the mobile terminal, and similarly cannot implement the invention.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems, and enables a mobile terminal to identify the parking position where the user has parked the vehicle without communicating with the vehicle. An object of the present invention is to provide a mobile terminal and a parking position specifying system.

A mobile terminal according to the present invention to achieve the above object is a mobile terminal carried by a user, comprising: a sound collecting means for collecting surrounding sounds; getting off determination means for determining whether or not the user carrying the terminal has gotten off the vehicle; and parking position specifying means for specifying a parking position where the vehicle is parked.
Here, the "parking position" may be specified by coordinates (latitude and longitude), or may be specified by the parking space if the parking space can be specified. Moreover, when the parking lot where the vehicle is parked is divided into a plurality of areas, the area may be specified. Furthermore, if the parking lot where the vehicle is parked is located far from the destination, the parking lot may be specified.

Further, the parking position specifying system according to the present invention includes a sound collecting means for collecting surrounding sounds in a mobile terminal carried by a user; a getting-off determining means for determining whether or not the user has gotten off the vehicle; and a parking position identifying means for identifying the parking position.

According to the mobile terminal and the parking position specifying system according to the present invention having the above configuration, the mobile terminal side can park the vehicle based on the information that the mobile terminal can acquire without communicating with the vehicle. It becomes possible to specify the position. As a result, the parking position can be specified without being affected by the functions of the vehicle in which the user rides, and high versatility can be achieved. Then, using the identified parking position, it becomes possible to provide various types of support such as information provision and movement guidance to the user.

1 is a schematic configuration diagram showing a parking position specifying system according to an embodiment; FIG. 1 is a block diagram showing the configuration of a mobile terminal according to an embodiment; FIG. 4 is a flowchart of a parking position identification processing program according to the embodiment; FIG. 4 is a diagram showing waveforms of door opening/closing sounds for each vehicle type. It is a figure explaining the identification method of the parking position based on the change of a user's movement mode, and the sound collection of an exit sound. It is the figure which showed the guidance example which guides a parking position using a parking lot map. It is the figure which showed the guidance example which guides a parking position using a parking lot map. It is the figure which showed the guidance example which guides a parking position using a map image. It is the figure which showed the guidance example which performs the movement guidance to a parking position.

Hereinafter, a mobile terminal according to the present invention will be described in detail based on a specific embodiment with reference to the drawings. First, a schematic configuration of a parking position identification system 2 including a mobile terminal 1 according to this embodiment will be described with reference to FIG. FIG. 1 is a schematic configuration diagram showing a parking position specifying system 2 according to this embodiment.

As shown in FIG. 1, the parking position identification system 2 according to this embodiment basically has an information providing server 4 owned by an information providing center 3 and a mobile terminal 1 carried by a user 5. FIG. The information providing server 4 and the mobile terminal 1 are configured to be able to transmit and receive electronic data to and from each other via the communication network 7 . The mobile terminal 1 is a terminal that can be carried by a user, and includes, for example, a mobile phone, a smart phone, a tablet terminal, a personal computer, and the like. Further, in this embodiment, it is assumed that the user 5 is in a state of moving to the destination by vehicle.

Here, the information providing server 4 is a server device that manages transmission and reception of information in the parking position specifying system 2 . The information providing server 4 stores information to be provided to the mobile terminal 1 such as map information in the information DB 8 . The map information stored in the information DB 8 includes, for example, link data related to roads (links), node data related to node points, point data related to points such as facilities, map display data for displaying maps, and data related to each intersection. It includes intersection data, search data for searching for routes, search data for searching for points, and the like. Furthermore, as point data, in addition to location information of parking lots, as information on parking lots (including both parking lots attached to facilities and independent parking lots) where vehicles are to be parked, the shape of the parking lot and the parking lot A parking map is included that shows the placement of parking spaces within the lot.

Further, when receiving a route search request from the mobile terminal 1, the information providing server 4 can search for a route from the departure point to the destination using the map information stored in the information DB 8. . Specifically, when a destination is set in the mobile terminal 1, the mobile terminal 1 transmits information necessary for route search such as a departure point and a destination to the information providing server 4 together with a route search request. After receiving the route search request, the information providing server 4 performs a route search using map information possessed by the information providing server 4, and specifies a recommended route from the departure point to the destination. After that, the identified recommended route is transmitted to the mobile terminal 1 that made the request. Then, the portable terminal 1 sets the received recommended route as a guidance route, and performs movement guidance according to the guidance route. As a result, even if the map information possessed by the mobile terminal 1 at the time of route search is of an old version, or even if the mobile terminal 1 does not have the map information itself, the latest version possessed by the information providing server 4 can be used. An appropriate guidance route can be set based on the map information.

However, it is also possible for the mobile terminal 1 to have the map information described above by a method such as downloading it to the mobile terminal 1 in advance. If the mobile terminal 1 has map information, the mobile terminal 1 can perform the route search process instead of the information providing server 4 . In addition, there is no need to acquire map information from the information providing server 4 when displaying a map image on the mobile terminal 1 . That is, the information providing server 4 is not essential in the parking position specifying system 2 .

On the other hand, the mobile terminal 1 is a terminal that can be carried by the user 5, and is an information terminal equipped with a navigation function, such as a mobile phone, a smart phone, a tablet terminal, a personal computer, and the like. In particular, when the mobile terminal 1 is a terminal capable of executing an application such as a smart phone, an application program is installed as one of the applications that can identify and guide the user's parking position. Note that the navigation application may have a function of identifying and guiding the parking position as one function. Other functions of the navigation application include displaying route information that identifies the route searched by the information providing server 4, and providing information for the user 5 based on map data obtained from the information providing server 4 and stored in memory. This corresponds to the function of displaying a map image around the current position, displaying the current position of the user 5 in the displayed map image, and performing movement guidance along a set guidance route. It should be noted that the mobile terminal 1 does not need to have all of the above navigation functions. Details of the mobile terminal 1 will be described later.

The communication network 7 includes a large number of base stations located all over the country and communication companies that manage and control each base station. It is configured by connecting Here, the base station has a transceiver (transmitter/receiver) for communicating with the mobile terminal 1 and an antenna. While the base station performs wireless communication between communication companies, it is the terminal of the communication network 7, and communicates with the information providing server 4 of the mobile terminal 1 within the range (cell) where the radio waves of the base station reach. It has a role of relay.

Next, a schematic configuration of the mobile terminal 1 carried by the user 5 will be described with reference to FIG. FIG. 2 is a block diagram schematically showing the control system of the mobile terminal 1 according to this embodiment. In addition, below, the case where the portable terminal 1 is especially a smart phone is mentioned as an example, and it demonstrates.

As shown in FIG. 2, the mobile terminal 1 has a data bus BUS, a CPU 11, and a memory 12 in which user information (user ID, etc.) related to a user 5 who carries the mobile terminal 1, user movement history, various setting information, and the like are stored. and a transmitting/receiving circuit unit (RF) 13 for transmitting/receiving signals to/from the base station of the communication network 7, and the RF (Radio Frequency) signal received by the transmitting/receiving circuit unit 13 is converted into a baseband signal, and the baseband It consists of a baseband processing unit 14 that converts a signal into an RF signal, an input/output unit 17 that is an interface with a microphone 15, a speaker 16, etc., a display 18 that is composed of a liquid crystal display panel, etc., a touch panel, hard buttons, etc. The input operation unit 19, the GPS 20, and the camera 21 are connected to each other.

Here, the CPU 11 built in the mobile terminal 1 is control means of the mobile terminal 1 that executes various operations according to the operation program stored in the memory 12 , and together with the memory 12 constitutes the mobile terminal control section 22 . Various processing contents of the mobile terminal control unit 22 are displayed on the display 18 as necessary. In addition, the mobile terminal control section 22 has various means as a processing algorithm together with the control section of the information providing server 4 . For example, the sound pickup means uses the microphone 15 to pick up surrounding sounds. The getting-off determination means determines whether or not the user 5 carrying the mobile terminal 1 has gotten off the vehicle based on the sound picked up by the microphone 15 . The parking position identifying means identifies the position of the mobile terminal 1 at the timing when the user 5 has exited the vehicle by the getting-off determining means as the parking position where the user 5 parked the vehicle.

In addition, the memory 12 stores user information (user ID, etc.) on the user 5 possessing the portable terminal 1, the user's web browsing history, and the user's movement history, which is the history of location information detected based on the GPS 20 and other sensors. , various setting information (for example, the waveform of door opening/closing sound for each vehicle type) and the like are stored. Various application programs including a parking position identification processing program (FIG. 3), which will be described later, are also stored. Also, the memory 12 may be configured by a hard disk, a memory card, or the like.

In addition, the microphone 15 is normally used to pick up the voice uttered by the user, but when the parking position identification processing program (FIG. 3), which will be described later, is executed, the microphone 15 is particularly generated in the surroundings other than the voice uttered by the user. It is used to pick up the sound produced. Specifically, in addition to the door opening/closing sound, engine sound, and door mirror operating sound of the vehicle in which the user gets in, it is also possible to pick up the running sound of other vehicles running in the vicinity after getting off the vehicle. Then, in this embodiment, by measuring the waveforms of the sounds picked up by the microphones 15, it is determined whether or not the user has exited the vehicle.

In addition to voice output of calls, the speaker 16 also provides voice guidance for driving along a guidance route (user's planned travel route) based on instructions from the mobile terminal control unit 22 when the navigation function is executed. Output.

A display 18 is arranged on one side of the housing, and a liquid crystal display, an organic EL display, or the like is used. A top screen for executing various applications installed in the mobile terminal 1, screens related to the executed applications (Internet screen, mail screen, navigation screen, etc.), and various information such as images and videos are displayed. be done. In particular, in this embodiment, it is also used when guiding the parking position where the user has parked the vehicle, as will be described later.

The input operation unit 19 is configured by a touch panel provided on the front surface of the display 18, hardware buttons arranged on the housing, and the like. Then, the mobile terminal control unit 22 performs control to execute various corresponding operations based on an electric signal output by pressing a touch panel or hardware button. The input operation unit 19 can also be composed of various keys such as number/character input keys, cursor keys for moving a cursor for selecting displayed contents, and decision keys for confirming selections.

Also, the GPS 20 can detect the current position and current date and time of the mobile terminal 1 (that is, the user 5) by receiving radio waves generated by artificial satellites. In addition to the GPS 20, the configuration may include other devices (for example, a gyro sensor, etc.) for detecting the current position and orientation of the mobile terminal 1. FIG.

Also, the camera 21 is a small-sized image pickup device configured by a camera using a solid-state image pickup device such as a CCD, and is built in the back side of the mobile terminal 1 . By operating the input operation unit 19 while the dedicated application program is activated, the user can capture an image of the surroundings. The captured image captured by the camera 21 is stored in the memory 12 .

Next, a parking position identification processing program executed by the CPU 11 in the portable terminal 1 having the above configuration will be described with reference to FIG. FIG. 3 is a flowchart of a parking position identification processing program according to this embodiment. Here, the parking position specifying processing program is executed after a predetermined application program such as a navigation application is started in the mobile terminal 1, specifies the parking position when the user parks the vehicle, and uses the specified parking position. It is a program that provides various types of support. 3 is stored in the memory 12 provided in the mobile terminal 1 and executed by the CPU 11. The program shown in the flowchart in FIG.

First, in step (hereinafter abbreviated as S) 1 of the parking position identification processing program, the CPU 11 obtains the detection result of the current position of the portable terminal 1 that is periodically output. Here, the mobile terminal 1 uses various sensors such as a magnetic sensor, a gyro sensor, etc. in addition to the GPS 20 to detect the current position and orientation (advance direction) of the mobile terminal 1 periodically (for example, every 1 sec). is output each time. In particular, when the mobile terminal 1 is located in an area where radio waves from satellites are difficult to reach, such as inside a building, underground, or near a high-rise building, the current location of the mobile terminal 1 can be determined using Wi-Fi or a mobile network. may be detected.

Then, in S1, the CPU 11 calculates the moving speed of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) based on the change in the current position of the mobile terminal 1 that is periodically output. Note that the calculation of the moving speed is continuously performed at predetermined intervals thereafter.

Next, in S2, the CPU 11 determines that the moving speed of the mobile terminal 1 (i.e., the user carrying the mobile terminal 1) obtained in S1 has an average value of 10 km/h or more and 120 km within the most recent predetermined time period (for example, 1 minute). /h or less. Note that the speed range, which is the determination condition of S2, is a moving speed range that can be generally taken when the user moves by vehicle, and may be changed depending on the country or region. Also, if the road type of the road on which the user is currently located can be specified, the speed range may be changed according to the road type. For example, 40 km/h or more and less than 70 km/h on general roads excluding narrow streets, 70 km/h or more and less than 120 km/h on expressways, and 10 km/h or more and less than 40 km/h on narrow streets.

Furthermore, if traffic information such as congestion can be acquired, it is desirable to change the speed range in consideration of the traffic information as well. That is, when the road on which the user is currently located is congested, the lower limit of the speed range is made smaller than 10 km/h.

Then, when it is determined that the average value of the moving speed of the mobile terminal 1 within the most recent predetermined time is 10 km/h or more and less than 120 km/h (S2: YES), the user 5 is moving by vehicle. , and shifts to S3. On the other hand, when it is determined that the average value of the moving speed of the mobile terminal 1 within the most recent predetermined time is not less than 10 km/h and less than 120 km/h (S2: NO), the user 5 uses a means of transportation other than a vehicle. It is assumed that the user is moving (for example, by train, by bicycle, on foot, etc.), and the parking position identification processing program is terminated.

Subsequently, in S3, the CPU 11 determines whether the moving speed of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has decreased to less than 10 km/h (including 0 km/h).

If it is determined that the moving speed of the mobile terminal 1 has decreased to less than 10 km/h (S3: YES), it is estimated that the vehicle may park after that, and the process proceeds to S4. On the other hand, when it is determined that the moving speed of the mobile terminal 1 is 10 km/h or more (S3: NO), the mobile terminal 1 waits until the moving speed becomes less than 10 km/h.

In S<b>4 , the CPU 11 starts collecting surrounding sounds with the microphone 15 . Note that the sound pickup by the microphone 15 is continued until the parking position is specified in S9 to be described later in a state where the moving speed of the portable terminal 1 is less than 10 km/h.

Thereafter, in S5, the CPU 11 determines whether or not the movement of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has stopped and the microphone 15 has picked up a get-off sound indicating that the user has gotten off the vehicle. . Note that "movement of the mobile terminal 1 is stopped" means that the current position of the mobile terminal 1, which is periodically output, does not change. However, it is desirable to consider that the movement of the mobile terminal 1 has stopped. Further, when the determination in S5 is YES, basically the exit sound is collected while the movement of the mobile terminal 1 is stopped. If the movement of the mobile terminal 1 stops within a certain period of time (for example, within 30 seconds), or if the exit sound cannot be picked up while the movement of the mobile terminal 1 has stopped, it is possible to pick up the sound within a predetermined time (for example, 30 seconds) after the movement is resumed. It is also desirable to determine YES when the exit sound is picked up within the time limit.

Also, the getting-off sound indicating that the user has gotten off the vehicle corresponds to, for example, the following sounds (1) to (4). All the sounds (1) to (4) may be included in the getting-off sound, or only some of them may be used as the getting-off sound. Further, in S5, the condition may be that at least one getting-off sound from among (1) to (4) is picked up, or that a plurality of getting-off sounds are picked up.
(1) Vehicle Door Opening/Closing Sound As shown in FIG. 4, the memory 12 of the mobile terminal 1 stores in advance the waveform of the sound representing the vehicle door opening/closing sound for each vehicle type. If the waveform of the sound picked up by the microphone 15 matches or resembles the waveform of the door opening/closing sound of any vehicle type, it is determined that the exiting sound has been picked up. Alternatively, the model of the vehicle that the user rides is obtained in advance based on the user's operation, and the waveform of the sound picked up by the microphone 15 matches or resembles the waveform of the opening/closing sound of the vehicle model that the user rides. Also, it is possible to determine that the exit sound has been picked up. Furthermore, as shown in FIG. 4, instead of registering in advance the opening and closing sounds of the doors of all vehicle types, only the opening and closing sounds of the doors of the vehicle in which the user rides are extracted from the sounds picked up by the microphone 15 in the past. If the waveform of the sound picked up by the microphone 15 matches or resembles the waveform of the registered opening/closing sound, it is possible to determine that the exiting sound has been picked up.
(2) Door Mirror Operation Sound The memory 12 of the mobile terminal 1 stores in advance a waveform of a sound representing the door mirror operation sound. It should be noted that the waveform may be stored for each vehicle type in the same manner as the door opening/closing sound. Then, when the waveform of the sound picked up by the microphone 15 matches or resembles the waveform of the sound indicating the operation sound of the door mirror, it is determined that the exiting sound has been picked up.
(3) Stopping Engine Sound The memory 12 of the mobile terminal 1 stores in advance a waveform of a sound indicating the driving sound of the engine. It should be noted that the waveform may be stored for each vehicle type in the same manner as the door opening/closing sound. Then, when the waveform corresponding to the driving sound of the engine disappears based on the waveform of the sound picked up by the microphone 15, it is determined that the exiting sound has been picked up.
(4) Changes in Environmental Sounds Since it is expected that the type and volume of environmental sounds picked up will differ significantly between the interior and exterior of the vehicle, the timing of the waveform of the sound picked up by the microphone 15 is the boundary. When there is a large change, it is determined that the getting-off sound has been picked up at that timing. A condition that the sound pressure has increased may be added as a condition. Moreover, it is possible to add a condition that the running sound of the other vehicle changes from being collected to being collected.

Then, when it is determined that the movement of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has stopped and the exit sound indicating that the user has exited the vehicle has been picked up by the microphone 15 (S5: YES). estimates that the user may have parked the vehicle and exited the parked vehicle. After that, the process proceeds to S6. On the other hand, if it is determined that the movement of the mobile terminal 1 has not stopped, or even if it has stopped, the exit sound indicating that the user has exited the vehicle cannot be picked up by the microphone 15 (S5: NO). , it is assumed that the user is still in the vehicle, and the process returns to S3.

In S6, the CPU 11 acquires the position of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) at the timing when it was determined in S5 that the user got out of the vehicle, and stores it in the memory 12 as a temporary parking position. As described above, the detection result of the current position of the mobile terminal 1 is periodically output. The current position of the mobile terminal 1 immediately after it is determined that the sound has been picked up is specified as a temporary parking position. Note that the temporary parking position may be specified by coordinates (latitude and longitude), or if the parking space can be specified, it may be specified by the parking space. Moreover, when the parking lot where the vehicle is parked is divided into a plurality of areas, the area may be specified. Furthermore, if the parking lot where the vehicle is parked is located far from the destination, the parking lot may be specified.

Subsequently, in S7, the CPU 11 determines that the mobile terminal 1 moves again within a predetermined time (for example, 3 minutes) after it is determined in S5 that the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has stopped moving. is started.

Then, it is determined that the mobile terminal 1 has started moving again within a predetermined time (for example, 3 minutes) after it is determined that the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has stopped moving in S5. If so (S7: YES), the process proceeds to S8. On the other hand, if the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has not started moving within a predetermined time (for example, 3 minutes) after it is determined that the mobile terminal 1 (ie, the user carrying the mobile terminal 1) has stopped moving, If so (S7: NO), it is assumed that the user has only parked the vehicle temporarily for a break, and will not get out of the vehicle and move to another location, and the process proceeds to S3. and return.

In S8, the CPU 11 confirms that the moving speed of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) after resuming movement has an average value of greater than 0 km/h and 10 km/h within the most recent predetermined time period (for example, 1 minute). It is determined whether or not it is less than h. Note that the speed range, which is the determination condition of S8, is the range of possible moving speeds when the user generally moves on foot.

It should be noted that the speed range, which is the determination condition of S8, can be set to a more optimum speed range suitable for the user through learning. Specifically, the movement speed when the user moves on foot is learned from the movement history when the user moves on foot in the past. For example, it is possible to calculate the average value of the movement speed when the user moves on foot from the past movement history, and set the range of the average value±σ (standard deviation) as the speed range.

Then, when it is determined that the average value of the moving speed of the mobile terminal 1 within the most recent predetermined time is greater than 0 km/h and less than 10 km/h (S8: YES), the user 5 gets off the vehicle. It is assumed that the user is moving on foot, and the process proceeds to S9. On the other hand, if it is determined that the average moving speed of the mobile terminal 1 within the most recent predetermined time is greater than 0 km/h and not less than 10 km/h (S8: NO), the user continues to drive the vehicle. It is assumed that the vehicle is in the state of getting on the vehicle, and the process returns to S3.

In S9, the CPU 11 reads out the temporary parking position stored in the memory 12 in S6, and finally determines it as the parking position where the user parked the vehicle. That is, by determining YES in S8, as shown in FIG. 5, the movement mode of the user is movement by vehicle before the timing when the sound of exiting the vehicle is collected, and after the timing when the sound of exiting the vehicle is collected. It can be assumed that they switched to walking. As a result, it can be estimated that the user carrying the mobile terminal got out of the vehicle at the timing of picking up the exit sound, and the position of the mobile terminal 1 at the timing of picking up the exit sound can be determined from the parking location where the user parked the vehicle. It can be specified as a position.

Further, as a condition for determining the parking position in S9, it may be added that the position where the movement of the mobile terminal 1 (that is, the user carrying the mobile terminal 1) has stopped is the parking lot in S5. good. It is determined based on the map information obtained from the information providing server 4 or read from the memory 12 whether or not the position where the movement of the portable terminal 1 has stopped is the parking lot. The point data included in the map information stores the positions of parking lots, including parking lots associated with facilities and independent parking lots. As a result, the user parks the vehicle only when the position of the mobile terminal 1 at the timing when the getting-off sound is collected in S9 (the timing when it is determined that the user has gotten off the vehicle) is in the parking lot. It becomes possible to identify the parking position.

After that, in S10, the CPU 11 executes various support processes based on the user's parking position specified in S9. For example, (A) parking position guidance processing for guiding the parking position, and (B) movement guidance processing for guiding movement from the user's current position to the parking position will be described as examples.

(A) Parking Position Guidance Processing for Providing Parking Position Guidance When the parking position guidance processing for guiding the parking position is performed, for example, FIG. A parking lot map 31 is displayed on the display 18 as follows. The parking lot map 31 is a guide image showing the shape of the parking lot where the vehicle is parked and the layout of the parking spaces in the parking lot, and is acquired from the information providing server 4, for example. Then, in the parking lot map 31, a mark 32 is displayed at the position of the parking space corresponding to the parking position specified in S9 to guide the user to the parking position. If it is difficult to specify the parking position for each parking space due to the problem of position information detection accuracy, a circular mark 33 is displayed centering on the specified parking position as shown in FIG. You can guide the parking position. Furthermore, if the parking lot where the vehicle is parked is divided into a plurality of areas, the area including the parking position may be guided.
On the other hand, when the user is away from the parking lot where the vehicle is parked, a map image 35 around the user's current position is displayed on the display 18 as shown in FIG. The map image 35 is obtained from the information providing server 4, for example. On the map image 35, a current position mark 36 indicating the user's current position and a parking position mark 37 at a point (coordinates) corresponding to the parking position specified in S9 are displayed. Thereby, the parking position is guided to the user. 8 is displayed on the display 18, when the user moves into or near the parking lot where the vehicle is parked, the parking lot shown in FIGS. It is desirable to switch to map 31 .

(B) Movement Guidance Processing for Providing Movement Guidance from the User's Current Position to the Parking Position When performing movement guidance processing for performing movement guidance from the user's current position to the parking position, the user's current position is first used as the departure point. , search for a recommended route with the parking position specified in S9 as the destination. Although the route search is performed by the information providing server 4, it may be performed by the mobile terminal 1 as long as the mobile terminal 1 has map information. The recommended route searched at this time is a walking route. Therefore, the mobile terminal 1 or the information providing server 4, which mainly searches for the recommended route, uses, in addition to normal map information, for example, a parking lot corresponding to the complex facility (a parking lot attached to the facility) in order to search for a walking route. (including parking lots and stand-alone parking lots), information that identifies the location of entrances and exits to parking lots, information that identifies the layout of parking spaces within parking lots, information on lane markings that separate parking spaces, and information on how vehicles and pedestrians It has information about passable passages. For complex facilities, information specifying the floor map of the facility is also included. The floor map includes, for example, information specifying the positions of entrances, exits, passages, stairs, elevators, escalators, and ticket gates in the case of stations. It also includes information specifying the location of each tenant who moves in. In addition, it is also possible to have information generated by 3D models of parking lots and complex facilities in particular. Movement guidance to the parking position is performed based on the searched recommended route. As a method of movement guidance, for example, as shown in FIG. A map is displayed, and a current position mark 41 indicating the user's current position and a future traveling direction 42 along the guidance route are also displayed. Also, voice guidance may be provided according to the guidance route. Information (for example, parking lot map, floor map, voice data, etc.) necessary for movement guidance can be obtained from the information providing server 4 as needed. As a result, the user can reliably reach the parking position where the vehicle is parked based on the guidance provided by the mobile terminal 1 .

However, if it is difficult to specify the detailed current position of the user in the building due to the accuracy of the GPS of the mobile terminal 1, the movement guidance based on the current position of the user is not performed, and the entire floor of the building is displayed. The map, the parking lot map, the parking position specified in S9, and the guidance route may be displayed. When it is determined that the user has reached the parking position after that, the portable terminal 1 ends the parking position guidance.

As described in detail above, in the computer program executed in the mobile terminal 1, the parking position specifying system 2, and the mobile terminal 1 according to the present embodiment, ambient sounds are picked up by the microphone 15 provided in the mobile terminal 1 (S4 ), it is determined whether or not the user 5 carrying the mobile terminal 1 has exited the vehicle based on the collected sound (S2 to S8), and the mobile terminal at the timing when it is determined that the user 5 has exited the vehicle is specified as the parking position where the user 5 parked the vehicle (S9). It becomes possible to identify the parking position where the vehicle was parked. As a result, the parking position can be specified without being affected by the functions of the vehicle in which the user rides, and high versatility can be achieved. Then, using the identified parking position, it becomes possible to provide various types of support such as information provision and movement guidance to the user.
In addition, position detection results obtained by detecting the position of the mobile terminal 1 are acquired at a predetermined cycle, and based on the acquired position detection results, the movement mode of the user is specified (S2, S3, S8), and the specified user's Since it is determined whether or not the user has exited the vehicle based on the mode of movement and the sound picked up by the microphone 15 (S2 to S8), the mobile terminal side can control the mobile terminal 1 without communicating with the vehicle. It becomes possible to identify the movement mode of the user from the information that can be obtained from the Then, by using the identified movement mode of the user, it becomes possible to accurately determine whether or not the user has exited the vehicle.
Further, when the microphone 15 included in the mobile terminal 1 picks up a getting-off sound indicating that the user has gotten off the vehicle, and the movement mode of the user specified is before the timing at which the getting-off sound is picked up, the vehicle If the movement is on foot after the timing of picking up the exit sound, it is determined that the user has exited the vehicle (S2 to S8). It is possible to specify the parking position where the user has parked the vehicle based on the sound picked up by the terminal and the change in the user's movement mode.
In addition, since the exit sound includes at least one of the opening and closing sound of the vehicle door, the operating sound of the door mirror, the stop of the engine sound, and the change in the environmental sound, the sound can be heard by the microphone provided in the mobile terminal without communicating with the vehicle. It is possible to determine whether or not the user has exited the vehicle from the collected sound.
In addition, the waveform of the sound representing the opening/closing sound of the vehicle door is stored for each vehicle type, and the waveform of the sound picked up by the microphone 15 matches or resembles the waveform of the sound of the vehicle type or any of the vehicle types that the user rides. In this case, it is determined that the sound of exiting the vehicle has been collected. Therefore, it is possible to determine whether the user has exited the vehicle by collecting the door opening/closing sound when the user exits the vehicle. .
Also, the movement speed when the user moves on foot is learned, and based on the detected movement speed of the mobile terminal and the learning result, it is determined whether or not the user's movement mode is walking (S8). , it becomes possible to accurately determine whether or not the user is moving on foot from the change in the location information of the mobile terminal.
In addition, map information including information specifying the position of a parking lot is acquired, and if the position of the mobile terminal at the timing when it is determined that the user has exited the vehicle is the position of the parking lot, the user can park the vehicle. Since it is specified as the parking position where the vehicle was parked, it is possible to prevent the parking position from being erroneously determined by using the map information.

It should be noted that the present invention is not limited to the above-described embodiments, and of course various improvements and modifications are possible without departing from the gist of the present invention.
For example, the present embodiment is characterized in that the mobile terminal 1 can specify the parking position without communicating with an onboard device (for example, a navigation device) mounted on the vehicle. Even if it is in the state, it is naturally possible to implement it. That is, it does not matter whether the mobile terminal 1 can communicate with the vehicle-mounted device.

Further, in the present embodiment, exiting sounds indicating that the user has exited the vehicle include the opening and closing sound of the vehicle doors, the operating sound of the door mirror, the stoppage of the engine sound, and changes in environmental sounds. Sounds other than those may be used. For example, the sound of opening and closing a window, the sound of putting on and taking off a seatbelt, the sound of getting up from a seat, and the like.

In addition, in the present embodiment, in addition to the pickup of the getting-off sound, the condition for determining that the user has gotten off the vehicle is that the user's movement mode has changed from moving by vehicle to moving on foot before and after that. Alternatively, it may be determined whether or not the user has exited the vehicle only by collecting the exit sound. That is, S2, S3, S7, and S8 may be omitted in the parking position identification processing program of FIG.

In addition to smartphones, the present invention can be applied to various devices having a function of collecting ambient sounds as mobile terminals. For example, it can be applied to mobile phones, tablet terminals, personal computers, and the like. Also, a microphone for picking up surrounding sounds may be built-in or may be externally attached.

It can also be applied to a system composed of a server and mobile terminals. In that case, each step of the above-described parking position identification processing program (FIG. 3) may be configured to be executed by either the server or the mobile terminal.

DESCRIPTION OF SYMBOLS 1... Portable terminal, 2... Parking position identification system, 4... Information providing server, 5... User, 8... Information DB, 11... CPU, 12... Memory, 15... Microphone, 18... Display, 22... Portable terminal control unit

Claims (8)

A mobile terminal carried by a user,
a sound collecting means for collecting surrounding sounds;
a getting-off determining means for determining whether or not the user carrying the mobile terminal has gotten off the vehicle based on the sound collected by the sound collecting means;
a parking position specifying means for specifying the position of the mobile terminal at the timing when the user got off the vehicle by the getting-off determining means as the parking position where the user parked the vehicle. a position result obtaining means for obtaining a position detection result of detecting the position of the mobile terminal at a predetermined cycle;
movement mode identification means for identifying a movement mode of the user based on the position detection result acquired by the position result acquisition means;
2. The getting-off determination means determines whether or not the user has gotten off the vehicle based on the movement manner of the user identified by the movement manner identification means and the sound collected by the sound collecting means. Mobile device as described. The getting-off determination means includes:
When the sound pickup means picks up a getting-off sound indicating that the user got off the vehicle,
and the movement mode of the user identified by the movement mode identification means is movement by vehicle before the timing of collecting the sound of getting off the vehicle, and movement on foot after the timing of collecting the sound of getting off the vehicle. to the
3. The mobile terminal according to claim 2, wherein it is determined that the user has exited the vehicle. 4. The portable terminal according to claim 3, wherein the getting-off sound includes at least one of a vehicle door opening/closing sound, a door mirror operation sound, an engine sound stop, and an environmental sound change. The waveform of the sound indicating the opening and closing sound of the vehicle door is stored for each vehicle type,
The getting-off determining means picks up the getting-off sound when the waveform of the sound picked up by the sound collecting means matches or resembles the waveform of the sound of the vehicle type or one of the vehicle types of the vehicle the user rides. 5. The mobile terminal according to claim 3 or 4, wherein the mobile terminal determines that Having a learning means for learning the movement speed when the user moves on foot,
The movement mode identification means calculates the movement speed of the mobile terminal based on the position detection result acquired by the position result acquisition means, and calculates the movement speed of the mobile terminal based on the learning result of the learning means. 6. The portable terminal according to any one of claims 3 to 5, wherein it is determined whether the mode of movement of the user is walking, based on the information. having map information acquisition means for acquiring map information including information specifying the position of the parking lot;
The parking position specifying means determines that the user has parked the vehicle when the position of the mobile terminal at the timing at which the getting-off determination means determines that the user has exited the vehicle is the position of the parking lot. 7. The mobile terminal according to any one of claims 1 to 6, which is specified as a parking position. a sound collecting means for collecting surrounding sounds in a mobile terminal carried by a user;
a getting-off determining means for determining whether or not the user carrying the mobile terminal has gotten off the vehicle based on the sound collected by the sound collecting means;
parking position specifying means for specifying the position of the mobile terminal at the timing when the user got off the vehicle by the getting-off determining means as the parking position where the user parked the vehicle. system.

Images