JP7045285B2 - Information providing equipment, information providing method, and information providing program - Google Patents

Description

The embodiments of the disclosure relate to an information providing device, an information providing method, and an information providing program.

Conventionally, there is a navigation system that guides a user to a walking route to a destination based on a self-position determined by GPS (Global Positioning System) and map information.

In addition, when GPS becomes unavailable, the user is guided to the walking route to the destination based on the user's travel distance information acquired from the step count sensor, the orientation information acquired from the geomagnetic sensor, and the map information. There is a navigation system (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2012-230092

However, in the conventional technology, when GPS is not available and there is no map information, it may not be possible to return the moved user to the original place.

One embodiment of the embodiment is made in view of the above, and is an information providing device capable of returning a moved user to the original place when GPS is not available and there is no map information. The purpose is to provide information provision methods and information provision programs.

The information providing device according to one embodiment includes a detecting unit, a marking unit, and a providing unit. The detection unit detects the movement of its own position. The marking unit marks the passing point of the self-position in the local coordinate system based on the movement start position of the self-position based on the detection result by the detection unit. The providing unit provides the user with information indicating the position of the passing point marked by the marking unit.

According to the information providing device, the information providing method, and the information providing program according to one aspect of the embodiment, when GPS is not available and there is no map information, the moved user can be returned to the original place. can.

FIG. 1 is an explanatory diagram showing an outline of an information providing method according to an embodiment. FIG. 2 is a block diagram showing an example of the configuration of the information providing device according to the embodiment. FIG. 3 is an explanatory diagram showing an example of passing point information according to the embodiment. FIG. 4 is an explanatory diagram showing a procedure for generating the shortest return information according to the embodiment. FIG. 5 is a flowchart showing an example of processing executed by the control unit of the information providing device according to the embodiment. FIG. 6 is a block diagram showing an example of the configuration of the information providing device according to the modified example of the embodiment. FIG. 7 is an explanatory diagram showing an example of the self-position correction procedure according to the embodiment. FIG. 8 is an explanatory diagram showing an example of an estimation procedure of a facility or equipment according to an embodiment. FIG. 9 is an explanatory diagram showing an example of an estimation procedure of a facility or equipment according to an embodiment. FIG. 10 is a hardware configuration diagram showing an example of a computer that realizes the function of the information providing device according to the embodiment.

Hereinafter, the information providing device, the information providing method, and the embodiment for implementing the information providing program (hereinafter referred to as “the embodiment”) according to the present application will be described in detail with reference to the drawings.

It should be noted that this embodiment does not limit the information providing device, the information providing method, and the information providing program according to the present application. Further, in the following embodiments, the same parts are designated by the same reference numerals, and duplicate description is omitted.

[1. Outline of information provision method]
First, with reference to FIG. 1, an outline of an information providing method performed by the information providing apparatus according to the embodiment will be described. FIG. 1 is an explanatory diagram showing an outline of an information providing method according to an embodiment. In the following, a case where the information providing device according to the embodiment is, for example, a mobile terminal such as a smartphone having a navigation function for providing route guidance to a user moving on foot will be described as an example. The information providing device according to the embodiment may be a car navigation device mounted on a vehicle to provide route guidance.

The information providing device according to the embodiment is an area where GPS (Global Positioning System) cannot be used, such as in a building or an underground mall, and in an area where there is no map data, the place where the moved user was originally located. Provide information to return to. The information providing device according to the embodiment can use GPS, and can also provide information for returning the moved user to the place where he / she was originally, even in an area where there is map data.

As shown in FIG. 1A, when the user of the information providing device moves from a certain start point P1 to a certain goal point P2 through the route L1 in a building where GPS is not available and there is no map data. There is. In such a case, the user may not be able to return from the goal point P2 to the original start point P1 unless he / she is familiar with the passage in the building.

Therefore, when the information providing device detects the movement of the self-position, the information providing device marks the passing point of the self-position in the local coordinate system based on the movement start position of the self-position based on the detection result. The local coordinate system here is, for example, a Cartesian coordinate system in which the user's movement start position (start point P1) is the origin, the east-west direction is the X direction, and the north-south direction is the Y direction.

Then, as shown in FIG. 1 (b), the information providing device marks, for example, the mark M1 at the position corresponding to the start point P1 in the local coordinate system, and then marks the passing point through which the self-position sequentially passes. Mark M2 to M14. The numbers in the circles indicating the marks M1 to M14 shown in FIG. 1B indicate the marking order, that is, the order in which the self-position passes through each passing point.

Then, the information providing device provides the user with information indicating the position of the marked passing point. As a result, even if the user is not familiar with the passage in the building, the goal point P2 can be returned by returning to the original route by self-contained navigation, relying on the information indicating the position of the passing point provided by the information providing device. You can return to the starting point P1 from. In this way, the information providing device can return the moved user to the place where he / she was originally.

At this time, the information providing device visualizes the information indicating the position of the passing point of the self-position and provides it to the user. As a result, the user can easily return to the original place only by looking at the visualized information provided by the information providing device.

Further, the information providing device provides the user with information indicating the order in which the self-position has passed the passing point. As a result, the user can easily return to the original place by reversing the order included in the information provided by the information providing device.

Such an information providing device includes a camera and a display for displaying an image captured by the camera, and displays information indicating the position of a passing point of its own position in the captured image and provides the information to the user. That is, the information providing device provides the user with information indicating the position of the passing point marked at the point visible to the user in the real space.

For example, as shown in FIG. 1 (c), when the user U turns to the original direction at the goal point P2 and images the passage with the camera of the information providing device, the information providing device is shown in FIG. 1 (d). Display the image on the display.

Specifically, as shown in FIG. 1D, the information providing device uses an augmented reality (AR) image as information indicating the position of a passing point in the captured image of the scenery visually observed by the user U. The marks M9 to M14 are superimposed and displayed.

At this time, the information providing device displays a number indicating the order in which the self-position has passed in each of the marks M9 to M14. Further, the information providing device uses the perspective method to display the marks M9 to M14 so that the size becomes smaller as the distance from the self-position increases.

As a result, the user U can intuitively recognize the original direction from the sizes of the displayed marks M9 to M14 and the numbers displayed on the marks M9 to M14. Then, the user U reverses the original route L1 (see FIG. 1A) by following the marks M14 having the largest number displayed in the order of the marks M13 to M1 having the smallest numbers. It is possible to return to the starting point P1 through the route L2 shown in (c).

Further, for example, as shown in FIG. 1 (e), when the user U turns to the left with respect to the original direction at the goal point P2 and the camera of the information providing device captures an image of the passage. The information providing device displays the image shown in FIG. 1 (f) on the display.

At this time, in the image shown in FIG. 1 (f), the passage extending in front of the user U is not a passage through which the user U has passed, so that there is no mark indicating a passing point. However, in the image shown in FIG. 1 (f), the passage extending in front of the user U and the passage intersecting at the T-junction are the passages through which the user U has passed, and therefore have the marks M1 to M3.

Moreover, the marks M1 to M3 displayed in the image shown in FIG. 1 (f) have a clearly smaller number in the circle than the nearest mark M14 on the original route. Therefore, the user U can recognize in the image shown in FIG. 1 (f) that the passage extending in front of the user U is a shortcut to return to the start point P1.

As a result, the user U advances through the passage extending in front of the user U in the image shown in FIG. 1 (f), and thereby passes through the shortest route L3 to the start point P1 shown in FIG. 1 (e) to the start point P1. You can go back to.

As described above, according to the information providing method according to the embodiment, information for returning the moved user to the original place is provided in the area where GPS cannot be used and there is no map data. be able to.

[2. Configuration of information providing device]
Next, with reference to FIG. 2, the configuration of the information providing device according to the embodiment will be described. FIG. 2 is a block diagram showing an example of the configuration of the information providing device 1 according to the embodiment. As shown in FIG. 2, the information providing device 1 includes a sensor unit 2, an imaging unit 3, an operation display unit 4, a storage unit 5, and a control unit 6.

(Sensor part)
The sensor unit 2 includes a plurality of sensors. For example, the sensor unit 2 includes a step count sensor, a geomagnetic sensor, an acceleration sensor, and the like. The pedometer sensor counts the number of steps when the user carrying the information providing device 1 moves on foot.

The geomagnetic sensor acquires the direction in which the information providing device 1 is facing by detecting the geomagnetism. Further, the acceleration sensor detects the moving acceleration in the up / down / front / back / left / right directions when the information providing device 1 moves. Each of the plurality of sensors included in the sensor unit 2 outputs the detection result to the control unit 6.

(Image pickup unit)
The image pickup unit 3 is, for example, a camera provided with a solid-state image pickup element or the like. The image pickup unit 3 outputs the data of the captured image to the control unit 6.

(Operation display)
The operation display unit 4 is, for example, a touch panel display. The operation display unit 4 accepts, for example, an operation for activating an information providing program by a user, an image imaging operation using the imaging unit 3, and the like. Further, the operation display unit 4 displays an image image captured by the image pickup unit 3 and image information such as a mark indicating a passing point of the self-position described above.

The sensor unit 2 and the image pickup unit 3 are installed at predetermined positions of the vehicle when the information providing device 1 is a car navigation device. That is, when the information providing device 1 is a car navigation device, the sensor unit 2 and the imaging unit 3 are provided outside the information providing device 1.

(Memory)
The storage unit 5 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk. The storage unit 5 stores the passing point information 51. The passing point information 51 will be described later with reference to FIG.

(Control unit)
The control unit 6 includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input / output port, and various circuits.

The control unit 6 has a detection unit 61 and a marking unit that function by the CPU executing various programs stored in the ROM (corresponding to an example of the information providing program according to the embodiment) using the RAM as a work area. 62 and a providing unit 63 are provided.

The detection unit 61, the marking unit 62, and the provision unit 63 may be partially or wholly composed of hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

(Detector)
The detection unit 61 detects the movement of the self-position of the information providing device 1 based on the detection results input from the plurality of sensors included in the sensor unit 2. For example, the detection unit 61 detects that the self-position has moved when the count value of the number of steps by the step number sensor increases. Further, the detection unit 61 detects that the self-position has moved when the generation of acceleration is detected by the acceleration sensor.

(Marking part)
Based on the detection result by the detection unit 61, the marking unit 62 marks the passing point of the self-position in the local coordinate system based on the movement start position of the self-position. For example, the marking unit 62 starts marking when the detection unit 61 detects that the movement of its own position has started.

The timing at which the marking unit 62 starts marking is not limited to the case where the start of movement of the self-position is detected. For example, the detection unit 61 may start marking at any timing as long as the timing is based on the detection result by the detection unit 61, such as starting marking when the self-position moves by a predetermined distance or more.

When the movement of the self-position is detected, the marking unit 62 sets the self-position at that time as the origin of the local coordinate system. After that, the marking unit 62 acquires the position of the passing point of its own position by PDR (Pedestrian Dead Reckoning).

Specifically, the marking unit 62 acquires the moving direction (direction) of the self-position from the geomagnetic sensor at a predetermined cycle (for example, at intervals of 2 seconds), and further, the self-position is based on the count value of the step count sensor. Get the distance traveled.

Then, the marking unit 62 sequentially calculates and acquires the coordinates of the passing point of the self-position in the local coordinate system based on the movement direction of the self-position and the movement distance of the self-position calculated from the number of steps, and the storage unit 5 Is stored as passing point information 51.

Here, an example of the passage point information 51 according to the embodiment will be described with reference to FIG. FIG. 3 is an explanatory diagram showing an example of the passage point information 51 according to the embodiment. As shown in FIG. 3, the passing point information 51 is information in which the ID of each passing point through which the self-position has passed, the acquisition date and time, and the position information are associated with each other.

The ID is identification information of a passing point assigned to each passing point by the marking unit 62 in order to identify each passing point. As shown in FIG. 3, the marking unit 62 assigns an ID in which the number indicating the order increases, such as M1, M2, ... In the order in which the self-position passes, to each passing point.

The acquisition date and time is the date and time when the coordinates of the passing point in the local coordinate system are acquired by the marking unit 62. The acquisition date / time # 1 and the acquisition date / time # 2 shown in FIG. 3 include the date and time when the coordinates of the passing points to which the IDs of M1 and M2 are assigned are acquired, respectively.

The position information is information indicating the position of each passing point in the local coordinate system. The position information # 1 and the position information # 2 shown in FIG. 3 include coordinate values in the local coordinate system of the passing points to which the IDs of M1 and M2 are assigned, respectively.

Each time the marking unit 62 acquires the coordinates of the passing point of its own position, an ID is assigned to each passing point, and the acquisition date and time of the coordinates and the position information are stored in the storage unit 5 while being added to the passing point information 51. The process by the marking unit 62 corresponds to the process of marking the marks M1 to M14 at the passing points shown in FIG. 1 (b).

(Providing department)
Returning to FIG. 2, the providing unit 63 will be described. The providing unit 63 provides the user with information indicating the position of the passing point marked by the marking unit 62. For example, the providing unit 63 provides the user with information indicating the position of the passing point when the detection unit 61 detects the end of the movement of the self-position.

At this time, the providing unit 63 superimposes an augmented reality image such as a mark indicating the position of the passing point (for example, marks M14 to M9 shown in FIG. 1B) on the captured image of the scenery visually viewed by the user. The displayed image is displayed by the operation display unit 4 and provided to the user.

Specifically, when the movement of the self-position is completed and the user captures the surrounding scenery by the imaging unit 3, the providing unit 63 recognizes the captured image to obtain the user's view in the captured image. Identify obstacles such as obstructing walls.

Then, the providing unit 63 excludes the marks invisible to the user due to the identified obstacle from the marks of all the passing points marked by the marking unit 62, and selectively captures only the marks visible to the user. It is superimposed and displayed on. As a result, the providing unit 63 can display, for example, an image as shown in FIGS. 1D and 1F on the operation display unit 4.

In this way, the providing unit 63 provides the user with information indicating the position of the passing point of the self-position marked by the marking unit 62, even in a place where GPS is not available and there is no map data. You can return the moved user to where he was.

Here, the case where the information providing device 1 does not have the function of using GPS and the map data has been described as an example, but the information providing device 1 may have the function of using GPS and the map data. good.

In the case of such a configuration, when GPS or map data can be used, the information providing device 1 causes the providing unit 63 to perform general route guidance (navigation) using GPS and map data. The information providing device 1 can also make the marking unit 62 mark the passing point described above even when the route guidance using GPS and map data is performed.

After that, the information providing device 1 passes through as described above by the providing unit 63, for example, when the radio wave from the GPS satellite cannot be received or when the self-position data does not exist in the map data. Have them provide information indicating the location of the point.

As a result, the information providing device 1 appropriately guides the user to the place where he / she was originally when the radio wave from the GPS satellite cannot be received during the route guidance or when the user enters a place not included in the map data. Can be returned.

In the information providing method described with reference to FIG. 1, the case where the user changes the imaging direction by the imaging unit 3 and selects the shortest route as the return route has been described as an example, but the providing unit 63 has described. Depending on the user's travel route, it is possible to provide the shortest return information from the beginning.

Next, with reference to FIG. 4, an example of a procedure in which the providing unit 63 generates the shortest return route information will be described. FIG. 4 is an explanatory diagram showing a procedure for generating the shortest return information according to the embodiment. As shown in FIG. 4A, the user may move from a certain start point P3 to a certain goal point P4 via a route L1, a route L5, a route L6, and a route L7.

In such a case, as shown in FIG. 4B, the marking unit 62 marks the passing points by the marks M1 to M26 in the order of the passing points where the self-position has moved, as in the case described above.

Then, when the moving path at the self-position connecting the passing points has an annular portion (loop), the providing unit 63 provides the shortest return route with information indicating the position of the passing point included in the route excluding the annular portion from the moving route. Provide to the user as information.

In the example shown in FIG. 4B, among the movement routes connecting all the passing points from the marks M1 to M26, the route from the mark M3 to the mark M24 via the mark M7, the mark M14, and the mark M18 is It's a loop.

In such a case, as shown in FIG. 4C, the providing unit 63 excludes the marks M3 to M24 included in the looped movement path, and leaves the marks M1, the mark M2, the mark M25, and the mark M26. ..

Then, the providing unit 63 superimposes and displays the augmented reality images of the remaining marks M1, mark M2, mark M25, and mark M26 on the captured image. As a result, as shown in FIG. 4D, the providing unit 63 can provide the user with information on the shortest route L8 from the goal point P4 to the start point P3.

It should be noted that the information providing device 1 further provides a configuration for acquiring information indicating a passing point through which another information providing device marked by the other information providing device has passed, thereby providing the user with more useful information. Can be done. An information providing device having such a configuration will be described later with reference to FIGS. 6 to 9.

[3. Information provider processing]
Next, with reference to FIG. 5, an example of the processing executed by the control unit 6 of the information providing device 1 according to the embodiment will be described. FIG. 5 is a flowchart showing an example of a process executed by the control unit 6 of the information providing device 1 according to the embodiment.

The control unit 6 executes the process shown in FIG. 5 when the information providing program according to the embodiment is started. Specifically, as shown in FIG. 5, when the information providing program is activated, the control unit 6 first determines whether or not it has detected the start of movement of its own position (step S101).

Then, when the control unit 6 determines that the start of movement is not detected (steps S101, No), the control unit 6 repeats the determination process of step S101 until the start of movement is detected. Further, when the control unit 6 determines that the start of movement is detected (step S101, Yes), the control unit 6 marks the passing point of the self-position (step S102).

Subsequently, the control unit 6 stores the position information in the local coordinate system of the marked passing point and the acquisition date and time of the position information (step S103). After that, the control unit 6 determines whether or not the end of movement of the self-position has been detected (step S104). Then, when the control unit 6 determines that the end of movement is not detected (step S104, No), the control unit 6 shifts the process to step S102.

Further, when the control unit 6 determines that the end of movement is detected (step S104, Yes), the augmented reality image of the passing point is superimposed and displayed on the image captured in the real space captured by the image pickup unit 3 (step S105). ), End the process. After that, the control unit 6 starts the process again from step S101.

[4. Modification example]
Although some of the embodiments of the present application have been described in detail with reference to the drawings, these are examples, and various modifications are made based on the knowledge of those skilled in the art, including the embodiments described in the disclosure column of the invention. It is possible to carry out the present invention in other modified forms.

For example, when the information providing device 1 uses a technology such as PDR, it cannot determine the self-position of the global coordinate system. Therefore, for example, the detection accuracy by the sensor, the physique of the user, and the walking method of the user are different. There may be an error in the acquired self-position due to the above.

Therefore, the information providing device 1 obtains information indicating a passing point (hereinafter, referred to as "other device passing point") through which the other information providing device marked by the other information providing device has passed. The self-position can be corrected based on the position of the device passing point.

FIG. 6 is a block diagram showing an example of the configuration of the information providing device 1a according to the modified example of the embodiment. As shown in FIG. 6, the information providing device 1a includes a communication unit 7 in addition to the configuration provided in the information providing device 1 shown in FIG. Further, in the information providing device 1a, the control unit 6a includes a GPS unit 64, an acquisition unit 65, and an estimation unit 66.

Further, the information providing device 1a is partially different from the information providing device 1 shown in FIG. 2 in that the operations of the marking unit 62a and the providing unit 63a and the contents of the passing point information 51a are different from those of the information providing device 1. The detection unit 61 is the same as that shown in FIG.

The information providing device 1a can communicate with the server device 100 and a plurality of other information providing devices 10-1 to 10-n (n is a natural number of 2 or more) via, for example, a communication network N such as the Internet. Be connected. In the following, when referring to any other information providing device, it will be referred to as another information providing device 10.

The other information providing device 10 has the same configuration as the information providing device 1a. Further, the server device 100 is a device that collects and stores information indicating the position of a passing point of another device from a plurality of other information providing devices 10-1 to 10-n.

The communication unit 7 of the information providing device 1a is realized by, for example, a NIC (Network Interface Card) or the like. The communication unit 7 is wirelessly connected to the plurality of other information providing devices 10-1 to 10-n and the server device 100 via the communication network N so as to be able to communicate with each other. The GPS unit 64 determines its own position in the global coordinate system based on the radio waves received from the GPS satellites.

The acquisition unit 65 acquires information indicating the position of a passing point of another device via the communication network N and the communication unit 7. Then, the marking unit 62a corrects its own position based on the information indicating the position of the passing point of the other device acquired by the acquisition unit 65.

At this time, the acquisition unit 65 can directly acquire information indicating the position of the passing point of the other device from the other information providing device 10. Further, the acquisition unit 65 can also acquire information indicating the passing points of the other information providing devices 10-1 to 10-n from the server device 100 at a time.

When the acquisition unit 65 directly acquires the information indicating the position of the passing point of the other device from the other information providing device 10, the acquisition unit 65 acquires the information indicating the position of the passing point of the other device from the other information providing device 10 passing by its own position. do.

The information providing device 1a receives, for example, a signal such as a beacon transmitted from another information providing device 10, and when the receiving strength gradually increases and then the receiving strength gradually decreases, the other information providing device 10 It can be determined that they have passed each other. At this time, the acquisition unit 65 acquires information indicating the position of the passing point of the other device from the other information providing device 10 that has passed each other.

The information providing device 1a is based on the correlation of the position information between the passing point marked by the own device at the time of passing the other information providing device 10 and the passing point of the other device marked by the other information providing device 10. Converts the position of the device passage point to the position in the local coordinate system.

As a result, the information providing device 1a can acquire the positions of all the passing points of other devices acquired from the other information providing devices 10 that have passed each other in the local coordinate system.

Further, when the acquisition unit 65 acquires information indicating the position of the passing point of the other device from the server device 100, the other information providing device 10 having the same position in the global coordinate system as the own device immediately before the GPS becomes unavailable. Information indicating the position of the passing point of another device is acquired from.

In such a case, since the reference (origin) of the local coordinate system of the own device and the reference (origin) of the local coordinate system of the other information providing device 10 are substantially the same position, the information providing device 1a is a passing point of the other device. The position of can be used as it is as the position of the local coordinate system of the own device.

Then, the marking unit 62a corrects its own position based on the position of the passing point of the other device acquired by the acquisition unit 65. FIG. 7 is an explanatory diagram showing an example of the self-position correction procedure according to the embodiment.

As shown in FIG. 7A, when the information providing device 1a arrives at a certain point P5 through a certain path L10, the information providing device 1a acquires information indicating the position of another device passing point. At this time, many other information providing devices 10 pass through, for example, the path L11 indicated by the thick arrow in FIG. 7A, and enter a certain area 101a as shown by a plurality of black dots in the figure. There may be.

In such a case, the area 101a may be a facility used by many users (for example, a toilet 101). Since the information providing device 1a also arrives in the vicinity of the area 101a that may be the toilet 101, the self-position of the information providing device 1a may actually be in the area 101a instead of the point P5. Is high.

Therefore, the marking unit 62a corrects the position of the marked point P5 based on the position of the place marked by the plurality of other information providing devices 10 exceeding a predetermined threshold value. For example, as shown in FIG. 7B, the marking portion 62a corrects the position of the point P5 to the center point P6 of the area 101a.

In addition, when there is a high possibility that the area 101a is a toilet, the marking unit 62 turns back the own device to a point where most of the other information providing devices 10 turn back from the area 101a (a point where there is a possibility of an exit of the toilet). You may make a correction to match the points.

As a result, when an error occurs in the position of the point P5, the marking unit 62a can improve the accuracy of the self-position by correcting the error. At this time, the marking unit 62a can correct the path L10 that has passed up to that point to the path L11 that many other information providing devices 10 have passed.

Further, the marking unit 62a can also correct the position of the marked passing point based on the position of the facility or equipment used by the user of the other information providing device 10 estimated by the estimation unit 66 described later.

As a result, the marking unit 62a further improves the accuracy of the self-position by correcting the self-position based on the location of a specific facility or equipment such as a toilet 101, stairs, or a store having a characteristic internal shape. Can be made to.

Further, the marking unit 62a corrects the position of the marked passing point based on the information indicating the position of the other device acquisition point acquired by the acquisition unit 65. For example, when the marking unit 62a makes a correction based on the information indicating the position of the passing point of the other device acquired from the other information providing device 10 passing by, the position of the marked passing point and the position of the corresponding passing point of the other device are used. Correct the position of the passing point so that it becomes the middle point of. As a result, the marking unit 62a can reduce the error when there is an error in the position of the marked passing point.

Further, when the marking unit 62a makes a correction based on the information indicating the position of the passing point of the other device passed by the other information providing devices 10-1 to 10-n acquired from the server device 100, more other information is obtained. The correction is performed so that the passing point is adjusted to the passing point of the other device that the providing device 10 has passed. As a result, the marking unit 62a can further reduce the error in the position of the marked passing point.

Further, when the marking unit 62a receives a signal from a transmitting device that transmits a signal (for example, a beacon) while moving to a known point at a known time, the marking unit 62a knows the position of the marked passing point in the past. The correction is made based on the position of the passing point of the other device of the other information providing device 10 that has passed the point of.

The transmitting device is, for example, a terminal device carried by a predetermined staff member such as a robot that automatically travels in the facility by self-contained navigation or a store employee or a facility guard. As a result, the marking unit 62a can improve the accuracy of the position of the passing point as the number of other information providing devices 10 that have passed the same known position as the own device in the past increases.

The estimation unit 66 estimates the facility or equipment used by the user of the other information providing device 10 based on the information indicating the position of the passing point of the other device acquired by the acquisition unit 65. 8 and 9 are explanatory views showing an example of the estimation procedure of the facility or equipment according to the embodiment.

As shown in FIG. 8, some other information providing devices 10 pass through the route L13, enter the busy passage L12, then enter the side road, then turn back and pass through the route L14, and again in the traffic. After entering the many passages L9, the passage may be separated from the passage L12.

In such a case, the estimation unit 66 estimates that the toilet 101 is at a point where the other information providing device 10 has turned back. Then, the providing unit 63a provides the user with information indicating the location of the toilet 101 based on the estimation result of the estimation unit 66.

Further, as shown in FIG. 9, many other information providing devices 10 may pass through the path L15, follow the spiral path, and then depart from the spiral path. In such a case, the estimation unit 66 estimates that the place where the other information providing device 10 has moved the spiral path is the staircase 102. Then, the providing unit 63a provides the user with information indicating the location of the stairs 102 based on the estimation result of the estimation unit 66.

As described above, according to the information providing device 1a, even if there is no data of the sketch of the facility and the equipment in the building, the type of the facility or the equipment in the building can be estimated by estimating from the movement route of the other information providing device 10. And information indicating the location can be provided to the user.

Further, the providing unit 63a provides the user with information indicating the position of the passing point of another device acquired by the acquiring unit 65, in addition to the information indicating the position of the passing point marked by the marking unit 62.

At this time, the providing unit 63a displays, for example, an augmented reality image having a different color or shape between the passing point of the own device marked by the marking unit 62 and the passing point of the other device. Thereby, the information providing device 1a can provide the information of the passage that the user has never passed to the user who is not familiar with the passage in the building.

Further, the providing unit 63a starts moving from the moving start position of the self-position based on the movement path of the self-position connecting the passing points of the self-position marked by the marking unit 62a and the information acquired by the acquisition unit 65. The shortest route to the position is specified and provided to the user. As a result, the providing unit 63a can provide the user with a return route that allows the user to return to the place where he / she was originally at the shortest travel distance.

[5. effect〕
As described above, the information providing device 1 according to the embodiment includes a detecting unit 61, a marking unit 62, and a providing unit 63. The detection unit 61 detects the movement of its own position. The marking unit 62 marks the passing point of the self-position in the local coordinate system based on the movement start position of the self-position based on the detection result by the detection unit 61. The providing unit 63 provides the user with information indicating the position of the passing point marked by the marking unit 62. As a result, the information providing device 1 can return the moved user to the original place when GPS is not available and there is no map information.

Further, the providing unit 63 visualizes the information indicating the position of the passing point and provides it to the user. As a result, the user can easily return to the original place only by looking at the visualized information provided by the information providing device 1.

Further, the providing unit 63 provides the user with information indicating the order in which the self-position has passed the passing point. As a result, the user can easily return to the original place by reversing the order included in the information provided by the information providing device 1.

Further, the providing unit 63 provides the user with information indicating the position of the passing point marked at the point visible to the user in the real space. As a result, the information providing device 1 can intuitively make the user recognize the route to return to the place where he / she was originally.

The providing unit 63 superimposes and displays an augmented reality image as information indicating the position of a passing point on the captured image of the scenery visually viewed by the user. As a result, the information providing device 1 can intuitively make the user recognize the route to return to the place where he / she was originally.

Further, the marking unit 62 marks a passing point when GPS is not available. As a result, when the information providing device 1 has a function of using GPS, even if GPS becomes unavailable, the moved user can be returned to the original place.

Further, the marking unit 62 marks the passing point when there is no map information about the periphery of the self-position. As a result, when the information providing device 1 has the map data, even if the user enters a place not included in the map data, the moved user can be returned to the original place.

Further, when the moving route at the self-position connecting the passing points has an annular portion, the providing unit 63 provides the user with information indicating the position of the passing point included in the route excluding the annular portion from the moving route. As a result, the information providing device 1 can provide the user with information on the shortest route that returns the user to the place where he / she was originally when there is an annular portion in the moving route.

Further, the information providing device 1a further includes an acquisition unit 65 for acquiring information indicating the position of the passing point marked by the other information providing device 10. Then, the providing unit 63a provides the user with information indicating the position of the passing point of the other device acquired by the acquiring unit 65. As a result, the information providing device 1a can provide the user with information on the passage that the user has never passed.

Further, the acquisition unit 65 acquires information indicating the position of the passing point marked by the other information providing device 10 from the other information providing device 10. As a result, the information providing device 1a can provide information on the passage that the user has never passed.

Further, the acquisition unit 65 acquires information indicating the position of the passing point marked by the other information providing device 10 from the other information providing device 10 passing by the self-position. As a result, the information providing device 1a can convert the position of the passing point marked by the other information providing device 10 to be acquired into the position in the local coordinate system and use it.

Further, the acquisition unit 65 is marked by another information providing device 10 from the server device 100 that collects and stores information indicating the position of the passing point marked by the plurality of other information providing devices 10-1 to 10-n. Acquire information indicating the position of the passing point. As a result, the information providing device 1a can acquire information indicating the positions of more passing points.

Further, the acquisition unit 65 acquires information indicating the position of the passing point marked by another information providing device 10 whose position in the global coordinate system immediately before the GPS becomes unavailable is the same as that of the own device. As a result, the information providing device 1a uses the position of the passing point marked by the other information providing device 10 acquired from the server device 100 as the position of the local coordinate system without converting it to the position of the local coordinate system. Can be done.

Further, the marking unit 62a corrects the position of the marked passing point based on the information acquired by the acquisition unit 65. As a result, the information providing device 1 can improve the accuracy of the position of the marked passing point.

The marking unit 62a corrects the position of the marked passing point based on the position of the place marked by the plurality of other information providing devices 10 exceeding a predetermined threshold value. As a result, the information providing device 1a can improve the accuracy of the self-position.

Further, the information providing device 1a further includes an estimation unit 66 that estimates the facility or equipment used by the user of the other information providing device 10 based on the information acquired by the acquisition unit 65, and the marking unit 62a marks the facility or equipment. The position of the transit point is corrected based on the position of the place where the facility or equipment is estimated by the estimation unit 66. As a result, the information providing device 1a can further improve the accuracy of the self-position.

In addition, the providing unit 63a provides the user with information about the facility or equipment estimated by the estimation unit 66. As a result, the information providing device 1a can be estimated from the movement route of the other information providing device 10 even if there is no data of the sketch of the facility and the equipment in the building, for example, and the type of the facility or the equipment in the building and the information providing device 1a. Information indicating the location can be provided to the user.

Further, the providing unit 63a starts moving from the moving start position of the self-position based on the movement path of the self-position connecting the passing points of the self-position marked by the marking unit 62a and the information acquired by the acquisition unit 65. The shortest route to the position is specified and provided to the user. As a result, the information providing device 1a can provide the user with a return route that allows him / her to return to the place where he / she was originally at the shortest travel distance.

Further, when the marking unit 62a receives a signal from a transmitting device that transmits a signal while moving to a known point at a known time, the marking unit 62a passes the marked passing point position to a known point in the past. The correction is made based on the position of the passing point marked by the information providing device 10. As a result, the information providing device 1a can improve the accuracy of the position of the passing point as the number of other information providing devices 10 that have passed the same known position as the own device in the past increases.

Further, the transmitting device is a robot that automatically travels by self-contained navigation or a terminal device carried by a predetermined staff member. As a result, the information providing device 1a can improve the accuracy of the position of the passing point when the robot or the terminal device functioning as the transmitting device moves in the facility where the robot or the terminal device is traveling.

[6. Hardware configuration]
Further, the information providing device 1 according to the above-described embodiment is realized by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 10 is a hardware configuration diagram showing an example of a computer that realizes the function of the information providing device 1 according to the embodiment. The computer 1000 has a CPU 1100, a RAM 1200, a ROM 1300, an HDD 1400, a communication interface (I / F) 1500, an input / output interface (I / F) 1600, and a media interface (I / F) 1700.

The CPU 1100 operates based on a program stored in the ROM 1300 or the HDD 1400, and controls each part. The ROM 1300 stores a boot program executed by the CPU 1100 when the computer 1000 is started, a program depending on the hardware of the computer 1000, and the like.

The HDD 1400 stores a program executed by the CPU 1100, data used by such a program, and the like. The communication interface 1500 receives data from another device via a communication network N such as the Internet and sends the data to the CPU 1100, and transmits the data generated by the CPU 1100 to the other device via the communication network N.

The CPU 1100 controls an output device such as a display and a printer, and an input device such as a keyboard and a mouse via the input / output interface 1600. The CPU 1100 acquires data from the input device via the input / output interface 1600. Further, the CPU 1100 outputs the generated data to the output device via the input / output interface 1600.

The media interface 1700 reads a program or data stored in the recording medium 1800 and provides the program or data to the CPU 1100 via the RAM 1200. The CPU 1100 loads the program from the recording medium 1800 onto the RAM 1200 via the media interface 1700, and executes the loaded program. The recording medium 1800 is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. And so on.

For example, when the computer 1000 functions as the information providing device 1 according to the embodiment, the CPU 1100 of the computer 1000 realizes the function of the control unit 6 by executing the information providing program loaded on the RAM 1200. The CPU 1100 of the computer 1000 reads these programs from the recording medium 1800 and executes them, but as another example, these programs may be acquired from another device via the communication network N.

[7. others〕
Further, among the processes described in the above-described embodiments and modifications, all or part of the processes described as being automatically performed can be manually performed, or are described as being manually performed. It is also possible to automatically perform all or part of the processed processing by a known method.

In addition, information including processing procedures, specific names, various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the information shown in the figure.

Further, each component of each of the illustrated devices is a functional concept, and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of them may be functionally or physically distributed / physically distributed in any unit according to various loads and usage conditions. Can be integrated and configured.

For example, the marking unit 62 may be connected via a network as an external device of the information providing device 1. Further, the function of the above-mentioned information providing device 1 may be realized by having another device having the marking unit 62 and connecting them to a network to cooperate with each other.

That is, the information providing device 1 may be realized by a plurality of server computers, and depending on the function, it may be realized by calling an external platform or the like by API (Application Programming Interface) or network computing, and the configuration is flexible. Can be changed to.

Further, the above-described embodiments and modifications can be appropriately combined as long as the processing contents do not contradict each other. Further, the above-mentioned "section, module, unit" can be read as "means" or "circuit". For example, the marking unit 62 can be read as a marking means or a marking circuit.

1,1a Information providing device 2 Sensor part 3 Imaging part 4 Operation display part 5 Storage part 51 Passing point information 6,6a Control part 61 Detection part 62 Marking part 63, 63a Providing part 64 GPS part 65 Acquisition part 66 Estimating part 10, 10-1 to 10-n Other information providing devices 100 Server devices

Claims (20)

A detector that detects the movement of its own position,
Based on the detection result by the detection unit, the number increases in the order of the passing point of the self-position and the passing point of the self-position in the local coordinate system based on the movement start position of the self-position. The marking part that marks the number and
A providing unit that provides the user with information including the position of the passing point marked by the marking unit and the number indicating the order in which the self-position has passed through the passing point .
With an acquisition unit that acquires information indicating the position of a passing point of the other information providing device marked by the other information providing device.
Equipped with
In addition to the information indicating the position of the passing point of the self-position marked by the marking unit, the providing unit provides the user with information indicating the position of the passing point of the other information providing device acquired by the acquiring unit. offer
An information providing device characterized by the fact that. A detector that detects the movement of its own position,
Based on the detection result by the detection unit, a marking unit that marks the passing point of the self-position in the local coordinate system based on the movement start position of the self-position, and a marking unit.
A providing unit that provides the user with information indicating the position of the passing point marked by the marking unit .
With an acquisition unit that acquires information indicating the position of a passing point of the other information providing device marked by the other information providing device.
Equipped with
The providing part
When it is determined that there is an annular portion in the movement path of the self-position connecting the passing points based on the information indicating the position of the passing point, the information indicating the position of the passing point included in the annular portion is used. Information indicating the position of the remaining passing point excluding the passing point included in the annular portion from the passing point included in the moving route is provided to the user without notifying the user, and the marking unit provides information. In addition to the information indicating the position of the passing point of the self-position marked, the user is provided with the information indicating the position of the passing point of the other information providing device acquired by the acquisition unit.
An information providing device characterized by the fact that. The providing part
The information providing device according to claim 1 or 2, wherein the information indicating the position of the passing point is visualized and provided to the user. The providing part
The information providing device according to any one of claims 1 to 3 , wherein an augmented reality image is superimposed and displayed as information indicating the position of the passing point on the captured image of the scenery visually viewed by the user. The marking part is
The information providing device according to any one of claims 1 to 4 , wherein when GPS (Global Positioning System) is unavailable, the passing point is marked. The marking part is
The information providing device according to any one of claims 1 to 5 , wherein when there is no map information about the periphery of the self-position, the passing point is marked. The acquisition unit
The information providing device according to any one of claims 1 to 6 , wherein information indicating the position of the passing point marked by the other information providing device is acquired from the other information providing device. The acquisition unit
The information providing device according to claim 7 , wherein information indicating the position of the passing point marked by the other information providing device is acquired from the other information providing device that passes the self-position. The acquisition unit
The information indicating the position of the passing point marked by the other information providing device is acquired from the server device that collects and stores the information indicating the position of the passing point marked by the plurality of other information providing devices. The information providing device according to any one of claims 1 to 8 , wherein the information providing device is characterized by the above. The acquisition unit
It is characterized by acquiring information indicating the position of the passing point marked by the other information providing device having the same position as the own device in the global coordinate system immediately before the GPS (Global Positioning System) becomes unavailable. The information providing device according to claim 9 . The marking part is
The information providing device according to any one of claims 1 to 10 , wherein the position of the marked passing point is corrected based on the information acquired by the acquisition unit. The marking part is
The information providing device according to claim 11 , wherein the position of the marked passing point is corrected based on the position of the place marked by the plurality of other information providing devices exceeding a predetermined threshold value. Further provided with an estimation unit that estimates the facility or equipment used by the user of the other information providing device based on the information acquired by the acquisition unit.
The marking part is
The information providing device according to claim 11 or 12 , wherein the position of the marked passing point is corrected based on the position of the place where the facility or equipment is estimated by the estimation unit. The providing part
The information providing device according to claim 13 , wherein information about a facility or equipment estimated by the estimation unit is provided to the user. The providing part
The shortest distance from the movement start position to the movement end position of the self-position based on the movement path of the self-position connecting the passing points of the self-position marked by the marking unit and the information acquired by the acquisition unit. The information providing device according to any one of claims 1 to 14 , wherein a route is specified and provided to the user. The marking part is
Providing the other information that has passed the known point in the past to the position of the marked passing point when the signal is received from the transmitting device that transmits the signal while moving to the known point at a known time. The information providing device according to any one of claims 1 to 15 , characterized in that correction is made based on the position of a passing point marked by the device. The transmitter is
The information providing device according to claim 16 , wherein the robot is a robot that automatically travels by self-contained navigation or a terminal device that is carried by a predetermined staff member. It is a method of providing information executed by a computer.
A detection process that detects the movement of the self-position and
Based on the detection result by the detection step, the number increases in the order of the passing point of the self-position and the passing point of the self-position in the local coordinate system based on the movement start position of the self-position. The marking process for marking numbers and
A providing step of providing the user with information including the position of the passing point marked by the marking step and the number indicating the order in which the self-position passed through the passing point .
With the acquisition process of acquiring information indicating the position of the passing point of the other information providing device marked by the other information providing device.
Including
In the providing step, in addition to the information indicating the position of the passing point of the self-position marked by the marking step, the information indicating the position of the passing point of the other information providing device acquired by the acquisition step is provided to the user. offer
Information provision method characterized by that. The detection procedure to detect the movement of the self position and
Based on the detection result by the detection procedure, the number increases in the order of the passing point of the self-position and the passing point of the self-position in the local coordinate system based on the movement start position of the self-position. Marking procedure for marking numbers and
A providing procedure for providing the user with information including the position of the passing point marked by the marking procedure and the number indicating the order in which the self-position passed through the passing point .
The acquisition procedure for acquiring information indicating the position of the passing point of the other information providing device marked by the other information providing device.
Let the computer run
In the provision procedure, in addition to the information indicating the position of the passing point of the self-position marked by the marking procedure, the information indicating the position of the passing point of the other information providing device acquired by the acquisition procedure is provided to the user. offer
An information provision program characterized by this. It is a method of providing information executed by a computer.
A detection process that detects the movement of the self-position and
Based on the detection result by the detection step, a marking step of marking the passing point of the self-position in the local coordinate system based on the movement start position of the self-position, and
A providing step of providing the user with information indicating the position of the passing point marked by the marking step, and a providing step .
With the acquisition process of acquiring information indicating the position of the passing point of the other information providing device marked by the other information providing device.
Including
The providing process is
When it is determined that there is an annular portion in the movement path of the self-position connecting the passing points based on the information indicating the position of the passing point, the information indicating the position of the passing point included in the annular portion is used. Information indicating the position of the remaining passing point excluding the passing point included in the annular portion from the passing point included in the moving route is provided to the user without notifying the user, and the marking step is performed. In addition to the information indicating the position of the passing point of the self-position marked, the user is provided with the information indicating the position of the passing point of the other information providing device acquired by the acquisition step.
Information provision method characterized by that.

Images