JP7447697B2 - Drive recorder operation system - Google Patents

Description

The present invention relates to a drive recorder operation system.

A drive recorder installed in a vehicle continuously photographs the area around the vehicle, such as in front of the vehicle, and stores the photographed images in a storage medium. For example, a drive recorder is known that has a function of transmitting data sensed by a sensor such as an acceleration sensor together with an image as data representing driving conditions (for example, Patent Document 1).

Japanese Patent Application Publication No. 2018-055352

Some stand-alone drive recorders that do not have a communication function synchronize captured images with events such as impacts detected by an acceleration sensor or the like and store the synchronized images in an external storage medium such as an SD card. Thereby, it is possible to specify and extract the video data of the date and time when the vehicle received an impact due to an accident or the like, for example. However, if a sensor such as an acceleration sensor is not installed, it is not possible to link the video data of the captured video with event information such as the date and time of the impact. Therefore, it is necessary to have a means for identifying and cutting out the video data on the date and time when the shock occurred.

An object of the present disclosure is to provide a drive recorder operation system that can link images shot with a drive recorder and events that occur in a vehicle.

A drive recorder operation system according to an aspect of the present disclosure includes a sensor unit that sends out index information including information on events that occur in a vehicle, a portable storage medium, and a drive recorder operation system that continuously photographs the surroundings of the vehicle over time. a drive recorder that generates a video file and stores it in the storage medium; and a collaboration that links events that occur in the vehicle with the video file stored in the storage medium based on index information sent from the sensor unit. A device.

According to the present disclosure, it is possible to link a video shot by a drive recorder with an event that occurs in a vehicle.

FIG. 1 is a conceptual diagram for explaining a drive recorder operation system according to the present disclosure. FIG. 2 is a block diagram illustrating an example of the configuration of a drive recorder according to the present disclosure. FIG. 3 is a block diagram illustrating an example of the configuration of a sensor unit according to the present disclosure. FIG. 4 is a diagram illustrating an example of index information generated by the index information generation section. FIG. 5 is a block diagram illustrating an example of the configuration of a server and a terminal device according to the present disclosure. FIG. 6 is a sequence diagram illustrating a specific example of event video information generation processing in the drive recorder operation system according to the first embodiment of the present disclosure. FIG. 7 is a flowchart illustrating a specific example of identification information verification processing in the drive recorder operation system according to the first embodiment of the present disclosure. FIG. 8 is a sequence diagram showing a specific example of event video information generation processing in the drive recorder operation system according to the second embodiment of the present disclosure.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Note that the present disclosure is not limited to this embodiment, and if there are multiple embodiments, it also includes a configuration in which each embodiment is combined. Further, in the following embodiments, the same parts are given the same reference numerals and redundant explanations will be omitted.

First, the configuration of the drive recorder operation system according to the present disclosure will be described. FIG. 1 is a conceptual diagram for explaining the configuration of a drive recorder operation system according to the present disclosure.

As shown in FIG. 1, a drive recorder operation system 100 according to the present disclosure includes a drive recorder 1, a storage medium 2, a sensor unit 3, and a cooperation device 200. The cooperation device 200 includes a server 4 and a terminal device 5.

Drive recorder 1 is mounted on vehicle 90. The drive recorder 1 continuously photographs the surroundings of the vehicle 90, such as in front or behind the vehicle 90, and records images. The drive recorder 1 stores captured video data in a storage medium 2.

The storage medium 2 is, for example, a portable storage medium such as an SD card or a USB memory. By making the storage medium 3 removably attachable to the drive recorder 1 and the terminal device 5, data of video captured by the drive recorder 1 can be transferred to the terminal device 5. The storage medium 2 is associated with identification information of the sensor unit 3 in advance. The identification information may be any information as long as the sensor unit 3 can be identified from a drive recorder mounted on another vehicle.

FIG. 2 is a block diagram illustrating an example of the configuration of a drive recorder according to the present disclosure.

The drive recorder 1 includes a video processing section 11, an interface 13, a clock section 14, a control section 16, a storage section 17, and the like. The video processing section 11, interface 13, time measurement section 14, control section 16, storage section 17, etc. are connected to each other via a data bus 1a so that they can send and receive electrical signals.

The imaging unit 11a includes an imaging device such as a CCD, and photographs the area around the vehicle 90, such as in front of the vehicle 90. The imaging unit 11a acquires images continuously in time and sends a video signal to the video processing unit 11.

The video processing unit 11 performs processing such as data compression on the video signal photographed by the imaging unit 11a, and generates a video file by adding date and time information measured in real time by the clock unit 14 at least at the time of photographing. The video file generated by the video processing unit 11 is stored in the storage medium 2 via the interface 13.

The control unit 16 is configured by, for example, a CPU. The control unit 16 executes each process in the drive recorder 1 according to a computer program.

The storage unit 17 is constituted by a data storage device such as a RAM (Random Access Memory), a flash memory, or a hard disk storage device. The storage unit 17 stores computer programs and the like executed by the control unit 16.

Return to Figure 1. The sensor unit 3 is mounted on the vehicle 90 together with the drive recorder 1. The sensor unit 3 detects an event occurring in the vehicle 90 and transmits to the server 4 at least data on the date and time when the event was detected.

FIG. 3 is a block diagram illustrating an example of the configuration of a sensor unit according to the present disclosure.

The sensor unit 3 includes a position information acquisition section 31, an event detection section 32, an index information generation section 33, a time measurement section 34, a communication section 35, a control section 36, a storage section 37, and the like. The position information acquisition section 31, the event detection section 32, the index information generation section 33, the time measurement section 34, the communication section 35, the control section 36, the storage section 37, etc. are configured so that they can mutually send and receive electrical signals via the data bus 3a. It is connected.

The position information acquisition unit 31 receives a GPS signal from a GPS satellite, for example, and acquires the position information of the sensor unit 3, in other words, the position information of the vehicle 90 on which the sensor unit 3 is mounted, based on the received GPS signal. do.

The event detection section 32 detects an event that occurs in the vehicle 90 in which the sensor unit 3 is mounted. Specifically, the event detection unit 32 is exemplified by, for example, an acceleration sensor. In this case, the event detection unit 32 detects, as an event occurring in the vehicle 90 on which the sensor unit 3 is mounted, that the vehicle 90 has received an impact due to an accident, for example, when the acceleration is equal to or higher than a predetermined value. The event detection unit 32 is not limited to an acceleration sensor, and may be, for example, a speed sensor, a vehicle speed sensor, a biological sensor, or the like. Further, a configuration including a plurality of these sensors may be used.

When the event detection section 32 detects an event that has occurred in the vehicle 90 on which the sensor unit 3 is mounted, the index information generation section 33 generates index information that includes the date, time, location, etc. of the event.

FIG. 4 is a diagram illustrating an example of index information generated by the index information generation section. In the example shown in FIG. 4, the index information includes the location, date, and time at which the event occurred. The location information indicating the location where the event occurred includes, for example, latitude and longitude. The date and time information indicating the date and time when the event occurred includes, for example, year, month, day, hour, minute, and second. Location information indicating the location where the event occurred is acquired by the location information acquisition unit 31. Date and time information indicating the date and time when the event occurred is acquired by the clock unit 34. Note that the index information may include, for example, a detection value of an acceleration sensor (event detection unit 32).

The index information is linked to the identification information of the sensor unit 3. Thereby, the index information and the sensor unit 3 are uniquely identified.

The communication unit 35 transmits the index information generated by the index information generation unit 33 to the server 4 via the communication network 91. In the present disclosure, the communication unit 35 performs communication based on communication standards such as an LTE (Long Term Evolution) network or a 3G (Third Generation) network, for example.

The control unit 36 is configured by, for example, a CPU. The control unit 36 executes each process in the sensor unit 3 according to a computer program.

The storage unit 37 is constituted by a data storage device such as a RAM (Random Access Memory), a flash memory, or a hard disk storage device. The storage unit 37 stores computer programs and the like executed by the control unit 36.

FIG. 5 is a block diagram illustrating an example of the configuration of a server and a terminal device according to the present disclosure.

The server 4 includes a display section 42, an operation section 43, a communication section 44, a control section 45, a storage section 46, and the like. The display section 42, the operation section 43, the communication section 44, the control section 45, the storage section 46, etc. are connected to each other via the data bus 4a so that they can send and receive electrical signals.

The display unit 42 includes a liquid crystal display, an organic EL (Electro Luminescence) display, an LED (Light Emitting Diode) display, and the like. The display unit 42 displays information regarding operations based on instructions from the control unit 45.

The operation unit 43 is composed of operation keys, cross keys, switches such as a touch panel, and accepts operation inputs from the server administrator. The operation input received by the operation unit 43 is acquired by the control unit 43. In addition to operation input, the operation unit 43 may also support input by other means such as voice input, and accepts instructions from the server administrator. This corresponds to instructions from

The communication unit 44 is communicatively connected to the communication network 91 wirelessly or by wire. The communication unit 44 communicates with the sensor unit 3, the terminal device 5, and the call center 6 via the communication network 91.

The control unit 45 is configured by, for example, a CPU. The control unit 45 executes each process in the server 4 according to a computer program.

The storage unit 46 is composed of a data storage device such as a RAM (Random Access Memory), a flash memory, or a hard disk storage device. The storage unit 46 stores computer programs and the like executed by the control unit 45.

The terminal device 5 includes a display section 52, an operation section 53, a communication section 54, a control section 55, a storage section 56, an interface 57, and the like. The terminal device 5 is, for example, an information processing terminal such as a PC (personal computer) or a smart phone. The data processing section 51, display section 52, operation section 53, communication section 54, control section 55, storage section 56, interface 57, etc. are connected to each other via the data bus 5a so that they can send and receive electrical signals.

The display unit 52 includes a liquid crystal display, an organic EL (Electro Luminescence) display, an LED (Light Emitting Diode) display, and the like. The display unit 52 displays information regarding operations based on instructions from the control unit 55.

The operation unit 53 includes operation keys, a cross key, switches such as a touch panel, and accepts operation inputs from the user. The operation input received by the operation unit 53 is acquired by the control unit 55. In addition to operation input, the operation unit 53 may also accept input by other means such as voice input, and receives instructions from the user, and the operation input by the user corresponds to the instruction from the user. .

The communication unit 54 is communicatively connected to the communication network 91 by wireless or wire. The communication unit 54 communicates with the server 4 via the communication network 91.

The control unit 55 is composed of, for example, a CPU. The control unit 55 executes each process in the terminal device 5 according to a computer program.

The storage unit 56 is constituted by a data storage device such as a RAM (Random Access Memory), a flash memory, or a hard disk storage device. The storage unit 56 stores computer programs and the like executed by the control unit 55.

The video file stored in the storage medium 2 is read via the interface 57.

[First embodiment]
In the first embodiment of the present disclosure, the storage unit 46 of the server 4 stores a first program for transferring index information sent from the sensor unit 3 to the terminal device 5. The control unit 45 of the server 4 transfers the index information sent from the sensor unit 3 from the communication unit 44 to the terminal device 5 via the communication network 91 according to the first program.

In the first embodiment of the present disclosure, when an event that occurs in the vehicle 90 is detected by the sensor unit 3 from the video file stored in the storage medium 2 based on the index information in the storage unit 56 of the terminal device 5. A second program is stored therein for cutting out the video as moving image data, generating event moving image information by adding index information to the cut out moving image data, and transmitting the generated event moving image information to the server 4. In accordance with the second program, the control unit 55 of the terminal device 5 converts a video image when an event occurring in the vehicle 90 is detected by the sensor unit 3 from the video file stored in the storage medium 2 based on the index information. Event video information is generated by cutting out the video data as data and adding index information to the clipped video data, and transmits it from the communication unit 54 to the server 4 via the communication network 91.

Thereby, the video captured by the drive recorder 1 and the event occurring in the vehicle 90 can be linked.

Further, in the first embodiment of the present disclosure, the storage unit 46 of the server 4 stores a third program for transferring event video information sent from the terminal device 5 to the call center 6. The control unit 45 of the server 4 transfers the event video information sent from the terminal device 5 from the communication unit 44 to the call center 6 via the communication network 91 according to the third program.

Hereinafter, with reference to FIG. 6, specific event video information generation processing in the drive recorder operation system 100 according to the first embodiment of the present disclosure will be described. FIG. 6 is a sequence diagram illustrating a specific example of event video information generation processing in the drive recorder operation system according to the first embodiment of the present disclosure. In the event video information generation process shown in FIG. 6, each process is performed by each component of the sensor unit 2, server 4, and terminal device 5. This will be explained as device 5.

When the sensor unit 2 detects an event that occurs in the vehicle 90 (for example, the vehicle 90 receives an impact due to an accident) (step S101), the sensor unit 2 detects the identification information of the sensor unit 3, the place and date where the event occurred, Index information (see FIG. 4) associated with information such as time is generated (step S102). The sensor unit 2 transmits the generated index information to the server 4 (step S103).

Upon receiving the index information from the sensor unit 2, the server 4 transfers the received index information to the terminal device 5 (step S104).

The index information transferred from the server 4 to the terminal device 5 may be, for example, stored in a dedicated file that can be recognized by the second program of the terminal device 5, and automatically sent to the user's e-mail address.

The index information received by the terminal device 5 is stored in the storage unit 56 of the terminal device 5 (step S105).

As described above, the storage medium 2 is associated with the identification information of the sensor unit 3 in advance. Further, when the index information is generated in the sensor unit 3, identification information of the sensor unit 3 is linked. Based on this identification information, the video file and index information stored in the storage medium 2 are uniquely identified.

The terminal device 5 performs the identification information verification process shown in FIG. FIG. 7 is a flowchart illustrating a specific example of identification information verification processing in the drive recorder operation system according to the first embodiment of the present disclosure. In the identification information matching process shown in FIG. 7, the main body of each process will be explained as the terminal device 5.

The terminal device 5 checks whether the identification information matches the storage medium 2 connected to the interface 57 and the index information received from the server 4 (step S106).

If the identification information does not match (step S106; No), the process does not proceed to step S107 shown in FIG. 6, and the event video information generation process ends.

If the identification information matches (step S106; Yes), the process moves to step S107 shown in FIG. The terminal device 5 reads the video file stored in the storage medium 2 (step S107).

Next, based on the index information, the terminal device 5 cuts out a video when an event occurring in the vehicle 90 is detected by the sensor unit 3 from the read video file as video data (step S108), and extracts the video data as video data. The index information stored in the storage unit 56 is added to the event video information to generate event video information (step S109).

Specifically, for example, when the user starts up the terminal device 5 and operates the operation unit 53 to open a dedicated file in which index information is stored, the second program is started and saved in the storage medium 2. Load video files and edit videos. The terminal device 5 extracts video data for a predetermined period (for example, 15 to 30 seconds) including the event occurrence date and time included in the index information from the read video file, and extracts the video data for a predetermined period (for example, 15 seconds to 30 seconds) including the event occurrence date and time included in the index information, and extracts the date and time information, position information, and acceleration included in the index information. Event video information including information such as detection values of the sensor (event detection unit 32) is generated.

As a result, event video information in which the video captured by the drive recorder 1 and the event that occurred in the vehicle 90 are linked is obtained.

Then, the terminal device 5 transmits the generated event video information to the server 4 (step S110).

Upon receiving the event video information from the terminal device 5, the server 4 transfers the received event video information to the call center 6 (step S111).

[Second embodiment]
In the second embodiment of the present disclosure, the storage unit 46 of the server 4 stores a first program for transferring index information sent from the sensor unit 3 to the terminal device 5. The control unit 45 of the server 4 transfers the index information sent from the sensor unit 3 from the communication unit 44 to the terminal device 5 via the communication network 91 according to the first program.

In the second embodiment of the present disclosure, when an event occurring in the vehicle 90 is detected by the sensor unit 3 based on the index information in the storage unit 56 of the terminal device 5 from the video file stored in the storage medium 2. A second program for cutting out the video as moving image data and sending it to the server 4 is stored. In accordance with the second program, the control unit 55 of the terminal device 5 converts a video image when an event occurring in the vehicle 90 is detected by the sensor unit 3 from the video file stored in the storage medium 2 based on the index information. It is extracted as data and sent from the communication unit 54 to the server 4 via the communication network 91.

Further, in the second embodiment of the present disclosure, the storage unit 46 of the server 4 is configured to generate event video information in which index information is added to the video data sent from the terminal device 5, and to send it to the call center 6. A third program is stored. The control unit 45 of the server 4 generates event video information by adding index information to the video data sent from the terminal device 5 according to the third program, and transmits the event video information from the communication unit 44 to the call center 6 via the communication network 91. Send.

Thereby, the video captured by the drive recorder 1 and the event occurring in the vehicle 90 can be linked.

Hereinafter, with reference to FIG. 8, specific event video information generation processing in the drive recorder operation system 100 according to the second embodiment of the present disclosure will be described. FIG. 8 is a sequence diagram showing a specific example of event video information generation processing in the drive recorder operation system according to the second embodiment of the present disclosure. In the event video information generation process shown in FIG. 8, each process is performed by each component of the sensor unit 2, server 4, and terminal device 5. This will be explained as device 5.

When the sensor unit 2 detects an event that occurs in the vehicle 90 (for example, the vehicle 90 receives an impact due to an accident) (step S201), the sensor unit 2 detects the identification information of the sensor unit 3, the place and date where the event occurred, Index information (see FIG. 4) associated with information such as time is generated (step S202). The sensor unit 2 transmits the generated index information to the server 4 (step S203).

The index information received by the server 4 is stored in the storage unit 46 of the server 4 (step S204). The server 4 transfers the received index information to the terminal device 5 (step S205).

The index information transferred from the server 4 to the terminal device 5 may be, for example, stored in a dedicated file that can be recognized by the second program of the terminal device 5, and automatically sent to the user's e-mail address.

The terminal device 5 checks whether the identification information matches the storage medium 2 connected to the interface 57 and the index information received from the server 4 (step S206). This identification information verification process is the same as the identification information verification process (step S106) in the first embodiment, so a description thereof will be omitted here.

If the identification information matches, the process moves to step S207 shown in FIG. 8. The terminal device 5 reads the video file stored in the storage medium 2 via the interface 57 (step S207).

Next, based on the index information, the terminal device 5 cuts out a video when an event occurring in the vehicle 90 is detected by the sensor unit 3 from the read video file as video data (step S208), and extracts the video data as video data. is transmitted to the server 4 (step S209).

Specifically, for example, when the user starts up the terminal device 5 and operates the operation unit 53 to open a dedicated file in which index information is stored, the second program is started and saved in the storage medium 2. Load the video file and edit the video. The terminal device 5 cuts out video data for a predetermined period (for example, 15 seconds to 30 seconds) including the event occurrence date and time included in the index information from the read video file, and transmits the cut video data to the server 4.

When the server 4 receives the video data from the terminal device 5, the server 4 adds the index information stored in the storage unit 46 to the received video data (specifically, for example, cuts out the video data, and adds date and time information, position information, etc. included in the index information) to the received video data. event video information (step S210).

As a result, event video information in which the video captured by the drive recorder 1 and the event that occurred in the vehicle 90 are linked is obtained.

Then, the server 4 transmits the generated event video information to the call center 6 (step S211).

Note that in the first and second embodiments described above, an example was shown in which the cooperation device 200 is configured with the server 4 and the terminal device 5, but it is also possible to configure the cooperation device 200 with one device. . In this case, the cooperation device 200 reads a video file from the storage medium 2, and based on the index information sent from the sensor unit 3, when an event that occurs in the vehicle 90 is detected by the sensor unit 3 from the read video file. It may be possible to cut out the video as video data, generate event video information by adding index information to the clipped video data, and send it to the call center 6.

Although the embodiments of the present disclosure have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-mentioned components include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those that are in a so-called equivalent range. Furthermore, the aforementioned components can be combined as appropriate. Furthermore, various omissions, substitutions, or changes of the constituent elements can be made without departing from the gist of the embodiments described above.

1 Drive recorder 2 Storage medium 3 Sensor unit 4 Server 5 Terminal device 6 Call center 100 Drive recorder operation system 200 Cooperation device

Claims (4)

a sensor unit that transmits index information including information on events that occur in the vehicle;
a portable storage medium;
a drive recorder that generates a video file that sequentially photographs the surroundings of the vehicle and stores it in the storage medium;
a coordination device that links an event occurring in the vehicle with a video file stored in the storage medium based on index information sent from the sensor unit;
Equipped with
The cooperation device is
a server that transfers index information sent from the sensor unit;
Load the video file from the storage medium and read the index information transferred from the server.
Based on the information, cut out video data for a predetermined period including the date and time of the event, and
Generate event video information by adding index information to the data and send it to the server.
a terminal device,
further comprising;
Drive recorder operation system. a sensor unit that transmits index information including information on events that occur in the vehicle;
a portable storage medium;
Generating a video file of sequentially photographed surroundings of the vehicle and storing it in the storage medium;
The existing drive recorder and
Based on the index information sent from the sensor unit, the problem occurring in the vehicle is detected.
a coordination device that links the vent and the video file stored in the storage medium;
Equipped with
The cooperation device is
a server that transfers index information sent from the sensor unit;
Load the video file from the storage medium and read the index information transferred from the server.
Based on the information, cut out the video data for a predetermined period including the date and time of the event and send it to the server.
a terminal device for sending data to the server;
Furthermore,
The server is
generating event video information by adding index information to video data sent from the terminal device;
Drive recorder operation system. The sensor unit includes an acceleration sensor that detects that the vehicle has received an impact as the event,
The index information includes date and time information when the detected value of the acceleration sensor exceeds a predetermined value.
The drive recorder operation system according to claim 1 or 2 . The sensor unit includes a position information acquisition section that acquires position information of the vehicle,
the index information includes the location information when the event occurs;
The drive recorder operation system according to claim 3 .

Images