JP7768295B2 - Terminal device, recording method, and program - Google Patents

Description

The present invention relates to a terminal device, a recording method, and a program.

2. Description of the Related Art Techniques for processing images taken by a drive recorder or the like to protect the privacy of people or the like included in the images are known.

For example, Patent Document 1 discloses a technology that can generate an image that makes it easy to understand the driving situation and other conditions while protecting the privacy of objects captured in the image.

Japanese Patent Application Laid-Open No. 2018-124825

When using content such as images and audio captured by a dashcam to investigate an accident, if the content has been processed, it may be difficult to ensure its admissibility as evidence.

An object of the present invention is to provide a terminal device, a recording method, and a program that can generate processed content whose admissibility as evidence is guaranteed.

A terminal device according to one aspect of the present invention includes a program acquisition unit that acquires an authenticated program authenticated by an issuer, a content data acquisition unit that acquires content data to be processed, a modification processing unit that uses the authenticated program to perform a predetermined process on the content data to generate modified content data , program identification information that can identify the authenticated program, and content identification information that can identify the content data.
The system includes a unique identification information generation unit that generates changed content identification information that can identify the changed content data, and a processing history information generation unit that generates processing history information that includes the program identification information, the content identification information, and the changed content identification information.

A recording method according to one aspect of the present invention includes a control unit of a terminal device that executes the following steps: acquiring an authenticated program authenticated by an issuer; acquiring content data to be processed; using the authenticated program to perform a predetermined process on the content data to generate modified content data; generating program identification information capable of identifying the authenticated program , content identification information capable of identifying the content data, and modified content identification information capable of identifying the modified content data ; and generating processing history information including the program identification information, the content identification information, and the modified content identification information.

A program according to one aspect of the present invention causes a control unit of a terminal device to execute the steps of acquiring an authenticated program authenticated by an issuer, acquiring content data to be processed, using the authenticated program to perform a predetermined processing on the content data to generate modified content data , generating program identification information capable of identifying the authenticated program , content identification information capable of identifying the content data, and modified content identification information capable of identifying the modified content data , and generating processing history information including the program identification information, the content identification information, and the modified content identification information.

The present invention makes it possible to generate processed images that are admissible as evidence.

FIG. 1 is a diagram illustrating the configuration of a recording system according to an embodiment. FIG. 2 is a block diagram illustrating an example of the configuration of a terminal device according to the embodiment. FIG. 3 is a diagram illustrating processing history information according to the embodiment. FIG. 4 is a block diagram illustrating an example of the configuration of a server according to the embodiment. FIG. 5 is a flowchart illustrating an example of a processing flow of the terminal device according to the embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to these embodiments, and when there are multiple embodiments, the present invention also includes configurations that combine the embodiments. Furthermore, in the following embodiments, the same components are designated by the same reference numerals, and redundant explanations will be omitted.
[Recording System]
The configuration of a recording system according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining the configuration of a recording system according to an embodiment.

As shown in FIG. 1, the recording system 1 according to the embodiment includes a terminal device 100 and a server 20
1. The terminal device 100 and the server 200 are connected to each other so as to be able to communicate with each other via, for example, a wireless network N. The network N is, for example, the Internet, but is not limited to this. In FIG. 1, the terminal device 100 includes one server 200.
However, a plurality of servers 200 may be connected to the terminal device 100.

The terminal device 100 is, for example, a drive recorder mounted on a vehicle.
The terminal device 100 acquires information about content data related to video and audio of an event, for example. The terminal device 100 acquires from the server 200 a program for identifying a processing target and processing the content data, for example, for privacy protection. The program acquired by the terminal device 100 from the server 200 is a program authenticated by a predetermined issuer. The predetermined issuer may include, but is not limited to, a certification body, an insurance company, a public institution (e.g., the police), etc. An authenticated program is a program that the predetermined issuer has permitted to be used when identifying a processing target and processing the content data. The recording system 1 can generate an edited image whose admissibility as evidence is guaranteed by using a program authenticated by the predetermined issuer to identify a processing target and process the content data.
[Terminal Device]
The configuration of a terminal device according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of a terminal device according to the embodiment.

2, the terminal device 100 includes a first storage unit 11, a second storage unit 12, an output unit 13, a communication unit 14, and a control unit 15. The first storage unit 11, the second storage unit 12, the output unit 13, the communication unit 14, and the control unit 15 are each connected by a bus B1.

The first storage unit 11 stores various types of information.
The first storage unit 11 stores unique information including the model number of 0 and the serial number.
The first storage unit 11 stores an authenticated program acquired from the server 200 for processing content data. The first storage unit 11 can be realized, for example, by a semiconductor memory device such as RAM (Random Access Memory) or flash memory, or a storage device such as a hard disk or solid-state drive. The first storage unit 11 may have a read-only storage area. This read-only storage area may store unique information, such as the model number and serial number of the terminal device 100. Furthermore, the first storage unit 11 may be configured to be resistant to unauthorized external reading and writing to prevent tampering with stored information. For example, the first storage unit 11 may be configured to detect deviations from a predetermined reading and writing procedure and prohibit unauthorized reading and writing. Furthermore, the information stored in the first storage unit 11 may be encrypted so that the encrypted information cannot be decrypted except through the predetermined reading and writing procedure.

The second storage unit 12 stores various types of information. For example, the second storage unit 12 stores processing history information related to processing history generated when processing content data. The second storage unit 12 is a storage medium that is removable from the terminal device 100. The second storage unit 12 stores:
For example, the second storage unit 12 can be realized by a USB (Universal Serial Bus) memory, an SD card, or the like. Here, for the sake of explanation, the second storage unit 12 is a different component from the first storage unit 11, but the information stored in the second storage unit 12 may be stored in the first storage unit 11 and then stored in an external storage unit via the communication unit 14. For example, the information may be stored in a virtual storage unit constructed on a predetermined NAS (Network Attached Storage) connected to a network or a cloud server. Furthermore, when the information is stored in the external storage unit via the communication unit 14, the information may be encrypted in a predetermined manner before being stored. Furthermore, when the information is stored via the communication unit 14, a VPN (Virtual Private Network) may be established for the communication path.
Alternatively, the information may be transmitted and stored in an encrypted communication environment established by the network.

The output unit 13 outputs various types of information. The output unit 13 has a function as a display unit that displays various types of information. The output unit 13 is, for example, a liquid crystal display (LCD).
The output unit 13 may be realized by a display including a liquid crystal display (LCD) or an organic electroluminescence (EL) display. The output unit 13 may also function as an audio output unit that outputs audio. In this case, the output unit 13 may include a speaker that outputs audio.

The communication unit 14 communicates with an external device via a network N. For example, the communication unit 14 communicates with a server 200 via the network N. For example, the communication unit 14 communicates with an external device via the network N.
This can be realized using an IC (Network Interface Card) and a communication circuit.
The communication unit 14 may be configured to include a transmitting unit and a receiving unit for performing wireless communication.

The control unit 15 controls each unit constituting the terminal device 100. For example, the control unit 15
By using a PU (Central Processing Unit) or MPU (Micro Processing Unit),
A program stored in a storage unit (not shown) (for example, a program according to the present invention) is stored in RAM.
The control unit 15 is implemented by, for example, an ASIC
(Application Specific Integrated Circuit) and FPGA (Field Programmable G
The control unit 15 may be realized by an integrated circuit such as a digital signal processor (DSP) or a digital signal processor array. The control unit 15 may be realized by a combination of software and hardware.

The control unit 15 includes a program acquisition unit 151, a content data acquisition unit 152, a change processing unit 153, a terminal identification information generation unit 154, a unique identification information generation unit 155, a processing history information generation unit 156, an output control unit 157, a storage control unit 158, and a communication control unit 159.
a terminal identification information generating unit 154, a unique identification information generating unit 155, and a processing history information generating unit 1
56, the output control unit 157, the storage control unit 158, and the communication control unit 159 are respectively
They are connected by bus B2.

The program acquisition unit 151 acquires various programs. For example, the program acquisition unit 151 acquires an authenticated program, which has been authenticated by a predetermined issuer and which performs a process of identifying or changing a predetermined processing target, from the server 200 via the communication unit 14. The authenticated program is a program that has been permitted for use with content data by a predetermined issuer. The authenticated program may include, for example, a program for performing image processing on an image in order to protect the privacy of a person's face, a vehicle license plate, or the like included in the image. The authenticated program may include, for example, a program for performing audio processing on an audio in order to protect the privacy of a person's voice, or the like.

The content data acquisition unit 152 acquires content data related to various types of content. For example, the content data acquisition unit 152 acquires content data related to content to be processed. For example, the content data acquisition unit 152 acquires video data related to video captured by an imaging unit 20 provided in the vehicle. For example, the content data acquisition unit 152 acquires audio data related to audio picked up by a microphone (not shown) provided in the vehicle. The content data acquisition unit 152 may also acquire other data as content data.

The change processing unit 153 identifies a processing target and executes various change processes on the content data acquired by the content data acquisition unit 152. For example, the change processing unit 153 uses the authenticated program acquired by the program acquisition unit 151 to change the content data acquired by the content data acquisition unit 152.
The modification processing unit 153 performs a predetermined modification process on the content data acquired by the program acquisition unit 152 to generate modified content data. For example, if the program acquisition unit 151 acquires multiple authenticated programs, the modification processing unit 153 performs the modification process using the multiple authenticated programs.
Modified content data may be generated.

When the content data is video data made up of a sequence of images, the change processing unit 153 identifies a target area for the sequence of images through a predetermined detection process and generates target area information.
This predetermined detection process may be performed using an authenticated program. The modification processing unit 153, for example, performs a well-known face detection process to recognize a person's face in the image sequence, identifies the area of the person's face included in the image sequence as a target area, and generates target area information. The modification processing unit 153 performs a predetermined irreversible processing process on the target area to generate a processed image. For example, the modification processing unit 153 performs irreversible processing to make the detected person unrecognizable, thereby generating a processed image. Specifically, the modification processing unit 153 performs a mosaic process on the person to blur the face, superimposes an icon on the person, or superimposes a background image or the like to erase the person, thereby generating a processed image in which the detected person is unrecognizable.

When the content data is audio data, the modification processing unit 153 performs a predetermined audio extraction process on the audio data to identify an area containing a person's voice as a target area and generate target area information. This predetermined audio extraction process is preferably performed using an authenticated program. The modification processing unit 153 performs a predetermined irreversible processing process on the target area to generate processed audio. For example, the modification processing unit 153 performs an irreversible processing process on the detected person's voice to make it indistinguishable, thereby generating processed audio. Specifically, the modification processing unit 153 adjusts the voice quality, vocal range, etc. of the detected person to generate processed audio that makes the detected person's voice indistinguishable.

The terminal identification information generation unit 154 generates terminal identification information that can uniquely identify the terminal device 100 (also referred to as its own terminal) using specific information.
The terminal identification information generating unit 154 acquires the unique information of the terminal device 100 and generates terminal identification information that can uniquely identify the terminal device 100. For example, the terminal identification information generating unit 154 generates the unique information of the terminal device 100.
The model number and serial number of the terminal device 100 are input into a predetermined hash function to calculate a hash value, which is unique information. Here, the terminal identification information may be generated in advance based on unique information of the terminal device 100 and stored in the first storage unit 11.
The storage unit 11 may be configured to have a read-only storage area, and to store the terminal identification information in this read-only storage area.

The unique identification information generation unit 155 generates program identification information that can uniquely identify the authenticated program acquired by the program acquisition unit 151 using unique information. The unique identification information generation unit 155 inputs, for example, the authenticated program itself, version information and build number of the authenticated program, etc., as the program identification information into a predetermined hash function to calculate a hash value that is unique information.

The unique identification information generation unit 155 generates content identification information that can uniquely identify the content data acquired by the content data acquisition unit 152 using unique information. For example, the unique identification information generation unit 155 inputs the acquired content data itself and information related to the date and time the content data was acquired into a predetermined hash function to calculate a hash value, which is unique information, as the content identification information. When generating content identification information from the acquired content data, the unique identification information may be sequentially generated using predetermined division units as processing units for generating content identification information. Examples of predetermined division units that may be used include the data size of the content, the duration of the content, the size of the screen area of the content, the frequency at which the content is converted, and, if the content is encoded according to a predetermined syntax structure, units of the predetermined syntax structure.

The unique identification information generation unit 155 generates changed content identification information that can uniquely identify the changed content data generated by the change processing unit 153 using unique information. For example, the unique identification information generation unit 155 inputs the changed content data itself and information related to the date and time the changed content data was generated into a predetermined hash function to calculate a hash value, which is unique information, as the changed content identification information. Here, when generating the changed content identification information from the changed content data, the changed content identification information may be generated sequentially using a predetermined division unit as the processing unit for generating the changed content identification information. The predetermined division unit may be the data size of the content,
The duration of the content, the size of the screen area of the content, the frequency at which the content is converted,
If the content is coded according to a predetermined syntax structure, the changed content identification information may be generated sequentially in units of the predetermined syntax structure, etc. Also, the predetermined division unit of the changed content data may be configured to be the same as the predetermined division unit of the acquired content data.

The processing history information generating unit 156 generates processing history information relating to the history of processing performed on the content data acquired by the content data acquiring unit 152 .

Processing history information according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a diagram for explaining processing history information according to the embodiment.

As shown in FIG. 3, the processing history information includes items such as "date and time,""terminal identification information,""program identification information,""content identification information," and "changed content identification information." In the processing history information, the "date and time,""terminal identification information,""program identification information,""content identification information," and "changed content identification information" are associated with each other. Note that, if the change processing unit 153 generates a processed image by performing a predetermined irreversible processing on the target area, the processing history information generating unit 156 may include target area information in the processing history information. Furthermore, the processing history information is configured based on a predetermined syntax structure, and may include, for example, "date and time,""terminal identification information," and "program identification information."
The elements included in the processing history information, such as "content identification information" and "changed content identification information," may be associated with each other and configured as a single piece of information.

"Date and time" is the date and time when the change processing unit 153 executed the authentication program on the content data. "Terminal identification information" is information generated by the terminal identification information generation unit 154 to uniquely identify the terminal device 100. "Program identification information" and "Content identification information"
The "date and time" and "changed content identification information" are information generated by the unique identification information generation unit 155 to uniquely identify the authenticated program, the content data, and the changed content data, respectively. Here, the "date and time" in the change processing unit 153 is described, but the "date and time" when the content is acquired may also be generated and associated with the content.

In FIG. 3, for example, the terminal identification information “D
1. As a result, the content data with the content identification information "C1" is updated to the authentication program with the program identification information "P1" by the terminal device 100 with the content identification information "C1".
It is also shown that the modified content data of "1A" has been obtained.

In FIG. 3, for example, the terminal identification information “D
The processing history information indicates that terminal device 100 "1" executed the authenticated program with program identification information "P1, P2" on content data with content identification information "C2". As a result, it also indicates that changed content data with changed content identification information "C2A" was obtained. In other words, when multiple authenticated programs are executed on one piece of content data, the processing history information indicates the program identification information of each of the executed authenticated programs.

"Terminal identification information" is conceptually shown as "D1", but in reality it is represented as a numerical value such as a hash value. "Program identification information" is conceptually shown as "P1", "P2", but in reality it is represented as a numerical value such as a hash value. "Content identification information"
Although the "changed content identification information" is conceptually shown as "C1" and "C2", it is actually represented by a numerical value such as a hash value. The "changed content identification information" is conceptually shown as "C1A" and "C2A", but it is actually represented by a numerical value such as a hash value.

Referring again to FIG. 2, the output control unit 157 controls the output unit 13.
For example, if the output unit 13 has a function as a display unit, the output control unit 157 causes the output unit 13 to display various images. For example, if the output unit 13 has a function as an audio output unit, the output control unit 157 causes the output unit 13 to output various sounds.

The storage control unit 158 stores various types of information in the first storage unit 11 or the second storage unit 12 .
The storage control unit 158 stores, for example, the authenticated program acquired by the program acquisition unit 151 in the first storage unit 11.
2 is stored in the first storage unit 11. The storage control unit 158, for example, stores the changed content data generated by the change processing unit 153 in the first storage unit 11. The storage control unit 158, for example, stores the processing history information generated by the processing history information generation unit 156 in the first storage unit 11. The storage control unit 158, for example, stores the processing history information generated by the processing history information generation unit 156 in the second storage unit 12, or outputs the processing history information generated by the processing history information generation unit 156 to an external device via the communication unit 14. The storage control unit 158, for example, transmits the processing history information generated by the processing history information generation unit 156 to the server 200 via the communication unit 14.

The communication control unit 159 controls communication between the terminal device 100 and an external device. The communication control unit 159 controls the communication unit 14 to control communication between the terminal device 100 and the server 200, for example.
[server]
The configuration of the server according to the embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing an example of the configuration of the server according to the embodiment.

4, the server 200 includes a communication unit 21, a storage unit 22, and a control unit 23. The server 200 is used by a predetermined issuer that provides an authenticated authentication program.

The communication unit 21 communicates with an external device via the network N. For example, the communication unit 21 communicates with a terminal device via the network N. For example, the communication unit 21 is
and communication circuits.

The storage unit 22 stores various types of information. For example, the storage unit 22 stores an authenticated program used by the terminal device 100. For example, the storage unit 22 stores processing history information generated by the terminal device 100. The storage unit 22 can be realized by, for example, a semiconductor memory element such as RAM or flash memory, or a storage device such as a hard disk or solid state drive. Furthermore, the server-side storage unit 22 may be configured as a virtual storage unit built on a predetermined network-attached storage (NAS) connected to a network or a cloud server.

The control unit 23 controls each unit constituting the server 200. For example, the control unit 23 controls the communication unit 21 to control communication between the server 200 and the terminal device 100.
The control unit 23 stores, for example, the authenticated program and processing history information received from the terminal device 100 in the storage unit 22. The control unit 23 is realized, for example, by a CPU, an MPU, or the like executing a program stored in a storage unit (not shown) using a RAM or the like as a work area. The control unit 23 may be realized, for example, by an integrated circuit such as an ASIC or an FPGA. The control unit 23 may also be realized by a combination of software and hardware.

The control unit 23 includes a program generation unit 231. The program generation unit 231 generates an authentication program used when the terminal device 100 identifies a processing target or executes a change process on content data for privacy protection or the like. The program generation unit 231 may generate one authentication program, or may generate multiple authentication programs that each execute a different change process.
[Terminal Device Processing]
The processing of the terminal device according to the embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing an example of the flow of processing of the terminal device according to the embodiment.

First, the control unit 15 generates terminal identification information (step S11). Specifically, the terminal identification information generation unit 154 generates the terminal identification information based on the unique information stored in the first storage unit 11.
The terminal identification information that can uniquely identify 00 is generated, and the process then proceeds to step S12.

The control unit 15 acquires the authenticated program (step S12). Specifically, the program acquisition unit 151 acquires the authenticated program for identifying a processing target of content data and for performing processing from the server 200. The program acquisition unit 151 acquires the authenticated program for identifying a processing target of content data and for performing processing from the server 200.
One or more authenticated programs may be acquired from the program. Then, the process proceeds to step S13.

The control unit 15 generates program identification information (step S13). Specifically, the unique identification information generation unit 155 generates program identification information that can uniquely identify the authenticated program based on the authenticated program itself, version information of the authenticated program, etc. Then, the process proceeds to step S14.

The control unit 15 acquires the content data to be processed (step S14). Specifically, the content data acquisition unit 152 acquires content data such as video data and audio data from the imaging unit 20. Then, the process proceeds to step S15.

The control unit 15 generates content identification information (step S15). Specifically, the unique identification information generation unit 155 generates content identification information that can uniquely identify the content data based on the content data itself and the date and time when the content data acquisition unit 152 acquired the content data. Then, the process proceeds to step S16.

The control unit 15 generates changed content data (step S16). Specifically, the change processing unit 153 performs a predetermined processing process for protecting privacy on the content data acquired by the content data acquisition unit 152 to generate changed content data. More specifically, the change processing unit 153 processes the content data using the authenticated program acquired by the program acquisition unit 151 to generate changed content data. Then, the process proceeds to step S17.

The control unit 15 generates changed content identification information (step S17). Specifically, the unique identification information generation unit 155 generates changed content identification information that can uniquely identify the changed content data based on the changed content data itself and the date and time when the change processing unit 153 performed image processing on the changed content data. Then, the process proceeds to step S18.

The control unit 15 generates processing history information (step S18). Specifically, the processing history information generating unit 156 generates the processing history information based on the terminal identification information, the program identification information, the content identification information, and the changed content identification information. Then, in step S1
Go to 9.

The control unit 15 outputs the processing history information (step S19). Specifically, the storage control unit 158 stores the processing history information in the second storage unit 12 or outputs it to the server 200.
Then, the process of FIG. 5 ends.

As described above, in this embodiment, when content data such as video data is processed, processing history information is generated in which terminal identification information, program identification information, content identification information, and changed content identification information are associated with each other.
By checking the processing history information, it is possible to easily grasp the correspondence between the terminal device that processed the changed content data, the program, and the content data before the processing. In other words, this embodiment can generate changed content data that is admissible as evidence.

Although the embodiments of the present invention have been described above, the present invention is not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments.

REFERENCE SIGNS LIST 1 Recording system 11 First storage unit 12 Second storage unit 13 Output unit 14, 21 Communication unit 15, 23 Control unit 20 Imaging unit 22 Storage unit 100 Terminal device 151 Program acquisition unit 152 Content data acquisition unit 153 Change processing unit 154 Terminal identification information generation unit 155 Unique identification information generation unit 156 Processing history information generation unit 157 Output control unit 158 Storage control unit 159 Communication control unit 200 Server 231 Program generation unit

Claims (5)

a program acquisition unit that acquires an authenticated program authenticated by an issuer;
a content data acquisition unit that acquires content data to be processed;
a modification processing unit that uses the authenticated program to perform a predetermined process on the content data to generate modified content data;
a unique identification information generating unit that generates program identification information that can identify the authenticated program, content identification information that can identify the content data, and changed content identification information that can identify the changed content data;
a processing history information generating unit that generates processing history information including the program identification information, the content identification information, and the changed content identification information;
A terminal device comprising: a communication unit that communicates with an external device;
Further provided with
The terminal device according to claim 1 , wherein the communication unit transmits the processing history information generated by the processing history information generation unit to the external device. the unique identification information generation unit, the authenticated program acquired by the program acquisition unit,
The content data acquired by the content data acquisition unit and the content data generated by the change processing unit
3. The terminal device according to claim 1, wherein the program identification information, the content identification information , and the changed content identification information are generated from changed content data . A control unit of the terminal device
obtaining a certified program certified by an issuer;
acquiring content data to be processed;
using the authenticated program to perform a predetermined process on the content data to generate modified content data;
generating program identification information capable of identifying the authenticated program, content identification information capable of identifying the content data, and modified content identification information capable of identifying the modified content data;
generating processing history information including the program identification information, the content identification information, and the changed content identification information;
Perform the recording method. The control unit of the terminal device
obtaining a certified program certified by an issuer;
acquiring content data to be processed;
using the authenticated program to perform a predetermined process on the content data to generate modified content data;
generating program identification information capable of identifying the authenticated program, content identification information capable of identifying the content data, and modified content identification information capable of identifying the modified content data;
generating processing history information including the program identification information, the content identification information, and the changed content identification information;
A program that executes.