WO2024189872A1 - Communication control device, communication system, communication control method, and program - Google Patents

Abstract

To enable reliable transmission of video images from a relay device to a communication control device (1), the communication control device (1) comprises: a reception means (11) that receives a plurality of video images captured by a plurality of video image capturing devices at each point and traffic information indicating traffic conditions at each point; an acquisition means (12) that acquires importance information indicating importance of the video images at each point and determined on the basis of the traffic information or the number of views of the plurality of video images at each point, and communication band information between the reception means (11) and a relay device for relaying the plurality of video images at each point; and a determination means (13) that determines the maximum bit rate of the plurality of video image capturing devices on the basis of the importance information and the communication band information.

Description

COMMUNICATION CONTROL DEVICE, COMMUNICATION SYSTEM, COMMUNICATION CONTROL METHOD, AND PROGRAM

The present invention relates to a communication control device, a communication system, a communication control method, and a program.

　There have traditionally been systems that place cameras around town, for example at intersections, to capture and monitor images of the city. Such systems are configured to place multiple cameras adjacent to each other, allowing for comprehensive video monitoring. In addition, the images captured by the cameras are organized in a tree structure that is aggregated at a main station via relay stations.

Patent Document 1 discloses that an imaging device captures images of vehicles and people passing on a road at a predetermined frame rate, transmits the generated images to a control device, and the control device processes the images acquired from the imaging device to detect the occurrence of a predetermined event (specific event). Patent Document 1 also discloses that an image processing unit identifies the type of traffic violation, and generates an importance level by reading an importance level according to this type from an information storage unit.

International Publication No. 2022/219848

In the case of a system in which cameras are placed at intersections as described above to capture and monitor images of the city, the upper limit of the video that can be transmitted is determined by the bandwidth between the relay station and the main station. Therefore, if there is not enough bandwidth between the relay station and the main station, there is a possibility that the video transmission between the relay station and the main station will be significantly delayed.

Furthermore, with the quality of camera footage improving and the number of cameras in town increasing, it is currently difficult to secure a bandwidth level that can transmit all camera footage in high quality. Even if it were possible, it would be extremely costly. Such problems cannot be solved even by using the technology disclosed in Patent Document 1.

One aspect of the present invention was made in consideration of the above problems, and aims to provide a technology that can reliably transmit video from a relay station (relay device) to a main station (communication control device).

A communication control device according to one embodiment of the present invention includes a receiving means for receiving a plurality of images captured by a plurality of video capture devices at each point and traffic information indicating traffic conditions at each of the points, an acquiring means for acquiring importance information indicating the importance of the images at each point determined based on the traffic information or the number of viewers of the plurality of images at each point, and communication bandwidth information between the receiving means and a relay device that relays the plurality of images at each point, and a determining means for determining a maximum bit rate for the plurality of video capture devices based on the importance information and the communication bandwidth information.

A communication system according to one embodiment of the present invention is a communication system including a plurality of video capture devices that capture video at various locations, a relay device that relays the plurality of videos captured by the plurality of video capture devices, and a communication control device that receives the plurality of videos from the relay device, wherein the relay device includes a video capture means for acquiring the plurality of videos captured by the plurality of video capture devices, a first communication means for transmitting the plurality of videos to the communication control device and receiving the maximum bit rate of the plurality of video capture devices from the communication control device, and a setting means for setting the maximum bit rate for the plurality of video capture devices. The communication control device includes a second communication means for receiving the multiple videos and traffic information indicating the traffic conditions at each point from the relay device and transmitting the maximum bit rate of the multiple video capture devices to the relay device, an acquisition means for acquiring importance information indicating the importance of the video at each point determined based on the traffic information or the number of viewers of the multiple videos at each point, and communication bandwidth information between the relay device and the second communication means, and a determination means for determining the maximum bit rate of the multiple video capture devices based on the importance information and the communication bandwidth information.

A communication control method according to one embodiment of the present invention receives multiple images captured by multiple video capture devices at each point and traffic information indicating traffic conditions at each of the points, obtains importance information indicating the importance of the images at each point determined based on the traffic information or the number of viewers of the multiple images at each point, and communication bandwidth information between a relay device that relays the multiple images at each point and a communication control device, and determines the maximum bit rate of the multiple video capture devices based on the importance information and the communication bandwidth information.

A program according to one embodiment of the present invention causes a computer to execute the following processes: receive multiple images captured by multiple video capture devices at each point and traffic information indicating traffic conditions at each of the points; acquire importance information indicating the importance of the images at each point determined based on the traffic information or the number of viewers of the multiple images at each point, and communication bandwidth information between a relay device that relays the multiple images at each point and a communication control device; and determine the maximum bit rate of the multiple video capture devices based on the importance information and the communication bandwidth information.

According to one aspect of the present invention, video transmission from a relay device to a communication control device can be performed reliably.

1 is a block diagram showing an example of the configuration of a communication control device according to a first exemplary embodiment of the present invention; 3 is a flow diagram showing the flow of a communication control method of the communication control device according to the first exemplary embodiment of the present invention. FIG. 2 is a diagram for explaining a sequence of a communication control device according to a first exemplary embodiment of the present invention. 1 is a block diagram showing an example of the configuration of a communication system according to a first exemplary embodiment of the present invention. FIG. 11 is a block diagram showing an example of the configuration of a communication system according to a second exemplary embodiment of the present invention. FIG. 11 is a diagram illustrating an example of incident information. FIG. 11 is a diagram for explaining a sequence of a communication system according to a second exemplary embodiment of the present invention. FIG. 1 is a diagram (part 1) for explaining traffic information and bit rates at each intersection. FIG. 2 is a diagram (part 2) for explaining traffic information and bit rates at each intersection. FIG. 3 is a diagram (part 3) for explaining traffic information and bit rates at each intersection. FIG. 2 is a block diagram showing a configuration of a computer that functions as a communication control device and a relay device according to each exemplary embodiment.

[Example embodiment 1]
<Communication control device 1 according to exemplary embodiment 1>
A first exemplary embodiment of the present invention will be described in detail with reference to the drawings. This exemplary embodiment is a basic form of the exemplary embodiments described later. Note that the drawing reference numbers added to this overview are added to each element for convenience as an example to aid understanding, and are not intended to limit the present invention to the illustrated form. In addition, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional. The unidirectional arrows are intended to show the main signal (data) flow diagrammatically, and do not exclude bidirectionality. In addition, the connection points of the input and output of each block in the figure may be configured to include ports or interfaces, but these configurations are omitted from the illustration.

FIG. 1 is a block diagram showing an example of the configuration of a communication control device 1 according to a first exemplary embodiment of the present invention. As shown in FIG. 1, the communication control device 1 according to this exemplary embodiment includes a receiving means 11, an acquiring means 12, and a determining means 13.

The receiving means 11 receives multiple images captured by multiple video capture devices at each point, and traffic information showing the traffic conditions at each point. A point is a location where vehicles pass, such as an intersection, and is not limited to an intersection, but may be any location where vehicles pass, such as a part of a road.

Multiple video capture devices are placed at each location, and the receiving means 11 receives multiple images captured by the multiple video capture devices at each location. A video capture device is a device capable of capturing video, such as a camera. Hereinafter, a video capture device may be referred to simply as a camera.

The receiving means 11 also receives traffic information indicating the traffic conditions at each point. This traffic information is information indicating the traffic conditions at each point, and includes, for example, information on emergency vehicles, information on runaway vehicles, information on traffic accidents, information on increased traffic volume, etc. The receiving means 11 can receive traffic information, for example, from an externally placed analysis device that analyzes multiple videos. Note that the traffic information may include information on vehicles exhibiting specific behavior, such as vehicles that are swerving or driving in the wrong direction.

The acquisition means 12 acquires importance information indicating the importance of the video at each point, which is determined based on traffic information or the number of viewers of the multiple videos at each point, and communication bandwidth information between the relay device that relays the multiple videos at each point and the receiving means 11.

As mentioned above, traffic information includes information about emergency vehicles, runaway vehicles, traffic accidents, and increased traffic volume, and this information has a preset importance level. Video corresponding to traffic information with a high level of importance is video with a high level of importance. Conversely, video corresponding to traffic information with a low level of importance is video with a low level of importance.

The importance information may also be determined based on the number of views of multiple videos. For example, assume that another device distributes videos at each location, and that the other device tallies the number of views of the videos at each location and provides this information to the communication control device 1. Videos with a large number of views are videos with a high level of importance. Conversely, videos with a small number of views are videos with a low level of importance.

The acquisition means 12 also acquires communication bandwidth information between the relay device that relays multiple videos at each point and the receiving means 11. The communication control device 1 may hold communication bandwidth information for each relay device in advance, or may periodically receive and hold communication bandwidth information from each relay device. This communication bandwidth information may be, for example, the maximum bandwidth between the relay device and the receiving means 11. Also, an estimate of the available bandwidth that is actually available for communication at the present time or several seconds in the future may be used as the communication bandwidth information.

The determination means 13 determines the maximum bit rate for the multiple video imaging devices based on the importance information and the communication bandwidth information. For example, the determination means 13 determines a high maximum bit rate for the multiple video imaging devices that transmit video with high importance information, and a low maximum bit rate for the multiple video imaging devices that transmit video with low importance information, within a range that does not exceed the communication bandwidth information (maximum bandwidth).

The same maximum bit rate may be set for multiple video capture devices at each location, or different maximum bit rates may be set for each video capture device. For example, if four video capture devices are placed at a certain location, different maximum bit rates may be set for the four video capture devices as appropriate so that the sum of the maximum bit rates of the four video capture devices is the same.

<Effects of the communication control device 1>
As described above, according to the communication control device 1 according to this exemplary embodiment, the determination means 13 determines the maximum bit rate of the multiple video imaging devices based on the importance information and the communication bandwidth information. Therefore, it is possible to determine the maximum bit rate of the multiple video imaging devices according to the importance information within the range of the communication bandwidth information (maximum bandwidth) between the relay device and the communication control device 1, and it is possible to reliably transmit video from the relay device to the communication control device 1.

<Flow of communication control method S1 by communication control device 1>
The flow of the communication control method executed by the communication control device 1 configured as above will be described with reference to Fig. 2. Fig. 2 is a flow diagram showing the flow of the communication control method. As shown in Fig. 2, the communication control method S1 includes steps S11 to S13.

First, the receiving means 11 receives a plurality of images captured by a plurality of image capturing devices at each point, and traffic information showing the traffic conditions at each point (S11). A point is a place where vehicles pass, such as an intersection, and is not limited to an intersection, but may be any place where vehicles pass, such as a part of a road.

Next, the acquisition means 12 acquires importance information indicating the importance of the video at each point, which is determined based on traffic information or the number of viewers of the multiple videos at each point, and communication bandwidth information between the relay device that relays the multiple videos at each point and the communication control device (S12).

Finally, the determination means 13 determines the maximum bit rates for the multiple video imaging devices based on the importance information and the communication bandwidth information (S13). For example, the determination means 13 determines a high maximum bit rate for the multiple video imaging devices that transmit video with high importance information, and a low maximum bit rate for the multiple video imaging devices that transmit video with low importance information, within a range that does not exceed the communication bandwidth information (maximum bandwidth).

FIG. 3 is a diagram for explaining the sequence of the communication control device 1 according to this exemplary embodiment. First, a plurality of images are transmitted from a plurality of video imaging devices arranged at point 1 (S21), and a plurality of images are transmitted from a plurality of video imaging devices arranged at point 2 (S22). At this time, the plurality of video imaging devices arranged at point 1 and the plurality of video imaging devices arranged at point 2 transmit images at an initial bit rate. The initial bit rate is set within a range in which the sum of the initial bit rates does not exceed the maximum bandwidth between the relay device and the communication control device 1.

The communication control device 1 receives traffic information indicating the traffic conditions at each point, and acquires importance information indicating the importance of the video at each point determined based on the traffic information or the number of viewers of the multiple videos at each point, and communication bandwidth information between the relay device that relays the multiple videos at each point and the receiving means 11 (S23).

Then, the communication control device 1 determines the maximum bit rate of the multiple video imaging devices based on the importance information and the communication bandwidth information (S24). The communication control device 1 then notifies the multiple video imaging devices at point 2 of the maximum bit rate (S25), and notifies the multiple video imaging devices at point 1 of the maximum bit rate (S26).

When the multiple video capture devices at point 2 receive the maximum bit rate from the communication control device 1, they change their bit rate settings (S27). Similarly, when the multiple video capture devices at point 1 receive the maximum bit rate from the communication control device 1, they change their bit rate settings (S28).

<Effects of communication control method S1>
As described above, according to the communication control method S1 of the communication control device 1 according to this exemplary embodiment, the determination means 13 determines the maximum bit rate of the multiple video imaging devices based on the importance information and the communication bandwidth information. Therefore, it is possible to determine the maximum bit rate of the multiple video imaging devices according to the importance information within the range of the communication bandwidth information (maximum bandwidth) between the relay device and the communication control device 1, and it is possible to reliably transmit video from the relay device to the communication control device 1.

<Communication system 100 according to exemplary embodiment 1>
Fig. 4 is a block diagram showing a configuration example of a communication system 100 according to a first exemplary embodiment of the present invention. As shown in Fig. 4, the communication system 100 according to this exemplary embodiment includes a communication control device 1A, video imaging devices 2-1-1 to 2-1-4 arranged at a point 1, video imaging devices 2-2-1 to 2-2-4 arranged at a point 2, video imaging devices 2-n-1 to 2-n-4 arranged at a point n, and relay devices 3-1 to 3-n. Note that n is an integer of 2 or more.

Relay device 3-1 receives multiple videos from video capture devices 2-1-1 to 2-1-4 located at point 1 and relays the multiple videos to communication control device 1A via network N. Relay device 3-2 receives multiple videos from video capture devices 2-2-1 to 2-2-4 located at point 2 and relays the multiple videos to communication control device 1A via network N. Similarly, relay device 3-n receives multiple videos from video capture devices 2-n-1 to 2-n-4 located at point n and relays the multiple videos to communication control device 1A via network N.

The relay device 3-1 includes a video acquisition means 31, a first communication means 32, and a setting means 33. The relay devices 3-2 to 3-n have the same configuration as the relay device 3-1. The video acquisition means 31 acquires multiple videos captured by multiple video capture devices 2-1-1 to 2-1-4.

The first communication means 32 transmits multiple images captured by multiple image capture devices 2-1-1 to 2-1-4 to the communication control device 1A, and receives the maximum bit rates of the multiple image capture devices 2-1-1 to 2-1-4 from the communication control device 1A.

When the setting means 33 receives the maximum bit rates of the multiple video imaging devices 2-1-1 to 2-1-4 from the communication control device 1A, it sets the maximum bit rates for the multiple video imaging devices 2-1-1 to 2-1-4.

The communication control device 1A includes a second communication means 11A, an acquisition means 12, and a determination means 13. The second communication means 11A receives multiple images and traffic information indicating the traffic conditions at each point 1 to n from the relay devices 3-1 to 3-n, and transmits the maximum bit rates of the multiple image capture devices 2-1-1 to 2-1-4, 2-2-1 to 2-2-4, and 2-n-1 to 2-n-4 to the relay devices 3-1 to 3-n.

The acquisition means 12 acquires importance information indicating the importance of the video at each of the points 1 to n, which is determined based on traffic information at each of the points 1 to n or the number of viewers of the multiple videos at each of the points 1 to n, and communication bandwidth information between the relay devices 3-1 to 3-n and the second communication means 11A.

The determination means 13 determines the maximum bit rate of the multiple video capture devices 2-1-1 to 2-1-4, 2-2-1 to 2-2-4, and 2-n-1 to 2-n-4 based on the importance information and communication bandwidth information.

<Advantages of communication system 100>
As described above, according to the communication system 100 of this exemplary embodiment, the determination means 13 of the communication control device 1A determines the maximum bit rate of the multiple video imaging devices 2-1-1 to 2-1-4, 2-2-1 to 2-2-4, and 2-n-1 to 2-n-4 based on the importance information and the communication bandwidth information. Therefore, within the range of the communication bandwidth information (maximum bandwidth) between the relay devices 3-1 to 3-n and the communication control device 1A, the maximum bit rate of the multiple video imaging devices 2-1-1 to 2-1-4, 2-2-1 to 2-2-4, and 2-n-1 to 2-n-4 according to the importance information can be determined, and video transmission from the relay devices 3-1 to 3-n to the communication control device 1A can be reliably performed.

Exemplary embodiment 2
<Configuration Example of Communication System 100A According to Exemplary Embodiment 2>
5 is a diagram showing a configuration of a communication system 100A according to a second exemplary embodiment of the present invention. The communication system 100A according to this exemplary embodiment includes a communication control device 1A, video imaging devices 2-1-1 to 2-1-4 arranged at an intersection 1, video imaging devices 2-2-1 to 2-2-4 arranged at an intersection 2, video imaging devices 2-n-1 to 2-n-4 arranged at an intersection n, relay devices 3-1 to 3-m, and MECs (Multi-access Edge Computing) 4-1 to 4-n. Note that m is an integer of 2 or more. Also, n is an integer of 2 or more.

MEC4-1 to 4-n are components that realize the analysis device in this exemplary embodiment. Note that the following will explain the case of an intersection as an example of a location.

MEC 4-1 receives multiple images from video capture devices 2-1-1 to 2-1-4 installed at intersection 1 and relays the multiple images to relay device 3-1. MEC 4-1 also analyzes the multiple images from video capture devices 2-1-1 to 2-1-4 and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1.

MEC 4-2 receives multiple images from video capture devices 2-2-1 to 2-2-4 installed at intersection 2 and relays the multiple images to relay device 3-1. MEC 4-2 also analyzes the multiple images from video capture devices 2-2-1 to 2-2-4 and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1.

MEC 4-3 receives multiple images from video capture devices 2-3-1 to 2-3-4 installed at intersection 3, and relays the multiple images to relay device 3-1. MEC 4-3 also analyzes the multiple images from video capture devices 2-3-1 to 2-3-4, and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1. The same applies to MEC 4-n.

The communication control device 1A may have the same functions as MEC 4-1 to 4-n, analyze multiple images received via network N, and generate traffic information for each intersection. In this case, MEC 4-1 to 4-n may be omitted.

　Relay device 3-1 receives multiple videos from MECs 4-1 to 4-3 and relays the multiple videos to communication control device 1A via network N. Note that relay devices 3-1 to 3-m have the same configuration and functions as relay devices 3-1 to 3-n described in exemplary embodiment 1.

MECs 4-1 to 4-n, for example, analyze multiple images from multiple video capture devices and generate incident information indicating that the traffic situation at each intersection is worsening as traffic information. Importance information is determined based on the incident information at each intersection.

FIG. 6 is a diagram showing an example of incident information. Incident information is, for example, information regarding the occurrence of an accident, information regarding an ambulance (emergency vehicle) or a runaway vehicle, information regarding increased traffic volume, etc. FIG. 6 shows that information regarding the occurrence of an accident has the highest priority of "5," information regarding an ambulance (emergency vehicle) or a runaway vehicle has a priority of "4," and information regarding increased traffic volume has a priority of "3," but this is not limited to this.

MEC 4-1 to 4-n may, for example, perform object recognition on multiple images to detect vehicles and traffic lights. MEC 4-1 to 4-n may then determine that an accident has occurred if one or multiple vehicles are stopped on the road for a predetermined period of time or longer even though the traffic light is green. MEC 4-1 to 4-n may also determine that an accident has occurred if a vehicle is stopped on the road for a predetermined period of time in a direction different from the direction in which the road extends.

In addition, MEC 4-1 to 4-n may perform object recognition on multiple images, for example, to detect the vehicle models of each vehicle. If an ambulance (emergency vehicle) is included among the vehicles, MEC 4-1 to 4-n may generate information about the ambulance (emergency vehicle) as incident information.

In addition, MEC 4-1 to 4-n may perform object recognition on multiple images to detect vehicles and traffic lights, for example. If a vehicle is traveling despite the traffic light being red, MEC 4-1 to 4-n may generate information about the out-of-control vehicle as incident information. In addition, MEC 4-1 to 4-n may determine that a vehicle traveling at a speed exceeding the speed limit by a specified amount is an out-of-control vehicle.

In addition, the MECs 4-1 to 4-n may perform object recognition on multiple images to detect vehicles. If the number of vehicles at an intersection is equal to or greater than a predetermined number, the MECs 4-1 to 4-n may generate information related to an increase in traffic volume as incident information.

In addition, when MEC 4-1 to 4-n detect an ambulance (emergency vehicle) or out-of-control vehicle, it may detect the vehicle's position information, or may detect the vehicle's direction of travel by detecting the difference in the image for each frame. MEC 4-1 to 4-n transmits the detected incident information, position information or direction of travel of the ambulance (emergency vehicle) or out-of-control vehicle, etc. to the communication control device 1A.

The second communication means 11A of the communication control device 1A receives multiple images captured by multiple video capture devices at intersections 1 to n, and traffic information (incident information) showing the traffic conditions at intersections 1 to n. If the incident information is information about an ambulance (emergency vehicle) or runaway vehicle, the second communication means 11A also receives the position information or direction of travel of that vehicle.

The acquisition means 12 acquires importance information indicating the importance of the video at each intersection 1-n, which is determined based on traffic information or the number of viewers of the multiple videos at the intersections, and communication bandwidth information between the communication control device 1A and relay devices 3-1-3-m that relay the multiple videos at the intersections 1-n. For example, the acquisition means 12 extracts importance information corresponding to incident information by referring to the table shown in FIG. 6.

The determination means 13 determines a high maximum bit rate for multiple video capture devices that transmit video with high importance information, and determines a low maximum bit rate for multiple video capture devices that transmit video with low importance information, within a range that does not exceed the communication bandwidth information (maximum bandwidth).

In addition, when the incident information is related to an ambulance (emergency vehicle) or a runaway vehicle, the decision means 13 may identify the intersection ahead based on the vehicle's position information or direction of travel, and set high the importance information for multiple images transmitted from multiple video capture devices positioned at that intersection.

The decision means 13 may also change at least one of the resolution and frame rate of the multiple video capture devices based on the incident information. For example, if the incident information is information related to the occurrence of an accident, the decision means 13 may increase the resolution (image quality) of the multiple video capture devices located at the intersection where the accident occurred and decrease the frame rate so that more detailed images are transmitted. The compression rate may also be changed.

Furthermore, if the incident information is information about an ambulance (emergency vehicle) or a runaway vehicle, the decision means 13 may lower the resolution (image quality) of multiple video capture devices placed at the intersection where the vehicle is traveling and increase the frame rate so that an image corresponding to the speed of the vehicle is transmitted. The compression rate may also be changed.

The determination means 13 may also change the frame rate and resolution within a range that is equal to or less than the determined maximum bit rate. In such a configuration, appropriate video can be transmitted while still ensuring reliable video transmission.

FIG. 7 is a diagram for explaining the sequence of a communication system according to a second exemplary embodiment of the present invention. First, MEC 4-1 receives multiple images from video capture devices 2-1-1 to 2-1-4 arranged at intersection 1 and relays the multiple images to relay device 3-1 (S31). MEC 4-2 receives multiple images from video capture devices 2-2-1 to 2-2-4 arranged at intersection 2 and relays the multiple images to relay device 3-1 (S32). MEC 4-3 receives multiple images from video capture devices 2-3-1 to 2-3-4 arranged at intersection 3 and relays the multiple images to relay device 3-1 (S33). Then, relay device 3-1 relays the multiple images relayed by MEC 4-1 to 4-3 to communication control device 1A (S34).

Next, MEC 4-1 analyzes the multiple images from video capture devices 2-1-1 to 2-1-4 (S35) and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1 (S38). MEC 4-2 analyzes the multiple images from video capture devices 2-2-1 to 2-2-4 (S36) and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1 (S39). Similarly, MEC 4-3 analyzes the multiple images from video capture devices 2-3-1 to 2-3-4 (S37) and transmits the analysis results as traffic information to communication control device 1A via relay device 3-1 (S40).

Next, the communication control device 1A receives traffic information for intersections 1-3 and acquires importance information indicating the importance of the video at intersections 1-3 determined based on the traffic information or the number of viewers of multiple videos at the intersections, as well as communication bandwidth information between the communication control device 1A and relay device 3-1, which relays the multiple videos at intersections 1-3 (S41).

Then, the communication control device 1A determines the maximum bit rate for each of the multiple video imaging devices at intersections 1 to 3 based on the importance information and communication bandwidth information (S42). The communication control device 1A then notifies the multiple video imaging devices 2-3-1 to 2-3-4 at intersection 3 of the maximum bit rate (S43), notifies the multiple video imaging devices 2-2-1 to 2-2-4 at intersection 2 of the maximum bit rate (S44), and notifies the multiple video imaging devices 2-1-1 to 2-1-4 at intersection 1 of the maximum bit rate (S45).

The communication control device 1A also determines the resolution and frame rate of each of the multiple video capture devices at intersections 1 to 3 based on the incident information (S46). The communication control device 1A then notifies the multiple video capture devices 2-3-1 to 2-3-4 at intersection 3 of the resolution and frame rate (S47), notifies the multiple video capture devices 2-2-1 to 2-2-4 at intersection 2 of the resolution and frame rate (S48), and notifies the multiple video capture devices 2-1-1 to 2-1-4 at intersection 1 of the resolution and frame rate (S49).

Finally, the multiple video capture devices 2-1-1 to 2-1-4 at intersection 1 change their settings (S50), the multiple video capture devices 2-2-1 to 2-2-4 at intersection 2 change their settings (S51), and the multiple video capture devices 2-3-1 to 2-3-4 at intersection 3 change their settings (S52).

FIGS. 8 to 10 are diagrams for explaining the traffic information and bit rates at each intersection. FIG. 8 shows the traffic information and bit rates at each intersection in the initial state, and indicates that the traffic information at intersections 1 to 3 is in a normal state (a state in which no incident information has occurred). In this case, the initial bit rates of the multiple video imaging devices at intersections 1 to 3 are determined so that the sum of the initial bit rates of the multiple video imaging devices at intersections 1 to 3 does not exceed the maximum bandwidth between relay device 3-1 and communication control device 1A.

In FIG. 8, for example, a maximum bit rate A [bit/s] is set for the video capture devices 2-1-1 to 2-1-4 at intersection 1, a maximum bit rate B [bit/s] is set for the video capture devices 2-2-1 to 2-2-4 at intersection 2, and a maximum bit rate C [bit/s] is set for the video capture devices 2-3-1 to 2-3-4 at intersection 3. It is assumed that A<B<C.

FIG. 9 shows the traffic information and bit rates at each intersection when a traffic accident occurs at intersection 2 and an increase in traffic volume occurs at intersection 3. As shown in FIG. 6, the importance information corresponding to the traffic accident is "5" and the importance information corresponding to the increase in traffic volume is "3", so a high maximum bit rate is set for the video capture devices 2-2-1 to 2-2-4 at intersection 2, and a lower maximum bit rate is set for the video capture devices 2-3-1 to 2-3-4 at intersection 3. As a result, a maximum bit rate C [bit/s] is set for the video capture devices 2-2-1 to 2-2-4 at intersection 2, and a maximum bit rate B [bit/s] is set for the video capture devices 2-3-1 to 2-3-4 at intersection 3.

FIG. 10 shows the traffic information and bit rates for each intersection when a runaway vehicle is traveling at intersection 2 and the direction of travel of the runaway vehicle is intersection 1. Because the runaway vehicle is traveling at intersection 2, a high maximum bit rate is set for the video recording devices 2-2-1 to 2-2-4 at intersection 2, and because the direction of travel of the runaway vehicle is intersection 1, an even higher maximum bit rate is set for the video recording devices 2-1-1 to 2-1-4 at intersection 1. As a result, a maximum bit rate C [bit/s] is set for the video recording devices 2-1-1 to 2-1-4 at intersection 1, and a maximum bit rate B [bit/s] is set for the video recording devices 2-2-1 to 2-2-4 at intersection 2.

When the communication control device 1A notifies the multiple video capture devices at intersections 1 to 3 of the maximum bit rate, it may also notify them of the timing for changing the bit rate.

Also, when changing the bit rate, multiple video capture devices that lower the bit rate may set it first, and multiple video capture devices that increase the bit rate may set it later. This makes it possible to prevent video transmission that exceeds the maximum bandwidth between relay device 3-1 and communication control device 1A.

In addition, when an intersection is added by multiple video capture devices at an intersection that was not transmitting video starting video transmission, the multiple video capture devices located at the added intersection may start video transmission at the initial bit rate. Also, the MEC may notify the communication control device 1A of only the added traffic information, etc., and wait for the maximum bit rate to be allocated by the communication control device 1A. In this case, upon receiving notification that an intersection has been added, the communication control device 1A will change the bit rate allocation for each intersection and notify it.

In addition, if the number of intersections decreases because multiple video capture devices at an intersection that were transmitting video stop transmitting video, the communication control device 1A may detect that video has not been transmitted for a predetermined period of time or more and consider the intersection to be closed. In this way, the communication control device 1A may autonomously determine whether an intersection is closed, or may determine that an intersection is closed based on receiving a notification from the intersection that video transmission has ended. When an intersection is closed, the communication control device 1A may increase the bit rate of an intersection that has a low maximum bit rate, or may redistribute the bit rate to the entire intersection.

<Effects of communication system 100A>
As described above, in the communication system 100A according to the present exemplary embodiment, the MECs 4-1 to 4-n analyze multiple images from multiple image capturing devices and generate, as traffic information, incident information indicating that the traffic situation at each intersection is worsening. Then, the importance information is determined based on the incident information at each intersection. Therefore, the communication control device 1A can increase the maximum bit rate of the multiple image capturing devices arranged at an intersection where the traffic situation is worsening, and obtain clearer images of the intersection.

In addition, since the incident information is information related to an emergency vehicle or an out-of-control vehicle, the communication control device 1A can obtain clearer images of the emergency vehicle or out-of-control vehicle by increasing the maximum bit rate of multiple video capture devices placed at the intersection where the emergency vehicle or out-of-control vehicle is traveling.

In addition, since the importance information is determined by the position information or traveling direction of the emergency vehicle or out-of-control vehicle, the communication control device 1A can increase the maximum bit rate of multiple video capture devices placed at the intersection where the emergency vehicle or out-of-control vehicle is traveling, thereby obtaining clearer video of the emergency vehicle or out-of-control vehicle.

In addition, since incident information is information related to the occurrence of an accident, the communication control device 1A can increase the maximum bit rate of multiple video capture devices placed at the intersection where the accident occurred, thereby obtaining clearer video of the accident scene.

In addition, since the incident information is information related to increased traffic volume, the communication control device 1A can increase the maximum bit rate of multiple video capture devices placed at intersections where traffic volume is increasing, thereby obtaining clearer images of the intersection.

In addition, the decision means 13 of the communication control device 1A changes at least one of the resolution, frame rate, and compression rate of the multiple video capture devices based on the incident information, so that an image of the intersection corresponding to the type of incident information can be obtained.

[Software implementation example]
The functions of the communication control device 1, 1A, relay device 3, MEC 4, and communication system 100, 100A may be partly or entirely realized by hardware such as an integrated circuit (IC chip), or by software.

In the latter case, the communication control devices 1, 1A, relay devices 3, MEC 4, and communication systems 100, 100A are realized, for example, by a computer that executes program instructions, which are software that realizes each function. An example of such a computer (hereinafter referred to as computer C) is shown in FIG. 11. Computer C has at least one processor C1 and at least one memory C2. Memory C2 stores program P for operating computer C as communication control devices 1, 1A, relay devices 3, MEC 4, and communication systems 100, 100A. In computer C, processor C1 reads program P from memory C2 and executes it to realize each function of communication control devices 1, 1A, relay devices 3, MEC 4, and communication systems 100, 100A.

The processor C1 may be, for example, a CPU (Central Processing Unit), GPU (Graphic Processing Unit), DSP (Digital Signal Processor), MPU (Micro Processing Unit), FPU (Floating point number Processing Unit), PPU (Physics Processing Unit), microcontroller, or a combination of these. The memory C2 may be, for example, a flash memory, HDD (Hard Disk Drive), SSD (Solid State Drive), or a combination of these.

Computer C may further include a RAM for expanding program P during execution and for temporarily storing various data. Computer C may further include a communications interface for sending and receiving data to and from other devices. Computer C may further include an input/output interface for connecting input/output devices such as a keyboard, mouse, display, and printer.

The program P can also be recorded on a non-transitory, tangible recording medium M that can be read by the computer C. Such a recording medium M can be, for example, a tape, a disk, a card, a semiconductor memory, or a programmable logic circuit. The computer C can obtain the program P via such a recording medium M. The program P can also be transmitted via a transmission medium. Such a transmission medium can be, for example, a communications network or broadcast waves. The computer C can also obtain the program P via such a transmission medium.

[Additional Note 1]
The present invention is not limited to the above-described embodiment, and various modifications are possible within the scope of the claims. For example, embodiments obtained by appropriately combining the technical means disclosed in the above-described embodiment are also included in the technical scope of the present invention.

[Additional Note 2]
Some or all of the above-described embodiments can be described as follows. However, the present invention is not limited to the aspects described below.

(Appendix 1)
A receiving means for receiving a plurality of images captured by a plurality of image capturing devices at each point and traffic information indicating traffic conditions at each point;
an acquisition means for acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the multiple videos at each of the locations, and communication bandwidth information between a relay device that relays the multiple videos at each of the locations and the receiving means;
a determination means for determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
A communication control device comprising:

The above configuration makes it possible to determine the maximum bit rate of multiple video capture devices according to the importance information within the range of the communication bandwidth information between the relay device and the communication control device, and ensures reliable video transmission from the relay device to the communication control device.

(Appendix 2)
The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
2. The communication control device of claim 1.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices located at locations where traffic conditions are deteriorating, thereby obtaining clearer images of the locations.

(Appendix 3)
The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
3. The communication control device of claim 2.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at locations where emergency vehicles, out-of-control vehicles, or vehicles exhibiting specific behavior are traveling, thereby obtaining clearer images of the emergency vehicles or out-of-control vehicles.

(Appendix 4)
The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
4. The communication control device of claim 3.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at the location where an emergency vehicle, out-of-control vehicle, or vehicle exhibiting a specific behavior is traveling, thereby obtaining clearer video of the emergency vehicle or out-of-control vehicle.

(Appendix 5)
The incident information is information regarding an accident occurrence.
3. The communication control device of claim 2.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at the location where the accident occurred, thereby obtaining clearer video of the accident scene.

(Appendix 6)
The incident information is information regarding an increase in traffic volume.
3. The communication control device of claim 2.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at locations where traffic volume is high, thereby obtaining clearer images of the locations.

(Appendix 7)
the determining means changes at least one of a resolution, a frame rate, and a compression rate of the plurality of video photographing devices based on the incident information.
7. A communication control device according to any one of claims 2 to 6.

With the above configuration, the communication control device can acquire video of a location that corresponds to the type of incident information.

(Appendix 8)
A communication system including a plurality of video capture devices that capture video at each location, a relay device that relays the plurality of videos captured by the plurality of video capture devices, and a communication control device that receives the plurality of videos from the relay device,
The relay device is
an image acquisition means for acquiring a plurality of images captured by the plurality of image capturing devices;
a first communication means for transmitting the plurality of images to the communication control device and receiving a maximum bit rate of the plurality of image capturing devices from the communication control device;
a setting unit for setting the maximum bit rate for the plurality of video imaging devices,
The communication control device includes:
a second communication means for receiving the plurality of images and traffic information indicating traffic conditions at each of the points from the relay device, and transmitting the maximum bit rate of the plurality of image capturing devices to the relay device;
an acquisition means for acquiring importance information indicating the importance of the video at each of the locations determined based on the traffic information or the number of viewers of the plurality of videos at each of the locations, and communication bandwidth information between the relay device and the second communication means;
a determination means for determining the maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information,
Communication systems.

The above configuration makes it possible to determine the maximum bit rate of multiple video capture devices according to the importance information within the range of the communication bandwidth information between the relay device and the communication control device, and ensures reliable video transmission from the relay device to the communication control device.

(Appendix 9)
The communication system further includes an analysis device that analyzes the plurality of videos and transmits an analysis result as the traffic information to the communication control device.
9. The communication system of claim 8.

(Appendix 10)
The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
10. The communication system of claim 8 or 9.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices located at locations where traffic conditions are deteriorating, thereby obtaining clearer images of the locations.

(Appendix 11)
The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
11. The communication system of claim 10.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at locations where emergency vehicles, out-of-control vehicles, or vehicles exhibiting specific behavior are traveling, thereby obtaining clearer images of the emergency vehicles or out-of-control vehicles.

(Appendix 12)
The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
12. The communication system of claim 11.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at the location where an emergency vehicle, out-of-control vehicle, or vehicle exhibiting a specific behavior is traveling, thereby obtaining clearer video of the emergency vehicle or out-of-control vehicle.

(Appendix 13)
The incident information is information regarding an accident occurrence.
11. The communication system of claim 10.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at the location where the accident occurred, thereby obtaining clearer video of the accident scene.

(Appendix 14)
The incident information is information regarding an increase in traffic volume.
11. The communication system of claim 10.

With the above configuration, the communication control device can increase the maximum bit rate of multiple video capture devices placed at locations where traffic volume is high, thereby obtaining clearer images of the locations.

(Appendix 15)
the determining means changes at least one of a resolution, a frame rate, and a compression rate of the plurality of video photographing devices based on the incident information.
15. A communication system according to any one of appendixes 10 to 14.

With the above configuration, the communication control device can acquire video of a location that corresponds to the type of incident information.

(Appendix 16)
receiving a plurality of images captured by a plurality of image capturing devices at each point and traffic information indicating traffic conditions at each of the points;
acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the plurality of videos at each of the locations, and communication bandwidth information between a relay device that relays the plurality of videos at each of the locations and a communication control device;
determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
Communications control method.

The above configuration makes it possible to determine the maximum bit rate of multiple video capture devices according to the importance information within the range of the communication bandwidth information between the relay device and the communication control device, and ensures reliable video transmission from the relay device to the communication control device.

(Appendix 17)
The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
17. A communication control method as described in claim 16.

With the above configuration, the maximum bit rate of multiple video capture devices placed at locations where traffic conditions are deteriorating can be increased, making it possible to obtain clearer images of the locations.

(Appendix 18)
The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
18. A communication control method as described in claim 17.

With the above configuration, it is possible to increase the maximum bit rate of multiple video capture devices placed at locations where emergency vehicles, out-of-control vehicles, or vehicles exhibiting specific behavior are traveling, thereby making it possible to obtain clearer images of the emergency vehicles or out-of-control vehicles.

(Appendix 19)
The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
19. A communication control method as described in claim 18.

With the above configuration, the maximum bit rate of multiple video capture devices placed at the location where an emergency vehicle, out-of-control vehicle, or vehicle exhibiting a specific behavior is traveling can be increased, making it possible to obtain clearer video of the emergency vehicle or out-of-control vehicle.

(Appendix 20)
The incident information is information regarding an accident occurrence.
18. A communication control method as described in claim 17.

With the above configuration, the maximum bit rate of multiple video capture devices placed at the location where the accident occurred can be increased, making it possible to obtain clearer video of the accident scene.

(Appendix 21)
The incident information is information regarding an increase in traffic volume.
18. A communication control method as described in claim 17.

The above configuration allows the maximum bit rate of multiple video capture devices placed at locations where traffic volume is high to be increased, making it possible to capture clearer images of the locations.

(Appendix 22)
In the process of determining, at least one of a resolution, a frame rate, and a compression rate of the plurality of video imaging devices is changed based on the incident information.
A communication control method according to any one of appendixes 17 to 21.

The above configuration makes it possible to obtain video of a location that corresponds to the type of incident information.

(Appendix 23)
On the computer,
receiving a plurality of images captured by a plurality of image capturing devices at each of the locations and traffic information indicating traffic conditions at each of the locations;
A process of acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the multiple videos at each of the locations, and communication bandwidth information between a relay device that relays the multiple videos at each of the locations and a communication control device;
determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
A program that executes the following.

The above configuration makes it possible to determine the maximum bit rate of multiple video capture devices according to the importance information within the range of the communication bandwidth information between the relay device and the communication control device, and ensures reliable video transmission from the relay device to the communication control device.

(Appendix 24)
At least one processor, the processor comprising:
receiving a plurality of images captured by a plurality of image capturing devices at each of the locations and traffic information indicating traffic conditions at each of the locations;
A process of acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the multiple videos at each of the locations, and communication bandwidth information between a relay device that relays the multiple videos at each of the locations and a communication control device;
determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
A communication control device that executes the above.

The communication control device may further include a memory, and the memory may store a program for causing the processor to execute the receiving process, the acquiring process, and the determining process. The program may also be recorded on a computer-readable, non-transitory, tangible recording medium.

1, 1A Communication control device (control center)
2 Video shooting device 3 Relay device 4 MEC
11 Receiving means 11A Second communication means 12 Acquiring means 13 Deciding means 31 Image acquiring means 32 First communication means 33 Setting means 100, 100A Communication system

Claims (23)

A receiving means for receiving a plurality of images captured by a plurality of image capturing devices at each point and traffic information indicating traffic conditions at each point;
an acquisition means for acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the multiple videos at each of the locations, and communication bandwidth information between a relay device that relays the multiple videos at each of the locations and the receiving means;
a determination means for determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
A communication control device comprising: The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
The communication control device according to claim 1 . The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
The communication control device according to claim 2. The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
The communication control device according to claim 3. The incident information is information regarding an accident occurrence.
The communication control device according to claim 2. The incident information is information regarding an increase in traffic volume.
The communication control device according to claim 2. the determining means changes at least one of a resolution, a frame rate, and a compression rate of the plurality of video photographing devices based on the incident information.
The communication control device according to any one of claims 2 to 6. A communication system including a plurality of video capture devices that capture video at each location, a relay device that relays the plurality of videos captured by the plurality of video capture devices, and a communication control device that receives the plurality of videos from the relay device,
The relay device is
an image acquisition means for acquiring a plurality of images captured by the plurality of image capturing devices;
a first communication means for transmitting the plurality of images to the communication control device and receiving a maximum bit rate of the plurality of image capturing devices from the communication control device;
a setting unit for setting the maximum bit rate for the plurality of video imaging devices,
The communication control device includes:
a second communication means for receiving the plurality of images and traffic information indicating traffic conditions at each of the points from the relay device, and transmitting the maximum bit rate of the plurality of image capturing devices to the relay device;
an acquisition means for acquiring importance information indicating the importance of the video at each of the locations determined based on the traffic information or the number of viewers of the plurality of videos at each of the locations, and communication bandwidth information between the relay device and the second communication means;
a determination means for determining the maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information,
Communication systems. The communication system further includes an analysis device that analyzes the plurality of videos and transmits an analysis result as the traffic information to the communication control device.
9. The communication system according to claim 8. The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
A communication system according to claim 8 or 9. The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
The communication system according to claim 10. The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
12. The communication system of claim 11. The incident information is information regarding an accident occurrence.
The communication system according to claim 10. The incident information is information regarding an increase in traffic volume.
The communication system according to claim 10. the determining means changes at least one of a resolution, a frame rate, and a compression rate of the plurality of video photographing devices based on the incident information.
The communication system according to claim 10. receiving a plurality of images captured by a plurality of image capturing devices at each point and traffic information indicating traffic conditions at each of the points;
acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the plurality of videos at each of the locations, and communication bandwidth information between a relay device that relays the plurality of videos at each of the locations and a communication control device;
determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
Communications control method. The traffic information is incident information indicating that traffic conditions at each of the points are deteriorating,
The importance information is determined based on the incident information at each of the locations.
The communication control method according to claim 16. The incident information is information regarding an emergency vehicle, a runaway vehicle, or a vehicle exhibiting a specific behavior.
The communication control method according to claim 17. The importance information is determined based on position information or a traveling direction of the emergency vehicle, the out-of-control vehicle, or the vehicle exhibiting the specific behavior.
The communication control method according to claim 18. The incident information is information regarding an accident occurrence.
The communication control method according to claim 17. The incident information is information regarding an increase in traffic volume.
The communication control method according to claim 17. In the process of determining, at least one of a resolution, a frame rate, and a compression rate of the plurality of video imaging devices is changed based on the incident information.
The communication control method according to claim 17. On the computer,
receiving a plurality of images captured by a plurality of image capturing devices at each of the locations and traffic information indicating traffic conditions at each of the locations;
A process of acquiring importance information indicating the importance of the video at each of the locations, which is determined based on the traffic information or the number of viewers of the multiple videos at each of the locations, and communication bandwidth information between a relay device that relays the multiple videos at each of the locations and a communication control device;
determining a maximum bit rate of the plurality of video imaging devices based on the importance information and the communication bandwidth information;
A program that executes the following.

Images