WO2025173058A1 - Offload control device, offload control method, and offload control program - Google Patents

Abstract

An offload control unit (24) controls whether to execute a target task in an external processing device upon arriving at a time preceding a reference time at which a time slot starts, the time slot corresponding to the data type of input data of the target task in time-division communication in which time slots available for communication are determined according to data type. The offload control unit (24) controls whether to execute the target task in the external processing device on the basis of the time remaining until a deadline of the target task, a predicted internal time that is the predicted execution time when the target task is executed by an internal processing device, and a predicted external time that is the predicted execution time when the target task is executed by the external processing device.

Description

Off-road control device, off-road control method, and off-road control program

This disclosure relates to a task allocation technique using an external computing device.

Patent Document 1 describes how tasks are assigned to processor cores taking into consideration the task execution order, task execution period, and communication costs between processor cores. In this way, Patent Document 1 aims to meet the deadlines of each task.

Japanese Patent Application Laid-Open No. 2015-225396

The technology described in Patent Document 1 can control task allocation within a processor core within a CPU. CPU stands for Central Processing Unit. However, the technology described in Patent Document 1 does not take into account control including external computing devices. In particular, the technology described in Patent Document 1 cannot optimize computing device allocation or reduce allocation-related processing delays in order to meet each task's deadline in an environment where it is unknown when input data will be available.

In an external computing device such as a GPU, even if a high-priority task becomes ready to run, it may be delayed until a previously running task is completed. GPU stands for Graphics Processing Unit. This delay can result in missed deadlines.
One solution to this problem is to restrict the use of the target external computing device by other tasks. However, if the timing of acquisition of input data for the target task is unknown, it is also impossible to determine when the external computing device will be used for calculations using the input data. This means that the use of the target external computing device will be restricted for a long period of time. This is inefficient in terms of computing resource utilization, and may result in the time it takes for other tasks to complete processing being extended, resulting in missed deadlines.

Furthermore, when using an external computing device such as a GPU, pre-processing is required before the target task can be executed, such as allocating memory on the external computing device and transferring data to that memory. If the timing of input data acquisition is known, the timing of task execution can be determined. Therefore, performing pre-processing immediately before execution can be considered to shorten the time it takes to complete task processing. Note that the data transferred in this data transfer is data other than the input data. However, if the timing of input data acquisition is unknown, pre-processing cannot be performed immediately before task execution. If pre-processing is performed in advance without considering the timing of task execution, it could lead to memory pressure on the external computing device, making it impossible to execute other tasks.

The purpose of this disclosure is to make it possible to allocate tasks to computing devices, including external computing devices, in a way that makes it easier to meet task deadlines.

The off-road control device according to the present disclosure includes:
a predicted time management unit that manages a predicted internal time, which is a predicted execution time when a target task is executed in an internal computing device, and a predicted external time, which is a predicted execution time when the target task is executed in an external computing device;
an offload control unit that controls whether to cause the external computing device to execute the target task based on the remaining time until the deadline of the target task at a point in time before a reference time at which a time slot corresponding to the data type of input data of the target task starts in time division communication in which time slots available for communication are determined according to data type, and the predicted internal time and the predicted external time managed by the predicted time management unit.

In this disclosure, whether or not to have an external computing device execute a target task is controlled using the remaining time until the deadline of the target task at the point before the reference time at which the time slot corresponding to the data type of input data starts, the predicted internal time, and the predicted external time. This makes it possible to assign tasks to computing devices, including external computing devices, in a way that makes it easier for task deadlines to be met.

FIG. 1 is a hardware configuration diagram of an off-road control device 10 according to a first embodiment. FIG. 1 is a functional configuration diagram of an off-road control device 10 according to a first embodiment. 3 is a flowchart of the overall processing of the off-road control device 10 according to the first embodiment. 4 is a flowchart of a first control process according to the first embodiment. 10 is a flowchart of a second control process according to the first embodiment. 10 is a flowchart of a third control process according to the first embodiment. 10 is a flowchart of a first control process according to the second embodiment. 10 is a flowchart of a second control process according to the second embodiment. 10 is a flowchart of a third control process according to the second embodiment. 11 is a flowchart of a first control process according to the third embodiment. 10 is a flowchart of the overall processing of the off-road control device 10 according to the fourth embodiment.

Embodiment 1.
***Configuration Description***
The hardware configuration of an off-road control device 10 according to the first embodiment will be described with reference to FIG.
The off-road control device 10 is a computer.
The off-road control device 10 includes the following hardware: an internal calculation unit 11, a memory 12, a storage device 13, and an external calculation unit 14.

The internal processing unit 11 is a processing unit that mainly performs processing. A specific example of the internal processing unit 11 is a CPU.

Memory 12 is a main storage device used as a work area for the internal processing unit 11. A specific example of memory 12 is RAM. RAM stands for Random Access Memory.

The storage device 13 is a storage device that stores program images such as an OS and application programs. OS is an abbreviation for Operating System. Specific examples of the storage device 13 include an SSD or HDD. SSD is an abbreviation for Solid State Drive. HDD is an abbreviation for Hard Disk Drive.
The storage device 13 may be a portable recording medium such as an SD (registered trademark) memory card, CompactFlash (registered trademark), NAND flash, a flexible disk, an optical disk, a compact disk, a Blu-ray (registered trademark) disk, or a DVD. SD stands for Secure Digital. DVD stands for Digital Versatile Disk.

The external processing unit 14 is a processing unit provided separately from the internal processing unit 11. A specific example of the external processing unit 14 is a GPU.

The functional configuration of the off-road control device 10 according to the first embodiment will be described with reference to FIG.
The offload control device 10 includes, as functional components, a communication management unit 21, a deadline management unit 22, a predicted time management unit 23, and an offload control unit 24. The functions of each of the functional components of the offload control device 10 are realized by software.
The storage device 13 stores programs that implement the functions of each functional component of the off-road control device 10. These programs are read into the memory 12 by the internal processing device 11 and executed by the internal processing device 11. In this way, the functions of each functional component of the off-road control device 10 are implemented.

In Figure 1, only one internal processing unit 11 is shown. However, there may be multiple internal processing units 11, and the multiple internal processing units 11 may work together to execute programs that realize each function.

***Explanation of Operation***
The operation of the off-road control device 10 according to the first embodiment will be described with reference to FIGS.
The operation procedure of the off-road control device 10 according to the first embodiment corresponds to the off-road control method according to the first embodiment. Furthermore, the program that realizes the operation of the off-road control device 10 according to the first embodiment corresponds to the off-road control program according to the first embodiment.

Here, we assume that the environment uses time-division communication, where available time slots are determined according to the data type. Therefore, task input data is only obtained in the time slot that corresponds to the data type of that input data. However, it is not known when the task input data will be available.

The overall processing of the off-road control device 10 according to the first embodiment will be described with reference to FIG.
(Step S101: Communication management process)
The communication management unit 21 manages time information of communication time slots corresponding to the data type of input data of each task in time-division communication. The offload control unit 24 acquires time information of time slots corresponding to the data type of input data of a target task from the communication management unit 21. The time slot corresponding to the data type of input data is called a target slot.
The communication management unit 21 waits until the reference time of the start time of the time slot indicated by the time information. In other words, the communication management unit 21 waits until the reference time of the start time of the target slot. Then, the communication management unit 21 proceeds to step S102 when the reference time of the start time of the target slot arrives. The reference time is a time set in advance. For example, the reference time is set to a time during which it is permitted to restrict the use of the external computing device 14 for other tasks.

(Step S102: Information Acquisition Processing (Deadline Management Processing, Predicted Time Management Processing))
The deadline management unit 22 manages the time remaining until the deadline of each task. The offload control unit 24 obtains the time remaining until the deadline of the target task from the deadline management unit 22. In other words, the offload control unit 24 obtains the time remaining until the deadline of the target task at a point in time before the reference time at which the target slot starts.
The predicted time management unit 23 manages predicted internal time, which is the predicted execution time when the target task is executed by the internal computing device 11, and predicted external time, which is the predicted execution time when the target task is executed by the external computing device 14. The offload control unit 24 obtains the predicted internal time and the predicted external time from the predicted time management unit 23.

(Step S103: Off-road control processing)
The offload control unit 24 determines an execution method for the target task when input data for the target task is acquired in the target slot, based on the remaining time acquired in step S102, the predicted internal time, and the predicted external time.
Specifically, the offload control unit 24 controls whether or not to cause the external computing device 14 to execute the target task. Furthermore, when the offload control unit 24 causes the external computing device 14 to execute the target task, the offload control unit 24 controls whether or not to allow the external computing device 14 to be used by a task different from the target task.

In the first embodiment, the description is based on the assumption that the predicted external time is shorter than the predicted internal time. Under this assumption, the offload control unit 24 determines to have the external computing device 14 execute the target task when the predicted internal time is longer than the remaining time. In other words, the offload control unit 24 determines to have the external computing device 14 execute the target task when the deadline will not be met unless the target task is executed by the external computing device 14.
When it is determined that the external computing device 14 should execute the target task, the offload control unit 24 determines whether to allow other tasks to use the external computing device 14 based on the remaining time and the predicted external time. Specifically, the offload control unit 24 determines that other tasks cannot use the external computing device 14 if a delay due to waiting to use the external computing device 14 is not allowed. For example, the offload control unit 24 may determine that a delay is allowed if the remaining time is longer than the predicted external time by at least a threshold time.

If the offload control unit 24 determines that the target task should be executed by the external computing device 14 and that use of the external computing device 14 by other tasks is not permitted, the offload control unit 24 proceeds to step S110. In other words, if the target task must be executed by the external computing device 14 in order to meet the deadline and a delay due to waiting for use of the external computing device 14 is not permitted, the offload control unit 24 proceeds to step S110.
If the offload control unit 24 determines that the target task can be executed by the external computing device 14 and that use of the external computing device 14 by other tasks is permissible, the offload control unit 24 proceeds to step S120. In other words, if the target task must be executed by the external computing device 14 to meet the deadline, but a delay due to waiting for use of the external computing device 14 is permissible, the offload control unit 24 proceeds to step S120.
If the offload control unit 24 determines not to cause the external computing device 14 to execute the target task, the offload control unit 24 proceeds to step S130. In other words, if the target task can be executed in time for the deadline even if it is executed by the internal computing device 11, the offload control unit 24 proceeds to step S130.

The first control process (step S110 in FIG. 3) according to the first embodiment will be described with reference to FIG.
(Step S111: Restriction process)
The offload control unit 24 sets restrictions on the use of the external computing device 14 by other tasks. In other words, the offload control unit 24 prevents other tasks from using the external computing device 14 at a point in time before the reference time when the target slot starts. In this way, when input data for the target task is acquired in the target slot, the offload control unit 24 prevents the target task from being prevented from using the external computing device 14 by the other tasks.

(Step S112: Acquisition determination process)
The offload control unit 24 determines whether input data for the target task has been acquired in the target slot.
If the input data is acquired, the offload control unit 24 proceeds to step S113. On the other hand, if the input data is not acquired, the offload control unit 24 skips step S113 and proceeds to step S114.

(Step S113: Calculation processing)
The offload control unit 24 instructs the external computing device 14 to execute the target task. As a result, the target task is executed by the external computing device 14. When execution of the target task starts, the offload control unit 24 advances the process to step S114.

(Step S114: Restriction removal process)
The offload control unit 24 releases the usage restriction set in step S111. That is, if input data for the target task is acquired in the target slot, the offload control unit 24 releases the usage restriction when execution of the target task by the external computing device 14 begins. On the other hand, if input data for the target task is not acquired in the target slot, the offload control unit 24 immediately releases the usage restriction.

The second control process (step S120 in FIG. 3) according to the first embodiment will be described with reference to FIG.
(Step S121: Acquisition determination process)
The offload control unit 24 determines whether input data for the target task has been acquired in the target slot.
If the input data is acquired, the offload control unit 24 proceeds to step S122. On the other hand, if the input data is not acquired, the offload control unit 24 skips step S122 and ends the process.

(Step S122: Calculation processing)
The offload control unit 24 instructs the external computing device 14 to execute the target task. As a result, the target task is executed by the external computing device 14. Once the target task has started, the offload control unit 24 ends the processing.

The third control process (step S130 in FIG. 3) according to the first embodiment will be described with reference to FIG.
(Step S131: Acquisition determination process)
The offload control unit 24 determines whether input data for the target task has been acquired in the target slot.
If the input data is acquired, the offload control unit 24 proceeds to step S132. On the other hand, if the input data is not acquired, the offload control unit 24 skips step S132 and ends the process.

(Step S132: Calculation processing)
The offload control unit 24 instructs the internal processing unit 11 to execute the target task. As a result, the target task is executed by the internal processing unit 11. When the target task is started, the offload control unit 24 ends the processing.

***Effects of First Embodiment***
As described above, the offload control device 10 according to the first embodiment controls whether to have the external computing device 14 execute the target task, using the remaining time until the deadline of the target task at the point in time before the reference time at which the target slot starts, the predicted internal time, and the predicted external time. This makes it possible to preferentially assign the external computing device 14, which is capable of high-speed processing, to a task whose deadline is approaching. As a result, the task deadline is more likely to be met.

When a deadline is approaching, the offload control device 10 according to the first embodiment restricts the use of the external computing device by other tasks before acquiring input data for the target task, thereby reducing delays caused by the target task waiting for an available external computing device 14.
Furthermore, the offload control device 10 according to the first embodiment releases the usage restriction when it is determined that the target task has started to be executed by the external calculation device 14 or that input data is no longer available. This minimizes the period of usage restriction and reduces the impact on other tasks.

***Other configurations***
<Modification 1>
In the first embodiment, each functional component is realized by software. However, as a first modification, each functional component may be realized by hardware. The following describes the differences between the first embodiment and the first modification.

If each functional component is implemented in hardware, the off-load control device 10 includes electronic circuits. These electronic circuits are dedicated circuits that implement the functions of each functional component.

Possible electronic circuits include single circuits, composite circuits, programmed processors, parallel programmed processors, logic ICs, GAs, ASICs, and FPGAs. GA stands for Gate Array. ASIC stands for Application Specific Integrated Circuit. FPGA stands for Field-Programmable Gate Array.
Each functional component may be realized by one electronic circuit, or each functional component may be realized by distributing it among a plurality of electronic circuits.

<Modification 2>
As a second modification, some of the functional components may be realized by hardware, and other functional components may be realized by software.

The internal calculation device 11, external calculation device 14, and electronic circuitry are collectively referred to as the processing circuit. In other words, the functions of each functional component are realized by the processing circuit.

Furthermore, the word "part" in the above description may be interpreted as "circuit," "process," "procedure," "processing," or "processing circuit."

Embodiment 2.
The second embodiment differs from the first embodiment in that advance preparation is performed on the arithmetic unit that performs the target task. In the second embodiment, this difference will be explained, and explanation of the same points will be omitted.

***Explanation of Operation***
The first control process (step S110 in FIG. 3) according to the second embodiment will be described with reference to FIG.
The process of step S211 is the same as the process of step S111 in Fig. 4. The processes of steps S213 and S214 are the same as the processes of steps S112 and S113 in Fig. 4. The process of step S216 is the same as the process of step S114 in Fig. 4.

(Step S212: Advance preparation process)
The offload control unit 24 performs advance preparations for the external computing device 14 to execute the target task. That is, the offload control unit 24 performs advance preparations at a time before the reference time of the target slot. The advance preparations include, for example, allocating memory.

(Step S215: Preparation cancellation process)
The offload control unit 24 cancels the advance preparation performed in step S212. That is, the offload control unit 24 cancels the advance preparation if the input data of the target task is not acquired in the target slot. For example, if the advance preparation was memory allocation, the offload control unit 24 releases the allocated memory.

The second control process (step S120 in FIG. 3) according to the second embodiment will be described with reference to FIG.
The processes in steps S222 and S223 are the same as the processes in steps S121 and S122 in FIG.

(Step S221: Advance preparation process)
As in step S212 of FIG. 7, the offload control unit 24 performs advance preparations for the external computing device 14 to execute the target task.

(Step S224: Preparation cancellation process)
As in step S215 of FIG. 7, the offload control unit 24 cancels the advance preparation performed in step S221.

The third control process (step S130 in FIG. 3) according to the second embodiment will be described with reference to FIG.
The processes in steps S232 and S233 are the same as the processes in steps S131 and S132 in FIG.

(Step S231: Advance preparation process)
The offload control unit 24 performs advance preparations for the internal processing unit 11 to execute the target task.

(Step S234: Preparation cancellation process)
The offload control unit 24 cancels the advance preparation performed in step S231.

***Effects of the Second Embodiment***
The offload control device 10 according to the second embodiment performs advance preparations for executing a target task before acquiring input data for the target task. This allows the target task to be executed smoothly, and the target task can be completed more quickly. As a result, it becomes easier to meet the deadline for the target task.

Embodiment 3.
The third embodiment differs from the first embodiment in that the use restriction of other tasks is realized by using a flag. In the third embodiment, this difference will be explained, and explanation of the same points will be omitted.

The first control process (step S110 in FIG. 3) according to the third embodiment will be described with reference to FIG.
The processes in steps S312 and S313 are the same as the processes in steps S112 and S113 in FIG.

In embodiment 3, other tasks are configured not to use the external computing device if the reservation flag is set. In other words, other tasks are configured to check the reservation flag before using the external computing device 14, and if the reservation flag is set, they wait or perform other processing until it is reset.

(Step S311: Restriction process)
The offload control unit 24 sets a reservation flag. That is, the offload control unit 24 sets the reservation flag when the time arrives before the reference time of the target slot. This restricts the use of the external processing unit 14 by other tasks, and allows the target task to use the external processing unit 14 preferentially after acquiring input data.

(Step S314: Restriction removal process)
The offload control unit 24 resets the reservation flag.

***Effects of the Third Embodiment***
As described above, the offload control device 10 according to the third embodiment sets a reservation flag before acquiring input data for a target task when the deadline is approaching. This makes it possible to reduce delays caused by the target task waiting for an available external computing device 14 when the input data is acquired.
Furthermore, the offload control device 10 according to the third embodiment resets the reservation flag when it is determined that the target task has started to be executed by the external calculation device 14 or that input data is not available. This minimizes the period of usage restriction and reduces the impact on other tasks.

Embodiment 4.
The fourth embodiment differs from the first embodiment in that the predicted external time is longer than the predicted internal time. In the fourth embodiment, this difference will be explained, and explanation of the same points will be omitted.

***Explanation of Operation***
The overall processing of the off-road control device 10 according to the fourth embodiment will be described with reference to FIG.
The processes in steps S401 and S402 are the same as those in steps S101 and S102 in Fig. 3. The processes in steps S410 to S430 are the same as those in steps S110 to S130 in Fig. 3.

(Step S403: Off-road control process)
Similar to step S103 in FIG. 3, the offload control unit 24 determines the execution method of the target task when input data for the target task is acquired in the target slot, based on the remaining time, the predicted internal time, and the predicted external time.
In this case, under the assumption that the predicted external time is longer than the predicted internal time, the offload control unit 24 determines to have the external computing device 14 execute the target task if the predicted external time is shorter than the remaining time. In other words, the offload control unit 24 determines to have the external computing device 14 execute the target task if the deadline can be met even if the target task is executed by the external computing device 14.
If it is determined that the external computing device 14 should execute the target task, similar to step S103 in FIG. 3, the offload control unit 24 determines whether to allow other tasks to use the external computing device 14 based on the remaining time and the predicted external time.

If the offload control unit 24 determines that the external computing device 14 is to execute the target task and that use of the external computing device 14 by other tasks is not permitted, the offload control unit 24 proceeds to step S410. In other words, if there is no delay due to waiting for use of the external computing device 14 and the target task can be executed on the external computing device 14 and still meet the deadline, the offload control unit 24 proceeds to step S410.
If the offload control unit 24 determines that the external computing device 14 can be made to execute the target task and that use of the external computing device 14 by other tasks is permissible, the offload control unit 24 proceeds to step S420. In other words, the offload control unit 24 proceeds to step S420 if the target task can be executed on the external computing device 14 and still meet the deadline, even if there is a delay due to waiting for use of the external computing device 14.
If the offload control unit 24 determines not to cause the external computing device 14 to execute the target task, the offload control unit 24 proceeds to step S430. In other words, if the target task must be executed by the internal computing device 11 in order to meet the deadline, the offload control unit 24 proceeds to step S430.

***Effects of the Fourth Embodiment***
As described above, when the predicted external time is longer than the predicted internal time, the offload control device 10 according to the fourth embodiment can preferentially allocate the internal processing unit 11 capable of high-speed processing to a task whose deadline is approaching. As a result, the deadline of the task becomes easier to meet.

The above describes embodiments and variations of the present disclosure. It is also possible to combine several of these embodiments and variations. It is also possible to partially implement one or several of them. It should be noted that the present disclosure is not limited to the above embodiments and variations, and various modifications are possible as needed.

10 Offload control device, 11 Internal processing unit, 12 Memory, 13 Storage device, 14 External processing unit, 21 Communication management unit, 22 Deadline management unit, 23 Predicted time management unit, 24 Offload control unit.

Claims (10)

a predicted time management unit that manages a predicted internal time, which is a predicted execution time when a target task is executed in an internal computing device, and a predicted external time, which is a predicted execution time when the target task is executed in an external computing device;
an offload control unit that controls whether to cause the external computing device to execute the target task based on the remaining time until the deadline of the target task at a point in time before a reference time at which a time slot corresponding to a data type of input data of the target task starts in time division communication in which time slots available for communication are determined according to data type, and the predicted internal time and the predicted external time managed by the predicted time management unit. 2. The offload control device according to claim 1, wherein the offload control unit causes the external computing device to execute the target task when the predicted external time is shorter than the predicted internal time and the predicted internal time is longer than the remaining time. 3. The offload control device according to claim 1, wherein the offload control unit causes the external computing device to execute the target task when the predicted external time is longer than the predicted internal time and the predicted external time is shorter than the remaining time. 4. The offload control device according to claim 1, wherein, when the external computing device is caused to execute the target task, the offload control unit controls whether to allow use of the external computing device by another task different from the target task, based on the remaining time and the predicted external time. 5. The offload control device according to claim 4, wherein, when the offload control unit does not allow other tasks different from the target task to use the external computing device, the offload control unit restricts the other tasks from using the external computing device at a time before the reference time of a target slot, which is a time slot corresponding to a data type of input data of the target task. The other task does not use the external computing device when the reservation flag is set,
6. The offload control device according to claim 5, wherein the offload control unit sets the reservation flag when a time before the reference time of the target slot arrives when the other task does not allow the external calculation device to be used by the other task. 7. The offload control device according to claim 5, wherein the offload control unit releases the usage restriction when the external computing device starts executing the target task if input data for the target task is acquired in the target slot, and immediately releases the usage restriction if input data for the target task is not acquired in the target slot. 6. The offload control device according to claim 1, wherein the offload control unit performs advance preparations for executing the target task when a time before the reference time of a target slot, which is a time slot corresponding to a data type of input data of the target task, arrives, and cancels the advance preparations if the input data of the target task is not acquired in the target slot. The computer manages a predicted internal time, which is a predicted execution time when a target task is executed in an internal computing device, and a predicted external time, which is a predicted execution time when the target task is executed in an external computing device;
1. An offload control method in which a computer controls whether to cause an external computing device to execute a target task based on the remaining time until the deadline of the target task at a point in time before a reference time at which a time slot corresponding to a data type of input data of the target task starts in time-division communication in which time slots available for communication are determined according to data type, the predicted internal time, and the predicted external time. a predicted time management process for managing a predicted internal time, which is a predicted execution time when a target task is executed in an internal computing device, and a predicted external time, which is a predicted execution time when the target task is executed in an external computing device;
an external computing device that executes an offload control program that causes a computer to function as an offload control device that performs offload control processing to control whether or not to cause the external computing device to execute the target task, based on the remaining time until the deadline of the target task at a point in time before a reference time at which a time slot corresponding to a data type of input data of the target task starts in time division communication in which time slots available for communication are determined according to data type, and the predicted internal time and the predicted external time managed by the predicted time management processing.