JP2008140042A - Image processing apparatus and program - Google Patents

Abstract

To detect the progress of image processing without changing the configuration of individual modules constituting an image processing unit.
An image processing module that obtains image data from the previous stage, performs image processing, and outputs the image data that has undergone image processing to the subsequent stage, and causes the image data from the previous stage to be written into a buffer and stored in the buffer. When the image processing unit 50 is instructed to detect the degree of progress of the image processing in the construction of the image processing unit 50 in which the buffer module 40 that performs processing for reading out the image data to be read later is connected in a pipeline form or the like The progress detection module 48 for detecting the progress of image processing at the insertion point is inserted in the next stage of the image processing module 38, and the progress detected by the individual detection modules 48 during the execution of the image processing is collected. The progress of the processing unit 50 as a whole is calculated and displayed.
[Selection] Figure 5

Description

  The present invention relates to an image processing apparatus and a program, and in particular, an image in which a buffer module is connected to at least one of a front stage and a rear stage of an image processing module, and individual modules are connected in a pipeline form or a directed acyclic graph form. The present invention relates to an image processing apparatus that constructs a processing unit and performs image processing, and an image processing program for causing a computer to function as the image processing apparatus.

  In an image processing device that performs image processing on input image data, a DTP (desktop publishing) system that can handle images, a print system that records an image represented by input image data on a recording material, etc. Various types of image processing such as enlargement / reduction, rotation, affine transformation, color conversion, filter processing, and image synthesis are performed on the image data. In these devices and systems, if the attributes of the input image data and the contents, procedures, parameters, etc. of the image processing for the image data are fixed, the image processing may be performed by specially designed hardware. However, for example, when various image data with different color space and the number of bits per pixel are input, or when the contents, procedures, and parameters of the image processing are changed variously, the image processing to be executed is more flexible. A changeable configuration is required.

  In order to satisfy such a requirement, for example, in Patent Document 1, a programmable processing module is connected to a pipeline form or a DAG (Directed Acyclic Graph) form to perform desired image processing. Technologies that enable this have been proposed. The technology described in Patent Literature 1 is configured so that the contents of the arithmetic processing in each of the plurality of programmable arithmetic processing units and the connection form of each programmable arithmetic processing unit by the network unit can be freely set from the outside through the host control means. As a result, a digital video signal processing apparatus capable of high-speed and advanced arithmetic processing and having a high degree of freedom for function change and system change is realized.

In relation to the above, Patent Document 2 discloses computer interface means for exchanging information with a computer, receiving image information represented by code information via the computer interface means, and developing the received image information. An image developing means for recording, an image recording means for recording an image developed by the image developing means, and an image communication means for transmitting / receiving an image developed by the image developing means via a communication line are operable in series or in parallel. In the complex image processing system, the management number of the processing unit, the information of the processing unit that executes the processing unit, the information of the execution status of the processing unit, the information indicating the contents of the processing unit, and the content of the error that occurred during the processing of the processing unit By storing and updating status information consisting of information indicating the status of each processing means, the processing status of each processing means is monitored. Technique for notifying scan information) to a user is disclosed.
JP-A-5-260373 JP-A-8-289061

  When configuring an image processing apparatus that performs desired image processing by arbitrarily combining a plurality of types of image processing modules as in the technique described in Patent Document 1, there are the following problems. That is, each image processing module has a unit (for example, a pixel unit, a line unit, a plurality of line units, a surface unit, etc.) that can be easily processed according to the type and content of image processing to be executed. However, in order to be able to connect the image processing modules in an arbitrary order and process them in a coordinated manner, the output units of all the image processing modules are aligned, or each image processing module is set to an arbitrary input unit. It is necessary to be able to cope with it, and the configuration of each image processing module becomes complicated. In addition, since each image processing module operates in cooperation with other image processing modules, each image processing module is connected to its own module other than the part that actually performs image processing on the input image data. In addition, a part for controlling processing for transferring image data to and from other image processing modules is required, and the configuration of each image processing module is further complicated.

  The above problems are caused by using a configuration in which a buffer is provided before and after the image processing module, causing each image processing module to perform various types of image processing, and changing each image processing module to the type and content of image processing to be performed. This can be solved by obtaining image data from the previous buffer for each unit that is easy to process, and performing image processing.

  However, when the output units (image data acquisition units and image processing execution units) of the individual image processing modules are not complete as described above, the image processing as the entire image processing unit including a plurality of image processing modules and buffers is performed. There is a problem that it is difficult to grasp the degree of progress. For this reason, a program corresponding to each module is displayed according to the progress of the image processing in the image processing unit, displaying the processing completion time of the image processing, or predicting the processing completion time of the image processing in the image processing unit. Inconvenience arises in that it is difficult to perform control such as changing the execution priority of resources and the allocation of resources to individual modules.

  On the other hand, although the above-mentioned patent document 2 discloses a technique for grasping and displaying the processing status by sequentially updating the status information based on the processing status report from each processing means, In order to detect the progress of the image processing in the image processing unit by applying the described technology, the processing status report is output for each image processing module constituting the image processing unit every time the progress of the processing changes. There is a problem that the development load for realizing a configuration capable of detecting the progress of image processing in the image processing unit is very large.

  The present invention has been made in consideration of the above facts, and an image processing apparatus and image processing capable of detecting the degree of progress of image processing in the image processing unit without changing the configuration of individual modules constituting the image processing unit. The purpose is to get a program.

  In order to achieve the above object, an image processing apparatus according to the first aspect of the present invention acquires image data from the previous stage of its own module, performs predetermined image processing on the acquired image data, and receives the image processing. Alternatively, an image processing module program for performing a series of processing for outputting a processing result of the image processing to the subsequent stage of the module for each unit processing amount and image data output from the preceding stage of the module are written in the buffer, By counting the number of times the image data is output from the previous stage of the own module or the data amount of the image data, the program of the buffer module that performs processing for reading the stored image data by the subsequent stage of the own module, Of a progress detection module for detecting the progress of image processing at the insertion point , And the buffer module is connected to at least one of the front and rear stages of the image processing module using the program of each module stored in the storage means. A construction means for constructing an image processing unit connected in a form or a directed acyclic graph form, and inserting the progress degree detection module at a subsequent stage of one or more image processing modules constituting the image processing unit; Collecting the degree of progress of the image processing detected by each of the degree-of-progress detection modules inserted into the image processing unit by the constructing means, and progressing of the image processing in the image processing unit based on the collected degree of progress And a management means for detecting the degree.

  According to the first aspect of the present invention, image data is acquired from the previous stage of the own module, predetermined image processing is performed on the acquired image data, and the image data subjected to the image processing or the processing result of the image processing is passed to the subsequent stage of the own module. The image processing module program that performs a series of output processing for each unit processing amount and the image data output from the previous stage of the own module are written to the buffer, and the image data stored in the buffer is read by the subsequent stage of the own module The degree of progress of image processing at the insertion point of the module is counted by counting the number of times the image data is output from the previous stage of the own module and the number of times the image data is output from the previous stage of the own module. The progress degree detection module program for detecting the .

  According to the first aspect of the present invention, the buffer module is connected to at least one of the front stage and the rear stage of the image processing module by the construction means using the program of each module stored in the storage means, and each module is connected to the pipe. An image processing unit connected in the form of a line or a directed acyclic graph is constructed, and a progress degree detection module is inserted on the subsequent stage side of one or more image processing modules constituting the image processing unit. The management means according to the first aspect of the invention collects the degree of progress of the image processing detected by each progress degree detection module inserted into the image processing unit by the construction means, and based on the collected degree of progress. The degree of progress of image processing in the image processing unit is detected.

  Thus, according to the first aspect of the present invention, by counting the number of times image data is output from the previous stage of the own module or the amount of image data from the previous stage of the own module, image processing at the insertion position of the own module is performed. The progress degree detection module for detecting the progress degree is inserted by the construction means on the rear side of one or more image processing modules constituting the image processing unit, and the progress degree of the image processing detected by each of the progress degree detection modules is determined. Since each image is collected by the management means and the progress of the image processing in the image processing unit is detected, each module (image processing module) constituting the image processing unit is detected in order to detect the progress of the image processing in the image processing unit. And the buffer module) need not be changed. Therefore, according to the first aspect of the invention, it is possible to detect the degree of progress of image processing in the image processing unit without changing the configuration of individual modules constituting the image processing unit.

  In the first aspect of the present invention, the insertion of the progress degree detection module into the image processing unit and the detection of the progress degree may be always performed. However, the present invention is not limited to this. As described above, the construction unit inserts the progress degree detection module into the image processing unit when the detection of the degree of progress of the image processing in the image processing unit is instructed. When the inserted image processing unit is constructed by the construction unit, the progress degree may be collected and the degree of image processing in the image processing unit may be detected. As a result, when it is not necessary to detect the degree of progress of image processing in the image processing unit, the degree of progress detection module is not inserted into the image processing unit, and the degree of progress is not collected and detected by the management means. , Processing efficiency can be improved.

  Further, in the invention described in claim 1, the constructing means, as described in claim 3, for example, when the detection of the degree of progress of the image processing in the image processing unit is instructed, Each of the image processing modules is inserted into a subsequent stage, or a plurality of image processing modules are included among the image processing modules constituting the image processing unit, and each module cooperates to perform specific image processing. As a unit of a group of modules that realize the above, a progress degree detection module can be inserted in each subsequent stage.

  Further, in the first aspect of the invention, the detection of the degree of progress of the image processing at the insertion position of each progress degree detection module by the individual progress degree detection module inserted in the image processing unit is specifically, for example, According to a fourth aspect of the present invention, the management means includes the data amount of the image data to be processed by the image processing unit, the contents of the image processing in the individual image processing modules existing on the upstream side of the specific progress detection module, and the specification The total output of the image data from the preceding image processing module until the image processing unit completes the processing on the processing target image data based on the unit processing amount in the preceding image processing module of the progress degree detection module A process for calculating and notifying the number of times in advance is performed for each progress degree detection module inserted in the image processing unit, and the image is displayed. Each progress detection module inserted in the processing unit counts the number of times image data is input from the preceding image processing module, and divides the counted number by the total number of outputs notified in advance from the management means It can be carried out.

  Furthermore, in the first aspect of the invention, the detection of the degree of progress of the image processing at the insertion position of each progress degree detection module by the individual progress degree detection module inserted in the image processing unit is specifically, for example, According to a fifth aspect of the present invention, the management means is based on the data amount of the image data to be processed by the image processing unit and the content of the image processing in each image processing module existing on the upstream side of the specific progress detection module. Until the image processing unit completes the processing on the image data to be processed, and the image processing unit is notified of the total amount of image data output from the preceding image processing module. This is performed for each inserted progress detection module, and each progress detection module inserted in the image processing unit is used for image processing in the previous stage. Counting the data amount of the image data input from Joules can be performed by dividing the total amount of data in advance notification from the management means counts the data amount.

  Further, in the invention according to any one of claims 1 to 5, the management unit displays the progress degree of the image processing in the detected image processing unit on the display unit as described in claim 6, for example. You may comprise. Thereby, the user can be made to recognize the degree of progress of the image processing in the image processing unit. In the present invention, the result of detecting the degree of progress of image processing in the image processing unit is not limited to being displayed on the display unit as described above, and the processing completion time of image processing in the image processing unit is predicted. Display on the display means, and control such as changing the execution priority of the program corresponding to each module and the allocation of resources to each module according to the degree of progress of the image processing in the image processing unit. It is also possible to use it.

  The image processing program according to the invention of claim 7 acquires image data from the previous stage of its own module, performs predetermined image processing on the acquired image data, and the image data subjected to the image processing or the processing result of the image processing The image processing module program for performing a series of processing for outputting to the subsequent stage of the own module for each unit processing amount and the image data output from the previous stage of the own module are written to the buffer, and the image data stored in the buffer is By counting the number of times the image data is output from the previous stage of the own module or the amount of the image data, the processing of the buffer module that performs processing to be read by the subsequent stage of the own module, the image processing at the insertion position of the own module is performed. Each of the program of the progress detection module for detecting the progress is stored. The buffer module is connected to at least one of the preceding stage and the succeeding stage of the image processing module using a program of each module stored in the storage means, and each module is connected to the pipeline connected to the storage means. A construction means for constructing an image processing unit connected in a form or a directed acyclic graph form, and inserting the progress degree detection module at a subsequent stage of one or more image processing modules constituting the image processing unit, And collecting the degree of progress of the image processing detected by each of the degree-of-progress detection modules inserted into the image processing unit by the construction means, and performing image processing in the image processing unit based on the collected degree of progress. It functions as a management means for detecting the degree of progress.

  An image processing program according to a seventh aspect of the invention is a program that causes a computer connected to the storage means to function as the construction means and the management means. By executing the image processing program, the computer functions as the image processing apparatus according to claim 1, and, similarly to the invention according to claim 1, the configuration of individual modules constituting the image processing unit is configured. Without changing, it is possible to detect the degree of progress of the image processing in the image processing unit.

  As described above, according to the present invention, the progress degree detection module that detects the progress degree of the image processing at the insertion position of the own module by counting the number of output times or the amount of data of the image data from the previous stage of the own module, One of the image processing modules constituting the processing unit is inserted into the subsequent stage, and the degree of progress of the image processing detected by each of the degree of progress detection modules inserted in the image processing unit is collected, and the collected degree of progress is collected. Since the progress of image processing in the image processing unit is detected based on this, it is possible to detect the progress of image processing in the image processing unit without changing the configuration of individual modules constituting the image processing unit. Has an excellent effect.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a computer 10 that can function as an image processing apparatus according to the present invention. The computer 10 is incorporated in any image handling apparatus that needs to perform image processing internally, such as a copying machine, a printer, a facsimile machine, a multifunction machine having these functions, a scanner, a photographic printer, or the like. Alternatively, it may be an independent computer such as a personal computer (PC), or may be a computer incorporated in a portable device such as a PDA (Personal Digital Assistant) or a cellular phone.

  The computer 10 includes a CPU 12, a memory 14 including a DRAM or SRAM, a display unit 16, an operation unit 18, a storage unit 20, an image data supply unit 22, and an image output unit 24, which are connected to each other via a bus 26. Has been. When the computer 10 is incorporated in the image handling device as described above, a display panel, a numeric keypad, or the like composed of an LCD or the like provided in the image handling device can be applied as the display unit 16 and the operation unit 18. When the computer 10 is an independent computer, a display, a keyboard, a mouse, or the like connected to the computer can be applied as the display unit 16 or the operation unit 18. The storage unit 20 is preferably an HDD (Hard Disk Drive), but other nonvolatile storage means such as a flash memory can be used instead.

  The image data supply unit 22 only needs to be able to supply image data to be processed. For example, an image reading unit that reads an image recorded on a recording material such as paper or photographic film, and outputs the image data. A receiving unit that receives image data from the outside via a line, an image storage unit (memory 14 or storage unit 20) that stores image data, and the like can be applied. The image output unit 24 may be any unit that outputs image data that has undergone image processing or an image represented by the image data. For example, the image recording unit records an image represented by the image data on a recording material such as paper or a photosensitive material. A display unit that displays an image represented by image data on a display, a writing device that writes image data to a recording medium, and a transmission unit that transmits image data via a communication line can be applied. The image output unit 24 may be an image storage unit (memory 14 or storage unit 20) that simply stores image data that has undergone image processing.

  As shown in FIG. 1, the storage unit 20 includes various programs executed by the CPU 12, such as management of resources such as the memory 14, management of execution of programs by the CPU 12, and communication between the computer 10 and the outside. A program of the system 30, an image processing program group 34 for causing the computer 10 to function as an image processing apparatus according to the present invention, and a desired image for the image processing apparatus realized by the CPU 12 executing the image processing program group. Programs of various applications 32 to be processed (represented as application program group 32 in FIG. 1) are stored.

  The image processing program group 34 reduces the development load when developing the above-described various image handling devices and portable devices, and reduces the development load when developing an image processing program usable on a PC or the like. The purpose is a program developed so that it can be commonly used in various devices (platforms) such as various image handling devices, portable devices, and PCs, and corresponds to the image processing program according to the present invention. The storage unit 20 for storing the image processing program group 34 corresponds to the storage unit according to the present invention. The image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 in accordance with a construction instruction from the application 32, and executes the image processing unit in accordance with an execution instruction from the application 32. The image processing program group 34 instructs the construction of an image processing unit (an image processing unit having a desired configuration) for performing desired image processing, or the constructed image processing unit. The application 32 is provided with an interface for instructing execution of image processing according to the above. For this reason, even when newly developing an arbitrary device that needs to perform image processing internally, regarding the development of a program for performing the image processing, the above-described interface is used to perform the image processing required for the device. It is only necessary to develop the application 32 to be used and executed by the image processing program group 34, and it is not necessary to newly develop a program for actually performing image processing, so that the development load can be reduced.

  Further, as described above, the image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 according to the construction instruction from the application 32, and constructs the constructed image processing unit. Therefore, for example, when the color space of the image data to be processed and the number of bits per pixel are indefinite or the contents of the image processing to be executed, the procedure / parameter, etc. are indefinite, When the application 32 instructs to reconstruct the image processing unit, the image processing executed by the image processing apparatus (image processing unit) can be flexibly changed according to the image data to be processed.

  Hereinafter, the image processing program group 34 will be described. As shown in FIG. 1, the image processing program group 34 is roughly divided into a module library 36, a process construction unit 42 program, and a process management unit 46 program. Although details will be described later, the processing construction unit 42 according to the present embodiment, according to an instruction from the application, as illustrated in FIG. 4 as an example, one or more image processing modules 38 that perform predetermined image processing, A buffer module 40 that is arranged in at least one of the preceding stage and the succeeding stage of each image processing module 38 and has a buffer for storing image data, and a pipeline form or a DAG (Directed Acyclic Graph) form An image processing unit 50 formed by linking is constructed. The entity of each image processing module constituting the image processing unit 50 is a first program executed by the CPU 12 and causing the CPU 12 to perform predetermined image processing, or an external unit that is executed by the CPU 12 and not shown in FIG. 2 is a second program for instructing execution of processing to the image processing apparatus (for example, a dedicated image processing board), and the module library 36 described above stores predetermined different image processing (for example, input processing and filter processing). , Color conversion processing, enlargement / reduction processing, skew angle detection processing, image rotation processing, image composition processing, output processing, and the like) are registered. Hereinafter, in order to simplify the description, it is assumed that the individual image processing modules constituting the image processing unit 50 are the first program.

  As shown in FIG. 6A as an example, each image processing module 38 includes an image processing engine 38A that performs image processing on image data by a predetermined unit processing data amount, and a front stage and a rear stage of the image processing module 38. The control unit 38B performs input / output of image data with the module and controls the image processing engine 38A. The unit processing data amount in each image processing module 38 is the image processing engine 38A from an arbitrary number of bytes including one line of the image, a plurality of lines of the image, one pixel of the image, one surface of the image, and the like. Is selected and set in advance according to the type of image processing to be performed. For example, in the image processing module 38 that performs color conversion processing and filter processing, the unit processing data amount is one pixel, and the image to be enlarged / reduced is processed. In the processing module 38, the unit processing data amount is equivalent to one line of the image or a plurality of lines of the image, and in the image processing module 38 that performs image rotation processing, the unit processing data amount is equivalent to one image, and the image compression / decompression processing is performed. In the image processing module 38 to be performed, the unit processing data amount is N bytes depending on the execution environment.

  The module library 36 also registers image processing modules 38 having the same type of image processing executed by the image processing engine 38A and different contents of the image processing executed (in FIG. 1, this type of image processing is performed). Modules are indicated as “module 1” and “module 2”). For example, with respect to the image processing module 38 that performs enlargement / reduction processing, the image processing module 38 that performs reduction processing to reduce the input image data to 50% by thinning out every other pixel is designated for the input image data. A plurality of image processing modules 38 such as an image processing module 38 that performs enlargement / reduction processing at the enlarged / reduced rate are prepared. For example, the image processing module 38 that performs color conversion processing includes an image processing module 38 that converts the RGB color space to the CMY color space, an image processing module 38 that converts the color space to the opposite, and an L * a * b * color space. Image processing modules 38 for performing other color space conversions are prepared.

  In addition, the control unit 38B of the image processing module 38 receives an image from a module (for example, the buffer module 40) in the previous stage of its own module in order to input image data necessary for the image processing engine 38A to process each unit processing data amount. Data is acquired for each unit read data amount, and image data output from the image processing engine 38A is output for each unit write data amount to a subsequent module (for example, the buffer module 40) (data amount such as compression by the image processing engine 38A). If the image processing with the increase / decrease is not performed, the unit writing data amount = the unit processing data amount) or the result of the image processing by the image processing engine 38A is output to the outside of the module (for example, the image processing engine 38A When performing image analysis processing such as skew angle detection processing, a scan is performed instead of image data. The image analysis processing result such as the angle detection result may be output). However, the module library 36 has the same type and content of the image processing executed by the image processing engine 38A, and the unit processing described above. Image processing modules 38 having different data amounts, unit read data amounts, and unit write data amounts are also registered. For example, the unit processing data amount in the image processing module 38 that performs image rotation processing is not limited to the one image plane described above, and the same image rotation processing is performed and the unit processing data amounts are different from each other (for example, one image). A plurality of image processing modules 38 (for a line, a plurality of lines, etc.) may be included in the module library 36.

  The program of each image processing module 38 registered in the module library 36 is composed of a program corresponding to the image processing engine 38A and a program corresponding to the control unit 38B, but a program corresponding to the control unit 38B. The image processing module 38 having the same unit read data amount and unit write data amount among the individual image processing modules 38 is concerned with the type and content of image processing executed by the image processing engine 38A. However, the program corresponding to the control unit 38B is shared (the same program is used as the program corresponding to the control unit 38B). Thereby, the development load in developing the program of the image processing module 38 is reduced.

  In the image processing module 38, the unit read data amount and the unit write data amount are not fixed when the input image attribute is unknown, and the input image data attribute is acquired and acquired. There is a module in which the unit read data amount and the unit write data amount are determined by substituting the attribute into a predetermined arithmetic expression, and this type of image processing module 38 has a unit read data amount and For the image processing module 38 in which the unit write data amount is derived using the same arithmetic expression, a program corresponding to the control unit 38B may be shared. The image processing program group 34 according to the present embodiment can be mounted on various devices as described above, but the number and types of image processing modules 38 registered in the module library 36 in the image processing program group 34 are described. Needless to say, addition, deletion, replacement, and the like can be appropriately performed in accordance with image processing required by various devices that implement the image processing program group 34.

  Further, as shown in FIG. 6B as an example, the individual buffer modules 40 constituting the image processing unit 50 are used to input / output image data between the buffer 40A and modules before and after the buffer module 40. The buffer control unit 40B manages the buffer 40A. The buffer 40A is composed of a memory area secured from the memory 14 provided in the computer 10 through the operating system 30 and the resource management unit 46B. The buffer control unit 40B of each buffer module 40 is also a program executed by the CPU 12, and the program of the buffer control unit 40B is also registered in the module library 36 (in FIG. 1, the program of the buffer control unit 40B is registered). "Buffer module")

  When the detection and display of the degree of progress of the image processing in the image processing unit 50 is instructed, the image processing unit 50 is configured as shown in FIGS. 5A to 5C as an example. A progress degree detection module 48 is inserted into the image processing module 38 and the buffer module 40 (details will be described later). The entity of the progress degree detection module 48 is a program executed by the CPU 12, and the program of the progress degree detection module 48 is also registered in the module library 36 (in FIG. "Degree detection module").

  Further, the processing construction unit 42 that constructs the image processing unit 50 in accordance with an instruction from the application 32 includes a plurality of types of module generation units 44 as shown in FIG. The plural types of module generation units 44 support different image processing, and are activated by the application 32 to generate a module group including an image processing module 38 and a buffer module 40 for realizing the corresponding image processing. Perform the process. In FIG. 1, as an example of the module generation unit 44, the module generation unit 44 corresponding to the type of image processing executed by each image processing module 38 registered in the module library 36 is shown. The image processing corresponding to the generation unit 44 may be image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing including skew angle detection processing and image rotation processing). When the required image processing is processing combining a plurality of types of image processing, the application 32 sequentially activates the module generation unit 44 corresponding to any of the plurality of types of image processing. As a result, an image processing unit 50 that performs necessary image processing is constructed by the module generation unit 44 that is sequentially activated by the application 32. The processing construction unit 42 corresponds to the construction means according to the present invention.

  As shown in FIG. 1, the process management unit 46 includes a workflow management unit 46 </ b> A that controls execution of image processing in the image processing unit 50, a memory 14 by each module of the image processing unit 50, and various files of the computer 10. It includes a resource management unit 46B that manages the use of resources, and an error management unit 46C that manages errors that have occurred in the image processing unit 50. When an error occurs while the image processing unit 50 is executing image processing, the error management unit 46C acquires error information such as the type and location of the error that has occurred, and the image processing program group 34 is installed. The device environment information representing the type or configuration of the device in which the computer 10 is incorporated is acquired from the storage unit 20 or the like, and an error notification method according to the device environment represented by the acquired device environment information is determined and determined. Performs processing to notify the occurrence of an error using the error notification method. The workflow management unit 46A corresponds to management means according to the present invention.

  Next, the operation of this embodiment will be described. In a device in which the image processing program group 34 is installed, when a situation where it is necessary to perform some kind of image processing, this situation is detected by a specific application 32. In addition, as a situation where it is necessary to perform image processing, for example, an image is read by an image reading unit as the image data supply unit 22, and is recorded as an image on a recording material by an image recording unit as the image output unit 24, or image output Whether the image is displayed on the display unit as the unit 24, the image data is written on the recording medium by the writing device as the image output unit 24, the image data is transmitted by the transmission unit as the image output unit 24, or the image output When the execution of a job to be stored in the image storage unit as the unit 24 is instructed by the user, or received by the reception unit as the image data supply unit 22 or stored in the image storage unit as the image data supply unit 22 For the image data being recorded, recording on the recording material, display on the display unit, writing to the recording medium, transmission, Any execution of a job for the storage of the image storage unit include when instructed by the user. In addition, the situation where image processing needs to be performed is not limited to the above. For example, in a state where the names of processes that can be executed by the application 32 in accordance with an instruction from the user are displayed in a list on the display unit 16, For example, the execution target process may be selected by the user.

  As described above, when detecting that it is necessary to perform some kind of image processing, the application 32 first recognizes the type of the image data supply unit 22 that supplies the image data to be processed (FIG. 2). If the recognized type is a buffer area (partial area of the memory 14) (if the determination in step 152 in FIG. 2 is affirmative), the image data supply unit 22 is designated. A buffer module 40 including a buffer area is generated (see also step 154 in FIG. 2). In the new generation of the buffer module 40 described later, the buffer control unit 40B is generated by generating a thread (which may be a process or an object; the same applies below) that executes a program of the buffer control unit 40B of the buffer module 40. The buffer controller 40B secures a memory area to be used as the buffer 40A. The generation of the buffer module 40 in step 154 is performed by using the designated buffer area as the already secured buffer 40A (buffer control). This is done by setting a parameter to be recognized by the unit 40B and generating a buffer control unit 40B. The buffer module 40 generated here functions as the image data supply unit 22.

  Subsequently, as described above, the application 32 recognizes the type of the image output unit 24 as an output destination of the image data subjected to image processing (see also step 156 in FIG. 2), and the recognized type is the buffer area (memory 14 (partial region 14) (if the determination in step 158 of FIG. 2 is affirmative), the buffer module 40 including the buffer region designated as the image output unit 24 is generated in the same manner as described above ( (See also step 160 in FIG. 2). The buffer module 40 generated here functions as the image output unit 24. Further, the application 32 recognizes the contents of the image processing to be executed, decomposes the image processing to be executed into a combination of image processing at a level corresponding to each module generation unit 44, and realizes the image processing to be executed. Therefore, the type of image processing necessary for the purpose and the execution order of the individual image processing are determined (see also step 162 in FIG. 2). In this determination, for example, the type of image processing and the execution order of the individual image processing are registered in advance as information in association with the type of job that can be instructed by the user. Can be realized by reading out information corresponding to the type of job instructed.

  Then, the application 32 first activates the module generation unit 44 corresponding to the image processing whose execution order is No. 1 based on the type and execution order of the image processing determined above (a thread for executing the program of the module generation unit 44). 2) (see also step 164 in FIG. 2), an input module for inputting image data to the module group as information necessary for generating the module group by the module generation unit 44 to the activated module generation unit 44 Input module identification information for identifying, output module identification information for identifying an output module from which the module group outputs image data, input image attribute information representing attributes of input image data input to the module group, Notifies the parameters of image processing to be executed and the corresponding module group Instructing generation (see step 166 of FIG. 2 also).

  In the above input module, the image data supply unit 22 is the input module for the module group with the first execution order, and the last module (usually the buffer) for the module group with the second execution order or later. Module 40) is the input module. For the above output modules, the image output unit 24 is designated as the output module in the module group whose execution order is the last, so that the image output unit 24 is designated as the output module. Specification by the application 32 is not performed for confirmation, and it is generated and set by the module generation unit 44 when necessary. The input image attributes and image processing parameters are registered as information in advance in association with, for example, the type of job that the user can instruct execution, and information corresponding to the type of job instructed to execute is read out. Thus, the application 32 may be recognized, or the user may be designated.

  On the other hand, when the module generation unit 44 is activated by the application 32, the module generation unit 44 performs a module generation process shown in FIG. 3 (see also step 168 in FIG. 2). In the module generation process, first, in step 200, it is determined whether or not there is an image processing module 38 to be generated next by the module generation unit 44. If there is an image processing module 38 to be generated, input image attribute information representing an attribute of the input image data input to the image processing module 38 to be generated is acquired in step 202. Whether the generation of the image processing module 38 determined to be generated in the previous step 200 is necessary even in light of the attribute of the input image data represented by the information acquired in step S200 is determined.

  Specifically, for example, a module generation unit 44 that generates a group of modules for which the module generation unit 44 corresponding to the module generation process being executed performs color conversion processing, and CMY colors as a color space of output image data according to image processing parameters When the space is designated by the application 32, if the input image data is found to be RGB color space data based on the input image attribute information acquired in step 202, the image processing module 38 that performs color space processing. It is necessary to generate an image processing module 38 that performs RGB → CMY color space conversion as follows. However, if the input image data is CMY color space data, the attributes of the input image data and the output image data are Since the color space is the same, the image processing module 38 that performs color space conversion processing does not need to be generated. It can be determined. If it is determined that it is unnecessary, the process returns to step 200.

  Note that in the process of acquiring the attributes of the input image data, when the buffer module 40 exists in the preceding stage of the image processing module 38 to be generated, the image processing module 38 in the preceding stage that writes the image data in the buffer module 40. This can be realized by acquiring the attribute of the output image data from.

  In the next step 206, it is determined whether or not the buffer module 40 is necessary after the image processing module 38 to be generated. This determination is made when the subsequent stage of the image processing module is an output module (image output unit 24) (see, for example, the last stage image processing module 38 in the image processing unit 50 shown in FIGS. 4A to 4C). As an example, like the image processing module 38 that performs the skew angle detection processing in the image processing unit 50 shown in FIG. If it is a module to be output to the image processing module 38, it is denied, and the process proceeds to step 210 without generating the buffer module 40. However, in other cases, the determination is affirmed and the process proceeds to step 208, where buffer control is performed. By starting the unit 40B (generating a thread for executing the program of the buffer control unit 40B), the image processing module is connected to the subsequent stage. To generate a buffer module 40.

  In the next step 210, information on the preceding module (for example, the buffer module 40), information on the succeeding buffer module 40, attributes of input image data input to the image processing module 38, and processing parameters are given, and the image processing module 38 is given. Is generated. It should be noted that the information of the subsequent buffer module 40 is not given to the image processing module 38 for which it is determined in step 206 that the subsequent buffer module 40 is unnecessary, and the processing content is fixed, for example, 50% reduction processing. If no special image processing parameter is required, no processing parameter is given.

  In the module generation process (step 210), the attributes of the input image data acquired in step 202 from among a plurality of candidate modules registered in the module library 36 and usable as the image processing module 38, and the image processing module At 38, an image processing module 38 that matches the processing parameter to be executed is selected. For example, the module generation unit 44 corresponding to the module generation processing being executed is a module generation unit that generates a group of modules that perform color conversion processing. Further, when the input image data is RGB color space data, the RGB → CMY color space is selected from among a plurality of types of image processing modules 38 that perform various color space processing registered in the module library 36. The image processing module 38 that performs the conversion is selected.

  The image processing module 38 is an image processing module 38 that performs enlargement / reduction processing. If the designated enlargement / reduction ratio is other than 50%, the input image data is enlarged at the designated enlargement / reduction ratio. If the image processing module 38 for performing the reduction process is selected and the designated enlargement / reduction ratio is 50%, the enlargement / reduction process specialized for the enlargement / reduction ratio of 50%, that is, the input image data is set every other pixel. An image processing module 38 that performs a reduction process for reducing the image to 50% by thinning out is selected. The selection of the image processing module 38 is not limited to the above. For example, a plurality of image processing modules 38 having different unit processing data amounts in image processing by the image processing engine 38A are registered in the module library 36, and the image processing unit The image processing module 38 having an appropriate unit processing data amount is selected according to the operating environment such as the size of the memory area that can be allocated to 50 (for example, the image processing module 38 having a smaller unit processing data amount as the size decreases). Or the application 32 or the user may select it.

  In the next step 212, the workflow management unit 46A is notified of the set of the ID of the subsequent buffer module 40 and the ID of the generated image processing module 38. The ID may be information that can uniquely identify each module, and may be, for example, a number given in the order of generation of each module, an address of an object of the buffer module 40 or the image processing module 38 on a memory, or the like. Information notified to the workflow management unit 46A is held in the workflow management unit 46A in a table format, a list format, an associative array format, or the like and used in later processing.

  When the process of step 212 is completed, the module generation unit 44 returns the control to step 200 and determines whether there is an image processing module to be generated next. Note that each module generation unit 44 generates a corresponding group of modules that perform certain image processing, and therefore this determination is made based on what image processing module is connected to each module generation unit 44 in what connection relationship. It can also be realized by pre-registering and reading information on whether to generate, or by describing it in a program for operating the module generation unit 44. For example, the module generation unit 44 corresponding to the module generation process being executed has image processing (for example, an image processing module 38 that performs skew angle detection processing and an image processing module that performs image rotation processing) realized by a plurality of types of image processing modules 38. In the case of generating a module group for performing skew correction processing realized by 38, a module group including two or more image processing modules 38 is generated.

  When the generation of the module group that realizes the target image processing (image processing corresponding to the activated module generation unit 44) is completed, the determination in step 200 is negative and the processing proceeds to step 214. In the present embodiment, the user can select whether or not to detect the degree of progress of the image processing in the image processing unit 50 while the image processing unit 50 is performing image processing. The result is input in advance by the user operating the operation unit 18 and is stored as information in a predetermined area on the memory 14. In step 214, it is determined whether or not the detection of the degree of progress of the image processing in the image processing unit 50 is instructed by referring to the information held in the predetermined area.

  If the determination is negative, the module generation process is terminated. If the determination in step 214 is affirmative, the process proceeds to step 216, and the progress degree detection module 48 is activated (the program of the progress degree detection module 48 is executed). By generating a thread, among the image processing modules 38 generated in step 200 to step 212 described above, the next stage of the image processing module 38 positioned at the last stage (the buffer module in the next stage of the image processing module) When 40 is located, the progress degree detection module 48 is inserted between the image processing module 38 and the buffer module. In the next step 218, the workflow management unit 46A is notified of the ID of the progress degree detection module 48 inserted in step 216, so that the workflow management part 46A recognizes the insertion of the progress degree detection module 48, and module generation processing is performed. Exit.

  When the generation of the module group is notified as described above from the module generation unit 44 that has instructed generation of the module group as described above, the application 32 is required based on the determination result in step 162 of FIG. It is determined whether it is necessary to generate a module group that performs other image processing in order to realize image processing. When the required image processing is a combination of a plurality of types of image processing, the application 32 activates another module generation unit 44 corresponding to each image processing to obtain information necessary for generating a module group. The notification process is sequentially performed (see also steps 170 and 172 in FIG. 2). Then, the module generation processing (FIG. 3) described above is sequentially performed by the module generation unit 44 that is sequentially activated (see also step 174 of FIG. 2), and as an example, as shown in FIGS. 4 (A) to (C). In addition, an image processing unit 50 that performs necessary image processing is constructed.

  In addition, the activated individual module generation unit 44 generates a module group that realizes image processing corresponding to the individual module generation unit 44 as described above, but the degree of progress of image processing in the image processing unit 50 is increased. When detection is instructed, a module group generated by each module generation unit 44 (“a single image or a plurality of image processing modules including each image processing module cooperates to specify a specific image”). As an example, as shown in FIGS. 5A to 5C, the degree of progress is set to the next stage of the last image processing module 38 in each module group. An image processing unit 50 into which the detection modules 48 are inserted is constructed.

  In the present embodiment, when the execution frequency of specific image processing is high, for example, the application 32 generates a plurality of types of module generation units 44 for generating the image processing unit 50 that performs specific image processing. Even after generating the image processing unit 50 that performs specific image processing, each module is generated as a thread each time it is necessary to perform specific image processing by not instructing the end of processing to leave it as a thread. It is also possible to regenerate the image processing unit 50 that performs specific image processing by sequentially instructing the unit 44 to generate a module group. This eliminates the need to start each of the corresponding module generation units 44 every time specific image processing needs to be performed, thereby reducing the time required to regenerate the image processing unit 50 that performs specific image processing. can do.

  Incidentally, the control unit 38B of the image processing module 38 initializes the image processing module 38 when activated by the module generation unit 44. In this initialization, first, the information of the modules before and after the own module given from the module generation unit 44 is stored. Subsequently, the module preceding the own module is determined. No processing is performed when no module exists in the previous stage of the own module, but if the previous module is other than the buffer module 40, for example, the image data supply unit 22, a specific file, or the like, as necessary. The initialization process is performed. When the buffer module 40 exists in the previous stage of the own module, the data amount (unit read data amount) of the image data acquired by reading the image data from the previous buffer module 40 once is recognized. . This unit read data amount is only one if the number of buffer modules 40 in the preceding stage of the own module is one. For example, the image processing unit 50 performs image composition processing in the image processing unit 50 shown in FIG. When there are a plurality of buffer modules 40 in the previous stage and the image processing engine 38A performs image processing using the image data respectively acquired from the plurality of buffer modules 40 as in the module 38, the individual buffer modules in the previous stage The unit read data amount corresponding to 40 is determined according to the type and content of image processing performed by the image processing engine 38A of the own module, the number of buffer modules 40 in the previous stage, and the like. Then, the unit read data amount is set in all the buffer modules 40 existing in the preceding stage by notifying the recognized unit read data amount to all the buffer modules 40 existing in the preceding stage (FIG. 6 ( (See also A) (1)).

  Next, the module following the own module is determined. If the module subsequent to the own module is other than the buffer module 40, such as the image output unit 24 or a specific file, the initialization process is performed as necessary (for example, if the subsequent module is the image output unit 24, the unit For example, processing for notifying output of image data by the amount of data corresponding to the amount of write data). If the subsequent module is the buffer module 40, the amount of image data (unit write data amount) in one image data write is recognized, and the unit write data amount is set in the subsequent buffer module. (See also (2) in FIG. 6A). Then, the completion of initialization of the image processing module 38 is notified to the module generation unit 44, and the process is terminated.

  On the other hand, the buffer control unit 40B of each buffer module 40 constituting the image processing unit 50 initializes the buffer module 40 when activated by the module generation unit 44 or the application 32. In the initialization of the buffer module 40, the unit write data amount is first notified from the image processing module 38 in the previous stage of the own module or the unit read data amount is notified from the image processing module 38 in the subsequent stage of the own module. The notified unit write data amount or unit read data amount is stored (see also (1) and (2) in FIG. 6B).

  When the unit write data amount or the unit read data amount is notified from all the image processing modules 38 connected to the own module, the unit documents set by the individual image processing modules 38 connected to the own module respectively. The size of the unit buffer area, which is the management unit of the buffer 40A of the own module, is determined based on the embedded data amount and the unit read data amount, and the determined size of the unit buffer area is stored. As the size of the unit buffer area, the maximum value of the unit write data amount and the unit read data amount set in the own module is suitable. However, the unit write data amount may be set or the unit read data amount may be set. The amount of data (the maximum value of the unit read data amount set by each image processing module 38 when a plurality of image processing modules 38 are connected to the subsequent stage of the own module) may be set. The least common multiple of the write data amount and the unit read data amount (the maximum value thereof) may be set. If the least common multiple is less than the predetermined value, the least common multiple is set. A value (for example, any one of the above-mentioned unit write data amount and unit read data amount, the unit write data amount, and the unit read data amount (the maximum value)) may be set.

  Further, when the own module is generated by the application 32 and is the buffer module 40 functioning as the image data supply unit 22 or the image output unit 24, the memory area used as the buffer 40A of the own module already exists. The size of the unit buffer area determined previously is changed to the size of the existing memory area used as the buffer 40A of the own module. Further, valid data pointers corresponding to the individual image processing modules 38 subsequent to the module are generated, and the generated valid data pointers are initialized. This valid data pointer is the image data (valid data) that has not been read by the corresponding subsequent image processing module 38 among the image data written in the buffer 40A of the own module by the preceding image processing module of the own module. These pointers point to the start position (next read start position) and the end position, respectively. At initialization, specific information indicating that there is no valid data is usually set. In the case of the buffer module 40 that is generated by the application 32 and functions as the image data supply unit 22, the image data to be processed may be already written in the memory area used as the buffer 40A of the own module. Indicates that the start and end positions of the image data are Each set of the valid data pointers corresponding to the individual image processing module 38. With the above processing, the initialization of the buffer module 40 is completed, and the buffer control unit 40B notifies the workflow management unit 46A of the completion of initialization.

  On the other hand, when the construction of the image processing unit 50 that performs the required image processing is completed by the above-described module generation processing being sequentially performed by the module generation unit 44 that is sequentially activated, the application 32 starts the program of the workflow management unit 46A. Is activated to instruct the workflow management unit 46A to execute image processing by the image processing unit 50.

  The workflow management unit 46A of the processing management unit 46 performs an image processing unit control process as shown in FIG. 10 when the program is started. In the image processing unit control process, the workflow management unit 46A inputs a processing request to a predetermined image processing module 38 among the image processing modules 38 constituting the image processing unit 50, so that the image processing by the image processing unit 50 is performed in parallel. However, in the following, prior to the description of the overall operation of the image processing unit 50, the processing after the completion of the initialization processing performed by the buffer control unit 40B of each buffer module 40, the control unit 38B of each image processing module 38, The image processing module control processing to be performed will be described in order.

  In this embodiment, when the image processing module 38 writes image data to the subsequent buffer module 40, a write request is input from the image processing module 38 to the buffer module 40, and the image processing module 38 receives the previous buffer module 40. When reading image data from the image processing module 38, a read request is input from the image processing module 38 to the buffer module 40. When a write request from the preceding image processing module 38 is input to the buffer module 40 (and a timer described later times out), a data writing process described below is executed by the buffer control unit 40B. .

  In the data writing process, first, it is determined whether or not the buffer 40A of the own module is being used by another thread. Since data is also read from the buffer 40A asynchronously with the data write, when the buffer 40A is in use, the input write request information is stored in a work memory or the like, and a timer is started to write the data. The process is temporarily terminated. In the subsequent processing, the input write request information is used as information to be processed. However, if the timer has timed out and the data write processing is started, it is input in the past and stored in the work memory or the like. The write request information being taken out is extracted from the work memory or the like, and the subsequent processing is performed using the taken write request information as information to be processed.

  Subsequently, in the data writing process, the unit management data amount is notified to the resource management unit 46B as the size of the memory area to be secured, and the memory area used for writing (writing buffer area: FIG. 7B is also shown). Reference) is acquired via the resource management unit 46B (processing in the resource management unit will be described later). Next, a unit buffer area (a unit buffer in which image data of the unit write data amount can be written) has an empty area larger than the unit write data amount in the storage unit buffer area constituting the buffer 40A of the own module. It is determined whether or not (region) exists. In the buffer module 40 generated by the module generation unit 44, a memory area (unit buffer area) used as the buffer 40A is not initially secured, and a unit buffer area is secured as a unit whenever a memory area shortage occurs. Therefore, when a write request is first input to the buffer module 40, there is no memory area (unit buffer area) used as the buffer 40A, and this determination is denied. Further, even after the unit buffer area used as the buffer 40A is secured through the processing described later, the free area in the unit buffer area is less than the unit write data amount as image data is written to the unit buffer area. The above determination is also denied in the case of

  If it is determined that there is no unit buffer area (unit buffer area into which image data of the unit write data amount can be written) that has an empty area greater than the unit write data amount, the size of the memory area to be secured (A size of the unit buffer area) is notified to the resource management unit 46B, and a memory area (unit buffer area used for storing image data) used as the buffer 40A of the own module is acquired via the resource management unit 46B. Then, using the previously obtained write buffer area as a write area, the start address of the write area is notified to the image processing module 38 of the write request source, and the start address that notifies the image data to be written Request to write in order. As a result, the image processing module 38 of the writing request source writes the image data in the writing buffer area notified of the head address (see also FIG. 7B).

  For example, when the size of the unit buffer area is not an integral multiple of the unit write data amount, the writing of the image data of the unit write data amount to the buffer 40A (unit buffer area) is repeated, for example, as shown in FIG. ), The size of the empty area in the unit buffer area with the empty area is smaller than the unit write data amount. In this case, the area in which the image data of the unit write data amount is written extends over a plurality of unit buffer areas, but in this embodiment, the memory area used as the buffer 40A is secured in units of the unit buffer area. It is not guaranteed that the unit buffer areas secured at different timings are continuous areas on the real memory (memory 14). On the other hand, in the present embodiment, the image processing module 38 writes the image data to the writing buffer area secured separately from the unit buffer area for storage, as shown in FIG. Since the image data once written in the write buffer area is copied to a single unit buffer area or a plurality of unit buffer areas for storage, regardless of whether the area in which the image data is written extends over a plurality of unit buffer areas. As described above, the notification of the write area to the image processing module 38 that is the write request source only needs to be notified of the start address, and the interface with the image processing module 38 is simplified.

  If the own module is the buffer module 40 generated by the application 32, that is, if the memory area used as the buffer 40A is already secured, the address of the already secured memory area is written to the image processing module 38. This is notified as the address of the embedded area, and the image data is written to the memory area. When the writing of the image data to the writing area by the image processing module 38 in the previous stage is completed, the attribute information is added to the image data written in the writing buffer area, and then written in the storage buffer area as it is. When the size of the empty area in the unit buffer area with the empty area is smaller than the unit write data amount, the image data written in the write buffer area is stored for storage as shown in FIG. Are written separately in a plurality of unit buffer areas.

  Then, the pointer indicating the end position of the valid data among the valid data pointers corresponding to the individual image processing modules 38 subsequent to the own module is moved backward by the unit write data amount by the end position of the valid data indicated by the pointer. In addition to updating so as to move (see also FIG. 7C), the memory area previously secured as the writing buffer area is released by the resource management unit 46B, and the data writing process is temporarily terminated. The write buffer area may be secured when the buffer module 40 is initialized and may be released when the buffer module 40 is erased.

  Subsequently, a data read process executed by the buffer control unit 40B of the buffer module 40 when a read request is input from the subsequent image processing module 38 to the buffer module 40 (and a timer described later times out). explain.

  In the data read process, first, it is determined whether or not the activation factor of the current data read process is a start by inputting a read request from the subsequent image processing module. If the determination is affirmative, an input from the subsequent image processing module is performed. The read request information is registered at the end of the read queue. Next, it is determined whether or not the buffer 40A of the own module is being used by another thread. If the buffer 40A is in use, it is determined whether or not read request information is registered in the read queue. If the read request information is not registered, the data read process is terminated and the read request information is registered. If so, the data read processing is terminated after starting the timer. When this timer times out, the data reading process is started again, an unprocessed read request (information) registered in the read queue is taken out again, and a process corresponding to the read request is performed.

  On the other hand, if the buffer 40A of the own module is not in use, the read request information registered at the head is extracted from the read queue, and the read request source is based on the request source identification information included in the read request information. The image processing module 38 is recognized, the unit read data amount set by the image processing module 38 of the read request source is recognized, and the read request is based on the valid data pointer corresponding to the image processing module 38 of the read request source. The head position and end position of the valid data on the buffer 40A corresponding to the original image processing module 38 are recognized. Next, based on the recognized start position and end position of valid data, valid data corresponding to the read request source image processing module 38 (image data that can be read by the read request source image processing module 38) is unit read data. Judge whether there is more than the amount.

  If the valid data corresponding to the image processing module 38 of the read request source is less than the unit read data amount, whether or not the end of the valid data that can be read by the image processing module 38 of the read request source is the end of the image data to be processed judge. Valid data corresponding to the image processing module 38 of the read request source is stored in the buffer 40A at a unit read data amount or more, or valid data corresponding to the image processing module 38 of the read request source stored in the buffer 40A is stored. If the end of the valid data is the end of the image data to be processed, although it is less than the unit read data amount, the unit read corresponding to the image processing module 38 that is the read request source is the size of the memory area to be secured. Not only the resource management unit 46B is notified of the amount of data, but also requests the resource management unit 46B to secure a memory area used for reading (see also the buffer area for reading: FIG. 8B), and the data is read via the resource management unit 46B. Get the buffer area.

  Next, the effective data to be read is read from the buffer 40A by the amount of the unit read data and written to the read buffer area, and the head address of the read buffer area is used as the read area start address to the read request source image processing module 38. Along with the notification, the image data is requested to be read sequentially from the notified head address. As a result, the image processing module 38 as the read request source reads the image data from the read area (read buffer area) to which the head address is notified. When the effective data to be read is data corresponding to the end of the image data to be processed, the size of the image data to be read is requested at the end of the image data to be processed when the image data is requested to be read. This is also notified to the image processing module 38 of the reading request source. When the own module is the buffer module 40 generated by the application 32, the memory area (collection of unit buffer areas) used as the buffer 40A is a continuous area. The writing of the target image data to the reading buffer area may be omitted, and the subsequent image processing module 38 may read the image data directly from the unit buffer area.

  As an example, as shown in FIG. 8A, the amount of valid data stored in the unit buffer area in which the image data of the head portion of the valid data is stored is less than the unit read data amount. When the target valid data extends over a plurality of unit buffer areas, the current target valid data is not always stored in a continuous area on the real memory (memory 14). In the data reading process, as shown in FIGS. 8B and 8C, even in such a case, the image data to be read is once written in the reading buffer area and then read from the reading buffer area. Therefore, regardless of whether or not the image data to be read is stored across a plurality of unit buffer areas, the read request is notified to the image processing module 38 of the read request source as described above. It is only necessary to notify the start address, and the interface with the image processing module 38 is simplified.

  When the completion of reading of the image data from the reading area by the image processing module 38 of the reading request source is notified, the start address and size of the memory area secured as the reading buffer area are notified to the resource management unit 46B, and the memory The area is released by the resource management unit 46B. This read buffer area may also be secured when the buffer module 40 is initialized and released when the buffer module 40 is erased. Further, by moving the pointer representing the start position of the valid data among the valid data pointers corresponding to the image processing module 38 that is the read request source, the start position of the valid data indicated by the pointer is moved backward by the unit read data amount. Update (see also FIG. 8C).

  Next, the effective data pointers corresponding to the individual image processing modules 38 in the subsequent stage are respectively referred to, and each of the subsequent stages of the stored image data is stored in the unit buffer area constituting the buffer 40A by updating the previous pointer. It is determined whether or not a unit buffer area that has been completely read by the image processing module 38, that is, a unit buffer area that does not store valid data, has appeared. If the determination is negative, the data reading process is terminated through the above-described reading queue check process (determination as to whether or not read request information is registered in the reading queue), but valid data When a unit buffer area that does not store is appeared, the unit buffer area is released by the resource management unit 46B, and then the data read process is terminated through a check process for the read queue.

  On the other hand, the amount of valid data stored in the buffer 40A and readable by the image processing module 38 that is the read request source is less than the unit read data amount, and the end of the readable valid data is the image data to be processed. If it is not the end (when no valid data that can be read is detected in (4) of FIG. 6B), a data request for requesting new image data is output to the workflow management unit 46A (FIG. 6 ( (See also (5) of B)) Read request information retrieved from the read queue is re-registered in the original queue (at the beginning or end), and then the data is read through the check process of the read queue The process ends. In this case, the workflow management unit 46A inputs a processing request to the image processing module 38 in the previous stage of the own module. As a result, until the amount of valid data that can be read exceeds the unit read data amount or until the end of the valid data that can be read is detected to be the end of the image data to be processed, the corresponding readout is performed. The request information is stored in a read queue and is periodically retrieved to repeatedly execute the requested process.

  Although details will be described later, when a data request is input from the buffer module 40, the workflow management unit 46A inputs a processing request to the image processing module 38 in the preceding stage of the buffer module 40 that is the data request source (see FIG. 6B). (See also (6)). When the processing of the control unit 38B of the preceding image processing module 38 is triggered by the input of this processing request, when the preceding image processing module 38 can write image data to the buffer module 40, the preceding image processing is performed. When the writing request is input from the module 38, the above-described data writing process is performed, and the image data is written from the preceding image processing module 38 to the buffer 40A of the buffer module 40 ((7) in FIG. 6B). ), See also (8)). As a result, the image data is read from the buffer 40A by the subsequent image processing module 38 (see also (9) in FIG. 6B).

  In the above-described data writing process and data reading process, exclusive control is performed so that while one is accessing the buffer 40A of its own module, the other stops accessing the buffer 40A. Thereby, even if the CPU 12 of the computer 10 executes the threads corresponding to the individual modules constituting the image processing unit 50 in parallel, a plurality of requests are input to the single buffer module 40 simultaneously or substantially simultaneously. Since the occurrence of inconvenience can be avoided, the CPU 12 of the computer 10 can execute threads corresponding to individual modules in parallel.

  Subsequently, each time a processing request is input from the workflow management unit 46A to the individual image processing modules 38 constituting the image processing unit 50, the image processing modules respectively performed by the control unit 38B of the individual image processing module 38. The control process (FIG. 9) will be described.

  In the image processing module control process, first, in step 220, when a module (the buffer module 40, the image data supply unit 22, the image processing module 38, etc.) exists in the previous stage of the own module, the module in the previous stage is processed. Data (image data or processing result of image processing such as analysis) is requested. In the next step 222, it is determined whether data can be acquired from the previous module. If the determination in step 222 is negative, it is determined in step 224 whether the end of the entire process has been notified. If the determination in step 224 is negative, the process returns to step 222, and steps 222 and 224 are repeated until data can be acquired from the preceding module. If the determination in step 222 is affirmed, data acquisition processing is performed in which data is acquired from the preceding module in step 226 and the acquired data is written in a temporary storage memory area.

  Here, if the previous module of the own module is the buffer module 40, when data is requested in the previous step 220 (read request), the readable valid data is transferred to the buffer 40A of the buffer module 40 in the unit read data amount. As long as the end of the valid data that has been stored or readable matches the end of the image data to be processed, the image processing module 38 in the previous stage of the buffer module 40 immediately returns to the state of the image data to be processed. After the image data is written in the buffer 40A of the buffer module 40, the state is changed to the above state, and then the start address of the reading area is notified from the buffer module 40 and the reading of the image data is requested. As a result, the determination at step 222 is affirmed and the routine proceeds to step 226, where image data of a unit read data amount (or a data amount less than that) is read from the read area in which the head address is notified from the preceding buffer module 40, Data acquisition processing to be written into the temporary storage memory area is performed (see also (3) in FIG. 6A).

  If the previous module of the own module is the image data supply unit 22, the image data supply unit 22 immediately notifies that the image data can be acquired when the data request is output in the previous step 220. As a result, the determination at step 222 is affirmed, and the routine proceeds to step 226, where image data of a unit read data amount is acquired from the image data supply unit 22 at the previous stage, and data acquisition processing for writing into the temporary storage memory area is performed. . If the previous module of the own module is the image processing module 38, a data request (processing request) is output in the previous step 220. If the previous image processing module 38 is ready to perform image processing, the data request is written. Since it is notified that the data (image processing result) can be acquired by inputting the load request, the determination in step 222 is affirmed and the process proceeds to step 226. The data acquisition process for writing the data output from the image processing module 38 in the previous stage to the temporary storage memory area is performed by notifying the address of the temporary storage memory area where the data is written and requesting the writing.

  In the next step 228, it is determined whether or not a plurality of modules are connected to the previous stage of the own module. If the determination is negative, the process proceeds to step 232 without performing any processing. If the determination is affirmative, the process proceeds to step 230, and whether or not data has been acquired from all modules connected in the previous stage. To determine. If the determination in step 230 is negative, the process returns to step 220, and steps 220 to 230 are repeated until the determination in step 230 is positive. When all the data to be acquired from the previous module is obtained, the determination in step 228 is denied or the determination in step 230 is affirmed, and the process proceeds to step 232.

  In the next step 232, an area for data output is requested to the module subsequent to the module, and the determination is repeated until the data output area can be acquired in step 232 (until the start address of the data output area is notified). . If the subsequent module is the buffer module 40, the request for the data output area is made by outputting a write request to the buffer module 40. When the data output area (the write area in which the start address is notified from the buffer module 40 if the subsequent module is the buffer module 40) can be acquired (see also (4) in FIG. 6A), the next step In 236, the data acquired in the previous data acquisition process, the data output area (start address) acquired from the subsequent module, and the memory area (start address and size) for image processing are input to the image processing engine 38A. The input data is subjected to predetermined image processing using the image processing memory area (see also (5) in FIG. 6A), and the processed data is written to the data output area (see FIG. 6). (See also 6 (A) (6)). When the input of the unit read data amount to the image processing engine 38A is completed and all the data output from the image processing engine 38A is written in the data output area, the subsequent step 238 indicates that the output has been completed. Notify the module.

  The processing (unit processing) for the data of the unit processing data amount in the image processing module 38 is completed by the above step 220 to step 238, and in the next step 242, the processing completion notification is output to the workflow management unit 46A, so that the input is performed. The workflow management unit 46A is notified that the processing corresponding to the requested processing request has been completed, and the image processing module control processing is terminated.

  Further, when the processing image data is processed to the end by repeating the above-described processing every time a processing request is input from the workflow management unit 46A, the end of the processing target image data is notified from the preceding module. Thus, the determination in step 224 is affirmed, and the process proceeds to step 244. The image data to be processed (note that the image data to be processed is often image data for one page, but is image data for a plurality of pages. An overall process end notification that means that the process for (which may be present) has ended is output to the workflow management unit 46A and the subsequent module. In the next step 246, a process for requesting the release of all acquired resources and deleting the own module is performed, and the image processing module control process is terminated.

  On the other hand, when activated by the application 32, the workflow management unit 46A performs the image processing unit control process 1 shown in FIG. In the image processing unit control processing 1, first, in step 500, a predetermined area on the memory 14 in which the result of the user's selection as to whether or not to detect the progress of the image processing in the image processing unit 50 is held as information is stored. By referencing, it is determined whether or not the detection of the degree of progress of the image processing in the image processing unit 50 is instructed. In the following, the process when the detection of the degree of progress of image processing is instructed will be described first, and the process when the detection of the degree of progress of image processing is instructed will be described later. If the determination is negative, the process proceeds to step 508, a processing request is input to the last image processing module 38 in the image processing unit 50 (see (1) in FIG. 11), and the image processing unit control processing 1 is terminated. To do.

Here, in the image processing unit 50 shown in FIG. 11, when the process from the workflow management unit 46A to the image processing module 38 ₄ of the last stage request is input, the control unit 38B of the image processing module 38 ₄ preceding buffer module 40 _A read request is input to ₃ (see (2) in FIG. 11). At this time, since the image processing module 38 ₄ readable valid data in the buffer 40A of the buffer module 40 ₃ (image data) is not stored, the buffer controller 40B of the buffer module 40 ₃ data in the workflow management unit 46A A request is input (see (3) in FIG. 11).

The workflow management unit 46A performs the image processing unit control process 2 shown in FIG. 10B every time a data request is input from the buffer module 40. In this image processing unit control process 2, in step 510, the image processing module 38 (here, the image processing module 38 ₃ ) of the preceding stage of the buffer module 40 (here, the buffer module 40 ₃ ) of the data request input source is recognized and recognized. The processing request is input to the preceding image processing module 38 (see (4) in FIG. 11), and the processing ends.

Control unit 38B of the image processing module 38 _3, the processing request is input to the input read request preceding the buffer module 40 ₂ (see (5) in FIG. 11), read in the buffer 40A of the buffer module 40 ₂ since possible image data is not stored, the buffer controller 40B of the buffer module 40 ₂ inputs the data request to the workflow management unit 46A (see (6) in FIG. 11). Workflow management unit 46A, even if the data request is input from the buffer module 40 _2, by performing the image processing unit control processing 2 described above again, enter the processing request to the image processing module 38 ₂ of the preceding stage (FIG. 11 (7)), the control unit 38B of an image processing module 38 ₃ inputs the read request to the buffer module 40 ₁ of the front reference ((8 in FIG. 11)). Further, since the readable image data to the buffer 40A of the buffer module 40 ₁ is not stored, the buffer controller 40B of the buffer module 40 ₁ also inputs the data request to the workflow management unit 46A (in FIG. 11 (9) reference). Even when a data request is input from the buffer module 40 ₁ , the workflow management unit 46A performs the above-described image processing unit control processing 2 again to input a processing request to the preceding image processing module 38 ₁ (see FIG. 11 (10)).

Here, since the previous module of the image processing module 38 ₁ is the image data supply unit 22, the control unit 38 B of the image processing module 38 ₁ inputs a data request to the image data supply unit 22, and thereby the image data supply unit 22. The image data of the unit read data amount is acquired from the image data 22 (see (11) in FIG. 11), and the image data obtained by the image processing engine 38A performing image processing on the acquired image data is stored in the subsequent buffer. write module 40 _first buffer 40A (see (12) in FIG. 11).

Further, the buffer control unit 40B of the buffer module 40 ₁ requests the image processing module 38 ₂ to read when valid data exceeding the unit read data amount that can be read by the subsequent image processing module 38 ₂ is written. the image processing module 38 _{and second} control unit 38B with the reads image data of the unit read data amount from the buffer module 40 ₁ of buffer 40A (see (13) in FIG. 11), the image processing engine on the acquired image data 38A is an image data obtained by performing image processing, written in the following buffer module 40 _second buffer 40A (see (14) in FIG. 11).

Similarly, the buffer controller 40B of the buffer module 40 _2, requested read when the subsequent image processing module 38 ₃ readable unit read data amount or more valid data is written to the image processing module 38 _3, image control unit 38B of the processing modules 38 ₃ reads the image data of the unit read data amount from the buffer module 40 _second buffer 40A (see (15) in FIG. 11), the image processing engine 38A is an image on the acquired image data the image data obtained by performing the processing, written in the following buffer module 40 _third buffer 40A (see (16) in FIG. 11).

The buffer controller 40B of the buffer module 40 ₃ may request the reading the following image processing module 38 ₄ readable unit read data amount or more valid data is written to the image processing module 38 _4, which control unit 38B of the image processing module 38 ₄ with the reads the image data of the unit read data amount from the buffer module 40 _third buffer 40A (see (17) in FIG. 11), the image processing engine on the acquired image data The image data obtained by the image processing performed by 38A is output to the image output unit 24, which is a subsequent module (see (18) in FIG. 11).

  In addition, when the control unit 38B of each image processing module 38 completes the writing of the image data to the buffer 40A of the subsequent buffer module 40, the control unit 38B inputs a processing completion notification to the workflow management unit 46A. The workflow management unit 46A performs image processing unit control processing 3 shown in FIG. 10C every time a processing completion notification is input from the image processing module 38. In this image processing unit control process 3, in step 520, the process request is input again to the image processing module 38 that is the process completion notification source, and the process ends. In this way, every time a processing completion notification is input from an arbitrary image processing module 38, by inputting the processing request again to the processing completion notification source image processing module 38, the image processing on the processing target image data is performed. This is done in parallel by the individual image processing modules 38.

  When the image data supplied from the image data supply unit 22 reaches the end of the image data to be processed, the input of the overall processing end notification from the individual image processing module 38 to the workflow management unit 46A is sent to the preceding image. The processing modules 38 are sequentially performed. The workflow management unit 46A performs the image processing unit control process 5 shown in FIG. 10E every time an overall processing end notification is input from the image processing module 38.

  In this image processing unit control process 5, in step 540, it is determined whether or not the image processing module 38 that is the input source of the overall process end notification is the last image processing module 38. If the determination is negative, the process ends without performing any process, but all the image data that has undergone the necessary image processing on the image data to be processed is output to the image output unit 24. When an overall processing end notification is input from the last-stage image processing module 38, the determination in step 540 is affirmed, and the process proceeds to step 544 through step 542 (described later), and the application 32 is notified of completion of image processing. The image processing unit control process 5 is terminated. The application 32 notified of the completion of the image processing notifies the user of the completion of the image processing.

  Next, a process when the detection of the degree of progress of image processing is instructed will be described. If the detection of the degree of progress of the image processing is instructed, the determination in step 500 of the image processing unit control process 1 (FIG. 10A) described above is affirmed and the process proceeds to step 502, and the individual degree of progress is detected. The total amount of output image data output from the image processing module 38 in the preceding stage of the module 48 is recognized, and the recognized total data amount is notified to the individual progress degree detection modules 48. The total amount of output image data is determined based on the total amount of input image data input to the specific image processing module 38 and the type of image processing performed by the specific image processing module 38. The total amount of output image data output from the image processing module 38 is calculated in order from the image processing module 38 in the foremost stage of the image processing unit 50 (note that the image processing in the foremost stage of the image processing unit 50 is performed). For the module 38, the image data amount of the processing target image data input to the image processing unit 50 is the total data amount of the input image data, and for the other image processing modules 38, the last stage on the front side of the own module. The total amount of output image data output from the image processing module 38 is the total amount of input image data). It can be obtained by determining the total amount of data of the output image data from the module 38 in turn.

  In step 504, an initial screen as shown in FIG. 12A is displayed on the display unit 16 as an example of the image processing progress display screen. As shown in FIG. 12, the progress degree display screen according to the present embodiment has numerical values (percentages) for the progress degree of image processing in each image processing module 38 and the progress degree of image processing as the entire image processing unit 50. A display area for displaying and a display area for displaying a bar graph (progress bar) 52 indicating the progress degree of the image processing as the entire image processing unit 50 are provided. In step 504, the progress degree display screen is displayed. As an initial screen, a screen that clearly indicates that the degree of progress of image processing is 0% is displayed on the display unit 16. In step 506, a timer for detecting timing for performing processing such as collection of the detection result of the progress degree is started, and the image processing unit control processing 1 is completed through the processing in step 508 described above. Note that the timer value (execution time interval of processing such as collection of the detection result of the degree of progress) may always be a constant value, but the scale of the image processing unit 50 (the number of modules constituting the image processing unit 50) ), The amount of image data to be processed, the display accuracy of the degree of progress of requested image processing, and the like may be switched.

  On the other hand, when the progress degree detection module 48 provided in the image processing unit 50 is notified of the total amount of output image data from the previous image processing module 38 from the workflow management unit 46A, FIG. The initialization process shown in Fig. 2 is performed. In this initialization process, first, in step 560, the total amount of image data output from the previous image processing module 38 notified from the workflow management unit 46A is stored in a predetermined memory area. In step 562, the count value indicating the count result of the data amount of the output image data from the previous image processing module 38 is initialized, and the initialization process ends.

  At the time of initialization of the image processing unit 50, information for reporting the unit write data amount to the subsequent buffer module 40 to the individual progress degree detection modules 48 provided in the image processing unit 50 is the preceding image processing module. In this case, each progress degree detection module 48 outputs the information input from the preceding image processing module 38 to the subsequent buffer module 40 as it is.

  When a processing request is input from the workflow management unit 46A to the final image processing module 38 of the image processing unit 50 in step 508 of the image processing unit control processing 1 (FIG. 10A), the image is processed as described above. Image processing in the processing unit 50 is started, and accordingly, each progress degree detection module 48 provided in the image processing unit 50 is requested to write image data as information addressed to the subsequent buffer module 40. Information (writing request) and information for writing completion (writing completion notification) are input from the preceding image processing module 38, and are sent to the writing buffer area as information addressed to the preceding image processing module 38. Information for requesting writing of image data (writing request) is input from the buffer module 40 in the subsequent stage. Each time the degree-of-advance detection module 48 receives these pieces of information from the preceding image processing module 38 or the succeeding buffer module 40, the received information is sent to the original destination (the following buffer module 40 or the preceding image). The data is directly output to the processing module 38).

  Thereby, even when the progress degree detection module 48 is inserted in the image processing unit 50, the individual image processing modules 38 and the buffer modules 40 provided in the image processing unit 50 detect the progress degree in the image processing unit 50. By performing the same processing as when the module 48 is not inserted, image processing in the image processing unit 50 is realized.

  The information input as a write request from the subsequent buffer module 40 includes the start address of the write buffer area, but each progress degree detection module 48 provided in the image processing unit 50 When information corresponding to the above write request is input from the subsequent buffer module 40, the start address of the write buffer area is extracted from the input information, and the extracted start address is stored in a predetermined memory area. After the storage, the input information (write request) is output to the preceding image processing module 38. Each progress degree detection module 48 provided in the image processing unit 50 receives a write completion notification from the preceding image processing module 38 after information corresponding to the writing request is input from the succeeding buffer module 40. When the corresponding information is input, the progress degree detection process shown in FIG.

  In this progress degree detection process, first, in step 570, based on the head address of the write buffer area previously stored in the predetermined memory area, the write buffer into which the image data has been written by the image processing module 38 in the previous stage. By referring to the area, the data amount of the image data written in the write buffer area is detected. In the next step 572, the data amount detected in step 570 is added to the count value of the data amount of the output image data from the previous image processing module 38. In step 574, the count value of the data amount of the output image data calculated in step 572 is used as the degree of progress of image processing at the insertion position of the own module (the degree of progress of image processing in the image processing module 38 preceding the own module). A value obtained by dividing the total amount of output image data notified from the workflow management unit 46A is calculated. In the next step 576, the progress degree calculated in step 574 is stored in a predetermined memory area. In step 578, the writing completion notification input from the preceding image processing module 38 is output as it is to the succeeding buffer module 40, and the progress degree detection processing ends.

  In this way, each progress degree detection module 48 provided in the image processing unit 50 has a data amount of the written image data each time the image data is written to the writing buffer area by the image processing module 38 in the previous stage. And the progress degree of the image processing is appropriately updated based on the detected data amount.

  Next, the image processing unit control processing 4 performed in the workflow management unit 46A when the timer started in step 506 of the image processing unit control processing 1 (FIG. 10A) times out will be described with reference to FIG. This will be described with reference to a flowchart.

  In the image processing unit control processing 4, in step 530, first, information for inquiring about the degree of progress of the image processing detected by the individual degree of progress detection module 48 is sent to all the progress degree detection modules 48 provided in the image processing unit 50. Output each. When the above information is input from the workflow management unit 46A, the individual progress degree detection module 48 provided in the image processing unit 50 performs a progress degree notification process (FIG. 13C). Information representing the detection result of the degree of progress is read from a predetermined memory area and output to the workflow management unit 46A. In step 530 of the image processing unit control process 4, every time information indicating the detection result of the progress of image processing is input from each progress detection module 48, the input information is stored in a predetermined memory area. Thus, information representing the detection result of the progress degree is collected from all the progress degree detection modules 48.

  In the next step 532, a numerical value is displayed on the progress degree display screen displayed on the display unit 16 based on the information indicating the detection result of the degree of progress of the image processing collected from the individual progress degree detection module 48 in step 530. The display of the progress display screen is updated by rewriting the progress of the image processing of each individual image processing module 38. Further, in step 534, by calculating the average value of the progress of the image processing collected from the individual progress detection modules 48, the progress of the image processing as the entire image processing unit 50 is calculated and displayed on the progress display screen. The progress degree of the entire image processing unit 50 displayed as the numerical value and the bar graph 52 is updated according to the calculated progress degree. The amount of output image data is collected from each progress degree detection module 48, and the sum of the collected data amounts is divided by the total value of the total data notified to each progress degree detection module 48. The value obtained in this way may be used as the degree of progress of image processing of the image processing unit 50 as a whole. In the next step 536, the timer is restarted and the image processing unit control process 4 is terminated.

  Thus, each time the timer times out, the image processing unit control process 4 is started, and the progress degree is collected, calculated, and displayed (display update of the progress degree display screen) from each progress degree detection module 48. Thus, the progress degree of the image processing displayed on the progress degree display screen is updated approximately in real time (see also FIGS. 12B and 12C), and the progress degree display screen displayed on the display unit 16 is updated. By referring to the above, it is possible to grasp the degree of progress of image processing in the image processing unit 50 in real time. When a notification of the end of the entire process is input from the last-stage image processing module 38 to the workflow management unit 46A, the timer is stopped in step 542 of the image processing unit control process 5 (FIG. 10E). Detection of the degree of progress of image processing is also terminated.

  As described above, in the present embodiment, when the detection of the degree of progress of image processing in the image processing unit 50 is instructed, the amount of output image data from the previous image processing module 38 is counted to perform image processing. A progress degree detection module 48 that detects the degree of progress is inserted into the subsequent stage of the image processing module 38 by the module generation unit 44, and is detected by the individual progress degree detection modules 48 during execution of image processing in the image processing unit 50. The degree of progress of image processing is collected by the workflow management unit 46A, and the degree of progress of image processing in the image processing unit 50 is calculated and displayed. Therefore, without changing the configuration of the image processing module 38 or the buffer module 40, The degree of progress of image processing in the image processing unit 50 can be detected.

Note that, as the degree of progress of image processing in the image processing unit 50, the simple average of the degree of progress of image processing collected from each individual degree of progress detection module 48 is used in the above, but the present invention is limited to this. Instead, for example, based on the result of measuring the processing speed of the image processing in each image processing module 38 in advance, a weight is given to each image processing module 38 constituting the image processing unit 50, and image processing is performed. As the degree of progress of image processing in the unit 50, a weighted average of the degree of progress of image processing collected from each of the degree of progress detection modules 48 may be calculated. Specifically, for example, the image processing unit 50 is configured to include _three image processing modules 38 ₁ , 38 ₂ , and 38 _3, and among these, the image processing module 38 ₂ is an image that is higher than the image processing modules 38 ₁ and 38 _3. If the processing speed of the processing is low, for example, the image processing module 38 _1, 38 _2, and 38 ₃ of each weight 1,2,1, the progress of image processing in the example image processing module 38 _1, 38 _2, 38 ₃ When each is 50%, 20%, 50%, the weighted average value of the progress degree as the progress degree of the image processing in the image processing unit 50 = (1 × 0.5 + 2 × 0.2 + 1 × 0.5) / 4 = 30% (however, 4 may be calculated and displayed.

  In the above description, the individual progress degree detection module 48 has been described as detecting the progress degree of the image processing based on the data amount of the output image data from the previous image processing module 38. However, the present invention is not limited to this. Instead, the image processing module 38 according to the present embodiment is configured to output the image data to the subsequent stage by a fixed amount (unit write data amount), so that the output of the image data from the preceding image processing module 38 is performed. By counting the number of times, it is possible to configure the progress degree detection module 48 so as to detect the progress degree of the image processing, and to detect the progress degree of the image processing in the image processing unit 50.

  Further, in the above description, when the detection of the degree of progress of the image processing in the image processing unit 50 is instructed, the module generation unit 44 is next to the image processing module 38 positioned at the last stage among the generated module group. Although the embodiment has been described in which the progress degree detection module 48 is inserted into the stage (between the image processing module 38 and the buffer module when the buffer module 40 is located at the next stage of the image processing module), the progress degree detection module has been described. The insertion position of 48 is not limited to the above, and the progress degree detection module 48 that detects the progress degree of the image processing based on the data amount of the image data from the previous stage or the output count of the image data is shown in FIG. As shown in FIG. 14B, it may be inserted in the next stage of the buffer module 40, or as shown in FIG. It may be inserted into the next stage of the module 38 and the next stage of the buffer module 40, respectively.

  In the above description, the result of calculating (detecting) the progress of image processing is displayed on the display unit 16 as a progress display screen. However, the present invention is not limited to this, The processing completion time of the image processing in the image processing unit 50 may be predicted based on the calculation (detection) of the processing progress degree, and the predicted processing completion time may be displayed on the display unit 16. Based on the result of calculating (detecting) the degree of progress of image processing, the execution priority of a program corresponding to each image processing module 38 (or a program corresponding to the buffer control unit 40B of each buffer module 40), Various resources for each image processing module 38 (for example, storage resources such as the memory 14, CPU, arithmetic unit for MMX (MultiMedia eXtention), SSE (Streaming SIM) (D Extension) computing unit, and allocation of program execution resources (high-speed computing units such as DSP (Digital Signal Processor) provided separately from the CPU) according to the degree of progress of image processing in the image processing unit 50 (For example, at the beginning of execution of image processing, the execution priority of the module on the upstream side of the image processing unit 50 is increased, or various resources are preferentially allocated to the module on the upstream side, and as the image processing progresses, The execution priority of the side module and the allocation priority of various resources may be relatively increased).

  Furthermore, although the aspect which applied this invention to the execution form which performs the image processing in each image processing module 38 of the image process part 50 in parallel above was demonstrated, the execution form of image processing is not limited above. Absent. In the image processing unit 50, for example, image processing (unit processing) is repeatedly performed only by a single image processing module 38, image processing for one surface of image data in the image processing module 38 is completed, and the image processing When image data for one surface is accumulated in the buffer 40A of the buffer module 40 subsequent to the module 38, the image processing module 38 for repeatedly performing image processing (unit processing) is stored in the buffer 40A. The image processing is performed in an execution form (so-called plane unit processing) in which the control to switch to the single image processing module 38 in the subsequent stage of the accumulated buffer module 40 is applied in order from the image processing module 38 in the previous stage of the image processing unit 50. In the present invention, the image processing unit 50 is controlled so that image processing is performed by plane unit processing. It can also be applied to the detection of the degree of progress of the case that.

  Further, in the above description, the image processing program group 34 corresponding to the image processing program according to the present invention is stored (installed) in the computer 10 in advance. However, the image processing program according to the present invention may be a CD-ROM, It is also possible to provide in a form recorded on a recording medium such as a DVD-ROM.

It is a block diagram which shows schematic structure of the computer (image processing apparatus) which concerns on this embodiment. It is a sequence diagram for demonstrating the process by an application. It is a flowchart which shows the content of the module production | generation process performed by the module production | generation part. It is a block diagram which shows the structural example of an image process part. It is a block diagram which shows the example of the image process part in which the progress degree detection module was inserted. (A) is an image processing module, and (B) is a block diagram showing a schematic configuration of a buffer module and processing to be executed. It is the schematic explaining the case where the image data to be written straddles a plurality of storage unit buffer areas. It is the schematic explaining the case where the image data to be read straddles a plurality of storage unit buffer areas. It is a flowchart which shows the content of the image processing module control process performed by the control part of an image processing module. It is a flowchart which shows the content of the image process part control process performed by the process management part. It is the schematic explaining the flow of the image processing in an image process part. It is an image figure which shows an example of a progress degree display screen. (A) is an initialization process, (B) is a flowchart showing a progress degree detection process, and (C) is a flowchart showing a progress degree notification process executed by the progress degree detection module. It is a block diagram which shows the other example of the insertion location of the progress degree detection module to an image process part.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Computer 16 Display part 38 Image processing module 40 Buffer module 42 Process construction part 44 Module production | generation part 46 Process management part 46A Workflow management part 48 Progress degree detection module 50 Image processing part

Claims (7)

A unit of a series of processes for acquiring image data from the previous stage of the own module, performing predetermined image processing on the acquired image data, and outputting the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module A buffer module that performs processing for causing an image processing module program to be processed for each processing amount and image data output from the preceding stage of the own module to be written in a buffer, and reading the image data stored in the buffer by a subsequent stage of the own module A program of the progress degree detection module for detecting the progress degree of the image processing at the insertion position of the own module by counting the number of output times of the image data from the previous stage of the own module or the data amount of the image data, Storage means for storing each of
Using the program of each module stored in the storage means, the buffer module is connected to at least one of the preceding stage and the succeeding stage of the image processing module, and each module is in a pipeline form or a directed acyclic graph form. A constructing unit that constructs an image processing unit connected to each other and inserts the progress degree detection module on the rear side of one or more image processing modules constituting the image processing unit;
The degree of image processing detected by each of the degree-of-advance detection modules inserted into the image processing unit by the construction unit is collected, and the degree of image processing in the image processing unit is collected based on the collected degree of progress. Management means to detect,
An image processing apparatus. The construction means inserts the progress degree detection module into the image processing section when the detection of the degree of progress of image processing in the image processing section is instructed,
The management means collects the progress degree and detects the progress degree of the image processing in the image processing section when the image processing section in which the progress degree detection module is inserted is constructed by the construction means. The image processing apparatus according to claim 1, wherein:   The construction means inserts the progress degree detection modules at the subsequent stage side of all the image processing modules constituting the image processing module when the detection of the degree of progress of the image processing in the image processing unit is instructed. Alternatively, among the image processing modules constituting the image processing unit, a subsequent group of units each including a single or a plurality of image processing modules and implementing a specific image processing in cooperation with each module. The image processing apparatus according to claim 1, wherein each of the progress degree detection modules is inserted on each side. The management means includes the amount of image data to be processed by the image processing unit, the contents of image processing in each image processing module existing on the front side of the specific progress degree detection module, and the previous stage of the specific progress degree detection module. Based on the unit processing amount of the image processing module, the total number of output times of the image data from the preceding image processing module until the image processing unit completes the processing on the image data to be processed is calculated in advance. The notification process is performed on each of the progress degree detection modules inserted into the image processing unit,
Each of the progress degree detection modules inserted in the image processing unit counts the number of times image data is input from the previous image processing module, and the counted number is the total number of outputs notified in advance from the management unit. The image processing apparatus according to claim 1, wherein the degree of progress of the image processing is detected by division. The management means includes the image processing unit based on the amount of image data to be processed by the image processing unit and the content of the image processing in each image processing module existing on the upstream side of the specific progress detection module. A process for preliminarily calculating and notifying the total amount of image data output from the preceding image processing module until the processing for the image data to be processed is completed has been inserted into the image processing unit. For each said progress detection module,
Each progress degree detection module inserted in the image processing unit counts the data amount of the image data input from the preceding image processing module, and the total data notified in advance from the management means of the counted data amount The image processing apparatus according to claim 1, wherein the degree of progress of the image processing is detected by dividing by an amount.   6. The image processing apparatus according to claim 1, wherein the management unit causes the display unit to display the detected degree of image processing in the image processing unit. A unit of a series of processes for acquiring image data from the previous stage of the own module, performing predetermined image processing on the acquired image data, and outputting the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module A buffer module that performs processing for causing an image processing module program to be processed for each processing amount and image data output from the preceding stage of the own module to be written in a buffer, and reading the image data stored in the buffer by a subsequent stage of the own module A program of the progress degree detection module for detecting the progress degree of the image processing at the insertion position of the own module by counting the number of output times of the image data from the previous stage of the own module or the data amount of the image data, A computer connected to storage means for storing each of
Using the program of each module stored in the storage means, the buffer module is connected to at least one of the preceding stage and the succeeding stage of the image processing module, and each module is in a pipeline form or a directed acyclic graph form. A constructing means for constructing an image processing unit connected to each other and inserting the progress degree detection module on a subsequent stage side of one or more image processing modules constituting the image processing unit;
And collecting the degree of progress of the image processing detected by each of the degree-of-progress detection modules inserted into the image processing unit by the construction means, and performing image processing in the image processing unit based on the collected degree of progress. An image processing program that functions as a management means for detecting the degree of progress.

Images