WO2020162081A1 - Image forming device - Google Patents

Abstract

This image forming device (1) is provided with: an error determination unit (101) which determines whether an error related to a predetermined component has occurred; an HDD (92) having a storage table (92A) which stores, in advance in association with each other, the component, the error, and a check part to be checked when the error has occurred; a specifying unit (102) which specifies the component and the check part corresponding to the error by using the storage table (92A), when the error is determined to have occurred by the error determination unit (101); an acquisition unit (103) which acquires a captured image obtained by capturing an image of the check part to be checked when the error has occurred; and a display control unit (105) which displays, on a display unit (473), the captured image acquired by the acquisition unit (103) as a guidance image that shows a work sequence for eliminating the error.

Description

Image forming device

The present invention relates to an image forming apparatus, and more particularly to a technique for displaying a guidance image indicating a work procedure for eliminating an error such as paper jam or toner exhaustion.

Some image forming apparatuses such as printers and multi-function peripherals have a function of displaying operation guidance (guidance image) for eliminating errors when an error such as paper jam or toner exhaustion occurs ( See Patent Document 1). In such an image forming apparatus, even an operator who is unfamiliar with the operation of the equipment can perform the recovery work while viewing the guidance image to eliminate the error.

JP, 2005-208335, A

The above image forming apparatus displays a guidance image for error cancellation prepared in advance on the display unit of the image forming apparatus when an error such as paper jam or toner exhaustion occurs, but the guidance image is different from the actual situation. If there is a difference between the guidance image and the actual state of the error position of the image forming apparatus, it may be difficult for the operator to understand the guidance image, and recovery work cannot be performed quickly. There is a problem.

The present invention has been made in view of the above circumstances, and it is an object of the present invention to enable an operator to clearly tell which part should be operated when an error occurs in the image forming apparatus.

An image forming apparatus according to one aspect of the present invention is an image forming apparatus that forms an image on a recording medium, and determines whether or not an error has occurred regarding a display unit and a predetermined component of the image forming apparatus. An error determination unit, a storage unit having a storage table that stores in advance the predetermined component, the error relating to the component, and the confirmation site to be confirmed when an error occurs in advance, and the error determination unit When it is determined that the error has occurred, the storage table is used to specify a component and a confirmation part corresponding to the error determined by the error determination unit, and the identification unit. The acquisition unit that acquires a captured image of the confirmation region identified by the user and the captured image acquired by the acquisition unit are displayed on the display unit as a guidance image indicating a work procedure for eliminating the error. And a display control unit.

According to the present invention, an operator can clearly tell which part should be operated when an error occurs in the image forming apparatus.

FIG. 1 is a diagram showing a structure of an image forming apparatus according to an embodiment of the present invention. FIG. 3 is a functional block diagram showing an internal configuration of the image forming apparatus. It is a figure which shows the relationship between an image forming apparatus and a camera. It is a figure which shows an example of a memory table. It is a live-action guidance image. It is a figure which shows the structural example of a normal guidance image. 6 is a flowchart illustrating an example of a guidance image display process when an error occurs in the image forming apparatus. It is a flow chart which shows an example of the display processing of the guidance image of an actual photograph. 7 is a flowchart showing a continuation of the display process of the guidance image of the real shot shown in FIG. 6. It is a figure which shows an example of the guidance image of a real image displayed on the display part of an image forming apparatus. It is a figure which shows an example of the guidance image of a real photograph. It is a figure which shows an example of the guidance image of animation. It is a figure which shows an example of the guidance image of a real photograph.

An image forming apparatus according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a structure of an image forming apparatus according to an embodiment of the present invention. The image forming apparatus 1 according to an embodiment of the present invention is, for example, a multifunction peripheral (MFP) having a plurality of functions such as a copy function, a printer function, a scanner function, and a facsimile function. The image forming apparatus 1 includes an operation unit 47, an image forming unit 12, a fixing unit 13, a paper feeding unit 14, a document feeding unit 6, a document reading unit 5, an image memory 32 shown in FIG. An HDD (Hard Disk Drive) 92 and the like are provided.

The operation unit 47 receives instructions such as an image forming operation execution instruction and a document reading operation execution instruction from the operator regarding various operations and processes that the image forming apparatus 1 can execute. The operation unit 47 includes a display unit 473. The display unit 473 includes an LCD (Liquid Crystal Display) and a touch panel arranged on the display surface side of the LCD, and has a touch panel function.

When the image forming apparatus 1 performs the document reading operation, the document reading unit 5 optically reads the image of the document fed by the document feeding unit 6 or the document placed on the document placing glass 161. Generate image data. The image data generated by the document reading unit 5 is stored in the HDD 92 or a computer connected to a network.

When the image forming apparatus 1 performs the image forming operation, based on the image data generated by the document reading operation, the image data received from the computer connected to the network, the image data stored in the HDD 92, or the like, The image forming unit 12 forms a toner image on a recording sheet P as a recording medium fed from the sheet feeding unit 14. When performing color printing, the image forming unit 12M for magenta, the image forming unit 12C for cyan, the image forming unit 12Y for yellow, and the image forming unit 12Bk for black of the image forming unit 12 respectively have the above-mentioned image. A toner image is formed on the photoconductor drum 121 by the steps of charging, exposure, and development based on the image composed of the respective color components forming the data, and the toner image is formed on the intermediate transfer belt 125 by the primary transfer roller 126. Transfer to.

The toner images of the respective colors transferred onto the intermediate transfer belt 125 are superimposed on the intermediate transfer belt 125 by adjusting the transfer timing to form a color toner image. The secondary transfer roller 210A transfers the toner image of the color formed on the surface of the intermediate transfer belt 125 from the paper feeding unit 14 to the conveyance path 190 at the nip portion N with the drive roller 125A with the intermediate transfer belt 125 interposed therebetween. The transferred recording paper P is transferred. After that, the fixing unit 13 fixes the toner image on the recording paper P to the recording paper P by thermocompression bonding. The recording paper P on which the color image has been formed and on which the fixing process has been completed is discharged to the discharge tray 151.

When performing double-sided printing in the image forming apparatus 1, after the recording paper P having an image formed on one surface by the image forming unit 12 is brought into a state where it is nipped by the discharge roller pair 159, P is switched back by the discharge roller pair 159 and sent to the reversal conveyance path 195, and is conveyed again by the conveyance roller pair 19 to the nip portion N and the fixing portion 13 in the upstream area in the conveyance direction of the recording paper P. As a result, the image forming unit 12 forms an image on the other surface of the recording paper.

The developing unit 122M in the image forming unit 12M, the developing unit 122C in the image forming unit 12C, the developing unit 122Y in the image forming unit 12Y, and the developing unit 122Bk in the image forming unit 12Bk are magenta (M), cyan (C), and Development processing for yellow (Y) and black (Bk) is performed. A toner container 61M for storing magenta toner, a toner container 61C for storing cyan toner, a yellow toner container, and a yellow toner container 61M are provided at positions distant from the developing units 122M, 122C, 122Y, 122Bk, specifically, above the intermediate transfer belt 125. A toner container 61Y for storing toner and a toner container 61Bk for storing black toner are attached to and detached from an unillustrated toner container mounting portion (hereinafter, also referred to as “mounting portion” as appropriate) provided in the apparatus main body 11. It is installed as possible. When the toner is used up, the toner container 61M, 61C, 61Y, 61Bk can be replaced as necessary by opening and closing a container cover (not shown) provided on the apparatus main body 11.

∙ Opening and closing covers, levers, etc. (not shown) are provided at various places on the device body 11. For example, a front cover is provided on the front surface of the apparatus main body 11, and a right cover and a left cover are provided on the right side surface and the left side surface, respectively. A fixing lever (not shown) for fixing the toner containers 61M, 61C, 61Y, 61Bk is provided inside the apparatus main body 11.

The operator operates the cover or lever of the apparatus main body 11 when performing error correction work of the image forming apparatus 1 (that is, work for correcting the error). For example, when a recording paper jam (paper jam) occurs, the operator opens the right cover or the left cover of the apparatus main body 11 so that the inside of the apparatus main body 11 can be seen, and the conveyance path 190 and the image forming unit 12 are provided. And remove the paper pieces jammed in the fixing unit 13 and the like. When replacing the toner containers 61M, 61C, 61Y, 61Bk, the operator opens the front cover and further releases the fixing lever to take out the empty toner containers 61M, 61C, 61Y, 61Bk.

Each member such as the cover and lever of the apparatus body 11 is provided with a sensor (state detection sensors 52, 53, 54, etc. shown in FIG. 2) that detects an operation state. Further, sensors are also provided in the sheet feeding cassettes 142, 143, 144 in the sheet feeding section 14, and the sensor detects the pulling/pushing state of these sheet feeding cassettes.

Next, the electrical configuration of the image forming apparatus 1 will be described. FIG. 2 is a functional block diagram showing the main internal configuration of the image forming apparatus 1. The image forming apparatus 1 includes a control unit 10, a document feeding unit 6, a document reading unit 5, an image forming unit 12, an HDD 92, an image memory 32, a fixing unit 13, an operation unit 47, a facsimile communication unit 71, and a network interface unit 91. And so on.

The document reading unit 5 includes a reading mechanism 163 (FIG. 1) having a light irradiation unit, a CCD sensor, and the like. The original reading unit 5 reads an image from the original by irradiating the original with the light emitting unit and receiving the reflected light by the CCD sensor.

The HDD 92 is a large-capacity storage device that stores various types of data, programs, images of documents read by the document reading unit 5, and the like.

The facsimile communication unit 71 includes an encoding/decoding unit, a modulation/demodulation unit, and an NCU (Network Control Unit), which are not shown, and transmits a facsimile using a public telephone line network.

The network interface unit 91 is composed of a communication module such as a LAN board, and transmits/receives data to/from the camera 20 that photographs the image forming apparatus 1 via a LAN (or the Internet) connected to the network interface unit 91. The network interface unit 91 is an example of the communication unit in the claims. Note that the camera 20 may be directly connected to the image forming apparatus 1 by wire or wirelessly (for example, near field communication).

The camera 20 is a photographing device for photographing the image forming apparatus 1, as shown in FIG. FIG. 3 is a diagram showing the relationship between the image forming apparatus and the camera. The image forming apparatus 1 causes the display unit 473 to display the image of the image forming apparatus 1 captured by the camera 20.

The error detection sensor group 51 detects an error relating to predetermined components of the image forming apparatus 1 (for example, the sheet feeding unit 14, the transport path 190, the toner containers 61M, 61C, 61Y, 61Bk, etc.).

The error detection sensor group 51 includes a sensor for detecting a jam (paper jam) generated in the transport path 190, a sensor for detecting a jam (paper jam) generated in the paper feeding unit 14, and toner containers 61M, 61C, 61Y, 61Bk. It includes a sensor that detects out of toner.

The state detection sensors 52, 53, 54 are provided on each member of the apparatus main body 11, that is, each of the right cover, the left cover, and the front cover, and the operating state (that is, the open/closed state) of the right cover, the left cover, and the front cover. Are detected respectively. The state detection sensors 52 to 54 may be mechanical type, optical type, or magnetic type.

The control unit 10 is composed of a processor, a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The processor is a CPU (Central Processing Unit), an MPU (Micro-Processing Unit), an ASIC (Application Specific Integrated Circuit), or the like. The control unit 10 includes a control unit 100, an error determination unit 101, an identification unit 102, an acquisition unit 103, a foreign matter determination unit 104, a display control unit 105, a work identification unit 106, and an imaging control unit 107.

The control unit 10 causes the control program stored in the HDD 92 to be executed by the processor, whereby the control unit 100, the error determination unit 101, the identification unit 102, the acquisition unit 103, the foreign matter determination unit 104, and the display unit. The control unit 105, the work specifying unit 106, and the imaging control unit 107 function. Each of the above-described constituent elements of the control unit 10 may be configured by a hardware circuit instead of the operation based on the control program described above.

The control unit 100 controls the overall operation of the image forming apparatus 1. The control unit 100 includes the document reading unit 5, the image forming unit 12, the fixing unit 13, the HDD 92, the image memory 32, the operation unit 47, the facsimile communication unit 71, the network interface unit 91, the error detection sensor group 51, and the state detection sensor 52. It is connected to 54 and so on. The control unit 100 controls each of the above-mentioned connected mechanisms and transmits/receives signals or data to/from each mechanism.

In addition, the control unit 100 drives and drives each mechanical unit necessary to execute control of each function of the scanner function, the copy function, and the printer function according to a job execution instruction received from the operator through the operation unit 47 and the like. Control the process.

The error determination unit 101 determines whether or not an error has occurred regarding a predetermined component of the image forming apparatus 1 based on the detection output of the error detection sensor group 51 including a plurality of sensors. Specifically, the error determination unit 101 determines whether the conveyance path 190 or the paper feed unit 14 detects a jam (paper jam) generated by each sensor (an example of the error detection sensor group 51) based on the detection output. The presence or absence of a jam (error) generated in 190 or the paper feeding unit 14 is determined. Further, the error determination unit 101 determines the presence/absence of toner (error) based on the detection output of the sensor that detects the toner exhaustion of the toner containers 61M, 61C, 61Y, 61Bk.

As shown in FIG. 4A, the HDD 92 has a storage table 92A in which a predetermined component, an error relating to the component, and a confirmation part to be confirmed when the error occurs are stored in advance in association with each other. FIG. 4A is a diagram showing an example of a storage table. Further, the HDD 92 stores in advance the reference image obtained by photographing the confirmation region when no error occurs in the storage table 92A in association with the confirmation region of the storage table 92A. In addition, the HDD 92 stores in advance a countermeasure image indicating the countermeasure against the foreign substance in the confirmation portion in the storage table 92A in association with the confirmation portion in the storage table 92A. The HDD 92 is an example of a storage unit in the claims.

Specifically, in the storage table 92A, when the error is “right side paper jam”, as shown in FIG. 4A, “right side paper jam” as an error relating to the paper feeding unit and “feeding as a component” are shown. "Paper section", "Inside the paper feed section" as a confirmation part, and "Captured image of the paper feed section as a reference image (image that was taken in advance when no error occurred) ", "Please remove the jammed paper" as the countermeasure image, and the work procedure for eliminating the error are stored in advance in association with each other. Further, when the error is “out of toner (magenta)”, the storage table 92A displays “out of toner (magenta)” as an error and “toner container (magenta)” as a component as shown in FIG. 4A. )”, the “front of the mounting part” as the confirmation part, the “image of the front of the mounting part” as the reference image, and the “please replace the toner container” as the countermeasure image. It is stored in advance in association with the work procedure for.

When the error determination unit 101 determines that an error has occurred, the identification unit 102 uses the storage table 92A to identify the component and the confirmation part corresponding to the error that the error determination unit 101 has determined to have occurred. .. For example, if the error determined by the error determination unit 101 is "right paper jam" using the storage table 92A, the identifying unit 102 determines that the component is the "paper feed unit" and the confirmation site is It is specified to be “inside the paper feed unit”.

The acquisition unit 103 acquires a photographed image of the confirmation region identified by the identification unit 102. For example, the acquisition unit 103 acquires, via the network interface unit 91, a captured image in which the camera 20 has captured the “inside of the paper feeding unit” that is the confirmation site.

The foreign matter determination unit 104 determines whether there is a foreign matter in the captured image acquired by the acquisition unit 103. For example, the foreign matter determination unit 104 determines the presence or absence of a foreign matter in the captured image by performing image analysis by pattern matching between the captured image acquired by the acquisition unit 103 and the reference image stored in the storage table 92A.

Further, when the foreign substance determination unit 104 determines that there is no foreign substance in the captured image even though the error determination unit 101 determines that an error has occurred, the foreign substance determination unit 104 acquires the specific region of the captured image acquired by the acquisition unit 103. By performing image analysis by pattern matching between the zoom image zoomed to a predetermined magnification and the enlarged reference image in which the specific area of the reference image is enlarged to the same size as the zoom image, Determine the presence or absence.

The display control unit 105 controls the display on the display unit 473 under the control of the control unit 100. The display control unit 105 also causes the display unit 473 to display the captured image acquired by the acquisition unit 103 as a guidance image indicating a work procedure for eliminating an error. Specifically, when the foreign matter determination unit 104 determines that there is a foreign matter, the display control unit 105 combines the captured image acquired by the acquisition unit 103 with an instruction image indicating the foreign matter determined by the foreign matter determination unit 104. The combined image is displayed on the display unit 473 as a guidance image. It should be noted that for the generation of the composite image, a composite display by superimposing, a composite display in which a plurality of layers are superimposed, and the like, which are known composition methods, may be performed.

Further, when the foreign matter determination unit 104 determines that there is a foreign matter, the display control unit 105 displays an instruction image indicating the foreign matter determined by the foreign matter determination unit 104 and the storage table 92A in the captured image acquired by the acquisition unit 103. A combined image obtained by combining the stored countermeasure image is displayed on the display unit 473 as a guidance image.

Further, in the acquisition unit 103, when a predetermined time has elapsed since the display control unit 105 displayed the composite image on the display unit 473, the error determination unit 101 continues to determine that an error has occurred. If so, a captured image is obtained after the confirmation region is imaged after the predetermined time has elapsed. Then, the foreign matter determination unit 104 determines the presence or absence of a foreign matter in the post-lapse captured image by performing image analysis by pattern matching between the post-pass captured image acquired by the acquisition unit 103 and the reference image. Then, when the foreign matter determination unit 104 determines that there is a foreign matter, the display control unit 105 combines an instruction image indicating the foreign matter determined by the foreign matter determination unit 104 with the post-lapse captured image acquired by the acquisition unit 103. The combined image is displayed on the display unit 473 as a guidance image.

That is, as shown in FIG. 4B, the display control unit 105 displays the guidance images P1 to P3 (hereinafter, appropriately referred to as “actual guidance images”, abbreviated as appropriate) according to the work procedure. May be performed) is displayed on the display unit 473. FIG. 4B is a diagram showing a configuration example of a guidance image of a live-action image.

Further, as shown in FIG. 4C, the HDD 92 displays a normal guidance image that is a guidance image indicating a work procedure for eliminating the error and does not include the captured image acquired by the acquisition unit 103 when the error occurs. It is stored in advance. FIG. 4C is a diagram showing a configuration example of a normal guidance image. The "normal guidance image" here is not a "realistic guidance image", but an animation guidance image prepared in advance. That is, as shown in FIG. 4C, the HDD 92 stores in advance animation guidance images B1 to B3 indicating the work procedure.

Further, when the acquisition unit 103 cannot acquire a captured image, or when the confirmation site in the captured image acquired by the acquisition unit 103 is hidden, the display control unit 105 replaces the guidance display including the captured image with The normal guidance image stored in the HDD 92 is displayed on the display unit 473.

In the display control unit 105, the operation unit 47 receives a selection instruction of a guidance image including a captured image (that is, “actual guidance image”) or a normal guidance image (that is, “animation guidance image”). Then, the guidance image is displayed on the display unit 473 in accordance with the selection instruction. It should be noted that in the present embodiment, “actual guidance image” is set in the HDD 92 as an initial setting value. The control unit 100 changes the set value to the “realistic guidance image” or the “animation guidance image” according to the selection instruction of the operation unit 47.

Further, the HDD 92 stores a work procedure for eliminating an error in the storage table 92A in advance in association with the error in the storage table 92A.

The work identifying unit 106 identifies the work to be performed by the operator based on the work procedure stored in the storage table 92A and the detection result of the error detection sensor group 51 and the detection result of the state detection sensor.

Further, the acquisition unit 103 captures the operation target captured image of the operation target associated with the work identified by the work identification unit 106 (that is, the work to be performed by the operator) and the confirmation site according to the work procedure of the storage table 92A. The captured images that have been taken are sequentially acquired.

The display control unit 105 also combines (i) a work guidance image indicating the work specified by the work specifying unit 106 (that is, the work to be performed by the operator) with the operation target captured image acquired by the acquisition unit 103. The combined image is displayed on the display unit 473 as the guidance image P1 (see FIG. 4B). Then, when the work specifying unit 106 specifies (ii) that the work to be performed by the operator is the work of the confirmation site, the display control unit 105 sets the captured image acquired by the acquisition unit 103 as the guidance image P2. It is displayed on the display unit 473 (see FIG. 4B). Then, when the operation specifying unit 106 specifies that the (iii) error has been resolved and that the work to be performed by the operator is the work of returning the member to the original state, the display control unit 105 determines that the captured image Then, the display unit 473 displays a combined image obtained by combining the work guide images indicating the work for returning the member specified by the work specifying unit 106 as the guidance image P3 (see FIG. 4B).

The photographing control unit 107 controls the camera 20 that photographs the image forming apparatus 1. The network interface unit 91 outputs a control signal from the imaging control unit 107 to the camera 20, and receives a captured image in which the camera 20 has captured the confirmed region.

The imaging control unit 107, based on the captured image of the camera 20 received by the network interface unit 91 (that is, the captured image of the confirmed region), at least the control items of the orientation, the shooting magnification, the focus, and the position of the camera 20. Control one. For example, the shooting control unit 107 may orient the camera 20 so that the shot image matches the reference image when the shot image is displaced from the reference image by pattern matching between the reference image and the shot image. Should be adjusted. Further, if the focus is out of focus, the image capturing control unit 107 may focus by the autofocus function. Then, the acquisition unit 103 acquires, from the network interface unit 91, a captured image in which the camera 20 has captured the confirmation region after the imaging control unit 107 controls the control items.

Next, the display process of the guidance image when an error occurs in the image forming apparatus 1 will be described. FIG. 5 is a flowchart showing an example of a guidance image display process when an error occurs in the image forming apparatus 1. FIG. 6 is a flowchart showing an example of display processing of a guidance image of a live-action image. FIG. 7 is a flowchart showing a continuation of the display process of the live-action guidance image shown in FIG.

As shown in FIG. 5, the error determination unit 101 determines whether or not an error has occurred regarding a predetermined component of the image forming apparatus 1 based on the detection output of the error detection sensor group 51 (S1). Here, it is assumed that a “right side paper jam” error has occurred, that is, a jam (paper jam) has occurred in the paper feeding unit 14.

When the error determination unit 101 determines that a jam (paper jam) has occurred in the paper feeding unit 14 (S1 “YES”), the identification unit 102 determines the error determination unit 101 using the storage table 92A. If the generated error is "paper jam on the right side", it is specified that the component is "paper feed unit" and the confirmation site is "inside the paper feed unit" (S2).

The control unit 100 determines whether the setting value of the HDD 92 is a “realistic guidance image” or an “animation guidance image” (S3). After S2, the display control unit 105 causes the display unit 473 to display a selection screen display that prompts the user to select the “realistic guidance image” or the “animation guidance image”, and the control unit 100 selects the operation unit 47. According to the instruction, the setting value of the HDD 92 may be changed to the “realistic guidance image” or the “animation guidance image”.

When it is determined that the setting value of the HDD 92 is the “realistic guidance image” (S3 “YES”), the control unit 100 executes the realism guidance image display process (S5). Here, the display processing of the guidance image of the real shot will be described with reference to FIGS. 6 and 7.

As shown in FIG. 6, the work identifying unit 106 is a work to be performed by the operator based on the work procedure stored in the storage table 92A and the detection result of the error detection sensor group 51 and the detection result of the state detection sensor. Is specified (S11). Specifically, the work identifying unit 106 detects the detection result of the error detection sensor group 51 (here, an error of “right side paper jam”) and the work procedure stored in the storage table 92A (here, “right side paper jam”). 4) and the detection result of the state detection sensor 52 (here, the right cover is in the closed state), the work to be performed by the operator is the work procedure shown in FIG. 4A. Is the first work (that is, the work for the operator to open the right cover).

The acquisition unit 103 acquires, via the network interface unit 91, the operation target captured image obtained by capturing the right side of the image forming apparatus 1 by the camera 20 (S12). The camera 20 is preset with the orientation, position, etc. of the camera 20 so that the right side of the image forming apparatus 1 can be photographed. When the orientation, position, etc. of the camera 20 are deviated, the image capturing control unit 107, based on the image from the camera 20 received by the network interface unit 91, the orientation, the image capturing magnification, the focus, the position of the camera 20. The orientation, position, etc. of the camera 20 may be adjusted by controlling at least one of the control items.

FIG. 8 is a diagram showing an example of a live-action guidance image displayed on the display unit 473 of the image forming apparatus 1. As shown in FIG. 8, the display control unit 105 performs (i) the work specified by the work specifying unit 106 with respect to the operation target captured image G1 acquired by the acquisition unit 103 (that is, the work in which the operator opens the right cover). ) Is displayed on the display unit 473 as an actual guidance image P1 (S13). Specifically, the display control unit 105, for the operation target photographed image G1 obtained by photographing the right side of the image forming apparatus 1, the image AG1 indicating the work of “please open the right cover.” and the right cover portion (work. A work guide image AG composed of an arrow image AG2 indicating a location) is displayed on the display unit 473 as a guidance image P1 of a real image.

The state detection sensor 52 detects whether the right cover of the apparatus body 11 is open or closed (S14). When the state detection sensor 52 detects that the right cover of the apparatus body 11 is open (S14 “YES”), the work identification unit 106 identifies that the work to be performed by the operator is the work of the confirmation site. Yes (S15). That is, the work identifying unit 106 identifies that the work to be performed by the operator is the second work of the work procedure of the storage table 92A illustrated in FIG. 4A (that is, the work in which the operator removes the sheet).

The camera 20 captures an image of the “inside of the paper feed section”, which is the confirmation part to be confirmed when an error occurs (S16). The acquisition unit 103 acquires the captured image captured by the camera 20 via the network interface unit 91.

The display control unit 105 determines whether a captured image has been acquired (S17). Specifically, when the acquisition unit 103 acquires a captured image, that is, when the acquisition unit 103 acquires a captured image via the network interface unit 91 (S17 “YES”), the foreign object determination unit 104 captures the captured image. Image analysis is performed (S18). Specifically, the foreign matter determination unit 104 performs image analysis by pattern matching between the captured image acquired by the acquisition unit 103 and the reference image stored in the storage table 92A, so that the foreign matter (clogging is present in the captured image. The presence or absence of paper) is determined (S19).

When the foreign substance determination unit 104 determines that there is a foreign substance in the captured image (S19 “YES”), the display control unit 105 instructs the captured image acquired by the acquisition unit 103 to indicate the foreign substance determined by the foreign substance determination unit 104. The image and the countermeasure image stored in the storage table 92A are combined (S20), and the combined image is displayed on the display unit 473 as a guidance image (S21). Specifically, as shown in FIG. 9A, the display control unit 105 detects foreign matter (jammed paper) in the photographed image G2 of the confirmation region (that is, the image G2 obtained by photographing “the inside of the paper feeding unit”). A synthetic image is generated by synthesizing the instruction image AG3 such as the pointing arrow and the countermeasure image AG4 (for example, the image of "please remove the jammed paper") stored in the storage table 92A, and the synthetic image is actually shot. Is displayed on the display unit 473 as the guidance image P2. As described above, the display control unit 105 (ii) displays the captured image acquired by the acquisition unit 103 when the work specifying unit 106 specifies that the work to be performed by the operator is the work of the confirmation site. As shown in FIG. 4B and FIG. 9A, it is displayed as a guidance image P2 of a real shot (S21).

On the other hand, in S17, the display control unit 105 determines that the acquisition unit 103 cannot acquire the captured image via the network interface unit 91 (S17 “NO”), or the confirmed region in the captured image acquired by the acquisition unit 103 is When it is hidden by a person or the like (S17 “NO”), instead of the guidance display including the captured image, the normal guidance image stored in the HDD 92 is displayed on the display unit 473 (S4). That is, the display control unit 105 causes the display unit 473 to display the “animation guidance image” as shown in FIG. 9B.

Note that the foreign matter determination unit 104 performs image analysis by pattern matching between the captured image in which the person captured by the acquisition unit 103 is reflected and the reference image stored in the storage table 92A, and thereby the number of mismatch points due to pattern matching. Is above a predetermined threshold score, it can be determined that the confirmed region is a captured image hidden by a person or the like. For example, when the number of disagreement points due to the pattern matching between the four corners of the captured image and the four corners of the reference image exceeds 2 (threshold score), it may be determined that the confirmed portion is a hidden captured image. Note that the presence of a person between the camera 20 and the confirmation site may be detected by using another obstacle detection sensor or the like.

On the other hand, in S19, if the foreign matter determination unit 104 determines that there is no foreign matter in the captured image even though the error determination unit 101 determines that an error has occurred (S19 “NO”), the acquisition unit Image analysis is performed by pattern matching between a zoom image obtained by zooming a specific region of the captured image acquired by 103 to a predetermined magnification and an enlarged reference image obtained by enlarging the specific region of the reference image to the same size as the zoom image. (S22), the presence/absence of foreign matter in the captured image is determined (S23).

When the foreign matter determination unit 104 determines that there is a foreign matter in the zoom image of the captured image (S23 “YES”), the display control unit 105 instructs the foreign matter determination unit 104 to identify the foreign matter in the zoom image of the captured image. The image AG3 is combined with the countermeasure image AG4 stored in the storage table 92A, and the combined image is displayed on the display unit 473 as a guidance image (S24).

After S21, S24, or when the foreign matter determination unit 104 determines that there is no foreign matter in the zoom image of the captured image in S23 (S23 “NO”), the error determination unit 101 outputs the detection output of the error detection sensor group 51. Based on, it is determined whether or not the "right side paper jam" error has been resolved (S25). When the “right-side paper jam” error has been resolved (S25 “YES”), the work identifying unit 106 determines that the work to be performed by the operator is the work to restore the member as shown in FIG. Identify (S26). Specifically, the work identification unit 106 detects the detection result of the error detection sensor group 51 (here, there is no “right side paper jam” error) and the work procedure stored in the storage table 92A (“right side paper jam”). 4) based on the detection result of the state detection sensor 52 (here, the right cover is open), that is, the third work of the work procedure shown in FIG. 4A (that is, the operator). Is the work of closing the right cover) (S26).

The acquisition unit 103 acquires, via the network interface unit 91, a captured image of the confirmation region captured by the camera 20 (S27).

The display control unit 105 combines the captured image of the confirmation site with the work guide image indicating the work of “Please close the right cover.”, and displays a combined image as shown in FIGS. 4B and 10. The image P3 is displayed on the display unit 473 (S28). Specifically, as shown in FIG. 10, the display control unit 105, with respect to the captured image G3 of the confirmation region, displays the image AG5 indicating the work of “Please close the right cover.” and the right cover place (work place). ) Is displayed on the display unit 473 as a real-time guidance image P3.

As described above, the display control unit 105 causes the work identifying unit 106 to determine that the (iii) error is resolved (S25 “YES”) and that the work to be performed by the operator is the work of restoring the right cover. When specified (S26), a combined image in which a work guide image indicating the work of closing the right cover specified by the work specifying unit 106 is combined with the captured image of the confirmation region captured by the camera 20 is displayed as a guidance image. It is displayed on the section 473 (S28).

On the other hand, in S25, when the predetermined time has elapsed from the occurrence of the error in S25, and the error has not yet been resolved (S25 “NO”), the acquisition unit 103 returns after the predetermined time has elapsed. A photographed image is acquired after the confirmation region is photographed (S16). The foreign matter determination unit 104 determines the presence or absence of foreign matter in the post-lapse photographed image by performing image analysis by pattern matching between the post-lapse photographed image and the reference image (S19). The display control unit 105 causes the display unit 473 to display, as a guidance image, a composite image in which the instruction image AG3 indicating the foreign matter determined by the foreign matter determination unit 104 is combined with the captured image after the passage (S21). As a result, it is possible to clearly inform the operator that a foreign object is present in the post-elapsed captured image, which is an image in which a predetermined time has elapsed since the error of the image forming apparatus 1.

By the way, when the error is eliminated (S25 “YES”), the state detection sensor 52 detects whether or not the right cover of the apparatus body 11 is closed (S29). When the state detection sensor 52 detects that the right cover is not closed (S29 “NO”), the control unit 100 returns to S29 and the state detection sensor 52 detects that the right cover is closed. And (S29 “YES”), this process is terminated.

As described above, according to this embodiment, the acquisition unit 103 acquires the captured image G2 (see FIG. 9A) that captures the confirmation site to be confirmed when an error occurs. The display control unit 105 causes the display unit 473 to display the captured image G2 acquired by the acquisition unit 103 as a guidance image P2 indicating a work procedure for eliminating an error (see FIG. 9A). As a result, the operator can perform the recovery work by viewing the captured image G2 of the confirmation site captured when the error occurs. Therefore, the operator can clearly tell which part should be operated when an error occurs in the image forming apparatus 1.

Further, the foreign matter determination unit 104 performs image analysis by pattern matching between the captured image of the confirmation region acquired by the acquisition unit 103 and the reference image of the confirmation region captured when no error occurs, thereby performing the image analysis. The presence/absence of foreign matter in the captured image is determined. When the foreign matter determination unit 104 determines that there is a foreign matter, the display control unit 105 combines a captured image acquired by the acquisition unit 103 with a composite image obtained by combining the instruction image AG3 indicating the foreign matter determined by the foreign matter determination unit 104. The guidance image P2 is displayed on the display unit 473 (see FIG. 9A). As a result, it is possible to clearly inform the operator of the foreign matter in the confirmation portion when an error occurs in the image forming apparatus 1, and it is possible to quickly perform the recovery work.

Further, when the foreign matter determination unit 104 determines that there is no foreign matter even though the error determination unit 101 determines that an error has occurred, the foreign matter determination unit 104 predetermines a specific area of the captured image acquired by the acquisition unit 103. The presence or absence of foreign matter in the captured image is determined by performing image analysis by pattern matching between the zoom image zoomed to the specified magnification and the enlarged reference image obtained by enlarging the specific area of the reference image to the same size as the zoom image. judge. As a result, even if the foreign matter in the confirmation portion is small when an error occurs in the image forming apparatus 1, the foreign matter can be found and the detection accuracy of the foreign matter in the confirmation portion can be improved.

Further, when the foreign matter determination unit 104 determines that there is a foreign matter, the display control unit 105 indicates the foreign matter determined by the foreign matter determination unit 104 in the captured image acquired by the acquisition unit 103, as illustrated in FIG. 9A. A synthetic image obtained by synthesizing the instruction image AG3 and the countermeasure image AG4 indicating the countermeasure against the foreign matter is displayed on the display unit 473 as the guidance image P2. As a result, it is possible to clearly notify the operator of the presence of the foreign matter in the confirmation portion and the countermeasure against the foreign matter when an error occurs in the image forming apparatus 1, and it is possible to quickly perform the recovery work.

Further, when the acquisition unit 103 cannot acquire the captured image, or when the confirmation site in the captured image acquired by the acquisition unit 103 is hidden, the display control unit 105 displays the guidance including the captured image. A normal guidance image (that is, an animation guidance image) stored in advance in the HDD 92 is displayed on the display unit 473 instead of (that is, a live-action guidance image). As a result, when the captured image cannot be acquired, or when the confirmation region in the captured image acquired by the acquisition unit 103 is hidden, the display is automatically switched to the normal guidance image, and the operator Recovery work can be performed by viewing the normal guidance image displayed on the display unit 473. In addition, it is possible to deal with an unexpected situation in which the operator cannot use the actual captured image without performing the display change operation.

Further, in the display control unit 105, the operation unit receives a selection instruction of a guidance image including a captured image (that is, a guidance image of a real image) or a normal guidance image that does not include a captured image (that is, an animation guidance image). Then, the guidance image is displayed on the display unit 473 in accordance with the selection instruction. Thereby, the operator can select the display of the guidance image including the captured image or the normal guidance image that does not include the captured image, and the guidance image according to the operator's request can be provided.

Further, (i) the display control unit 105 combines the operation target captured image G1 acquired by the acquisition unit 103 with the work guidance image AG indicating the work to be performed by the operator, and the guidance image P1 (see FIG. 8). (Ii) and then (ii) when the work specifying unit 106 specifies that the work to be performed by the operator is the work of the confirmation site, the captured image G2 acquired by the acquisition unit 103 is displayed as a guidance image. P2 (see FIG. 9A) is displayed, and then (iii) the error is resolved, and the work specifying unit 106 specifies that the work to be performed by the operator is the work to restore the right cover. A combined image obtained by combining the photographed image G3 and the work guide image AG showing the work of returning the right cover is displayed as the guidance image P3 (see FIG. 10). As a result, the recovery work can be performed while sequentially viewing the guidance images P1 to P3 including a series of captured images according to the work procedure for eliminating the error. That is, since the work procedure for eliminating the error is the guidance images P1 to P3 shown by using a series of actual captured images, the operator can select which portion in order when the error occurs in the image forming apparatus 1. It is possible to clearly tell whether or not to operate by using a series of actual captured images.

Further, the shooting control unit 107 controls the camera 20 that shoots the image forming apparatus 1. The network interface unit 91 outputs a control signal from the shooting control unit 107 to the camera 20, and receives shooting data from the camera 20. The imaging control unit 107 controls at least one of the control items of the orientation, the imaging magnification, the focus, and the position of the camera 20, based on the captured image captured by the network interface unit 91 that captures the confirmation region. The acquisition unit 103 acquires, from the network interface unit 91, a captured image in which the camera 20 whose control items are controlled by the imaging control unit 107 has captured the confirmation region. Accordingly, when the orientation or position of the camera 20 is deviated, or when the photographing magnification or the focus of the camera 20 is deviated, these deviations can be adjusted, and the camera 20 can favorably photograph the confirmation site. It can be executed, and a guidance image using a suitable captured image can be provided.

The present invention is not limited to the configuration of the above embodiment, and various modifications can be made. In the above-described embodiment, as an example of the error elimination work, it is described that the guidance work image of the recording paper jam is displayed on the display unit 473, but the invention is not limited to this. For example, as the error elimination work, the toner container 61M, 61C, 61Y, 61Bk replacement work, the replacement work when the image forming unit 12 and the fixing unit 13 are defective, the paper jam in the document feeding unit 6, etc. You may make it display on the display part 473 the guidance image of a real thing included about these. For example, when exchanging the toner containers 61M, 61C, 61Y, 61Bk, it is necessary to photograph the front surface of the image forming apparatus 1. Therefore, the photographing control unit 107 causes the camera 20 to move the image by the moving mechanism (not shown). The front surface of the image forming apparatus 1 may be moved to a position for photographing, or another camera 20 for photographing the front surface of the image forming apparatus 1 may be used.

Also, in the above embodiment, a still image is used as the live-action guidance image, but a moving image may be used. For example, the foreign substance determination unit 104 performs the foreign substance determination on at least one frame image (captured image) of the plurality of frame images (captured image) forming the moving image of the confirmation region, and the display control unit 105 acquires A composite image obtained by combining the instruction image indicating the foreign matter determined by the foreign matter determination unit 104 with at least one frame image (captured image) acquired by the unit 103 may be displayed on the display unit 473 as a guidance image. Good.

Further, the display control unit 105 may cause the display unit 473 to display in parallel a guidance image including a captured image (actual guidance image) and a normal guidance image not including a captured image (animation guidance image). ..

Further, the configuration and processing shown by the above embodiment using FIGS. 1 to 10 are merely one embodiment of the present invention, and the present invention is not intended to be limited to the configuration and processing.

Claims (10)

An image forming apparatus for forming an image on a recording medium,
Display part,
An error determination unit that determines whether or not an error has occurred regarding a predetermined component of the image forming apparatus,
A storage unit having a storage table that stores in advance the predetermined component and an error relating to the component and a confirmation site to be confirmed when the error occurs, in advance.
When the error determination unit determines that the error has occurred, the storage table is used to specify a component and a confirmation part corresponding to the error determined to have occurred by the error determination unit, and a specifying unit. ,
An acquisition unit that acquires a captured image of the confirmation region identified by the identification unit,
An image forming apparatus comprising: a display control unit that causes the display unit to display the captured image acquired by the acquisition unit as a guidance image indicating a work procedure for eliminating the error. A foreign matter determination unit that determines the presence or absence of a foreign matter in the captured image acquired by the acquisition unit,
The storage unit further stores, in advance in the storage table, a reference image obtained by photographing the confirmation region when an error has not occurred, in association with the confirmation region in the storage table,
The foreign matter determination unit determines the presence or absence of foreign matter in the captured image by performing image analysis by pattern matching between the captured image acquired by the acquisition unit and the reference image stored in the storage table,
When the foreign matter determination unit determines that there is a foreign matter, the display control unit combines a captured image acquired by the acquisition unit with an instruction image indicating the foreign matter determined by the foreign matter determination unit and is a composite image. The image forming apparatus according to claim 1, wherein is displayed on the display unit as the guidance image. When the foreign matter determination unit determines that there is no foreign matter, a zoom image obtained by zooming a specific area of the captured image acquired by the acquisition unit to a predetermined magnification, and the specific area of the reference image being the zoom image. The image forming apparatus according to claim 2, wherein the presence or absence of a foreign matter in the captured image is determined by performing image analysis by pattern matching with the enlarged reference image enlarged to the same size as the above. The storage unit further stores, in advance in the storage table, a countermeasure image indicating a countermeasure against foreign matter in the confirmation region, in association with the confirmation region in the storage table,
When the foreign matter determination unit determines that there is a foreign matter, the display control unit, in the captured image acquired by the acquisition unit, displays an instruction image indicating the foreign matter determined by the foreign matter determination unit and the storage table. The image forming apparatus according to claim 2, wherein a combined image obtained by combining the stored countermeasure image is displayed on the display unit as the guidance image. The acquisition unit, when a predetermined time has elapsed after the display control unit displays the composite image on the display unit, the error determination unit continues to determine whether the error has occurred. If there is, obtain a captured image after the confirmation site is captured after the predetermined time has passed,
The foreign matter determination unit determines the presence or absence of foreign matter in the post-lapse taken image by performing image analysis by pattern matching between the post-taken captured image acquired by the acquisition unit and the reference image,
When the foreign matter determination unit determines that there is a foreign matter, the display control unit synthesizes an instruction image indicating the foreign matter determined by the foreign matter determination unit with the post-lapse captured image acquired by the acquisition unit. The image forming apparatus according to claim 2, wherein a composite image is displayed on the display unit as the guidance image. The storage unit stores in advance a normal guidance image that is a guidance image indicating a work procedure for eliminating the error and does not include the captured image acquired by the acquisition unit when the error occurs. ,
When the acquisition unit cannot acquire the captured image, or when the confirmation part in the captured image acquired by the acquisition unit is hidden, the display control unit switches to a guidance display including the captured image. The image forming apparatus according to claim 1, wherein the normal guidance image stored in the storage unit is displayed on the display unit. The foreign matter determination unit performs image analysis by pattern matching between the captured image acquired by the acquisition unit and the reference image stored in the storage table, so that the mismatch score by pattern matching is a predetermined threshold score. The image forming apparatus according to claim 6, wherein when the number exceeds the above, it is determined that the confirmation region in the captured image acquired by the acquisition unit is hidden. Further comprising an operation unit operated by an operator,
The storage unit stores in advance a normal guidance image that is a guidance image indicating a work procedure for eliminating the error and does not include the captured image acquired by the acquisition unit when the error occurs. ,
The display control unit causes the display unit to display a guidance image according to the selection instruction when the operation unit receives a selection instruction of the guidance image including the captured image or the normal guidance image. The image forming apparatus according to item 1. The storage unit further stores a work procedure for eliminating the error in the storage table in advance in association with the error in the storage table.
The image forming apparatus, an error detection sensor for detecting the occurrence of an error relating to the predetermined components,
A state detection sensor that detects an operation state of a member of the image forming apparatus,
Further, the work procedure stored in the storage table, based on the detection result of the error detection sensor and the detection result of the state detection sensor, a work specifying unit for specifying the work to be performed by the operator,
According to the work procedure, the acquisition unit sequentially acquires an operation target imaged image of an operation target imaged by the operator specified by the work identification unit and an imaged image of the confirmation region. Then
The display control unit (i) combines the operation target captured image acquired by the acquisition unit with a combined image in which a work guidance image indicating a work to be performed by the operator specified by the work specifying unit is combined, When the work specifying unit specifies that the work to be performed by the operator is the work of the confirmation site, the captured image acquired by the acquisition unit is displayed on the display unit as the guidance image. Is displayed on the display unit as the guidance image, and (iii) the error is eliminated, and the work specifying unit specifies that the work to be performed by the operator is a work to restore the member. Then, a composite image obtained by combining the captured image with a work guidance image indicating work for returning the member identified by the work identification unit is displayed on the display unit as the guidance image. The image forming apparatus described. A photographing control unit that controls a photographing device that photographs the image forming apparatus;
A communication unit that outputs a control signal from the imaging control unit to the imaging device, and the imaging device receives a captured image of the confirmation region, and
The photographing control unit controls at least one of control items of the orientation, the photographing magnification, the focus, and the position of the photographing device, based on the photographed image of the confirmation region received by the communication unit,
The image forming apparatus according to claim 1, wherein the acquisition unit acquires, from the reception unit, a captured image of the confirmation region captured by the imaging device after the imaging control unit controls the control items.

Images