[go: up one dir, main page]

WO2013062532A1 - Capturing workflow data using gesture tracking - Google Patents

Capturing workflow data using gesture tracking Download PDF

Info

Publication number
WO2013062532A1
WO2013062532A1 PCT/US2011/057720 US2011057720W WO2013062532A1 WO 2013062532 A1 WO2013062532 A1 WO 2013062532A1 US 2011057720 W US2011057720 W US 2011057720W WO 2013062532 A1 WO2013062532 A1 WO 2013062532A1
Authority
WO
WIPO (PCT)
Prior art keywords
print
workstation
image capture
activity
instructions
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2011/057720
Other languages
French (fr)
Inventor
Eric Hoarau
Jun Zeng
Giordano B. BERETTA
I-Jong Lin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hewlett Packard Development Co LP
Original Assignee
Hewlett Packard Development Co LP
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hewlett Packard Development Co LP filed Critical Hewlett Packard Development Co LP
Priority to PCT/US2011/057720 priority Critical patent/WO2013062532A1/en
Publication of WO2013062532A1 publication Critical patent/WO2013062532A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1202Dedicated interfaces to print systems specifically adapted to achieve a particular effect
    • G06F3/1203Improving or facilitating administration, e.g. print management
    • G06F3/1207Improving or facilitating administration, e.g. print management resulting in the user being informed about print result after a job submission
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1223Dedicated interfaces to print systems specifically adapted to use a particular technique
    • G06F3/1237Print job management
    • G06F3/1259Print job monitoring, e.g. job status
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1278Dedicated interfaces to print systems specifically adapted to adopt a particular infrastructure
    • G06F3/1285Remote printer device, e.g. being remote from client or server
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1202Dedicated interfaces to print systems specifically adapted to achieve a particular effect
    • G06F3/1211Improving printing performance
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/12Digital output to print unit, e.g. line printer, chain printer
    • G06F3/1201Dedicated interfaces to print systems
    • G06F3/1223Dedicated interfaces to print systems specifically adapted to use a particular technique
    • G06F3/1275Print workflow management, e.g. defining or changing a workflow, cross publishing

Definitions

  • Print service providers fulfill the demand for print products by printing a vast array of print products, such as photographs, brochures, school course materials, periodicals, books, advertisements, and/or product packaging. Once a job order is released to the PSP floor for production, it goes through four stages of production (Pre-press, Press, Post-Press, and
  • FIG. 1 illustrates a block diagram of a production floor for a print service provider (PSP) in accordance with an embodiment
  • FIG. 2 illustrates a block diagram of an embodiment of an image capture device, a station controller, and a workflow controller of the PSP of FIG. 1 ;
  • FIG. 3 is a diagram of operations, processes, and sub-processes performed in the PSP and captured by the image capture device of FIG. 2;
  • FIG. 4 is a flow chart illustrating the operation of the image capture device of FIG. 2.
  • the PSP 10 may be, for example, a print shop or other printing location that prints brochures, school course materials, periodicals, books, advertisements, product packaging, and/or other types of on-demand printing jobs.
  • the PSP 10 may be organized into four basic stations, each with a specific role that allows for a print job to be fulfilled. These stations of the PSP 10 may include a pre-press station 12, a press station 14, a post-press station 16, and a shipping station 18. Tasks such as inspecting incoming print jobs for errors, editing incoming print jobs for accuracy, creating proofs, and coordinating production of the print jobs may be performed in the pre-press station 12 of the PSP 10.
  • a print job may be transferred to the press station 14.
  • the print job may be printed.
  • tasks performed at the press station 14 may include, for example (depending on the material to be printed and the devices available to complete the printing), preparing
  • lithographic (offset) plates lithographic (offset) plates, flexographic presses, letterpresses, intaglio printing processes (e.g., rotogravure printing), hybrid machines, such as ink-jet over silk screen or intaglio over gravure machines, digital presses (e.g., an Indigo digital press from Hewlett-Packard Company) and/or industrial printers (e.g., a Scitex press from Hewlett-Packard Company) for printing the print job, loading particular paper and/or ink, and offloading printed material. Subsequent to the print job being printed in the press station 14, the printed material for the print job may be transported to the post-press station 16.
  • intaglio printing processes e.g., rotogravure printing
  • hybrid machines such as ink-jet over silk screen or intaglio over gravure machines
  • digital presses e.g., an Indigo digital press from Hewlett-Packard Company
  • industrial printers e.g
  • the printed material for a given print job may undergo additional processing.
  • the printed material may be cut, collated, and/or bound at the post-press station 16 (depending on the requirements of a given print job). That is, the print job may be finished (i.e., placed into final form) at the post-press station 16.
  • the print job is transported to the shipping station 18, whereby the finished print job may be, for example, packed, labeled, and/or shipped to a customer.
  • each of the stations 12, 14, 16, and 18 of the PSP 10 may include various workstations at which the various tasks of the stations 12, 14, 16, and 18 may be performed.
  • the pre-press station 12 may include, for example, workstations 20 and 22.
  • Each of workstations 20 and 22 may include or may share, for example, an electronic device, such as a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer, to aid in performing the various tasks undertaken in pre-press station 12.
  • the press station 14 may include, for example, workstations 24, 26, 28, and 30.
  • Workstations 24, 26, 28, and 30 may each include, for example, a black and white printer, a color printer, a continuous feed printer, or another printer.
  • Post-press station 16 may include, for example, workstations 32, 34, 36, 38, and 40.
  • workstations 32, 34, 36, 38, and 40 may include, for example, a cutter for cutting printed material, a binder for binding printed material, or a collator for collating printed material.
  • each of the workstations 32, 34, 36, 38, and 40 may include a device that would combine one or more of the cutter, binder, and collator into a single device.
  • shipping station 18 may include, for example, workstations 42, 44, and 46.
  • Workstations 42, 44, and 46 each may include or may share, for example, an electronic device, such as a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer, as well as one or more packing machines to aid in performing the various tasks undertaken in the shipping station 18.
  • an electronic device such as a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer, as well as one or more packing machines to aid in performing the various tasks undertaken in the shipping station 18.
  • Each of the each of the individual workstations 20, 22, 24, 26, 28, 30, 32, 34, 36, 38, 40, 42, 44, and 46 may also have an respective image capture device 48, 50, 52, 54, 56, 58, 60, 62, 64, 66, 68, 70, 72, and 74 (collectively referred to hereafter as image capture devices 48-74) associated therewith.
  • each of the image capture devices 48-74 may operate to capture movements of a worker as tasks are undertaken at each of the various workstations 20-46 and transmit indications of worker movements, as will be described in greater detail below.
  • image capture devices 48-74 may be networked devices.
  • image capture devices 48 and 50 may be connected via wires or wirelessly to a pre-press station controller 76 in the prepress station 12
  • image capture devices 52, 54, 56, and 58 may be connected via wires or wirelessly to a press station controller 78 in the press station 14
  • image capture devices 60, 62, 64, 66, and 68 may be connected via wires or wirelessly to a post-press station controller 80 in the post-press station 12
  • image capture devices 70, 72, and 74 may be connected via wires or wirelessly to a shipping station controller 82 in the shipping station 18.
  • Each of the pre-press station controller 76, the press station controller 78, the post-press station controller 80, and the shipping station controller 82 may be for example, an electronic device, such as a server tower, a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer used to monitor the progress of one or more print jobs for each of the respective stations 12, 14, 16, and 18 with which the pre-press station controller 76, the press station controller 78, the post-press station controller 80, and the shipping station controller 82 is associated. Additionally, each of the station controllers 76-82 may be networked devices and connected, via wired or wirelessly, to workflow controller 84.
  • Workflow controller 84 may be for example, an electronic device, such as a server tower, a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer used to monitor the progress of one or more print jobs for one or more of the respective stations 12, 14, 16, and 18.
  • the workflow controller may also dynamically adjust the workflows of at least some of the print jobs passing through the PSP 10 to account for changes of circumstances on the production floor of the PSP 10, such as one or more of the workstations 20-46 breaking down, performing slowly, or otherwise impeding successful completion of a printing job.
  • each of image capture devices 48-74 may be directly connected, either via wires or wirelessly, to the workflow controller 84 in addition to, or instead of, being connected to the respective station controllers 76-82. Additionally, it should be noted that communications between the image capture devices 48-74 and the respective station controllers 76-82, communications between the station controllers 76-82 and the workflow controller 84, and/or communications between the image capture devices 48- 74 and the workflow controller 84 may take place, for example, utilizing the job definition format (JDF) and/or job messaging format (JMF) standards.
  • JDF job definition format
  • JMF job messaging format
  • a print job identifier 86, 88, 90, 92, 94, 96, 98, 100, 102, 104, 106, 108, 1 10, and 1 12 may be associated with each of the workstations 20-46 and/or the image capture devices 48-74.
  • Each of the print job identifiers 86-1 12 may include a radio frequency identification (RFID) scanner, a bar code scanner, a near field communicator (NFC), or another device able to detect an indicator assigned to a particular print job.
  • RFID radio frequency identification
  • NFC near field communicator
  • each print job may be assigned a particular identification (e.g., an RFID, a barcode, etc.) that may be physically or otherwise attached to the print job and may be read (i.e., identified) by the print job identifiers 86-1 12.
  • the print job identifiers 86-1 12 may record the status of a print job as it is being processed in the PSP 10.
  • the results of this status may be transmitted, via a wired or wireless connection, to the station controllers 76-82, and/or the workflow controller 84, so that real time monitoring of any print job may be accomplished.
  • these status updates from the print job identifiers 86-1 12 may be used in conjunction with or separate from status updates transmitted from the image capture devices 48-74.
  • FIG. 2 a detailed schematic of an image capture device (e.g., image capture device 60), a station controller (e.g., post-press station controller 80), and a workflow controller 84 are illustrated.
  • the various functional blocks of the image capture device 60, the post-press station controller 80, and the workflow controller 84 may include hardware elements, processor-executable instructions, or a combination of both.
  • each of image capture devices 48-74 may include the same elements as described with respect to image capture device 60.
  • post-press station controller 80 is described in detail below
  • each of the station controllers 76-82 may include the same elements as described with respect to post-press station controller 80.
  • the blocks illustrated in FIG. 2 are intended to represent only one example of a particular implementation of the image capture device 60, the post-press station controller 80, and the workflow controller 84, and the illustrated devices may include more or fewer components, as desired.
  • the image capture device 60, the post-press station controller 80, and the workflow controller 84 may include processors 1 14 and/or other data processing circuitry that may be operably coupled to memory 1 16 and storage 1 18 to execute instructions for carrying out the presently disclosed techniques. These instructions may be encoded in programs that may be executed by the processors 1 14. The instructions may be stored in any suitable article of manufacturer that includes at least one tangible non-transitory, computer- readable medium that at least collectively stores these instructions or routines, such as the memory 1 16 or the storage 1 18.
  • the memory 1 16 and the storage 1 18 of capture device 60, the post-press station controller 80, and the workflow controller 84 may include, for example, random-access memory, read-only memory, rewritable memory, hard drive(s), and/or optical discs.
  • the image capture device 60, the post-press station controller 80, and the workflow controller 84 may also include
  • the network interface 122 may provide communication via a personal area network (PAN) (e.g., Bluetooth), a local area network (LAN) (e.g., Wi-Fi), a wide area network (WAN) (e.g., 3G or LTE), a near field communication device (NFC), a physical connection (e.g., an Ethernet connection), and/or the like.
  • PAN personal area network
  • LAN local area network
  • WAN wide area network
  • NFC near field communication device
  • the image capture device 60, the post-press station controller 80, and the workflow controller 84 may be part of a communication network across which data related to various print jobs in the PSP 10 may be transmitted.
  • each of the post-press station controller 80 and the workflow controller 84 may include a display 124 for displaying, for example, a graphical user interface (GUI) and/or data related to GUI.
  • GUI graphical user interface
  • the image capture device 60 may include a sensory input device that senses vibrations, noises, or images.
  • the sensory input device comprises an image capture element 126.
  • This image capture element 126 may be a three dimensional (3D) capture camera that allows for depth image scenes to be captured.
  • the image capture element may include a depth sensor 128 (e.g., an infrared projection element in conjunction with a CMOS [complimentary metal-oxide semiconductor] sensor) for use in capturing depth maps for a region of interest (e.g., one or more portions of the workstations 20-46) as well as a conventional imaging device 130 (e.g., a digital camera) that may be utilized in conjunction to capture three dimensional images.
  • a depth sensor 128 e.g., an infrared projection element in conjunction with a CMOS [complimentary metal-oxide semiconductor] sensor
  • a conventional imaging device 130 e.g., a digital camera
  • the image capture element may include a 3D camera that incorporates single-photon avalanche diodes (SPADs) to allow for single-photon synchronous detection (SPSD) to generate 3D images.
  • SPSD single-photon synchronous detection
  • detection of a worker or a worker's hands in a particular area of the workstations 20-46 may be accomplished through the use of, for example, a directional passive infrared sensor (PIR), which may be included in the image capture device 60.
  • PIR passive infrared sensor
  • FIG. 3 illustrates a chart of a set of operations 132, processes 134, and sub-processes 136 that may be monitored by the image capture devices 48-74 for monitoring of the health and status of the PSP 10.
  • Operations 132 may include pre-press operations 138 that are performed at the pre-press station 12 of the PSP 10, press operations 140 that are performed at the press station 14 of the PSP 10, post-press operations 142 that are performed at the post-press station 16 of the PSP 10, and shipping operations 144 that are performed at the shipping station 18 of the PSP 10.
  • the pre-press operations 138 may include tasks such as inspecting incoming print jobs for errors, editing incoming print jobs for accuracy, creating proofs, and coordinating production of the print jobs.
  • the press operations 140 may include tasks such as preparing lithographic (offset) plates for printing the print job, loading particular paper and/or ink, and offloading printed material.
  • the shipping operations 144 may include tasks such as packing, labeling, and/or shipping completed print jobs to a customer.
  • Processes 134 illustrate examples of tasks that may be performed as part of post-press operations 142.
  • the post press operations 142 may include a cutting process 146 whereby printed material is cut to a desired size, a collating process 148 whereby cut material is collated, a first binding process 150, a second binding process 152 that includes binding steps, and a quality assurance process 154 that includes checking of a bound print job.
  • the first binding process 150 may include a set of sub- processes 136. These sub-processes 136 may include, for example, a start process 156 whereby, for example, a user (e.g., worker) begins the binding process for a given job.
  • a set-up process 158 may be undertaken by a worker, which may include, for example, adjusting one or more settings of a particular workstation (e.g., workstation 32) for a particular print job.
  • a loading process 160 may be executed, whereby pages are loaded into a particular workstation (e.g., workstation 32) followed by binding process 162, whereby binding occurs.
  • a quality check process may be undertaken and if the bound document meets quality requirements, the bound document may be moved to an output bin in process 166 for
  • operations 132, processes 134, and sub- processes 136 may be monitored by the image capture devices 48-74.
  • each of image capture devices 60, 62, 64, 66, and 68 may monitor respective workstations 32, 34, 36, 38, and 40 to determine a start of the operation 142.
  • This monitoring may begin, for example, when a print job with an assigned a particular identification (e.g., an RFID, a barcode, etc.) that may be physically or otherwise attached to the print job is read (i.e., identified) by one of the print job identifiers 98, 100, 102, 104, or 106.
  • a respective image capture devices 60, 62, 64, 66, or 68 can capture motions of a worker to determine which processes 134 and/or sub-processes 136 are being performed.
  • a worker may only identify a print job once (when first received at a particular workstation 32, 34, 36, 38, and 40), thus freeing the worker to complete the process 134 steps and sub-process 136 steps without entering further information as to the completion of any particular step.
  • the progress of a print job may still be followed, as the image capture devices 60, 62, 64, 66, or 68 continue to process movement by a worker and transmit these movements to, for example, post-press station controller 80 and/or workflow controller 84.
  • the image capture devices 60, 62, 64, 66, and 68 may also capture a movement or gesture that signifies the end or final step in process 134 and/or sub-process 136 and transmit that information to, for example, post-process controller 78 and/or workflow controller 84.
  • the start of a process 134 or sub-process 136 may be determined by a gesture or movement of a worker instead of through monitoring for a print job
  • FIG. 4 illustrates a flow diagram 170 for the operation of an image capture device (e.g., image capture device 60) while monitoring sub-processes 136.
  • the steps in flow diagram 170 may be applicable to monitoring of any of the operations 132 or processes 134 and for any of the workstations 20-46.
  • the image capture device 60 is activated. This activation may occur, for example, by the image capture device recognizing that a print job identifier (e.g., an RFID, a barcode, etc.) has been read (i.e., identified) by a print job identifiers (e.g., print job identifier 98).
  • a print job identifier e.g., an RFID, a barcode, etc.
  • the activation of the image capture device 60 may occur by capturing and identifying a movement or gesture associated with, for example, a start process 156.
  • the image capture device 60 monitors activities. Monitoring activities in step 174 may include the image capture device 60 monitoring movements and/or gestures of a worker that is working on workstation 32. Additionally or alternatively, monitoring activities in step 174 may include monitoring noise emanating from the workstation 32 (since particular noises at a workstation, e.g., workstation 32, may indicate which processes 134 or sub- processes 136 are being performed), via a sensory input device.
  • This sensory input device may include an array of microphones to enable acoustic source localization and ambient noise suppression, motion sensors, such as accelerometers, gyroscopes, humidity sensors, smell sensors, thermometer, altimeter, and or other sensors and may be part of a single chip) may also monitor vibrations, time span of one or more gestures, and/or various motions as part of step 174.
  • motion sensors such as accelerometers, gyroscopes, humidity sensors, smell sensors, thermometer, altimeter, and or other sensors and may be part of a single chip
  • Step 176 includes determining if a particular activity has been detected. That is, the image capture device 60 may determine if a particular movement and/or gesture of a worker that is working on workstation 32 (and/or a particular noise) has been detected. In one embodiment, the image capture device 60 may compare each of the monitored signals, such as presence, movements, gestures, vibration, and/or sounds against a database of pre-set (e.g., predetermined) movements, gestures, and sounds to determine if a particular movement, gesture, or sound has been detected in step 176.
  • pre-set e.g., predetermined
  • This process may be performed by the processor 1 14 of the image capture device 60 executing a software program or instructions (stored in memory 1 16 or storage 1 18) that compares inputs (i.e., monitored movements, gestures, and/or sounds) against stored predetermined values (i.e., movements, gestures, and/or sounds) in memory 1 16 or storage 1 18.
  • a model such as a machine learning algorithm utilizing, for example, a hidden Markov model (HMM) may be utilized to perform step 176.
  • HMM hidden Markov model
  • Utilization of a HMM may be beneficial as it allows for a multi-modal sensory system that fuses various modes, for example, to model them with a combined HMM.
  • step 176 may be repeated, as illustrated by line 178. However, if a particular activity is detected in step 176, a record may be generated in step 180. This record generated in step 180 may indicate that a particular sub-process 136 step has been completed. In one embodiment, this record is generated by the image capture device 60 for transmission to the post-press station controller 80 and/or to the workflow controller 84. In one embodiment, the record generated in step 180 may include an indication that a particular sub-process 136 step, process step 142, or operation 132 has been completed.
  • step 182 the image capture device 60 determines if any activities remain. That is, the image capture device may determine in step 182 if the record generated in step 180 indicates that a sub-process 136, process 134, or operation 132 has been completed. If, in step 182, it is determined that there are more activities to be monitored (e.g., a sub-process 136, process 134 step, or operation 132 has not been completed), the above described process may be repeated beginning anew at step 174, as illustrated by line 184.
  • step 182 If, however, in step 182 it is determined that the there are no more activities to be monitored (e.g., a sub-process 136, process 134, or operation 132 has been completed), the above described process may end in step 186 so that the image capture device 60 may be reset for a subsequent print job (i.e., so that steps 172-184 may be performed for a subsequent print job.)
  • each of steps in flow diagram 170 may be initiated and/or performed by software or instructions executed by processors 1 14 in an image capture device (e.g., image capture device 60).
  • the instructions may be stored in any suitable article of manufacturer that includes at least one tangible non- transitory, computer-readable medium that at least collectively stores these instructions or routines, such as the memory 1 16 or the storage 1 18 of the image capture device 60.
  • one or movements or gestures of a worker may be associated with each process 134 step and sub-process 136 step. That is, certain gestures may be recognizable as coinciding with, for example, a process 134 step and sub-process 136 step being performed. That is, by tracking the movements and/or gestures of a worker, the progress of a print job may be monitored as it proceeds through PSP 10. For example, records generated in step 180 may be utilized by the post-press station controller 80 and/or to the workflow controller 84 to monitor the progress of a particular print job. In another embodiment, only the transition between process 134 steps, sub-process 136 steps, or a transition between a process 134 step and a sub- process 136 step may be captured. Capture of transitions may be
  • job sensing may mark the beginning of a series of steps, while each transition marks the following steps.
  • each transition marks the following steps.
  • the post-press station controller 80 and/or to the workflow controller 84 may determine that a task has not been completed. That is, a particular workstation (e.g., workstation 32) may be determined to be malfunctioning and, thus, causing a disruption both for the immediate print job being processed as well as any remaining scheduled print jobs (i.e., if workstation 32 is inoperable, the overall capacity of the PSP is reduced, thus leading to increased production times for all scheduled print jobs.) Additionally, as records are received, bottlenecks in the PSP 10 may be identified.
  • a certain workstation e.g., workstation 32
  • modifications can be made in real time, such as switching workers so that more experienced (i.e., faster) workers may move to workstations that are underperforming.
  • the monitoring system and process described above may allow for, for example, dynamic updates of various print jobs, dynamic updates of the in response to live conditions on the PSP 10 production floor (e.g., temporary unavailability of a print machine), and may allow for collection of accurate statistics on the amount of time to complete various tasks with respect to particular print jobs.
  • a map of the PSP 10 can be provided on display 124 of the workflow controller 84 and/or a map of the post-production section16 may be provided on a display 124 of the post-press station controller 80 (whereby each may includes information related to the records transmitted by the various image capture devices 48-74), so that a supervisor may visually determine where bottlenecks/problems that need attention are located.
  • a floor manager of the PSP 10 may be assisted by the collection of real-time job status information by the image capture devices 48-74 to aid in making decision on-the-fly (i.e., in real time.) Additionally, this data may be catalogued for analysis and auditing purposes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Factory Administration (AREA)

Abstract

Devices and methods for tracking a print job through monitoring of activities on a print service provider (PSP) (10) production floor are provided. As activities are performed, an image capture device (48) may monitor the activities. These activities may be analyzed and compared to a set of predetermined activities to determine if a step in a print job has been completed. This may allow for real-time tracking of the print job as well as real-time indications of problems that occur on the PSP (10) floor.

Description

CAPTURING WORKFLOW DATA USING GESTURE TRACKING
BACKGROUND
[0001] This section is intended to introduce the reader to various aspects of art, which may be related to various aspects of the present invention that are described or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present invention. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
[0002] Print service providers (PSPs) fulfill the demand for print products by printing a vast array of print products, such as photographs, brochures, school course materials, periodicals, books, advertisements, and/or product packaging. Once a job order is released to the PSP floor for production, it goes through four stages of production (Pre-press, Press, Post-Press, and
Shipping.) Automated gathering of process information through these stages of production is very limited. However, information relating to each stage of the process is valuable to enable real-time monitoring and job/resource scheduling. Accordingly, gathering detailed information about the timing of each stage of production, as well as the various sub-process undertaken at each stage of production, would allow for a more accurate characterization of each process, which would allow for a better estimation of the delivery time and allow for more accurate scheduling of product production times. BRIEF DESCRIPTION OF THE DRAWINGS
[0003] FIG. 1 illustrates a block diagram of a production floor for a print service provider (PSP) in accordance with an embodiment;
[0004] FIG. 2 illustrates a block diagram of an embodiment of an image capture device, a station controller, and a workflow controller of the PSP of FIG. 1 ;
[0005] FIG. 3 is a diagram of operations, processes, and sub-processes performed in the PSP and captured by the image capture device of FIG. 2; and
[0006] FIG. 4 is a flow chart illustrating the operation of the image capture device of FIG. 2.
DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS
[0007] One or more exemplary embodiments of the present invention will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
[0008] Technical effects of the present disclosure include real-time monitoring of a print job as it progresses through a workflow. This monitoring may be accomplished by tracking the movements or gestures of workers as they complete tasks associated with various print jobs. Additionally, by tracking the completion of tasks by the workers, conditions on the PSP production floor may be monitored in real-time. Accordingly, accurate PSP production floor data can be obtained for visualization and auditing purposes.
[0009] Turning now to the drawings and referring first to FIG. 1 , an embodiment of a print service provider (PSP) 10. Specifically, the PSP 10 may be, for example, a print shop or other printing location that prints brochures, school course materials, periodicals, books, advertisements, product packaging, and/or other types of on-demand printing jobs. The PSP 10 may be organized into four basic stations, each with a specific role that allows for a print job to be fulfilled. These stations of the PSP 10 may include a pre-press station 12, a press station 14, a post-press station 16, and a shipping station 18. Tasks such as inspecting incoming print jobs for errors, editing incoming print jobs for accuracy, creating proofs, and coordinating production of the print jobs may be performed in the pre-press station 12 of the PSP 10.
[0010] Subsequent to being received at the pre-press station 12, a print job may be transferred to the press station 14. At the press station 14, the print job may be printed. To complete the printing of a print job, tasks performed at the press station 14 may include, for example (depending on the material to be printed and the devices available to complete the printing), preparing
lithographic (offset) plates, flexographic presses, letterpresses, intaglio printing processes (e.g., rotogravure printing), hybrid machines, such as ink-jet over silk screen or intaglio over gravure machines, digital presses (e.g., an Indigo digital press from Hewlett-Packard Company) and/or industrial printers (e.g., a Scitex press from Hewlett-Packard Company) for printing the print job, loading particular paper and/or ink, and offloading printed material. Subsequent to the print job being printed in the press station 14, the printed material for the print job may be transported to the post-press station 16.
[0011] At the post-press station 16, the printed material for a given print job may undergo additional processing. For example, the printed material may be cut, collated, and/or bound at the post-press station 16 (depending on the requirements of a given print job). That is, the print job may be finished (i.e., placed into final form) at the post-press station 16. Subsequent to the print job being finished at the post-press station 16, the print job is transported to the shipping station 18, whereby the finished print job may be, for example, packed, labeled, and/or shipped to a customer.
[0012] Additionally, each of the stations 12, 14, 16, and 18 of the PSP 10 may include various workstations at which the various tasks of the stations 12, 14, 16, and 18 may be performed. For example, the pre-press station 12 may include, for example, workstations 20 and 22. Each of workstations 20 and 22 may include or may share, for example, an electronic device, such as a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer, to aid in performing the various tasks undertaken in pre-press station 12. Similarly, the press station 14 may include, for example, workstations 24, 26, 28, and 30. Workstations 24, 26, 28, and 30 may each include, for example, a black and white printer, a color printer, a continuous feed printer, or another printer. Post-press station 16 may include, for example, workstations 32, 34, 36, 38, and 40. Each of workstations 32, 34, 36, 38, and 40 may include, for example, a cutter for cutting printed material, a binder for binding printed material, or a collator for collating printed material. Additionally, it is envisioned that each of the workstations 32, 34, 36, 38, and 40 may include a device that would combine one or more of the cutter, binder, and collator into a single device. Finally, shipping station 18 may include, for example, workstations 42, 44, and 46. Workstations 42, 44, and 46, each may include or may share, for example, an electronic device, such as a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer, as well as one or more packing machines to aid in performing the various tasks undertaken in the shipping station 18.
[0013] Each of the each of the individual workstations 20, 22, 24, 26, 28, 30, 32, 34, 36, 38, 40, 42, 44, and 46 (collectively referred to hereafter as workstations 20-46) may also have an respective image capture device 48, 50, 52, 54, 56, 58, 60, 62, 64, 66, 68, 70, 72, and 74 (collectively referred to hereafter as image capture devices 48-74) associated therewith. Moreover, each of the image capture devices 48-74 may operate to capture movements of a worker as tasks are undertaken at each of the various workstations 20-46 and transmit indications of worker movements, as will be described in greater detail below.
[0014] In one embodiment, image capture devices 48-74 may be networked devices. For example, image capture devices 48 and 50 may be connected via wires or wirelessly to a pre-press station controller 76 in the prepress station 12, image capture devices 52, 54, 56, and 58 may be connected via wires or wirelessly to a press station controller 78 in the press station 14, image capture devices 60, 62, 64, 66, and 68 may be connected via wires or wirelessly to a post-press station controller 80 in the post-press station 12, and image capture devices 70, 72, and 74 may be connected via wires or wirelessly to a shipping station controller 82 in the shipping station 18.
[0015] Each of the pre-press station controller 76, the press station controller 78, the post-press station controller 80, and the shipping station controller 82 (collectively referred to hereafter as station controllers 76-82) may be for example, an electronic device, such as a server tower, a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer used to monitor the progress of one or more print jobs for each of the respective stations 12, 14, 16, and 18 with which the pre-press station controller 76, the press station controller 78, the post-press station controller 80, and the shipping station controller 82 is associated. Additionally, each of the station controllers 76-82 may be networked devices and connected, via wired or wirelessly, to workflow controller 84.
[0016] Workflow controller 84 may be for example, an electronic device, such as a server tower, a desktop computer, a notebook computer, a handheld device (e.g., a portable phone), or a tablet computer used to monitor the progress of one or more print jobs for one or more of the respective stations 12, 14, 16, and 18. The workflow controller may also dynamically adjust the workflows of at least some of the print jobs passing through the PSP 10 to account for changes of circumstances on the production floor of the PSP 10, such as one or more of the workstations 20-46 breaking down, performing slowly, or otherwise impeding successful completion of a printing job. In another embodiment, each of image capture devices 48-74 may be directly connected, either via wires or wirelessly, to the workflow controller 84 in addition to, or instead of, being connected to the respective station controllers 76-82. Additionally, it should be noted that communications between the image capture devices 48-74 and the respective station controllers 76-82, communications between the station controllers 76-82 and the workflow controller 84, and/or communications between the image capture devices 48- 74 and the workflow controller 84 may take place, for example, utilizing the job definition format (JDF) and/or job messaging format (JMF) standards.
[0017] Additionally, in one embodiment, a print job identifier 86, 88, 90, 92, 94, 96, 98, 100, 102, 104, 106, 108, 1 10, and 1 12 (collectively referred to hereafter as print job identifiers 86-1 12) may be associated with each of the workstations 20-46 and/or the image capture devices 48-74. Each of the print job identifiers 86-1 12 may include a radio frequency identification (RFID) scanner, a bar code scanner, a near field communicator (NFC), or another device able to detect an indicator assigned to a particular print job. That, is, each print job may be assigned a particular identification (e.g., an RFID, a barcode, etc.) that may be physically or otherwise attached to the print job and may be read (i.e., identified) by the print job identifiers 86-1 12. In this manner, the print job identifiers 86-1 12 may record the status of a print job as it is being processed in the PSP 10. Moreover, the results of this status may be transmitted, via a wired or wireless connection, to the station controllers 76-82, and/or the workflow controller 84, so that real time monitoring of any print job may be accomplished. In addition, these status updates from the print job identifiers 86-1 12 may be used in conjunction with or separate from status updates transmitted from the image capture devices 48-74.
[0018] Turning next to FIG. 2, a detailed schematic of an image capture device (e.g., image capture device 60), a station controller (e.g., post-press station controller 80), and a workflow controller 84 are illustrated. The various functional blocks of the image capture device 60, the post-press station controller 80, and the workflow controller 84 may include hardware elements, processor-executable instructions, or a combination of both. Moreover, it is noted that while only image capture device 60 is described in detail below, each of image capture devices 48-74 may include the same elements as described with respect to image capture device 60. Similarly, while post-press station controller 80 is described in detail below, each of the station controllers 76-82 may include the same elements as described with respect to post-press station controller 80. Thus, the blocks illustrated in FIG. 2 are intended to represent only one example of a particular implementation of the image capture device 60, the post-press station controller 80, and the workflow controller 84, and the illustrated devices may include more or fewer components, as desired.
[0019] The image capture device 60, the post-press station controller 80, and the workflow controller 84 may include processors 1 14 and/or other data processing circuitry that may be operably coupled to memory 1 16 and storage 1 18 to execute instructions for carrying out the presently disclosed techniques. These instructions may be encoded in programs that may be executed by the processors 1 14. The instructions may be stored in any suitable article of manufacturer that includes at least one tangible non-transitory, computer- readable medium that at least collectively stores these instructions or routines, such as the memory 1 16 or the storage 1 18.
[0020] The memory 1 16 and the storage 1 18 of capture device 60, the post-press station controller 80, and the workflow controller 84 may include, for example, random-access memory, read-only memory, rewritable memory, hard drive(s), and/or optical discs. The image capture device 60, the post-press station controller 80, and the workflow controller 84 may also include
input/output (I/O) ports 120 for connection to external devices (e.g., a printer, mouse, keyboard, etc.) as well as a network interface 122. The network interface 122 may provide communication via a personal area network (PAN) (e.g., Bluetooth), a local area network (LAN) (e.g., Wi-Fi), a wide area network (WAN) (e.g., 3G or LTE), a near field communication device (NFC), a physical connection (e.g., an Ethernet connection), and/or the like. Through the network interface 122, the image capture device 60, the post-press station controller 80, and the workflow controller 84 may be part of a communication network across which data related to various print jobs in the PSP 10 may be transmitted.
Additionally, in one embodiment, each of the post-press station controller 80 and the workflow controller 84 may include a display 124 for displaying, for example, a graphical user interface (GUI) and/or data related to
communications from the image capture devices 48-74.
[0021] Furthermore, the image capture device 60 may include a sensory input device that senses vibrations, noises, or images. In one embodiment, the sensory input device comprises an image capture element 126. This image capture element 126 may be a three dimensional (3D) capture camera that allows for depth image scenes to be captured. For example, the image capture element may include a depth sensor 128 (e.g., an infrared projection element in conjunction with a CMOS [complimentary metal-oxide semiconductor] sensor) for use in capturing depth maps for a region of interest (e.g., one or more portions of the workstations 20-46) as well as a conventional imaging device 130 (e.g., a digital camera) that may be utilized in conjunction to capture three dimensional images. Additionally, or alternatively, the image capture element may include a 3D camera that incorporates single-photon avalanche diodes (SPADs) to allow for single-photon synchronous detection (SPSD) to generate 3D images. These images that are captured and generated in the image capture device 60 may be utilized, for example, to detect gestures of a worker at each of the workstations 20-46 to allow for automated tracking of the progress of a print job as it passes through the PSP 10. In another
embodiment, detection of a worker or a worker's hands in a particular area of the workstations 20-46 may be accomplished through the use of, for example, a directional passive infrared sensor (PIR), which may be included in the image capture device 60.
[0022] FIG. 3 illustrates a chart of a set of operations 132, processes 134, and sub-processes 136 that may be monitored by the image capture devices 48-74 for monitoring of the health and status of the PSP 10. Operations 132 may include pre-press operations 138 that are performed at the pre-press station 12 of the PSP 10, press operations 140 that are performed at the press station 14 of the PSP 10, post-press operations 142 that are performed at the post-press station 16 of the PSP 10, and shipping operations 144 that are performed at the shipping station 18 of the PSP 10. The pre-press operations 138 may include tasks such as inspecting incoming print jobs for errors, editing incoming print jobs for accuracy, creating proofs, and coordinating production of the print jobs. The press operations 140 may include tasks such as preparing lithographic (offset) plates for printing the print job, loading particular paper and/or ink, and offloading printed material. The shipping operations 144 may include tasks such as packing, labeling, and/or shipping completed print jobs to a customer.
[0023] Processes 134 illustrate examples of tasks that may be performed as part of post-press operations 142. For example, the post press operations 142 may include a cutting process 146 whereby printed material is cut to a desired size, a collating process 148 whereby cut material is collated, a first binding process 150, a second binding process 152 that includes binding steps, and a quality assurance process 154 that includes checking of a bound print job. As illustrated, the first binding process 150 may include a set of sub- processes 136. These sub-processes 136 may include, for example, a start process 156 whereby, for example, a user (e.g., worker) begins the binding process for a given job.
[0024] Subsequent to the start process 156, a set-up process 158 may be undertaken by a worker, which may include, for example, adjusting one or more settings of a particular workstation (e.g., workstation 32) for a particular print job. Next, a loading process 160 may be executed, whereby pages are loaded into a particular workstation (e.g., workstation 32) followed by binding process 162, whereby binding occurs. In process 164, a quality check process may be undertaken and if the bound document meets quality requirements, the bound document may be moved to an output bin in process 166 for
conveyance to the next process (e.g., second binding process 152.) Finally, in process 168, the sub-processes 136 are indicated as being completed. [0025] As noted above, operations 132, processes 134, and sub- processes 136 may be monitored by the image capture devices 48-74. For example, each of image capture devices 60, 62, 64, 66, and 68 may monitor respective workstations 32, 34, 36, 38, and 40 to determine a start of the operation 142. This monitoring may begin, for example, when a print job with an assigned a particular identification (e.g., an RFID, a barcode, etc.) that may be physically or otherwise attached to the print job is read (i.e., identified) by one of the print job identifiers 98, 100, 102, 104, or 106. Once read, a respective image capture devices 60, 62, 64, 66, or 68 can capture motions of a worker to determine which processes 134 and/or sub-processes 136 are being performed.
[0026] In this manner, a worker may only identify a print job once (when first received at a particular workstation 32, 34, 36, 38, and 40), thus freeing the worker to complete the process 134 steps and sub-process 136 steps without entering further information as to the completion of any particular step.
However, the progress of a print job may still be followed, as the image capture devices 60, 62, 64, 66, or 68 continue to process movement by a worker and transmit these movements to, for example, post-press station controller 80 and/or workflow controller 84. The image capture devices 60, 62, 64, 66, and 68 may also capture a movement or gesture that signifies the end or final step in process 134 and/or sub-process 136 and transmit that information to, for example, post-process controller 78 and/or workflow controller 84. Additionally, the start of a process 134 or sub-process 136 may be determined by a gesture or movement of a worker instead of through monitoring for a print job
identification.
[0027] FIG. 4 illustrates a flow diagram 170 for the operation of an image capture device (e.g., image capture device 60) while monitoring sub-processes 136. However, it should be noted that the steps in flow diagram 170 may be applicable to monitoring of any of the operations 132 or processes 134 and for any of the workstations 20-46. [0028] In step 172, the image capture device 60 is activated. This activation may occur, for example, by the image capture device recognizing that a print job identifier (e.g., an RFID, a barcode, etc.) has been read (i.e., identified) by a print job identifiers (e.g., print job identifier 98). Alternatively, the activation of the image capture device 60 may occur by capturing and identifying a movement or gesture associated with, for example, a start process 156. In step 174, the image capture device 60 monitors activities. Monitoring activities in step 174 may include the image capture device 60 monitoring movements and/or gestures of a worker that is working on workstation 32. Additionally or alternatively, monitoring activities in step 174 may include monitoring noise emanating from the workstation 32 (since particular noises at a workstation, e.g., workstation 32, may indicate which processes 134 or sub- processes 136 are being performed), via a sensory input device. This sensory input device (which may include an array of microphones to enable acoustic source localization and ambient noise suppression, motion sensors, such as accelerometers, gyroscopes, humidity sensors, smell sensors, thermometer, altimeter, and or other sensors and may be part of a single chip) may also monitor vibrations, time span of one or more gestures, and/or various motions as part of step 174.
[0029] Step 176 includes determining if a particular activity has been detected. That is, the image capture device 60 may determine if a particular movement and/or gesture of a worker that is working on workstation 32 (and/or a particular noise) has been detected. In one embodiment, the image capture device 60 may compare each of the monitored signals, such as presence, movements, gestures, vibration, and/or sounds against a database of pre-set (e.g., predetermined) movements, gestures, and sounds to determine if a particular movement, gesture, or sound has been detected in step 176. This process may be performed by the processor 1 14 of the image capture device 60 executing a software program or instructions (stored in memory 1 16 or storage 1 18) that compares inputs (i.e., monitored movements, gestures, and/or sounds) against stored predetermined values (i.e., movements, gestures, and/or sounds) in memory 1 16 or storage 1 18. Alternatively, a model, such as a machine learning algorithm utilizing, for example, a hidden Markov model (HMM), may be utilized to perform step 176. Utilization of a HMM may be beneficial as it allows for a multi-modal sensory system that fuses various modes, for example, to model them with a combined HMM.
[0030] If no particular activity has been detected in step 176, step 176 may be repeated, as illustrated by line 178. However, if a particular activity is detected in step 176, a record may be generated in step 180. This record generated in step 180 may indicate that a particular sub-process 136 step has been completed. In one embodiment, this record is generated by the image capture device 60 for transmission to the post-press station controller 80 and/or to the workflow controller 84. In one embodiment, the record generated in step 180 may include an indication that a particular sub-process 136 step, process step 142, or operation 132 has been completed.
[0031] In step 182, the image capture device 60 determines if any activities remain. That is, the image capture device may determine in step 182 if the record generated in step 180 indicates that a sub-process 136, process 134, or operation 132 has been completed. If, in step 182, it is determined that there are more activities to be monitored (e.g., a sub-process 136, process 134 step, or operation 132 has not been completed), the above described process may be repeated beginning anew at step 174, as illustrated by line 184.
[0032] If, however, in step 182 it is determined that the there are no more activities to be monitored (e.g., a sub-process 136, process 134, or operation 132 has been completed), the above described process may end in step 186 so that the image capture device 60 may be reset for a subsequent print job (i.e., so that steps 172-184 may be performed for a subsequent print job.) In one embodiment, each of steps in flow diagram 170 may be initiated and/or performed by software or instructions executed by processors 1 14 in an image capture device (e.g., image capture device 60). The instructions may be stored in any suitable article of manufacturer that includes at least one tangible non- transitory, computer-readable medium that at least collectively stores these instructions or routines, such as the memory 1 16 or the storage 1 18 of the image capture device 60.
[0033] As noted above, one or movements or gestures of a worker may be associated with each process 134 step and sub-process 136 step. That is, certain gestures may be recognizable as coinciding with, for example, a process 134 step and sub-process 136 step being performed. That is, by tracking the movements and/or gestures of a worker, the progress of a print job may be monitored as it proceeds through PSP 10. For example, records generated in step 180 may be utilized by the post-press station controller 80 and/or to the workflow controller 84 to monitor the progress of a particular print job. In another embodiment, only the transition between process 134 steps, sub-process 136 steps, or a transition between a process 134 step and a sub- process 136 step may be captured. Capture of transitions may be
advantageous as being simpler and faster to do since specific gestures may not be necessary to register a transition as occurring. For example, job sensing may mark the beginning of a series of steps, while each transition marks the following steps. Thus, once a new job is sensed, it process may restart.
[0034] Additionally, if no records are received, the post-press station controller 80 and/or to the workflow controller 84 may determine that a task has not been completed. That is, a particular workstation (e.g., workstation 32) may be determined to be malfunctioning and, thus, causing a disruption both for the immediate print job being processed as well as any remaining scheduled print jobs (i.e., if workstation 32 is inoperable, the overall capacity of the PSP is reduced, thus leading to increased production times for all scheduled print jobs.) Additionally, as records are received, bottlenecks in the PSP 10 may be identified. That is, if a certain workstation (e.g., workstation 32) is completing tasks at a reduced rate relative to other workstations in its station 16, modifications can be made in real time, such as switching workers so that more experienced (i.e., faster) workers may move to workstations that are underperforming.
[0035] Thus, the monitoring system and process described above may allow for, for example, dynamic updates of various print jobs, dynamic updates of the in response to live conditions on the PSP 10 production floor (e.g., temporary unavailability of a print machine), and may allow for collection of accurate statistics on the amount of time to complete various tasks with respect to particular print jobs. For example, a map of the PSP 10 can be provided on display 124 of the workflow controller 84 and/or a map of the post-production section16 may be provided on a display 124 of the post-press station controller 80 (whereby each may includes information related to the records transmitted by the various image capture devices 48-74), so that a supervisor may visually determine where bottlenecks/problems that need attention are located. Thus, for example, a floor manager of the PSP 10 may be assisted by the collection of real-time job status information by the image capture devices 48-74 to aid in making decision on-the-fly (i.e., in real time.) Additionally, this data may be catalogued for analysis and auditing purposes.
[0036] The specific embodiments described above have been shown by way of example, and it should be understood that these embodiments may be susceptible to various modifications and alternative forms. It should be further understood that the claims are not intended to be limited to the particular forms disclosed, but rather to cover all modifications, equivalents, and alternatives falling within the spirit and scope of this disclosure.

Claims

CLAIMS What is claimed is:
1 . An electronic device comprising:
a sensory input device configured to monitor activity in relation to a print workstation;
a processor configured to determine if the monitored activity corresponds to a predicted activity performed at the print workstation and generate a record indicative of the occurrence of the predicted activity; and
a network interface configured to transmit the record to a print service station controller related to the print workstation or to a print service workflow controller.
2. The electronic device of claim 1 , wherein the monitored activity comprises a gesture of a worker at the print workstation.
3. The electronic device of claim 1 , wherein the monitored activity comprises a transition between gestures or positions of a worker at the print workstation.
4. The electronic device of claim 1 , wherein the processor is configured to receive a set of signals from the sensory input device corresponding to infrared light, gestures, vibrations, video, or noise generated by the print workstation and utilize the set of signals to determine if the monitored activity corresponds to the predicted activity.
5. The electronic device of claim 1 , wherein the sensory input device comprises a directional passive infrared sensor.
6. The electronic device of claim 1 , wherein the sensory input device comprises a digital camera configured to generate three dimensional images.
7. The electronic device of claim 6, wherein the digital camera comprises a single-photon avalanche diode (SPADs) to allow for single-photon synchronous detection (SPSD) to generate the three dimensional images.
8. The electronic device of claim 1 , comprising a print job identifier configured to identify a print job to be processed at the print workstation via a Bluetooth transmission or a near field communication transmission.
9. The electronic device of claim 8, wherein the print job identifier comprises a radio frequency identification (RFID) scanner or a barcode scanner,
10. An article of manufacture comprising:
at least one tangible, machine-readable medium at least collectively storing processor-executable instructions, the instructions comprising:
instructions to monitor activity at a print workstation in relation to a print job on a print service provider production floor;
instructions to determine if the monitored activity corresponds to a predicted activity performed at the print workstation;
instructions to generate a record indicative of the occurrence of the predicted activity; and
instructions to transmit the record indicative of the occurrence of the predicted activity to a print service station controller related to the print workstation or to a print service workflow controller.
1 1 . The article of manufacture of claim 10, comprising instructions to detect a print job identification prior to executing instructions to monitor activity at the print workstation.
12. The article of manufacture of claim 10, comprising instructions to reset an image capture device when the occurrence of the predicted activity comprises a completion of actions by a worker at the workstation.
13. A method comprising:
monitoring via an image capture device activity at a print workstation in relation to a print job on a print service provider production floor;
determining at the image capture device if the monitored activity corresponds to a predicted activity performed at the print workstation;
generating at the image capture device a record indicative of the occurrence of the predicted activity; and
transmitting from the image capture device the record indicative of the occurrence of the predicted activity to a print service station controller related to the print workstation or to a print service workflow controller.
14. The method of claim 13, comprising receiving the record at the print service station controller and generating a visual indication of the record on a display of the print service station controller.
15. The method of claim 13, comprising receiving the record at the print service workflow controller and generating a visual indication of the record on a display of the print service workflow controller.
PCT/US2011/057720 2011-10-25 2011-10-25 Capturing workflow data using gesture tracking Ceased WO2013062532A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2011/057720 WO2013062532A1 (en) 2011-10-25 2011-10-25 Capturing workflow data using gesture tracking

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2011/057720 WO2013062532A1 (en) 2011-10-25 2011-10-25 Capturing workflow data using gesture tracking

Publications (1)

Publication Number Publication Date
WO2013062532A1 true WO2013062532A1 (en) 2013-05-02

Family

ID=48168206

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2011/057720 Ceased WO2013062532A1 (en) 2011-10-25 2011-10-25 Capturing workflow data using gesture tracking

Country Status (1)

Country Link
WO (1) WO2013062532A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080303913A1 (en) * 2005-08-26 2008-12-11 Koninklijke Philips Electronics, N.V. Imaging Camera Processing Unit and Method
US20090257081A1 (en) * 2008-04-10 2009-10-15 Xerox Corporation Expected time to collect a print job

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080303913A1 (en) * 2005-08-26 2008-12-11 Koninklijke Philips Electronics, N.V. Imaging Camera Processing Unit and Method
US20090257081A1 (en) * 2008-04-10 2009-10-15 Xerox Corporation Expected time to collect a print job

Similar Documents

Publication Publication Date Title
US8760691B2 (en) Devices and methods for print job tracking
US6633821B2 (en) System for sensing factory workspace
JP7171407B2 (en) Information processing device, production instruction support method
US20150358488A1 (en) Method for identifying print control elements for quality data acquisition and interface having a code for identifying print control elements
CN110554845A (en) Printing process management device and computer-readable medium
JP2010109887A5 (en)
CN106462567A (en) Augmented data view
JP2006301742A5 (en)
JP2015075792A (en) Report preparation system
KR20090073643A (en) Production site information provision system and method
CN107871201B (en) Adjustment work support system
JP2006309350A5 (en)
US10061549B2 (en) Information processing apparatus, control method, and storage medium for on-demand printing of a composite job
EP3153962B1 (en) Printing control device, printing system, and printing control method
WO2013062532A1 (en) Capturing workflow data using gesture tracking
JP7540817B2 (en) Date generation device, control method, and program
JP6305170B2 (en) Vehicle weight weighing system and vehicle weight weighing method
JP5994394B2 (en) Steel plate identification device and identification method
CN104933454A (en) Equipment spot inspection device based on Internet of things and control method thereof
CN204347856U (en) Based on the equipment point-detecting device of technology of Internet of things
CN105164718A (en) Information system and method for information processing, in particular for supporting work in a motor vehicle workshop
US10317887B2 (en) Apparatus and method for maintaining a machine
JP6672952B2 (en) Maintenance system, program, maintenance method
JP6363639B2 (en) Numerical control device with processing data batch output function
JP6242770B2 (en) Manufacturing management system, mobile terminal for manufacturing management, and manufacturing management method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11874845

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11874845

Country of ref document: EP

Kind code of ref document: A1