WO2011158955A1 - 作業機械の周囲監視装置 - Google Patents
作業機械の周囲監視装置 Download PDFInfo
- Publication number
- WO2011158955A1 WO2011158955A1 PCT/JP2011/064065 JP2011064065W WO2011158955A1 WO 2011158955 A1 WO2011158955 A1 WO 2011158955A1 JP 2011064065 W JP2011064065 W JP 2011064065W WO 2011158955 A1 WO2011158955 A1 WO 2011158955A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- work machine
- image
- monitoring
- area
- worker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/20—Drives; Control devices
- E02F9/22—Hydraulic or pneumatic drives
- E02F9/226—Safety arrangements, e.g. hydraulic driven fans, preventing cavitation, leakage, overheating
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/24—Safety devices, e.g. for preventing overload
-
- E—FIXED CONSTRUCTIONS
- E02—HYDRAULIC ENGINEERING; FOUNDATIONS; SOIL SHIFTING
- E02F—DREDGING; SOIL-SHIFTING
- E02F9/00—Component parts of dredgers or soil-shifting machines, not restricted to one of the kinds covered by groups E02F3/00 - E02F7/00
- E02F9/26—Indicating devices
- E02F9/261—Surveying the work-site to be treated
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
Definitions
- This invention relates to a surrounding monitoring device for a work machine.
- a work machine such as a hydraulic excavator has regions that are difficult to see from the operator's side on the left and right sides and the rear of the operation room. Therefore, it is desirable to provide a monitoring device for obstacles and intruders to prevent accidents.
- a work machine monitoring apparatus as described below is known (for example, Patent Document 1).
- the work machine is provided with a proximity sensor that detects an object existing in a monitoring area around the work machine, and an imaging device that captures an image in the detection area of the proximity sensor.
- the monitoring device obtains the position of the object based on the time until the ultrasonic wave emitted from the proximity sensor is reflected by the object, and when the presence of the object is detected in the monitoring region, the imaging device described above Is displayed on the display device together with the image picked up by.
- a surroundings monitoring device includes a display device, a worker position detection unit that detects the position of a worker who performs work around the work machine, and a work machine attached to the work machine.
- An imaging unit that captures and obtains a surrounding image
- an image conversion unit that converts the surrounding image of the work machine obtained from the imaging unit into an overhead image viewed from above the work machine, and an overhead view converted by the image conversion unit
- An image generation unit that generates an image for monitoring based on the image and the position of the worker obtained from the worker position detection unit, a display control unit that displays the monitoring image on a display device, and a position of the worker in advance
- the image generation unit includes a determination unit that determines whether or not the set monitoring region exists, and a plurality of work machine state detection units that detect a posture or a drive state of the work machine including a traveling speed of the work machine.
- the judgment result by the judgment part based on information from at least one work machine state detection unit, a plurality of monitoring images are generated that display the situation within the monitoring range having different sizes set around the work machine.
- the surroundings monitoring device according to the second aspect of the present invention is the surrounding monitoring device for a working machine according to the first aspect, wherein the plurality of monitoring images are neighboring display images indicating the state of a neighboring region set around the working machine.
- the surroundings monitoring device is the surrounding monitoring device for a work machine according to the second aspect, wherein the determination unit sets the monitoring area as the wide area and the position of the worker exists in the monitoring area. It is preferable to determine whether or not to do so.
- the surroundings monitoring apparatus is the surrounding monitoring apparatus for a work machine according to the second aspect, wherein the determination unit sets the monitoring area as the vicinity area and the position of the worker exists in the monitoring area. It is preferable to determine whether or not.
- a surroundings monitoring device is the surroundings monitoring device for a work machine according to any one of the second to fourth aspects, wherein the wide-area displaying image is displayed when the wide-ranging displaying image is displayed on the display device. It is preferable that a first input unit that accepts an operation for enlarging or reducing the image is further provided, and the image generation unit changes the size of the wide-area display image while the operation is accepted by the first input unit.
- a surroundings monitoring apparatus according to a sixth aspect of the present invention is the surrounding monitoring apparatus for a work machine according to any one of the second to fifth aspects, in which the user manually selects one of the proximity display image and the wide display image. It is preferable to further include a second input unit for selecting.
- the determination unit determines that the position of the worker is not within the monitoring area.
- the image generation unit generates a wide display image
- the display control unit displays the wide display image on the display device.
- a surrounding monitoring apparatus is the surrounding monitoring apparatus for a working machine according to any one of the second to sixth aspects, wherein the working machine includes a front work machine configured to be extendable and contractible, Even if it is determined by the determination unit that the position is within the monitoring area, if the work machine state detection unit detects that the front work machine is being extended, the image generation unit It is preferable that the image is generated and the display control unit displays the wide-area display image on the display device.
- a surrounding monitoring apparatus is the surrounding monitoring apparatus for a working machine according to any one of the second to sixth aspects, wherein the working machine includes a front work machine configured to be extendable and contracted, Even if it is determined by the determination unit that the position is within the monitoring area, and the front work machine is detected to be contracting by the work machine state detection unit, the work machine state detection unit detects that the work machine is running. When it is detected that the speed is higher than a predetermined speed, the image generation unit preferably generates a wide display image, and the display control unit displays the wide display image on the display device.
- the surroundings monitoring apparatus is the surrounding monitoring apparatus for a work machine according to any one of the first to ninth aspects, wherein the vicinity display image generated by the image generation unit is a bird's-eye view image.
- the display image is preferably a display image that includes an image obtained by reducing the overhead image and an image that schematically shows the state of a predetermined range in the outer peripheral portion of the vicinity region.
- the setting is made around the work machine based on whether or not a worker working around the work machine exists in the monitoring area, or based on the traveling speed of the work machine or the work posture of the work machine.
- a plurality of monitoring images having different sizes are generated and displayed. As a result, it is possible to accurately provide the operator with the situation around the work machine.
- Embodiment 1 of the surroundings monitoring apparatus of the working machine of this invention It is a figure for demonstrating the method of obtaining the image around the working machine shown in FIG. 1, and a worker's positional information. It is a block diagram which shows the whole system containing the surroundings monitoring apparatus of the working machine shown in FIG. It is a figure which shows the content of the database hold
- FIG. 10 is a display image displayed on the display device in order to select a worker intrusion displayed in the display image of FIG. 9 and to set a worker intrusion determination rule.
- FIG. 10 is a display image displayed on the display device in order to select a front tip position displayed in the display image of FIG. 9 and set a determination rule for the front tip position.
- FIG. FIG. 10 is a display image displayed on the display device in order to select a traveling speed displayed in the display image of FIG. 9 and set a traveling speed determination rule.
- FIG. 10 is a display image displayed on the display device in order to select a traveling speed displayed in the display image of FIG. 9 and set a traveling speed determination rule.
- FIG. 5 is a diagram for explaining a change in recorded content when a situation changes from the current status to the next status regarding the recorded content recorded in the entry detail item field illustrated in FIG. 4.
- FIG. 5 is a diagram for explaining a change in the recorded content when the situation changes from the current status to the next status with respect to the recorded content recorded in the front end position item field illustrated in FIG. 4.
- FIG. 5 is a diagram for explaining the update of the recorded content when the situation changes from the current status to the next status with respect to the recorded content recorded in the travel speed item column illustrated in FIG. 4. It is a flowchart for demonstrating the determination process with respect to the operator's invasion in an intrusion determination part. It is a flowchart for demonstrating the selection process of the display range in a display control part.
- FIG. 22 is a display image in a state where the monitoring image is manually enlarged in FIG. 21. It is a monitoring image which shows the example from which a worker mark differs when a worker around a working machine is located in a wide-area monitoring area.
- FIG. 24 is a monitoring image when the worker moves to the vicinity monitoring region in FIG. 23.
- FIG. 1 is a perspective view showing an appearance of the work machine 1.
- the work machine 1 is a hydraulic excavator as an example.
- 1A is a front work machine
- 1B is a vehicle body
- 1a is a boom
- 1b is an arm
- 1c is a bucket
- 1d is a swinging body (main body frame)
- 1e is a traveling body
- 1f is an operation room.
- the work machine 1 includes a multi-joint type front work machine 1A including a boom 1a, an arm 1b, and a bucket 1c that rotate in a vertical direction, and a vehicle body 1B including a revolving body 1d and a traveling body 1e.
- the base end of the boom 1a is rotatably supported by the front part of the revolving body 1d, and one end of the arm 1b is rotatably supported by the tip of the boom 1a.
- a bucket 1c is rotatably supported at the other end.
- the boom 1a is driven to rotate in the vertical direction by the boom cylinder 3a
- the arm 1b is driven to rotate in the vertical direction by the arm cylinder 3b
- the bucket 1c is rotated in the vertical direction by the bucket cylinder 3c.
- a swing body 1d having an operation chamber 1f is attached on the traveling body 1e via a swing motor 3d (not shown in FIG. 1, refer to FIG.
- the swing motor 3d is driven.
- the swivel body 1d turns with respect to the traveling body 1e.
- the traveling body 1e is driven by a traveling motor 3e.
- the traveling body 1e and the traveling motor 3e are also provided on the opposite side of the vehicle body 1B, and the pair of traveling motors 3e are independently driven.
- the pair of travel motors 3e are driven simultaneously or independently, and each of the travel bodies 1e is driven, whereby the work machine 1 travels forward or backward, and the travel direction can be changed.
- a boom operation lever 4a that drives the boom cylinder 3a
- an arm operation lever 4b that drives the arm cylinder 3b
- a bucket operation lever 4c that drives the bucket cylinder 3c
- a swing motor drive that drives the swing body 1d
- a travel motor operation lever 4e for driving the travel motor 3e are provided (see FIG. 3).
- a display device and an alarm device which will be described later, are mounted in the operation room 1f.
- 8a, 8b, and 8c are angle detectors that detect rotation angles provided at the rotation fulcrums of the boom 1a, the arm 1b, and the bucket 1c, respectively, and 8d is an inclination angle that detects the inclination angle of the swivel body 1d. It is a detector.
- Each of the angle detectors 8a to 8d is driven by a driver (not shown). Information on the detected angle is displayed on a monitor mounted in the operation room 1f.
- Radio receivers 10a, 10b, and 10c including antennas are attached to the upper side of the revolving unit 1d, respectively.
- the radio receivers 10a, 10b, and 10c function as worker position detectors.
- the wireless receiver 10a is attached to the upper left side of the upper part of the swinging body 1d with the antenna facing in a direction in which radio waves are received well from the left side of the work machine 1.
- the radio receiver 10c is attached to the right side of the upper part of the swing body 1d with the antenna facing in a direction in which reception of radio waves from the right side of the work machine 1 is good.
- the radio receiver 10b is attached to the rear side of the upper part of the swivel body 1d with the antenna facing in a direction in which radio waves from the rear of the work machine 1 are favorably received.
- alarm devices 19a, 19b, and 19c are attached in the vicinity of the wireless receivers 10a, 10b, and 10c on the upper side of the swivel body 1d, respectively.
- the alarm device 19a is disposed in the vicinity of the wireless receiver 10a, and is attached so that the sound greatly resonates in the left direction of the work machine 1.
- the alarm device 19c is disposed in the vicinity of the wireless receiver 10c and is attached so that the sound reverberates greatly in the right direction of the work machine 1.
- the alarm device 19b is disposed in the vicinity of the wireless receiver 10b, and is attached so that the sound reverberates greatly in the rear side direction of the work machine 1.
- the 13a, 13b, and 13c are cameras, that is, imaging units.
- the camera 13a is disposed in the vicinity of the wireless receiver 10a so that the range that can be received by the wireless receiver 10a is directed in the direction in which the image can be captured.
- the camera 13b is disposed in the vicinity of the wireless receiver 10b so that the range that can be received by the wireless receiver 10b is directed in a direction in which imaging can be performed.
- the camera 13c is arranged in the vicinity of the wireless receiver 10c so that the range that can be received by the wireless receiver 10c is directed in the direction in which imaging can be performed.
- the situation around the working machine is presented to the user as an overhead image that is seen from above the working machine. For this reason, the number of cameras and the shooting direction of the cameras are determined so that the situation of the area to be monitored in the real space can be displayed as an overhead image viewed from above the work machine.
- FIG. 2 is a schematic diagram for explaining a method for obtaining an image around the work machine shown in FIG. 1 and position information of the worker.
- the worker 80 has, for example, a radio transmitter 81 attached to a helmet or the like.
- An ID (worker identification information), which will be described later, is transmitted from the wireless transmitter 81.
- This signal is received by each of the radio receivers 10a, 10b, and 10c attached to the swing body 1d.
- the sensitivity of each of the wireless receivers 10a, 10b, and 10c is adjusted so that the signal transmitted from the wireless transmitter 81 corresponds to the monitoring area.
- the cameras 13a, 13b, and 13c are installed so as to be able to capture images from just below the work machine 1 to a distance as shown in FIG.
- FIG. 5 is a plan view for explaining a method of setting a monitoring area around the work machine
- FIG. 6 is a side view of the work machine for explaining a turning range of the work machine in FIG.
- the first region 101 is a range in which it is difficult for an operator in the operation room 1 f to visually recognize due to the structure of the work machine 1.
- the second region 102 is a region through which the front work machine 1A passes when the work machine 1 is turned in an attitude after excavation.
- the posture after excavation means that the boom 1a is raised, the arm 1b is folded so as to be positioned below the boom 1a, and the bucket 1c is positioned between the arm 1b and the boom 1a. It is in the state bent so as to.
- the third area 103 is an area determined by combining the first area 101 and the second area 102.
- the third area 103 is set to be wider than the second area 102 except for the area where the work machine 1 performs work in a range that can be visually recognized by the operator in the operation room 1f. Further, in the range where it is difficult for the operator in the operation room 1f to visually recognize, it almost coincides with the first region 101.
- the first to third areas 101 to 103 are areas set in a real space around the work machine, and the second area 102 is an area corresponding to a neighboring area set around the work machine. Is displayed on the display device as an overhead image.
- the third area 103 corresponds to the attention range set around the work machine, and when the worker enters the third area 103 beyond the boundary 103a, the worker is approaching or entering the work machine. Recognize.
- the outer boundary 103a of the third region 103 has a limit that allows each of the wireless receivers 10a, 10b, and 10c to receive a signal transmitted from the wireless transmitter 81.
- the sensitivity of 10c may be adjusted and set.
- FIG. 3 is a block diagram showing an entire system including the monitoring apparatus shown in FIG.
- the monitoring device includes a vehicle body controller 30, a display device 50, a monitoring controller 60, wireless receivers 10a, 10b, and 10c, and cameras 13a, 13b, and 13c. Further, as a peripheral device related to the monitoring device, a management office computer 70, an information terminal 71, an alarm control unit 66, alarm devices 19a to 19c, and a radio transmitter 81 illustrated in FIG. 2 are provided.
- the information terminal 71 is, for example, a notebook PC (Personal Computer), a PDA (Personal Digital Assistant) or a dedicated mobile communication terminal, and periodically receives the latest data on the work of the worker from the management office computer 70, For example, the data is read from the worker database before starting the work of the day.
- the latest data read from the worker database is held in the information holding unit 65 of the monitoring controller 60 by wireless or wired communication.
- the vehicle body controller 30 has a vehicle body control unit 31.
- the vehicle body control unit 31 includes cylinders 3a, 3b, 3c, a turning motor 3d, a pair of travel motors 3e, 3f, operation levers 4a, 4b, 4c, 4d, 4e provided in the operation chamber 1f, and an angle detector 8a. , 8b, 8c, 8d and speed detectors 8e, 8f are connected. Although the speed detectors 8e and 8f are not shown in FIG. 1, the rotational speeds of the left and right motors 3e and 3f are attached to the traveling body 1e so as to be able to measure each. The traveling speed and the traveling direction of the work machine are detected by signals from the speed detectors 8e and 8f.
- the vehicle body control unit 31 drives the cylinders 3a to 3c according to the operation of the operation levers 4a to 4e operated by the operator in the operation chamber 1f to operate the boom 1a, the arm 1b, and the bucket 1c, and the motor 3d. 3e and 3f are driven, the turning body 1d is turned, and the vehicle body is caused to travel. From the angle detectors 8a to 8d, detection information related to the posture (angle) of the boom 1a, arm 1b, and bucket 1c of the work machine 1 and the driving state (tilt angle) of the swing body 1d is transmitted to the monitoring controller 60. From the speed detectors 8e and 8f, vehicle body state detection information such as the travel speed of the vehicle body is transmitted to the monitoring controller 60.
- the monitoring controller 60 includes an intrusion determination unit 61, a display control unit 62, a camera image processing unit 63, and an information holding unit 65.
- the information holding unit 65 holds a work monitoring area diagram and a worker database in advance.
- the work monitoring area diagram is a figure set as an area that needs to be monitored around the work machine.
- the work monitoring area diagram also includes an external appearance illustration overlooking the work machine 1, which will be described later.
- the worker database includes fixed items that indicate fixed information about each worker, and variable items that indicate work machine state information such as changes in each worker's situation and body posture and driving state with time. It has become.
- the fixed items include “ID” (worker identification information), “name” (worker identification information), “work content”, “work area”, and “update date / time”. “ID” is information for identifying each worker from other workers, and “ID” is output from the radio transmitter 81 owned by each worker.
- the outpatient also has a radio transmitter in which “ID” indicating that the outpatient is registered.
- Name is a name for identifying a worker, for example, a first and last name.
- the “work content” indicates the type of work performed by the worker, and is information for determining how close each worker needs to work with respect to the work machine or the work area.
- the “work area” indicates information for classifying the work area where the worker works. Some workers also need to enter a plurality of work areas to perform work, and information on all work areas that enter each worker is written. “Update date and time” indicates the date and time when the information of each worker was updated.
- variable items are "intrusion status", "intrusion site” and “intrusion details” items related to worker information that works around the work machine, and work machine status information such as work machine attitude and drive status.
- Each item includes “front end position” and “running speed”.
- the left, back, and right information written in the “intrusion site” correspond to the reception directions of the wireless receivers 10a, 10b, and 10c, respectively, and this also indicates the alarm devices 19a, 19b, 19c, and This corresponds to the direction in which the cameras 13a, 13b, and 13c are facing.
- the intrusion determination unit 61 includes an intrusion determination unit (not shown), and constantly monitors the reception status of the radio receivers 10a to 10c. When a signal transmitted from the wireless transmitter 81 is received by the wireless receivers 10a to 10c, or when it is determined that the wireless transmitter 81 is located in the work monitoring area, the intrusion determination unit 61 performs the wireless transmitter 81. The worker database held in the information holding unit 65 is collated based on the “ID” obtained from the above. Then, the intrusion determination unit 61 writes the above-described information in the “intrusion situation” and “intrusion site” of the corresponding “ID”.
- the camera image processing unit 63 includes an image conversion unit, and captures images captured by the cameras 13a, 13b, and 13c.
- the image conversion unit converts the captured image into an image obtained by bird's-eye view of the surrounding image of the work machine 1, and generates a combined image obtained by joining the images of the converted cameras 13a to 13c. This composite image is transmitted to the display control unit 62.
- the situation around the working machine is displayed on the display device as an overhead image centering on the working machine. Therefore, the composite image is an overhead image that represents an area to be monitored set around the work machine as seen from above the work machine.
- a neighborhood display image showing the situation of the neighborhood area in the real space set in the vicinity of the work machine and the situation of the wide area set in the real space so as to include the neighborhood area are displayed.
- the wide display image shown is selectively displayed on the display device.
- the neighborhood display image is an image including a schematic image of the work machine and an overhead image drawn around the work machine and looking down a predetermined range around the work machine from directly above the work machine. is there.
- the overhead image is a moving image.
- the wide area display image is an image including a near display image, that is, an image obtained by reducing a bird's-eye view image, and an image schematically representing a situation of a wide area set with a predetermined width around the vicinity area.
- the wide-area display image is an image for monitoring the state of the third region 103 in FIG.
- the display control unit 62 transmits the vehicle body information 39 sent from the vehicle body controller 30, the information recorded in each item of the work monitoring area diagram and the worker database held by the information holding unit 65, and the camera image processing unit 63.
- a monitoring image is generated on the basis of the synthesized overhead image regarding the work machine surrounding information, and is output to the display device 50 and displayed on the display device 50.
- the monitoring images in the surroundings monitoring apparatus according to the present embodiment are the vicinity display image and the wide area display image described above.
- the display device 50 includes a display unit 51, an alarm unit 52, an input unit 53, and a sound collection unit 54.
- the display unit 51 displays the monitoring image created by the display control unit 62.
- the alarm unit 52 emits an alarm sound.
- the sound collection unit 54 has a transmitter including a microphone and an amplifier that transmit sound to each of the alarm devices 19a, 19b, and 19c. Three microphones are provided so as to correspond to the alarm devices 19a, 19b and 19, and the sound input to one microphone is transmitted to the alarm control unit 66, and the corresponding one of the alarm devices 19a, 19b and 19c. Generated from any one of the alarms.
- the input unit 53 outputs a signal for switching the display image of the display unit 51 via the display control unit 62.
- the input unit 53 can be configured as a touch panel mounted on the display unit 51. Although details will be described later, for example, an input signal is supplied to the display control unit 62 by touching the key input units 114 to 116, 118, 134 to 135, etc. in the display screens shown in FIGS. Predetermined control is performed.
- the display control unit 62 updates the “intrusion details” in accordance with the intrusion status of workers working around the work machine 1.
- Information recorded in the “intrusion details” includes three statuses “no intrusion”, “approaching”, and “intrusion” illustrated in FIG. 13.
- note range 113 described below, the first warning area 112 a, the second warning area 112b, details will be described later.
- the first line in FIG. 13 when “entering within the caution range 113” of “trigger condition” from “no entry” of “current status”, “approaching” described in “next status” Indicates to update.
- the front tip position is updated as shown in FIG.
- the arm 1b is driven in the folding direction, so that the “next status” is set. Updated to “Decreased” as described.
- the front end is “shortening” of “current status” to “exiting from the second alarm range 112b to the caution range 113” of “trigger condition”
- the arm 1b is driven in the opening direction. To “Decompressing” described in "Status".
- the travel speed is updated as shown in FIG.
- the traveling speed is detected from “stop” in “current status” to “with driving lever operation” in “trigger condition”, it is updated to “low speed” described in “next status”.
- the travel speed is “low speed” of “current status” to “no travel lever operation” of “trigger condition”, it is updated to “stop” described in “next status”.
- the travel speed is detected from “low speed” of “current status” to “5 km / h or more” of “trigger condition”, it is updated to “high speed” described in “next status”.
- the traveling speed is detected from “high speed” of “current status” to “4 km / h or less” of “trigger condition”, it is updated to “low speed” described in “next status”.
- the display control unit 62 generates two different images, a wide area monitoring image shown in FIG. 7 and a neighboring area monitoring image shown in FIG.
- the wide area monitoring image is the above-described wide area display image
- the near area monitoring image is the above-described vicinity display image.
- a surrounding image area 111 on which an overhead image sent from the camera image processing unit 63 is drawn, a boundary line 112a representing a first alarm range, a second A boundary line 112b representing an alarm range, a boundary line 113 representing a caution range, a worker mark 121 that is an index indicating the position of a worker generated for an invading worker sent from the information holding unit 65, a worker It consists of worker information 122 relating to a worker who is invading, such as specific information and a work area, and intrusion detailed information 124 relating to details of the worker's intrusion.
- the bird's-eye view image itself drawn in the surrounding image area 111 is also denoted by reference numeral 111.
- the image 112a of the first alarm range surrounded by the boundary line 112a is also denoted by reference numeral 112a
- the image of the second alarm range surrounded by the boundary line 112b is also denoted by reference numeral 112b.
- the first alarm range 112a is set based on the turning range of the tip of the arm 1b of the front work machine 1A and substantially corresponds to the second region 102 in FIG.
- the first alarm range 112a is a range defined in the display screen
- the second region 102 is a region defined in the actual space to be monitored around the work machine.
- the second area 102 defined in the real space corresponds to the surrounding image area 111 defined in the display screen. Therefore, the situation of the area inside the turning locus at the front end of the front work machine when the front work machine 1A takes a specific posture is displayed as an overhead image.
- the second alarm range 112b has a range obtained by adding a length in which both standard arms are widened by a standard worker to the outside of the first alarm range 112a.
- Note range 113 is a range in which it is possible to monitor whether or not an operator is approaching the work machine by radio receivers 10a to 10c, and substantially corresponds to third region 103 in FIG. That is, the attention range 113 is a range defined in the display screen, and the third area 103 is an area for monitoring the approaching situation of the worker to the work machine in the real space to be monitored around the work machine.
- the monitoring image (neighboring display image) in the vicinity area illustrated in FIG. 8 includes an appearance illustration 110 overlooking the work machine 1, a surrounding image area 111 in which an overhead image sent from the camera image processing unit 63 is drawn, and a camera image.
- the surrounding image area 111 is enlarged and displayed on the entire display screen with respect to the monitoring image in the wide area shown in FIG.
- the situation of the second area 102 captured by the cameras 13 a, 13 b, and 13 c is displayed as an overhead image synthesized by the camera image processing unit 63.
- these are also displayed as a bird's-eye view image.
- key input units 114, 115, 116, and 118 are displayed on each screen as a monitoring image.
- the key input units 114, 115, 116, and 118 are displayed corresponding to the touch keys of the input unit 53, and a key signal is input by touching this portion.
- the key input unit 114 at the lower center of the monitoring image is displayed as “automatic” with white characters on a black background as illustrated in FIGS. 7 and 8.
- “automatic” is displayed in black characters on a white background.
- the key input unit 115 on the lower left side of the monitoring image is displayed with “white” on the black background as “Near”, otherwise, “Nearby” is displayed in black on a white background.
- the key input unit 116 on the lower right side of the monitoring image displays “Wide area” in white characters on a black background, otherwise, “Wide area” is displayed in black on a white background.
- the key input unit 118 displayed as “Setting” is arranged at the upper right of the monitoring image.
- the key input unit 118 is operated when determining the details of the determination rule in the automatic mode.
- the screen is switched to the screen shown in FIG.
- reference numeral 117 denotes a title display portion, which displays “Set judgment rule”.
- the display units 131, 132, and 133 are for setting determination rules for “worker entry”, “front tip position”, and “traveling speed”, respectively.
- the user touches the key input unit 134 displayed as “valid”.
- the key input unit 135 displayed as “invalid” is touched.
- the selected key input units 134 and 135 are displayed with white characters on a black background, and the unselected key input units 134 and 135 are displayed with black characters on a white background.
- FIGS. 10, 11 and 12 show screens for setting determination rules for “worker entry”, “front end position”, and “traveling speed”, respectively.
- the monitoring range of the wide area can be adjusted on the screen for setting the details of the worker intrusion determination rule shown in FIG.
- the third area 103 (attention range 113 in the display screen), which is an indication of the reception range of the radio receivers 10a to 10c, can be adjusted to change the monitoring range of the wide area from the specified value.
- the range to be monitored defined by the third area 103 on the left side of the work machine 1, that is, the attention range 113 in the screen faces the operation room 1f and is easy to monitor.
- the value is set to a relatively small numerical value, for example, “6.5” m.
- the range to be monitored defined by the third area 103 on the right side of the work machine 1, that is, the attention range 113 in the screen is in the direction opposite to the operation room 1f and is difficult to monitor.
- the initial value of 138 is set to a numerical value larger than the numerical value of the range display unit 136, for example, “7.5” m.
- the range to be monitored defined by the third region 103 on the rear side of the work machine 1, that is, the attention range 113 in the screen is the backward direction of the operator of the operation room 1f and is very difficult to monitor.
- the initial value of the range display unit 138 is set to the largest numerical value, for example, “9.0” m.
- the initial setting values of the range display sections 136 to 138 are adjusted by gradually pressing the “ ⁇ ” key 141 or the “ ⁇ ” key 142 and gradually increasing or decreasing the numerical values.
- the front tip position to be switched to the wide area display is changed from the specified value.
- the initial value is set to “4.5” m.
- the numerical value is gradually increased or decreased to adjust the distance of the front tip position from the rotation center of the swivel body 1d.
- the travel speed to be switched to the wide area display is changed from the specified value.
- the traveling speed to switch to the wide area display is normally set to “4” km / h as the initial value of the speed display unit 148 on the basis of the speed at which a person walks.
- the switching speed is adjusted by continuing to press the “ ⁇ ” key 149 or “ ⁇ ” key 150 of the hourly speed display portion 148 and gradually increasing or decreasing the numerical value.
- the key input unit 119 displayed as “return” in the upper right corner of FIGS. 9 to 12 is a touch key operated when returning to the previous screen.
- FIG. 16 is a flowchart of the worker intrusion determination process in the intrusion determination unit 61. This process is started at a predetermined cycle during the operation of the work machine 1 for each of the radio receivers 10a to 10c.
- the intrusion determination unit 61 constantly checks the input from the wireless receivers 10a, 10b, and 10c (step S11) to determine whether or not there is signal reception. (Step S12). If a signal is received, the process of step S13 is performed. If no signal is received, the process of step S17 is performed.
- the signal is received, that is, when the worker enters the third area 103 defined in the real space around the work machine, in step S13, the “ID” of the wireless transmitter 81 is determined from the received signal. "Is checked and" ID "is acquired.
- step S15 based on the acquired “ID”, the worker database held in the information holding unit 65 is collated and the “intrusion status” corresponding to the corresponding “ID” is updated to “present”. Then, the “intrusion status” corresponding to the “ID” other than the acquired “ID” is updated to “none” (step S14). Also, based on the magnitude of the input signals of the radio receivers 10a, 10b, 10c, the worker database held in the information holding unit 65 is collated, and the “intrusion status” becomes “ID” corresponding to “present”. One of “left”, “right”, and “rear” is recorded in the corresponding “invasion site” (step S15).
- step S12 if no signal is received, in step S17, the worker database held in the information holding unit 65 is collated, and the “intrusion status” corresponding to all “IDs” is set to “no”. Update.
- step S18 the worker database held in the information holding unit 65 is collated to clear the information recorded in the “intrusion site”. This process is repeated during the surrounding monitoring period, and when an end signal from the monitoring controller 60 is detected (step S19), the intrusion determination processing flow ends.
- step S21 it is determined whether the display range is selected in the automatic mode or the manual mode. Whether the mode is the automatic mode or the manual mode is selected by a touch operation of the key input unit 114 by the operator illustrated in FIGS. 7 and 8. If the automatic mode is selected, the process of step S22 is performed. If the manual mode is selected, the process of step S26 is performed.
- step S22 it is determined whether or not an operator has entered in step S22. In other words, it is determined whether or not a worker is present in the third area 103 defined in the real space around the work machine (in the caution area 113 in the display screen). If the “intrusion details” in the worker database (FIG. 4) held in the information holding unit 65 is “no intrusion”, that is, if the worker does not exist within the attention range 113 in the display screen, step S25 is performed. Perform the process. If it is “approaching” or “intrusion”, that is, if the worker is within the caution area 113, the process of step S23 is performed. In step S23, the arm tip position is determined. This determination is determined by whether or not the “front tip position” in FIG. 4 is “extending”. If it is “expanding”, the process of step S25 is performed, and if it is “shortening”, the process of step S24 is performed.
- step S23 if “shortening”, “running speed” is determined in step S24. This determination is determined by whether or not the “traveling speed” in FIG. 4 is “high speed”. In the case of “high speed” in step S24, the process of step S25 is performed, and in the case of “low speed” or “stop”, the process of step S27 is performed. In step S25, a monitoring image of a wide area is created as a monitoring image around the work machine 1.
- step S21 If it is determined in step S21 that the manual mode is selected, it is determined in step S26 which of the wide area display shown in FIG. 7 and the proximity display shown in FIG. 8 is selected.
- step S25 When the wide area display is selected, the process of step S25 is performed, and when the vicinity display is selected, the process of step S27 is performed.
- step S27 a monitoring image in the vicinity region is created as a monitoring image around the work machine 1.
- step S31 the attention range 113 shown in FIG. 7 is drawn.
- step S32 the first alarm range 112a and the second alarm range 112b illustrated in FIG. 7 are drawn.
- step S33 the surrounding image area 111 is drawn.
- the surrounding image area 111 is a bird's-eye view image of the situation around the work machine 1 as viewed from above the work machine.
- step S ⁇ b> 34 an appearance illustration of the work machine 1 held in the information holding unit 65 is drawn.
- step S35 After the appearance illustration is drawn, a title and input keys are drawn in step S35.
- step S36 it is determined whether or not the “intrusion details” of the worker is “approaching” or “intrusion”. If “incoming” or “intrusion”, the process of step S37 is performed. If any worker is “no intrusion”, the process is terminated.
- step S37 information of “ID”, “name” (worker specifying information), “work area”, and “invasion site” is acquired from the worker database. A worker mark 121 is added to the “name” and “work area” obtained from the worker database, and these images are drawn so as to be displayed at the screen display position corresponding to “intrusion site”.
- the images drawn in steps S31 to S35 and S37 are combined to obtain a wide area monitoring image as shown in FIG. Note that the processing in steps S36 to S37 is performed for all workers whose “invasion status” in the worker database is “present”.
- step S41 the camera image processing unit 63 draws the surrounding image area 111 in which the surrounding image of the work machine 1 is converted into an image obtained by looking down from above. In this case, if there is a worker or another work machine or equipment, an overhead image thereof is displayed.
- step S42 an appearance illustration of the work machine 1 held in the information holding unit 65 is drawn.
- step S43 a title and input keys are drawn.
- step S44 it is determined whether or not the “intrusion detail” of the worker is “intrusion”.
- step S45 information of “ID”, “name” (worker specifying information), “work area”, and “intrusion site” is acquired from the worker database. Then, “name”, “work area”, worker information 122, and intrusion detailed information 124 obtained from the worker database are drawn so as to be displayed in the vicinity of the screen display position of the corresponding worker image.
- step S46 determines whether the “intrusion details” is “approaching”, and if it is not “approaching”, this processing flow ends. If it is “approaching”, the approach mark 130 is drawn in step S47, and then this processing flow is terminated. The approach mark 130 is drawn so as to be displayed at the position of the corresponding attention area.
- step S41 to step S43, step S45, and step S47 are combined to obtain a monitoring image in the vicinity region as shown in FIG.
- the processes in steps S44 to S47 are performed for all workers whose “intrusion status” in the worker database is “present”.
- the monitoring image of the wide area or the monitoring image of the nearby area is selected according to the situation of “intrusion details”, and the work machine and the work around the work machine are performed in the monitoring image of the wide area It is easy to grasp the positional relationship between employees. In this case, it is possible to comprehensively grasp the positions of a plurality of workers and obstacles, and in particular, it is possible to check the movement status such as the direction and speed of the workers or other work machines. When the intruder is approaching or invading, it is possible to switch to a monitoring image in the vicinity that becomes an enlarged display, so it is easy to eliminate monitoring mistakes.
- the monitoring image is appropriately switched between the monitoring image in the wide area and the monitoring image in the vicinity area, so that the operation burden on the operator is small, work efficiency is improved, and , Monitoring safety will be even higher.
- FIG. 20 shows a state where “wide area” is selected by operating the key input unit 116.
- a “ ⁇ ” key 151 and a “ ⁇ ” key 152 are displayed.
- the “ ⁇ ” key 151 is continuously pressed, the image of the monitoring area is enlarged as shown in FIG.
- the “ ⁇ ” key 152 is continuously pressed, the image in the monitoring area is reduced and returned to the original image size shown in FIG.
- the operator can change the monitoring area according to his / her convenience for the sensitivity of the radio receivers 10a to 10c, and can be adjusted according to the moving speed of the work machine and the surrounding conditions. It is possible to perform monitoring with good work efficiency.
- FIG. 23 shows a monitoring image in which obstacle marks 161 and 162 are displayed at the position of the obstacle detected by the proximity sensor. In this case, even if the obstacle marks 161 and 162 are workers, the worker information is not displayed.
- FIG. 24 shows a state in which the obstacle mark 161 has entered the surrounding image area 111. The obstacle mark 161 is displayed by replacing the worker image captured by the cameras 10a to 10c with the worker image 123 converted into an overhead view from above. In addition, when the obstacle mark 162 illustrated in FIG. 23 is located outside the surrounding image area 111, the obstacle mark 162 is displayed by being replaced with an approach mark 130 indicating that the obstacle mark 162 is located outside the alarm range.
- the location and number of the wireless receivers 10a to 10c and the cameras 13a to 13c in the above embodiment can be changed as appropriate. Further, the number of monitoring areas such as the attention area and the first and second warning areas may be increased or decreased.
- the present invention can also be implemented in the following modes.
- the wide-area display image and the proximity display image may be selectively displayed based only on whether or not an operator has entered the third area 103 (the attention range 113 in the screen) that is the monitoring area.
- the wide-area display image and the proximity display image may be selectively displayed based on whether or not a worker has entered the monitoring area 103 and the driving state of the front work machine of the work machine.
- the wide-area display image and the proximity display image may be selectively displayed based on whether or not a worker has entered the monitoring area and the traveling speed of the work machine.
- the wide-area display image and the proximity display image may be selectively displayed based on whether or not a worker has entered the monitoring area and the traveling direction of the work machine.
- the wide area display image and the proximity display image may be selectively displayed based only on the driving state of the front work machine of the work machine. In this case, for example, a wide-area display image is displayed when the front work machine is extended, and a proximity display image is displayed when the front work machine is contracted. (6) The wide area display image and the proximity display image may be selectively displayed based on only the traveling speed of the work machine. In this case, for example, a wide-area display image is displayed when the traveling speed of the work machine is high, and a proximity display image is displayed when the traveling speed is low. (7) The wide-area display image and the proximity display image may be selectively displayed based on the driving state of the front work machine of the work machine and the traveling speed of the work machine.
- the display from the wide display image to the near display image is performed. I switched.
- the display may be switched from the wide-area display image to the proximity display image.
- the working machine surroundings monitoring device of the present invention can be variously modified and configured within the scope of the gist of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Mining & Mineral Resources (AREA)
- Civil Engineering (AREA)
- General Engineering & Computer Science (AREA)
- Structural Engineering (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Component Parts Of Construction Machinery (AREA)
Abstract
Description
その一例として、以下のような作業機械の監視装置が知られている(例えば、特許文献1)。この作業機械には、作業機械周囲の監視領域内に存在する物体を検出する近接センサと、この近接センサの検出領域内の画像を撮像する撮像装置とが設けられている。監視装置は、近接センサから発射された超音波が物体によって反射されるまでの時間に基づいてその物体の位置を求め、監視領域内に物体が存在することが検出されると、上記の撮像装置によって撮像された画像と共に表示装置に表示する。
本発明の第2の態様による周囲監視装置は、第1の態様の作業機械の周囲監視装置において、複数の監視用画像は、作業機械の周囲に設定した近傍領域の状況を示す近傍表示用画像と、作業機械の周囲に近傍領域を含んで設定された広域領域の状況を示す広域表示用画像を含むことが好ましい。
本発明の第3の態様による周囲監視装置は、第2の態様の作業機械の周囲監視装置において、判断部は、監視領域を前記広域領域として設定して作業員の位置が監視領域内に存在するか否かを判断することが好ましい。
本発明の第4の態様による周囲監視装置は、第2の態様の作業機械の周囲監視装置において、判断部は、監視領域を近傍領域として設定して作業員の位置が監視領域内に存在するか否かを判断することが好ましい。
本発明の第5の態様による周囲監視装置は、第2乃至第4の何れか態様の作業機械の周囲監視装置において、表示装置に広域表示用画像が表示されているときに、広域表示用画像を拡大、縮小させるための操作を受け付ける第1入力部をさらに備え、第1入力部により操作が受け付けられている間、画像生成部は広域表示用画像の大きさを変化させることが好ましい。
本発明の第6の態様による周囲監視装置は、第2乃至第5の何れかの態様の作業機械の周囲監視装置において、近傍表示用画像と広域表示用画像のいずれか一方をユーザが手動で選択するための第2入力部をさらに備えることが好ましい。
本発明の第7の態様による周囲監視装置は、第2乃至第6の何れかの態様の作業機械の周囲監視装置において、作業員の位置が監視領域内にないことが判断部で判断されると、画像生成部は広域表示用画像を生成し、表示制御部は広域表示用画像を表示装置に表示することが好ましい。
本発明の第8の態様による周囲監視装置は、第2乃至第6の何れかの態様の作業機械の周囲監視装置において、作業機械は伸縮可能に構成されたフロント作業機を備え、作業員の位置が監視領域内に存在することが判断部で判断されていても、作業機械状態検出部によりフロント作業機が伸長中であることが検出されている場合には、画像生成部は広域表示用画像を生成し、表示制御部は広域表示用画像を表示装置に表示する好ましい。
本発明の第9の態様による周囲監視装置は、第2乃至第6の何れかの態様の作業機械の周囲監視装置において、作業機械は伸縮可能に構成されたフロント作業機を備え、作業員の位置が監視領域内に存在することが判断部で判断され、かつ、作業機械状態検出部によりフロント作業機が収縮中であることが検出されていても、作業機械状態検出部により作業機械の走行速度が所定の速度よりも高速であることが検出されると、画像生成部は広域表示用画像を生成し、表示制御部は広域表示用画像を表示装置に表示することが好ましい。
本発明の第10の態様による周囲監視装置は、第1乃至第9の何れかの態様の作業機械の周囲監視装置において、画像生成部により生成される近傍表示用画像は俯瞰画像であり、広域表示用画像は俯瞰画像を縮小した画像および近傍領域外周部の所定範囲の状況を模式的に示す画像を含む表示画像であることが好ましい。
図1は、作業機械1の外観を示す斜視図である。本実施形態において、作業機械1は油圧ショベルを例とする。1Aはフロント作業機、1Bは車体、1aはブーム、1bはアーム、1cはバケット、1dは旋回体(本体フレーム)、1eは走行体、1fは操作室である。作業機械1は、垂直方向に夫々回動するブーム1a、アーム1b及びバケット1cからなる多関節型のフロント作業機1Aと、旋回体1d及び走行体1eからなる車体1Bとで構成されている。
作業員80は、例えば、ヘルメット等に取り付けられた無線発信機81を有している。無線発信機81からは後述するID(作業員識別情報)等が発信される。この信号は、旋回体1dに取り付けられた各無線受信機10a、10b、10cで受信される。各無線受信機10a、10b、10cは、無線発信機81から発信される信号が監視領域に対応するように、その感度が調整される。カメラ13a、13b、13cは、図2に図示されるように作業機械1の直ぐ下から遠方まで撮像可能に設置されている。
第1~第3の領域101~103は、作業機械周囲の実空間に設定された領域であり、第2の領域102は、作業機械周囲に設定した近傍領域に対応する領域であり、この領域の状況が俯瞰画像として表示装置に表示される。第3の領域103は、作業機械周囲に設定した注意範囲に対応し、作業員が境界103aを越えて第3の領域103に侵入したとき、作業員が作業機械に接近中もしくは侵入中であると認識する。この場合、第3の領域103の外側の境界103aは、無線発信機81から発信される信号を各無線受信機10a、10b、10cが受信できる限界となるように各無線受信機10a、10b、10cの感度を調整して設定するようにしてもよい。
監視装置は、車体コントローラ30、表示装置50、監視コントローラ60および無線受信機10a、10b、10c、カメラ13a、13b、13cを備えている。また、監視装置に係る周辺装置として、管理事務所コンピュータ70、情報端末71、警報制御部66、警報機19a~19c、および図2に図示された無線発信機81を備えている。
情報保持部65は、予め、作業監視領域図および作業員データベースを保持している。作業監視領域図は、作業機械周囲において監視が必要とされる領域として設定された図であり、図5に図示された、作業機械1の周囲に設定された第1~第3の領域101~103に対応する図である。作業監視領域図には、また、後述する、作業機械1を俯瞰した外観イラストも含まれる。
作業員データベースは、各作業員に関する固定された情報を示す固定項目と、時間推移に伴う各作業員の状況の変動および車体の姿勢および駆動状態等の作業機械状態情報を示す変動項目と、からなっている。固定項目は、「ID」(作業員識別情報)、「名前」(作業員特定情報)、「作業内容」、「作業エリア」および「更新日時」の各項目を備えている。「ID」は、個々の作業員に付された他の作業員との識別をするための情報であり、各作業員が所有する無線発信機81からは「ID」が出力される。外来者も、外来者であることを示す「ID」が登録された無線発信機を所有する。
なお、広域表示用画像は、図5の第3の領域103の状況を監視する画像である。
表示制御部62は、この実施形態では、図7に図示する広域領域の監視画像と図8に図示する近傍領域の監視画像の2つの異なる画像を生成する。広域領域の監視画像は上述した広域表示用画像であり、近傍領域の監視画像は上述した近傍表示用画像である。
図7に図示された広域領域の監視画像(広域表示用画像)は、カメラ画像処理部63から送られる俯瞰画像が描画された周囲画像領域111、第一警報範囲を表す境界線112a、第二警報範囲を表す境界線112b、注意範囲を表す境界線113、情報保持部65から送られる侵入中の作業員に対して生成される作業員の位置を示す指標である作業員マーク121、作業員特定情報および作業エリア等、侵入中の作業員に関する作業員情報122および作業員の侵入詳細に関する侵入詳細情報124から構成される。
以下では、説明の便宜上、周囲画像領域111内に描画される俯瞰画像そのものについても符号111を付記する。また、境界線112aで囲まれた第一警報範囲の画像そのものについても符号112aを付記し、境界線112bで囲まれた第二警報範囲の画像そのものについても符号112bを付記して説明する。
なお、図9~12の上部右上の「戻る」と表示されたキー入力部119は、前画面に戻る際に操作するタッチキーである。
侵入判定部61における作業員の侵入判定の処理を図16のフローチャートに示す。
この処理は、無線受信機10a~10cのそれぞれに関して、作業機械1の動作中に所定の周期で起動される。
監視コントローラ60により侵入判定の処理が起動されると、侵入判定部61では、無線受信機10a、10b、10cからの入力を常時チェックし(ステップS11)、信号の受信があるか否かを判断する(ステップS12)。信号の受信があった場合には、ステップS13の処理を、受信が無かった場合には、ステップS17の処理を行う。信号の受信があった場合、すなわち、作業機械周囲の実空間内に規定した第3の領域103内に作業員が進入してきた場合、ステップS13において、受信した信号から無線発信機81の「ID」チェックを行い、「ID」を取得する。
ステップS21において、表示範囲の選択が自動モードであるか手動モードであるかを判断する。自動モードであるか手動モードであるかは、図7および図8に図示された、操作者によるキー入力部114のタッチ操作によって選択される。自動モードが選択されている場合は、ステップS22の処理が行われ、手動モードが選択されている場合は、ステップS26の処理が行われる。
先ず、ステップS31において、図7に図示する注意範囲113を描画する。次に、ステップS32において、図7に図示する第一警報範囲112aおよび第二警報範囲112bを描画する。次に、ステップS33において、周囲画像領域111を描画する。周囲画像領域111は、前述した如く、作業機械1の周囲の状況を作業機械上方から俯瞰した俯瞰画像である。次に、ステップS34において、情報保持部65に保持された作業機械1の外観イラストを描画する。
ステップS31~ステップS35およびステップS37において描画した画像は合成されて、図7に図示されるような広域領域の監視画像が得られる。
なお、ステップS36~ステップS37の処理は、作業員データベースの「侵入状況」が「有」の作業員全員に対して行われる。
先ず、ステップS41において、カメラ画像処理部63において、作業機械1の周囲画像を上方から俯瞰した画像に変換された周囲画像領域111を描画する。この場合、作業員または他の作業機械や設備があれば、それらの俯瞰画像が表示される。
次に、ステップS42において、情報保持部65に保持された作業機械1の外観イラストを描画する。次に、ステップS43において、タイトルおよび入力キーを描画する。ステップS44において、作業員の「侵入詳細」が「侵入中」であるか否か判断し、「侵入中」であればステップS45の処理を行い、「侵入中」でなければステップS45の処理を省略してステップS46へジャンプする。ステップS45においては作業員データベースから「ID」、「名前」(作業員特定情報)、「作業エリア」「侵入部位」の各情報を取得する。そして、作業員データベースから得られた「名前」、「作業エリア」、作業員情報122、侵入詳細情報124を、対応する作業員画像の画面表示位置の近傍に表示されるように描画する。
なお、ステップS44~ステップS47の処理は、作業員データベースの「侵入状況」が「有」の作業員全員に対して行う。
図4に図示された「ID=P4」は、広域領域の監視画像が選択される条件の一例を示し、「ID=P5」は近傍領域の監視画像が選択される条件の一例を示す。
また、「フロント先端位置」や「走行速度」に応じて、適切に、広域領域の監視画像と近傍領域の監視画像とに切り替わるので、操作者の操作負担が小さく、作業効率が向上し、且つ、監視の安全性も一層高くなる。
上記実施形態では、注意範囲113を設定または変更する場合、図7または図8の画面において「設定」を選択して図9の判定規則設定画面にし、「作業員侵入」を「有効」にして、広域表示の判定規則設定画面とする。そして、無線受信機10a~10cの感度調整を行い、これに連動して、注意範囲113を変更するものであった。
しかし、広域表示の場合の表示範囲を、注意範囲113とは、独立して操作者が任意に設定するようにしてもよい。
この方法によれば、操作者は、無線受信機10a~10cの感度に対して、自己の都合に応じて監視領域を変更することが可能となり、作業機械の移動速度や周囲の状況に合わせて作業効率の良い監視を行うようにすることができる。
図23は、近接センサにより検出した障害物の位置に、障害物マーク161、162を表示した監視画像を示す。この場合には、障害物マーク161、162が作業員であっても、作業員情報は表示されない。図24は、障害物マーク161が、周囲画像領域111内に侵入した状態を示す。障害物マーク161は、カメラ10a~10cにより撮像した作業員の画像を上方からの俯瞰図に変換した作業員画像123に置換して表示される。また、図23に図示された障害物マーク162は、周囲画像領域111の外部に位置している場合には、警報範囲の外部に位置することを示す接近マーク130に置換して表示される。
(2)監視領域103への作業員の侵入の有無と作業機械のフロント作業機の駆動状態に基づいて、広域表示用画像と近傍表示用画像を選択表示してもよい。
(3)監視領域への作業員の侵入の有無と作業機械の走行速度に基づいて、広域表示用画像と近傍表示用画像を選択表示してもよい。
(4)監視領域への作業員の侵入の有無と作業機械の進行方向に基づいて、広域表示用画像と近傍表示用画像を選択表示してもよい。
(6)作業機械の走行速度のみに基づいて、広域表示用画像と近傍表示用画像を選択表示してもよい。この場合、例えば、作業機械の走行速度が高速のときは広域表示用画像を表示し、低速のときは近傍表示用画像を表示する。
(7)作業機械のフロント作業機の駆動状態と作業機械の走行速度に基づいて、広域表示用画像と近傍表示用画像を選択表示してもよい。
その他、本発明の作業機械の周囲監視装置は、発明の趣旨の範囲内において、種々、変形して構成することが可能である。
日本国特許出願2010年第139088号(2010年6月18日出願)
Claims (10)
- 表示装置と、
作業機械の周囲で作業をする作業員の位置を検出する作業員位置検出部と、
作業機械に取り付けられ、作業機械の周囲を撮像して、周囲画像を得る撮像部と、
前記撮像部から得られた前記作業機械の周囲画像を、作業機械の上方から俯瞰した俯瞰画像に変換する画像変換部と、
前記画像変換部により変換された前記俯瞰画像、および前記作業員位置検出部から得られた作業員の位置に基づいて監視用画像を生成する画像生成部と、
前記監視用画像を前記表示装置に表示する表示制御部と、
作業員の位置が予め設定した監視領域内に存在するか否かを判断する判断部と、
作業機械の走行速度を含む作業機械の姿勢または駆動状態を検出する複数の作業機械状態検出部とを備え、
前記画像生成部は、前記判断部による判断結果、または少なくとも1つの前記作業機械状態検出部からの情報に基づいて、前記作業機械の周囲に設定した広さの異なる監視範囲内の状況を表示する複数の監視用画像を生成する作業機械の周囲監視装置。 - 請求項1に記載の作業機械の周囲監視装置において、
前記複数の監視用画像は、前記作業機械の周囲に設定した近傍領域の状況を示す近傍表示用画像と、前記作業機械の周囲に前記近傍領域を含んで設定された広域領域の状況を示す広域表示用画像を含む作業機械の周囲監視装置。 - 請求項2に記載の作業機械の周囲監視装置において、
前記判断部は、前記監視領域を前記広域領域として設定して前記作業員の位置が前記監視領域内に存在するか否かを判断する作業機械の周囲監視装置。 - 請求項2に記載の作業機械の周囲監視装置において、
前記判断部は、前記監視領域を前記近傍領域として設定して前記作業員の位置が前記監視領域内に存在するか否かを判断する作業機械の周囲監視装置。 - 請求項2乃至請求項4の何れか1項に記載の作業機械の周囲監視装置において、
前記表示装置に前記広域表示用画像が表示されているときに、前記広域表示用画像を拡大、縮小させるための操作を受け付ける第1入力部をさらに備え、
前記第1入力部により操作が受け付けられている間、前記画像生成部は前記広域表示用画像の大きさを変化させる作業機械の周囲監視装置。 - 請求項2乃至請求項5の何れか1項に記載の作業機械の周囲監視装置において、
前記近傍表示用画像と前記広域表示用画像のいずれか一方をユーザが手動で選択するための第2入力部をさらに備える作業機械の周囲監視装置。 - 請求項2乃至請求項6の何れか一項に記載の作業機械の周囲監視装置において、
前記作業員の位置が前記監視領域内にないことが前記判断部で判断されると、前記画像生成部は前記広域表示用画像を生成し、前記表示制御部は前記広域表示用画像を前記表示装置に表示する作業機械の周囲監視装置。 - 請求項2乃至請求項6の何れか一項に記載の作業機械の周囲監視装置において、
作業機械は伸縮可能に構成されたフロント作業機を備え、
前記作業員の位置が前記監視領域内に存在することが前記判断部で判断されていても、前記作業機械状態検出部により前記フロント作業機が伸長中であることが検出されている場合には、前記画像生成部は前記広域表示用画像を生成し、前記表示制御部は前記広域表示用画像を前記表示装置に表示する作業機械の周囲監視装置。 - 請求項2乃至請求項6の何れか一項に記載の作業機械の周囲監視装置において、
作業機械は伸縮可能に構成されたフロント作業機を備え、
前記作業員の位置が前記監視領域内に存在することが前記判断部で判断され、かつ、前記作業機械状態検出部により前記フロント作業機が収縮中であることが検出されていても、前記作業機械状態検出部により作業機械の走行速度が所定の速度よりも高速であることが検出されると、前記画像生成部は前記広域表示用画像を生成し、前記表示制御部は前記広域表示用画像を前記表示装置に表示する作業機械の周囲監視装置。 - 請求項1至請求項9の何れか一項に記載の作業機械の周囲監視装置において、
前記画像生成部により生成される近傍表示用画像は俯瞰画像であり、広域表示用画像は前記俯瞰画像を縮小した画像および前記近傍領域外周部の所定範囲の状況を模式的に示す画像を含む表示画像である作業機械の周囲監視装置。
Priority Applications (6)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201180030230.7A CN102947515B (zh) | 2010-06-18 | 2011-06-20 | 作业机械的周围监视装置 |
| US13/704,933 US9332229B2 (en) | 2010-06-18 | 2011-06-20 | Surrounding area monitoring device for monitoring area around work machine |
| AU2011266010A AU2011266010B2 (en) | 2010-06-18 | 2011-06-20 | Surrounding area monitoring device for monitoring area around work machine |
| EP11795857.9A EP2570556B1 (en) | 2010-06-18 | 2011-06-20 | Device for monitoring area around work machine |
| KR1020127032914A KR101797261B1 (ko) | 2010-06-18 | 2011-06-20 | 작업 기계의 주위 감시 장치 |
| JP2012520517A JP5395266B2 (ja) | 2010-06-18 | 2011-06-20 | 作業機械の周囲監視装置 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2010-139088 | 2010-06-18 | ||
| JP2010139088 | 2010-06-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2011158955A1 true WO2011158955A1 (ja) | 2011-12-22 |
Family
ID=45348344
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2011/064065 Ceased WO2011158955A1 (ja) | 2010-06-18 | 2011-06-20 | 作業機械の周囲監視装置 |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US9332229B2 (ja) |
| EP (1) | EP2570556B1 (ja) |
| JP (1) | JP5395266B2 (ja) |
| KR (1) | KR101797261B1 (ja) |
| CN (1) | CN102947515B (ja) |
| AU (1) | AU2011266010B2 (ja) |
| WO (1) | WO2011158955A1 (ja) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014045466A1 (ja) * | 2012-09-20 | 2014-03-27 | 株式会社小松製作所 | 作業車両用周辺監視システム及び作業車両 |
| WO2014045459A1 (ja) * | 2012-09-21 | 2014-03-27 | 株式会社小松製作所 | 作業車両用周辺監視システム及び作業車両 |
| US8768583B2 (en) | 2012-03-29 | 2014-07-01 | Harnischfeger Technologies, Inc. | Collision detection and mitigation systems and methods for a shovel |
| WO2014148204A1 (ja) * | 2013-03-19 | 2014-09-25 | 住友重機械工業株式会社 | 作業機械用周辺監視装置 |
| GB2522616A (en) * | 2014-01-22 | 2015-08-05 | Cementation Skanska Ltd | Mechanical plant safety system |
| WO2016158255A1 (ja) * | 2015-03-31 | 2016-10-06 | 株式会社小松製作所 | 作業機械の周辺監視装置 |
| JP2016194481A (ja) * | 2015-04-01 | 2016-11-17 | 新日鐵住金株式会社 | 作業車両用の安全装置及び作業車両の監視方法 |
| WO2017038123A1 (ja) * | 2015-08-28 | 2017-03-09 | 日立建機株式会社 | 車両の周囲監視装置 |
| JP2018141314A (ja) * | 2017-02-28 | 2018-09-13 | コベルコ建機株式会社 | 建設機械 |
| JP2019001082A (ja) * | 2017-06-16 | 2019-01-10 | ファナック株式会社 | 加工機 |
| WO2019176036A1 (ja) * | 2018-03-14 | 2019-09-19 | 日立建機株式会社 | 作業機械 |
| WO2020218454A1 (ja) * | 2019-04-26 | 2020-10-29 | 住友建機株式会社 | 表示装置、ショベル、情報処理装置 |
| JP2021134533A (ja) * | 2020-02-26 | 2021-09-13 | 日本道路株式会社 | 安全装置および作業機械 |
| WO2021241033A1 (ja) * | 2020-05-29 | 2021-12-02 | 日立建機株式会社 | 作業機械 |
| WO2025187318A1 (ja) * | 2024-03-07 | 2025-09-12 | 株式会社クボタ | 俯瞰画像出力装置、俯瞰画像表示システム、作業機 |
Families Citing this family (85)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9113047B2 (en) * | 2010-10-22 | 2015-08-18 | Hitachi Construction Machinery Co., Ltd. | Peripheral monitoring device for working machine |
| US20120249342A1 (en) * | 2011-03-31 | 2012-10-04 | Koehrsen Craig L | Machine display system |
| US9736434B2 (en) * | 2012-06-25 | 2017-08-15 | The Boeing Company | Apparatus and method for displaying a view corresponding to a position of a mobile display device |
| JP2014031223A (ja) * | 2012-08-01 | 2014-02-20 | Tadano Ltd | 作業範囲図および作業範囲図表示装置 |
| US20140168412A1 (en) * | 2012-12-19 | 2014-06-19 | Alan Shulman | Methods and systems for automated micro farming |
| JP6545430B2 (ja) * | 2013-03-19 | 2019-07-17 | 住友重機械工業株式会社 | ショベル |
| US20140293047A1 (en) * | 2013-04-02 | 2014-10-02 | Caterpillar Inc. | System for generating overhead view of machine |
| US9712949B2 (en) * | 2013-06-07 | 2017-07-18 | Strata Products Worldwide, Llc | Method and apparatus for protecting a miner |
| JP5607841B1 (ja) * | 2013-07-30 | 2014-10-15 | 株式会社小松製作所 | 鉱山機械の管理システム及び管理方法 |
| KR102123127B1 (ko) * | 2013-12-06 | 2020-06-15 | 두산인프라코어 주식회사 | 화면모드 선택 장치 및 방법 |
| JP6267972B2 (ja) * | 2014-01-23 | 2018-01-24 | 日立建機株式会社 | 作業機械の周囲監視装置 |
| JP6262068B2 (ja) * | 2014-04-25 | 2018-01-17 | 日立建機株式会社 | 車体近傍障害物報知システム |
| JP6545541B2 (ja) * | 2014-06-25 | 2019-07-17 | 株式会社半導体エネルギー研究所 | 撮像装置、監視装置、及び電子機器 |
| EP4389689A1 (en) * | 2014-08-19 | 2024-06-26 | Crown Equipment Corporation | De-centralized operational indicator system for a materials handling vehicle |
| JP6665412B2 (ja) * | 2015-03-23 | 2020-03-13 | 株式会社タダノ | 作業機械の調整装置 |
| WO2016174754A1 (ja) | 2015-04-28 | 2016-11-03 | 株式会社小松製作所 | 作業機械の周辺監視装置及び作業機械の周辺監視方法 |
| US9871968B2 (en) | 2015-05-22 | 2018-01-16 | Caterpillar Inc. | Imaging system for generating a surround-view image |
| US9454147B1 (en) | 2015-09-11 | 2016-09-27 | Caterpillar Inc. | Control system for a rotating machine |
| EP3380865A4 (en) * | 2015-11-25 | 2019-08-07 | VHS IP Pty Ltd | SAFETY DEVICE FOR WORKING PLACE WITH LIDAR |
| WO2017094627A1 (ja) * | 2015-11-30 | 2017-06-08 | 住友重機械工業株式会社 | 作業機械用周辺監視システム |
| WO2017094626A1 (ja) * | 2015-11-30 | 2017-06-08 | 住友重機械工業株式会社 | 作業機械用周辺監視システム |
| US9787951B2 (en) * | 2015-12-18 | 2017-10-10 | Serge Kannon | Vehicle proximity warning system |
| JP6504072B2 (ja) * | 2016-02-15 | 2019-04-24 | オムロン株式会社 | 作業領域推定装置、制御装置、制御システム、作業領域推定方法およびプログラム |
| KR102484103B1 (ko) * | 2016-02-23 | 2023-01-04 | 현대두산인프라코어(주) | 표시 시스템 |
| US10750082B2 (en) * | 2016-03-28 | 2020-08-18 | Komatsu Ltd. | Evaluation device |
| US10590629B2 (en) * | 2016-03-29 | 2020-03-17 | Komatsu Ltd. | Working vehicle |
| JP6868805B2 (ja) * | 2016-06-07 | 2021-05-12 | パナソニックIpマネジメント株式会社 | 画像生成装置、画像生成方法、およびプログラム |
| KR102386846B1 (ko) * | 2016-07-05 | 2022-04-13 | 스미토모 겐키 가부시키가이샤 | 쇼벨 |
| JP2018039477A (ja) * | 2016-09-09 | 2018-03-15 | 株式会社タダノ | 画像表示システム |
| JP6546138B2 (ja) * | 2016-09-15 | 2019-07-17 | 日立建機株式会社 | 作業車両 |
| CN106406312B (zh) * | 2016-10-14 | 2017-12-26 | 平安科技(深圳)有限公司 | 导览机器人及其移动区域标定方法 |
| CN109314769B (zh) | 2016-11-01 | 2022-06-07 | 住友建机株式会社 | 施工机械用周边监视系统 |
| KR102454612B1 (ko) | 2016-11-01 | 2022-10-13 | 스미토모 겐키 가부시키가이샤 | 건설기계용 안전관리시스템, 관리장치 |
| US10594934B2 (en) * | 2016-11-17 | 2020-03-17 | Bendix Commercial Vehicle Systems Llc | Vehicle display |
| KR102426644B1 (ko) * | 2016-12-06 | 2022-07-27 | 스미토모 겐키 가부시키가이샤 | 건설기계 |
| US20180198983A1 (en) * | 2017-01-06 | 2018-07-12 | Olympus Corporation | Image pickup apparatus, image pickup system, image pickup method, image pickup program, and display apparatus for image pickup |
| US20180201132A1 (en) * | 2017-01-13 | 2018-07-19 | Deere & Company | Mobile machine-user protocol system and method |
| JP7092688B2 (ja) * | 2017-02-17 | 2022-06-28 | 住友重機械工業株式会社 | 作業機械用周辺監視システム |
| EP3587675B1 (en) * | 2017-02-22 | 2024-06-05 | Sumitomo (S.H.I.) Construction Machinery Co., Ltd. | Excavator |
| JP6760163B2 (ja) * | 2017-03-22 | 2020-09-23 | コベルコ建機株式会社 | 建設機械 |
| JP6581139B2 (ja) * | 2017-03-31 | 2019-09-25 | 日立建機株式会社 | 作業機械の周囲監視装置 |
| JP6819462B2 (ja) * | 2017-05-30 | 2021-01-27 | コベルコ建機株式会社 | 作業機械 |
| JP6960802B2 (ja) * | 2017-08-24 | 2021-11-05 | 日立建機株式会社 | 作業機械の周囲監視装置 |
| JP7080615B2 (ja) * | 2017-10-04 | 2022-06-06 | 株式会社日立製作所 | 監視装置、その方法および、そのシステム |
| JP2019085855A (ja) * | 2017-11-10 | 2019-06-06 | コベルコ建機株式会社 | 検出装置 |
| KR102627093B1 (ko) * | 2017-12-04 | 2024-01-18 | 스미도모쥬기가이고교 가부시키가이샤 | 주변감시장치 |
| CN111788358B (zh) * | 2018-02-28 | 2022-07-15 | 住友建机株式会社 | 挖土机 |
| JP2019151304A (ja) * | 2018-03-06 | 2019-09-12 | アイシン精機株式会社 | 周辺監視装置 |
| EP3779066B1 (en) * | 2018-03-26 | 2023-10-25 | Sumitomo (S.H.I.) Construction Machinery Co., Ltd. | Shovel |
| JP6947101B2 (ja) | 2018-03-28 | 2021-10-13 | コベルコ建機株式会社 | 遠隔操作システム及び主操作装置 |
| JP7070047B2 (ja) * | 2018-04-26 | 2022-05-18 | コベルコ建機株式会社 | 旋回式作業機械の旋回制御装置 |
| US10883256B2 (en) * | 2018-05-25 | 2021-01-05 | Deere & Company | Object responsive control system for a work machine |
| US10679065B2 (en) * | 2018-07-03 | 2020-06-09 | Hitachi, Ltd. | Non-invasive data extraction from digital displays |
| JP2020063566A (ja) * | 2018-10-15 | 2020-04-23 | 日立建機株式会社 | 油圧ショベル |
| JP7222775B2 (ja) * | 2019-03-26 | 2023-02-15 | 日立建機株式会社 | 作業機械 |
| DE102019116759A1 (de) * | 2019-06-21 | 2020-12-24 | Tadano Demag Gmbh | Verfahren zum Betrieb eines Fahrzeugkrans |
| JP7201548B2 (ja) * | 2019-07-12 | 2023-01-10 | 株式会社小松製作所 | 作業機械 |
| JP7152370B2 (ja) * | 2019-08-26 | 2022-10-12 | 日立建機株式会社 | 現場監視装置および現場監視システム |
| KR20220077908A (ko) * | 2019-09-19 | 2022-06-09 | 주식회사 윌러스표준기술연구소 | 스케일링 프로세스를 사용하는 비디오 신호 처리 방법 및 장치 |
| JP7269853B2 (ja) * | 2019-09-30 | 2023-05-09 | 日立建機株式会社 | 作業機械 |
| JP7424784B2 (ja) * | 2019-09-30 | 2024-01-30 | 株式会社小松製作所 | 制御装置、作業機械および制御方法 |
| CN114423911B (zh) * | 2019-10-31 | 2024-04-09 | 日立建机株式会社 | 作业机械 |
| JP7255454B2 (ja) * | 2019-11-07 | 2023-04-11 | コベルコ建機株式会社 | 作業機械の周囲監視装置 |
| CN110905036A (zh) * | 2019-12-02 | 2020-03-24 | 三一重机有限公司 | 挖掘机动臂的防撞方法、挖掘机动臂的防撞系统及挖掘机 |
| WO2021131761A1 (ja) * | 2019-12-27 | 2021-07-01 | 日立建機株式会社 | 建設機械 |
| JP7516068B2 (ja) * | 2020-02-21 | 2024-07-16 | 株式会社小松製作所 | 作業機械の遠隔操作システム |
| KR102757259B1 (ko) * | 2020-03-27 | 2025-01-21 | 히다치 겡키 가부시키 가이샤 | 작업 기계 |
| JP7428052B2 (ja) * | 2020-03-31 | 2024-02-06 | コベルコ建機株式会社 | 作業機械の周囲検知装置 |
| KR102332616B1 (ko) * | 2020-05-06 | 2021-12-01 | 이지스로직 주식회사 | 라이다와 ar을 이용한 건설 장비용 디스플레이 장치 |
| KR102647365B1 (ko) * | 2020-05-29 | 2024-03-12 | 히다찌 겐끼 가부시키가이샤 | 작업 기계 |
| JP7663327B2 (ja) * | 2020-09-02 | 2025-04-16 | 株式会社小松製作所 | 作業機械の障害物報知システムおよび作業機械の障害物報知方法 |
| US11521397B2 (en) * | 2020-09-08 | 2022-12-06 | Caterpillar Inc. | Object tracking for work machines |
| US11661722B2 (en) * | 2020-11-19 | 2023-05-30 | Deere & Company | System and method for customized visualization of the surroundings of self-propelled work vehicles |
| WO2022107718A1 (ja) * | 2020-11-19 | 2022-05-27 | 日立建機株式会社 | 作業機械 |
| US11898331B2 (en) * | 2020-12-02 | 2024-02-13 | Caterpillar Sarl | System and method for detecting objects within a working area |
| FR3120860B1 (fr) * | 2021-03-17 | 2023-05-12 | Haulotte Group | Nacelle élévatrice à visibilité améliorée |
| JP7581996B2 (ja) * | 2021-03-19 | 2024-11-13 | コベルコ建機株式会社 | 遠隔操作支援システムおよび遠隔操作支援方法 |
| WO2022202855A1 (ja) * | 2021-03-22 | 2022-09-29 | 住友建機株式会社 | 建設機械及び建設機械用支援装置 |
| JP2023004180A (ja) * | 2021-06-25 | 2023-01-17 | コベルコ建機株式会社 | 監視システム |
| CN117500986A (zh) * | 2021-06-28 | 2024-02-02 | 斗山山猫北美公司 | 用于控制挖掘机和其他动力机器的系统和方法 |
| US20230050240A1 (en) * | 2021-08-10 | 2023-02-16 | Ford Global Technologies, Llc | Passive access calibration |
| WO2023105198A1 (en) * | 2021-12-06 | 2023-06-15 | Mbda Uk Limited | Apparatus and method for imaging |
| JP2023110512A (ja) * | 2022-01-28 | 2023-08-09 | 株式会社小松製作所 | 作業機械、作業機械を制御するための方法、及び、作業機械の制御システム |
| US12227145B2 (en) * | 2023-01-20 | 2025-02-18 | Caterpillar Inc. | Machine security system |
| US12489860B2 (en) | 2023-03-08 | 2025-12-02 | Deere & Company | Digital panning system and method for a work machine |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002327470A (ja) | 2001-05-02 | 2002-11-15 | Komatsu Ltd | 作業機械の表示装置 |
| WO2006106685A1 (ja) * | 2005-03-31 | 2006-10-12 | Hitachi Construction Machinery Co., Ltd. | 作業機械の周囲監視装置 |
| JP2007085091A (ja) * | 2005-09-22 | 2007-04-05 | Hitachi Constr Mach Co Ltd | 作業現場の安全管理装置及びこれに適用される作業機械 |
| JP2008163719A (ja) * | 2007-01-05 | 2008-07-17 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
| JP2008248613A (ja) * | 2007-03-30 | 2008-10-16 | Hitachi Constr Mach Co Ltd | 作業機械周辺監視装置 |
| JP2009121053A (ja) * | 2007-11-12 | 2009-06-04 | Clarion Co Ltd | 建設・土木作業車両の作業安全監視システム |
| JP2010198519A (ja) * | 2009-02-27 | 2010-09-09 | Hitachi Constr Mach Co Ltd | 周囲監視装置 |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20020033816A (ko) * | 2000-07-19 | 2002-05-07 | 마츠시타 덴끼 산교 가부시키가이샤 | 감시시스템 |
| JP4433887B2 (ja) * | 2003-07-01 | 2010-03-17 | 日産自動車株式会社 | 車両用外界認識装置 |
| JP4404103B2 (ja) * | 2007-03-22 | 2010-01-27 | 株式会社デンソー | 車両外部撮影表示システムおよび画像表示制御装置 |
| JP2009060499A (ja) * | 2007-09-03 | 2009-03-19 | Sanyo Electric Co Ltd | 運転支援システム及び連結車両 |
| CN102906593B (zh) * | 2010-05-19 | 2015-06-17 | 三菱电机株式会社 | 车辆后方监视装置 |
| CN103547747A (zh) * | 2011-05-13 | 2014-01-29 | 日立建机株式会社 | 作业机械的周围监视装置 |
-
2011
- 2011-06-20 EP EP11795857.9A patent/EP2570556B1/en active Active
- 2011-06-20 WO PCT/JP2011/064065 patent/WO2011158955A1/ja not_active Ceased
- 2011-06-20 KR KR1020127032914A patent/KR101797261B1/ko not_active Expired - Fee Related
- 2011-06-20 CN CN201180030230.7A patent/CN102947515B/zh not_active Expired - Fee Related
- 2011-06-20 JP JP2012520517A patent/JP5395266B2/ja active Active
- 2011-06-20 AU AU2011266010A patent/AU2011266010B2/en not_active Ceased
- 2011-06-20 US US13/704,933 patent/US9332229B2/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002327470A (ja) | 2001-05-02 | 2002-11-15 | Komatsu Ltd | 作業機械の表示装置 |
| WO2006106685A1 (ja) * | 2005-03-31 | 2006-10-12 | Hitachi Construction Machinery Co., Ltd. | 作業機械の周囲監視装置 |
| JP2007085091A (ja) * | 2005-09-22 | 2007-04-05 | Hitachi Constr Mach Co Ltd | 作業現場の安全管理装置及びこれに適用される作業機械 |
| JP2008163719A (ja) * | 2007-01-05 | 2008-07-17 | Hitachi Constr Mach Co Ltd | 作業機械の周囲監視装置 |
| JP2008248613A (ja) * | 2007-03-30 | 2008-10-16 | Hitachi Constr Mach Co Ltd | 作業機械周辺監視装置 |
| JP2009121053A (ja) * | 2007-11-12 | 2009-06-04 | Clarion Co Ltd | 建設・土木作業車両の作業安全監視システム |
| JP2010198519A (ja) * | 2009-02-27 | 2010-09-09 | Hitachi Constr Mach Co Ltd | 周囲監視装置 |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9115482B2 (en) | 2012-03-29 | 2015-08-25 | Harnischfeger Technologies, Inc. | Collision detection and mitigation systems and methods for a shovel |
| US9598836B2 (en) | 2012-03-29 | 2017-03-21 | Harnischfeger Technologies, Inc. | Overhead view system for a shovel |
| US8768583B2 (en) | 2012-03-29 | 2014-07-01 | Harnischfeger Technologies, Inc. | Collision detection and mitigation systems and methods for a shovel |
| JP2014064144A (ja) * | 2012-09-20 | 2014-04-10 | Komatsu Ltd | 作業車両用周辺監視システム及び作業車両 |
| WO2014045466A1 (ja) * | 2012-09-20 | 2014-03-27 | 株式会社小松製作所 | 作業車両用周辺監視システム及び作業車両 |
| US9333915B2 (en) | 2012-09-20 | 2016-05-10 | Komatsu Ltd. | Work vehicle periphery monitoring system and work vehicle |
| US9415722B2 (en) | 2012-09-21 | 2016-08-16 | Komatsu Ltd. | Working vehicle perimeter monitoring system and working vehicle |
| CN103827942B (zh) * | 2012-09-21 | 2015-07-08 | 株式会社小松制作所 | 作业车辆用周边监视系统及作业车辆 |
| CN103827942A (zh) * | 2012-09-21 | 2014-05-28 | 株式会社小松制作所 | 作业车辆用周边监视系统及作业车辆 |
| WO2014045459A1 (ja) * | 2012-09-21 | 2014-03-27 | 株式会社小松製作所 | 作業車両用周辺監視システム及び作業車両 |
| JP2014182038A (ja) * | 2013-03-19 | 2014-09-29 | Sumitomo Heavy Ind Ltd | 作業機械用周辺監視装置 |
| WO2014148204A1 (ja) * | 2013-03-19 | 2014-09-25 | 住友重機械工業株式会社 | 作業機械用周辺監視装置 |
| GB2522616A (en) * | 2014-01-22 | 2015-08-05 | Cementation Skanska Ltd | Mechanical plant safety system |
| GB2522616B (en) * | 2014-01-22 | 2016-07-20 | Cementation Skanska Ltd | Mechanical plant safety system |
| JPWO2016158255A1 (ja) * | 2015-03-31 | 2017-07-20 | 株式会社小松製作所 | 作業機械の周辺監視装置 |
| WO2016158255A1 (ja) * | 2015-03-31 | 2016-10-06 | 株式会社小松製作所 | 作業機械の周辺監視装置 |
| WO2016157462A1 (ja) * | 2015-03-31 | 2016-10-06 | 株式会社小松製作所 | 作業機械の周辺監視装置 |
| JP2016194481A (ja) * | 2015-04-01 | 2016-11-17 | 新日鐵住金株式会社 | 作業車両用の安全装置及び作業車両の監視方法 |
| WO2017038123A1 (ja) * | 2015-08-28 | 2017-03-09 | 日立建機株式会社 | 車両の周囲監視装置 |
| JP2018141314A (ja) * | 2017-02-28 | 2018-09-13 | コベルコ建機株式会社 | 建設機械 |
| JP2019001082A (ja) * | 2017-06-16 | 2019-01-10 | ファナック株式会社 | 加工機 |
| US10780618B2 (en) | 2017-06-16 | 2020-09-22 | Fanuc Corporation | Machine tool |
| US11225777B2 (en) | 2018-03-14 | 2022-01-18 | Hitachi Construction Machinery Co., Ltd. | Work machine |
| WO2019176036A1 (ja) * | 2018-03-14 | 2019-09-19 | 日立建機株式会社 | 作業機械 |
| JPWO2019176036A1 (ja) * | 2018-03-14 | 2020-04-16 | 日立建機株式会社 | 作業機械 |
| JP7511547B2 (ja) | 2019-04-26 | 2024-07-05 | 住友建機株式会社 | 表示装置、ショベル、情報処理装置 |
| JPWO2020218454A1 (ja) * | 2019-04-26 | 2020-10-29 | ||
| WO2020218454A1 (ja) * | 2019-04-26 | 2020-10-29 | 住友建機株式会社 | 表示装置、ショベル、情報処理装置 |
| US12325980B2 (en) | 2019-04-26 | 2025-06-10 | Sumitomo Construction Machinery Co., Ltd. | Display device, shovel, and information processing apparatus |
| JP2021134533A (ja) * | 2020-02-26 | 2021-09-13 | 日本道路株式会社 | 安全装置および作業機械 |
| WO2021241033A1 (ja) * | 2020-05-29 | 2021-12-02 | 日立建機株式会社 | 作業機械 |
| JPWO2021241033A1 (ja) * | 2020-05-29 | 2021-12-02 | ||
| JP7332805B2 (ja) | 2020-05-29 | 2023-08-23 | 日立建機株式会社 | 作業機械 |
| US12060697B2 (en) | 2020-05-29 | 2024-08-13 | Hitachi Construction Machinery Co., Ltd. | Work machine for determining condition for recording and retaining video |
| WO2025187318A1 (ja) * | 2024-03-07 | 2025-09-12 | 株式会社クボタ | 俯瞰画像出力装置、俯瞰画像表示システム、作業機 |
Also Published As
| Publication number | Publication date |
|---|---|
| US20130088593A1 (en) | 2013-04-11 |
| AU2011266010A1 (en) | 2013-01-10 |
| US9332229B2 (en) | 2016-05-03 |
| JP5395266B2 (ja) | 2014-01-22 |
| CN102947515B (zh) | 2015-07-29 |
| EP2570556A4 (en) | 2018-01-03 |
| KR101797261B1 (ko) | 2017-11-13 |
| KR20130100919A (ko) | 2013-09-12 |
| EP2570556A1 (en) | 2013-03-20 |
| EP2570556B1 (en) | 2021-04-28 |
| JPWO2011158955A1 (ja) | 2013-08-19 |
| AU2011266010B2 (en) | 2015-01-29 |
| CN102947515A (zh) | 2013-02-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP5395266B2 (ja) | 作業機械の周囲監視装置 | |
| JP5369057B2 (ja) | 作業機械の周囲監視装置 | |
| KR101322201B1 (ko) | 건설용 중장비 접근 감시 시스템 | |
| JP7252137B2 (ja) | 周辺監視装置 | |
| JP6734260B2 (ja) | 作業機械 | |
| WO2006106685A1 (ja) | 作業機械の周囲監視装置 | |
| CN104884712B (zh) | 工程机械的感知装置及方法 | |
| JP4776491B2 (ja) | 作業機械の周囲監視装置 | |
| JP7058582B2 (ja) | 作業機械 | |
| JPWO2018084161A1 (ja) | 建設機械用安全管理システム、管理装置 | |
| JP2008144378A (ja) | 遠隔操縦作業機の制御装置 | |
| CN113727883A (zh) | 显示装置、挖土机、信息处理装置 | |
| KR20130138227A (ko) | 작업 기계의 주위 감시 장치 | |
| JP6878025B2 (ja) | 作業機械用周辺監視システム | |
| JP2014031660A (ja) | 重機周りの接近作業員検知方法及びシステム | |
| JP2016219864A (ja) | 作業車両の周囲監視装置 | |
| JP6917167B2 (ja) | 建設機械用俯瞰画像表示装置 | |
| JP2018024500A (ja) | 障害物検出装置 | |
| WO2021065814A1 (ja) | 領域設定支援システムおよびこれを搭載した作業車両 | |
| JP2019182212A (ja) | 作業機の監視システム | |
| KR20230122795A (ko) | 라이다와 카메라를 이용한 건설기계 안전관리 시스템 | |
| JP2021134533A (ja) | 安全装置および作業機械 | |
| US12398540B2 (en) | Monitoring system for work machine | |
| JP7739200B2 (ja) | 監視システム | |
| JP2006173999A (ja) | カメラ装置および遠隔装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| WWE | Wipo information: entry into national phase |
Ref document number: 201180030230.7 Country of ref document: CN |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11795857 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2012520517 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2011795857 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 20127032914 Country of ref document: KR Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 13704933 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2011266010 Country of ref document: AU Date of ref document: 20110620 Kind code of ref document: A |