CN111673749A - Adjustment method of vision welding robot and vision welding robot - Google Patents
Adjustment method of vision welding robot and vision welding robot Download PDFInfo
- Publication number
- CN111673749A CN111673749A CN202010515894.3A CN202010515894A CN111673749A CN 111673749 A CN111673749 A CN 111673749A CN 202010515894 A CN202010515894 A CN 202010515894A CN 111673749 A CN111673749 A CN 111673749A
- Authority
- CN
- China
- Prior art keywords
- welding
- robot
- camera
- visual
- coordinate system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B23—MACHINE TOOLS; METAL-WORKING NOT OTHERWISE PROVIDED FOR
- B23K—SOLDERING OR UNSOLDERING; WELDING; CLADDING OR PLATING BY SOLDERING OR WELDING; CUTTING BY APPLYING HEAT LOCALLY, e.g. FLAME CUTTING; WORKING BY LASER BEAM
- B23K37/00—Auxiliary devices or processes, not specially adapted for a procedure covered by only one of the other main groups of this subclass
- B23K37/02—Carriages for supporting the welding or cutting element
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
- B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1679—Programme controls characterised by the tasks executed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J9/00—Programme-controlled manipulators
- B25J9/16—Programme controls
- B25J9/1694—Programme controls characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
- B25J9/1697—Vision controlled systems
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Robotics (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Manipulator (AREA)
- Numerical Control (AREA)
Abstract
本申请的实施例揭示了一种视觉焊接机器人的调校方法及视觉焊接机器人,视觉焊接机器人具有摄像头,该方法包括:将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步;获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点;获得焊缝轨迹的特征点在机器人基坐标系中的坐标;根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动;根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。本申请的技术方法在自动调校视觉焊接机器人时,能够保证机器人本体以及相关零部件在调试过程中不被损坏,也保证了调试人员的安全性。
Embodiments of the present application disclose a method for adjusting a vision welding robot and a vision welding robot, wherein the vision welding robot has a camera, and the method includes: synchronizing a control coordinate system of a vision welding robot control system with a base coordinate system of the vision welding robot ; Obtain the image of the workpiece to be welded collected by the camera to extract the weld track in the image of the workpiece to be welded, and extract the feature points of the weld track; obtain the coordinates of the feature points of the weld track in the robot base coordinate system; The seam trajectory and the coordinates of the feature points in the robot base coordinate system control the camera to move along the welding seam trajectory; adjust the position of the camera of the visual welding robot according to the pictures captured by the camera moving along the welding seam trajectory. The technical method of the present application can ensure that the robot body and related components are not damaged during the debugging process when automatically adjusting the visual welding robot, and also ensure the safety of the debugging personnel.
Description
技术领域technical field
本申请涉及机器人调校技术领域,具体而言,涉及一种视觉焊接机器人的调校方法、视觉焊接机器人的调校方法装置、电子设备以及计算机可读存储介质。The present application relates to the technical field of robot calibration, and in particular, to a calibration method for a visual welding robot, a calibration method device for a visual welding robot, an electronic device, and a computer-readable storage medium.
背景技术Background technique
目前,机器人调校技术尚未形成统一的操作标准,因此,在调校机器人的过程,有可能会出现机器人本体和控制系统在调试过程中被损坏的问题。At present, the robot adjustment technology has not yet formed a unified operating standard. Therefore, in the process of adjusting the robot, the robot body and control system may be damaged during the debugging process.
需要说明的是,在上述背景技术部分公开的信息仅用于加强对本申请的背景的理解,因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。It should be noted that the information disclosed in the above Background section is only for enhancing understanding of the background of the application, and therefore may include information that does not form the prior art known to a person of ordinary skill in the art.
发明内容SUMMARY OF THE INVENTION
为解决上述问题,本申请的实施例提供了一种视觉焊接机器人的调校方法、视觉焊接机器人的调校方法装置、电子设备以及计算机可读存储介质。To solve the above problems, embodiments of the present application provide a method for adjusting a visual welding robot, an apparatus for adjusting a visual welding robot, an electronic device, and a computer-readable storage medium.
其中,本申请所采用的一种视觉焊接机器人的调校方法为:Wherein, the adjustment method of a kind of visual welding robot adopted in this application is:
将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步;获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点;获得焊缝轨迹的特征点在机器人基坐标系中的坐标;根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动;根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。Synchronize the control coordinate system of the visual welding robot control system with the base coordinate system of the visual welding robot; acquire the image of the workpiece to be welded collected by the camera to extract the weld track in the image of the workpiece to be welded, and extract the feature points of the weld track ; Obtain the coordinates of the feature points of the welding seam trajectory in the robot base coordinate system; control the camera to move along the welding seam trajectory according to the welding seam trajectory and the coordinates of the feature points in the robot base coordinate system; according to the camera along the welding seam trajectory Adjust the position of the camera of the visual welding robot according to the picture captured by the movement.
在另外的实施例中,基于前述方案,将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步,包括:检测视觉焊接机器人的位置信号;若检测到预设位置信号,则确定视觉焊接机器人回到了机械原点,机械原点是机器人基坐标系的原点,预设位置信号是视觉焊接机器人回到机械原点时的位置信号;当确定视觉焊接机器人回到机械原点时设置控制坐标系,以使控制坐标系与机器人基坐标系同步。In another embodiment, based on the aforementioned solution, synchronizing the control coordinate system of the visual welding robot control system with the base coordinate system of the visual welding robot includes: detecting the position signal of the visual welding robot; if a preset position signal is detected, then Make sure that the visual welding robot has returned to the mechanical origin, the mechanical origin is the origin of the robot base coordinate system, and the preset position signal is the position signal when the visual welding robot returns to the mechanical origin; when it is determined that the visual welding robot has returned to the mechanical origin, set the control coordinate system , to synchronize the control coordinate system with the robot base coordinate system.
在另外的实施例中,基于前述方案,根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动,包括:将特征点的位置作为工件坐标系的原点,获取焊缝轨迹的各个点在工件坐标系中的坐标数据;根据特征点在机器人基坐标系中的坐标以及焊缝轨迹的各个点在工件坐标系中的坐标数据,控制摄像头沿着焊缝轨迹进行运动。In another embodiment, based on the foregoing solution, controlling the camera to move along the welding seam trajectory according to the welding seam trajectory and the coordinates of the feature points in the robot base coordinate system, including: taking the position of the feature point as the origin of the workpiece coordinate system , to obtain the coordinate data of each point of the welding seam trajectory in the workpiece coordinate system; according to the coordinates of the feature points in the robot base coordinate system and the coordinate data of each point of the welding seam trajectory in the workpiece coordinate system, control the camera to follow the welding seam trajectory to move.
在另外的实施例中,基于前述方案,视觉焊接机器人具有焊枪,该方法还包括:控制摄像头运动以拍摄特征点;当特征点位于摄像头所拍摄画面的中心时,记录摄像头在机器人基坐标系中的坐标;控制焊枪进行运动,以使焊枪移动至与特征点距离预设起弧距离的位置;获得焊枪在机器人基坐标系中的坐标;根据摄像头以及焊枪在机器人基坐标系中的坐标,确定焊枪与摄像头的偏置距离。In another embodiment, based on the aforementioned solution, the visual welding robot has a welding gun, and the method further includes: controlling the camera to move to capture the feature point; when the feature point is located in the center of the image captured by the camera, recording the camera in the robot base coordinate system control the welding torch to move to move the welding torch to the position with the preset arc starting distance from the feature point; obtain the coordinates of the welding torch in the robot base coordinate system; determine the coordinates of the camera and the welding torch in the robot base coordinate system The offset distance between the welding torch and the camera.
在另外的实施例中,基于前述方案,视觉焊接机器人具有多个轴,多个轴用于控制焊枪进行运动,在控制焊枪进行运动,以使焊枪移动至与特征点距离预设起弧距离的位置之前,方法还包括:对焊枪的运动进行调试,在调试开始后第一时长,控制视觉焊接机器人的多个轴在第一限速下运行;达到第一时长后,控制视觉焊接机器人的多个轴在第二限速下运行,第二限速大于第一限速。In another embodiment, based on the aforementioned solution, the visual welding robot has multiple axes, and the multiple axes are used to control the welding torch to move, and the welding torch is controlled to move so that the welding torch is moved to a distance from the feature point to a preset arc starting distance. Before the position, the method further includes: debugging the motion of the welding torch, and controlling multiple axes of the visual welding robot to run at the first speed limit for the first time period after the debugging starts; after reaching the first time period, controlling the multiple axes of the visual welding robot. Axes run under the second limit speed, and the second limit speed is greater than the first limit speed.
在另外的实施例中,基于前述方案,还包括:控制焊枪根据焊缝轨迹进行模拟仿形焊接,得到焊枪的运动轨迹;比较焊枪的运动轨迹以及焊缝轨迹,得到第一比较结果;控制焊枪根据焊缝轨迹进行焊接,以及控制摄像头与焊枪保持偏置距离拍摄的焊枪焊接的焊接轨迹;根据焊接轨迹以及焊缝轨迹,得到第二比较结果;根据第一比较结果以及第二比较结果,确定对视觉焊接机器人调校的调校结果,若第一比较结果与第二比较均为匹配,则确定对视觉焊接机器人的调校结果为成功,若第一比较结果和第二比较结果中任一结果为不匹配,则确定对视觉焊接机器人的调校结果为失败。In another embodiment, based on the foregoing solution, the method further includes: controlling the welding torch to perform simulated profiling welding according to the welding seam trajectory, to obtain the motion trajectory of the welding gun; comparing the motion trajectory of the welding torch and the welding seam trajectory to obtain a first comparison result; Weld according to the welding seam track, and control the welding track of the welding gun to keep the offset distance from the camera and the welding gun; obtain the second comparison result according to the welding track and the welding seam track; determine according to the first comparison result and the second comparison result For the adjustment result of the adjustment of the visual welding robot, if the first comparison result matches the second comparison result, it is determined that the adjustment result of the vision welding robot is successful, if either the first comparison result or the second comparison result is successful. If the result is a mismatch, it is determined that the adjustment result of the vision welding robot is a failure.
在另外的实施例中,基于前述方案,在对焊枪的运动进行调试之后,还包括:确认视觉焊接机器人的各个轴的运动是否平稳,以及确认焊枪的运动轨迹是否平滑;当确定各个轴的运动平稳且焊枪的运动轨迹平滑后,根据焊缝轨迹、偏置距离对焊枪的焊接路径进行焊接工艺以及焊接路径的规划;若焊接工艺以及焊接路径的规划满足预设条件,则确定对视觉焊接机器人的焊接工艺以及焊接路径的调试结果为成功。In another embodiment, based on the foregoing solution, after the motion of the welding torch is debugged, the method further includes: confirming whether the motion of each axis of the visual welding robot is smooth, and confirming whether the motion trajectory of the welding torch is smooth; when determining the motion of each axis After the movement trajectory of the welding torch is stable and smooth, the welding process and the welding path of the welding torch are planned according to the welding seam trajectory and the offset distance; if the welding process and the planning of the welding path meet the preset conditions, the vision welding robot is determined. The welding process and the debugging results of the welding path were successful.
在另外的实施例中,基于前述方案,在获得摄像头采集待焊件图像之前,还包括:拍摄多张待焊件图像;根据多张待焊件图像的图像信息,对摄像头进行调试,摄像头的调试包括确定曝光时间、确定采样频率、选定图像处理策略以及选定特征提取策略中的一种或多种。In another embodiment, based on the foregoing solution, before obtaining the image of the workpiece to be welded by the camera, the method further includes: shooting a plurality of images of the workpiece to be welded; Commissioning includes one or more of determining the exposure time, determining the sampling frequency, selecting an image processing strategy, and selecting a feature extraction strategy.
在另外的实施例中,基于前述方案,在拍摄多张待焊件图像之前,还包括:确认视觉焊接机器人的机器人本体的有无变形,以及确认视觉焊接机器人的电气控制安装连线是否正确以及有无松脱;若确定机器人本体的无变形以及确认电气控制安装连线正确且无松脱,则拍摄多种待焊件图像。In another embodiment, based on the foregoing solution, before shooting a plurality of images of the workpiece to be welded, the method further includes: confirming whether the robot body of the visual welding robot is deformed, and confirming whether the electrical control installation wiring of the visual welding robot is correct and Whether there is looseness; if it is confirmed that there is no deformation of the robot body and that the electrical control installation wiring is correct and not loose, take various images of the parts to be welded.
基于本申请的另一方面,本申请还提供了一种视觉焊接机器人,其特征在于,包括:机器人本体;机器人本体具有多个轴;摄像头机构,具有摄像头,摄像头机构与机器人本体连接;焊接设备,与机器人本体连接,焊接设备包括焊枪;控制器,与机器人本体、摄像头机构以及焊接设备连接,用于控制摄像头机构以及焊接设备执行所前所述的视觉焊接机器人的调校方法的步骤。Based on another aspect of the present application, the present application also provides a visual welding robot, which is characterized by comprising: a robot body; the robot body has a plurality of axes; a camera mechanism has a camera, and the camera mechanism is connected to the robot body; welding equipment , connected with the robot body, the welding equipment includes a welding torch; the controller is connected with the robot body, the camera mechanism and the welding equipment, and is used to control the camera mechanism and the welding equipment to perform the steps of the aforementioned adjustment method of the visual welding robot.
基于本申请的另一方面,本申请还提供了一种视觉焊接机器人的调校装置,该视觉焊接机器人具有摄像头,包括:Based on another aspect of the present application, the present application also provides a device for adjusting a vision welding robot, the vision welding robot having a camera, including:
同步单元,用于将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步;The synchronization unit is used to synchronize the control coordinate system of the visual welding robot control system with the base coordinate system of the visual welding robot;
提取单元,用于获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点;an extraction unit, configured to acquire the image of the workpiece to be welded collected by the camera, to extract the weld track in the image of the to-be-welded workpiece, and to extract the feature points of the weld track;
获得单元,用于获得焊缝轨迹的特征点在机器人基坐标系中的坐标;The obtaining unit is used to obtain the coordinates of the feature points of the welding seam trajectory in the robot base coordinate system;
控制单元,用于根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动;The control unit is used to control the camera to move along the welding seam trajectory according to the welding seam trajectory and the coordinates of the feature points in the robot base coordinate system;
调校单元,用于根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。The adjustment unit is used to adjust the position of the camera of the visual welding robot according to the picture captured by the camera moving along the welding seam track.
基于本申请的另一方面,本申请还提供了Based on another aspect of the present application, the present application also provides
一种视觉焊接机器人的调校设备,包括处理器及存储器,所述存储器上存储有计算机可读指令,所述计算机可读指令被所述处理器执行时实现如上所述的视觉焊接机器人的调校方法。A calibration device for a visual welding robot, comprising a processor and a memory, on which computer-readable instructions are stored, and when the computer-readable instructions are executed by the processor, the above-mentioned adjustment of the visual welding robot is realized. school method.
一种计算机可读存储介质,其上存储有计算机可读指令,当所述计算机可读指令被计算机的处理器执行时,使计算机执行如上所述的视觉焊接机器人的调校方法。A computer-readable storage medium on which computer-readable instructions are stored, when the computer-readable instructions are executed by a processor of a computer, the computer is made to execute the above-mentioned adjustment method of a visual welding robot.
申请实施例提供的技术方案可以包括以下有益效果:The technical solutions provided by the application embodiments may include the following beneficial effects:
本申请的技术方法在自动调校视觉焊接机器人时,能够保证机器人本体以及相关零部件在调试过程中不被损坏,也保证了调试人员的安全性。The technical method of the present application can ensure that the robot body and related components are not damaged during the debugging process when automatically adjusting the visual welding robot, and also ensure the safety of the debugging personnel.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本申请。It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not limiting of the present application.
附图说明Description of drawings
此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本申请的实施例,并与说明书一起用于解释本申请的原理。显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术者来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。在附图中:The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description serve to explain the principles of the application. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without creative effort. In the attached image:
图1是根据一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 1 is a flowchart of a method for adjusting a vision welding robot according to an exemplary embodiment;
图2是图1所示实施例中步骤S110在另一个实施例的流程图;FIG. 2 is a flowchart of step S110 in another embodiment of the embodiment shown in FIG. 1;
图3是图1所示实施例中步骤S140在另一个实施例的流程图;FIG. 3 is a flowchart of step S140 in another embodiment of the embodiment shown in FIG. 1;
图4是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 4 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图5是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 5 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图6是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 6 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图7是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 7 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图8是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 8 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图9是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图;FIG. 9 is a flowchart of a method for adjusting a vision welding robot according to another exemplary embodiment;
图10是根据本申请的一个实施例的视觉焊接机器人的调校方法的流程图;10 is a flowchart of a method for adjusting a vision welding robot according to an embodiment of the present application;
图11是根据一示例性实施例示出的一种视觉焊接机器人的调校装置1100的框图;FIG. 11 is a block diagram of a calibration device 1100 for a visual welding robot according to an exemplary embodiment;
图12是根据一示例性实施例示出的一种视觉焊接机器人的调校设备的硬件结构示意图。Fig. 12 is a schematic diagram of the hardware structure of a calibration device for a vision welding robot according to an exemplary embodiment.
具体实施方式Detailed ways
这里将详细地对示例性实施例进行说明,其示例表示在附图中。下面的描述涉及附图时,除非另有表示,不同附图中的相同数字表示相同或相似的要素。以下示例性实施例中所描述的实施方式并不代表与本申请相一致的所有实施方式。相反,它们仅是与如所附权利要求书中所详述的、本申请的一些方面相一致的装置和方法的例子。Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as recited in the appended claims.
图1是根据一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图。如图1所示,在一示例性实施例中,该视觉焊接机器人的调校方法可以包括以下步骤S110至步骤S150。Fig. 1 is a flow chart of a method for adjusting a vision welding robot according to an exemplary embodiment. As shown in FIG. 1 , in an exemplary embodiment, the adjustment method of the visual welding robot may include the following steps S110 to S150 .
首先需要说明的是,对视觉焊接机器人的调校过程包括对摄像头的调整和校准,通过以下步骤S110至步骤S150可以实现对摄像头的调校。First of all, it should be noted that the adjustment process of the visual welding robot includes adjustment and calibration of the camera, and the adjustment of the camera can be realized through the following steps S110 to S150.
步骤S110,将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步。In step S110, the control coordinate system of the visual welding robot control system is synchronized with the base coordinate system of the visual welding robot.
坐标系,从一个原点的固定点通过轴定义平面或空间。视觉焊接机器人的控制系统通过坐标系的各个轴来进行测量和定位,视觉焊接机器人的控制具有多个坐标系,其中,控制坐标系是控制系统所使用的坐标系,该坐标系可以设置为与该视觉焊接机器人的基坐标系同步,基坐标系是位于视觉焊接机器人基座,便于视觉焊接机器人从一个位置移动到另一个位置的坐标系。A coordinate system that defines a plane or space through axes from a fixed point of origin. The control system of the visual welding robot performs measurement and positioning through each axis of the coordinate system. The control of the visual welding robot has multiple coordinate systems, wherein the control coordinate system is the coordinate system used by the control system, and the coordinate system can be set to The base coordinate system of the visual welding robot is synchronized, and the base coordinate system is a coordinate system located at the base of the visual welding robot, which is convenient for the visual welding robot to move from one position to another.
通过将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步,可以实现更方便的控制该视觉焊接机器人的各部位进行运动。By synchronizing the control coordinate system of the visual welding robot control system with the base coordinate system of the visual welding robot, it is possible to more conveniently control each part of the visual welding robot to move.
步骤S120,获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点。In step S120, the image of the workpiece to be welded collected by the camera is acquired, so as to extract the welding seam trajectory in the image of the to-be-welded workpiece, and extract the feature points of the welding seam trajectory.
待焊件是等待焊件的工件,其上有焊缝轨迹,用于指示需要焊件的点或线。A weldment is a workpiece waiting for a weldment with a weld trace on it to indicate the point or line where the weldment is required.
可以通过摄像头采集待焊件的图像,以提取该图像中的焊接轨迹,在另外的实施例中,还可以采用传感器获得待焊件的图像,当采集的到该待焊接额图像时,通过图像处理组件对该图像预处理,例如图像二值化、中值滤波、图像形态学细化等,再将经过预处理的图像发送至视觉焊接机器人控制系统的控制器进行处理。The image of the workpiece to be welded can be collected by a camera to extract the welding track in the image. In another embodiment, a sensor can also be used to obtain the image of the workpiece to be welded. When the image of the forehead to be welded is collected, the image The processing component preprocesses the image, such as image binarization, median filtering, image morphological refinement, etc., and then sends the preprocessed image to the controller of the visual welding robot control system for processing.
可以预先对焊缝轨迹的特征点定义,例如该特征点的平面坐标为焊缝中心线的第一个转折点的坐标,T性角接焊缝的特征点坐标为两条断裂条纹右边条纹的中心延长线或左边条纹接触的第一个点的坐标,此处不进行限制。The feature points of the weld track can be defined in advance. For example, the plane coordinates of the feature point are the coordinates of the first turning point of the center line of the weld, and the coordinates of the feature point of the T-shaped fillet weld are the center of the right stripe of the two fracture stripes. The coordinates of the first point where the extension line or the left stripe touches, there is no restriction here.
应当理解,根据所采集图像中的焊缝轨迹和该焊缝轨迹的特征点,可以获得该焊缝轨迹特征点与该视觉焊接机器人的位置关系。It should be understood that, according to the welding seam trajectory and the feature points of the welding seam trajectory in the collected image, the positional relationship between the welding seam trajectory feature point and the visual welding robot can be obtained.
在本实施例中,所提取的焊缝轨迹的特征点、焊缝轨迹以及其中所暗含的位置关系可用于调校该视觉焊接机器人的摄像头的位置。In this embodiment, the extracted feature points of the welding seam trajectory, the welding seam trajectory and the positional relationship implied therein can be used to adjust the position of the camera of the visual welding robot.
步骤S130,获得焊缝轨迹的特征点在机器人基坐标系中的坐标。In step S130, the coordinates of the feature points of the welding seam trajectory in the robot base coordinate system are obtained.
如前所述,基坐标系是位于视觉焊接机器人基座的坐标系。通过步骤S220可以得到焊缝轨迹的特征点与该视觉焊接机器人的位置关系。那么,容易理解的,可以获得焊缝轨迹的特征点在机器人基坐标系中的坐标。As mentioned earlier, the base coordinate system is the coordinate system located at the base of the vision welding robot. Through step S220, the positional relationship between the feature points of the welding seam trajectory and the visual welding robot can be obtained. Then, it is easy to understand that the coordinates of the feature points of the welding seam trajectory in the robot base coordinate system can be obtained.
步骤S140,根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动。Step S140, controlling the camera to move along the welding seam trajectory according to the welding seam trajectory and the coordinates of the feature points in the robot base coordinate system.
根据焊缝轨迹特征点的坐标以及该焊缝轨迹的图像,可以获得该焊缝轨迹所有点在该视觉焊接机器人的基坐标系中的坐标。根据所获得该焊缝轨迹所有点在该视觉焊接机器人的基坐标系中的坐标,可以控制安装在该视觉焊接机器人的摄像头沿着该焊缝轨迹运动。According to the coordinates of the feature points of the weld track and the image of the weld track, the coordinates of all points of the weld track in the base coordinate system of the visual welding robot can be obtained. According to the obtained coordinates of all points of the welding seam trajectory in the base coordinate system of the visual welding robot, the camera installed on the visual welding robot can be controlled to move along the welding seam trajectory.
步骤S150,根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。In step S150, the position of the camera of the visual welding robot is adjusted according to the picture captured by the camera moving along the trajectory of the welding seam.
可以基于双目视觉的摄像头自动校正,基于双目视觉的摄像头自动校正是示教中的视觉焊接机器人的摄像头根据所拍摄的焊缝轨迹在拍摄画面中的位置,自动调整摄像头的位置。The camera based on binocular vision can be automatically corrected. The automatic camera correction based on binocular vision is that the camera of the visual welding robot in the teaching automatically adjusts the position of the camera according to the position of the captured weld track in the shooting screen.
需要说明的是,在调校该视觉焊接机器人的过程中,若发生异常,可以强制关闭电源,异常可由调试者预先设置,由安装在该视觉焊接机器人各部位的传感器检测发现。It should be noted that in the process of adjusting the visual welding robot, if an abnormality occurs, the power supply can be forcibly turned off. The abnormality can be preset by the debugger and detected by the sensors installed in various parts of the visual welding robot.
由此,通过视觉焊接机器人的控制系统自动调校该机器人的摄像头的位置,可以实现保证调试人员的安全,且保证机器人本体和控制系统在调试过程中不被损坏,节约了人工成本。Therefore, the position of the camera of the robot can be automatically adjusted by the control system of the visual welding robot, which can ensure the safety of the debugging personnel, and ensure that the robot body and the control system are not damaged during the debugging process, saving labor costs.
图2是图1所示实施例中步骤S110在另一个实施例的流程图,在该实施例中,将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步,包括步骤S210至步骤S230。Fig. 2 is a flowchart of step S110 in another embodiment of the embodiment shown in Fig. 1. In this embodiment, the control coordinate system of the visual welding robot control system is synchronized with the base coordinate system of the visual welding robot, including step S210 Go to step S230.
步骤S210,检测视觉焊接机器人的位置信号。Step S210, detecting the position signal of the visual welding robot.
位置信号可以在该视觉焊接机器人回到机械原点时预设的开关信号。The position signal can be a preset switch signal when the vision welding robot returns to the mechanical origin.
步骤S220,若检测到预设位置信号,则确定视觉焊接机器人回到了机械原点,机械原点是机器人基坐标系的原点,预设位置信号是视觉焊接机器人回到机械原点时的位置信号。Step S220, if a preset position signal is detected, it is determined that the visual welding robot has returned to the mechanical origin, the mechanical origin is the origin of the robot base coordinate system, and the preset position signal is the position signal when the visual welding robot returns to the mechanical origin.
当检测到该开关信号时,可确定该视觉焊接机器人已回机械原点,也就可以基于该机械原点对该机器人进行更好的控制。When the switch signal is detected, it can be determined that the visual welding robot has returned to the mechanical origin, and the robot can be better controlled based on the mechanical origin.
步骤S230,当确定视觉焊接机器人回到机械原点时设置控制坐标系,以使控制坐标系与机器人基坐标系同步。Step S230, when it is determined that the visual welding robot returns to the mechanical origin, the control coordinate system is set, so that the control coordinate system is synchronized with the robot base coordinate system.
当确定该视觉焊接机器人已回到机械原点,可以将控制系统的控制坐标系的原点设置为该机械原点的位置,如此,便可实现控制坐标系和基坐标系的同步。When it is determined that the visual welding robot has returned to the mechanical origin, the origin of the control coordinate system of the control system can be set to the position of the mechanical origin, so that the synchronization of the control coordinate system and the base coordinate system can be realized.
图3是图1所示实施例中步骤S140在另一个实施例的流程图,在该实施例中,步骤S140,根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动,可以包括以下步骤S310和步骤S320。FIG. 3 is a flow chart of step S140 in another embodiment of the embodiment shown in FIG. 1 . In this embodiment, step S140 is to control the camera along the trajectory of the welding seam and the coordinates of the feature points in the base coordinate system of the robot. The movement of the welding seam trajectory may include the following steps S310 and S320.
步骤S310,将特征点的位置作为工件坐标系的原点,获取焊缝轨迹的各个点在工件坐标系中的坐标数据。In step S310, the position of the feature point is taken as the origin of the workpiece coordinate system, and the coordinate data of each point of the welding seam trajectory in the workpiece coordinate system is obtained.
其中,工件坐标系是以工件原点与坐标轴构成的坐标系,该工件坐标系的坐标数据是该工件坐标系相对于基坐标系的坐标数据。The workpiece coordinate system is a coordinate system composed of a workpiece origin and a coordinate axis, and the coordinate data of the workpiece coordinate system is the coordinate data of the workpiece coordinate system relative to the base coordinate system.
步骤S320,根据特征点在机器人基坐标系中的坐标以及焊缝轨迹的各个点在工件坐标系中的坐标数据,控制摄像头沿着焊缝轨迹进行运动。Step S320 , according to the coordinates of the feature points in the robot base coordinate system and the coordinate data of each point of the welding seam trajectory in the workpiece coordinate system, the camera is controlled to move along the welding seam trajectory.
由此,可以通过摄像头拍摄焊缝轨迹,形成多张画面,通过分析每张画面中焊缝轨迹的特征点的位置,对该摄像头的位置实现自动调校。In this way, the welding seam trajectory can be photographed by the camera to form multiple pictures, and the position of the camera can be automatically adjusted by analyzing the positions of the feature points of the welding seam trajectory in each picture.
图4是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图。如图4所示,在一示例性实施例中,视觉焊接机器人具有焊枪,该视觉焊接机器人的调校方法还可以包括以下步骤步骤S410至步骤S450。Fig. 4 is a flow chart of a method for adjusting a vision welding robot according to another exemplary embodiment. As shown in FIG. 4 , in an exemplary embodiment, the vision welding robot has a welding torch, and the adjustment method of the vision welding robot may further include the following steps S410 to S450 .
步骤S410,控制摄像头运动以拍摄特征点;Step S410, controlling the movement of the camera to capture feature points;
步骤S420,当特征点位于摄像头所拍摄画面的中心时,记录摄像头在机器人基坐标系中的坐标;Step S420, when the feature point is located at the center of the picture captured by the camera, record the coordinates of the camera in the robot base coordinate system;
步骤S430,控制焊枪进行运动,以使焊枪移动至与特征点距离预设起弧距离的位置;Step S430, controlling the welding torch to move, so that the welding torch is moved to a position with a preset arc starting distance from the feature point;
步骤S440,获得焊枪在机器人基坐标系中的坐标;Step S440, obtaining the coordinates of the welding torch in the robot base coordinate system;
步骤S450,根据摄像头以及焊枪在机器人基坐标系中的坐标,确定焊枪与摄像头的偏置距离。Step S450: Determine the offset distance between the welding torch and the camera according to the coordinates of the camera and the welding torch in the robot base coordinate system.
视觉焊接机器人的调校过程还包括设置焊枪与摄像头的偏置距离。具体的,将焊缝特征点所在的位置为参考点,调整摄像头的位置,使摄像头在合适的范围内移动,最终实现该特征点位于该摄像头所拍摄画面的中心,当确定摄像头的位置之后,移动焊枪,使焊枪距离该特征点的距离为预设起弧距离。从而,得到焊枪和摄像头的偏置距离,以便于摄像头基于结构光原理对焊接过程进行拍摄。The adjustment process of the visual welding robot also includes setting the offset distance between the welding torch and the camera. Specifically, the position of the feature point of the welding seam is used as the reference point, and the position of the camera is adjusted to make the camera move within a suitable range, and finally the feature point is located in the center of the picture captured by the camera. After the position of the camera is determined, Move the welding torch so that the distance between the welding torch and the feature point is the preset arc starting distance. Thus, the offset distance between the welding torch and the camera is obtained, so that the camera can photograph the welding process based on the principle of structured light.
在另外的实施例中,特征点也可以位于摄像头所拍摄画面的最左侧或最右侧,可以由调校者根据具体情况具体设置,此处不进行限制。In another embodiment, the feature point may also be located at the far left or the far right of the picture captured by the camera, which may be specifically set by the adjuster according to the specific situation, which is not limited here.
需要说明的是,预设起弧距离、起弧电压和起弧电流都会影响该视觉焊接机器人的焊接效果。因此,在另外的实施例中,对视觉焊接机器人的调校过程还可以包含对起弧参数的设定,起弧参数包括起弧距离、起弧电压和起弧电流。It should be noted that the preset arc starting distance, arc starting voltage and arc starting current will all affect the welding effect of the visual welding robot. Therefore, in another embodiment, the adjustment process of the visual welding robot may further include the setting of arc starting parameters, and the arc starting parameters include arc starting distance, arc starting voltage and arc starting current.
图5是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图,在图4所述的视觉焊接机器人的调校方法的基础上,视觉焊接机器人具有多个轴,多个轴用于控制焊枪进行运动,在步骤S430之前,该方法还包括步骤S510和S520。Fig. 5 is a flowchart showing a method for adjusting a visual welding robot according to another exemplary embodiment. On the basis of the adjusting method for a visual welding robot described in Fig. 4, the visual welding robot has multiple axes, A plurality of axes are used to control the welding torch to move. Before step S430, the method further includes steps S510 and S520.
步骤S510,对焊枪的运动进行调试,在调试开始后第一时长,控制视觉焊接机器人的多个轴在第一限速下运行;Step S510, debug the motion of the welding torch, and control multiple axes of the visual welding robot to run at a first speed limit for a first time period after the debugging starts;
步骤S520,达到第一时长后,控制视觉焊接机器人的多个轴在第二限速下运行,第二限速大于第一限速。In step S520, after the first time period is reached, the axes of the visual welding robot are controlled to run at a second speed limit, and the second speed limit is greater than the first speed limit.
视觉焊接机器人具有多个轴,即,视觉焊接机器人是多轴机器人,多轴机器人是能够实现自动控制、可重复编程、多自由度、运动自由度建成空间直角关系的、多用途的操作机。按照操作机的轴数,多轴机器人可分为4轴、5轴、6轴等机器人。即分别能向4、5或6个方向自由移动。The visual welding robot has multiple axes, that is, the visual welding robot is a multi-axis robot, and the multi-axis robot is a multi-purpose manipulator that can realize automatic control, repeatable programming, multiple degrees of freedom, and movement degrees of freedom to establish a spatial right-angle relationship. According to the number of axes of the manipulator, multi-axis robots can be divided into 4-axis, 5-axis, 6-axis and other robots. That is, it can move freely in 4, 5 or 6 directions, respectively.
对视觉焊接机器人的调校过程还包括对各个轴的运动进行调试。The adjustment process of the vision welding robot also includes the adjustment of the movement of each axis.
具体的,在对各个轴的运动调试的初期,即在调试开始后第一时长,控制各个轴在第一限速下运行,随着随着调试的不断进行和调试结果的不断优化,各轴的速度可逐渐提高至第二限速。由此,可以实现提高设备的安全性,且保证调试人员安全,保证机器人本体和控制系统硬件在调试过程中不被损坏。Specifically, in the early stage of the motion debugging of each axis, that is, for the first time after the debugging starts, each axis is controlled to run at the first speed limit. With the continuous progress of debugging and the continuous optimization of debugging results, each axis The speed can be gradually increased to the second speed limit. In this way, the safety of the equipment can be improved, the safety of the debugging personnel can be ensured, and the robot body and the hardware of the control system are not damaged during the debugging process.
图6是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图,在图5所示的视觉焊接机器人的调校方法的基础上,在该实施例中,还可以包括步骤S610至步骤S650。Fig. 6 is a flowchart showing a method for adjusting a visual welding robot according to another exemplary embodiment. On the basis of the adjusting method for a visual welding robot shown in Fig. 5, in this embodiment, the Steps S610 to S650 are included.
步骤S610,控制焊枪根据焊缝轨迹进行模拟仿形焊接,得到焊枪的运动轨迹;Step S610, controlling the welding torch to perform simulated profiling welding according to the welding seam trajectory to obtain the motion trajectory of the welding torch;
步骤S620,比较焊枪的运动轨迹以及焊缝轨迹,得到第一比较结果;Step S620, comparing the motion trajectory of the welding torch and the welding seam trajectory to obtain a first comparison result;
步骤S630,控制焊枪根据焊缝轨迹进行焊接,以及控制摄像头与焊枪保持偏置距离拍摄的焊枪焊接的焊接轨迹;Step S630, controlling the welding torch to perform welding according to the welding seam track, and controlling the welding track of the welding torch welding captured by the camera and the welding torch at an offset distance;
步骤S640,根据焊接轨迹以及焊缝轨迹,得到第二比较结果;Step S640, obtaining a second comparison result according to the welding track and the welding seam track;
步骤S650,根据第一比较结果以及第二比较结果,确定对视觉焊接机器人调校的调校结果,若第一比较结果与第二比较均为匹配,则确定对视觉焊接机器人的调校结果为成功,若第一比较结果和第二比较结果中任一结果为不匹配,则确定对视觉焊接机器人的调校结果为失败。Step S650, according to the first comparison result and the second comparison result, determine the adjustment result for the adjustment of the visual welding robot, if both the first comparison result and the second comparison match, then determine that the adjustment result for the vision welding robot is: Success, if any of the first comparison result and the second comparison result does not match, it is determined that the adjustment result of the visual welding robot is a failure.
对视觉焊接机器人的调校过程还包括进行焊接测试。为了更好地观察视觉焊接机器人运行过程中运行情况和焊接过程中外界环境对焊接机器人表现性能的影响,焊接测试过程分为两个阶段。第一阶段,控制焊枪根据焊缝轨迹进行模拟仿形焊接,得到焊枪的运动轨迹,该运动轨迹是在不起弧的情况下,焊枪模拟焊接的运动轨迹,可以通过安装在焊枪上的位置传感器获得,也可以通过其他任意的方式获得,通过将该运动轨迹与焊缝轨迹进行比较,得到第一比较结果,通过对比较结果的分析,可以得到控制系统对焊枪的控制情况,若该运动轨迹与焊缝轨迹的查值小于预设值,则可确定控制系统可以对焊枪进行精准控制,以上,通过仿形焊接得到控制系统对焊接的控制效果,能够节约焊料。第二阶段是实际的焊接过程,通过摄像头记录实际焊接后,产生的焊接轨迹,既可以验证摄像头的调校结果,也可以验证实际焊接的效果,可以实现对视觉焊接机器人焊接过程的测试,通过测试结果还可以验证对该视觉焊接机器人调校效果。The adjustment process of the vision welding robot also includes the welding test. In order to better observe the operation of the visual welding robot and the influence of the external environment on the performance of the welding robot during the welding process, the welding test process is divided into two stages. In the first stage, the welding torch is controlled to simulate profiling welding according to the welding seam trajectory, and the motion trajectory of the welding torch is obtained. The motion trajectory is the motion trajectory of the welding torch to simulate welding without arcing. It can also be obtained by other arbitrary methods. By comparing the motion trajectory with the welding seam trajectory, the first comparison result can be obtained. By analyzing the comparison results, the control system of the welding torch can be obtained. If the motion trajectory If the check value of the welding seam trajectory is less than the preset value, it can be determined that the control system can accurately control the welding torch. Above, the control effect of the control system on welding can be obtained through profiling welding, which can save solder. The second stage is the actual welding process. After the actual welding is recorded by the camera, the generated welding trajectory can not only verify the adjustment result of the camera, but also the actual welding effect, and can realize the test of the welding process of the visual welding robot. The test results can also verify the adjustment effect of the vision welding robot.
图7是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图,在图5所示的视觉焊接机器人的调校方法的基础上,在步骤S510,对焊枪的运动进行调试之后,在该实施例中,还可以包括以下步骤:Fig. 7 is a flowchart showing a method for adjusting a visual welding robot according to another exemplary embodiment. On the basis of the adjusting method for a visual welding robot shown in Fig. 5, in step S510, the movement of the welding torch is adjusted. After debugging, in this embodiment, the following steps may also be included:
步骤S710,确认视觉焊接机器人的各个轴的运动是否平稳,以及确认焊枪的运动轨迹是否平滑;Step S710, confirming whether the motion of each axis of the visual welding robot is smooth, and confirming whether the motion trajectory of the welding torch is smooth;
步骤S720,当确定各个轴的运动平稳且焊枪的运动轨迹平滑后,根据焊缝轨迹、偏置距离对焊枪的焊接路径进行焊接工艺以及焊接路径的规划;Step S720, after determining that the motion of each axis is stable and the motion trajectory of the welding torch is smooth, plan the welding process and the welding path of the welding torch according to the welding seam trajectory and the offset distance;
步骤S730,若焊接工艺以及焊接路径的规划满足预设条件,则确定对视觉焊接机器人的焊接工艺以及焊接路径的调试结果为成功。Step S730, if the planning of the welding process and the welding path satisfy the preset conditions, it is determined that the debugging result of the welding process and the welding path of the visual welding robot is successful.
在该实施例中,基于前述方法,在对焊枪的运动进行调试之后,对该视觉焊接机器人的调试过程还可以包括确定视觉焊接机器人的各个轴运动是否平稳且确定焊枪的运动轨迹是否平滑,在确定视觉焊接机器人的各个轴运动平稳且焊枪的运动轨迹平滑后,可以通过控制系统的控制面板人工选择参数,或者根据传感器获得焊缝类型、工艺等数据,使用控制系统中的相应的模块进行图像处理,实现焊接工艺以及焊接路径的规划。In this embodiment, based on the aforementioned method, after the motion of the welding torch is debugged, the debugging process of the visual welding robot may further include determining whether the motion of each axis of the visual welding robot is smooth and determining whether the motion trajectory of the welding torch is smooth. After confirming that the motion of each axis of the visual welding robot is smooth and the motion trajectory of the welding torch is smooth, parameters can be manually selected through the control panel of the control system, or data such as welding seam type and process can be obtained according to the sensor, and the corresponding module in the control system can be used to image the image. Process, realize the welding process and the planning of the welding path.
图8是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图,在图1所示的视觉焊接机器人的调校方法的基础上,在步骤S120之前,在该实施例中,还可以包括以下步骤:Fig. 8 is a flow chart showing a method for adjusting a visual welding robot according to another exemplary embodiment. On the basis of the adjusting method for a visual welding robot shown in Fig. 1, before step S120, in this implementation In this example, the following steps may also be included:
步骤S810,拍摄多张待焊件图像;Step S810, photographing a plurality of images of the workpiece to be welded;
步骤S820,根据多张待焊件图像的图像信息,对摄像头进行调试,摄像头的调试包括确定曝光时间、确定采样频率、选定图像处理策略以及选定特征提取策略中的一种或多种。Step S820, debug the camera according to the image information of the multiple images of the workpiece to be welded. The debugging of the camera includes one or more of determining the exposure time, determining the sampling frequency, selecting an image processing strategy and selecting a feature extraction strategy.
对视觉焊接机器人的调试还包括对摄像头拍摄参数的调试,拍摄参数包括曝光时间、采样频率、图像处理策略以及特征提取策略中的一种或多种。具体的,可以采用不同曝光时间拍摄或者采用不同采样频率或不同的曝光时间和采用频率的组合拍摄待焊件的图像,将所拍摄的图像传输至控制系统,由控制系统根据图像质量标准确定最终的曝光时间和采样频率,再由不同的图像处理策略以及特征提取策略进行图像处理。以根据不同待焊件的特点、环境的亮度等确定摄像头的各个拍摄参数。The debugging of the visual welding robot also includes the debugging of the camera shooting parameters, and the shooting parameters include one or more of exposure time, sampling frequency, image processing strategy and feature extraction strategy. Specifically, different exposure times or combinations of different sampling frequencies or exposure times and frequencies can be used to photograph the image of the workpiece to be welded, and the photographed image is transmitted to the control system, which determines the final image according to the image quality standard. According to the exposure time and sampling frequency, different image processing strategies and feature extraction strategies are used for image processing. In order to determine the various shooting parameters of the camera according to the characteristics of different parts to be welded and the brightness of the environment.
图9是根据另一示例性实施例示出的一种视觉焊接机器人的调校方法的流程图,在图8所示的视觉焊接机器人的调校方法的基础上,在步骤S810之前,在该实施例中,还可以包括以下步骤:Fig. 9 is a flowchart showing a method for adjusting a visual welding robot according to another exemplary embodiment. On the basis of the adjusting method for a visual welding robot shown in Fig. 8, before step S810, in this implementation In this example, the following steps may also be included:
步骤S910,确认视觉焊接机器人的机器人本体的有无变形,以及确认视觉焊接机器人的电气控制安装连线是否正确以及有无松脱;Step S910, confirming whether the robot body of the visual welding robot is deformed, and confirming whether the electrical control installation connection of the visual welding robot is correct and whether it is loose;
步骤S920,若确定机器人本体无变形以及确认电气控制安装连线正确且无松脱,则拍摄多种待焊件图像。In step S920, if it is determined that the robot body is not deformed and that the electrical control installation wiring is correct and not loose, various images of the parts to be welded are captured.
在该实施例中,在拍摄多张待焊件图像之前,对该视觉焊接机器人的调试过程还可以包括确定该视觉焊接机器人的机器人本体的有无变形以及确认视觉焊接机器人的电气控制安装连线是否正确以及有无松脱,若确定机器人本体无变形以及确认电气控制安装连线正确且无松脱,则开始拍摄多张待焊件图像。In this embodiment, before taking a plurality of images of the workpiece to be welded, the debugging process of the visual welding robot may further include determining whether the robot body of the visual welding robot is deformed or not and confirming the electrical control installation connection of the visual welding robot Whether it is correct and whether it is loose, if it is confirmed that the robot body is not deformed and that the electrical control installation wiring is correct and not loose, start to take multiple images of the workpiece to be welded.
为便于理解,以下通过一个具体的视觉焊接机器人的调校流程,来说明本申请的发明构思。For ease of understanding, the following describes the inventive concept of the present application through a specific adjustment process of a visual welding robot.
图10是根据本申请的一个实施例的视觉焊接机器人的调校方法的流程图。如图10所示,在本实施例中,视觉焊接机器人的调校过程依次包括机器人本体调试1001、电气控制安装调试1002、摄像头采集调试1003、设置各轴工作行程范围1004、设置轴方向、脉冲向量1005、回机械原点1006、摄像头随动仿形与对中心调试1007、设置摄像头与焊枪的偏置距离1008、各个轴的速度调整1009、焊枪轨迹平滑1010、焊枪路径焊接工艺规划1011、给定起弧电压、起弧电流和起弧距离1012、焊接测试1013。FIG. 10 is a flowchart of a method for adjusting a vision welding robot according to an embodiment of the present application. As shown in Figure 10, in this embodiment, the adjustment process of the visual welding robot sequentially includes
其中,机器人本体调试1001,包括严格按照经方案设计、仿真分析和机械装配纸制造机械零部件,并对零部件进行装配,确保装配正确、牢固,没有缺少零部件,装配过程中没有出现撞击变形、损坏等情况,检查本体各部分丝杆、滑轨及齿条等润滑是否妥当,检查传动丝杆是否有卡死现象,保证各个轴运动方向无阻碍。若确定安装无误。机器人本体无变形,则进入下一步骤。Among them, the
电气控制安装调试1002,包括,检查各个电气元件的安装连线是否正确,有无接线松脱现象,各元器件间能否正常通讯;电气回路的连线是否正常,各保险限位安装和性能是否安全可靠,检查电气输出及设置是否正常;检查端子板输入信号指示LED灯,通过模拟干扰原点开关,若相应LED灯状态有变化,说明原点信号已送到端子板上,确保从端子板到焊接机器人驱动控制、限位、零点的接线正确,能大大缩短调试时间。通过上位机软件“端口”在线调试模块来确定各端口信号的传输是否正常,圆点为绿色时表示该信号此时有效,圆点红色表示该信号此时无效(没有输入或输出),若各个电气元件安装无误、无松脱,则进入下一步骤。Electrical control installation and
摄像头采集调试1003,包括,调试曝光时间、采样频率、图像处理方法和特征提出策略,使得到的焊缝信息更加准确,更好的应用于焊接控制。设置完成后,进入下一步骤。The camera acquisition and
设置各轴工作行程范围1004,包括,以视觉焊接机器人实际尺寸为依据,以使用软限位功能,设置各个轴的工作行程范围。设置完成后,进入下一步骤。Setting the working
设置轴方向、脉冲向量1005,包括,移动机器人各轴,确定各轴的运动方向是否正确,如果运动方向不正确,可以通过上位机修改轴方向1或-1,也可以设置伺服驱动器相关参数;越小脉冲当量,使控制的分辨率越高,而且脉冲当量的值直接影响最大的进给速度。Set the axis direction and
回机械原点1006,包括,若检测到预设位置信号,则确定视觉焊接机器人回到了机械原点,机械原点是机器人基坐标系的原点,预设位置信号是视觉焊接机器人回到机械原点时的位置信号。Returning to the
摄像头随动仿形与对中心调试1007,包括,获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点;获得焊缝轨迹的特征点在机器人基坐标系中的坐标;根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动;根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。Camera follow-up profiling and centering
设置摄像头与焊枪的偏置距离1008,包括,控制摄像头运动以拍摄特征点;当特征点位于摄像头所拍摄画面的中心时,记录摄像头在机器人基坐标系中的坐标;控制焊枪进行运动,以使焊枪移动至与特征点距离预设起弧距离的位置;获得焊枪在机器人基坐标系中的坐标;根据摄像头以及焊枪在机器人基坐标系中的坐标,确定焊枪与摄像头的偏置距离。Set the offset distance 1008 between the camera and the welding gun, including: controlling the camera to move to shoot the feature point; when the feature point is located in the center of the picture captured by the camera, record the coordinates of the camera in the robot base coordinate system; control the welding gun to move to make The welding torch is moved to the position with the preset arc starting distance from the feature point; the coordinates of the welding torch in the robot base coordinate system are obtained; the offset distance between the welding torch and the camera is determined according to the coordinates of the camera and the welding torch in the robot base coordinate system.
各个轴的速度调整1009,包括,对焊枪的运动进行调试,在调试开始后第一时长,控制视觉焊接机器人的多个轴在第一限速下运行;达到第一时长后,控制视觉焊接机器人的多个轴在第二限速下运行,第二限速大于第一限速。The
焊枪轨迹平滑1010,包括,根据焊缝轨迹的特定,设置焊枪初始路径,并通过平滑策略优化初始路径,以设置达到满足平滑条件的焊枪轨迹。The welding gun trajectory smoothing 1010 includes, according to the specific welding seam trajectory, setting the initial path of the welding gun, and optimizing the initial path through a smoothing strategy, so as to set the welding gun trajectory satisfying the smoothing condition.
焊枪路径焊接工艺规划1011,包括,根据焊缝的特征,如缝隙的宽度、热变形、坐标距离等因素,对焊枪的焊接路径以及焊接工艺进行规划调整。The welding process planning 1011 of the welding torch path includes planning and adjusting the welding path and welding process of the welding torch according to the characteristics of the welding seam, such as the width of the gap, thermal deformation, coordinate distance and other factors.
给定起弧电压、起弧电流和起弧距离1012,包括,在控制系统给定的起弧电压、起弧电流和起弧距离的基础上进行调试,以根据实际情况确定最终的起弧电压、起弧电流和起弧距离。Given the arcing voltage, arcing current and
焊接测试1013包括控制焊枪根据焊缝轨迹进行模拟仿形焊接,得到焊枪的运动轨迹;比较焊枪的运动轨迹以及焊缝轨迹,得到第一比较结果;控制焊枪根据焊缝轨迹进行焊接,以及控制摄像头与焊枪保持偏置距离拍摄的焊枪焊接的焊接轨迹;根据焊接轨迹以及焊缝轨迹,得到第二比较结果;根据第一比较结果以及第二比较结果,确定对视觉焊接机器人调校的调校结果。The
若第一比较结果与第二比较结果均为匹配,则确定对视觉焊接机器人的调校结果为成功,若第一比较结果和第二比较结果中任一结果为不匹配,则确定对视觉焊接机器人的调校结果为失败。If both the first comparison result and the second comparison result match, it is determined that the adjustment result of the visual welding robot is successful; The adjustment result of the robot is failed.
由此,可以实现保证调试人员安全,保证机器人本体和控制系统硬件在调试过程中不被损坏,节省焊接材料,降低成本,以及由慢到快的运动速度等方面加强设备的安全性。In this way, it is possible to ensure the safety of debugging personnel, ensure that the robot body and control system hardware are not damaged during the debugging process, save welding materials, reduce costs, and enhance the safety of the equipment in terms of slow-to-fast movement speed.
本申请一个实施例还示出了一种视觉焊接机器人,视觉焊接机器人包括:机器人本体;机器人本体具有多个轴;摄像头机构,具有摄像头,摄像头机构与机器人本体连接;焊接设备,与机器人本体连接,焊接设备包括焊枪;控制器,与机器人本体、摄像头机构以及焊接设备连接,用于控制摄像头机构以及焊接设备执行所前所述的视觉焊接机器人的调校方法的步骤。An embodiment of the present application also shows a visual welding robot. The visual welding robot includes: a robot body; the robot body has a plurality of axes; a camera mechanism has a camera, and the camera mechanism is connected to the robot body; a welding device is connected to the robot body , the welding equipment includes a welding torch; a controller, connected with the robot body, the camera mechanism and the welding equipment, is used to control the camera mechanism and the welding equipment to execute the steps of the aforementioned adjustment method of the visual welding robot.
图11是根据一示例性实施例示出的一种视觉焊接机器人的调校装置1100的框图,如图11所示,该视觉焊接机器人的调校装置包括同步单元1101、提取单元1102、获得单元1103、控制单元1104以及调校单元1105。FIG. 11 is a block diagram of a calibration device 1100 for a visual welding robot according to an exemplary embodiment. As shown in FIG. 11 , the calibration device for a visual welding robot includes a
同步单元1101,用于将视觉焊接机器人控制系统的控制坐标系与视觉焊接机器人的基坐标系同步;The
提取单元1102,用于获取摄像头采集的待焊件图像,以提取待焊件的图像中的焊缝轨迹,以及提取焊缝轨迹的特征点;The
获得单元1103,用于获得焊缝轨迹的特征点在机器人基坐标系中的坐标;Obtaining
控制单元1104,用于根据焊缝轨迹以及特征点在机器人基坐标系中的坐标,控制摄像头沿着焊缝轨迹进行运动;The
调校单元1105,用于根据摄像头沿着焊缝轨迹运动所拍摄的画面,调校视觉焊接机器人的摄像头的位置。The
需要说明的是,上述实施例所提供的装置与上述实施例所提供的方法属于同一构思,其中各个模块和单元执行操作的具体方式已经在方法实施例中进行了详细描述,此处不再赘述。It should be noted that the apparatus provided by the above embodiments and the methods provided by the above embodiments belong to the same concept, and the specific manners in which each module and unit perform operations have been described in detail in the method embodiments, which will not be repeated here. .
在另一示例性的实施例中,本申请还提供了一种视觉焊接机器人的调校设备,包括处理器和存储器,其中,存储器上存储有计算机可读指令,该计算机可读指令被处理器执行时实现如前所述的视觉焊接机器人的调校方法。In another exemplary embodiment, the present application also provides a calibration device for a visual welding robot, including a processor and a memory, wherein the memory stores computer-readable instructions, and the computer-readable instructions are processed by the processor When executed, the aforementioned adjustment method of the vision welding robot is implemented.
请参阅图12,图12是根据一示例性实施例示出的一种视觉焊接机器人的调校设备的硬件结构示意图。Please refer to FIG. 12 , which is a schematic diagram of a hardware structure of a calibration device for a visual welding robot according to an exemplary embodiment.
需要说明的是,该设备只是一个适配于本申请的示例,不能认为是提供了对本申请的使用范围的任何限制。该设备也不能解释为需要依赖于或者必须具有图12中示出的示例性的视觉焊接机器人的调校设备中的一个或者多个组件。It should be noted that this device is only an example adapted to the present application, and should not be considered as providing any limitation on the scope of use of the present application. Nor should the apparatus be construed as requiring one or more components in a tuning apparatus that relies on or must have the exemplary vision welding robot shown in FIG. 12 .
该设备的硬件结构可因配置或者性能的不同而产生较大的差异,如图12所示,该设备包括:电源1210、接口1230、至少一存储器1250、以及至少一中央处理器(CPU,CentralProcessing Units)1270。The hardware structure of the device may vary greatly due to different configurations or performances. As shown in FIG. 12 , the device includes: a
其中,电源1210用于为该设备上的各硬件设备提供工作电压。Among them, the
接口1230包括至少一有线或无线网络接口1231、至少一串并转换接口1233、至少一输入输出接口1235以及至少一USB接口1237等,用于与外部设备通信。The
存储器1250作为资源存储的载体,可以是只读存储器、随机存储器、磁盘或者光盘等,其上所存储的资源包括操作系统1251、应用程序1253或者数据1255等,存储方式可以是短暂存储或者永久存储。其中,操作系统1251用于管理与控制该设备上的各硬件设备以及应用程序1253,以实现中央处理器1270对数据1255的计算与处理,其可以是WindowsServerTM、Mac OS XTM、UnixTM、LinuxTM等。应用程序1253是基于操作系统1251之上完成至少一项特定工作的计算机程序,其可以包括至少一模块,每个模块都可以分别包含有对该设备的一系列计算机可读指令。The
中央处理器1270可以包括一个或多个以上的处理器,并设置为通过总线与存储器1250通信,用于运算与处理存储器1250中的数据1255。The
如上面所详细描述的,适用本申请的视觉焊接机器人的调校设备将通过中央处理器1270读取存储器1250中存储的一系列计算机可读指令的形式来完成如前所述的视觉焊接机器人的调校方法。As described in detail above, the adjustment equipment for the visual welding robot applicable to the present application will complete the aforementioned visual welding robot through the
此外,通过硬件电路或者硬件电路结合软件指令也能同样实现本申请,因此,实现本申请并不限于任何特定硬件电路、软件以及两者的组合。In addition, the present application can also be implemented by a hardware circuit or a hardware circuit combined with software instructions. Therefore, the implementation of the present application is not limited to any specific hardware circuit, software, or combination of the two.
在另一示例性的实施例中,本申请还提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如前所述的视觉焊接机器人的调校方法。该计算机可读存储介质可以是上述实施例中描述的视觉焊接机器人的调校设备中所包含的,也可以是单独存在,而未装配入该视觉焊接机器人的调校设备中。In another exemplary embodiment, the present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, realizes the aforementioned adjustment of the visual welding robot method. The computer-readable storage medium may be included in the adjustment device of the visual welding robot described in the above-mentioned embodiments, or may exist alone without being assembled into the adjustment device of the vision welding robot.
上述内容,仅为本申请的较佳示例性实施例,并非用于限制本申请的实施方案,本领域普通技术人员根据本申请的主要构思和精神,可以十分方便地进行相应的变通或修改,故本申请的保护范围应以权利要求书所要求的保护范围为准。The above contents are only preferred exemplary embodiments of the present application, and are not intended to limit the embodiments of the present application. Those of ordinary skill in the art can easily make corresponding changes or modifications according to the main concept and spirit of the present application. Therefore, the protection scope of this application shall be subject to the protection scope required by the claims.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515894.3A CN111673749B (en) | 2020-06-09 | 2020-06-09 | Adjustment method of vision welding robot and vision welding robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010515894.3A CN111673749B (en) | 2020-06-09 | 2020-06-09 | Adjustment method of vision welding robot and vision welding robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111673749A true CN111673749A (en) | 2020-09-18 |
| CN111673749B CN111673749B (en) | 2021-06-08 |
Family
ID=72435614
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010515894.3A Active CN111673749B (en) | 2020-06-09 | 2020-06-09 | Adjustment method of vision welding robot and vision welding robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111673749B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114289857A (en) * | 2022-01-25 | 2022-04-08 | 江西理工大学 | Method for automatically correcting travel path of stirring head of friction stir welding equipment |
| CN115042181A (en) * | 2022-06-30 | 2022-09-13 | 中船黄埔文冲船舶有限公司 | Multi-welding track generation method and system for intermediate assembly segmented robot |
| CN119457343A (en) * | 2024-11-01 | 2025-02-18 | 新乡航空工业(集团)有限公司 | A multi-layer filter element continuous automatic welding device and welding method |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5572102A (en) * | 1995-02-28 | 1996-11-05 | Budd Canada Inc. | Method and apparatus for vision control of welding robots |
| CN107876970A (en) * | 2017-12-13 | 2018-04-06 | 浙江工业大学 | A kind of robot multi-pass welding welding seam three-dimensional values and weld seam inflection point identification method |
| WO2018173655A1 (en) * | 2017-03-21 | 2018-09-27 | 株式会社神戸製鋼所 | Operating program correction method and welding robot system |
| US20190076949A1 (en) * | 2017-09-12 | 2019-03-14 | Autodesk, Inc. | Automated edge welding based on edge recognition |
| CN110524580A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of welding robot visual component and its measurement method |
| CN110539109A (en) * | 2019-08-28 | 2019-12-06 | 广东工业大学 | A robot automatic welding system and method based on single and binocular vision |
| CN110842351A (en) * | 2018-07-30 | 2020-02-28 | 发那科株式会社 | Robot system and calibration method |
| CN111055054A (en) * | 2020-01-13 | 2020-04-24 | 北京博清科技有限公司 | Welding seam identification method and device, welding robot and storage medium |
| CN111093876A (en) * | 2017-11-29 | 2020-05-01 | 林肯环球股份有限公司 | Method and system for using intelligent welding torch with position tracking in robot welding |
-
2020
- 2020-06-09 CN CN202010515894.3A patent/CN111673749B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5572102A (en) * | 1995-02-28 | 1996-11-05 | Budd Canada Inc. | Method and apparatus for vision control of welding robots |
| WO2018173655A1 (en) * | 2017-03-21 | 2018-09-27 | 株式会社神戸製鋼所 | Operating program correction method and welding robot system |
| US20190076949A1 (en) * | 2017-09-12 | 2019-03-14 | Autodesk, Inc. | Automated edge welding based on edge recognition |
| CN111093876A (en) * | 2017-11-29 | 2020-05-01 | 林肯环球股份有限公司 | Method and system for using intelligent welding torch with position tracking in robot welding |
| CN107876970A (en) * | 2017-12-13 | 2018-04-06 | 浙江工业大学 | A kind of robot multi-pass welding welding seam three-dimensional values and weld seam inflection point identification method |
| CN110842351A (en) * | 2018-07-30 | 2020-02-28 | 发那科株式会社 | Robot system and calibration method |
| CN110539109A (en) * | 2019-08-28 | 2019-12-06 | 广东工业大学 | A robot automatic welding system and method based on single and binocular vision |
| CN110524580A (en) * | 2019-09-16 | 2019-12-03 | 西安中科光电精密工程有限公司 | A kind of welding robot visual component and its measurement method |
| CN111055054A (en) * | 2020-01-13 | 2020-04-24 | 北京博清科技有限公司 | Welding seam identification method and device, welding robot and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114289857A (en) * | 2022-01-25 | 2022-04-08 | 江西理工大学 | Method for automatically correcting travel path of stirring head of friction stir welding equipment |
| CN115042181A (en) * | 2022-06-30 | 2022-09-13 | 中船黄埔文冲船舶有限公司 | Multi-welding track generation method and system for intermediate assembly segmented robot |
| CN119457343A (en) * | 2024-11-01 | 2025-02-18 | 新乡航空工业(集团)有限公司 | A multi-layer filter element continuous automatic welding device and welding method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111673749B (en) | 2021-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111673749A (en) | Adjustment method of vision welding robot and vision welding robot | |
| CN111331592A (en) | Tool center point correction device for robotic arm, method thereof, and robotic arm system | |
| CN104029008A (en) | System And Method For Aligning Two Work Pieces With Vision System In The Presence Of Occlusion | |
| JP2014510276A (en) | Vision inspection system with improved image clarity | |
| JP2019119027A (en) | Method of controlling robot system, and robot system | |
| JP2017535965A (en) | Inspection device and component mounting system having the same | |
| CN109448062A (en) | A kind of camera calibration method, apparatus, terminal device and storage medium | |
| CN114593695B (en) | Visual alignment method, system and electronic device | |
| CN214101601U (en) | Information processing system | |
| JP2019525191A (en) | Soldering quality inspection platform | |
| CN111993420A (en) | Fixed binocular vision 3D guide piece feeding system | |
| JP2007511075A (en) | Pick and place machine with improved settings and operating procedures | |
| US20240338886A1 (en) | Recording medium, display data generation apparatus, and display data generation method | |
| TW201828695A (en) | Picture alignment method and system used for projector projection picture test | |
| JP2015148507A (en) | Quality control system | |
| KR102449983B1 (en) | Printed assembly circuit board assembly inspection device | |
| WO2021044549A1 (en) | Position estimation method, position estimation system, and position estimation device | |
| JP5740648B2 (en) | Image measuring apparatus, autofocus control method, and autofocus control program | |
| CN118365713B (en) | Dynamic calibration method for random moving multi-camera | |
| CN111105109A (en) | Operation detection device, operation detection method, and operation detection system | |
| TWI537556B (en) | Printed circuit board assembly detection system and the detection method thereof | |
| CN102794771A (en) | Mechanical arm correction system and method | |
| JP2665227B2 (en) | Position correction device | |
| US8873030B2 (en) | Testing device, detection system, and automatic detection method thereof | |
| CN118817255A (en) | Vehicle light image function test system and test method based on lighting simulation HIL bench |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230421 Address after: 518000 Shenzhen national engineering laboratory building b1001-b1004, No. 20, Gaoxin South seventh Road, high tech Zone community, Yuehai street, Nanshan District, Shenzhen, Guangdong Patentee after: SHENZHEN CIMC SECURITY AND SMART TECHNOLOGY Co.,Ltd. Address before: Room 102, Block A, Phase II, Science and Technology Building, 1057 Nanhai Avenue, Shekou, Nanshan District, Shenzhen City, Guangdong Province, 518000 Patentee before: SHENZHEN CIMC SECURITY AND SMART TECHNOLOGY Co.,Ltd. Patentee before: CHINA INTERNATIONAL MARINE CONTAINERS (GROUP) Ltd. |
|
| TR01 | Transfer of patent right | ||
| PP01 | Preservation of patent right |
Effective date of registration: 20251205 Granted publication date: 20210608 |