[go: up one dir, main page]

WO2024094118A1 - Point cloud data processing method and apparatus, electronic device, and storage medium - Google Patents

Point cloud data processing method and apparatus, electronic device, and storage medium Download PDF

Info

Publication number
WO2024094118A1
WO2024094118A1 PCT/CN2023/129319 CN2023129319W WO2024094118A1 WO 2024094118 A1 WO2024094118 A1 WO 2024094118A1 CN 2023129319 W CN2023129319 W CN 2023129319W WO 2024094118 A1 WO2024094118 A1 WO 2024094118A1
Authority
WO
WIPO (PCT)
Prior art keywords
point cloud
data
plane
grid
height
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2023/129319
Other languages
French (fr)
Chinese (zh)
Inventor
彭显明
赵梦雨
姚奕轩
刘晓萍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SF Technology Co Ltd
SF Tech Co Ltd
Original Assignee
SF Technology Co Ltd
SF Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SF Technology Co Ltd, SF Tech Co Ltd filed Critical SF Technology Co Ltd
Publication of WO2024094118A1 publication Critical patent/WO2024094118A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75Determining position or orientation of objects or cameras using feature-based methods involving models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • G06T7/73Determining position or orientation of objects or cameras using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds

Definitions

  • the present application relates to the technical field of three-dimensional point cloud processing, and specifically to a point cloud data processing method, device, electronic device and storage medium.
  • 3D point cloud data is of great guiding significance for object detection such as volume measurement.
  • the amount of 3D point cloud data obtained based on sensor measurement or 3D imaging equipment is usually large. If filtering and 3D reconstruction are performed based on the full amount of 3D point cloud data, the processing efficiency will be low.
  • the full amount of collected point cloud data is usually downsampled, and then point cloud data filtering and reconstruction processing such as interference object recognition and boundary recognition are performed.
  • point cloud data filtering and reconstruction processing such as interference object recognition and boundary recognition
  • the inventors of the present application found in the actual application process that: on the one hand, downsampling the point cloud data will cause a large amount of original information to be lost; on the other hand, if downsampling is performed under the premise of ensuring that a certain amount of original information is not lost, the amount of data cannot be effectively reduced, and a large amount of downsampled point cloud data still needs to be processed, and the processing efficiency is difficult to effectively improve.
  • the present application provides a point cloud data processing method, device, electronic device and computer-readable storage medium, which can improve the processing efficiency of point cloud data on the basis of reducing the degree of loss of original data volume.
  • the present application provides a point cloud data processing method, comprising: projecting the original point cloud data of the area to be processed onto a preset gridded plane to obtain a projected point cloud of the original point cloud data; based on the height value and plane coordinates of each projection point in the projected point cloud, obtaining target structural data of the original point cloud data, wherein the target structural data includes the structural data of each plane grid into which the original point cloud data falls, the structural data of each plane grid includes the plane coordinates and the number of projection points of each plane grid, and the structural data of each plane grid also includes the point cloud curvature of each plane grid, the maximum point cloud height, the minimum point cloud height, the average point cloud height and at least one of the point cloud height variance values; performing point cloud processing based on the target structural data to obtain processed structural data of the original point cloud data; and restoring the processed structural data to obtain processed point cloud data of the original point cloud data.
  • the present application provides a point cloud data processing device, which includes: a first acquisition unit, which is used to project the original point cloud data of the area to be processed onto a preset gridded plane to obtain a projected point cloud of the original point cloud data; a second acquisition unit, which is used to acquire target structure data of the original point cloud data based on the height value and plane coordinates of each projection point in the projected point cloud, wherein the target structure data includes the structure data of each plane grid into which the original point cloud data falls, and the structure data of each plane grid includes the plane coordinates of each plane grid, the number of projection points, and the structure of each plane grid.
  • the data also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid; a processing unit is used to perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data; and a restoration unit is used to restore the processed structure data to obtain processed point cloud data of the original point cloud data.
  • the present application further provides an electronic device, comprising a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, any point cloud data processing method provided in the first aspect of the present application is executed.
  • the present application further provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the point cloud data processing method provided in the first aspect of the present application.
  • the present application processes the plane coordinates, the number of projection points, and at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid into the structural data of each plane grid.
  • the embodiments of the present application can improve the processing efficiency of point cloud data on the basis of reducing the degree of loss of the original data volume.
  • FIG1 is a schematic diagram of a scene of a point cloud data processing system provided in an embodiment of the present application.
  • FIG2 is a flow chart of an implementation of a point cloud data processing method provided in an embodiment of the present application.
  • FIG3 is a schematic diagram of a preset grid plane provided in an embodiment of the present application.
  • FIG4 is an exemplary flowchart of step 202 provided in an embodiment of the present application.
  • FIG5 is an exemplary flowchart of step 203 provided in an embodiment of the present application.
  • FIG6 is a schematic structural diagram of an implementation of a point cloud data processing device provided in an embodiment of the present application.
  • FIG. 7 is a schematic diagram of the structure of an implementation method of an electronic device provided in an embodiment of the present application.
  • first and second are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
  • the features defined as “first” and “second” may explicitly or implicitly include one or more of the features.
  • the meaning of “multiple” is two or more, unless otherwise clearly and specifically defined.
  • the present application provides a point cloud data processing method, device, electronic device and computer readable storage medium.
  • the point cloud data processing device can be integrated in an electronic device, which can be a server or a terminal.
  • the execution subject of the point cloud data processing method of the embodiment of the present application may be the point cloud data processing device provided in the embodiment of the present application, or various types of electronic devices such as a server device, a physical host or a user equipment (UE) integrated with the point cloud data processing device.
  • the point cloud data processing device may be implemented in hardware or software, and the UE may specifically be a terminal device such as a smart phone, a tablet computer, a laptop computer, a PDA, a handheld computer, a desktop computer or a personal digital assistant (PDA).
  • PDA personal digital assistant
  • the electronic device may work in a single operation mode, or in a device cluster mode.
  • the point cloud data processing method can be applied to the point cloud data processing system shown in FIG1 .
  • the point cloud data processing system includes a terminal 101 and a server 102.
  • the terminal 101 can be a device having both receiving and transmitting functions, that is, a device capable of performing two-way communication (receiving and transmitting) on a two-way communication link.
  • the terminal 101 can be, for example, one of the electronic devices such as a mobile phone, a tablet computer, a laptop computer, or a camera installed at a monitoring site for raw point cloud data collection, storage, and transmission.
  • the terminal 101 and the server 102 can communicate bidirectionally via a network.
  • the server 102 can be an independent server, or a server network or server cluster composed of servers, which includes but is not limited to computers, network hosts, a single network server, a set of multiple network servers, or multiple
  • a cloud server is composed of a large number of computers or network servers based on cloud computing.
  • FIG. 1 is only an application scenario applicable to the embodiment of the present application, and does not constitute a limitation on the application scenario of the embodiment of the present application.
  • Other application environments applicable to the embodiment of the present application may include more or fewer computer devices than those shown in FIG. 1.
  • FIG. 1 shows only one server 102, while in other application environments, the point cloud data processing system may also include one or more other servers, which are not specifically limited here.
  • the point cloud data processing system may also include a memory for storing data, such as storing original point cloud data.
  • scenario diagram of the point cloud data processing system shown in Figure 1 is merely an example.
  • the point cloud data processing system and scenario described in the embodiment of the present invention are intended to more clearly illustrate the technical solution of the embodiment of the present invention, and do not constitute a limitation on the technical solution provided by the embodiment of the present invention.
  • Ordinary technicians in this field can know that with the evolution of the point cloud data processing system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present invention is also applicable to similar technical problems.
  • the point cloud data processing method provided in the embodiment of the present application is introduced below.
  • an electronic device is used as an execution subject for illustration.
  • the execution subject will be omitted in the subsequent method embodiments.
  • FIG2 is a flowchart of an implementation of a point cloud data processing method provided in an embodiment of the present application. It should be noted that although a logical order is shown in the flowchart shown in FIG2 or other figures, in some cases, the steps shown or described may be performed in a different order than that shown here.
  • the point cloud data processing method provided in the embodiment of the present application may include steps 201 to 204 , which are specifically as follows.
  • Step 201 Project the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data.
  • the area to be processed refers to the area that needs to be processed by point cloud data, which can be a geographical area (such as a community, a business district, etc.), a pre-planned site area (such as a logistics transfer site, a warehouse, etc.), a local area of an object (for example, the compartment area on a truck, the deck area on a ship, etc.), etc.
  • point cloud data can be a geographical area (such as a community, a business district, etc.), a pre-planned site area (such as a logistics transfer site, a warehouse, etc.), a local area of an object (for example, the compartment area on a truck, the deck area on a ship, etc.), etc.
  • the original point cloud data refers to the collection of points formed by collecting point cloud data of the area to be processed through a three-dimensional imaging device. Furthermore, when the area to be processed is too large to collect all the point cloud data at one time, the original point cloud data of the area to be processed can be formed by multi-angle data collection and point cloud splicing.
  • the preset plane coordinate system is a coordinate system used to record the position of each projection point and each plane grid position.
  • the preset plane coordinate system can be a coordinate system composed of the X-axis and the Y-axis in the three-dimensional coordinate system of the original point cloud data, and a coordinate system composed of the Y-axis and the The coordinate system formed by the Z axis and the coordinate system formed by the X axis and the Z axis.
  • the coordinate system formed by the X axis and the Y axis (abbreviated as the XY coordinate system) is exemplarily used as the preset plane coordinate system in this embodiment.
  • the preset gridded plane refers to a plane obtained by gridding the plane where the preset plane coordinate system is located.
  • the size of the preset gridded plane can be limited.
  • the projected point cloud refers to a set of projection points obtained after each point in the original point cloud data is projected onto a preset grid plane.
  • the projection point of each point in the original point cloud data in the preset gridding plane can be obtained, thereby obtaining the projected point cloud of the original point cloud data (as represented by the curve area in FIG3 ).
  • this article takes "using the coordinates of the upper left corner point of each plane grid to represent the plane coordinates of each plane grid" as an example for explanation.
  • Step 202 Based on the height value and plane coordinates of each projection point in the projected point cloud, obtain the target structure data of the original point cloud data.
  • the target structural data includes the structural data of each plane grid into which the original point cloud data falls, and the structural data of each plane grid includes the plane coordinates and the number of projection points of each plane grid, and also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid.
  • each point in the original point cloud data has obtained its coordinate value in the three-dimensional coordinate system when it is collected, so the height of the original point corresponding to each projection point (that is, the coordinate value on the Z axis) can be directly used as the height value of each projection point.
  • the set of plane grids that the original point cloud data falls into is defined as the falling grid set, which specifically refers to the set of grids where the projected point cloud is located in each grid of the preset grid plane after the original point cloud data is projected onto the preset grid plane.
  • each plane grid that falls into the grid set is each plane grid that the original point cloud data falls into.
  • the target structural data is a set including structural data of each plane grid falling into the grid set. Therefore, the target structural data can be obtained by acquiring the structural data of each plane grid falling into the grid set.
  • step 202 can specifically include the following steps 2021A to 2022A:
  • Step 2021A based on the height value and plane coordinates of each projection point in the projected point cloud, obtain the plane coordinates, number of projection points, point cloud curvature, maximum point cloud height, minimum point cloud height, average point cloud height and point cloud height variance value of each plane grid.
  • each plane grid includes multiple points, for all plane grids, it is necessary to uniformly record the coordinates of each plane grid at the same position (such as the upper left corner point, lower left corner point, upper right corner point, or lower right corner point of the grid, etc.) as the plane coordinates of each plane grid, so as to accurately record the plane coordinates of each plane grid.
  • the plane coordinates of each plane grid can be obtained by the following steps A1 to A3:
  • the first coordinate axis and the second coordinate axis can be the X-axis and the Y-axis respectively.
  • the preset grid coordinate system is a coordinate system used to indicate the position of each plane grid. As shown in Figure 3, for ease of understanding, the preset grid coordinate system is represented by a coordinate system consisting of the h-axis and the w-axis, and the directions of the h-axis and the w-axis are respectively the same as the directions of the X-axis and the Y-axis of the preset plane coordinate system.
  • the point cloud curvature of each plane grid can be determined directly based on the target projection points in each plane grid. For example, first, referring to the aforementioned method, according to the grid coordinates of each plane grid and the plane coordinates of each projection point in the preset plane coordinate system, the set composed of all target projection points located in each plane grid is determined as the target projection point cloud of the plane grid. Then, in combination with the three-dimensional coordinates corresponding to the target projection point cloud of each plane grid, the surface composed of the target projection point cloud in each plane is calculated. Finally, based on the surface composed of the target projection point cloud in each plane, the curvature at the same position (such as the upper left corner point) in each plane grid is calculated as the point cloud curvature of each plane grid.
  • the projection point is the point obtained by projecting the original point cloud data onto the preset grid plane, so the 3D coordinates corresponding to the projection point are the 3D coordinates of the point corresponding to the target projection point in the original point cloud data.
  • the plane coordinates of the projection point are (2,3), and the 3D coordinates corresponding to the projection point are also (2,3,4).
  • the curvature of each plane mesh may also be determined based on the projected point cloud. For example, first, the three-dimensional coordinates of each projection point in the projected point cloud are combined to calculate the surface formed by the projected point cloud. Then, based on the surface formed by the projected point cloud, the curvature at the same position (such as the upper left corner point) in each plane mesh is calculated as the point cloud curvature of each plane mesh.
  • the target projection point cloud of each plane grid is determined according to the grid coordinates of each plane grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the maximum height value is found as the maximum height value of the point cloud of the plane grid.
  • the target projection points in the first plane grid are point 1, point 2, point 3, point 4, and point 5, and the corresponding height values are 0.1m, 0.2m, 0.3m, 0.4m, and 0.5m, respectively.
  • the maximum point cloud height in the first plane grid is 0.5m.
  • the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the minimum height value is found as the minimum point cloud height value of the plane grid.
  • the target projection point clouds in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively. Then the minimum point cloud height value in the first plane grid is 0.1 meters.
  • the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the average height of the target projection points in each plane grid is counted as the average height of the point cloud of each plane grid.
  • the target projection points in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively. Then, the average height of the point cloud in the first plane grid is 0.3 meters.
  • the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the height value variance of the target projection point in the plane grid is calculated as the point cloud height variance value of the plane grid.
  • the target projection points in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively.
  • the point cloud height variance value in the first plane grid is 0.22.
  • Step 2022A according to the preset data storage format, the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid are stored to obtain the structural data of each plane grid.
  • the plane coordinates, number of projection points, point cloud curvature, maximum point cloud height, minimum point cloud height, average point cloud height, and point cloud height variance of each plane grid can be stored in the preset data format [X, Y, Zmin, Zmax, Zmean, Zstd, Num, Cur], that is, [X-axis coordinate value of plane coordinates, Y-axis coordinate value of plane coordinates, minimum point cloud height
  • the point cloud height value, the maximum value of the point cloud height, the average value of the point cloud height, the variance value of the point cloud height, the number of projection points, and the point cloud curvature are stored as the structural data of each plane grid.
  • an M*N*K data matrix can be obtained as the target structure data.
  • M and N are the number of grids in the X-axis direction and the number of grids in the Y-axis direction in the grid set, respectively.
  • each plane grid can be obtained based on at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid.
  • step 202 may specifically include the following steps: based on the plane coordinates of each projection point, obtaining the target projection point of each plane grid; based on the height value of the target projection point, obtaining the point cloud height variance value of each plane grid; based on the height value of the target projection point, obtaining the point cloud curvature of each plane grid; based on the point cloud height variance value and the point cloud curvature of each plane grid, forming the structural data of each plane grid to obtain the target structural data.
  • the plane coordinates, number of projection points, point cloud curvature and point cloud height variance of each plane grid can be stored in a preset data storage format [X, Y, Zstd, Num, Cur], i.e. [X-axis coordinate value of plane coordinates, Y-axis coordinate value of plane coordinates, point cloud height variance value, number of projection points, point cloud curvature] as the structural data of each plane grid.
  • Step 203 Perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data.
  • the processed structural data refers to the structural data obtained after using the target structural data to perform point cloud processing such as boundary recognition, interference recognition, and interference filtering.
  • a plane grid is stored as a structural data, and a plane grid contains multiple projection points
  • the point cloud data including multiple points that originally need to be processed separately can be compressed into one structural data.
  • this embodiment can realize batch processing of multiple points in the point cloud by processing one structural data, thereby improving the processing efficiency of point cloud processing processes such as boundary recognition, interference recognition, and interference filtering, and realizing efficient processing of point clouds.
  • point cloud processing processes such as boundary recognition, interference recognition, and interference filtering
  • the original point cloud data can be first stored as target structural data, and then the above processing is performed based on the target structural data, thereby reducing the amount of data processing.
  • the processed structural data is interference point structural data.
  • the structural data of each plane grid at least includes the point cloud curvature and point cloud height variance value of each plane grid.
  • Step 203 may specifically include: traversing each plane grid where the original point cloud data falls, detecting the point cloud curvature of the current plane grid; detecting the point cloud height variance value of the current plane grid; if the point cloud curvature of the current plane grid is greater than a preset curvature threshold and the point cloud height variance value is greater than a preset variance threshold, then determining the structural data of the current plane grid as the interference point structural data of the original point cloud data.
  • the target structural data includes the structural data of grid 1, the structural data of grid 2, ..., the structural data of grid 100.
  • grid 1, grid 2, ..., grid 100 can be traversed to detect the point cloud curvature and point cloud height variance value of the current plane grid (such as grid 1). If the point cloud curvature of the current plane grid (such as 0.5) is greater than the preset curvature threshold (such as 0.3) and the point cloud height variance value of the current plane grid (such as 1) is greater than the preset variance threshold (such as 0.5), the current plane grid (such as grid 1) can be used as the interference point structural data of the original point cloud data.
  • the current plane grid such as grid 1 can be used as the interference point structural data of the original point cloud data.
  • the interference point is identified by setting a preset curvature threshold and a preset variance threshold, which can improve the recognition accuracy of the interference point.
  • the interference point is identified in units of structural data of each plane grid, there is no need to process each point in the original point cloud data separately, which can improve the recognition speed of interference points (such as walls, vehicles, columns, etc. in the scene of man-made interference objects for non-bulk goods in the positioning warehouse).
  • the processed structural data is the boundary structural data.
  • the structural data of each plane grid at least includes the average point cloud height of each plane grid.
  • Step 203 may specifically include the following steps: traverse each plane grid where the original point cloud data falls, and obtain the difference between the average point cloud height of the current plane grid and the average point cloud height of the adjacent plane grids of the current plane grid; if the difference is greater than a preset difference threshold, the structural data of the current plane grid is used as the boundary structural data of the original point cloud data.
  • the adjacent plane grid can be a plane grid that falls into the grid set and is adjacent to the current plane grid in the h-axis direction; or a plane grid that falls into the grid set and is adjacent to the current plane grid in the w-axis direction; or a plane grid that falls into the grid set and is adjacent to the current plane grid in one of the h-axis and w-axis directions.
  • the target structure data includes the structure data of grid 1, the structure data of grid 2, ..., the structure data of grid 100.
  • grid 1, grid 2, ..., grid 100 can be traversed to detect the average point cloud height of the current plane grid (such as grid 1) and the average point cloud height of the adjacent plane grid (such as grid 2). If the difference (such as 0.5) between the average point cloud height of the current plane grid (such as grid 1) and the adjacent plane grid (such as grid 2) is greater than the preset difference threshold If the value (such as 0.3) is set, the current plane grid (such as grid 1) can be used as the boundary structure data of the original point cloud data. Similarly, when the traversal of grid 1, grid 2, ..., grid 100 is completed, all the boundary structure data of the original point cloud data can be obtained.
  • the structural data of the current plane grid can be used as the boundary structural data of the original point cloud data.
  • the recognition accuracy of the boundary point can be improved by setting a preset difference threshold between the average value of the point cloud height and the average value of the point cloud height of the adjacent plane grid to identify the boundary point.
  • the recognition speed of the boundary point (such as the boundary point between the interference object such as the wall, vehicle, column and the target object (i.e., bulk cargo) in the scene of the artificial interference object of non-bulk cargo in the positioning warehouse) can be improved.
  • the processed structural data is the filtered structural data.
  • step 203 may specifically include the following steps 2031C to 2034C:
  • Step 2031C identify interference points based on the target structure data to obtain interference point structure data of the original point cloud data.
  • Step 2032C perform boundary point recognition based on the target structure data to obtain boundary structure data of the original point cloud data.
  • steps 2031C to 2032C may refer to the relevant descriptions in the above-mentioned implementation methods, and will not be repeated here.
  • Step 2033C Based on the interference point structure data and the boundary structure data, interference area identification is performed to obtain interference structure data of the original point cloud data.
  • the interference point structure data and boundary structure data can be used as seed points
  • point cloud processing methods such as clustering and region generation can be used to identify interference objects (such as man-made objects such as vehicles, walls, and columns in warehouses other than goods) to determine the interference object structure data of the original point cloud data.
  • Step 2034C filter out the interference structure data from the target structure data to obtain filtered structure data of the original point cloud data.
  • the target structural data includes the structural data of grid 1, the structural data of grid 2, ..., the structural data of grid 100.
  • the structural data of grid 1, grid 2, grid 5, and grid 6 are identified as interference structural data.
  • the structural data of grid 1, grid 2, grid 5, and grid 6 can be filtered out from the target structural data to obtain the filtered structural data of the original point cloud data.
  • the interference points may be filtered.
  • the interference point structure data obtained in the above steps may be filtered out from the target structure data to obtain filtered structure data of the original point cloud data.
  • the interference points may be filtered.
  • the boundary structure data obtained in the above steps may be filtered out from the target structure data to obtain filtered structure data of the original point cloud data.
  • boundary points are identified based on the structural data of each plane grid, there is no need to process each point in the original point cloud data separately, which can improve the filtering speed of interference objects (such as walls, vehicles, columns and other interference objects in the scene of non-bulk man-made interference objects in the positioning warehouse), interference points, and boundary points.
  • interference objects such as walls, vehicles, columns and other interference objects in the scene of non-bulk man-made interference objects in the positioning warehouse
  • Step 204 restore the processed structural data to obtain processed point cloud data of the original point cloud data.
  • the processed point cloud data refers to the point cloud data obtained after performing point cloud processing processes such as boundary recognition, interference recognition, and interference filtering on the original point cloud data based on the target structure data.
  • the structural data of each plane grid in the processed structural data can be regenerated under the condition that the newly generated point cloud of each plane grid conforms to the point cloud curvature, the maximum value of the point cloud height, the minimum value of the point cloud height, the average value of the point cloud height, and the variance value of the point cloud height of the grid, and the number of newly generated points of each plane grid is equal to the number of projection points of the grid.
  • the newly generated point cloud of each plane grid in the processed structural data constitutes the processed point cloud data of the original point cloud data.
  • FIG6 is a schematic diagram of a structure of an implementation method of the point cloud data processing device provided in the embodiment of the present application. As shown in FIG6, the point cloud data processing device 600 includes:
  • the first acquisition unit 601 is used to project the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data;
  • a second acquisition unit 602 is used to acquire target structural data of the original point cloud data based on the height value and plane coordinates of each projection point in the projected point cloud, wherein the target structural data includes structural data of each plane grid into which the original point cloud data falls, the structural data of each plane grid includes the plane coordinates of each plane grid and the number of projection points, and the structural data of each plane grid also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid;
  • a processing unit 603 is used to perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data;
  • the restoration unit 604 is used to restore the processed structural data to obtain processed point cloud data of the original point cloud data.
  • the processed structural data includes interference point structural data
  • the structural data of each plane grid includes the point cloud curvature and point cloud height variance value of each plane grid.
  • the processing unit 603 is specifically used to: traverse each plane grid where the original point cloud data falls, detect the point cloud curvature of the current plane grid; detect the point cloud height variance value of the current plane grid; if the point cloud curvature of the current plane grid is greater than a preset curvature threshold and the point cloud height variance value is greater than a preset variance threshold, then determine the structural data of the current plane grid as the interference point structural data of the original point cloud data.
  • the processed structural data includes boundary structural data
  • the structural data of each plane grid includes the average point cloud height of each plane grid.
  • the processing unit 603 is specifically used to: traverse each plane grid where the original point cloud data falls, obtain the difference between the average point cloud height of the current plane grid and the average point cloud height of the adjacent plane grids of the current plane grid; if the difference is greater than a preset difference threshold, use the structural data of the current plane grid as the boundary structural data of the original point cloud data.
  • the processed structural data includes filtered structural data.
  • the processing unit 603 is specifically used to: identify interference points based on the target structural data to obtain interference point structural data of the original point cloud data; identify boundary points based on the target structural data to obtain boundary structural data of the original point cloud data; identify interference object regions based on the interference point structural data and boundary structural data to obtain interference object structural data of the original point cloud data; and filter out the interference object structural data from the target structural data to obtain filtered structural data of the original point cloud data.
  • the processed structural data includes filtered structural data.
  • the processing unit 603 is specifically used to: identify interference points based on the target structural data to obtain interference point structural data of the original point cloud data; and filter the interference point structural data from the target structural data to obtain filtered structural data of the original point cloud data;
  • boundary point recognition is performed based on the target structure data to obtain boundary structure data of the original point cloud data; and the boundary structure data is filtered out from the target structure data to obtain filtered structure data of the original point cloud data.
  • the second acquisition unit 602 is specifically used to: acquire the target projection point of each plane grid based on the plane coordinates of each projection point; count the number of target projection points of each plane grid as the projection of each plane grid; The number of points; based on the height value of the target projection point, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid are obtained; according to the preset data storage format, the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid are stored to form the structural data of each plane grid and obtain the target structural data.
  • the second acquisition unit 602 is specifically used to: obtain the minimum value of the first coordinate axis of each plane grid in the preset plane coordinate system; obtain the minimum value of the second coordinate axis of each plane grid in the preset plane coordinate system; based on the minimum value of the first coordinate axis and the minimum value of the second coordinate axis, obtain the plane coordinates of each plane grid.
  • the point cloud data processing device 600 provided in the embodiment of the present application can bring the following technical effects: by processing the plane coordinates, the number of projection points, and at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid into the structural data of each plane grid, on the one hand, it is possible to compress multiple point clouds in each plane grid to obtain target structural data, so that the amount of data processing can be reduced when the target structural data is used for subsequent processing, thereby improving the processing efficiency of the point cloud processing process; on the other hand, since the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid can reflect the point cloud distribution in each plane grid, when restoring the processed structural data, a point cloud that matches the distribution of the original point cloud data can be accurately and completely obtained. Therefore, the processing efficiency of point cloud data can be improved on the basis of reducing the degree of loss of the original data volume.
  • the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities.
  • the specific implementation methods and effects of the above units can refer to the corresponding contents in the previous method embodiments, which will not be repeated here.
  • an embodiment of the present application also provides an electronic device, which may be a terminal device such as a smart phone, a tablet computer, a laptop computer, a touch screen, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA), etc.
  • a terminal device such as a smart phone, a tablet computer, a laptop computer, a touch screen, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA), etc.
  • FIG7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • the electronic device 700 includes a processor 701 having one or more processing cores, a memory 702 having one or more computer-readable storage media, and a computer program stored in the memory 702 and executable on the processor.
  • the processor 701 is electrically connected to the memory 702.
  • the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.
  • the processor 701 is the control center of the electronic device 700. It uses various interfaces and lines to connect various parts of the entire electronic device 700, executes various functions of the electronic device 700 and processes data by running or loading software programs and/or modules stored in the memory 702, and calling data stored in the memory 702, thereby monitoring the electronic device 700 as a whole.
  • the processor 701 in the electronic device 700 will load instructions corresponding to the processes of one or more applications into the memory 702 in accordance with the steps of any point cloud data processing method provided in the present application, and the processor 701 will run the application stored in the memory 702, thereby implementing the specific process of the above-mentioned point cloud data processing method.
  • the electronic device 700 further includes: a touch screen 703, a radio frequency circuit 704, an audio circuit 705, an input unit 706, and a power supply 707.
  • the processor 701 is electrically connected to the touch screen 703, the radio frequency circuit 704, the audio circuit 705, the input unit 706, and the power supply 707.
  • the electronic device structure shown in FIG7 does not limit the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.
  • the touch display screen 703 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface.
  • the touch display screen 703 may include a display panel and a touch panel.
  • the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, which can be composed of graphics, text, icons, videos and any combination thereof.
  • the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode), etc.
  • LCD liquid crystal display
  • OLED Organic Light-Emitting Diode
  • the touch panel can be used to collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute the corresponding program.
  • the touch panel may include two parts: a touch detection device and a touch controller.
  • the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller;
  • the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 701, and can receive the command sent by the processor 701 and execute it.
  • the touch panel can cover the display panel.
  • the touch panel When the touch panel detects a touch operation on or near it, it is transmitted to the processor 701 to determine the type of touch event, and then the processor 701 provides a corresponding visual output on the display panel according to the type of touch event.
  • the touch panel and the display panel can be integrated into the touch display screen 703 to realize the input and output functions.
  • the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 703 can also be used as a part of the input unit 706 to realize the input function.
  • the radio frequency circuit 704 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals with the network device or other electronic devices.
  • the audio circuit 705 can be used to provide an audio interface between the user and the electronic device through a speaker and a microphone.
  • the audio circuit 705 can convert the received audio data into an electrical signal and transmit it to the speaker, which converts it into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 705 and converted into audio data.
  • the audio data is then processed by the processor 701 and sent to another electronic device, or to another electronic device, through the radio frequency circuit 704.
  • the audio circuit 705 may also include an earplug jack to provide communication between an external headset and the electronic device.
  • the input unit 706 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
  • user feature information such as fingerprint, iris, facial information, etc.
  • the power supply 707 is used to supply power to various components of the electronic device 700.
  • the power supply 707 can be logically connected to the processor 701 through a power management system, so that the power management system can manage charging, discharging, and power consumption.
  • the power supply 707 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
  • the electronic device 700 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail herein.
  • an embodiment of the present application provides a computer-readable storage medium, in which multiple computer programs are stored.
  • the computer programs can be loaded by a processor to execute the steps in any point cloud data processing method provided in the embodiment of the present application.
  • the computer readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or CD, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)

Abstract

The present application provides a point cloud data processing method and apparatus, an electronic device, and a computer readable storage medium. The point cloud data processing method comprises: projecting original point cloud data of an area to be processed to a preset gridded plane to obtain a projected point cloud; obtaining target structure data of the original point cloud data on the basis of the height value and plane coordinates of each projected point, the target structure data comprising structure data of each plane grid, and the structure data comprising at least one of the plane coordinates, the number of projected points, point cloud curvature, a point cloud height maximum value, a point cloud height minimum value, a point cloud height average value and a point cloud height variance value; performing point cloud processing on the basis of the target structure data to obtain processed structure data of the original point cloud data; and restoring the processed structure data to obtain processed point cloud data of the original point cloud data. The present application reduces the degree of loss of an original data volume and improves the processing efficiency of point cloud data.

Description

点云数据处理方法、装置、电子设备及存储介质Point cloud data processing method, device, electronic device and storage medium 技术领域Technical Field

本申请涉及三维点云处理技术领域,具体涉及一种点云数据处理方法、装置、电子设备及存储介质。The present application relates to the technical field of three-dimensional point cloud processing, and specifically to a point cloud data processing method, device, electronic device and storage medium.

发明背景Background of the Invention

三维点云数据对如体积测量等物体检测有重要指导意义。然而,通常基于传感器测量或三维成像设备得到的三维点云数据的数据量较大,如果依据全量的三维点云数据进行滤波和三维重建处理,将导致处理效率较低。3D point cloud data is of great guiding significance for object detection such as volume measurement. However, the amount of 3D point cloud data obtained based on sensor measurement or 3D imaging equipment is usually large. If filtering and 3D reconstruction are performed based on the full amount of 3D point cloud data, the processing efficiency will be low.

现有技术中,为了提高数据处理效率,通常将采集到的全量点云数据进行降采样,然后再进行如干扰物识别、边界识别等点云数据滤波和重建处理。然而,本申请发明人在实际应用过程中发现:一方面,对点云数据进行降采样会导致大量的原始信息丢失;另一方面,如果在保障一定原始信息不丢失的前提下进行降采样,则无法有效降低数据量,仍需对大量降采样后的点云数据进行处理,处理效率难以有效提高。In the prior art, in order to improve data processing efficiency, the full amount of collected point cloud data is usually downsampled, and then point cloud data filtering and reconstruction processing such as interference object recognition and boundary recognition are performed. However, the inventors of the present application found in the actual application process that: on the one hand, downsampling the point cloud data will cause a large amount of original information to be lost; on the other hand, if downsampling is performed under the premise of ensuring that a certain amount of original information is not lost, the amount of data cannot be effectively reduced, and a large amount of downsampled point cloud data still needs to be processed, and the processing efficiency is difficult to effectively improve.

发明内容Summary of the invention

本申请提供一种点云数据处理方法、装置、电子设备及计算机可读存储介质,可以在降低原始数据量丢失程度的基础上,提高点云数据的处理效率。The present application provides a point cloud data processing method, device, electronic device and computer-readable storage medium, which can improve the processing efficiency of point cloud data on the basis of reducing the degree of loss of original data volume.

第一方面,本申请提供一种点云数据处理方法,包括:将待处理区域的原始点云数据投影至预设网格化平面,得到原始点云数据的投影点云;基于投影点云中每个投影点的高度值和平面坐标,获取原始点云数据的目标结构数据,其中,目标结构数据包括原始点云数据所落入的每个平面网格的结构数据,每个平面网格的结构数据包括每个平面网格的平面坐标、投影点个数,每个平面网格的结构数据还包括每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值中的至少一者;基于目标结构数据进行点云处理,得到原始点云数据的处理后结构数据;对处理后结构数据进行还原,得到原始点云数据的处理后点云数据。In a first aspect, the present application provides a point cloud data processing method, comprising: projecting the original point cloud data of the area to be processed onto a preset gridded plane to obtain a projected point cloud of the original point cloud data; based on the height value and plane coordinates of each projection point in the projected point cloud, obtaining target structural data of the original point cloud data, wherein the target structural data includes the structural data of each plane grid into which the original point cloud data falls, the structural data of each plane grid includes the plane coordinates and the number of projection points of each plane grid, and the structural data of each plane grid also includes the point cloud curvature of each plane grid, the maximum point cloud height, the minimum point cloud height, the average point cloud height and at least one of the point cloud height variance values; performing point cloud processing based on the target structural data to obtain processed structural data of the original point cloud data; and restoring the processed structural data to obtain processed point cloud data of the original point cloud data.

第二方面,本申请提供一种点云数据处理装置,点云数据处理装置包括:第一获取单元,用于将待处理区域的原始点云数据投影至预设网格化平面,得到原始点云数据的投影点云;第二获取单元,用于基于投影点云中每个投影点的高度值和平面坐标,获取原始点云数据的目标结构数据,其中,目标结构数据包括原始点云数据所落入的每个平面网格的结构数据,每个平面网格的结构数据包括每个平面网格的平面坐标、投影点个数,每个平面网格的结构 数据还包括每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值中的至少一者;处理单元,用于基于目标结构数据进行点云处理,得到原始点云数据的处理后结构数据;还原单元,用于对处理后结构数据进行还原,得到原始点云数据的处理后点云数据。In a second aspect, the present application provides a point cloud data processing device, which includes: a first acquisition unit, which is used to project the original point cloud data of the area to be processed onto a preset gridded plane to obtain a projected point cloud of the original point cloud data; a second acquisition unit, which is used to acquire target structure data of the original point cloud data based on the height value and plane coordinates of each projection point in the projected point cloud, wherein the target structure data includes the structure data of each plane grid into which the original point cloud data falls, and the structure data of each plane grid includes the plane coordinates of each plane grid, the number of projection points, and the structure of each plane grid. The data also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid; a processing unit is used to perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data; and a restoration unit is used to restore the processed structure data to obtain processed point cloud data of the original point cloud data.

第三方面,本申请还提供一种电子设备,电子设备包括处理器和存储器,存储器中存储有计算机程序,处理器调用存储器中的计算机程序时执行本申请上述第一方面提供的任一种点云数据处理方法。In a third aspect, the present application further provides an electronic device, comprising a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, any point cloud data processing method provided in the first aspect of the present application is executed.

第四方面,本申请还提供一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器进行加载,以执行本申请上述第一方面提供的点云数据处理方法。In a fourth aspect, the present application further provides a computer-readable storage medium on which a computer program is stored, and the computer program is loaded by a processor to execute the point cloud data processing method provided in the first aspect of the present application.

本申请通过将每个平面网格的平面坐标、投影点个数,以及每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者处理为每个平面网格的结构数据,一方面,可以实现对每个平面网格内的多个点云进行压缩得到目标结构数据,使得后续使用目标结构数据进行处理时可以减少数据处理量,进而提高点云处理过程的处理效率;另一方面,由于每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值可以反映每个平面网格内的点云分布情况,因此对处理后结构数据进行还原时,可以准确、完整地得到与原始点云数据分布匹配的点云。由此,本申请的实施例可以在降低原始数据量丢失程度的基础上,提高点云数据的处理效率。The present application processes the plane coordinates, the number of projection points, and at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid into the structural data of each plane grid. On the one hand, it can compress multiple point clouds in each plane grid to obtain target structural data, so that the amount of data processing can be reduced when the target structural data is used for subsequent processing, thereby improving the processing efficiency of the point cloud processing process; on the other hand, since the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid can reflect the point cloud distribution in each plane grid, when the processed structural data is restored, a point cloud that matches the distribution of the original point cloud data can be accurately and completely obtained. Therefore, the embodiments of the present application can improve the processing efficiency of point cloud data on the basis of reducing the degree of loss of the original data volume.

附图简要说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

图1是本申请实施例所提供的点云数据处理系统的场景示意图;FIG1 is a schematic diagram of a scene of a point cloud data processing system provided in an embodiment of the present application;

图2是本申请实施例提供的点云数据处理方法的一种实现方式的流程示意图;FIG2 is a flow chart of an implementation of a point cloud data processing method provided in an embodiment of the present application;

图3是本申请实施例提供的预设网格化平面的示意图;FIG3 is a schematic diagram of a preset grid plane provided in an embodiment of the present application;

图4是本申请实施例中提供的步骤202的示例性的流程示意图;FIG4 is an exemplary flowchart of step 202 provided in an embodiment of the present application;

图5是本申请实施例中提供的步骤203的示例性的流程示意图;FIG5 is an exemplary flowchart of step 203 provided in an embodiment of the present application;

图6是本申请实施例中提供的点云数据处理装置的一种实现方式的结构示意图;FIG6 is a schematic structural diagram of an implementation of a point cloud data processing device provided in an embodiment of the present application;

图7是本申请实施例中提供的电子设备的一种实现方式的结构示意图。 FIG. 7 is a schematic diagram of the structure of an implementation method of an electronic device provided in an embodiment of the present application.

实施本发明的方式Mode for Carrying Out the Invention

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of this application.

在本申请实施例的描述中,需要理解的是,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个所述特征。在本申请实施例的描述中,“多个”的含义是两个或两个以上,除非另有明确具体的限定。In the description of the embodiments of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

为了使本领域任何技术人员能够实现和使用本申请,给出了以下描述。在以下描述中,为了解释的目的而列出了细节。应当明白的是,本领域普通技术人员可以认识到,在不使用这些特定细节的情况下也可以实现本申请。在其它实例中,不会对公知的过程进行详细阐述,以避免不必要的细节使本申请实施例的描述变得晦涩。因此,本申请并非旨在限于所示的实施例,而是与符合本申请实施例所公开的原理和特征的最广范围相一致。In order to enable any person skilled in the art to implement and use the present application, the following description is provided. In the following description, details are listed for the purpose of explanation. It should be understood that those of ordinary skill in the art can recognize that the present application can also be implemented without using these specific details. In other examples, the known process will not be elaborated in detail to avoid unnecessary details that make the description of the present application embodiment obscure. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in accordance with the embodiments of the present application.

本申请实施例提供一种点云数据处理方法、装置、电子设备和计算机可读存储介质。其中,该点云数据处理装置可以集成在电子设备中,该电子设备可以是服务器,也可以是终端等设备。The present application provides a point cloud data processing method, device, electronic device and computer readable storage medium. The point cloud data processing device can be integrated in an electronic device, which can be a server or a terminal.

本申请实施例点云数据处理方法的执行主体可以为本申请实施例提供的点云数据处理装置,或者集成了该点云数据处理装置的服务器设备、物理主机或者用户设备(User Equipment,UE)等各种类型的电子设备。点云数据处理装置可以采用硬件或者软件的方式实现,UE具体可以为智能手机、平板电脑、笔记本电脑、掌上电脑、台式电脑或者个人数字助理(Personal Digital Assistant,PDA)等终端设备。该电子设备可以采用单独运行的工作方式,或者也可以采用设备集群的工作方式。The execution subject of the point cloud data processing method of the embodiment of the present application may be the point cloud data processing device provided in the embodiment of the present application, or various types of electronic devices such as a server device, a physical host or a user equipment (UE) integrated with the point cloud data processing device. The point cloud data processing device may be implemented in hardware or software, and the UE may specifically be a terminal device such as a smart phone, a tablet computer, a laptop computer, a PDA, a handheld computer, a desktop computer or a personal digital assistant (PDA). The electronic device may work in a single operation mode, or in a device cluster mode.

示例性地,本申请实施例提供的点云数据处理方法可以应用于如图1所示的点云数据处理系统中。其中,该点云数据处理系统包括终端101、服务器102,终端101可以是同时具有接收功能和发射功能的设备,即具有能够在双向通信链路上执行双向通信(接收和发射)的设备。终端101例如可以是手机、平板电脑、笔记本电脑等电子设备中的一种,或者可以是安装于监控现场用于原始点云数据采集、存储、传输的摄像头。终端101与服务器102可以通过网络进行双向通信,服务器102可以是独立的服务器,也可以是服务器组成的服务器网络或服务器集群,其包括但不限于计算机、网络主机、单个网络服务器、多个网络服务器集或多 个服务器构成的云服务器。其中,云服务器由基于云计算(Cloud Computing)的大量计算机或网络服务器构成。Exemplarily, the point cloud data processing method provided in the embodiment of the present application can be applied to the point cloud data processing system shown in FIG1 . The point cloud data processing system includes a terminal 101 and a server 102. The terminal 101 can be a device having both receiving and transmitting functions, that is, a device capable of performing two-way communication (receiving and transmitting) on a two-way communication link. The terminal 101 can be, for example, one of the electronic devices such as a mobile phone, a tablet computer, a laptop computer, or a camera installed at a monitoring site for raw point cloud data collection, storage, and transmission. The terminal 101 and the server 102 can communicate bidirectionally via a network. The server 102 can be an independent server, or a server network or server cluster composed of servers, which includes but is not limited to computers, network hosts, a single network server, a set of multiple network servers, or multiple A cloud server is composed of a large number of computers or network servers based on cloud computing.

本领域技术人员可以理解,图1中示出的应用环境仅是适用于本申请实施例的一种应用场景,并不构成对本申请实施例的应用场景的限定。本申请实施例所适用的其他的应用环境可以包括比图1中所示更多或更少的计算机设备,例如图1中仅示出一个服务器102,而在其他应用环境中该点云数据处理系统还可以包括一个或多个其他服务器,具体此处不作限定。另外,如图1所示,该点云数据处理系统还可以包括存储器,用于存储数据,如存储原始点云数据等。Those skilled in the art will appreciate that the application environment shown in FIG. 1 is only an application scenario applicable to the embodiment of the present application, and does not constitute a limitation on the application scenario of the embodiment of the present application. Other application environments applicable to the embodiment of the present application may include more or fewer computer devices than those shown in FIG. 1. For example, FIG. 1 shows only one server 102, while in other application environments, the point cloud data processing system may also include one or more other servers, which are not specifically limited here. In addition, as shown in FIG. 1, the point cloud data processing system may also include a memory for storing data, such as storing original point cloud data.

还需说明的是,图1所示的点云数据处理系统的场景示意图仅仅是一个示例,本发明实施例描述的点云数据处理系统以及场景是为了更加清楚的说明本发明实施例的技术方案,并不构成对于本发明实施例提供的技术方案的限定,本领域普通技术人员可知,随着点云数据处理系统的演变和新业务场景的出现,本发明实施例提供的技术方案对于类似的技术问题,同样适用。It should also be noted that the scenario diagram of the point cloud data processing system shown in Figure 1 is merely an example. The point cloud data processing system and scenario described in the embodiment of the present invention are intended to more clearly illustrate the technical solution of the embodiment of the present invention, and do not constitute a limitation on the technical solution provided by the embodiment of the present invention. Ordinary technicians in this field can know that with the evolution of the point cloud data processing system and the emergence of new business scenarios, the technical solution provided by the embodiment of the present invention is also applicable to similar technical problems.

下面对本申请实施例提供的点云数据处理方法进行介绍,本申请实施例中以电子设备作为执行主体来举例说明,为了简化与便于描述,后续方法实施例中将省略该执行主体。The point cloud data processing method provided in the embodiment of the present application is introduced below. In the embodiment of the present application, an electronic device is used as an execution subject for illustration. For the sake of simplicity and ease of description, the execution subject will be omitted in the subsequent method embodiments.

图2是本申请实施例提供的点云数据处理方法的一种实现方式的流程示意图。需要说明的是,虽然在图2或其他附图所示的流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。FIG2 is a flowchart of an implementation of a point cloud data processing method provided in an embodiment of the present application. It should be noted that although a logical order is shown in the flowchart shown in FIG2 or other figures, in some cases, the steps shown or described may be performed in a different order than that shown here.

如图2所示,本申请实施例提供的点云数据处理方法可以包括步骤201~204,具体如下。As shown in FIG. 2 , the point cloud data processing method provided in the embodiment of the present application may include steps 201 to 204 , which are specifically as follows.

步骤201、将待处理区域的原始点云数据投影至预设网格化平面,得到原始点云数据的投影点云。Step 201 : Project the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data.

其中,待处理区域是指需要进行点云数据处理的区域,具体可以是地理区域(如小区、商圈等)、预先规划的场地区域(如物流中转场地、仓库等)、物体的局部区域(比如,货车上的车厢区域、轮船上的甲板区域等)等。Among them, the area to be processed refers to the area that needs to be processed by point cloud data, which can be a geographical area (such as a community, a business district, etc.), a pre-planned site area (such as a logistics transfer site, a warehouse, etc.), a local area of an object (for example, the compartment area on a truck, the deck area on a ship, etc.), etc.

其中,原始点云数据是指通过三维成像设备对待处理区域进行点云数据采集而形成的点的集合。进一步地,当待处理区域因范围较大等原因导致无法一次性采集得到全部点云数据时,可以通过多角度数据采集和点云拼接的方式形成待处理区域的原始点云数据。The original point cloud data refers to the collection of points formed by collecting point cloud data of the area to be processed through a three-dimensional imaging device. Furthermore, when the area to be processed is too large to collect all the point cloud data at one time, the original point cloud data of the area to be processed can be formed by multi-angle data collection and point cloud splicing.

预设平面坐标系是用于记录每个投影点位置、每个平面网格位置的坐标系。具体地,预设平面坐标系可以是原始点云数据的所在三维坐标系中由X轴与Y轴构成的坐标系、由Y轴与 Z轴构成的坐标系、由X轴与Z轴构成的坐标系。为方便理解,本实施例中示例性地以X轴与Y轴构成的坐标系(简称XY坐标系)作为预设平面坐标系。The preset plane coordinate system is a coordinate system used to record the position of each projection point and each plane grid position. Specifically, the preset plane coordinate system can be a coordinate system composed of the X-axis and the Y-axis in the three-dimensional coordinate system of the original point cloud data, and a coordinate system composed of the Y-axis and the The coordinate system formed by the Z axis and the coordinate system formed by the X axis and the Z axis. For ease of understanding, the coordinate system formed by the X axis and the Y axis (abbreviated as the XY coordinate system) is exemplarily used as the preset plane coordinate system in this embodiment.

其中,预设网格化平面是指对预设平面坐标系所在平面进行网格划分后所得到平面。The preset gridded plane refers to a plane obtained by gridding the plane where the preset plane coordinate system is located.

进一步地,为了减少后续处理所需遍历的平面网格数量,可以限制预设网格化平面的大小。如图3所示,示例性地,假设原始点云数据位于预设平面坐标系“X=(Xmin,Xmax)=(-30米,50米)、Y=(Ymin,Ymax)=(-20米,100米)”的范围内,可以按照每个网格的预设尺寸(如X轴方向尺寸Xsize=轴方向尺寸Ysize=0.1米),对范围X=(-30米,50米)、Y=(-20米,100米)的平面进行网格划分,得到在X轴方向包含800个网格、在Y轴方向包含1200个网格的预设网格化平面。Furthermore, in order to reduce the number of plane grids that need to be traversed for subsequent processing, the size of the preset gridded plane can be limited. As shown in FIG3, illustratively, assuming that the original point cloud data is located in the range of the preset plane coordinate system "X = (Xmin, Xmax) = (-30 meters, 50 meters), Y = (Ymin, Ymax) = (-20 meters, 100 meters)", the plane with the range X = (-30 meters, 50 meters) and Y = (-20 meters, 100 meters) can be gridded according to the preset size of each grid (such as the X-axis direction size Xsize = the axis direction size Ysize = 0.1 meters), and a preset gridded plane containing 800 grids in the X-axis direction and 1200 grids in the Y-axis direction is obtained.

其中,投影点云是指原始点云数据中的各个点投影至预设网格化平面后,所得到的投影点的集合。The projected point cloud refers to a set of projection points obtained after each point in the original point cloud data is projected onto a preset grid plane.

示例性地,如图3所示,通过将原始点云数据正投影至预设网格化平面中,可以得到原始点云数据中的每个点在预设网格化平面中的投影点,从而得到原始点云数据的投影点云(如图3中曲线区域表示)。Exemplarily, as shown in FIG3 , by projecting the original point cloud data onto a preset gridding plane, the projection point of each point in the original point cloud data in the preset gridding plane can be obtained, thereby obtaining the projected point cloud of the original point cloud data (as represented by the curve area in FIG3 ).

为了便于表述,本文中以“采用每个平面网格的左上角点坐标表示每个平面网格的平面坐标”为例进行说明。For ease of description, this article takes "using the coordinates of the upper left corner point of each plane grid to represent the plane coordinates of each plane grid" as an example for explanation.

步骤202、基于投影点云中每个投影点的高度值和平面坐标,获取原始点云数据的目标结构数据。Step 202: Based on the height value and plane coordinates of each projection point in the projected point cloud, obtain the target structure data of the original point cloud data.

其中,目标结构数据包括原始点云数据所落入的每个平面网格的结构数据,每个平面网格的结构数据包括每个平面网格的平面坐标和投影点个数,还包括每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者。Among them, the target structural data includes the structural data of each plane grid into which the original point cloud data falls, and the structural data of each plane grid includes the plane coordinates and the number of projection points of each plane grid, and also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid.

其中,原始点云数据中的每个点在采集时已经得到了其在三维坐标系中的坐标值,因此可以直接采用每个投影点对应的原始点的高度(即在Z轴的坐标值)作为每个投影点的高度值。Among them, each point in the original point cloud data has obtained its coordinate value in the three-dimensional coordinate system when it is collected, so the height of the original point corresponding to each projection point (that is, the coordinate value on the Z axis) can be directly used as the height value of each projection point.

在这里,将原始点云数据落入的平面网格的集合定义为落入网格集合,具体是指原始点云数据投影至预设网格化平面后,投影点云在预设网格化平面各网格中所处的网格的集合。也就是说,落入网格集合中的每个平面网格即为原始点云数据所落入的每个平面网格。Here, the set of plane grids that the original point cloud data falls into is defined as the falling grid set, which specifically refers to the set of grids where the projected point cloud is located in each grid of the preset grid plane after the original point cloud data is projected onto the preset grid plane. In other words, each plane grid that falls into the grid set is each plane grid that the original point cloud data falls into.

可以理解的是,目标结构数据是包括落入网格集合中每个平面网格的结构数据的集合,因此,通过获取落入网格集合中每个平面网格的结构数据,即可得到目标结构数据。 It can be understood that the target structural data is a set including structural data of each plane grid falling into the grid set. Therefore, the target structural data can be obtained by acquiring the structural data of each plane grid falling into the grid set.

下面以每个平面网格的结构数据包括每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值的实施方式为例,对获取每个平面网格的结构数据的方式进行说明。此时,如图4所示,步骤202具体可以包括如下步骤2021A~2022A:The following is an example of an implementation in which the structural data of each plane grid includes the plane coordinates of each plane grid, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value, to illustrate the method of obtaining the structural data of each plane grid. At this time, as shown in FIG. 4, step 202 can specifically include the following steps 2021A to 2022A:

步骤2021A、基于投影点云中每个投影点的高度值和平面坐标,获取每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值。Step 2021A, based on the height value and plane coordinates of each projection point in the projected point cloud, obtain the plane coordinates, number of projection points, point cloud curvature, maximum point cloud height, minimum point cloud height, average point cloud height and point cloud height variance value of each plane grid.

以下,针对步骤2021A中获取每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值的具体实现方式分别进行说明。应当理解,以下所记载的实现方式仅为获取这些数据的示例性方案,本领域技术人员也可以采用其他的方式获取这些数据,本申请的实施例对此不进行限定。The following is a description of the specific implementation methods for obtaining the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid in step 2021A. It should be understood that the implementation methods described below are only exemplary solutions for obtaining these data, and those skilled in the art may also use other methods to obtain these data, and the embodiments of the present application are not limited to this.

一、每个平面网格的平面坐标。1. The plane coordinates of each plane grid.

为了记录预设网格化平面中每个平面网格的位置,可以记录每个平面网格在预设平面坐标系中的平面坐标。由于每个平面网格包括多个点,因此针对所有平面网格,需要统一记录每个平面网格在同一位置(如网格的左上角点、左下角点、右上角点、或右下角点等)的坐标,作为每个平面网格的平面坐标,从而准确记录每个平面网格的平面坐标。例如,以记录每个平面网格的左上角点坐标作为每个平面网格的平面坐标为例,每个平面网格的平面坐标可以通过如下步骤A1~A3获取得到:In order to record the position of each plane grid in the preset gridded plane, the plane coordinates of each plane grid in the preset plane coordinate system can be recorded. Since each plane grid includes multiple points, for all plane grids, it is necessary to uniformly record the coordinates of each plane grid at the same position (such as the upper left corner point, lower left corner point, upper right corner point, or lower right corner point of the grid, etc.) as the plane coordinates of each plane grid, so as to accurately record the plane coordinates of each plane grid. For example, taking the recording of the coordinates of the upper left corner point of each plane grid as the plane coordinates of each plane grid as an example, the plane coordinates of each plane grid can be obtained by the following steps A1 to A3:

A1、获取每个平面网格在预设平面坐标系中的第一坐标轴的最小值。A1. Obtain the minimum value of the first coordinate axis of each plane grid in the preset plane coordinate system.

A2、获取每个平面网格在预设平面坐标系中的第二坐标轴的最小值。A2. Obtain the minimum value of the second coordinate axis of each plane grid in the preset plane coordinate system.

A3、基于第一坐标轴的最小值和第二坐标轴的最小值,得到每个平面网格的平面坐标。A3. Based on the minimum value of the first coordinate axis and the minimum value of the second coordinate axis, the plane coordinates of each plane grid are obtained.

例如,以预设平面坐标系是原始点云数据所在三维坐标系中X轴与Y轴构成的坐标系为例,则第一坐标轴、第二坐标轴可以分别是X轴、Y轴,此时,获取一个平面网格在预设平面坐标系的X轴的最小值为(x=1)、Y轴的最小值为(y=1),从而确定该平面网格的左上角点坐标为(1,1),并将其作为该平面网格的平面坐标。For example, taking the preset plane coordinate system as a coordinate system composed of the X-axis and the Y-axis in the three-dimensional coordinate system where the original point cloud data is located, the first coordinate axis and the second coordinate axis can be the X-axis and the Y-axis respectively. At this time, the minimum value of the X-axis of a plane grid in the preset plane coordinate system is obtained as (x=1), and the minimum value of the Y-axis is obtained as (y=1), thereby determining that the coordinates of the upper left corner point of the plane grid are (1,1), and use them as the plane coordinates of the plane grid.

二、每个平面网格的投影点个数。2. The number of projection points of each plane grid.

预设网格坐标系是用于指示每个平面网格位置的坐标系。如图3所示,为方便理解,本文中以h轴和w轴构成的坐标系表示预设网格坐标系,并令h轴、w轴方向分别与预设平面坐标系的X轴、Y轴方向相同。例如,如图3所示,针对位于预设网格化平面中h轴方向的第 11行、w轴方向的第13列的网格(如图3中矩形框处所示),其网格坐标为(h=11,w=13),其平面坐标为(x=-30+10*0.1米,y=-20+12*0.1米)=(x=-29米,y=-18.8米)。The preset grid coordinate system is a coordinate system used to indicate the position of each plane grid. As shown in Figure 3, for ease of understanding, the preset grid coordinate system is represented by a coordinate system consisting of the h-axis and the w-axis, and the directions of the h-axis and the w-axis are respectively the same as the directions of the X-axis and the Y-axis of the preset plane coordinate system. For example, as shown in Figure 3, for the first position in the h-axis direction of the preset grid plane, The grid of the 11th row and the 13th column in the w-axis direction (as shown in the rectangular box in Figure 3) has grid coordinates (h=11, w=13), and its plane coordinates are (x=-30+10*0.1m, y=-20+12*0.1m)=(x=-29m, y=-18.8m).

可以理解的是,如前文所述“采用每个平面网格的左上角点坐标表示每个平面网格的平面坐标”主要是为了便于记录每个平面网格的平面坐标。实际上平面坐标处于范围:x=(-30+10*0.1米,-30+11*0.1米)=(-29米,-28.9米),y=(-20+12*0.1米,-20+13*0.1米)=(-18.8米,-18.7米)内的投影点均落入该平面坐标为(x=-29米,y=-18.8米)的平面网格。It is understandable that, as mentioned above, "using the coordinates of the upper left corner of each plane grid to represent the plane coordinates of each plane grid" is mainly for the convenience of recording the plane coordinates of each plane grid. In fact, the projection points within the plane coordinate range: x = (-30 + 10 * 0.1 meters, -30 + 11 * 0.1 meters) = (-29 meters, -28.9 meters), y = (-20 + 12 * 0.1 meters, -20 + 13 * 0.1 meters) = (-18.8 meters, -18.7 meters) all fall into the plane grid with the plane coordinates of (x = -29 meters, y = -18.8 meters).

示例性地,首先,根据每个平面网格的网格坐标确定每个平面网格的平面坐标范围,如:x=(-29米,-28.9米),y=(-18.8米,-18.7米);并获取每个投影点在预设平面坐标系中的平面坐标。然后,遍历投影点云中每个投影点,若当前投影点的平面坐标(如x=-28.93,y=-18.71)处于平面坐标范围:x=(-29米,-28.9米),y=(-18.8米,-18.7米),则将当前投影点确定为位于该平面网格中的目标投影点,直至投影点云中的所有投影点遍历完成。最后,统计每个平面网格中的目标投影点的数量,即可得到每个平面网格的投影点个数。Exemplarily, first, the plane coordinate range of each plane grid is determined according to the grid coordinates of each plane grid, such as: x = (-29 meters, -28.9 meters), y = (-18.8 meters, -18.7 meters); and the plane coordinates of each projection point in the preset plane coordinate system are obtained. Then, each projection point in the projection point cloud is traversed. If the plane coordinates of the current projection point (such as x = -28.93, y = -18.71) are in the plane coordinate range: x = (-29 meters, -28.9 meters), y = (-18.8 meters, -18.7 meters), the current projection point is determined as the target projection point located in the plane grid until all projection points in the projection point cloud are traversed. Finally, the number of target projection points in each plane grid is counted to obtain the number of projection points of each plane grid.

三、每个平面网格的点云曲率。3. The point cloud curvature of each plane mesh.

在一些实施例中,可以直接基于每个平面网格内的目标投影点确定每个平面网格的点云曲率。例如,首先,参考前述方式,根据每个平面网格的网格坐标和每个投影点在预设平面坐标系中的平面坐标,确定位于每个平面网格中的所有目标投影点所构成集合为该平面网格的目标投影点云。然后,结合每个平面网格的目标投影点云对应的三维坐标,计算每个平面内的目标投影点云构成的曲面。最后,根据每个平面内的目标投影点云构成的曲面,计算每个平面网格中同一位置(如左上角点)处的曲率作为每个平面网格的点云曲率。In some embodiments, the point cloud curvature of each plane grid can be determined directly based on the target projection points in each plane grid. For example, first, referring to the aforementioned method, according to the grid coordinates of each plane grid and the plane coordinates of each projection point in the preset plane coordinate system, the set composed of all target projection points located in each plane grid is determined as the target projection point cloud of the plane grid. Then, in combination with the three-dimensional coordinates corresponding to the target projection point cloud of each plane grid, the surface composed of the target projection point cloud in each plane is calculated. Finally, based on the surface composed of the target projection point cloud in each plane, the curvature at the same position (such as the upper left corner point) in each plane grid is calculated as the point cloud curvature of each plane grid.

其中,投影点是将原始点云数据投影至预设网格化平面得到的点,因此投影点对应的三维坐标即为目标投影点在原始点云数据中对应的点的三维坐标。例如,原始点云数据中三维坐标为(2,3,4)的点投影至预设网格化平面后得到平面坐标为(2,3)的投影点,则投影点对应的三维坐标也为(2,3,4)。The projection point is the point obtained by projecting the original point cloud data onto the preset grid plane, so the 3D coordinates corresponding to the projection point are the 3D coordinates of the point corresponding to the target projection point in the original point cloud data. For example, if the point with 3D coordinates (2,3,4) in the original point cloud data is projected onto the preset grid plane, the plane coordinates of the projection point are (2,3), and the 3D coordinates corresponding to the projection point are also (2,3,4).

在一些实施例中,也可以基于投影点云确定每个平面网格的曲率。例如,首先,结合投影点云中每个投影点的三维坐标,计算投影点云构成的曲面。然后,根据投影点云构成的曲面,计算每个平面网格中同一位置(如左上角点)处的曲率作为每个平面网格的点云曲率。In some embodiments, the curvature of each plane mesh may also be determined based on the projected point cloud. For example, first, the three-dimensional coordinates of each projection point in the projected point cloud are combined to calculate the surface formed by the projected point cloud. Then, based on the surface formed by the projected point cloud, the curvature at the same position (such as the upper left corner point) in each plane mesh is calculated as the point cloud curvature of each plane mesh.

四、每个平面网格的点云高度最大值。4. The maximum point cloud height of each plane grid.

示例性地,首先,参考前述方式,根据每个片面网格的网格坐标和每个投影点在预设平面坐标系中的平面坐标,确定每个平面网格的目标投影点云。然后,根据每个平面网格内的目标投影点云中各目标投影点的高度值,查找出最大的高度值,作为该平面网格的点云高度最 大值。例如,第1个平面网格内的目标投影点分别为:点1、点2、点3、点4、点5,对应的高度值分别为0.1米、0.2米、0.3米、0.4米、0.5米,则第1个平面网格内的的点云高度最大值为0.5米。For example, first, referring to the above method, the target projection point cloud of each plane grid is determined according to the grid coordinates of each plane grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the maximum height value is found as the maximum height value of the point cloud of the plane grid. For example, the target projection points in the first plane grid are point 1, point 2, point 3, point 4, and point 5, and the corresponding height values are 0.1m, 0.2m, 0.3m, 0.4m, and 0.5m, respectively. The maximum point cloud height in the first plane grid is 0.5m.

五、每个平面网格的点云高度最小值。5. Minimum point cloud height of each plane grid.

示例性地,首先,参考前述方式,根据每个片面网格的网格坐标和每个投影点在预设平面坐标系中的平面坐标,确定每个平面网格的目标投影点云。然后,根据每个平面网格内的目标投影点云中各目标投影点的高度值,查找出最小的高度值,作为该平面网格的点云高度最小值。例如,第1个平面网格内的目标投影点云分别为:点1、点2、点3、点4、点5,对应的高度值分别为0.1米、0.2米、0.3米、0.4米、0.5米,则第1个平面网格内的的点云高度最小值为0.1米。Exemplarily, first, referring to the aforementioned method, the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the minimum height value is found as the minimum point cloud height value of the plane grid. For example, the target projection point clouds in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively. Then the minimum point cloud height value in the first plane grid is 0.1 meters.

六、每个平面网格的点云高度平均值。6. The average point cloud height of each plane grid.

示例性地,首先,参考前述方式,根据每个片面网格的网格坐标和每个投影点在预设平面坐标系中的平面坐标,确定每个平面网格的目标投影点云。然后,根据每个平面网格内的目标投影点云中各目标投影点的高度值,统计出每个平面网格内的目标投影点的高度平均值,作为每个平面网格的点云高度平均值。例如,第1个平面网格内的目标投影点分别为:点1、点2、点3、点4、点5,对应的高度值分别为0.1米、0.2米、0.3米、0.4米、0.5米,则第1个平面网格内的点云高度平均值为0.3米。Exemplarily, first, referring to the aforementioned method, the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the average height of the target projection points in each plane grid is counted as the average height of the point cloud of each plane grid. For example, the target projection points in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively. Then, the average height of the point cloud in the first plane grid is 0.3 meters.

七、每个平面网格的点云高度方差值。7. The point cloud height variance value of each plane grid.

示例性地,首先,参考前述方式,根据每个片面网格的网格坐标和每个投影点在预设平面坐标系中的平面坐标,确定每个平面网格的目标投影点云。然后,根据每个平面网格内的目标投影点云中各目标投影点的高度值,计算得到该平面网格内的目标投影点的高度值方差,作为该平面网格的的点云高度方差值。例如,第1个平面网格内的目标投影点分别为:点1、点2、点3、点4、点5,对应的高度值分别为0.1米、0.2米、0.3米、0.4米、0.5米,则第1个平面网格内的点云高度方差值为0.22。Exemplarily, first, referring to the aforementioned method, the target projection point cloud of each plane grid is determined according to the grid coordinates of each one-sided grid and the plane coordinates of each projection point in the preset plane coordinate system. Then, according to the height values of each target projection point in the target projection point cloud in each plane grid, the height value variance of the target projection point in the plane grid is calculated as the point cloud height variance value of the plane grid. For example, the target projection points in the first plane grid are: point 1, point 2, point 3, point 4, point 5, and the corresponding height values are 0.1 meters, 0.2 meters, 0.3 meters, 0.4 meters, and 0.5 meters, respectively. Then, the point cloud height variance value in the first plane grid is 0.22.

步骤2022A、按照预设的数据存储格式,将每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值存储起来,得到每个平面网格的结构数据。Step 2022A, according to the preset data storage format, the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid are stored to obtain the structural data of each plane grid.

例如,可以将每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值,按照预设的数据存储格式[X,Y,Zmin,Zmax,Zmean,Zstd,Num,Cur],即[平面坐标的X轴坐标值、平面坐标的Y轴坐标值、点云高度最小 值、点云高度最大值、点云高度平均值、点云高度方差值、投影点个数、点云曲率]存储起来,作为每个平面网格的结构数据。For example, the plane coordinates, number of projection points, point cloud curvature, maximum point cloud height, minimum point cloud height, average point cloud height, and point cloud height variance of each plane grid can be stored in the preset data format [X, Y, Zmin, Zmax, Zmean, Zstd, Num, Cur], that is, [X-axis coordinate value of plane coordinates, Y-axis coordinate value of plane coordinates, minimum point cloud height The point cloud height value, the maximum value of the point cloud height, the average value of the point cloud height, the variance value of the point cloud height, the number of projection points, and the point cloud curvature are stored as the structural data of each plane grid.

由此,针对落入网格集合,可以得到M*N*K的数据矩阵,作为目标结构数据。其中,M、N分别为落入网格集合中在X轴方向的网格数量、在Y轴方向的网格数量。K表示每个平面网格的结构数据的数量,如,若数据存储格式为[X,Y,Zmin,Zmax,Zmean,Zstd,Num,Cur],则K=8。Thus, for the grid set, an M*N*K data matrix can be obtained as the target structure data. Among them, M and N are the number of grids in the X-axis direction and the number of grids in the Y-axis direction in the grid set, respectively. K represents the number of structural data of each plane grid. For example, if the data storage format is [X, Y, Zmin, Zmax, Zmean, Zstd, Num, Cur], then K = 8.

同理,可以基于每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者获取每个平面网格的结构数据。Similarly, the structural data of each plane grid can be obtained based on at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid.

例如,每个平面网格的结构数据包括每个平面网格的点云曲率和点云高度方差值时,步骤202具体可以包括如下步骤:基于每个投影点的平面坐标,获取每个平面网格的目标投影点;基于目标投影点的高度值,获取每个平面网格的点云高度方差值;基于目标投影点的高度值,获取每个平面网格的点云曲率;基于每个平面网格的点云高度方差值和点云曲率,形成每个平面网格的结构数据,以得到目标结构数据。For example, when the structural data of each plane grid includes the point cloud curvature and the point cloud height variance value of each plane grid, step 202 may specifically include the following steps: based on the plane coordinates of each projection point, obtaining the target projection point of each plane grid; based on the height value of the target projection point, obtaining the point cloud height variance value of each plane grid; based on the height value of the target projection point, obtaining the point cloud curvature of each plane grid; based on the point cloud height variance value and the point cloud curvature of each plane grid, forming the structural data of each plane grid to obtain the target structural data.

各步骤的具体实现可以参考前文中“投影点云个数”部分、“点云高度方差值”部分以及“点云高度值”部分的相关说明,此处不再赘述。For the specific implementation of each step, please refer to the relevant descriptions in the "Number of Projected Point Clouds", "Point Cloud Height Variance" and "Point Cloud Height Value" sections in the previous article, which will not be repeated here.

其中,可以将每个平面网格的平面坐标、投影点个数、点云曲率以及点云高度方差值,按照预设的数据存储格式[X,Y,Zstd,Num,Cur],即[平面坐标的X轴坐标值、平面坐标的Y轴坐标值、点云高度方差值、投影点个数、点云曲率]存储起来,作为每个平面网格的结构数据。由此,可以得到M*N*K=M*N*5的数据矩阵,作为目标结构数据。The plane coordinates, number of projection points, point cloud curvature and point cloud height variance of each plane grid can be stored in a preset data storage format [X, Y, Zstd, Num, Cur], i.e. [X-axis coordinate value of plane coordinates, Y-axis coordinate value of plane coordinates, point cloud height variance value, number of projection points, point cloud curvature] as the structural data of each plane grid. Thus, a data matrix of M*N*K=M*N*5 can be obtained as the target structural data.

步骤203、基于目标结构数据进行点云处理,得到原始点云数据的处理后结构数据。Step 203: Perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data.

其中,处理后结构数据是指采用目标结构数据,进行如边界识别、干扰识别、干扰过滤等点云处理过程后,所得到的结构数据。The processed structural data refers to the structural data obtained after using the target structural data to perform point cloud processing such as boundary recognition, interference recognition, and interference filtering.

由于是一个平面网格存储为一个结构数据,而一个平面网格中包含了多个投影点,因此可以将原本需要分别处理的包括多个点的点云数据压缩为一个结构数据。可以理解地,本实施例通过处理一个结构数据,即可实现对点云中多个点进行批量处理,进而提高如边界识别、干扰识别、干扰过滤等点云处理过程的处理效率,实现了点云的高效处理。基于此,为了对原始点云数据进行如边界识别、干扰识别、干扰过滤等点云处理过程,可以将原始点云数据先存储为目标结构数据,再基于目标结构数据进行上述处理,从而能够降低数据处理量。Since a plane grid is stored as a structural data, and a plane grid contains multiple projection points, the point cloud data including multiple points that originally need to be processed separately can be compressed into one structural data. It can be understood that this embodiment can realize batch processing of multiple points in the point cloud by processing one structural data, thereby improving the processing efficiency of point cloud processing processes such as boundary recognition, interference recognition, and interference filtering, and realizing efficient processing of point clouds. Based on this, in order to perform point cloud processing processes such as boundary recognition, interference recognition, and interference filtering on the original point cloud data, the original point cloud data can be first stored as target structural data, and then the above processing is performed based on the target structural data, thereby reducing the amount of data processing.

步骤203中通过点云处理获取识别后结构数据的具体实现方式可以包括多种,以下示例性地介绍3种实现方式。应当理解,以下所记载的实现方式仅为获取识别后结构数据的示例性 方案,本领域技术人员也可以根据实际需要选择其他的方式,本申请的实施例对此不进行限定。There are many specific implementation methods for obtaining the recognized structure data by processing the point cloud in step 203. Three implementation methods are described below as examples. It should be understood that the implementation methods described below are only examples of obtaining the recognized structure data. Those skilled in the art may also select other methods according to actual needs, and the embodiments of the present application are not limited to this.

(1)处理后结构数据为干扰点结构数据。此时,每个平面网格的结构数据至少包括每个平面网格的点云曲率和点云高度方差值,步骤203具体可以包括:遍历原始点云数据所落入的每个平面网格,检测当前平面网格的点云曲率;检测当前平面网格的点云高度方差值;若当前平面网格的点云曲率大于预设曲率阈值且点云高度方差值大于预设方差阈值,则将当前平面网格的结构数据确定为原始点云数据的干扰点结构数据。(1) The processed structural data is interference point structural data. At this time, the structural data of each plane grid at least includes the point cloud curvature and point cloud height variance value of each plane grid. Step 203 may specifically include: traversing each plane grid where the original point cloud data falls, detecting the point cloud curvature of the current plane grid; detecting the point cloud height variance value of the current plane grid; if the point cloud curvature of the current plane grid is greater than a preset curvature threshold and the point cloud height variance value is greater than a preset variance threshold, then determining the structural data of the current plane grid as the interference point structural data of the original point cloud data.

例如,目标结构数据包括网格1的结构数据、网格2的结构数据、…、网格100的结构数据。在上述步骤中,可以遍历网格1、网格2、…、网格100,检测当前平面网格(如网格1)的点云曲率和点云高度方差值。若当前平面网格的点云曲率(如0.5)大于预设曲率阈值(如0.3)且当前平面网格的点云高度方差值(如1)大于预设方差阈值(如0.5),则可以将当前平面网格(如网格1)作为原始点云数据的干扰点结构数据。以此类推,当网格1、网格2、…、网格100遍历完成时,可以得到原始点云数据所有的干扰点结构数据。For example, the target structural data includes the structural data of grid 1, the structural data of grid 2, ..., the structural data of grid 100. In the above steps, grid 1, grid 2, ..., grid 100 can be traversed to detect the point cloud curvature and point cloud height variance value of the current plane grid (such as grid 1). If the point cloud curvature of the current plane grid (such as 0.5) is greater than the preset curvature threshold (such as 0.3) and the point cloud height variance value of the current plane grid (such as 1) is greater than the preset variance threshold (such as 0.5), the current plane grid (such as grid 1) can be used as the interference point structural data of the original point cloud data. By analogy, when the traversal of grid 1, grid 2, ..., grid 100 is completed, all the interference point structural data of the original point cloud data can be obtained.

由此,一方面,由于点云高度方差值和点云曲率可以在一定程度上反映干扰物的所在点,因此通过设置预设曲率阈值和预设方差阈值来对干扰点进行识别,可以提高干扰点的识别准确率。另一方面,由于采用以每个平面网格的结构数据为单位进行干扰点的识别,无需对原始点云数据中的每个点进行单独处理,可以提高针对干扰点(比如在定位仓库内非散货的人造干扰物场景中如墙壁,车辆,立柱等干扰点)的识别速度。Therefore, on the one hand, since the point cloud height variance value and the point cloud curvature can reflect the location of the interference object to a certain extent, the interference point is identified by setting a preset curvature threshold and a preset variance threshold, which can improve the recognition accuracy of the interference point. On the other hand, since the interference point is identified in units of structural data of each plane grid, there is no need to process each point in the original point cloud data separately, which can improve the recognition speed of interference points (such as walls, vehicles, columns, etc. in the scene of man-made interference objects for non-bulk goods in the positioning warehouse).

(2)处理后结构数据为边界结构数据。此时,每个平面网格的结构数据至少包括每个平面网格的点云高度平均值,步骤203具体可以包括如下步骤:遍历原始点云数据所落入的每个平面网格,获取当前平面网格的点云高度平均值与当前平面网格的相邻平面网格的点云高度平均值之间的差值;若差值大于预设差值阈值,则将当前平面网格的结构数据作为原始点云数据的边界结构数据。(2) The processed structural data is the boundary structural data. At this time, the structural data of each plane grid at least includes the average point cloud height of each plane grid. Step 203 may specifically include the following steps: traverse each plane grid where the original point cloud data falls, and obtain the difference between the average point cloud height of the current plane grid and the average point cloud height of the adjacent plane grids of the current plane grid; if the difference is greater than a preset difference threshold, the structural data of the current plane grid is used as the boundary structural data of the original point cloud data.

其中,相邻平面网格可以是落入网格集合中,在h轴方向上与当前平面网格相邻的平面网格;或者是落入网格集合中,在w轴方向上与当前平面网格相邻的平面网格;或者是落入网格集合中,在h轴和w轴其中一个方向上与当前平面网格相邻的平面网格。Among them, the adjacent plane grid can be a plane grid that falls into the grid set and is adjacent to the current plane grid in the h-axis direction; or a plane grid that falls into the grid set and is adjacent to the current plane grid in the w-axis direction; or a plane grid that falls into the grid set and is adjacent to the current plane grid in one of the h-axis and w-axis directions.

例如,目标结构数据包括网格1的结构数据、网格2的结构数据、…、网格100的结构数据。上述步骤中,可以遍历网格1、网格2、…、网格100,检测当前平面网格(如网格1)的点云高度平均值以及相邻平面网格(如网格2)的点云高度平均值。若当前平面网格(如网格1)的点云高度平均值与相邻平面网格(如网格2)之间的差值(如0.5)大于预设差值阈 值(如0.3),则可以将当前平面网格(如网格1)作为原始点云数据的边界结构数据。同理,当网格1、网格2、…、网格100遍历完成时,可以得到原始点云数据所有的边界结构数据。For example, the target structure data includes the structure data of grid 1, the structure data of grid 2, ..., the structure data of grid 100. In the above steps, grid 1, grid 2, ..., grid 100 can be traversed to detect the average point cloud height of the current plane grid (such as grid 1) and the average point cloud height of the adjacent plane grid (such as grid 2). If the difference (such as 0.5) between the average point cloud height of the current plane grid (such as grid 1) and the adjacent plane grid (such as grid 2) is greater than the preset difference threshold If the value (such as 0.3) is set, the current plane grid (such as grid 1) can be used as the boundary structure data of the original point cloud data. Similarly, when the traversal of grid 1, grid 2, ..., grid 100 is completed, all the boundary structure data of the original point cloud data can be obtained.

其中,由于相邻平面网格可能会有多个,对于有多个相邻平面网格情况下,只要当前平面网格的点云高度平均值与其中一个相邻平面网格的点云高度平均值之间的差值大于预设差值阈值,就可以将当前平面网格的结构数据作为原始点云数据的边界结构数据。Among them, since there may be multiple adjacent plane grids, in the case of multiple adjacent plane grids, as long as the difference between the average point cloud height of the current plane grid and the average point cloud height of one of the adjacent plane grids is greater than the preset difference threshold, the structural data of the current plane grid can be used as the boundary structural data of the original point cloud data.

由此,一方面,由于点云高度平均值与相邻平面网格的点云高度平均值之间差值较大的位置可以在一定程度上反映干扰物与目标物体之间的边界所在点,因此通过设置点云高度平均值与相邻平面网格的点云高度平均值之间的预设差值阈值来对边界点进行识别,可以提高边界点的识别准确率。另一方面,由于采用以每个平面网格的结构数据为单位进行边界点的识别,无需对原始点云数据中的每个点单独处理,可以提高对于边界点(比如在定位仓库内非散货的人造干扰物场景中如墙壁,车辆,立柱等干扰物体与目标物体(即散货)之间的边界点)的识别速度。Therefore, on the one hand, since the position where the difference between the average value of the point cloud height and the average value of the point cloud height of the adjacent plane grid is large can reflect the point where the boundary between the interference object and the target object is located to a certain extent, the recognition accuracy of the boundary point can be improved by setting a preset difference threshold between the average value of the point cloud height and the average value of the point cloud height of the adjacent plane grid to identify the boundary point. On the other hand, since the identification of the boundary point is performed in units of the structural data of each plane grid, it is not necessary to process each point in the original point cloud data separately, and the recognition speed of the boundary point (such as the boundary point between the interference object such as the wall, vehicle, column and the target object (i.e., bulk cargo) in the scene of the artificial interference object of non-bulk cargo in the positioning warehouse) can be improved.

(3)处理后结构数据为过滤后的结构数据。(3) The processed structural data is the filtered structural data.

在一些实施例中,可以对整个干扰物体进行过滤。此时,如图5所示,步骤203具体可以包括如下步骤2031C~2034C:In some embodiments, the entire interfering object may be filtered. At this time, as shown in FIG5 , step 203 may specifically include the following steps 2031C to 2034C:

步骤2031C、基于目标结构数据进行干扰点识别,得到原始点云数据的干扰点结构数据。Step 2031C: identify interference points based on the target structure data to obtain interference point structure data of the original point cloud data.

步骤2032C、基于目标结构数据进行边界点识别,得到原始点云数据的边界结构数据。Step 2032C: perform boundary point recognition based on the target structure data to obtain boundary structure data of the original point cloud data.

步骤2031C~2032C的实现可以分别参考与上述各实现方式中的相关说明,此处不再赘述。The implementation of steps 2031C to 2032C may refer to the relevant descriptions in the above-mentioned implementation methods, and will not be repeated here.

步骤2033C、基于干扰点结构数据和边界结构数据,进行干扰物区域识别,得到原始点云数据的干扰物结构数据。Step 2033C: Based on the interference point structure data and the boundary structure data, interference area identification is performed to obtain interference structure data of the original point cloud data.

例如,可以将干扰点结构数据、边界结构数据作为种子点,利用聚类、区域生成等点云处理方法对干扰物体(如仓库中的如除货物外的车辆、墙壁、立柱等人造物体)进行识别,以确定原始点云数据的干扰物结构数据。For example, the interference point structure data and boundary structure data can be used as seed points, and point cloud processing methods such as clustering and region generation can be used to identify interference objects (such as man-made objects such as vehicles, walls, and columns in warehouses other than goods) to determine the interference object structure data of the original point cloud data.

步骤2034C、将干扰物结构数据从目标结构数据滤除,得到原始点云数据的过滤后的结构数据。Step 2034C: filter out the interference structure data from the target structure data to obtain filtered structure data of the original point cloud data.

例如,目标结构数据包括网格1的结构数据、网格2的结构数据、…、网格100的结构数据,通过步骤2031C~2033C识别出网格1、网格2、网格5、网格6的结构数据为干扰物结构数据,则可以将网格1、网格2、网格5、网格6的结构数据从目标结构数据滤除,得到原始点云数据的过滤后的结构数据。 For example, the target structural data includes the structural data of grid 1, the structural data of grid 2, ..., the structural data of grid 100. Through steps 2031C to 2033C, the structural data of grid 1, grid 2, grid 5, and grid 6 are identified as interference structural data. Then, the structural data of grid 1, grid 2, grid 5, and grid 6 can be filtered out from the target structural data to obtain the filtered structural data of the original point cloud data.

在一些实施例中,可以对干扰点进行过滤。此时,可以将前述步骤中得到的干扰点结构数据从目标结构数据中滤除,得到原始点云数据的过滤后的结构数据。In some embodiments, the interference points may be filtered. In this case, the interference point structure data obtained in the above steps may be filtered out from the target structure data to obtain filtered structure data of the original point cloud data.

在一些实施例中,可以对干扰点进行过滤。此时,可以将前述步骤中得到的边界结构数据从目标结构数据中滤除,得到原始点云数据的过滤后的结构数据。In some embodiments, the interference points may be filtered. At this time, the boundary structure data obtained in the above steps may be filtered out from the target structure data to obtain filtered structure data of the original point cloud data.

由此,由于采用以每个平面网格的结构数据为单位进行边界点的识别,无需对原始点云数据中的每个点单独处理,可以提高对于干扰物(比如在定位仓库内非散货的人造干扰物场景中如墙壁,车辆,立柱等干扰物体)、干扰点、边界点的过滤速度。Therefore, since the boundary points are identified based on the structural data of each plane grid, there is no need to process each point in the original point cloud data separately, which can improve the filtering speed of interference objects (such as walls, vehicles, columns and other interference objects in the scene of non-bulk man-made interference objects in the positioning warehouse), interference points, and boundary points.

步骤204、对处理后结构数据进行还原,得到原始点云数据的处理后点云数据。Step 204: restore the processed structural data to obtain processed point cloud data of the original point cloud data.

其中,处理后点云数据是指基于目标结构数据,对原始点云数据进行如边界识别、干扰识别、干扰过滤等点云处理过程后,所得到的点云数据。The processed point cloud data refers to the point cloud data obtained after performing point cloud processing processes such as boundary recognition, interference recognition, and interference filtering on the original point cloud data based on the target structure data.

示例性地,可以将处理后结构数据中每个平面网格的结构数据,在使得每个平面网格新生成的点云符合该网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值,并使得每个平面网格新生成的点个数等于该网格的投影点个数的情况下,重新生成处理后结构数据中每个平面网格的点云。由此,处理后结构数据中每个平面网格的新生成的点云,即构成了原始点云数据的处理后点云数据。Exemplarily, the structural data of each plane grid in the processed structural data can be regenerated under the condition that the newly generated point cloud of each plane grid conforms to the point cloud curvature, the maximum value of the point cloud height, the minimum value of the point cloud height, the average value of the point cloud height, and the variance value of the point cloud height of the grid, and the number of newly generated points of each plane grid is equal to the number of projection points of the grid. Thus, the newly generated point cloud of each plane grid in the processed structural data constitutes the processed point cloud data of the original point cloud data.

由以上内容可以看出,通过将每个平面网格的平面坐标、投影点个数,以及每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者处理为每个平面网格的结构数据,一方面,可以实现对每个平面网格内的多个点云进行压缩得到目标结构数据,使得后续使用目标结构数据进行处理时可以减少数据处理量,进而提高点云处理过程的处理效率;另一方面,由于每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值可以反映每个平面网格内的点云分布情况,因此对处理后结构数据进行还原时,可以准确、完整地还原与原始点云数据分布匹配的点云。由此,本申请实施例可以在降低原始数据量丢失程度的基础上,提高点云数据的处理效率。From the above content, it can be seen that by processing the plane coordinates, the number of projection points, and at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid into the structural data of each plane grid, on the one hand, it is possible to compress multiple point clouds in each plane grid to obtain target structural data, so that the amount of data processing can be reduced when the target structural data is used for subsequent processing, thereby improving the processing efficiency of the point cloud processing process; on the other hand, since the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid can reflect the point cloud distribution in each plane grid, when restoring the processed structural data, the point cloud that matches the distribution of the original point cloud data can be accurately and completely restored. Therefore, the embodiment of the present application can improve the processing efficiency of point cloud data on the basis of reducing the degree of loss of the original data volume.

为了更好实施本申请实施例中点云数据处理方法,本申请实施例还提供一种点云数据处理装置。图6所示为本申请实施例中提供的点云数据处理装置的一种实现方式的结构示意图。如图6所示,该点云数据处理装置600包括:In order to better implement the point cloud data processing method in the embodiment of the present application, the embodiment of the present application also provides a point cloud data processing device. FIG6 is a schematic diagram of a structure of an implementation method of the point cloud data processing device provided in the embodiment of the present application. As shown in FIG6, the point cloud data processing device 600 includes:

第一获取单元601,用于将待处理区域的原始点云数据投影至预设网格化平面,得到原始点云数据的投影点云; The first acquisition unit 601 is used to project the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data;

第二获取单元602,用于基于投影点云中每个投影点的高度值和平面坐标,获取原始点云数据的目标结构数据,其中,目标结构数据包括原始点云数据所落入的每个平面网格的结构数据,每个平面网格的结构数据包括每个平面网格的平面坐标、投影点个数,每个平面网格的结构数据还包括每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者;A second acquisition unit 602 is used to acquire target structural data of the original point cloud data based on the height value and plane coordinates of each projection point in the projected point cloud, wherein the target structural data includes structural data of each plane grid into which the original point cloud data falls, the structural data of each plane grid includes the plane coordinates of each plane grid and the number of projection points, and the structural data of each plane grid also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance of each plane grid;

处理单元603,用于基于目标结构数据进行点云处理,得到原始点云数据的处理后结构数据;A processing unit 603 is used to perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data;

还原单元604,用于对处理后结构数据进行还原,得到原始点云数据的处理后点云数据。The restoration unit 604 is used to restore the processed structural data to obtain processed point cloud data of the original point cloud data.

在一些实施例中,处理后结构数据包括干扰点结构数据,每个平面网格的结构数据包括每个平面网格的点云曲率和点云高度方差值。其中,处理单元603具体用于:遍历原始点云数据所落入的每个平面网格,检测当前平面网格的点云曲率;检测当前平面网格的点云高度方差值;若当前平面网格的点云曲率大于预设曲率阈值且点云高度方差值大于预设方差阈值,则将当前平面网格的结构数据确定为原始点云数据的干扰点结构数据。In some embodiments, the processed structural data includes interference point structural data, and the structural data of each plane grid includes the point cloud curvature and point cloud height variance value of each plane grid. The processing unit 603 is specifically used to: traverse each plane grid where the original point cloud data falls, detect the point cloud curvature of the current plane grid; detect the point cloud height variance value of the current plane grid; if the point cloud curvature of the current plane grid is greater than a preset curvature threshold and the point cloud height variance value is greater than a preset variance threshold, then determine the structural data of the current plane grid as the interference point structural data of the original point cloud data.

在一些实施例中,处理后结构数据包括边界结构数据,每个平面网格的结构数据包括每个平面网格的点云高度平均值。其中,处理单元603具体用于:遍历原始点云数据所落入的每个平面网格,获取当前平面网格的点云高度平均值与当前平面网格的相邻平面网格的点云高度平均值之间的差值;若差值大于预设差值阈值,则将当前平面网格的结构数据作为原始点云数据的边界结构数据。In some embodiments, the processed structural data includes boundary structural data, and the structural data of each plane grid includes the average point cloud height of each plane grid. The processing unit 603 is specifically used to: traverse each plane grid where the original point cloud data falls, obtain the difference between the average point cloud height of the current plane grid and the average point cloud height of the adjacent plane grids of the current plane grid; if the difference is greater than a preset difference threshold, use the structural data of the current plane grid as the boundary structural data of the original point cloud data.

在一些实施例中,处理后结构数据包括过滤后的结构数据。其中,处理单元603具体用于:基于目标结构数据进行干扰点识别,得到原始点云数据的干扰点结构数据;基于目标结构数据进行边界点识别,得到原始点云数据的边界结构数据;基于干扰点结构数据和边界结构数据,进行干扰物区域识别,得到原始点云数据的干扰物结构数据;将干扰物结构数据从目标结构数据滤除,得到原始点云数据的过滤后的结构数据。In some embodiments, the processed structural data includes filtered structural data. The processing unit 603 is specifically used to: identify interference points based on the target structural data to obtain interference point structural data of the original point cloud data; identify boundary points based on the target structural data to obtain boundary structural data of the original point cloud data; identify interference object regions based on the interference point structural data and boundary structural data to obtain interference object structural data of the original point cloud data; and filter out the interference object structural data from the target structural data to obtain filtered structural data of the original point cloud data.

在一些实施例中,处理后结构数据包括过滤后的结构数据。其中,处理单元603单元具体用于:基于目标结构数据进行干扰点识别,得到原始点云数据的干扰点结构数据;以及,将干扰点结构数据从目标结构数据滤除,得到原始点云数据的过滤后的结构数据;In some embodiments, the processed structural data includes filtered structural data. The processing unit 603 is specifically used to: identify interference points based on the target structural data to obtain interference point structural data of the original point cloud data; and filter the interference point structural data from the target structural data to obtain filtered structural data of the original point cloud data;

或者,基于目标结构数据进行边界点识别,得到原始点云数据的边界结构数据;以及,将边界结构数据从目标结构数据滤除,得到原始点云数据的过滤后的结构数据。Alternatively, boundary point recognition is performed based on the target structure data to obtain boundary structure data of the original point cloud data; and the boundary structure data is filtered out from the target structure data to obtain filtered structure data of the original point cloud data.

在一些实施例中,第二获取单元602具体用于:基于每个投影点的平面坐标,获取每个平面网格的目标投影点;统计每个平面网格的目标投影点的个数,以作为每个平面网格的投影 点个数;基于目标投影点的高度值,获取每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值;按照预设的数据存储格式,对每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值进行存储,形成每个平面网格的结构数据,得到目标结构数据。In some embodiments, the second acquisition unit 602 is specifically used to: acquire the target projection point of each plane grid based on the plane coordinates of each projection point; count the number of target projection points of each plane grid as the projection of each plane grid; The number of points; based on the height value of the target projection point, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid are obtained; according to the preset data storage format, the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid are stored to form the structural data of each plane grid and obtain the target structural data.

在一些实施例中,第二获取单元602具体用于:获取每个平面网格在预设平面坐标系中的第一坐标轴的最小值;获取每个平面网格在预设平面坐标系中的第二坐标轴的最小值;基于第一坐标轴的最小值和第二坐标轴的最小值,得到每个平面网格的平面坐标。In some embodiments, the second acquisition unit 602 is specifically used to: obtain the minimum value of the first coordinate axis of each plane grid in the preset plane coordinate system; obtain the minimum value of the second coordinate axis of each plane grid in the preset plane coordinate system; based on the minimum value of the first coordinate axis and the minimum value of the second coordinate axis, obtain the plane coordinates of each plane grid.

由此,本申请实施例提供的点云数据处理装置600可以带来如下技术效果:通过将每个平面网格的平面坐标、投影点个数,以及每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值中的至少一者处理为每个平面网格的结构数据,一方面,可以实现对每个平面网格内的多个点云进行压缩得到目标结构数据,使得后续使用目标结构数据进行处理时可以减少数据处理量,进而提高点云处理过程的处理效率;另一方面,由于每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值、点云高度方差值可以反映每个平面网格内的点云分布情况,因此对处理后结构数据进行还原时,可以准确、完整地得到与原始点云数据分布匹配的点云。由此,可以在降低原始数据量丢失程度的基础上,提高点云数据的处理效率。Therefore, the point cloud data processing device 600 provided in the embodiment of the present application can bring the following technical effects: by processing the plane coordinates, the number of projection points, and at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid into the structural data of each plane grid, on the one hand, it is possible to compress multiple point clouds in each plane grid to obtain target structural data, so that the amount of data processing can be reduced when the target structural data is used for subsequent processing, thereby improving the processing efficiency of the point cloud processing process; on the other hand, since the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height, and the point cloud height variance value of each plane grid can reflect the point cloud distribution in each plane grid, when restoring the processed structural data, a point cloud that matches the distribution of the original point cloud data can be accurately and completely obtained. Therefore, the processing efficiency of point cloud data can be improved on the basis of reducing the degree of loss of the original data volume.

具体实施时,以上各个单元可以作为独立的实体来实现,也可以进行任意组合,作为同一或若干个实体来实现,以上各个单元的具体实施方式和效果可参见前面的方法实施例中相应的内容,在此不再赘述。In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation methods and effects of the above units can refer to the corresponding contents in the previous method embodiments, which will not be repeated here.

进一步地,本申请实施例还提供一种电子设备,该电子设备可以为智能手机、平板电脑、笔记本电脑、触控屏幕、个人计算机(PC,Personal Computer)、个人数字助理(Personal Digital Assistant,PDA)等终端设备。Furthermore, an embodiment of the present application also provides an electronic device, which may be a terminal device such as a smart phone, a tablet computer, a laptop computer, a touch screen, a personal computer (PC, Personal Computer), a personal digital assistant (Personal Digital Assistant, PDA), etc.

图7为本申请实施例提供的电子设备的结构示意图。如图7所示,该电子设备700包括有一个或者一个以上处理核心的处理器701、有一个或多个计算机可读存储介质的存储器702及存储在存储器702上并可在处理器上运行的计算机程序。其中,处理器701与存储器702电性连接。本领域技术人员可以理解,图中示出的电子设备结构并不构成对电子设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。FIG7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. As shown in FIG7, the electronic device 700 includes a processor 701 having one or more processing cores, a memory 702 having one or more computer-readable storage media, and a computer program stored in the memory 702 and executable on the processor. The processor 701 is electrically connected to the memory 702. Those skilled in the art will appreciate that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.

处理器701是电子设备700的控制中心,利用各种接口和线路连接整个电子设备700的各个部分,通过运行或加载存储在存储器702内的软件程序和/或模块,以及调用存储在存储器702内的数据,执行电子设备700的各种功能和处理数据,从而对电子设备700进行整体监控。 The processor 701 is the control center of the electronic device 700. It uses various interfaces and lines to connect various parts of the entire electronic device 700, executes various functions of the electronic device 700 and processes data by running or loading software programs and/or modules stored in the memory 702, and calling data stored in the memory 702, thereby monitoring the electronic device 700 as a whole.

在本申请实施例中,电子设备700中的处理器701会按照本申请提供的任一种点云数据处理方法的步骤,将一个或一个以上的应用程序的进程对应的指令加载到存储器702中,并由处理器701来运行存储在存储器702中的应用程序,从而实现上述点云数据处理方法的具体过程。In an embodiment of the present application, the processor 701 in the electronic device 700 will load instructions corresponding to the processes of one or more applications into the memory 702 in accordance with the steps of any point cloud data processing method provided in the present application, and the processor 701 will run the application stored in the memory 702, thereby implementing the specific process of the above-mentioned point cloud data processing method.

可选的,如图7所示,电子设备700还包括:触控显示屏703、射频电路704、音频电路705、输入单元706以及电源707。其中,处理器701分别与触控显示屏703、射频电路704、音频电路705、输入单元706以及电源707电性连接。本领域技术人员可以理解,图7中示出的电子设备结构并不构成对电子设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Optionally, as shown in FIG7 , the electronic device 700 further includes: a touch screen 703, a radio frequency circuit 704, an audio circuit 705, an input unit 706, and a power supply 707. The processor 701 is electrically connected to the touch screen 703, the radio frequency circuit 704, the audio circuit 705, the input unit 706, and the power supply 707. Those skilled in the art will appreciate that the electronic device structure shown in FIG7 does not limit the electronic device, and may include more or fewer components than shown, or combine certain components, or arrange components differently.

触控显示屏703可用于显示图形用户界面以及接收用户作用于图形用户界面产生的操作指令。触控显示屏703可以包括显示面板和触控面板。其中,显示面板可用于显示由用户输入的信息或提供给用户的信息以及电子设备的各种图形用户接口,这些图形用户接口可以由图形、文本、图标、视频和其任意组合来构成。可选的,可以采用液晶显示器(LCD,Liquid Crystal Display)、有机发光二极管(OLED,Organic Light-Emitting Diode)等形式来配置显示面板。触控面板可用于收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板上或在触控面板附近的操作),并生成相应的操作指令,且操作指令执行对应程序。可选的,触控面板可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器701,并能接收处理器701发来的命令并加以执行。触控面板可覆盖显示面板,当触控面板检测到在其上或附近的触摸操作后,传送给处理器701以确定触摸事件的类型,随后处理器701根据触摸事件的类型在显示面板上提供相应的视觉输出。在本申请实施例中,可以将触控面板与显示面板集成到触控显示屏703而实现输入和输出功能。但是在某些实施例中,触控面板与触控面板可以作为两个独立的部件来实现输入和输出功能。即触控显示屏703也可以作为输入单元706的一部分实现输入功能。The touch display screen 703 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 703 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, which can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-Emitting Diode), etc. The touch panel can be used to collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute the corresponding program. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 701, and can receive the command sent by the processor 701 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 701 to determine the type of touch event, and then the processor 701 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 703 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 703 can also be used as a part of the input unit 706 to realize the input function.

射频电路704可用于收发射频信号,以通过无线通信与网络设备或其他电子设备建立无线通讯,与网络设备或其他电子设备之间收发信号。The radio frequency circuit 704 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals with the network device or other electronic devices.

音频电路705可以用于通过扬声器、传声器提供用户与电子设备之间的音频接口。音频电路705可将接收到的音频数据转换后的电信号,传输到扬声器,由扬声器转换为声音信号输出;另一方面,传声器将收集的声音信号转换为电信号,由音频电路705接收后转换为音频数据,再将音频数据输出处理器701处理后,经射频电路704以发送给比如另一电子设备,或 者将音频数据输出至存储器702以便进一步处理。音频电路705还可能包括耳塞插孔,以提供外设耳机与电子设备的通信。The audio circuit 705 can be used to provide an audio interface between the user and the electronic device through a speaker and a microphone. The audio circuit 705 can convert the received audio data into an electrical signal and transmit it to the speaker, which converts it into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 705 and converted into audio data. The audio data is then processed by the processor 701 and sent to another electronic device, or to another electronic device, through the radio frequency circuit 704. The audio circuit 705 may also include an earplug jack to provide communication between an external headset and the electronic device.

输入单元706可用于接收输入的数字、字符信息或用户特征信息(例如指纹、虹膜、面部信息等),以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。The input unit 706 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

电源707用于给电子设备700的各个部件供电。可选的,电源707可以通过电源管理系统与处理器701逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源707还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。The power supply 707 is used to supply power to various components of the electronic device 700. Optionally, the power supply 707 can be logically connected to the processor 701 through a power management system, so that the power management system can manage charging, discharging, and power consumption. The power supply 707 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

尽管图7中未示出,电子设备700还可以包括摄像头、传感器、无线保真模块、蓝牙模块等,在此不再赘述。Although not shown in FIG. 7 , the electronic device 700 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail herein.

本领域普通技术人员可以理解,上述实施例的各种方法中的全部或部分步骤可以通过指令来完成,或通过指令控制相关的硬件来完成,该指令可以存储于一计算机可读存储介质中,并由处理器进行加载和执行。A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

为此,本申请实施例提供一种计算机可读存储介质,其中存储有多条计算机程序,该计算机程序能够被处理器进行加载,以执行本申请实施例所提供的任一种点云数据处理方法中的步骤。To this end, an embodiment of the present application provides a computer-readable storage medium, in which multiple computer programs are stored. The computer programs can be loaded by a processor to execute the steps in any point cloud data processing method provided in the embodiment of the present application.

其中,该计算机可读存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取记忆体(RAM,Random Access Memory)、磁盘或光盘等。Among them, the computer readable storage medium may include: read-only memory (ROM), random access memory (RAM), disk or CD, etc.

在上述点云数据处理装置、计算机可读存储介质、电子设备实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的点云数据处理装置、计算机可读存储介质、电子设备及其相应单元的具体工作过程及可带来的有益效果,可以参考如上实施例中点云数据处理方法的说明,具体在此不再赘述。In the above-mentioned point cloud data processing device, computer-readable storage medium, and electronic device embodiments, the description of each embodiment has its own emphasis. For parts not described in detail in a certain embodiment, reference can be made to the relevant description of other embodiments. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working process and beneficial effects of the above-mentioned point cloud data processing device, computer-readable storage medium, electronic device and its corresponding units can refer to the description of the point cloud data processing method in the above embodiment, and will not be repeated here.

以上对本申请实施例所提供的一种点云数据处理方法、装置、电子设备和计算机可读存储介质进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想,并非用于限定本申请的保护范围。此外,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均可以有改变之处,这些改变也应包含在本申请的保护范围之内。综上所述,本说明书内容不应理解为对本申请的限制。 The above is a detailed introduction to a point cloud data processing method, device, electronic device and computer-readable storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core ideas of the present application, and is not used to limit the scope of protection of the present application. In addition, for those skilled in the art, according to the ideas of the present application, there may be changes in the specific implementation methods and scope of application, and these changes should also be included in the scope of protection of the present application. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims (10)

一种点云数据处理方法,其特征在于,所述方法包括:A point cloud data processing method, characterized in that the method comprises: 将待处理区域的原始点云数据投影至预设网格化平面,得到所述原始点云数据的投影点云;Projecting the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data; 基于所述投影点云中每个投影点的高度值和平面坐标,获取所述原始点云数据的目标结构数据,其中,所述目标结构数据包括所述原始点云数据所落入的每个平面网格的结构数据,所述每个平面网格的结构数据包括所述每个平面网格的平面坐标、投影点个数,所述每个平面网格的结构数据还包括所述每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值中的至少一者;Based on the height value and plane coordinates of each projection point in the projected point cloud, the target structure data of the original point cloud data is obtained, wherein the target structure data includes the structure data of each plane grid into which the original point cloud data falls, the structure data of each plane grid includes the plane coordinates of each plane grid and the number of projection points, and the structure data of each plane grid also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid; 基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据;Performing point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data; 对所述处理后结构数据进行还原,得到所述原始点云数据的处理后点云数据。The processed structural data is restored to obtain processed point cloud data of the original point cloud data. 根据权利要求1所述的点云数据处理方法,其特征在于,所述处理后结构数据包括干扰点结构数据,所述每个平面网格的结构数据包括所述每个平面网格的点云曲率和点云高度方差值;The point cloud data processing method according to claim 1, characterized in that the processed structural data includes interference point structural data, and the structural data of each plane grid includes the point cloud curvature and point cloud height variance value of each plane grid; 所述基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据,包括:The step of performing point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data includes: 遍历所述原始点云数据所落入的每个平面网格,检测当前平面网格的点云曲率;Traversing each plane grid into which the original point cloud data falls, and detecting the point cloud curvature of the current plane grid; 检测所述当前平面网格的点云高度方差值;Detecting the point cloud height variance value of the current plane grid; 若所述当前平面网格的点云曲率大于预设曲率阈值且点云高度方差值大于预设方差阈值,则将所述当前平面网格的结构数据确定为所述原始点云数据的干扰点结构数据。If the point cloud curvature of the current plane mesh is greater than a preset curvature threshold and the point cloud height variance value is greater than a preset variance threshold, the structural data of the current plane mesh is determined as the interference point structural data of the original point cloud data. 根据权利要求1所述的点云数据处理方法,其特征在于,所述处理后结构数据包括边界结构数据,所述每个平面网格的结构数据包括所述每个平面网格的点云高度平均值;The point cloud data processing method according to claim 1, characterized in that the processed structural data includes boundary structural data, and the structural data of each plane grid includes the average value of the point cloud height of each plane grid; 所述基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据,包括:The step of performing point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data includes: 遍历所述原始点云数据所落入的每个平面网格,获取当前平面网格的点云高度平均值与所述当前平面网格的相邻平面网格的点云高度平均值之间的差值; Traversing each plane grid into which the original point cloud data falls, obtaining a difference between an average point cloud height of a current plane grid and an average point cloud height of adjacent plane grids of the current plane grid; 若所述差值大于预设差值阈值,则将所述当前平面网格的结构数据作为所述原始点云数据的边界结构数据。If the difference is greater than a preset difference threshold, the structural data of the current plane grid is used as the boundary structural data of the original point cloud data. 根据权利要求1所述的点云数据处理方法,其特征在于,所述处理后结构数据包括过滤后的结构数据,所述基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据,包括:The point cloud data processing method according to claim 1, characterized in that the processed structural data includes filtered structural data, and the point cloud processing based on the target structural data to obtain the processed structural data of the original point cloud data includes: 基于所述目标结构数据进行干扰点识别,得到所述原始点云数据的干扰点结构数据;Perform interference point identification based on the target structure data to obtain interference point structure data of the original point cloud data; 基于所述目标结构数据进行边界点识别,得到原始点云数据的边界结构数据;Perform boundary point recognition based on the target structure data to obtain boundary structure data of the original point cloud data; 基于所述干扰点结构数据和所述边界结构数据,进行干扰物区域识别,得到所述原始点云数据的干扰物结构数据;Based on the interference point structure data and the boundary structure data, interference area recognition is performed to obtain interference structure data of the original point cloud data; 将所述干扰物结构数据从所述目标结构数据滤除,得到所述原始点云数据的过滤后的结构数据。The interference structure data is filtered out from the target structure data to obtain filtered structure data of the original point cloud data. 根据权利要求1所述的点云数据处理方法,其特征在于,所述处理后结构数据包括过滤后的结构数据,所述基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据,包括:The point cloud data processing method according to claim 1, characterized in that the processed structural data includes filtered structural data, and the point cloud processing based on the target structural data to obtain the processed structural data of the original point cloud data includes: 基于所述目标结构数据进行干扰点识别,得到所述原始点云数据的干扰点结构数据;以及,将所述干扰点结构数据从所述目标结构数据滤除,得到所述原始点云数据的过滤后的结构数据;Identifying interference points based on the target structure data to obtain interference point structure data of the original point cloud data; and filtering the interference point structure data from the target structure data to obtain filtered structure data of the original point cloud data; 或者,or, 基于所述目标结构数据进行边界点识别,得到原始点云数据的边界结构数据;以及,将所述边界结构数据从所述目标结构数据滤除,得到所述原始点云数据的过滤后的结构数据。Boundary point recognition is performed based on the target structure data to obtain boundary structure data of the original point cloud data; and the boundary structure data is filtered out from the target structure data to obtain filtered structure data of the original point cloud data. 根据权利要求1-5中任一项所述的点云数据处理方法,其特征在于,所述基于所述投影点云中每个投影点的点云高度值和平面坐标,获取所述原始点云数据的目标结构数据,包括:The point cloud data processing method according to any one of claims 1 to 5, characterized in that the step of acquiring target structure data of the original point cloud data based on the point cloud height value and plane coordinates of each projection point in the projected point cloud comprises: 基于所述每个投影点的平面坐标,获取所述每个平面网格的目标投影点;Based on the plane coordinates of each projection point, obtaining the target projection point of each plane grid; 统计所述每个平面网格的目标投影点的个数,作为所述每个平面网格的投影点个数;Counting the number of target projection points of each plane grid as the number of projection points of each plane grid; 基于所述目标投影点的高度值,获取所述每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值; Based on the height value of the target projection point, obtain the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid; 按照预设的数据存储格式,对所述每个平面网格的平面坐标、投影点个数、点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值进行存储,形成所述每个平面网格的结构数据,得到所述目标结构数据。According to a preset data storage format, the plane coordinates, the number of projection points, the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid are stored to form the structural data of each plane grid and obtain the target structural data. 根据权利要求1所述的点云数据处理方法,其特征在于,所述每个平面网格的平面坐标通过如下步骤获取得到:The point cloud data processing method according to claim 1 is characterized in that the plane coordinates of each plane grid are obtained by the following steps: 获取所述每个平面网格在预设平面坐标系中的第一坐标轴的最小值;Obtaining the minimum value of the first coordinate axis of each plane grid in a preset plane coordinate system; 获取所述每个平面网格在预设平面坐标系中的第二坐标轴的最小值;Obtaining the minimum value of the second coordinate axis of each plane grid in the preset plane coordinate system; 基于所述第一坐标轴的最小值和所述第二坐标轴的最小值,得到所述每个平面网格的平面坐标。The plane coordinates of each plane grid are obtained based on the minimum value of the first coordinate axis and the minimum value of the second coordinate axis. 一种点云数据处理装置,其特征在于,所述点云数据处理装置包括:A point cloud data processing device, characterized in that the point cloud data processing device comprises: 第一获取单元,用于将待处理区域的原始点云数据投影至预设网格化平面,得到所述原始点云数据的投影点云;A first acquisition unit is used to project the original point cloud data of the area to be processed onto a preset grid plane to obtain a projected point cloud of the original point cloud data; 第二获取单元,用于基于所述投影点云中每个投影点的高度值和平面坐标,获取所述原始点云数据的目标结构数据,其中,所述目标结构数据包括所述原始点云数据所落入的每个平面网格的结构数据,所述每个平面网格的结构数据包括所述每个平面网格的平面坐标、投影点个数,所述每个平面网格的结构数据还包括所述每个平面网格的点云曲率、点云高度最大值、点云高度最小值、点云高度平均值以及点云高度方差值中的至少一者;A second acquisition unit is used to acquire target structural data of the original point cloud data based on the height value and plane coordinates of each projection point in the projected point cloud, wherein the target structural data includes structural data of each plane grid into which the original point cloud data falls, the structural data of each plane grid includes the plane coordinates and the number of projection points of each plane grid, and the structural data of each plane grid also includes at least one of the point cloud curvature, the maximum point cloud height, the minimum point cloud height, the average point cloud height and the point cloud height variance value of each plane grid; 处理单元,用于基于所述目标结构数据进行点云处理,得到所述原始点云数据的处理后结构数据;A processing unit, configured to perform point cloud processing based on the target structure data to obtain processed structure data of the original point cloud data; 还原单元,用于对所述处理后结构数据进行还原,得到所述原始点云数据的处理后点云数据。The restoration unit is used to restore the processed structural data to obtain processed point cloud data of the original point cloud data. 一种电子设备,其特征在于,包括处理器和存储器,所述存储器中存储有计算机程序,所述处理器调用所述存储器中的计算机程序时执行如权利要求1至7任一项所述的点云数据处理方法。An electronic device, characterized in that it includes a processor and a memory, wherein a computer program is stored in the memory, and when the processor calls the computer program in the memory, the point cloud data processing method according to any one of claims 1 to 7 is executed. 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被处理器进行加载,以执行权利要求1至7任一项所述的点云数据处理方法。 A computer-readable storage medium, characterized in that a computer program is stored thereon, and the computer program is loaded by a processor to execute the point cloud data processing method according to any one of claims 1 to 7.
PCT/CN2023/129319 2022-11-03 2023-11-02 Point cloud data processing method and apparatus, electronic device, and storage medium Ceased WO2024094118A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211367567.3A CN118037830A (en) 2022-11-03 2022-11-03 Point cloud data processing method, device, electronic device and storage medium
CN202211367567.3 2022-11-03

Publications (1)

Publication Number Publication Date
WO2024094118A1 true WO2024094118A1 (en) 2024-05-10

Family

ID=90929818

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/129319 Ceased WO2024094118A1 (en) 2022-11-03 2023-11-02 Point cloud data processing method and apparatus, electronic device, and storage medium

Country Status (2)

Country Link
CN (1) CN118037830A (en)
WO (1) WO2024094118A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119206091A (en) * 2024-11-26 2024-12-27 福建自贸试验区厦门片区Manteia数据科技有限公司 Three-dimensional point cloud processing method, device, electronic device and storage medium
CN120014158A (en) * 2025-01-13 2025-05-16 浙江大学 A complex surface reconstruction method for bridge digital twin model based on 3D point cloud
CN120782841A (en) * 2025-07-03 2025-10-14 军事科学院系统工程研究院后勤科学与技术研究所 Data processing method and device for warehouse goods

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130181983A1 (en) * 2010-06-25 2013-07-18 Kabushiki Kaisha Topcon Point cloud data processing device, point cloud data processing system, point cloud data processing method, and point cloud data processing program
CN111639626A (en) * 2020-06-11 2020-09-08 深圳市泰沃德自动化技术有限公司 Three-dimensional point cloud data processing method and device, computer equipment and storage medium
CN113066004A (en) * 2021-03-19 2021-07-02 广东博智林机器人有限公司 Point cloud data processing method and device
CN114693696A (en) * 2020-12-29 2022-07-01 华为技术有限公司 Point cloud data processing method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130181983A1 (en) * 2010-06-25 2013-07-18 Kabushiki Kaisha Topcon Point cloud data processing device, point cloud data processing system, point cloud data processing method, and point cloud data processing program
CN111639626A (en) * 2020-06-11 2020-09-08 深圳市泰沃德自动化技术有限公司 Three-dimensional point cloud data processing method and device, computer equipment and storage medium
CN114693696A (en) * 2020-12-29 2022-07-01 华为技术有限公司 Point cloud data processing method and device
CN113066004A (en) * 2021-03-19 2021-07-02 广东博智林机器人有限公司 Point cloud data processing method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119206091A (en) * 2024-11-26 2024-12-27 福建自贸试验区厦门片区Manteia数据科技有限公司 Three-dimensional point cloud processing method, device, electronic device and storage medium
CN120014158A (en) * 2025-01-13 2025-05-16 浙江大学 A complex surface reconstruction method for bridge digital twin model based on 3D point cloud
CN120782841A (en) * 2025-07-03 2025-10-14 军事科学院系统工程研究院后勤科学与技术研究所 Data processing method and device for warehouse goods

Also Published As

Publication number Publication date
CN118037830A (en) 2024-05-14

Similar Documents

Publication Publication Date Title
WO2024094118A1 (en) Point cloud data processing method and apparatus, electronic device, and storage medium
CN112329740B (en) Image processing method, image processing apparatus, storage medium, and electronic device
CN111274039B (en) Memory recycling method and device, storage medium and electronic equipment
CN111381953B (en) Process management method and device, storage medium and electronic equipment
CN115174890B (en) Flow playback testing method and device, computer equipment and storage medium
CN117632856A (en) Data processing methods, devices, electronic equipment and storage media
CN108829600B (en) Test method, device, storage medium and electronic device for algorithm library
WO2023155348A1 (en) Game data processing method and apparatus, computer device, and storage medium
CN115098468B (en) Flexible data migration method and device, storage medium and electronic equipment
CN113419795B (en) Call relation display method and device, computer equipment and storage medium
CN118276765A (en) Data cache queue processing method, device, electronic device and storage medium
CN116452651A (en) Image processing method, device, equipment and computer readable storage medium
CN115858330A (en) Software architecture quality evaluation method and device, electronic equipment and storage medium
CN115134523A (en) Remote control method, device, operation terminal, control device and storage medium
CN115861454A (en) Method and device for storing patch position information, electronic equipment and storage medium
CN114461153A (en) Security video data processing method and device, electronic equipment and storage medium
CN113961585A (en) Data processing method, apparatus, electronic device and storage medium
CN118379419B (en) Processing method and device of virtual object model, computer equipment and storage medium
CN114625522A (en) Object processing method, device, storage medium and computer equipment
CN119299842A (en) Camera startup method, device, terminal equipment and computer-readable storage medium
CN116681846A (en) Map generation method and device, electronic equipment and storage medium
CN114159782A (en) Method and device for determining placement position of game model, terminal and storage medium
CN118505928A (en) Model operation method, device, storage medium and computer equipment
CN118227628A (en) Building data updating method and device, electronic equipment and storage medium
CN119045714A (en) Message deduplication method, message deduplication device, computer equipment and computer readable storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23885044

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 23885044

Country of ref document: EP

Kind code of ref document: A1