[go: up one dir, main page]

WO2025217757A1 - Encoding method, decoding method, bit stream, decoder, encoder, and storage medium - Google Patents

Encoding method, decoding method, bit stream, decoder, encoder, and storage medium

Info

Publication number
WO2025217757A1
WO2025217757A1 PCT/CN2024/087747 CN2024087747W WO2025217757A1 WO 2025217757 A1 WO2025217757 A1 WO 2025217757A1 CN 2024087747 W CN2024087747 W CN 2024087747W WO 2025217757 A1 WO2025217757 A1 WO 2025217757A1
Authority
WO
WIPO (PCT)
Prior art keywords
attribute
value
point
current point
reconstruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/087747
Other languages
French (fr)
Chinese (zh)
Inventor
元辉
王泽涵
魏毓轩
李明
邹丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to PCT/CN2024/087747 priority Critical patent/WO2025217757A1/en
Publication of WO2025217757A1 publication Critical patent/WO2025217757A1/en
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression

Definitions

  • the embodiments of the present application relate to the field of video coding and decoding technology, and in particular to a coding and decoding method, a bit stream, a decoder, an encoder, and a storage medium.
  • one type of already encoded attribute information is often used to guide the encoding of another type of attribute information.
  • one type of attribute information is already encoded and another type of attribute information is encoded, there is still a lot of redundancy between the two types of attribute information, which results in a waste of bit rate and affects the encoding and decoding efficiency.
  • the embodiments of the present application provide a coding and decoding method, a code stream, a decoder, an encoder, and a storage medium, which can improve the utilization of the code rate and thus improve the coding and decoding efficiency.
  • an embodiment of the present application provides a decoding method, applied to a decoder, the method comprising:
  • an embodiment of the present application provides an encoding method, applied to an encoder, the method comprising:
  • the first syntax element information is coded and the obtained coded bits are written into a bitstream.
  • an embodiment of the present application provides a code stream, which is generated by bit encoding based on information to be encoded; wherein the information to be encoded includes at least one of the following:
  • First syntax element information, second syntax element information, and third syntax element information are used to indicate the prediction mode adopted by the current point, the second syntax element information is used to indicate the attribute reconstruction order of the current point, and the third syntax element information is used to indicate whether the current point allows the use of a cross-attribute prediction mode.
  • an embodiment of the present application provides a decoder, comprising a decoding part and a first determining part, wherein:
  • the decoding part is configured to decode the code stream and determine the first syntax element information of the current point
  • the first determination part is configured to determine, from the candidate prediction modes, the best prediction mode of the current point as the target cross-attribute prediction mode according to the value of the first syntax element information; determine one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determine the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determine the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient according to the attribute reference value of the attribute to be decoded at the current point; Attribute prediction value.
  • an encoder comprising an encoding part and a second determining part, wherein:
  • the second determination part is configured to determine the candidate cross-attribute prediction mode of the current point from the candidate prediction modes; determine one or more attribute reconstruction values of the candidate neighboring points of the current point according to the candidate cross-attribute prediction mode; determine the correlation coefficient of the candidate neighboring points according to the one or more attribute reconstruction values of the candidate neighboring points; determine the attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; make a coding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to the one or more candidate cross-attribute prediction modes, and determine the best prediction mode of the current point as the target cross-attribute prediction mode; determine the value of the first syntax element information of the current point according to the best prediction mode;
  • the encoding part is configured to perform encoding processing on the first syntax element information and write the obtained encoded bits into a bitstream.
  • an embodiment of the present application provides a decoder, comprising a first memory and a first processor, wherein:
  • the first memory is configured to store a computer program that can be executed on the first processor
  • the first processor is configured to execute the method according to the first aspect when running the computer program.
  • an encoder comprising a second memory and a second processor, wherein:
  • the second memory is configured to store a computer program that can be executed on the second processor
  • the second processor is configured to execute the method according to the second aspect when running the computer program.
  • an embodiment of the present application provides a computer-readable storage medium, which stores a computer program.
  • the computer program When executed, it implements the method described in the first aspect or the second aspect.
  • the embodiment of the present application provides a coding and decoding method, a code stream, a decoder, an encoder and a storage medium.
  • the decoding method includes: decoding the code stream, determining the first syntax element information of the current point; determining the best prediction mode of the current point as the target cross-attribute prediction mode from the candidate prediction modes according to the value of the first syntax element information; determining one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determining the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determining the attribute prediction value of the attribute to be decoded of the current point according to the attribute reference value and the correlation coefficient of the attribute to be decoded of the current point.
  • the candidate cross-attribute prediction mode of the current point is determined from the candidate prediction mode; on the one hand, by determining the attribute prediction value of the attribute to be decoded of the current point through the target cross-attribute prediction mode and the correlation coefficient of the target neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information, thereby reducing the amount of data to be transmitted during encoding, thereby reducing the waste of bit rate.
  • the process of predicting the attribute reconstruction value of the attribute to be decoded at the current point it is determined based on the correlation coefficient of the target neighboring point of the current point and the attribute reference value of the attribute to be decoded at the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of decoding.
  • the encoding method includes: determining one or more attribute reconstruction values of candidate neighboring points of the current point based on candidate cross-attribute prediction modes; determining the correlation coefficient of the candidate neighboring points based on the one or more attribute reconstruction values of the candidate neighboring points; determining the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value and correlation coefficient of the attribute to be encoded at the current point; making an encoding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the optimal prediction mode for the current point as the target cross-attribute prediction mode; determining the value of the first syntax element information of the current point based on the optimal prediction mode; encoding the first syntax element information and writing the resulting coded bits into the bitstream.
  • the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information, thereby reducing the amount of data required to be transmitted during encoding, and thus reducing bit rate waste.
  • the process of predicting the attribute reconstruction value of the attribute to be encoded at the current point it is determined based on the correlation coefficient of the candidate neighboring points of the current point and the attribute reference value of the attribute to be encoded at the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of coding.
  • FIG1A is a schematic diagram of a three-dimensional point cloud image provided in an embodiment of the present application.
  • FIG1B is a partially enlarged view of a three-dimensional point cloud image provided in an embodiment of the present application.
  • FIG2A is a schematic diagram of six viewing angles of a point cloud image provided by an embodiment of the present application.
  • FIG2B is a schematic diagram of a data storage format corresponding to a point cloud image provided in an embodiment of the present application.
  • FIG3 is a schematic diagram of a network architecture of point cloud encoding and decoding provided by an embodiment of the present application
  • FIG4A is a schematic diagram of a composition framework of a G-PCC encoder provided in an embodiment of the present application.
  • FIG4B is a schematic diagram of a composition framework of a G-PCC decoder provided in an embodiment of the present application.
  • FIG5 is a schematic diagram of a PT encoding process provided in an embodiment of the present application.
  • FIG6 is a schematic diagram of a distance-based LoD generation process provided in an embodiment of the present application.
  • FIG7 is a first flow chart of a method for determining an optimal prediction mode according to an embodiment of the present application.
  • FIG8 is a flowchart diagram of a decoding method provided in an embodiment of the present application.
  • FIG9 is a schematic diagram of a correlation between brightness and reflectivity provided in an embodiment of the present application.
  • FIG10 is a second flow chart of a decoding method provided in an embodiment of the present application.
  • FIG11 is a schematic diagram of a flow chart of an encoding method provided in an embodiment of the present application.
  • FIG12 is a second schematic diagram of a process for determining an optimal prediction mode according to an embodiment of the present application.
  • FIG13 is a schematic diagram of a flow chart of an encoding end implementation provided in an embodiment of the present application.
  • FIG14 is a schematic diagram of a process flow implemented by a decoding end according to an embodiment of the present application.
  • FIG15 is a schematic diagram of the structure of a decoder provided in an embodiment of the present application.
  • FIG16 is a schematic diagram of a specific hardware structure of a decoder provided in an embodiment of the present application.
  • FIG17 is a schematic diagram of the structure of an encoder provided in an embodiment of the present application.
  • FIG18 is a schematic diagram of a specific hardware structure of an encoder provided in an embodiment of the present application.
  • FIG19 is a schematic diagram of the composition structure of a coding and decoding system provided in an embodiment of the present application.
  • first ⁇ second ⁇ third involved in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that “first ⁇ second ⁇ third” can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
  • Point Cloud is a three-dimensional representation of the surface of an object.
  • Point Cloud (data) on the surface of an object can be collected through acquisition equipment such as photoelectric radar, lidar, laser scanner, and multi-view camera.
  • a point cloud is a set of irregularly distributed discrete points in space that express the spatial structure and surface properties of a three-dimensional object or scene.
  • Figure 1A shows a three-dimensional point cloud image
  • Figure 1B shows a partially enlarged view of the three-dimensional point cloud image. It can be seen that the point cloud surface is composed of densely distributed points.
  • each pixel In a two-dimensional image, each pixel contains information and is distributed regularly, so there's no need to record its location. However, the distribution of points in a point cloud in three-dimensional space is random and irregular, so recording the location of each point in space is necessary to fully represent the point cloud. Similar to a two-dimensional image, each location in the acquisition process has corresponding attribute information, typically an RGB color value, which reflects the object's color. For a point cloud, in addition to color information, each point's corresponding attribute information often includes reflectance values, which reflect the surface texture of the object. Therefore, point cloud data typically includes both point location information and point attribute information. Point location information can also be referred to as point geometric information.
  • point geometric information can be the point's three-dimensional coordinates (x, y, z).
  • Point attribute information can include color information and/or reflectance.
  • reflectance can be one-dimensional reflectance information (r).
  • Color information can be information in any color space, or it can be three-dimensional color information, such as RGB.
  • R represents red (R)
  • G represents green (G)
  • B represents blue (B).
  • the color information may be luminance and chrominance (YCbCr, YUV) information, where Y represents brightness (Luma), Cb (U) represents blue color difference, and Cr (V) represents red color difference.
  • a point cloud generated using laser measurement principles can include both its 3D coordinate information and its reflectivity.
  • a point cloud generated using photogrammetry principles can include both its 3D coordinate information and its 3D color information.
  • a point cloud generated using a combination of laser measurement and photogrammetry principles can include both its 3D coordinate information, its reflectivity value, and its 3D color information.
  • Figures 2A and 2B show a point cloud image and its corresponding data storage format.
  • Figure 2A provides six viewing angles of the point cloud image
  • Figure 2B consists of a file header and data.
  • the header includes the data format, data representation type, the total number of points in the point cloud, and the content represented by the point cloud.
  • the point cloud is in ".ply" format, represented by ASCII code, with a total of 207,242 points.
  • Each point has 3D coordinate information (x, y, z) and 3D color information (r, g, b).
  • Point clouds can be divided into the following categories according to the acquisition method:
  • Static point cloud the object is stationary and the device that acquires the point cloud is also stationary;
  • Dynamic point cloud The object is moving, but the device that obtains the point cloud is stationary;
  • Dynamic point cloud acquisition The device used to acquire the point cloud is in motion.
  • point clouds can be divided into two categories according to their usage:
  • Category 1 Machine perception point cloud, which can be used in scenarios such as autonomous navigation systems, real-time inspection systems, geographic information systems, visual sorting robots, and disaster relief robots;
  • Category 2 Human eye perception point cloud, which can be used in point cloud application scenarios such as digital cultural heritage, free viewpoint broadcasting, 3D immersive communication, and 3D immersive interaction.
  • Point clouds can flexibly and conveniently express the spatial structure and surface properties of three-dimensional objects or scenes. Moreover, since point clouds are obtained by directly sampling real objects, they can provide a strong sense of reality while ensuring accuracy. Therefore, they are widely used, including virtual reality games, computer-aided design, geographic information systems, automatic navigation systems, digital cultural heritage, free viewpoint broadcasting, three-dimensional immersive remote presentation, and three-dimensional reconstruction of biological tissues and organs.
  • Point clouds are primarily collected through computer generation, 3D laser scanning, and 3D photogrammetry.
  • Computers can generate point clouds of virtual 3D objects and scenes; 3D laser scanning can obtain point clouds of static real-world 3D objects or scenes, generating millions of point clouds per second; and 3D photogrammetry can obtain point clouds of dynamic real-world 3D objects or scenes, generating tens of millions of point clouds per second.
  • 3D photogrammetry can obtain point clouds of dynamic real-world 3D objects or scenes, generating tens of millions of point clouds per second.
  • the data volume for 10 seconds is approximately 1280 ⁇ 720 ⁇ 12 bits ⁇ 24 fps ⁇ 10 seconds ⁇ 0.33 GB.
  • the point cloud is a collection of massive points, storing the point cloud not only consumes a lot of memory, but is also not conducive to transmission. There is also not enough bandwidth to support direct transmission of the point cloud at the network layer without compression. Therefore, the point cloud needs to be compressed.
  • point cloud coding frameworks that can compress point clouds can be the Geometry-based Point Cloud Compression (G-PCC) codec framework or the Video-based Point Cloud Compression (V-PCC) codec framework provided by the Moving Picture Experts Group (MPEG), or the AVS-PCC codec framework provided by AVS.
  • G-PCC codec framework can be used to compress the first type of static point clouds and the third type of dynamically acquired point clouds, and can be based on the Point Cloud Compression Test Platform (Test Model Compression 13, TMC13).
  • the V-PCC codec framework can be used to compress the second type of dynamic point clouds, and can be based on the Point Cloud Compression Test Platform (Test Model Compression 2, TMC2). Therefore, the G-PCC codec framework is also called the Point Cloud Codec TMC13, and the V-PCC codec framework is also called the Point Cloud Codec TMC2.
  • FIG3 is a schematic diagram of a network architecture of a point cloud encoding and decoding system provided by an embodiment of the present application.
  • the network architecture includes one or more electronic devices 13 to 1N and a communication network 01, wherein the electronic devices 13 to 1N can perform video interaction through the communication network 01.
  • the electronic device can be various types of devices with point cloud encoding and decoding functions.
  • the electronic device can include a mobile phone, a tablet computer, a personal computer, a personal digital assistant, a navigator, a digital phone, a video phone, a television, a sensor device, a server, etc., which is not limited by the embodiment of the present application.
  • the decoder or encoder in the embodiment of the present application can be the above-mentioned electronic device.
  • the electronic device in the embodiment of the present application has a point cloud encoding and decoding function, generally including a point cloud encoder (ie, encoder) and a point cloud decoder (ie, decoder).
  • a point cloud encoder ie, encoder
  • a point cloud decoder ie, decoder
  • the point cloud data to be encoded is first divided into multiple slices through slice partitioning.
  • the geometric information of the point cloud and the attribute information corresponding to each point are encoded separately.
  • Figure 4A shows a schematic diagram of the G-PCC encoder's architecture.
  • the geometric information is transformed so that the entire point cloud is contained within a bounding box.
  • Quantization is then performed. This quantization step primarily serves a scaling purpose. Due to quantization rounding, the geometric information of some point clouds becomes identical. Parameters are then used to determine whether to remove duplicate points. This process of quantization and removing duplicate points is also known as voxelization.
  • the bounding box is then partitioned into an octree or constructed as a prediction tree. During this process, arithmetic coding is performed on the points within the leaf nodes of the partition to generate a binary geometry bitstream.
  • arithmetic coding is performed on the intersection points (vertices) generated by the partition (surface fitting is performed based on the intersection points) to generate a binary geometry bitstream.
  • color conversion is performed to convert the color information (i.e., attribute information) from the RGB color space to the YUV color space.
  • the reconstructed geometry information is then used to recolor the point cloud so that the unencoded attribute information corresponds to the reconstructed geometry information.
  • Attribute encoding is mainly performed on color information. In the process of color information encoding, the main There are two transformation methods.
  • One is a distance-based lifting transform that relies on the level of detail (LOD) division, and the other is a direct region adaptive hierarchical transform (RAHT) followed by arithmetic coding of the quantized coefficients to generate a binary attribute bitstream.
  • LOD level of detail
  • RAHT direct region adaptive hierarchical transform
  • Figure 4B shows a schematic diagram of the composition framework of a G-PCC decoder.
  • the geometric bit stream and attribute bit stream in the binary bit stream are first decoded independently.
  • the geometric information of the point cloud is obtained through arithmetic decoding-reconstruction of the octree/reconstruction of the prediction tree-reconstruction of the geometry-coordinate inverse conversion;
  • the attribute information of the point cloud is obtained through arithmetic decoding-inverse quantization-LOD partitioning/RAHT-color inverse conversion, and the point cloud data to be encoded (i.e., the output point cloud) is restored based on the geometric information and attribute information.
  • predictive transform (PT) encoding of point cloud attribute information is a technique used for point cloud data compression. It combines attribute prediction and transform coding methods to achieve efficient compression of point cloud data. Specifically, attributes in the point cloud data are first predicted. This can be done by analyzing the attribute values of neighboring points or leveraging prior knowledge. The goal of prediction is to estimate the value of each attribute in the point cloud as accurately as possible for subsequent compression and encoding. After prediction, the predicted attribute value is compared with the original attribute value to obtain the prediction error or residual. Next, entropy encoding is performed on the quantized coefficients, typically using techniques such as Huffman coding or arithmetic coding to further compress the data.
  • the receiver decodes and decompresses the encoded data, recovering the prediction error and adding it to the predicted value to obtain the reconstructed attribute value.
  • the resulting reconstructed attribute value can be used to restore the original point cloud data.
  • PT encoding effectively leverages the attribute correlation and predictability in point cloud data, achieving efficient compression and transmission of point cloud data.
  • FIG5 is a schematic diagram of a PT encoding process provided by an embodiment of the present application.
  • the original point cloud is divided into levels of detail (LoDs) according to the LoD generation order.
  • the attributes of the current point to be encoded are predicted using the reconstructed points (the three nearest neighbors of the i-th point).
  • the prediction residual of the current point to be encoded is obtained by subtracting the attribute prediction value from the original attribute value of the i-th point.
  • the prediction residual is quantized and entropy coded to generate an attribute code stream.
  • Step 1 LoD generation:
  • the G-PCC software platform currently uses a distance-based LoD construction method.
  • the original sequence includes the following points: P1, P2, P3, P4, P5, P6, P7, P8, P9, and P10.
  • the LoD sequence includes three refinement levels: LoD1, LoD2, and LoD3.
  • (R l ) l 0...L-1 represents the refinement level, and L is the number of LoD levels.
  • the specific steps for constructing LoD are as follows:
  • all points are traversed. If the current point has been visited, it is ignored. Otherwise, the minimum distance D between the current point and the point set V is calculated. If D is less than dl , the current point is ignored. Otherwise, the current point is marked as visited and added to Rl and V. The above process is repeated until all points have been traversed.
  • Step 2 Select the optimal prediction value:
  • the process of determining the optimal prediction mode in the related art includes S11 to S17:
  • the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the LoD generation order.
  • the attribute reconstructed values of these three nearest neighboring points are used as candidate prediction values of the current point to be encoded.
  • the maximum attribute difference max_difference of the three candidate neighbors is calculated. If the maximum attribute difference is greater than a preset threshold (adaptive threshold adaptive_threshold), S13 is executed. If the maximum attribute difference is less than or equal to the preset threshold (adaptive threshold adaptive_threshold), S14 is executed.
  • the optimal prediction value is selected according to Rate-Distortion Optimal (RDO).
  • RDO Rate-Distortion Optimal
  • the three neighboring points are considered to have attribute values close to the predicted point, and thus mode 0 weighted prediction is adopted.
  • the mode corresponding to the minimum cost score among the scores of modes 0 to 3 is taken as the best prediction mode.
  • Table 1 is a schematic table of candidate prediction modes for attribute coding provided in an embodiment of the present application.
  • the attribute prediction value of the point to be coded (also called the current point or the node before the point) is the weighted average of the attributes of the three nearest neighbors of the point to be coded.
  • the attribute prediction value of the point to be coded is the attribute value of the first nearest neighbor of the point to be coded.
  • the attribute prediction value of the point to be coded is the attribute value of the second nearest neighbor of the point to be coded.
  • the attribute prediction value of the point to be coded is the attribute value of the third nearest neighbor of the point to be coded.
  • the prediction variable index of the attribute value of the nearest neighbor point P2 is set to 1; the attribute prediction variable indexes of the second nearest neighbor point P7 and the third nearest neighbor point P10 are set to 2 and 3 respectively; and the prediction variable index of the weighted average value of points P2, P7 and P10 is set to 0.
  • the weighted average for prediction mode 0 can be expressed by formula (1) and formula (2):
  • formula (1) and formula (2) represents the attribute prediction value of the current point i
  • j represents the index of the three neighboring points (also called neighboring points)
  • x i , y ij and z ij represent the geometric position coordinates of the neighboring point j
  • x i , y i and z i represent the geometric position coordinates of the current point i.
  • Step 3 Attribute prediction residual and quantification:
  • the attribute prediction value of the current point i is obtained through steps 1 and 2.
  • (k is the total number of points in the point cloud).
  • the attribute prediction residual of the current point i is quantized by formula (4):
  • ri represents the attribute prediction residual of the current point i
  • Qs represents the quantization step (Qs)
  • Qi represents the quantized attribute prediction residual of the current point i.
  • the quantization step Qs can be calculated using the quantization parameter (QP) specified by the connectionless transport protocol (CTC).
  • the G-PCC software platform uses a LoD construction method based on Euclidean distance.
  • point cloud sequences Adaptive Multi-resolution Fused Point Cloud Sequences, Am-fused point cloud sequences
  • adaptive multi-resolution characteristics and fused processing containing multiple attributes color, reflectivity
  • the prediction of the other attribute can be guided by the already encoded attribute. For example, if the reflectivity values of two points in the reconstructed point cloud are very different, it should be assumed that the color information of the two points is also very different.
  • G-PCC modified the LoD construction method in the multi-attribute point cloud.
  • maxGeom represents the sum of the length, width, and height of the bounding box of the block
  • maxAttr represents the maximum value of the encoded attribute
  • represents a parameter that balances the importance of geometry and attributes
  • the value of attrDis is the difference in the encoded attribute values between the current point and the predicted point
  • geomDis represents the Euclidean distance between the current point and the predicted point
  • geomW is set to 1.
  • intra-frame prediction and inter-frame prediction are widely introduced to remove the temporal and spatial redundancy of point cloud coding.
  • Inter-chrominance prediction is also introduced to remove the redundancy between the chrominance blue component (Cb) and the chrominance red component (Cr).
  • Cb chrominance blue component
  • Cr chrominance red component
  • G-PCC encodes an Am-fused point cloud sequence with multiple attributes (color, reflectivity)
  • the redundancy between the two attributes has not been fully mined and removed.
  • There are related technologies to mine The correlation information between attributes is mined, but it only uses the encoded attribute information to guide the encoding of another attribute. When one attribute has been encoded and another attribute is encoded, there is still a lot of redundancy between the attributes, which will inevitably cause a waste of bit rate.
  • an embodiment of the present application provides a decoding method.
  • the attribute prediction value of the attribute to be decoded of the current point through the correlation coefficient of the target cross-attribute prediction mode and the target neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information. This can reduce the amount of data that needs to be transmitted during encoding, thereby reducing the waste of bit rate.
  • the process of predicting the attribute reconstruction value of the attribute to be decoded of the current point it is determined based on the correlation coefficient of the target neighboring points of the current point and the attribute reference value of the attribute to be decoded of the current point, which can improve the utilization of the bit rate, avoid the waste of bit rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of decoding.
  • FIG8 is a flowchart of a decoding method provided by the embodiment of the present application. As shown in FIG8 , the method may include S101 to S105:
  • S101 Decode a bitstream and determine the first syntax element information of the current point.
  • the decoding method of the embodiment of the present application is applied to the decoder.
  • the decoding method can specifically refer to a method for cross-attribute prediction of lidar point clouds.
  • this is mainly aimed at improving a PT encoding method for single-neighbor cross-attribute prediction to avoid the problem of a large amount of redundancy between the two attribute information when one attribute information has been encoded and another attribute information is encoded in the related art.
  • the current point is also called the current node, the current point to be decoded, the point to be decoded, the current point to be detected, the node to be decoded, etc., and the embodiment of the present application does not impose any limitation on this.
  • the first syntax element information is used to indicate the best prediction mode for the current point, wherein the best prediction mode for the current point can be a cross-attribute prediction mode or a non-cross-attribute prediction mode.
  • the value of the first syntax element information can be in parameter form or in digital form.
  • the first syntax element information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the best prediction mode of the current point is determined to be prediction mode 0; if the value of the first syntax element information is 1, the best prediction mode of the current point is determined to be prediction mode 1.
  • S102 Determine, according to the value of the first syntax element information, the best prediction mode at the current point from the candidate prediction modes as the target cross-attribute prediction mode.
  • the candidate prediction mode includes at least one or more candidate cross-attribute prediction modes.
  • the candidate cross-attribute prediction mode is also referred to as a cross-attribute prediction mode.
  • the target cross-attribute prediction mode is the best prediction mode among one or more candidate cross-attribute prediction modes.
  • the candidate prediction modes may include three candidate cross-attribute prediction modes, prediction mode 1, prediction mode 2, and prediction mode 3.
  • prediction mode 1 is used as the target cross-attribute prediction mode.
  • prediction mode 2 is used as the target cross-attribute prediction mode.
  • prediction mode 3 is used as the target cross-attribute prediction mode.
  • the candidate cross-attribute prediction mode refers to predicting the attribute prediction value of the to-be-decoded attribute of the current point by using one or more attribute reconstruction values of the neighboring points of the current point.
  • the following description is made by taking one or more attribute reconstruction values including a brightness reconstruction value and a reflectivity reconstruction value as an example.
  • the candidate cross-attribute prediction mode may represent the use of the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the brightness reconstruction value of the current point.
  • the cross-attribute prediction mode may represent the use of the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the reflectivity reconstruction value of the current point.
  • the candidate cross-attribute prediction mode uses the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the brightness reconstruction value or reflectivity reconstruction value of the current point.
  • the brightness reconstruction value and reflectivity reconstruction value are not limited to these values and can also be the reconstruction values of other attributes. This embodiment of the present application does not impose any restrictions on this.
  • S103 Determine one or more attribute reconstruction values of target neighboring points of the current point according to the target cross-attribute prediction mode.
  • the target cross-attribute prediction mode corresponds to the target neighbor point, that is, the target neighbor point is the neighbor point corresponding to the target cross-attribute prediction mode among the M neighbor points of the current point.
  • the target cross-attribute prediction mode is related to the target neighbor point.
  • Table 2 is a schematic table 1 of a candidate prediction mode provided in an embodiment of the present application.
  • the target cross-attribute prediction mode when the target cross-attribute prediction mode is prediction mode 1, it indicates that the first neighbor point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.
  • the target cross-attribute prediction mode is prediction mode 2
  • the target cross-attribute prediction mode when the target cross-attribute prediction mode is prediction mode 3, it indicates that the third neighbor point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.
  • the first, second, and third neighbor points in Table 1 are determined according to the RoD generation order.
  • the current point cloud sequence includes the following points: P0, P1, P2, P3, P4, P5, P6, P7, P8, P9, and P10
  • the distance-based LoD construction is performed on the above 11 points to obtain the LoD sequence: P0, P2, P7, P10, P1, P5, P6, P9, P3, P4, and P8.
  • the current point is P0
  • the first neighbor point of P0 is P2
  • the second neighbor point of P0 is P7
  • the third neighbor point of P0 is P10.
  • prediction mode 1 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the first neighboring point of the current point, or prediction mode 1 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the first neighboring point of the current point.
  • Prediction mode 2 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the second neighboring point of the current point, or prediction mode 2 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the second neighboring point of the current point.
  • Prediction mode 3 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the third neighboring point of the current point, or prediction mode 3 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the third neighboring point of the current point.
  • S104 Determine the correlation coefficient of the target neighboring point based on one or more attribute reconstruction values of the target neighboring point.
  • the correlation coefficients of the target neighbor points have the following three cases:
  • the correlation coefficient of the target neighboring points represents the correlation between the reconstructed values of multiple attributes of the target neighboring points.
  • the multiple attribute reconstruction values of the target neighboring point may include: a brightness reconstruction value and a reflectivity reconstruction value.
  • the correlation coefficient of the target neighboring point may represent the correlation between the brightness reconstruction value and the reflectivity reconstruction value of the target neighboring point.
  • Case 2 The correlation coefficient of the target neighboring point represents the correlation between the attribute reconstruction value of the target neighboring point and the attribute reconstruction value of the current point.
  • the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstruction value of the target neighbor point and the brightness reconstruction value of the current point.
  • the correlation coefficient of the target neighbor point can represent the correlation between the reflectivity reconstruction value of the target neighbor point and the reflectivity reconstruction value of the current point.
  • the correlation coefficient of the target neighbor point represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the non-target neighbor point of the current point.
  • the non-target neighbor point is any neighbor point other than the target neighbor point among the M neighbor points of the current point.
  • the non-target neighbor point can be the neighbor point closest to the current point other than the target neighbor point among the M neighbor points of the current point.
  • the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstructed value of the target neighbor point and the brightness reconstructed value of the non-target neighbor point.
  • the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstructed value of the target neighbor point and the reflectivity reconstructed value of the non-target neighbor point.
  • the correlation coefficient of the target neighbor point can represent the correlation between the reflectivity reconstructed value of the target neighbor point and the reflectivity reconstructed value of the non-target neighbor point.
  • S105 Determine the attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value and the correlation coefficient of the attribute to be decoded at the current point.
  • the attribute to be decoded may be brightness or reflectivity.
  • the attribute reference value of the attribute to be decoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be decoded.
  • S106 Determine the attribute reconstruction value of the attribute to be decoded at the current point based on the attribute prediction value of the attribute to be decoded at the current point.
  • the implementation of S106 may include:
  • the attribute prediction difference values of the attribute to be decoded at the current point are added to obtain the attribute reconstruction value of the attribute to be decoded at the current point.
  • the embodiment of the present application provides a decoding method, which includes: decoding a code stream, determining the first syntax element information of the current point; determining the best prediction mode adopted by the current point from the candidate prediction modes as the target cross-attribute prediction mode according to the value of the first syntax element information; determining one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determining the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determining the attribute reference value and the correlation coefficient of the attribute to be decoded of the current point according to ...
  • the predicted attribute value of the attribute to be decoded at the current point is determined based on the predicted attribute value.
  • the reconstructed attribute value of the attribute to be decoded at the current point is determined based on the predicted attribute value.
  • the predicted attribute value of the attribute to be decoded at the current point is determined based on the attribute reference value and the correlation coefficient.
  • the predicted attribute value of the attribute to be decoded is calculated based on the correlation information of the current point's neighboring points and the known attribute values. It serves as the predicted value of the attribute at the current point.
  • the correlation coefficient helps measure the degree of correlation between the attribute to be decoded and the known attributes. A high correlation coefficient indicates a strong linear relationship between the two, and the predicted value more accurately reflects the actual value of the attribute to be decoded. Using the correlation coefficient for prediction avoids unnecessary data transmission and storage.
  • the predicted value will be closer to the actual value of the attribute to be decoded, reducing the transmission and storage of redundant data. This improves bitrate utilization, avoids bitrate waste, and ultimately improves decoding performance.
  • the correlation coefficient in case 1 represents the correlation between the reconstructed values of multiple attributes of the target neighboring points.
  • the correlation coefficient includes a first coefficient; and the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:
  • a first coefficient is determined according to a first attribute reconstruction value of the target neighboring point and a second attribute reconstruction value of the target neighboring point.
  • the attribute corresponding to the first attribute reconstruction value of the target neighbor point is different from the attribute corresponding to the second attribute reconstruction value of the target neighbor point, and the attribute corresponding to the first attribute reconstruction value is correlated with the attribute corresponding to the second attribute reconstruction value.
  • the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction value are different and correlated, meaning that the first attribute reconstruction value and the second attribute reconstruction value are reconstruction values of two different attributes (the first attribute and the second attribute), but the first attribute and the second attribute are correlated.
  • the first attribute can be brightness and the second attribute can be reflectivity.
  • brightness generally refers to the intensity or brightness of light perceived by the human eye.
  • Reflectivity characterizes the degree of light reflection from an object's surface, that is, the relative intensity of light reflected from the surface. Generally speaking, higher reflectivity results in higher brightness.
  • an object's brightness and reflectivity properties are strongly correlated. Statistics show that the reflectivity and brightness information of most points in the Am-fused point cloud also have a strong correlation, especially for neighboring points, where the correlation is essentially the same. Therefore, using the encoded attribute information of the current point to predict the unencoded attribute value can reduce residual errors and remove redundancy.
  • the brightness information (luma) of the current point cloud has been encoded.
  • the current point (the point to be predicted) is P0, and its three neighboring points are P1, P2, and P3.
  • the first coefficient reflects the degree of correlation between the different attributes of the target's neighboring points. If the first coefficient is close to 1, it indicates a strong positive correlation between the first and second attributes; if it is close to 0, it indicates almost no correlation between the two. This helps to assess the correlation between attributes and better understand the characteristics and patterns of the data.
  • the first coefficient includes a ratio of a first attribute reconstruction value of the target neighbor point to a second attribute reconstruction value of the target neighbor point.
  • the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction are related to the attribute coding order of the current node.
  • the first coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point.
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the target neighbor point is the reflectivity reconstruction value of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point
  • the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the current point
  • the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.
  • the reflectivity prediction value of the current point can be determined according to formula (7) and formula (8):
  • Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded)
  • Coeff luma represents the brightness reconstruction value of the current point (the attribute reference value of the attribute to be decoded)
  • si represents the target neighbor point (the i-th neighbor of the current point).
  • the first coefficient of the nearest neighbor point Represents the reflectivity reconstruction value of the target neighboring point (i.e., the first attribute reconstruction value of the target neighboring point), Represents the brightness reconstruction value of the target neighboring point (that is, the second attribute reconstruction value of the target neighboring point).
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the reflectivity reconstruction value of the target neighbor point
  • the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the current point
  • the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value
  • the brightness prediction value of the current point can be determined according to formula (9) and formula (10):
  • Coeff ref represents the reflectivity reconstruction value of the current point (the attribute reference value of the attribute to be decoded)
  • Coeff luma represents the brightness prediction value of the current point (the attribute prediction value of the attribute to be decoded)
  • si represents the first coefficient of the target neighbor point (the i-th neighbor point of the current point).
  • the correlation between the first attribute reconstruction value and the second attribute reconstruction value of the target neighbor point can be incorporated into the prediction process through the first coefficient. If the first coefficient is large, it indicates that there is a strong correlation between the two attributes. Then, when predicting the attribute to be decoded at the current point, the relationship between the first attribute and the second attribute can be more accurately utilized to improve the accuracy of the prediction. On the other hand, combining the first coefficient and the attribute reference value can obtain a more accurate attribute prediction value of the attribute to be decoded. This prediction method based on correlation information can avoid unnecessary errors and improve the accuracy of the decoding process.
  • the attribute prediction value calculation process based on the first coefficient and the attribute reference value is relatively simple and accurate, does not require excessive computing resources, can reduce redundant information in the data transmission process, and improve the efficiency of data transmission. Especially in the case of limited bandwidth or high transmission costs, the effective use of correlation information can save transmission data resources.
  • the correlation coefficient represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the current point.
  • the correlation coefficient includes a second coefficient
  • the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:
  • the second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point.
  • the attribute corresponding to the first attribute reconstruction value of the target neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the current point.
  • the second coefficient includes a ratio of a first attribute reconstruction value of the current point to a first attribute reconstruction value of a target neighboring point.
  • the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.
  • the second coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point
  • the first attribute reconstruction value of the target neighboring point is the reconstruction value of the first attribute of the target neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighboring point
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the current point is the brightness reconstruction value of the current point
  • the first attribute reconstruction value of the target neighboring point is the brightness reconstruction value of the target neighboring point
  • the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the target neighboring point
  • the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.
  • the brightness prediction value of the current point can be determined according to formula (11) and formula (12):
  • Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded)
  • Coeff luma represents the brightness reconstruction value of the current point (the first attribute reconstruction value of the current point)
  • si represents the second coefficient of the target neighbor point (the i-th neighbor point of the current point)
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point
  • the first attribute reconstruction value of the target neighboring point is the reconstruction value of the second attribute of the target neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighboring point
  • the attribute reconstruction order of the current point is that reflection precedes brightness
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point
  • the first attribute reconstruction value of the target neighboring point is the reflectivity reconstruction value of the target neighboring point
  • the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the target neighboring point
  • the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value.
  • the brightness prediction value of the current point can be determined according to formula (13) and formula (14):
  • Coeff ref represents the reflectivity reconstruction value of the current point (the first attribute reconstruction value of the current point)
  • Coeff luma represents the brightness prediction value of the current point (the attribute reference value of the attribute to be decoded)
  • si represents the second coefficient of the target neighbor point (the i-th neighbor point of the current point).
  • the second coefficient takes into account the ratio between the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point. This relationship can help consider the correlation between the attributes of the current point and the attributes of the target neighboring point, thereby more accurately predicting the attribute value of the current point. Combining the second coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained.
  • the consideration of the second coefficient makes the prediction process more targeted, can better reflect the attribute relationship between the current point and the target neighboring point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the second coefficient, the correlation between attributes can be more effectively utilized, redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.
  • the correlation coefficient in case 2 represents the correlation between the attribute reconstruction values of the target neighboring points and the attribute reconstruction values of the non-target neighboring points of the current point.
  • the correlation coefficient includes a third coefficient; and the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:
  • the third coefficient is determined according to the first attribute reconstructed value of the non-target neighbor point and the first attribute reconstructed value of the target neighbor point.
  • the attribute corresponding to the first attribute reconstruction value of the target neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the non-target neighbor point.
  • the non-target neighbor point is any neighbor point among the M neighbor points of the current point except the target neighbor point.
  • the non-target neighbor point can be the neighbor point closest to the current point among the M neighbor points of the current point except the target neighbor point, or the non-target neighbor point can be the neighbor point closest to the target neighbor point among the M neighbor points of the current point except the target neighbor point.
  • the present application does not impose any restrictions on this.
  • the third coefficient includes a ratio of the first attribute reconstructed value of the target neighboring point to the first attribute reconstructed value of the non-target neighboring point.
  • the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.
  • the third coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the non-target neighbor point is the reconstruction value of the first attribute of the non-target neighbor point
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighbor point
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the non-target neighbor point is the brightness reconstruction value of the current point
  • the first attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point
  • the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the target neighbor point
  • the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.
  • the brightness prediction value of the current point can be determined according to formula (15) and formula (16):
  • Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded)
  • coeff_lumap represents the brightness reconstruction value of the non-target neighbor point (the pth neighbor point of the current point) (the first attribute reconstruction value of the non-target neighbor point)
  • si represents the third coefficient of the target neighbor point (the i-th neighbor point of the current point)
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the non-target neighbor point is the reconstruction value of the second attribute of the non-target neighbor point
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighbor point
  • the attribute reconstruction order of the current point is that reflection precedes brightness
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point
  • the first attribute reconstruction value of the target neighboring point is the reflectivity reconstruction value of the target neighboring point
  • the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the target neighboring point
  • the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value.
  • the brightness prediction value of the current point can be determined according to formula (17) and formula (18):
  • formula (17) and formula (18) represents the reflectivity reconstruction value of the non-target neighboring point (the pth neighboring point of the current point) (the first attribute reconstruction value of the non-target neighboring point),
  • Coeff luma represents the brightness prediction value of the current point (the attribute reference value of the attribute to be decoded)
  • si represents the third coefficient of the target neighboring point (the i-th neighboring point of the current point)
  • the third coefficient takes into account the ratio relationship between the first attribute reconstruction value of the target neighbor point and the first attribute reconstruction value of the non-target neighbor point. This ratio relationship can help evaluate the attribute correlation between the target neighbor point and the non-target neighbor point, so as to better understand the characteristics and laws of the data.
  • a more accurate attribute prediction value of the attribute to be decoded can be obtained.
  • the consideration of the third coefficient makes the prediction process more comprehensive and comprehensive, which can better reflect the attribute relationship between the current point and the target neighbor point and the non-target neighbor point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources.
  • the attribute correlation between the target neighbor point and the non-target neighbor point can be more effectively utilized, the redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.
  • the decoding method further includes:
  • determining the attribute reconstruction order of the current point is that the first attribute precedes the second attribute
  • the attribute reconstruction order of the current point is that the second attribute precedes the first attribute.
  • the second syntax element information is used to indicate the attribute reconstruction order of the current point.
  • the second syntax element information may be a flag bit in the attribute parameter APS, and the second syntax element information may be expressed as muti_crosstype_pre, which is used to indicate the attribute coding order of the current point.
  • the first value and the second value are different, and the first value and the second value can be in parameter form or in digital form.
  • the second syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the first value can be set to 1 and the second value can be set to 0; or, the first value can be set to 0 and the second value can be set to 1; or, the first value can be set to true and the second value can be set to false; or, the first value can be set to false and the second value can be set to true; but this is not specifically limited here.
  • the first value is set to 1 (true) and the second value is set to 0 (false)
  • the value of the second syntax identification information is 1 (true)
  • it can be determined that the attribute reconstruction order of the current point is that the first attribute (brightness) precedes the second attribute (reflectivity)
  • the value of the second syntax identification information is 0 (false)
  • the attribute reconstruction order of the current point is that the second attribute (reflectivity) precedes the first attribute (brightness)
  • it is necessary to use the correlation coefficient of the target neighbor node and the reflectivity reconstruction value of the current point to predict the brightness prediction value of the current point.
  • the candidate prediction mode further includes the first prediction mode
  • the decoding method further includes S107:
  • S107 Determine, according to the value of the first syntax element information, the best prediction mode at the current point from the candidate prediction modes as the first prediction mode.
  • the first prediction mode is a non-cross-attribute prediction mode.
  • the first prediction mode is associated with the reconstructed attribute values of the M neighboring points of the current point.
  • the first prediction mode may represent a weighted average of the reconstructed attribute values of the M neighboring points of the current node.
  • the reconstructed attributes of the M neighboring points are identical to the attribute to be decoded of the current point.
  • candidate prediction modes can be divided into two cases:
  • the candidate prediction modes include: one or more cross-attribute prediction modes.
  • the candidate prediction modes are shown in Table 2, and one or more cross-attribute prediction modes may include: prediction mode 1, prediction mode 2, and prediction mode 3.
  • prediction mode 1 it means that the first neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.
  • prediction mode 2 it means that the second neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.
  • the target cross-attribute prediction mode is prediction mode 3 it means that the third neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.
  • the candidate prediction modes include: one or more cross-attribute prediction modes and one or more non-cross-attribute prediction modes.
  • Table 3 is a schematic table 2 of a candidate prediction mode provided in an embodiment of the present application.
  • the candidate prediction modes include: 3 cross-attribute prediction modes and 1 non-cross-attribute prediction mode (prediction mode 0).
  • prediction mode 0 When the target cross-attribute prediction mode is prediction mode 0, it means that the attribute reconstruction values of the 3 neighboring points of the current point are used to derive the attribute prediction value of the attribute to be decoded of the current point.
  • the weighted average value of the brightness reconstruction values of the 3 neighboring points of the current point is used as the brightness prediction value of the current point, or the weighted average value of the reflectivity reconstruction values of the 3 neighboring points of the current point is used as the reflectivity prediction value of the current point.
  • the decoding method further includes S201 to S203:
  • the preset condition is specified by both the encoder and the decoder, and both the encoder and the decoder need to execute the judgment step S201.
  • the reconstructed attribute is the same as the attribute to be decoded.
  • M is a positive integer greater than or equal to 2; the preset condition includes: the maximum attribute difference between the reconstructed attributes of the M neighboring points is greater than or equal to a preset threshold.
  • the preset threshold is a value specified by both the decoder and the encoder, or the preset threshold is set by the encoder, the encoder writes the preset threshold into the bitstream, and the decoder obtains the preset threshold after decoding the bitstream.
  • This application does not impose any restrictions on the method for setting the preset threshold.
  • the preset threshold is an adaptive threshold, for example, it can be adaptively adjusted according to relevant information of the current point cloud (size, attribute complexity, number of points, etc.), and the preset threshold can be expressed as adaptive_threshold.
  • the neighboring points of the current point include: neighboring point 1, neighboring point 2, and neighboring point 3.
  • the attribute reconstruction values of the reconstructed attributes of the three neighboring points of the current point include: brightness reconstruction luma1 of neighboring point 1, brightness reconstruction luma2 of neighboring point 2, and brightness reconstruction luma3 of neighboring point 3.
  • the attribute reconstruction differences between the three neighboring points of the current point include:
  • the decoder executes the step of decoding the code stream in S101 to determine the first syntax element information of the current point. If the maximum attribute difference is less than the preset threshold, it is determined that the current point adopts the second prediction mode.
  • the second prediction mode is the same as or different from the first prediction mode.
  • the second prediction mode predicts the attribute prediction value of the attribute to be decoded at the current point using the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point.
  • the second prediction mode predicts the attribute prediction value of the attribute to be decoded at the current point using the weighted average reconstruction value of the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point.
  • S202 and S203 are parallel implementation steps, and either S202 or S203 can be executed, that is, the decoder can execute S202 or S203, and this application does not limit this.
  • Decoding only data that meets the conditions or selecting the second prediction mode helps avoid unnecessary data processing errors or misjudgments, and improves the accuracy and reliability of data processing. Furthermore, the application of preset conditions can make system operation more intelligent and efficient. Flexible selection of decoding or prediction modes based on specific conditions helps improve system efficiency and meet different data processing requirements.
  • the preset conditions are judged and the decoding code stream is executed or the second prediction mode is selected. This can produce beneficial effects in terms of data decision optimization, resource utilization efficiency improvement, data transmission cost reduction, data quality assurance and system operation efficiency improvement, which is of great significance to the efficiency and accuracy in the data encoding and decoding and transmission process.
  • the decoding method further includes:
  • the attribute prediction value of the attribute to be decoded is determined according to the attribute reconstruction value of each of the reconstructed attributes of the M neighboring points and the spatial geometric weights of each of the M neighboring points.
  • the process of determining the attribute prediction value of the attribute to be decoded using the second prediction mode can be expressed by formula (19) and formula (20):
  • formula (19) and formula (20) represents the attribute prediction value of the attribute to be decoded at the current point i
  • j represents the index of M neighboring points
  • x i , y ij and z ij represent the geometric position coordinates of the neighbor point j
  • x i , y i and z i represent the geometric position coordinates (spatial position) of the current point i.
  • the decoding method further includes:
  • the candidate prediction modes include one or more cross-attribute prediction modes
  • the candidate prediction modes include one or more non-cross-attribute prediction modes
  • a target prediction mode of the current point is determined from one or more non-cross-attribute prediction modes.
  • the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the candidate prediction mode is related to whether the current point indicated by the third syntax element allows the use of the cross-attribute prediction mode, specifically including the following two cases:
  • Case 1 The third syntax element information indicates that the cross-attribute prediction mode is allowed at the current point.
  • the candidate prediction modes include at least: one or more cross-attribute prediction modes.
  • the candidate prediction modes of the current point include: prediction mode 0 (first prediction mode), prediction mode 1, prediction mode 2, and prediction mode 3.
  • prediction mode 0 is a non-cross-attribute prediction mode
  • prediction mode 1, prediction mode 2, and prediction mode 3 are cross-attribute prediction modes.
  • the first syntax element information is used to indicate the target prediction mode adopted by the current point, wherein the target prediction mode can be a target cross-attribute prediction mode (any one of prediction modes 1 to 3) or a non-cross-attribute prediction mode (prediction mode 0).
  • the target prediction mode can be a target cross-attribute prediction mode (any one of prediction modes 1 to 3) or a non-cross-attribute prediction mode (prediction mode 0).
  • the decoder uses the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point as the brightness prediction value of the current point. If the value of the first syntax element information is 1, the target prediction mode of the current point is determined to be prediction mode 1. At this time, the decoder uses the reflectivity reconstruction value of the current point and the correlation coefficient of the first neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 2, the target prediction mode of the current point is determined to be prediction mode 2.
  • the decoder uses the reflectivity reconstruction value of the current point and the correlation coefficient of the second neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 3, the target prediction mode of the current point is determined to be prediction mode 3. At this time, the decoder uses the reflectivity reconstruction value of the current point The correlation coefficient with the third neighboring point of the current point is used to determine the brightness prediction value of the current point.
  • Case 2 The third syntax element information indicates that the cross-attribute prediction mode is not allowed at the current point.
  • the candidate prediction modes include at least one or more non-cross-attribute prediction modes.
  • the candidate prediction modes for the current point include: prediction mode 0, prediction mode 1, prediction mode 2, and prediction mode 3.
  • prediction modes 0 to 3 are all non-cross-attribute prediction modes.
  • the target prediction mode of the current point is determined to be 0.
  • the decoder uses the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point as the brightness prediction value of the current point. If the value of the first syntax element information is 1, the target prediction mode of the current point is determined to be prediction mode 1. At this time, the decoder uses the brightness reconstruction value of the first neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 2, the target prediction mode of the current point is determined to be prediction mode 2.
  • the decoder uses the brightness reconstruction value of the second neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 3, the target prediction mode of the current point is determined to be prediction mode 3. At this time, the decoder uses the brightness reconstruction value of the third neighboring point of the current point to determine the brightness prediction value of the current point.
  • the cross-attribute prediction mode when the cross-attribute prediction mode is allowed, it is determined that the candidate prediction mode includes one or more cross-attribute prediction modes; or, when the cross-attribute prediction mode is not allowed, it is determined that the candidate prediction mode includes one or more non-cross-attribute prediction modes, so that the attribute prediction requirements of the current point can be matched more accurately, and the accuracy and reliability of the prediction can be improved.
  • determining whether the cross-attribute prediction mode or the non-cross-attribute prediction mode is allowed at the current point according to the third syntax element information helps to improve the efficiency of data prediction.
  • Using a suitable prediction mode can make data prediction faster and reduce computing and time costs.
  • Reasonable selection of a prediction mode can reduce unnecessary data transmission and save transmission resources.
  • redundant information in the prediction process can be reduced and data transmission efficiency can be optimized.
  • Appropriate prediction mode selection can avoid errors or misjudgments in the prediction process and ensure the accuracy and reliability of data processing.
  • the decoding method further includes:
  • the value of the third syntax element information is the third value, it is determined that the cross-attribute prediction mode is allowed at the current point; or
  • the value of the third syntax element information is the fourth value, it is determined that the cross-attribute prediction mode is not allowed at the current point.
  • the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the third syntax element information may be a flag in the attribute parameter APS, and the third syntax element information may be expressed as crosstype_enable_flag, which is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the third value is different from the fourth value, and the third value and the fourth value can be in parameter form or in numerical form.
  • the third syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the third value can be set to 1 and the fourth value can be set to 0; or, the third value can be set to 0 and the fourth value can be set to 1; or, the third value can be set to true and the fourth value can be set to false; or, the third value can be set to false and the fourth value can be set to true; but this is not specifically limited here.
  • an embodiment of the present application provides a coding method.
  • the attribute prediction value of the attribute to be coded of the current point can be predicted more accurately, avoiding the transmission of redundant information. This can reduce the amount of data to be transmitted during coding, thereby reducing the waste of code rate.
  • the process of predicting the attribute reconstruction value of the attribute to be coded of the current point it is determined based on the correlation coefficient of the candidate neighboring points of the current point and the attribute reference value of the attribute to be coded of the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of coding.
  • FIG11 is a flow chart of an encoding method provided by the embodiment of the present application. As shown in FIG11 , the method may include S301 to S307:
  • S301 Determine a candidate cross-attribute prediction mode for the current point from candidate prediction modes.
  • the encoding method of the embodiment of the present application is applied to an encoder.
  • the encoding method can specifically refer to a method for cross-attribute prediction of lidar point clouds.
  • this is mainly an improvement of a PT encoding method for single-neighbor cross-attribute prediction, so as to avoid the problem of a large amount of redundancy between the two attribute information when one attribute information has been encoded and another attribute information is encoded in the related art.
  • the current point is also called the current node, the current point to be encoded, the point to be encoded, the current point to be detected, the node to be encoded, etc., and the embodiment of the present application does not impose any limitations on this.
  • the candidate cross-attribute prediction mode is one or more candidate cross-attribute prediction modes in the candidate prediction mode.
  • the candidate cross-attribute prediction mode is also referred to as a cross-attribute prediction mode.
  • the candidate prediction mode includes three candidate cross-attribute prediction modes: prediction mode 1, prediction mode 2, and prediction mode 3.
  • the candidate cross-attribute prediction mode refers to any one of prediction mode 1, prediction mode 2, and prediction mode 3.
  • S302 Determine one or more attribute reconstruction values of candidate neighboring points of the current point according to the candidate cross-attribute prediction mode.
  • each candidate cross-attribute prediction mode of the candidate prediction modes it is necessary to determine one or more attribute reconstruction values of candidate neighboring points of the current point.
  • the candidate neighboring points correspond to the candidate cross-attribute prediction modes.
  • one or more attribute reconstruction values of the first candidate neighbor point of the current point are determined; according to prediction mode 2, one or more attribute reconstruction values of the second candidate neighbor point of the current point are determined; according to prediction mode 3, one or more attribute reconstruction values of the third candidate neighbor point of the current point are determined.
  • S303 Determine the correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points.
  • the correlation coefficients of candidate neighbor points have the following three cases:
  • Case 1 The correlation coefficient of the candidate neighbor points represents the correlation between multiple attribute reconstruction values of the candidate neighbor points.
  • the multiple attribute reconstruction values of the candidate neighboring points may include: a brightness reconstruction value and a reflectivity reconstruction value.
  • the correlation coefficient of the candidate neighboring points may represent the correlation between the brightness reconstruction value and the reflectivity reconstruction value of the candidate neighboring points.
  • Case 2 The correlation coefficient of the candidate neighboring points represents the correlation between the attribute reconstruction value of the candidate neighboring points and the attribute reconstruction value of the current point.
  • the correlation coefficient of the candidate neighbor point can represent the correlation between the brightness reconstruction value of the candidate neighbor point and the brightness reconstruction value of the current point.
  • the correlation coefficient of the candidate neighbor point can represent the correlation between the reflectivity reconstruction value of the candidate neighbor point and the reflectivity reconstruction value of the current point.
  • Case 3 The correlation coefficient of the candidate neighbor points represents the correlation between the attribute reconstruction values of the candidate neighbor points and the attribute reconstruction values of the non-candidate neighbor points of the current point.
  • the non-candidate neighbor point is any neighbor point other than the candidate neighbor point among the M neighbor points of the current point.
  • the non-candidate neighbor point can be the neighbor point closest to the current point other than the candidate neighbor point among the M neighbor points of the current point.
  • the correlation coefficient of the candidate neighbor point may represent the correlation between the brightness reconstructed value of the candidate neighbor point and the brightness reconstructed value of the non-candidate neighbor point.
  • the correlation coefficient of the candidate neighbor point may represent the correlation between the brightness reconstructed value of the candidate neighbor point and the reflectivity reconstructed value of the non-candidate neighbor point.
  • the correlation coefficient of the candidate neighbor point may represent the correlation between the reflectivity reconstructed value of the candidate neighbor point and the reflectivity reconstructed value of the non-candidate neighbor point.
  • S304 Determine the attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value and the correlation coefficient of the attribute to be encoded at the current point.
  • the attributes to be encoded may include: brightness and reflectivity.
  • the attribute reference value of the attribute to be encoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be encoded.
  • S305 Make a coding decision based on the attribute prediction value of the to-be-coded attribute of the current point corresponding to one or more candidate cross-attribute prediction modes, and determine the best prediction mode of the current point as the target cross-attribute prediction mode.
  • a rate-distortion optimization is performed on the attribute prediction value of the attribute to be encoded of the current point corresponding to one or more candidate cross-attribute prediction modes to obtain one or more rate-distortion cost values; and the candidate cross-attribute prediction mode corresponding to the minimum cost value among the one or more rate-distortion cost values is used as the optimal prediction mode for the current point.
  • RDO rate-distortion optimization
  • S306 Determine the value of the first syntax element information at the current point according to the optimal prediction mode.
  • the first syntax element information is used to indicate the best prediction mode for the current point, wherein the best prediction mode for the current point can be a cross-attribute prediction mode or a non-cross-attribute prediction mode.
  • the value of the first syntax element information can be in parameter form or in digital form.
  • the first syntax element information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the value of the first syntax element information is set to 0; if it is determined that the best prediction mode of the current point is prediction mode 1, the value of the first syntax element information is set to 1.
  • S307 Encode the first syntax element information, and write the obtained coded bits into a bitstream.
  • An embodiment of the present application provides a coding method, which includes: determining a candidate cross-attribute prediction mode for a current point from candidate prediction modes; determining one or more attribute reconstruction values of candidate neighboring points of the current point based on the candidate cross-attribute prediction mode; determining the correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points; determining the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value and the correlation coefficient of the attribute to be encoded at the current point; making a coding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the best prediction mode for the current point as the target cross-attribute prediction mode; and determining the best prediction mode for the current point as the target cross-attribute prediction mode based on the best
  • the optimal prediction mode is used to determine the value of the first syntax element information at the current point; the first syntax element
  • the attribute prediction value of the attribute to be coded is calculated based on the correlation information of the neighboring points of the current point and the known attribute values, and can be used as the predicted value of the attribute at the current point.
  • the correlation coefficient can help measure the degree of correlation between the attribute to be coded and the known attributes. If the correlation coefficient is high, it means that there is a strong linear relationship between the two, and the predicted value can more accurately reflect the actual value of the attribute to be coded. By using the correlation coefficient for prediction, unnecessary data transmission and storage can be avoided. If the correlation between the attribute to be coded and the known attributes is low, the predicted value will be closer to the actual value of the attribute to be coded, reducing the transmission and storage of redundant data. This can improve the utilization of the bit rate, avoid bit rate waste, and thus improve coding performance.
  • the correlation coefficient represents the correlation between multiple attribute reconstruction values of candidate neighbor points.
  • the correlation coefficient includes a first coefficient; and the implementation of determining the correlation coefficient of the candidate neighboring point based on one or more attribute reconstruction values of the candidate neighboring point in S303 may include:
  • a first coefficient is determined according to the first attribute reconstruction value of the candidate neighbor point and the second attribute reconstruction value of the candidate neighbor point.
  • the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is different from the attribute corresponding to the second attribute reconstruction value of the candidate neighbor point, and the attribute corresponding to the first attribute reconstruction value is correlated with the attribute corresponding to the second attribute reconstruction value.
  • the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction value are different and correlated, meaning that the first attribute reconstruction value and the second attribute reconstruction value are reconstruction values of two different attributes (the first attribute and the second attribute), but the first attribute and the second attribute are correlated.
  • the first attribute can be brightness and the second attribute can be reflectivity.
  • brightness generally refers to the intensity or brightness of light perceived by the human eye.
  • Reflectivity characterizes the degree of light reflection from an object's surface, that is, the relative intensity of light reflected from the surface. Generally speaking, higher reflectivity results in higher brightness.
  • an object's brightness and reflectivity properties are strongly correlated. Statistics show that the reflectivity and brightness information of most points in the Am-fused point cloud also have a strong correlation, especially for neighboring points, where the correlation is essentially the same. Therefore, using the encoded attribute information of the current point to predict the unencoded attribute value can reduce residual errors and remove redundancy.
  • the brightness information (luma) of the current point cloud has been encoded.
  • the current point (the point to be predicted) is P0, and its three neighboring points are P1, P2, and P3.
  • the candidate neighbor point of the current point is P1
  • the first coefficient can reflect the degree of correlation between the different attributes of the candidate neighbor points. If the first coefficient is close to 1, it indicates a strong positive correlation between the first attribute and the second attribute; if it is close to 0, it indicates that there is almost no correlation between the two. This helps to assess the correlation between attributes and better understand the characteristics and patterns of the data.
  • the first coefficient includes a ratio of a first attribute reconstruction value of the candidate neighbor point to a second attribute reconstruction value of the candidate neighbor point.
  • the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction are related to the attribute coding order of the current node.
  • the first coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point
  • the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point.
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the candidate neighbor point is the reflectivity reconstruction value of the candidate neighbor point
  • the second attribute reconstruction value of the candidate neighbor point is the brightness reconstruction value of the candidate neighbor point
  • the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the current point
  • the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value.
  • the reflectivity prediction value of the current point can refer to the description of formulas (7) and (8) above.
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point
  • the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point
  • the second attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the current point
  • the attribute to be decoded of the current point is the reflectivity reconstruction value of the current point.
  • the attribute prediction value of the code attribute is a brightness prediction value.
  • the brightness prediction value of the current point can refer to the description of formula (9) and formula (10) in the above text.
  • the correlation between the first attribute reconstruction value and the second attribute reconstruction value of the candidate neighbor point can be incorporated into the prediction process through the first coefficient. If the first coefficient is large, indicating that there is a strong correlation between the two attributes, then when predicting the attribute to be decoded at the current point, the relationship between the first attribute and the second attribute can be more accurately utilized to improve the accuracy of the prediction. On the other hand, combining the first coefficient and the attribute reference value can obtain a more accurate attribute prediction value of the attribute to be decoded. This prediction method based on correlation information can avoid unnecessary errors and improve the accuracy of the decoding process.
  • the attribute prediction value calculation process based on the first coefficient and the attribute reference value is relatively simple and accurate, does not require excessive computing resources, can reduce redundant information in the data transmission process, and improve the efficiency of data transmission. Especially in the case of limited bandwidth or high transmission costs, the effective use of correlation information can save transmission data resources.
  • the correlation coefficient represents the correlation between the attribute reconstruction value of the candidate neighbor point and the attribute reconstruction value of the current point.
  • the correlation coefficient includes a second coefficient
  • the implementation of determining the correlation coefficient of the candidate neighbor point based on one or more attribute reconstruction values of the candidate neighbor point in S303 may include:
  • the second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point.
  • the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the current point.
  • the second coefficient includes a ratio of a first attribute reconstruction value of the current point to a first attribute reconstruction value of a candidate neighboring point.
  • the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.
  • the second coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the first attribute of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the candidate neighboring point
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the current point is the brightness reconstruction value of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the candidate neighboring point
  • the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value.
  • the brightness prediction value of the current point can refer to the description of formula (11) and formula (12) in the previous text.
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the second attribute of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the candidate neighboring point
  • the attribute reconstruction order of the current point is reflectance before brightness
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the candidate neighboring point
  • the attribute prediction value of the attribute to be decoded of the current point is the brightness prediction value.
  • the brightness prediction value of the current point can refer to the description of formula (13) and formula (14) above.
  • the second coefficient takes into account the ratio between the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point. This relationship can help consider the correlation between the attributes of the current point and the attributes of the candidate neighboring points, thereby more accurately predicting the attribute value of the current point. Combining the second coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained. Consideration of the second coefficient makes the prediction process more targeted, can better reflect the attribute relationship between the current point and the candidate neighboring points, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the second coefficient, the correlation between attributes can be more effectively utilized, redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.
  • the correlation coefficient in case 2 represents the correlation between the attribute reconstruction values of the candidate neighbor points and the attribute reconstruction values of the non-candidate neighbor points of the current point.
  • the correlation coefficient includes a third coefficient; and the implementation of determining the correlation coefficient of the candidate neighbor point based on one or more attribute reconstruction values of the candidate neighbor point in S303 may include:
  • the third coefficient is determined according to the first attribute reconstruction value of the non-candidate neighbor point and the first attribute reconstruction value of the candidate neighbor point.
  • the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the non-candidate neighbor point.
  • a non-candidate neighbor point is any neighbor point among the M neighbor points of the current point except the candidate neighbor point.
  • the non-candidate neighbor point can be the neighbor point closest to the current point among the M neighbor points of the current point excluding the candidate neighbor point, or the non-candidate neighbor point can be the neighbor point closest to the candidate neighbor point among the M neighbor points of the current point excluding the candidate neighbor point. This application does not impose any restrictions on this.
  • the third coefficient includes a ratio of the first attribute reconstructed value of the candidate neighbor point to the first attribute reconstructed value of the non-candidate neighbor point.
  • the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.
  • the third coefficient includes the following two cases:
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the non-candidate neighbor point is the reconstruction value of the first attribute of the non-candidate neighbor point
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the candidate neighbor point
  • the attribute reconstruction order of the current point is brightness before reflectivity
  • the attribute to be decoded of the current node is reflectivity
  • the first attribute reconstruction value of the non-candidate neighboring point is the brightness reconstruction value of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the candidate neighboring point
  • the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value.
  • the brightness prediction value of the current point can refer to the description of formula (15) and formula (16) in the previous text.
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the non-candidate neighbor point is the reconstruction value of the second attribute of the non-candidate neighbor point
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the candidate neighbor point
  • the attribute reconstruction order of the current point is reflectance before brightness
  • the attribute to be decoded of the current node is brightness
  • the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point
  • the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the candidate neighboring point
  • the attribute prediction value of the attribute to be decoded of the current point is the brightness prediction value.
  • the brightness prediction value of the current point can refer to the description of formulas (17) and (18) above.
  • the third coefficient takes into account the ratio relationship between the first attribute reconstruction value of the candidate neighbor point and the first attribute reconstruction value of the non-candidate neighbor point. This ratio relationship can help evaluate the attribute correlation between the candidate neighbor point and the non-candidate neighbor point, so as to better understand the characteristics and laws of the data. Combining the third coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained.
  • the consideration of the third coefficient makes the prediction process more comprehensive and comprehensive, which can better reflect the attribute relationship between the current point and the candidate neighbor point and the non-candidate neighbor point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the third coefficient, the attribute correlation between the candidate neighbor point and the non-candidate neighbor point can be more effectively utilized, the redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.
  • the encoding method further includes:
  • determining the attribute reconstruction order of the current point is that the first attribute precedes the second attribute
  • the value of the second syntax element information is the second value, determining that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute;
  • the method also includes:
  • the second syntax identification information is coded, and the obtained coded bits are written into the bitstream.
  • the second syntax element information is used to indicate the attribute reconstruction order of the current point.
  • the second syntax element information may be a flag bit in the attribute parameter APS, and the second syntax element information may be expressed as muti_crosstype_pre, which is used to indicate the attribute coding order of the current point.
  • the first value and the second value are different, and the first value and the second value can be in parameter form or in digital form.
  • the second syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the candidate prediction mode further includes the first prediction mode
  • the encoding method further includes S401 to S403:
  • S402 Determine an attribute prediction value of the attribute to be encoded at the current point according to the first prediction mode
  • S403 Make a coding decision based on the attribute prediction values of the to-be-coded attribute of the current point corresponding to each of the one or more candidate cross-attribute prediction modes and the first prediction mode, and determine that the best prediction mode for the current point is the first prediction mode.
  • the first prediction mode is a non-cross-attribute prediction mode.
  • the first prediction mode is related to the reconstructed attribute values of the M neighboring points of the current point.
  • the first prediction mode can represent the weighted average of the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current node.
  • the reconstructed attributes are the same as the attributes to be encoded of the current point.
  • candidate prediction modes can be divided into two cases:
  • the candidate prediction modes include: one or more candidate cross-attribute prediction modes.
  • one or more candidate cross-attribute prediction modes may include: prediction mode 1, prediction mode 2, and prediction mode 3.
  • Prediction mode 1 indicates that the first candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point.
  • Prediction mode 2 indicates that the second candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point.
  • Prediction mode 3 indicates that the third candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point.
  • the encoder will make encoding decisions on the attribute prediction values of the attribute to be encoded of the current point corresponding to prediction mode 1, prediction mode 2, and prediction mode 3, respectively, to determine the optimal prediction mode for the current point.
  • the candidate prediction modes include: one or more candidate cross-attribute prediction modes and one or more non-cross-attribute prediction modes.
  • the candidate prediction modes include; 3 candidate cross-attribute prediction modes (prediction mode 1, prediction mode 2 and prediction mode 3) and 1 non-cross-attribute prediction mode (prediction mode 0).
  • Prediction mode 0 indicates the use of the attribute reconstruction values of the 3 candidate neighboring points of the current point to derive the attribute prediction value of the attribute to be encoded of the current point.
  • prediction mode 0 indicates the use of the weighted average of the brightness reconstruction values of the 3 candidate neighboring points of the current point as the brightness prediction value of the current point, or the use of the weighted average of the reflectivity reconstruction values of the 3 neighboring points of the current point as the reflectivity prediction value of the current point.
  • the encoder will make encoding decisions on the attribute prediction values of the attribute to be encoded of the current point corresponding to prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3, respectively, to determine the best prediction mode for the current point.
  • the encoding method further includes S501 to S503:
  • M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference of the attribute reconstruction values of the reconstructed attributes between the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be encoded.
  • the encoding method further includes:
  • the attribute prediction value of the attribute to be encoded is determined according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weight of each of the M neighboring points.
  • Encoding only data that meets the conditions or selecting the second prediction mode helps avoid unnecessary data processing errors or misjudgments, improving data processing accuracy and reliability. Furthermore, the application of preset conditions can make system operation more intelligent and efficient. Flexible selection of encoding or prediction modes based on specific conditions helps improve system efficiency and meet diverse data processing requirements.
  • the encoding method further includes:
  • the candidate prediction modes include one or more cross-attribute prediction modes
  • the candidate prediction modes include one or more non-cross-attribute prediction modes
  • the encoding method also includes:
  • the third syntax identification information is coded, and the obtained coded bits are written into the bitstream.
  • the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the candidate prediction mode is related to whether the current point indicated by the third syntax element allows the use of the cross-attribute prediction mode, specifically including the following two cases:
  • Case 1 The third syntax element information indicates that the cross-attribute prediction mode is allowed at the current point.
  • the candidate prediction modes include at least: one or more candidate cross-attribute prediction modes.
  • the candidate prediction modes of the current point include: prediction mode 0 (first prediction mode), prediction mode 1, prediction mode 2, and prediction mode 3.
  • prediction mode 0 is a non-cross-attribute prediction mode
  • prediction mode 1, prediction mode 2, and prediction mode 3 are cross-attribute prediction modes.
  • the first syntax element information is used to indicate the best prediction mode adopted by the current point, wherein the best prediction mode can be a target cross-attribute prediction mode (any one of prediction modes 1 to 3) or a non-cross-attribute prediction mode (prediction mode 0).
  • Case 2 The third syntax element information indicates that the cross-attribute prediction mode is not allowed at the current point.
  • the candidate prediction modes include at least one or more non-cross-attribute prediction modes.
  • the candidate prediction modes for the current point include: prediction mode 0, prediction mode 1, prediction mode 2, and prediction mode 3.
  • Prediction modes 0 to 3 are all non-cross-attribute prediction modes.
  • the candidate prediction modes of the current point include: prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3.
  • Prediction mode 0 indicates that the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point is used as the brightness prediction value of the current point.
  • Prediction mode 1 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the first neighboring point of the current point.
  • Prediction mode 2 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the second neighboring point of the current point.
  • Prediction mode 3 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the third neighboring point of the current point.
  • the encoder makes an encoding decision based on the brightness prediction value of the current point corresponding to prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3 to determine the best prediction mode for the current point.
  • the encoding method further includes:
  • the value of the third syntax element information is determined to be the fourth value.
  • the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the third syntax element information may be a flag in the attribute parameter APS, and the third syntax element information may be expressed as crosstype_enable_flag, which is used to indicate whether the cross-attribute prediction mode is allowed at the current point.
  • the third value is different from the fourth value, and the third value and the fourth value can be in parameter form or in numerical form.
  • the third syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.
  • the third value can be set to 1 and the fourth value can be set to 0; or, the third value can be set to 0 and the fourth value can be set to 1; or, the third value can be set to true and the fourth value can be set to false; or, the third value can be set to false and the fourth value can be set to true; but this is not specifically limited here.
  • the encoding and decoding method provided in the embodiment of the present application is also called an improved PT encoding method for single-neighbor cross-attribute prediction.
  • the process of determining the optimal prediction mode includes S21 to S29:
  • the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the LoD generation order.
  • the attribute reconstructed values of these three nearest neighboring points (3 nearest neighboring points) are used as candidate prediction values for the current point to be encoded.
  • the maximum attribute difference max_difference of the three candidate neighbors is calculated. If the maximum attribute difference is greater than a preset threshold (adaptive threshold adaptive_threshold), step 23 is executed. If the maximum attribute difference is less than or equal to the preset threshold (adaptive threshold adaptive_threshold), step S24 is executed.
  • the three neighboring points are considered to have attribute values close to the predicted point, and thus mode 0 weighted prediction is adopted.
  • the optimal prediction value is selected according to Rate-Distortion Optimal (RDO).
  • RDO Rate-Distortion Optimal
  • the mode corresponding to the minimum cost score among the scores of modes 0 to 3 is taken as the best prediction mode.
  • the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the generation order of the LoD.
  • the maximum attribute difference max_difference of the three candidate neighbors is then calculated. If the value of max_difference is less than the adaptive threshold, the three neighboring points are considered to be close to the attribute values of the predicted point, and thus mode 0 weighted prediction is adopted.
  • the optimal prediction value is selected from four prediction modes according to RDO: mode 0 is average prediction, and modes 1, 2, and 3 respectively reconstruct the attribute values of the three nearest neighboring points as the attribute prediction value of the current point to be encoded.
  • the prediction modes 1, 2, and 3 are modified to use the correlation between the two attributes of each nearest neighbor point as the correlation between the two attributes of the current point (equivalent to the correlation coefficient), so that the first attribute value encoded at the current point (equivalent to the attribute reference value of the attribute to be decoded at the current point) can be used to predict the second attribute value to be encoded at the current point (equivalent to the attribute prediction value of the attribute to be decoded at the current point).
  • prediction modes 1 to 3 directly use the attribute reconstruction values of the three nearest neighbors of the current point as the attribute prediction value of the current point to be encoded. Since the brightness information and reflectivity information of the point cloud are correlated, especially between neighboring points, the correlation between the two attributes is roughly the same. If the brightness information of the point cloud has already been encoded, cross-attribute prediction is used to remove redundancy.
  • the reflectivity value of the current point to be predicted can be expressed as: Where Coeff ref and Coeff luma represent the reflectivity value and brightness value of the current point respectively, and s is the correlation coefficient.
  • This application replaces prediction modes 1 to 3 with the correlation coefficients of the brightness reconstruction values and reflectivity reconstruction values of the three nearest neighboring points of the current point, and then uses these three correlation coefficients as the attribute correlation coefficients of the current point, thereby achieving the purpose of single neighbor guidance cross-attribute prediction. Therefore, the improved prediction mode modification of attribute coding is shown in Table 3.
  • the calculation of the correlation coefficient of the brightness and reflectivity of the neighboring nodes can be expressed as: in and represent the reconstructed reflectance value and brightness value of the ith neighbor, respectively, and si represents the correlation coefficient of the brightness and reflectance attributes of the ith neighbor.
  • the operation flow at the encoding end is shown in FIG13.
  • brightness equivalent to the first attribute
  • the brightness information of the original point cloud is encoded according to the original mode.
  • the reflectivity first, according to the generation order of LoD, first find the three nearest neighboring points (3 nearest neighboring points) of the current point to be encoded (current point) from the encoded data points (the nearest neighboring points of the current point). Then calculate the maximum attribute distance (maximum attribute difference) of the three nearest neighboring points.
  • the adaptive threshold select threshold 0 (first prediction mode); if the maximum attribute distance is greater than the adaptive threshold, calculate the correlation coefficient s (first coefficient) of the brightness and attribute information of the three nearest neighboring points respectively. Then use the brightness information of the current point to be encoded (brightness reconstruction value) and the calculated correlation coefficient s to calculate the predicted value of the reflectivity (the predicted value of the reflectivity of the current point). Use RDO technology to select the best predicted value, quantize the prediction residual (the predicted residual of the reflectivity of the current point), entropy code, and form an attribute code stream.
  • the original code stream structure is not changed, and only the flag crosstype_enable_flag (equivalent to the third syntax element information) is added to the attribute parameter APS and encoded. Its value is 1 to enable cross-attribute prediction, and its value is 0 to disable cross-attribute prediction.
  • the operation process at the decoding end is shown in Figure 14.
  • the brightness information of the original point cloud is decoded according to the original mode.
  • the decoding end reads the attribute code stream, first solves the attribute quantization residual through entropy decoding, and dequantizes the decoded quantization residual to obtain the attribute residual (reflectivity prediction residual). Then, according to the generated LoD order, the three nearest neighbors (3 neighboring points) of the current point are found from the decoded and reconstructed data points (the neighboring points of the current point).
  • the maximum attribute distance (maximum attribute difference) between the three nearest neighbor points is then calculated. If the maximum attribute distance is less than an adaptive threshold (preset threshold), the prediction mode is inferred to be the average prediction of 0 (the first prediction mode). If the maximum attribute distance is greater than the adaptive threshold, the optimal prediction mode i (the first syntax element information) is decoded from the bitstream. If the value of i is 1 to 3, the correlation coefficient (the first coefficient) between the brightness and reflectivity of the i-th neighbor (the target neighbor point) is calculated. The reflectivity prediction value (the current point's reflectivity prediction value) is then calculated using the current point's brightness information (the current point's brightness reconstruction value) and the correlation coefficient s (the first coefficient).
  • an adaptive threshold set threshold
  • the prediction mode is inferred to be the average prediction of 0 (the first prediction mode). If the maximum attribute distance is greater than the adaptive threshold, the optimal prediction mode i (the first syntax element information) is decoded from the bitstream. If the value of i is 1 to 3,
  • the attribute prediction value (the current point's reflectivity prediction value)
  • the attribute residual obtained by inverse quantization (the current point's reflectivity prediction residual)
  • the true reconstructed attribute value (the current point's reflectivity reconstruction value).
  • the reflectivity information decoding of the current point is completed. This process is repeated through all point sets until the reflectivity information of all points is fully reconstructed.
  • the specific implementation of the decoding end program is as follows: if the distance (maximum attribute difference) is greater than the adaptive threshold (predicted value), (a threshold is set), the optimal prediction mode i is decoded from the bitstream. If the value of i is 1 to 3, the correlation coefficient between the brightness and reflectivity of the i-th neighbor is calculated. The predicted reflectivity is then calculated using the brightness information of the current point and the correlation coefficient s (the first coefficient) of the target neighbor. This calculation process is implemented in the decoder function predictReflectance, where s is the correlation coefficient between the brightness and reflectivity of the i-th neighbor (the target neighbor).
  • tests were conducted using the G-PCC reference software TMC13 V24.0 under the CTC-C1 and CTC-C2 test conditions, using octree-predicting and bitrates of r01, r02, and r03.
  • this application achieved a -2.9% gain in the reflectance component of the Am-fused average dataset under the TMC13 and CTC-C1 test conditions, and a -3.0% gain under the CTC-C2 test conditions.
  • this application did not change the runtime complexity of G-PCC.
  • the C1 condition is lossless geometry, lossy attribute coding
  • the C2 condition is lossy geometry, lossy attribute coding.
  • End-to-End BD-AttrRate represents the BD-Rate of the end-to-end attribute value for the attribute bitstream.
  • BD-Rate reflects the difference in PSNR curves between two scenarios (with and without filtering).
  • a decrease in BD-Rate indicates improved performance with a reduced bitrate while maintaining the same PSNR; conversely, performance decreases.
  • the greater the decrease in BD-Rate the better the compression.
  • the Am-fused average dataset represents the fused point cloud dataset, and Overall average is the average of all sequence test results.
  • the same correlation coefficient prediction method can be imitated on the LT lifting transformation (an improvement based on the PT) to perform neighbor-guided cross-attribute prediction redundancy removal.
  • the size of the serial numbers of the above-mentioned processes does not mean the order of execution.
  • the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
  • a code stream is provided, wherein the code stream is generated by bit encoding based on information to be encoded; wherein the information to be encoded includes at least one of the following:
  • First syntax element information, second syntax element information, and third syntax element information are used to indicate the prediction mode adopted by the current point, the second syntax element information is used to indicate the attribute reconstruction order of the current point, and the third syntax element information is used to indicate whether the current point allows the use of a cross-attribute prediction mode.
  • the decoder 1000 includes a decoding part 1001 and a first determining part 1002, wherein:
  • the decoding part 1001 is configured to decode the code stream and determine the first syntax element information of the current point;
  • the first determining part 1002 is configured to determine, from the candidate prediction modes, the best prediction mode of the current point as the target cross-attribute prediction mode according to the value of the first grammatical element information; determine one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determine the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points. determining the attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient.
  • the correlation coefficient represents the correlation between multiple attribute reconstruction values of the target neighboring points.
  • the correlation coefficient includes a first coefficient; the first determining portion 1002 is further configured to determine the first coefficient based on a first attribute reconstruction value of the target neighbor point and a second attribute reconstruction value of the target neighbor point.
  • the first coefficient includes a ratio of a first attribute reconstructed value of the target neighbor point to a second attribute reconstructed value of the target neighbor point.
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point
  • the attribute reconstruction order of the current point is that the second attribute precedes the first attribute
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point
  • the second attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.
  • the correlation coefficient represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the current point.
  • the correlation coefficient includes a second coefficient; the first determining part 1002 is further configured to determine the second coefficient based on the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point.
  • the second coefficient includes a ratio of the first attribute reconstruction value of the current point to the first attribute reconstruction value of the target neighboring point.
  • the attribute to be decoded is the second attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point
  • the first attribute reconstruction value of the target neighboring point is the reconstruction value of the first attribute of the target neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighboring point
  • the attribute reconstruction order of the current point is that the second attribute precedes the first attribute
  • the attribute to be decoded is the first attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point
  • the first attribute reconstruction value of the target neighboring point is the reconstruction value of the second attribute of the target neighboring point
  • the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighboring point.
  • the decoding part 1001 is further configured to parse the code stream to determine the second syntax element information.
  • the first determining part 1002 is further configured to, if the value of the second grammatical element information is a first value, determine that the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or, if the value of the second grammatical element information is a second value, determine that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute.
  • the correlation coefficient represents the correlation between the attribute reconstructed value of the target neighbor point and the attribute reconstructed value of the non-target neighbor point of the current point.
  • the first determining portion 1002 is further configured to multiply the attribute reference value of the attribute to be decoded at the current point by the correlation coefficient to determine the attribute prediction value of the attribute to be decoded.
  • the candidate prediction mode also includes a first prediction mode
  • the first determination part 1002 is further configured to determine that the best prediction mode of the current point from the candidate prediction modes is the first prediction mode based on the value of the first syntax element information.
  • the first determination part 1002 is further configured to determine whether the current point meets a preset condition based on the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point; when the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point meet the preset condition, perform the step of decoding the code stream and determining the first syntax element information of the current point; or, when the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point do not meet the preset condition, determine that the current point adopts the second prediction mode.
  • M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference between the attribute reconstruction values of the reconstructed attributes of the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be decoded.
  • the first determination part 1002 is further configured to, when it is determined that the current point adopts the second prediction mode, determine the spatial geometric weights of the M neighboring points according to the spatial positions of the M neighboring points and the spatial position of the current point; and determine the attribute prediction value of the attribute to be decoded according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weights of each of the M neighboring points.
  • the decoding part 1001 is further configured to decode the code stream and determine third syntax element information.
  • the first determining part 1002 is further configured to determine that the candidate prediction mode includes one or more cross-attribute prediction modes when the third syntax element information indicates that the current point allows the cross-attribute prediction mode; or When the third syntax element information indicates that the current point does not allow the cross-attribute prediction mode, it is determined that the candidate prediction modes include one or more non-cross-attribute prediction modes; and according to the value of the first syntax element information, the target prediction mode of the current point is determined from the one or more non-cross-attribute prediction modes.
  • the value of the third syntax element information is a third value, it is determined that the current point allows the use of a cross-attribute prediction mode; or, if the value of the third syntax element information is a fourth value, it is determined that the current point does not allow the use of a cross-attribute prediction mode.
  • a "part" can be a part of a circuit, a part of a processor, a part of a program or software, etc., and of course it can also be a module, or it can be non-modular.
  • the various components in this embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into a single unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated unit is implemented in the form of a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in this embodiment.
  • the aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • an embodiment of the present application provides a computer-readable storage medium, which is applied to the decoder 1000.
  • the computer-readable storage medium stores a computer program, and when the computer program is executed by the first processor, it implements the method described in any one of the aforementioned embodiments.
  • the decoder 1000 may include: a first communication interface 1101, a first memory 1102, and a first processor 1103; these components are coupled together via a first bus system 1104. It will be understood that the first bus system 1104 is used to achieve connection and communication between these components. In addition to including a data bus, the first bus system 1104 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, in Figure 16, all various buses are labeled as the first bus system 1104.
  • the first communication interface 1101 is used to receive and send signals when sending and receiving information with other external network elements;
  • a first memory 1102 is used to store computer programs that can be run on the first processor 1103;
  • the first processor 1103 is configured to, when running the computer program, execute:
  • the first memory 1102 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories.
  • the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • the volatile memory can be a random access memory (RAM), which is used as an external cache.
  • RAM static RAM
  • DRAM dynamic RAM
  • SDRAM synchronous DRAM
  • DDR SDRAM double data rate synchronous DRAM
  • ESDRAM enhanced synchronous DRAM
  • SLDRAM synchronous link DRAM
  • DRRAM direct RAM
  • the first processor 1103 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the first processor 1103 or the instructions in the form of software.
  • the above-mentioned first processor 1103 can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components.
  • DSP digital signal processor
  • ASIC application-specific integrated circuit
  • FPGA field programmable gate array
  • the various methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed.
  • the general-purpose processor can be a microprocessor or the processor can also be any conventional processor Etc.
  • the steps of the method disclosed in conjunction with the embodiments of this application can be directly implemented as execution by a hardware decoding processor, or can be implemented using a combination of hardware and software modules within the decoding processor.
  • the software module can be located in a storage medium well-established in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc.
  • the storage medium is located in the first memory 1102, and the first processor 1103 reads the information in the first memory 1102 and, in conjunction with its hardware, completes the steps of the above method.
  • the embodiments described in this application can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof.
  • the processing unit can be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in this application, or a combination thereof.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DSPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGAs field programmable gate arrays
  • the technology described in this application can be implemented by modules (such as processes, functions, etc.) that perform the functions described in this application.
  • the software code can be stored in a memory and executed by a processor.
  • the memory can be implemented in the processor or outside the processor.
  • the first processor 1103 is further configured to execute any one of the methods described in the foregoing embodiments when running the computer program.
  • FIG17 shows a schematic diagram of the composition structure of an encoder provided by an embodiment of the present application.
  • the encoder 2000 may include a second determining part 2001 and an encoding part 2002; wherein,
  • the second determining part 2001 is configured to determine a candidate cross-attribute prediction mode for the current point from the candidate prediction modes; determine one or more attribute reconstruction values of candidate neighboring points of the current point based on the candidate cross-attribute prediction mode; determine the correlation coefficient of the candidate neighboring points based on the one or more attribute reconstruction values of the candidate neighboring points; determine the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; make a coding decision based on the attribute prediction values of the attribute to be encoded at the current point corresponding to the one or more candidate cross-attribute prediction modes, and determine the best prediction mode for the current point as the target cross-attribute prediction mode; and determine the value of the first syntax element information of the current point based on the best prediction mode;
  • the encoding part 2002 is configured to perform encoding processing on the first syntax element information and write the obtained encoded bits into a bitstream.
  • the correlation coefficient represents the correlation between multiple attribute reconstruction values of the candidate neighboring points.
  • the correlation coefficient includes a first coefficient; the second determining part 2001 is further configured to determine the first coefficient according to the first attribute reconstruction value of the candidate neighbor point and the second attribute reconstruction value of the candidate neighbor point.
  • the first coefficient includes a ratio of a first attribute reconstruction value of the candidate neighbor point to a second attribute reconstruction value of the candidate neighbor point.
  • the attribute to be encoded is the second attribute
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point
  • the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be encoded is the reconstruction value of the first attribute of the current point
  • the attribute reconstruction order of the current point is that the second attribute precedes the first attribute
  • the attribute to be encoded is the first attribute
  • the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point
  • the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point
  • the attribute reference value of the attribute to be encoded is the reconstruction value of the second attribute of the current point.
  • the correlation coefficient represents the correlation between the attribute reconstruction value of the candidate neighbor point and the attribute reconstruction value of the current point.
  • the correlation coefficient includes a second coefficient; the second determination part 2001 is further configured to determine the second coefficient according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point.
  • the second coefficient includes a ratio of the first attribute reconstruction value of the current point to the first attribute reconstruction value of the candidate neighboring point.
  • the attribute to be encoded is the second attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the first attribute of the candidate neighboring point
  • the attribute reference value of the attribute to be encoded is the reconstruction value of the second attribute of the candidate neighboring point
  • the attribute reconstruction order of the current point is that the second attribute precedes the first attribute
  • the attribute to be encoded is the first attribute
  • the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point
  • the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the second attribute of the candidate neighboring point
  • the attribute reference value of the attribute to be encoded is the reconstruction value of the first attribute of the candidate neighboring point.
  • the second determination part 2001 is further configured to determine second grammatical element information; if the value of the second grammatical element information is a first value, the attribute reconstruction order of the current point is determined to be the first attribute before the second attribute; or, if the value of the second grammatical element information is a second value, the attribute reconstruction order of the current point is determined to be the second attribute before the first attribute.
  • the encoding part 2002 is further configured to encode the second syntax identification information and write the obtained encoded bits into a bitstream.
  • the correlation coefficient represents the correlation between the attribute reconstruction values of the candidate neighboring points and the attribute reconstruction values of the non-candidate neighboring points of the current point.
  • the second determining portion 2001 is further configured to multiply the attribute reference value of the attribute to be encoded at the current point by the correlation coefficient to determine the attribute prediction value of the attribute to be encoded.
  • the candidate prediction mode also includes a first prediction mode
  • the second determination part 2001 is further configured to determine the first prediction mode of the current point from the candidate prediction mode; determine the attribute prediction value of the attribute to be encoded of the current point based on the first prediction mode; make an encoding decision based on the attribute prediction value of the attribute to be encoded of the current point corresponding to each of the one or more candidate cross-attribute prediction modes and the first prediction mode, and determine that the best prediction mode of the current point is the first prediction mode.
  • the second determination part 2001 is further configured to determine whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point; when the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point meet the preset condition, perform the step of determining the candidate cross-attribute prediction mode of the current point from the candidate prediction modes, or, when the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point do not meet the preset condition, determine that the current point adopts the second prediction mode.
  • M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference of the attribute reconstruction values of the reconstructed attributes between the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be encoded.
  • the second determination part 2001 is further configured to, when it is determined that the current point adopts the second prediction mode, determine the spatial geometric weights of the M neighboring points according to the spatial positions of the M neighboring points and the spatial position of the current point; and determine the attribute prediction value of the attribute to be encoded according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weights of each of the M neighboring points.
  • the second determination part 2001 is further configured to determine third syntax element information; when the third syntax element information indicates that the current point allows the use of a cross-attribute prediction mode, determine that the candidate prediction mode includes one or more cross-attribute prediction modes; or, when the third syntax element information indicates that the current point prohibits the use of a cross-attribute prediction mode, determine that the candidate prediction mode includes one or more non-cross-attribute prediction modes; determine one or more attribute prediction values of the current point based on the one or more non-cross-attribute prediction modes; determine the optimal prediction mode adopted by the current point based on the encoding decision of the one or more attribute prediction values of the current point; and determine the value of the first syntax element information based on the optimal prediction mode.
  • the encoding part 2002 is further configured to perform encoding processing on the third syntax identification information and write the obtained encoded bits into the bitstream.
  • a "portion" may be a circuit portion, a processor portion, a program portion, or software portion, and may also be a module or non-modular.
  • the various components in this embodiment may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit.
  • the aforementioned integrated units may be implemented in the form of hardware or software functional modules.
  • the integrated unit is implemented as a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • this embodiment provides a computer-readable storage medium, which is applied to the encoder 2000 and stores a computer program. When the computer program is executed by the second processor, it implements any of the methods in the aforementioned embodiments.
  • the encoder 2000 may include: a second communication interface 2101, a second memory 2102 and a second processor 2103; each component is coupled together through a second bus system 2104. It can be understood that the second bus system 2104 is used to realize the connection and communication between these components.
  • the second bus system 2104 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, various buses are marked as the second bus system 2104 in Figure 18. Among them,
  • the second communication interface 2101 is used to receive and send signals during the process of sending and receiving information between other external network elements;
  • the second memory 2102 is used to store computer programs that can be run on the second processor 2103;
  • the second processor 2103 is configured to, when running the computer program, execute:
  • the first syntax element information is coded and the obtained coded bits are written into a bitstream.
  • the second processor 2103 is further configured to execute any one of the methods described in the foregoing embodiments when running the computer program.
  • the hardware functions of the second memory 2102 are similar to those of the first memory 1102, and the hardware functions of the second processor 2103 are similar to those of the first processor 1103; they will not be described in detail here.
  • the coding and decoding system 3000 may include a decoder 3001 and an encoder 3002 .
  • the decoder 3001 may be the decoder described in any one of the aforementioned embodiments
  • the encoder 3002 may be the encoder described in any one of the aforementioned embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Provided in the present application are an encoding method, a decoding method, a bit stream, a decoder, an encoder, and a storage medium. At a decoding end, the decoding method comprises: decoding a bit stream, and determining first syntax element information of the current point; on the basis of the value of the first syntax element information, determining the optimal prediction mode of the current point from candidate prediction modes as a target cross-attribute prediction mode; on the basis of the target cross-attribute prediction mode, determining one or more attribute reconstruction values of a target neighbor point of the current point; on the basis of the one or more attribute reconstruction values of the target neighbor point, determining a correlation coefficient of the target neighbor point; and on the basis of an attribute reference value of an attribute to be decoded of the current point and the correlation coefficient, determining an attribute prediction value of said attribute of the current point. The present application can improve the utilization rate of a bit rate, such that the encoding and decoding efficiency is improved.

Description

编解码方法、码流、解码器、编码器以及存储介质Coding and decoding method, code stream, decoder, encoder and storage medium 技术领域Technical Field

本申请实施例涉及视频编解码技术领域,尤其涉及一种编解码方法、码流、解码器、编码器以及存储介质。The embodiments of the present application relate to the field of video coding and decoding technology, and in particular to a coding and decoding method, a bit stream, a decoder, an encoder, and a storage medium.

背景技术Background Art

在基于几何的点云压缩技术(Geometry-based Poind Cloud Compression,GPCC/G-PCC)的属性编码框架中,为了去除点云编码的时间和空间冗余,引入了帧内预测和帧间预测。而当G-PCC编码多种属性(比如颜色和反射率等)的点云序列时,多种属性间的冗余还没有充分挖掘并去除。In the attribute coding framework of Geometry-based Point Cloud Compression (GPCC/G-PCC), intra-frame prediction and inter-frame prediction are introduced to remove temporal and spatial redundancy in point cloud encoding. However, when G-PCC encodes point cloud sequences with multiple attributes (such as color and reflectivity), the redundancy between these attributes has not been fully explored and removed.

相关技术中,通常使用已编码好的一种属性信息去指导另一种属性信息的编码。然而,当一个属性信息已经编码完成,对另一种属性信息进行编码时,两种属性信息之间还存在着大量的冗余,这样,会造成码率的浪费,从而影响了编解码效率。In related technologies, one type of already encoded attribute information is often used to guide the encoding of another type of attribute information. However, when one type of attribute information is already encoded and another type of attribute information is encoded, there is still a lot of redundancy between the two types of attribute information, which results in a waste of bit rate and affects the encoding and decoding efficiency.

发明内容Summary of the Invention

本申请实施例提供一种编解码方法、码流、解码器、编码器以及存储介质,能够提高码率的利用率,从而提升编解码效率。The embodiments of the present application provide a coding and decoding method, a code stream, a decoder, an encoder, and a storage medium, which can improve the utilization of the code rate and thus improve the coding and decoding efficiency.

本申请实施例的技术方案可以如下实现:The technical solution of the embodiment of the present application can be implemented as follows:

第一方面,本申请实施例提供了一种解码方法,应用于解码器,该方法包括:In a first aspect, an embodiment of the present application provides a decoding method, applied to a decoder, the method comprising:

解码码流,确定当前点的第一语法元素信息;Decode the code stream and determine the first syntax element information of the current point;

根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;Determining, according to the value of the first syntax element information, the best prediction mode for the current point from the candidate prediction modes as the target cross-attribute prediction mode;

根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of target neighboring points of the current point according to the target cross-attribute prediction mode;

根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数;Determining a correlation coefficient of the target neighboring point based on one or more attribute reconstruction values of the target neighboring point;

根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值。Determine an attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient.

第二方面,本申请实施例提供了一种编码方法,应用于编码器,该方法包括:In a second aspect, an embodiment of the present application provides an encoding method, applied to an encoder, the method comprising:

从候选预测模式中确定所述当前点的候选跨属性预测模式;Determining a candidate cross-attribute prediction mode for the current point from candidate prediction modes;

根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of candidate neighboring points of the current point according to the candidate cross-attribute prediction mode;

根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;Determining a correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points;

根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值;Determining an attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient;

根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;Performing a coding decision based on the attribute prediction values of the to-be-coded attribute of the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the best prediction mode of the current point as a target cross-attribute prediction mode;

根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;Determining, according to the optimal prediction mode, a value of the first syntax element information of the current point;

对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The first syntax element information is coded and the obtained coded bits are written into a bitstream.

第三方面,本申请实施例提供了一种码流,该码流是根据待编码信息进行比特编码生成的;其中,所述待编码信息包括下述至少一项:In a third aspect, an embodiment of the present application provides a code stream, which is generated by bit encoding based on information to be encoded; wherein the information to be encoded includes at least one of the following:

第一语法元素信息、第二语法元素信息和第三语法元素信息;所述第一语法元素信息用于指示所述当前点采用的预测模式,所述第二语法元素信息用于指示所述当前点的属性重建顺序,所述第三语法元素信息用于指示所述当前点是否允许采用跨属性预测模式。First syntax element information, second syntax element information, and third syntax element information; the first syntax element information is used to indicate the prediction mode adopted by the current point, the second syntax element information is used to indicate the attribute reconstruction order of the current point, and the third syntax element information is used to indicate whether the current point allows the use of a cross-attribute prediction mode.

第四方面,本申请实施例提供了一种解码器,该解码器包括解码部分和第一确定部分,其中:In a fourth aspect, an embodiment of the present application provides a decoder, comprising a decoding part and a first determining part, wherein:

所述解码部分,被配置为解码码流,确定当前点的第一语法元素信息;The decoding part is configured to decode the code stream and determine the first syntax element information of the current point;

所述第一确定部分,被配置为根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数;根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的 属性预测值。The first determination part is configured to determine, from the candidate prediction modes, the best prediction mode of the current point as the target cross-attribute prediction mode according to the value of the first syntax element information; determine one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determine the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determine the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient according to the attribute reference value of the attribute to be decoded at the current point; Attribute prediction value.

第五方面,本申请实施例提供了一种编码器,该编码器包括编码部分和第二确定部分,其中:In a fifth aspect, an embodiment of the present application provides an encoder, comprising an encoding part and a second determining part, wherein:

所述第二确定部分,被配置为从候选预测模式中确定所述当前点的候选跨属性预测模式;根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值;根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;The second determination part is configured to determine the candidate cross-attribute prediction mode of the current point from the candidate prediction modes; determine one or more attribute reconstruction values of the candidate neighboring points of the current point according to the candidate cross-attribute prediction mode; determine the correlation coefficient of the candidate neighboring points according to the one or more attribute reconstruction values of the candidate neighboring points; determine the attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; make a coding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to the one or more candidate cross-attribute prediction modes, and determine the best prediction mode of the current point as the target cross-attribute prediction mode; determine the value of the first syntax element information of the current point according to the best prediction mode;

所述编码部分,被配置为对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The encoding part is configured to perform encoding processing on the first syntax element information and write the obtained encoded bits into a bitstream.

第六方面,本申请实施例提供了一种解码器,该解码器包括第一存储器和第一处理器,其中:In a sixth aspect, an embodiment of the present application provides a decoder, comprising a first memory and a first processor, wherein:

所述第一存储器,被配置为存储能够在所述第一处理器上运行的计算机程序;The first memory is configured to store a computer program that can be executed on the first processor;

所述第一处理器,被配置为在运行所述计算机程序时,执行如第一方面所述的方法。The first processor is configured to execute the method according to the first aspect when running the computer program.

第七方面,本申请实施例提供了一种编码器,该编码器包括第二存储器和第二处理器,其中:In a seventh aspect, an embodiment of the present application provides an encoder, comprising a second memory and a second processor, wherein:

所述第二存储器,被配置为存储能够在所述第二处理器上运行的计算机程序;The second memory is configured to store a computer program that can be executed on the second processor;

所述第二处理器,被配置为在运行所述计算机程序时,执行如第二方面所述的方法。The second processor is configured to execute the method according to the second aspect when running the computer program.

第八方面,本申请实施例提供了一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,所述计算机程序被执行时实现如第一方面或第二方面所述的方法。In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed, it implements the method described in the first aspect or the second aspect.

本申请实施例提供了一种编解码方法、码流、解码器、编码器以及存储介质,在解码侧,该解码方法包括:解码码流,确定当前点的第一语法元素信息;根据第一语法元素信息的取值,从候选预测模式中确定当前点的最佳预测模式为目标跨属性预测模式;根据目标跨属性预测模式,确定当前点的目标近邻点的一个或多个属性重建值;根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数;根据当前点的待解码属性的属性参考值和相关系数,确定当前点的待解码属性的属性预测值。在编码侧,从候选预测模式中确定所述当前点的候选跨属性预测模式;一方面,通过目标跨属性预测模式和目标近邻点的相关系数确定当前点的待解码属性的属性预测值,可以更准确地预测当前点的属性值,避免了传输冗余的信息,这样可以在编码时减少需要传输的数据量,从而降低了码率的浪费。一方面,在对当前点的待解码属性的属性重建值进行预测的过程中,是基于当前点的目标近邻点的相关系数和当前点的待解码属性的属性参考值确定的,可以提高码率的利用率,避免码率的浪费,可以减少数据传输时的冗余和成本,从而可以提升解码的效率和性能。The embodiment of the present application provides a coding and decoding method, a code stream, a decoder, an encoder and a storage medium. On the decoding side, the decoding method includes: decoding the code stream, determining the first syntax element information of the current point; determining the best prediction mode of the current point as the target cross-attribute prediction mode from the candidate prediction modes according to the value of the first syntax element information; determining one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determining the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determining the attribute prediction value of the attribute to be decoded of the current point according to the attribute reference value and the correlation coefficient of the attribute to be decoded of the current point. On the encoding side, the candidate cross-attribute prediction mode of the current point is determined from the candidate prediction mode; on the one hand, by determining the attribute prediction value of the attribute to be decoded of the current point through the target cross-attribute prediction mode and the correlation coefficient of the target neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information, thereby reducing the amount of data to be transmitted during encoding, thereby reducing the waste of bit rate. On the one hand, in the process of predicting the attribute reconstruction value of the attribute to be decoded at the current point, it is determined based on the correlation coefficient of the target neighboring point of the current point and the attribute reference value of the attribute to be decoded at the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of decoding.

在编码侧,该编码方法包括:根据候选跨属性预测模式,确定当前点的候选近邻点的一个或多个属性重建值;根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数;根据当前点的待编码属性的属性参考值和相关系数,确定当前点的待编码属性的属性预测值;根据一个或多个候选跨属性预测模式对应的当前点的待编码属性的属性预测值进行编码决策,确定当前点的最佳预测模式为目标跨属性预测模式;根据最佳预测模式,确定当前点的第一语法元素信息的取值;对第一语法元素信息进行编码处理,将所得到的编码比特写入码流。一方面,通过候选跨属性预测模式和候选近邻点的相关系数确定当前点的待编码属性的属性预测值,可以更准确地预测当前点的属性值,避免了传输冗余的信息,这样可以在编码时减少需要传输的数据量,从而降低了码率的浪费。一方面,在对当前点的待编码属性的属性重建值进行预测的过程中,是基于当前点的候选近邻点的相关系数和当前点的待编码属性的属性参考值确定的,可以提高码率的利用率,避免码率的浪费,可以减少数据传输时的冗余和成本,从而可以提升编码的效率和性能。On the encoding side, the encoding method includes: determining one or more attribute reconstruction values of candidate neighboring points of the current point based on candidate cross-attribute prediction modes; determining the correlation coefficient of the candidate neighboring points based on the one or more attribute reconstruction values of the candidate neighboring points; determining the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value and correlation coefficient of the attribute to be encoded at the current point; making an encoding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the optimal prediction mode for the current point as the target cross-attribute prediction mode; determining the value of the first syntax element information of the current point based on the optimal prediction mode; encoding the first syntax element information and writing the resulting coded bits into the bitstream. On the one hand, by determining the attribute prediction value of the attribute to be encoded at the current point through the candidate cross-attribute prediction modes and the correlation coefficient of the candidate neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information, thereby reducing the amount of data required to be transmitted during encoding, and thus reducing bit rate waste. On the one hand, in the process of predicting the attribute reconstruction value of the attribute to be encoded at the current point, it is determined based on the correlation coefficient of the candidate neighboring points of the current point and the attribute reference value of the attribute to be encoded at the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of coding.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1A为本申请实施例提供的一种三维点云图像示意图;FIG1A is a schematic diagram of a three-dimensional point cloud image provided in an embodiment of the present application;

图1B为本申请实施例提供的一种三维点云图像的局部放大图;FIG1B is a partially enlarged view of a three-dimensional point cloud image provided in an embodiment of the present application;

图2A为本申请实施例提供的一种点云图像的六个观看角度示意图;FIG2A is a schematic diagram of six viewing angles of a point cloud image provided by an embodiment of the present application;

图2B为本申请实施例提供的一种点云图像对应的数据存储格式示意图;FIG2B is a schematic diagram of a data storage format corresponding to a point cloud image provided in an embodiment of the present application;

图3为本申请实施例提供的一种点云编解码的网络架构示意图;FIG3 is a schematic diagram of a network architecture of point cloud encoding and decoding provided by an embodiment of the present application;

图4A为本申请实施例提供的一种G-PCC编码器的组成框架示意图;FIG4A is a schematic diagram of a composition framework of a G-PCC encoder provided in an embodiment of the present application;

图4B为本申请实施例提供的一种G-PCC解码器的组成框架示意图;FIG4B is a schematic diagram of a composition framework of a G-PCC decoder provided in an embodiment of the present application;

图5为本申请实施例提供的一种PT编码的流程示意图;FIG5 is a schematic diagram of a PT encoding process provided in an embodiment of the present application;

图6为本申请实施例提供的一种基于距离的LoD生成过程的示意图;FIG6 is a schematic diagram of a distance-based LoD generation process provided in an embodiment of the present application;

图7为本申请实施例提供的一种确定最佳预测模式的流程示意图一; FIG7 is a first flow chart of a method for determining an optimal prediction mode according to an embodiment of the present application;

图8为本申请实施例提供的一种解码方法的流程示意图一;FIG8 is a flowchart diagram of a decoding method provided in an embodiment of the present application;

图9为本申请实施例提供的一种亮度和反射率之间的相关性的示意图;FIG9 is a schematic diagram of a correlation between brightness and reflectivity provided in an embodiment of the present application;

图10为本申请实施例提供的一种解码方法的流程示意图二;FIG10 is a second flow chart of a decoding method provided in an embodiment of the present application;

图11为本申请实施例提供的一种编码方法的流程示意图;FIG11 is a schematic diagram of a flow chart of an encoding method provided in an embodiment of the present application;

图12为本申请实施例提供的一种确定最佳预测模式的流程示意图二;FIG12 is a second schematic diagram of a process for determining an optimal prediction mode according to an embodiment of the present application;

图13为本申请实施例提供的一种编码端实现的流程示意图;FIG13 is a schematic diagram of a flow chart of an encoding end implementation provided in an embodiment of the present application;

图14为本申请实施例提供的一种解码端实现的流程示意图;FIG14 is a schematic diagram of a process flow implemented by a decoding end according to an embodiment of the present application;

图15为本申请实施例提供的一种解码器的组成结构示意图;FIG15 is a schematic diagram of the structure of a decoder provided in an embodiment of the present application;

图16为本申请实施例提供的一种解码器的具体硬件结构示意图;FIG16 is a schematic diagram of a specific hardware structure of a decoder provided in an embodiment of the present application;

图17为本申请实施例提供的一种编码器的组成结构示意图;FIG17 is a schematic diagram of the structure of an encoder provided in an embodiment of the present application;

图18为本申请实施例提供的一种编码器的具体硬件结构示意图;FIG18 is a schematic diagram of a specific hardware structure of an encoder provided in an embodiment of the present application;

图19为本申请实施例提供的一种编解码系统的组成结构示意图。FIG19 is a schematic diagram of the composition structure of a coding and decoding system provided in an embodiment of the present application.

具体实施方式DETAILED DESCRIPTION

为了能够更加详尽地了解本申请实施例的特点与技术内容,下面结合附图对本申请实施例的实现进行详细阐述,所附附图仅供参考说明之用,并非用来限定本申请实施例。In order to enable a more detailed understanding of the features and technical contents of the embodiments of the present application, the implementation of the embodiments of the present application is described in detail below with reference to the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present application.

除非另有定义,本文所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本文中所使用的术语只是为了描述本申请实施例的目的,不是旨在限制本申请。Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

在以下的描述中,涉及到“一些实施例”,其描述了所有可能实施例的子集,但是可以理解,“一些实施例”可以是所有可能实施例的相同子集或不同子集,并且可以在不冲突的情况下相互结合。In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

还需要指出,本申请实施例所涉及的术语“第一\第二\第三”仅是用于区别类似的对象,不代表针对对象的特定排序,可以理解地,“第一\第二\第三”在允许的情况下可以互换特定的顺序或先后次序,以使这里描述的本申请实施例能够以除了在这里图示或描述的以外的顺序实施。It should also be pointed out that the terms "first\second\third" involved in the embodiments of the present application are only used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

点云(Point Cloud)是物体表面的三维表现形式,通过光电雷达、激光雷达、激光扫描仪、多视角相机等采集设备,可以采集得到物体表面的点云(数据)。Point Cloud is a three-dimensional representation of the surface of an object. Point Cloud (data) on the surface of an object can be collected through acquisition equipment such as photoelectric radar, lidar, laser scanner, and multi-view camera.

点云是空间中一组无规则分布的、表达三维物体或场景的空间结构及表面属性的离散点集,图1A展示了三维点云图像和图1B展示了三维点云图像的局部放大图,可以看到点云表面是由分布稠密的点所组成的。A point cloud is a set of irregularly distributed discrete points in space that express the spatial structure and surface properties of a three-dimensional object or scene. Figure 1A shows a three-dimensional point cloud image and Figure 1B shows a partially enlarged view of the three-dimensional point cloud image. It can be seen that the point cloud surface is composed of densely distributed points.

二维图像在每一个像素点均有信息表达,分布规则,因此不需要额外记录其位置信息;然而点云中的点在三维空间中的分布具有随机性和不规则性,因此需要记录每一个点在空间中的位置,才能完整地表达一幅点云。与二维图像类似,采集过程中每一个位置均有对应的属性信息,通常为RGB颜色值,颜色值反映物体的色彩;对于点云来说,每一个点所对应的属性信息除了颜色信息以外,还有比较常见的是反射率(reflectance)值,反射率值反映物体的表面材质。因此,点云数据通常包括点的位置信息和点的属性信息。其中,点的位置信息也可称为点的几何信息。例如,点的几何信息可以是点的三维坐标信息(x,y,z)。点的属性信息可以包括颜色信息和/或反射率等等。例如,反射率可以是一维反射率信息(r);颜色信息可以是任意一种色彩空间上的信息,或者颜色信息也可以是三维颜色信息,如RGB信息。在这里,R表示红色(Red,R),G表示绿色(Green,G),B表示蓝色(Blue,B)。再如,颜色信息可以是亮度色度(YCbCr,YUV)信息。其中,Y表示明亮度(Luma),Cb(U)表示蓝色色差,Cr(V)表示红色色差。In a two-dimensional image, each pixel contains information and is distributed regularly, so there's no need to record its location. However, the distribution of points in a point cloud in three-dimensional space is random and irregular, so recording the location of each point in space is necessary to fully represent the point cloud. Similar to a two-dimensional image, each location in the acquisition process has corresponding attribute information, typically an RGB color value, which reflects the object's color. For a point cloud, in addition to color information, each point's corresponding attribute information often includes reflectance values, which reflect the surface texture of the object. Therefore, point cloud data typically includes both point location information and point attribute information. Point location information can also be referred to as point geometric information. For example, point geometric information can be the point's three-dimensional coordinates (x, y, z). Point attribute information can include color information and/or reflectance. For example, reflectance can be one-dimensional reflectance information (r). Color information can be information in any color space, or it can be three-dimensional color information, such as RGB. Here, R represents red (R), G represents green (G), and B represents blue (B). For another example, the color information may be luminance and chrominance (YCbCr, YUV) information, where Y represents brightness (Luma), Cb (U) represents blue color difference, and Cr (V) represents red color difference.

根据激光测量原理得到的点云,点云中的点可以包括点的三维坐标信息和点的反射率值。再如,根据摄影测量原理得到的点云,点云中的点可以可包括点的三维坐标信息和点的三维颜色信息。再如,结合激光测量和摄影测量原理得到点云,点云中的点可以可包括点的三维坐标信息、点的反射率值和点的三维颜色信息。For example, a point cloud generated using laser measurement principles can include both its 3D coordinate information and its reflectivity. For another example, a point cloud generated using photogrammetry principles can include both its 3D coordinate information and its 3D color information. For another example, a point cloud generated using a combination of laser measurement and photogrammetry principles can include both its 3D coordinate information, its reflectivity value, and its 3D color information.

如图2A和图2B所示为一幅点云图像及其对应的数据存储格式。其中,图2A提供了点云图像的六个观看角度,图2B由文件头信息部分和数据部分组成,头信息包含了数据格式、数据表示类型、点云总点数、以及点云所表示的内容。例如,点云为“.ply”格式,由ASCII码表示,总点数为207242,每个点具有三维坐标信息(x,y,z)和三维颜色信息(r,g,b)。Figures 2A and 2B show a point cloud image and its corresponding data storage format. Figure 2A provides six viewing angles of the point cloud image, while Figure 2B consists of a file header and data. The header includes the data format, data representation type, the total number of points in the point cloud, and the content represented by the point cloud. For example, the point cloud is in ".ply" format, represented by ASCII code, with a total of 207,242 points. Each point has 3D coordinate information (x, y, z) and 3D color information (r, g, b).

点云可以按获取的途径分为:Point clouds can be divided into the following categories according to the acquisition method:

静态点云:即物体是静止的,获取点云的设备也是静止的;Static point cloud: the object is stationary and the device that acquires the point cloud is also stationary;

动态点云:物体是运动的,但获取点云的设备是静止的;Dynamic point cloud: The object is moving, but the device that obtains the point cloud is stationary;

动态获取点云:获取点云的设备是运动的。 Dynamic point cloud acquisition: The device used to acquire the point cloud is in motion.

例如,按点云的用途分为两大类:For example, point clouds can be divided into two categories according to their usage:

类别一:机器感知点云,其可以用于自主导航系统、实时巡检系统、地理信息系统、视觉分拣机器人、抢险救灾机器人等场景;Category 1: Machine perception point cloud, which can be used in scenarios such as autonomous navigation systems, real-time inspection systems, geographic information systems, visual sorting robots, and disaster relief robots;

类别二:人眼感知点云,其可以用于数字文化遗产、自由视点广播、三维沉浸通信、三维沉浸交互等点云应用场景。Category 2: Human eye perception point cloud, which can be used in point cloud application scenarios such as digital cultural heritage, free viewpoint broadcasting, 3D immersive communication, and 3D immersive interaction.

点云可以灵活方便地表达三维物体或场景的空间结构及表面属性,并且由于点云通过直接对真实物体采样获得,在保证精度的前提下能提供极强的真实感,因而应用广泛,其范围包括虚拟现实游戏、计算机辅助设计、地理信息系统、自动导航系统、数字文化遗产、自由视点广播、三维沉浸远程呈现、生物组织器官三维重建等。Point clouds can flexibly and conveniently express the spatial structure and surface properties of three-dimensional objects or scenes. Moreover, since point clouds are obtained by directly sampling real objects, they can provide a strong sense of reality while ensuring accuracy. Therefore, they are widely used, including virtual reality games, computer-aided design, geographic information systems, automatic navigation systems, digital cultural heritage, free viewpoint broadcasting, three-dimensional immersive remote presentation, and three-dimensional reconstruction of biological tissues and organs.

点云的采集主要有以下途径:计算机生成、3D激光扫描、3D摄影测量等。计算机可以生成虚拟三维物体及场景的点云;3D激光扫描可以获得静态现实世界三维物体或场景的点云,每秒可以获取百万级点云;3D摄影测量可以获得动态现实世界三维物体或场景的点云,每秒可以获取千万级点云。这些技术降低了点云数据获取成本和时间周期,提高了数据的精度。点云数据获取方式的变革,使大量点云数据的获取成为可能,伴随着应用需求的增长,海量3D点云数据的处理遭遇存储空间和传输带宽限制的瓶颈。Point clouds are primarily collected through computer generation, 3D laser scanning, and 3D photogrammetry. Computers can generate point clouds of virtual 3D objects and scenes; 3D laser scanning can obtain point clouds of static real-world 3D objects or scenes, generating millions of point clouds per second; and 3D photogrammetry can obtain point clouds of dynamic real-world 3D objects or scenes, generating tens of millions of point clouds per second. These technologies reduce the cost and time required to acquire point cloud data while improving data accuracy. While changes in point cloud data acquisition methods have made it possible to acquire large amounts of point cloud data, the processing of this massive amount of 3D point cloud data is facing bottlenecks due to storage space and transmission bandwidth constraints, as application demands grow.

示例性地,以帧率为30帧每秒(fps)的点云视频为例,每帧点云的点数为70万,每个点具有坐标信息xyz(float)和颜色信息RGB(uchar),则10s点云视频的数据量大约为0.7million×(4Byte×3+1Byte×3)×30fps×10s=3.15GB,其中,1Byte为10bit;而YUV采样格式为4:2:0,帧率为24fps的1280×720二维视频,其10s的数据量约为1280×720×12bit×24fps×10s≈0.33GB,10s的两视角三维视频的数据量约为0.33×2=0.66GB。由此可见,点云视频的数据量远超过相同时长的二维视频和三维视频的数据量。因此,为更好地实现数据管理,节省服务器存储空间,降低服务器与客户端之间的传输流量及传输时间,点云压缩成为促进点云产业发展的关键问题。For example, taking a point cloud video with a frame rate of 30 frames per second (fps), each frame contains 700,000 points, and each point has coordinate information (xyz, float) and color information (RGB, uchar). Therefore, the data volume of a 10-second point cloud video is approximately 0.7 million × (4 bytes × 3 + 1 byte × 3) × 30 fps × 10 seconds = 3.15 GB, where 1 byte is 10 bits. For a 1280 × 720 2D video with a YUV sampling format of 4:2:0 and a frame rate of 24 fps, the data volume for 10 seconds is approximately 1280 × 720 × 12 bits × 24 fps × 10 seconds ≈ 0.33 GB. The data volume of a 10-second two-view 3D video is approximately 0.33 × 2 = 0.66 GB. This shows that the data volume of a point cloud video far exceeds that of 2D and 3D videos of the same length. Therefore, in order to better realize data management, save server storage space, and reduce the transmission traffic and transmission time between the server and the client, point cloud compression has become a key issue in promoting the development of the point cloud industry.

也就是说,由于点云是海量点的集合,存储点云不仅会消耗大量的内存,而且不利于传输,也没有这么大的带宽可以支持将点云不经过压缩直接在网络层进行传输,因此,需要对点云进行压缩。That is to say, since the point cloud is a collection of massive points, storing the point cloud not only consumes a lot of memory, but is also not conducive to transmission. There is also not enough bandwidth to support direct transmission of the point cloud at the network layer without compression. Therefore, the point cloud needs to be compressed.

目前,可对点云进行压缩的点云编码框架可以是运动图像专家组(Moving Picture Experts Group,MPEG)提供的基于几何的点云压缩(Geometry-based Point Cloud Compression,G-PCC)编解码框架或基于视频的点云压缩(Video-based Point Cloud Compression,V-PCC)编解码框架,也可以是AVS提供的AVS-PCC编解码框架。G-PCC编解码框架可用于针对第一类静态点云和第三类动态获取点云进行压缩,其可以是基于点云压缩测试平台(Test Model Compression 13,TMC13),V-PCC编解码框架可用于针对第二类动态点云进行压缩,其可以是基于点云压缩测试平台(Test Model Compression 2,TMC2)。故G-PCC编解码框架也称为点云编解码器TMC13,V-PCC编解码框架也称为点云编解码器TMC2。Currently, point cloud coding frameworks that can compress point clouds can be the Geometry-based Point Cloud Compression (G-PCC) codec framework or the Video-based Point Cloud Compression (V-PCC) codec framework provided by the Moving Picture Experts Group (MPEG), or the AVS-PCC codec framework provided by AVS. The G-PCC codec framework can be used to compress the first type of static point clouds and the third type of dynamically acquired point clouds, and can be based on the Point Cloud Compression Test Platform (Test Model Compression 13, TMC13). The V-PCC codec framework can be used to compress the second type of dynamic point clouds, and can be based on the Point Cloud Compression Test Platform (Test Model Compression 2, TMC2). Therefore, the G-PCC codec framework is also called the Point Cloud Codec TMC13, and the V-PCC codec framework is also called the Point Cloud Codec TMC2.

本申请实施例提供了一种包含解码方法和编码方法的点云编解码系统的网络架构,图3为本申请实施例提供的一种点云编解码的网络架构示意图。如图3所示,该网络架构包括一个或多个电子设备13至1N和通信网络01,其中,电子设备13至1N可以通过通信网络01进行视频交互。电子设备在实施的过程中可以为各种类型的具有点云编解码功能的设备,例如,所述电子设备可以包括手机、平板电脑、个人计算机、个人数字助理、导航仪、数字电话、视频电话、电视机、传感设备、服务器等,本申请实施例不作限制。其中,本申请实施例中的解码器或编码器就可以为上述电子设备。An embodiment of the present application provides a network architecture of a point cloud encoding and decoding system including a decoding method and an encoding method. FIG3 is a schematic diagram of a network architecture of a point cloud encoding and decoding system provided by an embodiment of the present application. As shown in FIG3 , the network architecture includes one or more electronic devices 13 to 1N and a communication network 01, wherein the electronic devices 13 to 1N can perform video interaction through the communication network 01. During the implementation process, the electronic device can be various types of devices with point cloud encoding and decoding functions. For example, the electronic device can include a mobile phone, a tablet computer, a personal computer, a personal digital assistant, a navigator, a digital phone, a video phone, a television, a sensor device, a server, etc., which is not limited by the embodiment of the present application. Among them, the decoder or encoder in the embodiment of the present application can be the above-mentioned electronic device.

其中,本申请实施例中的电子设备具有点云编解码功能,一般包括点云编码器(即编码器)和点云解码器(即解码器)。Among them, the electronic device in the embodiment of the present application has a point cloud encoding and decoding function, generally including a point cloud encoder (ie, encoder) and a point cloud decoder (ie, decoder).

下面以G-PCC编解码框架为例进行相关技术的说明。The following describes the related technologies using the G-PCC encoding and decoding framework as an example.

相关技术1:Related technology 1:

在点云G-PCC编解码框架中,针对待编码的点云数据,首先通过片(slice)划分,将点云数据划分为多个slice。在每一个slice中,点云的几何信息和每个点所对应的属性信息是分开进行编码的。In the point cloud G-PCC codec framework, the point cloud data to be encoded is first divided into multiple slices through slice partitioning. In each slice, the geometric information of the point cloud and the attribute information corresponding to each point are encoded separately.

图4A示出了一种G-PCC编码器的组成框架示意图。如图4A所示,在几何编码过程中,对几何信息进行坐标转换,使点云全都包含在一个包围盒(Bounding Box)中,然后再进行量化,这一步量化主要起到缩放的作用,由于量化取整,使得一部分点云的几何信息相同,于是再基于参数来决定是否移除重复点,量化和移除重复点这一过程又被称为体素化过程。接着对包围盒进行八叉树划分或者预测树构建。在该过程中,针对划分的叶子结点中的点进行算术编码,生成二进制的几何比特流;或者,针对划分产生的交点(Vertex)进行算术编码(基于交点进行表面拟合),生成二进制的几何比特流。在属性编码过程中,几何编码完成,对几何信息进行重建后,需要先进行颜色转换,将颜色信息(即属性信息)从RGB颜色空间转换到YUV颜色空间。然后,利用重建的几何信息对点云重新着色,使得未编码的属性信息与重建的几何信息对应起来。属性编码主要针对颜色信息进行,在颜色信息编码过程中,主要 有两种变换方法,一是依赖于细节层次(Level of Detail,LOD)划分的基于距离的提升变换,二是直接进行区域自适应分层变换(Region Adaptive Hierarchal Transform,RAHT),之后对量化系数进行算术编码,可以生成二进制的属性比特流。Figure 4A shows a schematic diagram of the G-PCC encoder's architecture. As shown in Figure 4A, during the geometry encoding process, the geometric information is transformed so that the entire point cloud is contained within a bounding box. Quantization is then performed. This quantization step primarily serves a scaling purpose. Due to quantization rounding, the geometric information of some point clouds becomes identical. Parameters are then used to determine whether to remove duplicate points. This process of quantization and removing duplicate points is also known as voxelization. The bounding box is then partitioned into an octree or constructed as a prediction tree. During this process, arithmetic coding is performed on the points within the leaf nodes of the partition to generate a binary geometry bitstream. Alternatively, arithmetic coding is performed on the intersection points (vertices) generated by the partition (surface fitting is performed based on the intersection points) to generate a binary geometry bitstream. During the attribute encoding process, after the geometry encoding is completed and the geometry information is reconstructed, color conversion is performed to convert the color information (i.e., attribute information) from the RGB color space to the YUV color space. The reconstructed geometry information is then used to recolor the point cloud so that the unencoded attribute information corresponds to the reconstructed geometry information. Attribute encoding is mainly performed on color information. In the process of color information encoding, the main There are two transformation methods. One is a distance-based lifting transform that relies on the level of detail (LOD) division, and the other is a direct region adaptive hierarchical transform (RAHT) followed by arithmetic coding of the quantized coefficients to generate a binary attribute bitstream.

图4B示出了一种G-PCC解码器的组成框架示意图。如图4B所示,针对所获取的二进制比特流,首先对二进制比特流中的几何比特流和属性比特流分别进行独立解码。在对几何比特流的解码时,通过算术解码-重构八叉树/重构预测树-重建几何-坐标逆转换,得到点云的几何信息;在对属性比特流的解码时,通过算术解码-反量化-LOD划分/RAHT-颜色逆转换,得到点云的属性信息,基于几何信息和属性信息还原待编码的点云数据(即输出点云)。Figure 4B shows a schematic diagram of the composition framework of a G-PCC decoder. As shown in Figure 4B, for the acquired binary bit stream, the geometric bit stream and attribute bit stream in the binary bit stream are first decoded independently. When decoding the geometric bit stream, the geometric information of the point cloud is obtained through arithmetic decoding-reconstruction of the octree/reconstruction of the prediction tree-reconstruction of the geometry-coordinate inverse conversion; when decoding the attribute bit stream, the attribute information of the point cloud is obtained through arithmetic decoding-inverse quantization-LOD partitioning/RAHT-color inverse conversion, and the point cloud data to be encoded (i.e., the output point cloud) is restored based on the geometric information and attribute information.

相关技术2:Related technology 2:

在点云G-PCC编解码框架中,点云属性信息的预测变换(Predicting Transform,PT)编码一种用于点云数据压缩的技术,它结合了属性预测和变换编码的方法,以实现对点云数据的高效压缩。具体地,首先,对点云数据中的属性进行预测,这可以通过分析相邻点的属性值或者利用先验知识来进行属性预测。预测的目的是尽可能准确地估计点云中每个属性的值,以便后续的压缩和编码。预测完成后,将预测得到的属性值与原始属性值进行比较,得到预测误差或者残差。接着,对量化后的系数进行熵编码,通常采用霍夫曼编码或者算术编码等技术来进一步压缩数据。接收端对经过编码的数据进行解码和解压缩,恢复出预测误差,并与预测值相加得到重建的属性值。最终得到的重建属性值可以用来还原原始的点云数据。通过PT编码,可以有效地利用点云数据中的属性相关性和预测性,实现对点云数据的高效压缩和传输。In the point cloud G-PCC codec framework, predictive transform (PT) encoding of point cloud attribute information is a technique used for point cloud data compression. It combines attribute prediction and transform coding methods to achieve efficient compression of point cloud data. Specifically, attributes in the point cloud data are first predicted. This can be done by analyzing the attribute values of neighboring points or leveraging prior knowledge. The goal of prediction is to estimate the value of each attribute in the point cloud as accurately as possible for subsequent compression and encoding. After prediction, the predicted attribute value is compared with the original attribute value to obtain the prediction error or residual. Next, entropy encoding is performed on the quantized coefficients, typically using techniques such as Huffman coding or arithmetic coding to further compress the data. The receiver decodes and decompresses the encoded data, recovering the prediction error and adding it to the predicted value to obtain the reconstructed attribute value. The resulting reconstructed attribute value can be used to restore the original point cloud data. PT encoding effectively leverages the attribute correlation and predictability in point cloud data, achieving efficient compression and transmission of point cloud data.

图5为本申请实施例提供的一种PT编码的流程示意图,如图5所示,首先,根据细节层次(Levels of Detail,LoD)生成顺序,对原始点云进行LoD划分。然后,利用已重建的点(第i个点的3个最近邻点)对当前待编码点进行属性预测。进一步,通过属性预测值与第i个点的原始属性值作差得到当前待编码点的预测残差。最后,对预测残差进行量化和熵编码,生成属性码流。FIG5 is a schematic diagram of a PT encoding process provided by an embodiment of the present application. As shown in FIG5 , first, the original point cloud is divided into levels of detail (LoDs) according to the LoD generation order. Then, the attributes of the current point to be encoded are predicted using the reconstructed points (the three nearest neighbors of the i-th point). Furthermore, the prediction residual of the current point to be encoded is obtained by subtracting the attribute prediction value from the original attribute value of the i-th point. Finally, the prediction residual is quantized and entropy coded to generate an attribute code stream.

下文将按照上述步骤对PT预测编码流程做详细介绍。The following will give a detailed introduction to the PT prediction coding process according to the above steps.

步骤1、LoD生成:Step 1: LoD generation:

目前G-PCC软件平台采用的是基于距离的LoD构建方法,如图6所示,原始序列包括以下点:P1、P2、P3、P4、P5、P6、P7、P8、P9和P10。LoD序列包括3个细化层(Refinement levels):LoD1、LoD2和LoD3。(Rl)l=0…L-1表示细化层,L是LoD的层数。构建LoD具体步骤如下:The G-PCC software platform currently uses a distance-based LoD construction method. As shown in Figure 6, the original sequence includes the following points: P1, P2, P3, P4, P5, P6, P7, P8, P9, and P10. The LoD sequence includes three refinement levels: LoD1, LoD2, and LoD3. (R l ) l = 0…L-1 represents the refinement level, and L is the number of LoD levels. The specific steps for constructing LoD are as follows:

(1)、用户自定义L个欧式距离(dl)l=0…L-1,划分L个细化层(Rl)l=0…L-1(1) The user defines L Euclidean distances (d l ) l = 0…L-1 and divides the network into L refinement levels (R l ) l = 0…L-1 ;

(2)、将所有的点标记为未访问,并将已访问点集V设为空集;(2) Mark all points as unvisited and set the visited point set V to an empty set;

(3)、细化层Rl生成:(3) Generation of refinement layer Rl :

在一些实施例中,遍历所有点,如果已经访问当前点,则忽略;否则,计算当前点距离点集V的最小距离D。若D小于dl,则忽略当前点,否则,将当前点标记为已访问并加入到Rl和V中。重复上述过程,直到所有点被遍历到。In some embodiments, all points are traversed. If the current point has been visited, it is ignored. Otherwise, the minimum distance D between the current point and the point set V is calculated. If D is less than dl , the current point is ignored. Otherwise, the current point is marked as visited and added to Rl and V. The above process is repeated until all points have been traversed.

(4)、取细化层R0,R1,...,Rl的并集得到细节层LoDl(即);(4) Take the union of the refinement layers R 0 , R 1 , ..., R l to get the detail layer LoD l (i.e. );

(5)、重复上述过程,直到所有点均已被访问。(5) Repeat the above process until all points have been visited.

步骤2、最优预测值选取:Step 2: Select the optimal prediction value:

在一些实施例中,如图7所示,相关技术中确定最佳预测模式的流程包括S11至S17:In some embodiments, as shown in FIG7 , the process of determining the optimal prediction mode in the related art includes S11 to S17:

S11、计算3个候选邻居的最大属性差值。S11. Calculate the maximum attribute difference of the three candidate neighbors.

在一些实施例中,LoD构建完成以后,根据LoD的生成顺序,首先从已编码的数据点中找到当前待编码点的三个最近邻点。将这三个最近邻点的属性重建值,作为当前待编码点的候选预测值。In some embodiments, after the LoD is constructed, the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the LoD generation order. The attribute reconstructed values of these three nearest neighboring points are used as candidate prediction values of the current point to be encoded.

S12、最大属性差值是否大于预设阈值。S12: Whether the maximum attribute difference is greater than a preset threshold.

在一些实施例中,计算三个候选邻居的最大属性差值max_difference,如果最大属性差值大于预设阈值(自适应阈值adaptive_threshold),则执行S13,若最大属性差值小于或等于预设阈值(自适应阈值adaptive_threshold),则执行S14。In some embodiments, the maximum attribute difference max_difference of the three candidate neighbors is calculated. If the maximum attribute difference is greater than a preset threshold (adaptive threshold adaptive_threshold), S13 is executed. If the maximum attribute difference is less than or equal to the preset threshold (adaptive threshold adaptive_threshold), S14 is executed.

S13、利用RDO计算预测模式0~3的分数。S13. Calculate the scores of prediction modes 0 to 3 using RDO.

在一些实施例中,如果max_difference的值大于自适应阈值adaptive_threshold,则根据率失真优化(Rate-Distortion Optimal,RDO)从中选择最优的预测值。计算模式0~3的得分,并寻找最小代价得分作为最佳预测模式。In some embodiments, if the value of max_difference is greater than the adaptive threshold adaptive_threshold, the optimal prediction value is selected according to Rate-Distortion Optimal (RDO). The scores of modes 0 to 3 are calculated, and the minimum cost score is found as the optimal prediction mode.

S14、最佳预测模式=0。S14. Best prediction mode = 0.

在一些实施例中,如果max_difference的值小于自适应阈值adaptive_threshold,则认为三个邻居点是与被预测点属性值相近的,因此采用模式0加权预测。In some embodiments, if the value of max_difference is less than the adaptive threshold adaptive_threshold, the three neighboring points are considered to have attribute values close to the predicted point, and thus mode 0 weighted prediction is adopted.

S15、找到最小分数。 S15. Find the minimum score.

在一些实施例中,将模式0~3的得分中的最小代价得分对应的模式作为最佳预测模式。In some embodiments, the mode corresponding to the minimum cost score among the scores of modes 0 to 3 is taken as the best prediction mode.

S16、设置最佳预测模式。S16. Setting the optimal prediction mode.

S17、最佳预测模式=0~3。S17, optimal prediction mode = 0 to 3.

表1为本申请实施例提供的一种属性编码的候选预测模式的示意表,对于预测模式0,待编码点(也称为当前点或点前节点)的属性预测值为待编码点的三近邻的属性加权平均。对于预测模式1,待编码点的属性预测值为待编码点的第1近邻的属性值。对于预测模式2,待编码点的属性预测值为待编码点的第2近邻的属性值。对于预测模式3,待编码点的属性预测值为待编码点的第3近邻的属性值。示例性的,当编码图6中点P0的属性值时,将最近邻居点P2属性值的预测变量索引设为1;将次近邻点P7和三近邻点P10的属性预测变量索引分别设为2和3;将点P2、P7和P10的加权平均值的预测变量索引设为0。Table 1 is a schematic table of candidate prediction modes for attribute coding provided in an embodiment of the present application. For prediction mode 0, the attribute prediction value of the point to be coded (also called the current point or the node before the point) is the weighted average of the attributes of the three nearest neighbors of the point to be coded. For prediction mode 1, the attribute prediction value of the point to be coded is the attribute value of the first nearest neighbor of the point to be coded. For prediction mode 2, the attribute prediction value of the point to be coded is the attribute value of the second nearest neighbor of the point to be coded. For prediction mode 3, the attribute prediction value of the point to be coded is the attribute value of the third nearest neighbor of the point to be coded. Exemplarily, when encoding the attribute value of point P0 in Figure 6, the prediction variable index of the attribute value of the nearest neighbor point P2 is set to 1; the attribute prediction variable indexes of the second nearest neighbor point P7 and the third nearest neighbor point P10 are set to 2 and 3 respectively; and the prediction variable index of the weighted average value of points P2, P7 and P10 is set to 0.

表1
Table 1

在一些实施例中,对于预测模式0的加权平均可以通过公式(1)和公式(2)表示:

In some embodiments, the weighted average for prediction mode 0 can be expressed by formula (1) and formula (2):

在公式(1)和公式(2)中,表示当前点i的属性预测值,j表示3个邻居点(也称为近邻点)的索引,表示近邻点i的属性重建值,表示近邻点j到当前点i的空间几何权重,xi、yij和zij表示近邻点j的几何位置坐标,xi、yi和zi表示当前点i的几何位置坐标。In formula (1) and formula (2), represents the attribute prediction value of the current point i, j represents the index of the three neighboring points (also called neighboring points), represents the attribute reconstruction value of the neighboring point i, represents the spatial geometric weight from the neighboring point j to the current point i, x i , y ij and z ij represent the geometric position coordinates of the neighboring point j, and x i , y i and z i represent the geometric position coordinates of the current point i.

步骤3、属性预测残差及量化:Step 3: Attribute prediction residual and quantification:

在一些实施例中,通过步骤1和步骤2得到当前点i的属性预测值(k为点云的总点数)。令(ai)i∈0…k-1为当前点的原始属性值,则属性预测残差(ri)i∈0…k-1可以通过公式(3)表示:
In some embodiments, the attribute prediction value of the current point i is obtained through steps 1 and 2. (k is the total number of points in the point cloud). Let (a i ) i∈0…k-1 be the original attribute value of the current point, then the attribute prediction residual ( ri ) i∈0…k-1 can be expressed by formula (3):

在公式(3)中,表示当前点i的属性预测值,ai表示当前点i的原始属性值,ri表示当前点i的属性预测残差。In formula (3), Represents the attribute prediction value of the current point i, ai represents the original attribute value of the current point i, and ri represents the attribute prediction residual of the current point i.

在一些实施例中,对当前点i的属性预测残差进行量化通过公式(4)表示:
In some embodiments, the attribute prediction residual of the current point i is quantized by formula (4):

在公式(4)中,ri表示当前点i的属性预测残差,Qs表示量化步长(Quantization step,Qs),Qi表示当前点i的量化后的属性预测残差。其中,量化步长Qs可以由无连接传输协议(Connectionless Transport Protocol,CTC)规定的量化参数(Quantization Parameter,QP)计算得出。In formula (4), ri represents the attribute prediction residual of the current point i, Qs represents the quantization step (Qs), and Qi represents the quantized attribute prediction residual of the current point i. The quantization step Qs can be calculated using the quantization parameter (QP) specified by the connectionless transport protocol (CTC).

相关技术3:Related technology 3:

G-PCC软件平台采用的是基于欧式距离的LoD构建方法,但是对于含有多种属性(颜色、反射率)的具有自适应多分辨率特性并且经过融合处理的点云序列(Adaptive Multi-resolution Fused Point Cloud Sequences,Am-fused点云序列),如果Am-fused点云序列的一种属性已经编码好,则另一种属性的预测可以被已经编码好的属性指导。例如如果重建点云某两个点的反射率值差距很大,则理应认为这两个点的颜色信息差距也很大。基于这个思路,G-PCC在多属性点云中修改了LoD构建方法,当编码第二个属性时,LoD的距离计算公式可以通过公式(5)和公式(6)表示:
overrallDis=geomW×geomDis+attrW×attrDis             (5)
attrW=λ×maxGeom/maxAttr                     (6)
The G-PCC software platform uses a LoD construction method based on Euclidean distance. However, for point cloud sequences (Adaptive Multi-resolution Fused Point Cloud Sequences, Am-fused point cloud sequences) with adaptive multi-resolution characteristics and fused processing containing multiple attributes (color, reflectivity), if one attribute of the Am-fused point cloud sequence has been encoded, the prediction of the other attribute can be guided by the already encoded attribute. For example, if the reflectivity values of two points in the reconstructed point cloud are very different, it should be assumed that the color information of the two points is also very different. Based on this idea, G-PCC modified the LoD construction method in the multi-attribute point cloud. When encoding the second attribute, the distance calculation formula of LoD can be expressed by formula (5) and formula (6):
overrallDis=geomW×geomDis+attrW×attrDis (5)
attrW=λ×maxGeom/maxAttr (6)

在公式(5)和公式(6)中,maxGeom表示分块边界框的长、宽、高之和,maxAttr表示已编码好属性的最大值,λ表示一个平衡几何和属性重要性的参数,attrDis的值为当前点与预测点之间已经编码好的属性值的差异,geomDis代表当前点与预测点之间的欧式距离,geomW被设置为1。In formulas (5) and (6), maxGeom represents the sum of the length, width, and height of the bounding box of the block, maxAttr represents the maximum value of the encoded attribute, λ represents a parameter that balances the importance of geometry and attributes, the value of attrDis is the difference in the encoded attribute values between the current point and the predicted point, geomDis represents the Euclidean distance between the current point and the predicted point, and geomW is set to 1.

在目前的G-PCC属性编码框架中,为了去除点云编码的时间和空间冗余,广泛引入了帧内预测和帧间预测。并且还引入了色度间预测,用来去除色度蓝色分量(Chrominance Blue Component,Cb)和色度红色分量(Chrominance red component,Cr)之间的冗余。而当G-PCC编码多种属性(颜色、反射率)的Am-fused点云序列时,两种属性间的冗余还没有充分挖掘并去除。虽然已经有相关技术去挖 掘属性间的相关性信息,但仅仅也是用编码好的一种属性信息去指导另一种属性编码。而当一个属性已经编码完成,对另一种属性进行编码时,属性间还存在着大量的冗余,这必然会造成码率的浪费。In the current G-PCC attribute coding framework, intra-frame prediction and inter-frame prediction are widely introduced to remove the temporal and spatial redundancy of point cloud coding. Inter-chrominance prediction is also introduced to remove the redundancy between the chrominance blue component (Cb) and the chrominance red component (Cr). However, when G-PCC encodes an Am-fused point cloud sequence with multiple attributes (color, reflectivity), the redundancy between the two attributes has not been fully mined and removed. Although there are related technologies to mine The correlation information between attributes is mined, but it only uses the encoded attribute information to guide the encoding of another attribute. When one attribute has been encoded and another attribute is encoded, there is still a lot of redundancy between the attributes, which will inevitably cause a waste of bit rate.

基于此,第一方面,本申请实施例提供了一种解码方法,一方面,通过目标跨属性预测模式和目标近邻点的相关系数确定当前点的待解码属性的属性预测值,可以更准确地预测当前点的属性值,避免了传输冗余的信息,这样可以在编码时减少需要传输的数据量,从而降低了码率的浪费。一方面,在对当前点的待解码属性的属性重建值进行预测的过程中,是基于当前点的目标近邻点的相关系数和当前点的待解码属性的属性参考值确定的,可以提高码率的利用率,避免码率的浪费,可以减少数据传输时的冗余和成本,从而可以提升解码的效率和性能。Based on this, on the first aspect, an embodiment of the present application provides a decoding method. On the one hand, by determining the attribute prediction value of the attribute to be decoded of the current point through the correlation coefficient of the target cross-attribute prediction mode and the target neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information. This can reduce the amount of data that needs to be transmitted during encoding, thereby reducing the waste of bit rate. On the one hand, in the process of predicting the attribute reconstruction value of the attribute to be decoded of the current point, it is determined based on the correlation coefficient of the target neighboring points of the current point and the attribute reference value of the attribute to be decoded of the current point, which can improve the utilization of the bit rate, avoid the waste of bit rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of decoding.

下面将结合附图对本申请各实施例进行详细说明。The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

在本申请的一实施例中,图8为本申请实施例提供的一种解码方法的流程示意图。如图8所示,该方法可以包括S101至S105:In one embodiment of the present application, FIG8 is a flowchart of a decoding method provided by the embodiment of the present application. As shown in FIG8 , the method may include S101 to S105:

S101、解码码流,确定当前点的第一语法元素信息。S101: Decode a bitstream and determine the first syntax element information of the current point.

需要说明的是,本申请实施例的解码方法应用于解码器。另外,该解码方法具体可以是指一种面向激光雷达点云跨属性预测方法。其中,在属性预测模式中,这里主要是针对一种单邻居跨属性预测的PT编码方法的改进,以避免相关技术中当一个属性信息已经编码完成,对另一种属性信息进行编码时,两种属性信息之间还存在着大量的冗余的问题。It should be noted that the decoding method of the embodiment of the present application is applied to the decoder. In addition, the decoding method can specifically refer to a method for cross-attribute prediction of lidar point clouds. Among them, in the attribute prediction mode, this is mainly aimed at improving a PT encoding method for single-neighbor cross-attribute prediction to avoid the problem of a large amount of redundancy between the two attribute information when one attribute information has been encoded and another attribute information is encoded in the related art.

在本申请实施例中,当前点也称为当前节点、当前待解码点、待解码点、当前待检测点、待解码节点等,本申请实施例对此不作任何限定。In the embodiment of the present application, the current point is also called the current node, the current point to be decoded, the point to be decoded, the current point to be detected, the node to be decoded, etc., and the embodiment of the present application does not impose any limitation on this.

在本申请实施例中,第一语法元素信息用于指示当前点的最佳预测模式。其中,当前点的最佳预测模式可以为跨属性预测模式或非跨属性预测模式。In the embodiment of the present application, the first syntax element information is used to indicate the best prediction mode for the current point, wherein the best prediction mode for the current point can be a cross-attribute prediction mode or a non-cross-attribute prediction mode.

在本申请实施例中,第一语法元素信息的取值可以为参数形式,也可以是数字形式。具体地,第一语法元素信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。In the embodiment of the present application, the value of the first syntax element information can be in parameter form or in digital form. Specifically, the first syntax element information can be a parameter written in the profile or a flag value, which is not specifically limited here.

示例性的,若第一语法元素信息的取值为0,则确定当前点的最佳预测模式为预测模式0;若第一语法元素信息的取值为1,则确定当前点的最佳预测模式为预测模式1。Exemplarily, if the value of the first syntax element information is 0, the best prediction mode of the current point is determined to be prediction mode 0; if the value of the first syntax element information is 1, the best prediction mode of the current point is determined to be prediction mode 1.

S102、根据第一语法元素信息的取值,从候选预测模式中确定当前点的最佳预测模式为目标跨属性预测模式。S102: Determine, according to the value of the first syntax element information, the best prediction mode at the current point from the candidate prediction modes as the target cross-attribute prediction mode.

在本申请实施例中,候选预测模式至少包括一个或多个候选跨属性预测模式。这里,候选跨属性预测模式也称为跨属性预测模式。In the embodiment of the present application, the candidate prediction mode includes at least one or more candidate cross-attribute prediction modes. Here, the candidate cross-attribute prediction mode is also referred to as a cross-attribute prediction mode.

在本申请实施例中,目标跨属性预测模式为一个或多个候选跨属性预测模式中的最佳预测模式。In the embodiment of the present application, the target cross-attribute prediction mode is the best prediction mode among one or more candidate cross-attribute prediction modes.

示例性的,候选预测模式可以包括3个候选跨属性预测模式,预测模式1、预测模式2和预测模式3。在第一语法元素信息的取值为1的情况下,将预测模式1作为目标跨属性预测模式。在第一语法元素信息的取值为2的情况下,将预测模式2作为目标跨属性预测模式。在第一语法元素信息的取值为3的情况下,将预测模式3作为目标跨属性预测模式。Exemplarily, the candidate prediction modes may include three candidate cross-attribute prediction modes, prediction mode 1, prediction mode 2, and prediction mode 3. When the value of the first syntax element information is 1, prediction mode 1 is used as the target cross-attribute prediction mode. When the value of the first syntax element information is 2, prediction mode 2 is used as the target cross-attribute prediction mode. When the value of the first syntax element information is 3, prediction mode 3 is used as the target cross-attribute prediction mode.

在本申请实施例中,候选跨属性预测模式指的是利用当前点的近邻点的一个或多个属性重建值,预测当前点的待解码属性的属性预测值。In the embodiment of the present application, the candidate cross-attribute prediction mode refers to predicting the attribute prediction value of the to-be-decoded attribute of the current point by using one or more attribute reconstruction values of the neighboring points of the current point.

下面以一个或多个属性重建值包括亮度重建值和反射率重建值为例进行说明。The following description is made by taking one or more attribute reconstruction values including a brightness reconstruction value and a reflectivity reconstruction value as an example.

示例性的,候选跨属性预测模式可以表征利用当前点的近邻点的亮度重建值和反射率重建值,预测当前点的亮度重建值。或者,跨属性预测模式可以表征利用当前点的近邻点的亮度重建值和反射率重建值,预测当前点的反射率重建值。For example, the candidate cross-attribute prediction mode may represent the use of the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the brightness reconstruction value of the current point. Alternatively, the cross-attribute prediction mode may represent the use of the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the reflectivity reconstruction value of the current point.

需要说明的是,在本申请实施例中,候选跨属性预测模式以当前点的近邻点的亮度重建值和反射率重建值预测当前点的亮度重建值或反射率重建值进行说明。在实际应用场景中并不限制亮度重建值和反射率重建值,还可以为其他属性的重建值,本申请实施例对此不作任何限定。It should be noted that in this embodiment of the present application, the candidate cross-attribute prediction mode uses the brightness reconstruction value and reflectivity reconstruction value of the current point's neighboring points to predict the brightness reconstruction value or reflectivity reconstruction value of the current point. In actual application scenarios, the brightness reconstruction value and reflectivity reconstruction value are not limited to these values and can also be the reconstruction values of other attributes. This embodiment of the present application does not impose any restrictions on this.

S103、根据目标跨属性预测模式,确定当前点的目标近邻点的一个或多个属性重建值。S103 : Determine one or more attribute reconstruction values of target neighboring points of the current point according to the target cross-attribute prediction mode.

在本申请实施例中,目标跨属性预测模式与目标近邻点相对应。即目标近邻点为当前点的M个近邻点中的与目标跨属性预测模式对应的近邻点。In the embodiment of the present application, the target cross-attribute prediction mode corresponds to the target neighbor point, that is, the target neighbor point is the neighbor point corresponding to the target cross-attribute prediction mode among the M neighbor points of the current point.

在本申请实施例中,目标跨属性预测模式与目标近邻点相关。表2为本申请实施例提供的一种候选预测模式的示意表一,如表2所示,在目标跨属性预测模式为预测模式1的情况下,表明利用当前点的第1个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。在目标跨属性预测模式为预测模式2的情况下,表明利用当前点的第2个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。在目标跨属性预测模式为预测模式3的情况下,表明利用当前点的第3个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。 In an embodiment of the present application, the target cross-attribute prediction mode is related to the target neighbor point. Table 2 is a schematic table 1 of a candidate prediction mode provided in an embodiment of the present application. As shown in Table 2, when the target cross-attribute prediction mode is prediction mode 1, it indicates that the first neighbor point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point. When the target cross-attribute prediction mode is prediction mode 2, it indicates that the second neighbor point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point. When the target cross-attribute prediction mode is prediction mode 3, it indicates that the third neighbor point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.

表2
Table 2

在本申请实施例中,表1中的第1个近邻点、第2个近邻点和第3个近邻点是根据RoD生成顺序确定的。假设当前点云序列包括以下点:P0、P1、P2、P3、P4、P5、P6、P7、P8、P9和P10,对上述11个点进行基于距离的LoD构建,得到LoD序列:P0、P2、P7、P10、P1、P5、P6、P9、P3、P4和P8。假设当前点为P0,则P0的第1个近邻点为P2,P0的第2个近邻点为P7,P0的第3个近邻点为P10。In the embodiment of the present application, the first, second, and third neighbor points in Table 1 are determined according to the RoD generation order. Assuming that the current point cloud sequence includes the following points: P0, P1, P2, P3, P4, P5, P6, P7, P8, P9, and P10, the distance-based LoD construction is performed on the above 11 points to obtain the LoD sequence: P0, P2, P7, P10, P1, P5, P6, P9, P3, P4, and P8. Assuming that the current point is P0, the first neighbor point of P0 is P2, the second neighbor point of P0 is P7, and the third neighbor point of P0 is P10.

示例性的,预测模式1可以指利用当前点的第1个近邻点的亮度重建值和属性重建值预测当前点的亮度重建值,或者,预测模式1可以指利用当前点的第1个近邻点的亮度重建值和属性重建值预测当前点的反射率重建值。预测模式2可以指利用当前点的第2个近邻点的亮度重建值和属性重建值预测当前点的亮度重建值,或者,预测模式2可以指利用当前点的第2个近邻点的亮度重建值和属性重建值预测当前点的反射率重建值。预测模式3可以指利用当前点的第3个近邻点的亮度重建值和属性重建值预测当前点的亮度重建值,或者,预测模式3可以指利用当前点的第3个近邻点的亮度重建值和属性重建值预测当前点的反射率重建值。Exemplarily, prediction mode 1 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the first neighboring point of the current point, or prediction mode 1 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the first neighboring point of the current point. Prediction mode 2 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the second neighboring point of the current point, or prediction mode 2 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the second neighboring point of the current point. Prediction mode 3 may refer to predicting the brightness reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the third neighboring point of the current point, or prediction mode 3 may refer to predicting the reflectivity reconstruction value of the current point using the brightness reconstruction value and attribute reconstruction value of the third neighboring point of the current point.

S104、根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数。S104: Determine the correlation coefficient of the target neighboring point based on one or more attribute reconstruction values of the target neighboring point.

在本申请实施例中,目标近邻点的相关系数有以下3种情况:In the embodiment of the present application, the correlation coefficients of the target neighbor points have the following three cases:

情况1、目标近邻点的相关系数表征目标近邻点的多个属性重建值之间的相关性。Case 1: The correlation coefficient of the target neighboring points represents the correlation between the reconstructed values of multiple attributes of the target neighboring points.

示例性的,目标近邻点的多个属性重建值可以包括:亮度重建值和反射率重建值。这时,目标近邻点的相关系数可以表征目标近邻点的亮度重建值和反射率重建值之间的相关性。For example, the multiple attribute reconstruction values of the target neighboring point may include: a brightness reconstruction value and a reflectivity reconstruction value. In this case, the correlation coefficient of the target neighboring point may represent the correlation between the brightness reconstruction value and the reflectivity reconstruction value of the target neighboring point.

情况2、目标近邻点的相关系数表征目标近邻点的属性重建值和当前点的属性重建值之间的相关性。Case 2: The correlation coefficient of the target neighboring point represents the correlation between the attribute reconstruction value of the target neighboring point and the attribute reconstruction value of the current point.

示例性的,在目标近邻点的属性重建值为亮度重建值的情况下,目标近邻点的相关系数可以表征目标近邻点的亮度重建值和当前点的亮度重建值之间的相关性。或者,在目标近邻点的属性重建值为反射率重建值的情况下,目标近邻点的相关系数可以表征目标近邻点的反射率重建值和当前点的反射率重建值之间的相关性。For example, when the attribute reconstruction value of the target neighbor point is a brightness reconstruction value, the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstruction value of the target neighbor point and the brightness reconstruction value of the current point. Alternatively, when the attribute reconstruction value of the target neighbor point is a reflectivity reconstruction value, the correlation coefficient of the target neighbor point can represent the correlation between the reflectivity reconstruction value of the target neighbor point and the reflectivity reconstruction value of the current point.

情况3、目标近邻点的相关系数表征目标近邻点的属性重建值和当前点的非目标近邻点的属性重建值之间的相关性。Case 3: The correlation coefficient of the target neighbor point represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the non-target neighbor point of the current point.

示例性的,非目标近邻点为当前点的M个近邻点中的除目标近邻点之外的任一个近邻点。非目标近邻点可以为当前点的M个近邻点中的除目标近邻点之外距离当前点最近的近邻点。Exemplarily, the non-target neighbor point is any neighbor point other than the target neighbor point among the M neighbor points of the current point. The non-target neighbor point can be the neighbor point closest to the current point other than the target neighbor point among the M neighbor points of the current point.

示例性的,目标近邻点的相关系数可以表征目标近邻点的亮度重建值和非目标近邻点的亮度重建值之间的相关性。或者,目标近邻点的相关系数可以表征目标近邻点的亮度重建值和非目标近邻点的反射率重建值之间的相关性。或者,目标近邻点的相关系数可以表征目标近邻点的反射率重建值和非目标近邻点的反射率重建值之间的相关性。For example, the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstructed value of the target neighbor point and the brightness reconstructed value of the non-target neighbor point. Alternatively, the correlation coefficient of the target neighbor point can represent the correlation between the brightness reconstructed value of the target neighbor point and the reflectivity reconstructed value of the non-target neighbor point. Alternatively, the correlation coefficient of the target neighbor point can represent the correlation between the reflectivity reconstructed value of the target neighbor point and the reflectivity reconstructed value of the non-target neighbor point.

S105、根据当前点的待解码属性的属性参考值和相关系数,确定当前点的待解码属性的属性预测值。S105 : Determine the attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value and the correlation coefficient of the attribute to be decoded at the current point.

在本申请实施例中,待解码属性可以为亮度或反射率。In the embodiment of the present application, the attribute to be decoded may be brightness or reflectivity.

在本申请的一些实施例中,将当前点的待解码属性的属性参考值和相关系数相乘,确定待解码属性的属性预测值。In some embodiments of the present application, the attribute reference value of the attribute to be decoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be decoded.

在本申请实施例中,S105之后的实现,该包括S106:In the embodiment of the present application, the implementation after S105 includes S106:

S106、基于当前点的待解码属性的属性预测值,确定当前点的待解码属性的属性重建值。S106 : Determine the attribute reconstruction value of the attribute to be decoded at the current point based on the attribute prediction value of the attribute to be decoded at the current point.

在本申请实施例中,S106的实现可以包括:In the embodiment of the present application, the implementation of S106 may include:

解码码流,确定当前点的待解码属性的属性预测差值;Decode the code stream and determine the attribute prediction difference of the attribute to be decoded at the current point;

根据当前点的待解码属性的属性预测差值,确定当前点的待解码属性的属性重建值。Determine the attribute reconstruction value of the attribute to be decoded at the current point according to the attribute prediction difference of the attribute to be decoded at the current point.

在本申请实施例中,将当前点的待解码属性的属性预测差值相加,得到当前点的待解码属性的属性重建值。In the embodiment of the present application, the attribute prediction difference values of the attribute to be decoded at the current point are added to obtain the attribute reconstruction value of the attribute to be decoded at the current point.

本申请实施例提供了一种解码方法,该解码方法包括:解码码流,确定当前点的第一语法元素信息;根据第一语法元素信息的取值,从候选预测模式中确定当前点采用的最佳预测模式为目标跨属性预测模式;根据目标跨属性预测模式,确定当前点的目标近邻点的一个或多个属性重建值;根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数;根据当前点的待解码属性的属性参考值和相关系 数,确定当前点的待解码属性的属性预测值;基于当前点的待解码属性的属性预测值,确定当前点的待解码属性的属性重建值。根据当前点的属性参考值和相关系数,确定当前点的待解码属性的属性预测值。待解码属性的属性预测值是根据当前点的邻近点的相关性信息和已知属性值计算得出的,可以作为当前点属性的预测值。相关系数可以帮助衡量待解码属性与已知属性之间的相关程度。如果相关系数较高,意味着两者之间存在较强的线性关系,预测值可以更准确地反映出待解码属性的实际值。通过利用相关系数进行预测,可以避免不必要的数据传输和存储。如果待解码属性与已知属性之间相关性较低,预测值会更加接近待解码属性的实际值,减少了冗余数据的传输和存储。从而可以提高码率的利用率,避免码率浪费,进而可以提高解码性能。The embodiment of the present application provides a decoding method, which includes: decoding a code stream, determining the first syntax element information of the current point; determining the best prediction mode adopted by the current point from the candidate prediction modes as the target cross-attribute prediction mode according to the value of the first syntax element information; determining one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determining the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; determining the attribute reference value and the correlation coefficient of the attribute to be decoded of the current point according to ... The predicted attribute value of the attribute to be decoded at the current point is determined based on the predicted attribute value. The reconstructed attribute value of the attribute to be decoded at the current point is determined based on the predicted attribute value. The predicted attribute value of the attribute to be decoded at the current point is determined based on the attribute reference value and the correlation coefficient. The predicted attribute value of the attribute to be decoded is calculated based on the correlation information of the current point's neighboring points and the known attribute values. It serves as the predicted value of the attribute at the current point. The correlation coefficient helps measure the degree of correlation between the attribute to be decoded and the known attributes. A high correlation coefficient indicates a strong linear relationship between the two, and the predicted value more accurately reflects the actual value of the attribute to be decoded. Using the correlation coefficient for prediction avoids unnecessary data transmission and storage. If the correlation between the attribute to be decoded and the known attributes is low, the predicted value will be closer to the actual value of the attribute to be decoded, reducing the transmission and storage of redundant data. This improves bitrate utilization, avoids bitrate waste, and ultimately improves decoding performance.

下面对前文中提到的目标近邻点的相关系数的3种情况下,如何对当前点的待解码属性的属性预测值进行跨属性预测分别说明,具体分为以下3点。The following describes how to perform cross-attribute prediction on the attribute prediction value of the attribute to be decoded at the current point in the three cases of correlation coefficients of the target neighbor points mentioned above. The details are divided into the following three points.

1、针对情况1中相关系数表征目标近邻点的多个属性重建值之间的相关性。1. The correlation coefficient in case 1 represents the correlation between the reconstructed values of multiple attributes of the target neighboring points.

在本申请的一些实施例中,相关系数包括第一系数;S104中根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a first coefficient; and the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:

根据目标近邻点的第一属性重建值和目标近邻点的第二属性重建值,确定第一系数。A first coefficient is determined according to a first attribute reconstruction value of the target neighboring point and a second attribute reconstruction value of the target neighboring point.

在本申请实施例中,在情况1中,目标近邻点的第一属性重建值对应的属性与目标近邻点的第二属性重建值对应的属性不同,且第一属性重建值对应的属性与第二属性重建值对应的属性具有相关性。In an embodiment of the present application, in situation 1, the attribute corresponding to the first attribute reconstruction value of the target neighbor point is different from the attribute corresponding to the second attribute reconstruction value of the target neighbor point, and the attribute corresponding to the first attribute reconstruction value is correlated with the attribute corresponding to the second attribute reconstruction value.

需要说明的是,第一属性重建值对应的属性与第二属性重建值对应的属性不同且具有相关性,意味着第一属性重建值和第二属性重建值为两种不同属性(第一属性和第二属性)的重建值,但是第一属性和第二属性具有相关性。示例性的,第一属性可以为亮度,第二属性可以为反射率。It should be noted that the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction value are different and correlated, meaning that the first attribute reconstruction value and the second attribute reconstruction value are reconstruction values of two different attributes (the first attribute and the second attribute), but the first attribute and the second attribute are correlated. For example, the first attribute can be brightness and the second attribute can be reflectivity.

这里,对亮度和反射率之间具有相关性进行说明。在物体的光学特性方面,亮度通常指的是人眼感知到的光的强度或者光的明暗程度。而反射率则是表征物体表面对光的反射程度,即表面反射光的相对强度。在通常情况下,较高的反射率通常会导致更高的亮度。根据光学理论,物体的亮度属性和反射率属性具有较强的相关性,经统计,Am-fused类别点云中的多数点之间的反射率和亮度信息也有着较强的相关性,特别是对于近邻点,它们的相关关系基本相同。因此使用当前点已经编码好的属性信息去预测未编码属性值,便可起到减少残差、去除冗余的效果。示例性的,如图9所示,当前点云的亮度信息(luma)已编码完成,当前点(待预测点)为P0,当前点的三个近邻点分别为P1、P2和P3。当前点的目标近邻点为P1,则利用P1的亮度重建值(luma=40)和P1的反射率重建值(ref=40)之间的关系建立线性模型(第一系数),作为当前点P0的亮度信息与反射率信息的相关关系,从而利用P0的亮度重建值和P1的第一系数预测当前点的待解码属性(反射率)的属性预测值,或者,利用P0的反射率重建值和P1的第一系数预测当前点的待解码属性(亮度)的属性预测值。Here, the correlation between brightness and reflectivity is explained. In terms of the optical properties of an object, brightness generally refers to the intensity or brightness of light perceived by the human eye. Reflectivity, on the other hand, characterizes the degree of light reflection from an object's surface, that is, the relative intensity of light reflected from the surface. Generally speaking, higher reflectivity results in higher brightness. According to optical theory, an object's brightness and reflectivity properties are strongly correlated. Statistics show that the reflectivity and brightness information of most points in the Am-fused point cloud also have a strong correlation, especially for neighboring points, where the correlation is essentially the same. Therefore, using the encoded attribute information of the current point to predict the unencoded attribute value can reduce residual errors and remove redundancy. For example, as shown in Figure 9, the brightness information (luma) of the current point cloud has been encoded. The current point (the point to be predicted) is P0, and its three neighboring points are P1, P2, and P3. If the target neighbor point of the current point is P1, a linear model (first coefficient) is established using the relationship between the brightness reconstruction value of P1 (luma=40) and the reflectivity reconstruction value of P1 (ref=40) as the correlation between the brightness information and the reflectivity information of the current point P0, thereby using the brightness reconstruction value of P0 and the first coefficient of P1 to predict the attribute prediction value of the attribute to be decoded (reflectivity) of the current point, or, using the reflectivity reconstruction value of P0 and the first coefficient of P1 to predict the attribute prediction value of the attribute to be decoded (brightness) of the current point.

可以理解的是,第一系数可以反映目标近邻点的不同属性之间的关联程度。如果第一系数接近于1,表示第一属性和第二属性之间存在强烈的正相关关系;如果接近于0,表示两者之间几乎没有相关性,这有助于评估属性之间的关联性,从而更好地理解数据的特征和规律。It can be understood that the first coefficient reflects the degree of correlation between the different attributes of the target's neighboring points. If the first coefficient is close to 1, it indicates a strong positive correlation between the first and second attributes; if it is close to 0, it indicates almost no correlation between the two. This helps to assess the correlation between attributes and better understand the characteristics and patterns of the data.

在本申请的一些实施例中,第一系数包括目标近邻点的第一属性重建值和目标近邻点的第二属性重建值的比值。In some embodiments of the present application, the first coefficient includes a ratio of a first attribute reconstruction value of the target neighbor point to a second attribute reconstruction value of the target neighbor point.

在本申请实施例中,第一属性重建值对应的属性和第二属性重建对应的属性与当前节点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction are related to the attribute coding order of the current node.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第一系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the first coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,目标近邻点的第一属性重建值为目标近邻点第二属性的重建值,目标近邻点的第二属性重建值为目标近邻点第一属性的重建值,待解码属性的属性参考值为当前点第一属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,目标近邻点的第一属性重建值为目标近邻点的反射率重建值,目标近邻点的第二属性重建值为目标近邻点的亮度重建值,当前点的待解码属性的属性参考值为当前点的亮度重建值,当前点的待解码属性的属性预测值为反射率预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the target neighbor point is the reflectivity reconstruction value of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point, the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the current point, and the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.

示例性的,当前点的反射率预测值可以根据公式(7)和公式(8)确定:

For example, the reflectivity prediction value of the current point can be determined according to formula (7) and formula (8):

在公式(7)和公式(8)中,Coeffref表示当前点的反射率预测值(待解码属性的属性预测值),Coeffluma表示当前点的亮度重建值(待解码属性的属性参考值),si表示目标近邻点(当前点的第i个 近邻点)的第一系数,表示目标近邻点的反射率重建值(即目标近邻点的第一属性重建值),表示目标近邻点的亮度重建值(即目标近邻点的第二属性重建值)。In formula (7) and formula (8), Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded), Coeff luma represents the brightness reconstruction value of the current point (the attribute reference value of the attribute to be decoded), and si represents the target neighbor point (the i-th neighbor of the current point). The first coefficient of the nearest neighbor point, Represents the reflectivity reconstruction value of the target neighboring point (i.e., the first attribute reconstruction value of the target neighboring point), Represents the brightness reconstruction value of the target neighboring point (that is, the second attribute reconstruction value of the target neighboring point).

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,目标近邻点的第一属性重建值为目标近邻点第一属性的重建值,目标近邻点的第二属性重建值为目标近邻点第二属性的重建值,待解码属性的属性参考值为当前点第二属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,目标近邻点的第一属性重建值为目标近邻点的亮度重建值,目标近邻点的第二属性重建值为目标近邻点的反射率重建值,当前点的待解码属性的属性参考值为当前点的反射率重建值,当前点的待解码属性的属性预测值为亮度预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is that reflection precedes brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the reflectivity reconstruction value of the target neighbor point, the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the current point, and the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value.

示例性的,当前点的亮度预测值可以根据公式(9)和公式(10)确定:

For example, the brightness prediction value of the current point can be determined according to formula (9) and formula (10):

在公式(9)和公式(10)中,Coeffref表示当前点的反射率重建值(待解码属性的属性参考值),Coeffluma表示当前点的亮度预测值(待解码属性的属性预测值),si表示目标近邻点(当前点的第i个近邻点)的第一系数,表示目标近邻点的反射率重建值(目标近邻点的第二属性重建值),表示目标近邻点的亮度重建值(即目标近邻点的第一属性重建值)。In formula (9) and formula (10), Coeff ref represents the reflectivity reconstruction value of the current point (the attribute reference value of the attribute to be decoded), Coeff luma represents the brightness prediction value of the current point (the attribute prediction value of the attribute to be decoded), and si represents the first coefficient of the target neighbor point (the i-th neighbor point of the current point). Represents the reflectivity reconstruction value of the target neighboring point (the second attribute reconstruction value of the target neighboring point), Represents the brightness reconstruction value of the target neighboring point (that is, the first attribute reconstruction value of the target neighboring point).

可以理解的是,一方面,通过第一系数,可以将目标近邻点的第一属性重建值和第二属性重建值的相关性纳入预测过程中。如果第一系数较大,表示两个属性之间存在强烈的相关性,那么在预测当前点的待解码属性时,可以更准确地利用第一属性和第二属性之间的关系,提高预测的准确性。再一方面,结合第一系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。这种基于相关性信息的预测方法可以避免不必要的误差,并提高解码过程的准确性。又一方面,基于第一系数和属性参考值的属性预测值计算过程相对简单且准确,不需要过多的计算资源,可以减少数据传输过程中的冗余信息,提高数据传输的效率。特别是在带宽有限或传输成本较高的情况下,有效利用相关性信息可以节省传输数据资源。It can be understood that, on the one hand, the correlation between the first attribute reconstruction value and the second attribute reconstruction value of the target neighbor point can be incorporated into the prediction process through the first coefficient. If the first coefficient is large, it indicates that there is a strong correlation between the two attributes. Then, when predicting the attribute to be decoded at the current point, the relationship between the first attribute and the second attribute can be more accurately utilized to improve the accuracy of the prediction. On the other hand, combining the first coefficient and the attribute reference value can obtain a more accurate attribute prediction value of the attribute to be decoded. This prediction method based on correlation information can avoid unnecessary errors and improve the accuracy of the decoding process. On the other hand, the attribute prediction value calculation process based on the first coefficient and the attribute reference value is relatively simple and accurate, does not require excessive computing resources, can reduce redundant information in the data transmission process, and improve the efficiency of data transmission. Especially in the case of limited bandwidth or high transmission costs, the effective use of correlation information can save transmission data resources.

2、针对情况2中相关系数表征目标近邻点的属性重建值和当前点的属性重建值之间的相关性。2. For case 2, the correlation coefficient represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the current point.

在本申请的一些实施例中,相关系数包括第二系数;S104中根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a second coefficient; and the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:

根据当前点的第一属性重建值和目标近邻点的第一属性重建值,确定第二系数。The second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point.

在本申请实施例中,在情况2中,目标近邻点的第一属性重建值对应的属性与当前点的属性重建值对应的属性相同。In the embodiment of the present application, in case 2, the attribute corresponding to the first attribute reconstruction value of the target neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the current point.

在本申请的一些实施例中,第二系数包括当前点的第一属性重建值和目标近邻点的第一属性重建值的比值。In some embodiments of the present application, the second coefficient includes a ratio of a first attribute reconstruction value of the current point to a first attribute reconstruction value of a target neighboring point.

在本申请实施例中,第一属性重建值对应的属性与当前点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第二系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the second coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,当前点的第一属性重建值为当前点第一属性的重建值,目标近邻点的第一属性重建值为目标近邻点第一属性的重建值,待解码属性的属性参考值为目标近邻点第二属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstruction value of the first attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighboring point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,当前点的第一属性重建值为当前点的亮度重建值,目标近邻点的第一属性重建值为目标近邻点的亮度重建值,当前点的待解码属性的属性参考值为目标近邻点的反射率重建值,当前点的待解码属性的属性预测值为反射率预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the current point is the brightness reconstruction value of the current point, the first attribute reconstruction value of the target neighboring point is the brightness reconstruction value of the target neighboring point, the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the target neighboring point, and the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.

示例性的,当前点的亮度预测值可以根据公式(11)和公式(12)确定:

For example, the brightness prediction value of the current point can be determined according to formula (11) and formula (12):

在公式(11)和公式(12)中,Coeffref表示当前点的反射率预测值(待解码属性的属性预测值),Coeffluma表示当前点的亮度重建值(当前点的第一属性重建值),si表示目标近邻点(当前点的第i个近邻点)的第二系数,表示目标近邻点的反射率重建值(待解码属性的属性参考值),表示目标近邻点的亮度重建值(目标近邻点的第一属性重建值)。 In formula (11) and formula (12), Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded), Coeff luma represents the brightness reconstruction value of the current point (the first attribute reconstruction value of the current point), si represents the second coefficient of the target neighbor point (the i-th neighbor point of the current point), Represents the reflectivity reconstruction value of the target neighbor point (the attribute reference value of the attribute to be decoded), Represents the brightness reconstruction value of the target neighboring point (the first attribute reconstruction value of the target neighboring point).

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,当前点的第一属性重建值为当前点第二属性的重建值,目标近邻点的第一属性重建值为目标近邻点第二属性的重建值,待解码属性的属性参考值为目标近邻点第一属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstruction value of the second attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighboring point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,当前点的第一属性重建值为当前点的反射率重建值,目标近邻点的第一属性重建值为目标近邻点的反射率重建值,当前点的待解码属性的属性参考值为目标近邻点的亮度重建值,当前点的待解码属性的属性预测值为亮度预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is that reflection precedes brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point, the first attribute reconstruction value of the target neighboring point is the reflectivity reconstruction value of the target neighboring point, the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the target neighboring point, and the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value.

示例性的,当前点的亮度预测值可以根据公式(13)和公式(14)确定:

For example, the brightness prediction value of the current point can be determined according to formula (13) and formula (14):

在公式(13)和公式(14)中,Coeffref表示当前点的反射率重建值(当前点的第一属性重建值),Coeffluma表示当前点的亮度预测值(待解码属性的属性参考值),si表示目标近邻点(当前点的第i个近邻点)的第二系数,表示目标近邻点的反射率重建值(目标近邻点的第一属性重建值),表示目标近邻点的亮度重建值(待解码属性的属性参考值)。In formula (13) and formula (14), Coeff ref represents the reflectivity reconstruction value of the current point (the first attribute reconstruction value of the current point), Coeff luma represents the brightness prediction value of the current point (the attribute reference value of the attribute to be decoded), and si represents the second coefficient of the target neighbor point (the i-th neighbor point of the current point). Represents the reflectivity reconstruction value of the target neighboring point (the first attribute reconstruction value of the target neighboring point), Represents the brightness reconstruction value of the target neighbor point (the attribute reference value of the attribute to be decoded).

可以理解的是,第二系数考虑了当前点的第一属性重建值与目标近邻点的第一属性重建值之间的比值关系,这种关系可以帮助考虑当前点属性与目标近邻点属性之间的相关性,从而更准确地预测当前点的属性值。结合第二系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。第二系数的考虑使得预测过程更加针对性,可以更好地反映当前点与目标近邻点之间的属性关系,提高预测的准确性。准确的属性预测值可以减少不必要的数据传输,节省传输资源。通过考虑第二系数,可以更有效地利用属性之间的相关性,减少传输过程中的冗余信息,提高数据传输的效率。It can be understood that the second coefficient takes into account the ratio between the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point. This relationship can help consider the correlation between the attributes of the current point and the attributes of the target neighboring point, thereby more accurately predicting the attribute value of the current point. Combining the second coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained. The consideration of the second coefficient makes the prediction process more targeted, can better reflect the attribute relationship between the current point and the target neighboring point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the second coefficient, the correlation between attributes can be more effectively utilized, redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.

3、针对情况2中相关系数表征目标近邻点的属性重建值和当前点的非目标近邻点的属性重建值之间的相关性。3. The correlation coefficient in case 2 represents the correlation between the attribute reconstruction values of the target neighboring points and the attribute reconstruction values of the non-target neighboring points of the current point.

在本申请的一些实施例中,相关系数包括第三系数;S104中根据目标近邻点的一个或多个属性重建值,确定目标近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a third coefficient; and the implementation of determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point in S104 may include:

根据非目标近邻点的第一属性重建值和目标近邻点的第一属性重建值,确定第三系数。The third coefficient is determined according to the first attribute reconstructed value of the non-target neighbor point and the first attribute reconstructed value of the target neighbor point.

在本申请实施例中,在情况3中,目标近邻点的第一属性重建值对应的属性与非目标近邻点的属性重建值对应的属性相同。In the embodiment of the present application, in case 3, the attribute corresponding to the first attribute reconstruction value of the target neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the non-target neighbor point.

在本申请实施例中,非目标近邻点为当前点的M个近邻点中除目标近邻点之外的任一个近邻点,比如,非目标近邻点可以为当前点的M个近邻点中除目标近邻点之外的距离当前点最近的近邻点,或者,非目标近邻点可以为当前点的M个近邻点中除目标近邻点之外的距离目标近邻点最近的近邻点,本申请对此不作任何限定。In an embodiment of the present application, the non-target neighbor point is any neighbor point among the M neighbor points of the current point except the target neighbor point. For example, the non-target neighbor point can be the neighbor point closest to the current point among the M neighbor points of the current point except the target neighbor point, or the non-target neighbor point can be the neighbor point closest to the target neighbor point among the M neighbor points of the current point except the target neighbor point. The present application does not impose any restrictions on this.

在本申请的一些实施例中,第三系数包括目标近邻点的第一属性重建值和非目标近邻点的第一属性重建值的比值。In some embodiments of the present application, the third coefficient includes a ratio of the first attribute reconstructed value of the target neighboring point to the first attribute reconstructed value of the non-target neighboring point.

在本申请实施例中,第一属性重建值对应的属性与当前点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第三系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the third coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,非目标近邻点的第一属性重建值为非目标近邻点第一属性的重建值,目标近邻点的第一属性重建值为目标近邻点第一属性的重建值,待解码属性的属性参考值为目标近邻点第二属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the non-target neighbor point is the reconstruction value of the first attribute of the non-target neighbor point, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighbor point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,非目标近邻点的第一属性重建值为当前点的亮度重建值,目标近邻点的第一属性重建值为目标近邻点的亮度重建值,当前点的待解码属性的属性参考值为目标近邻点的反射率重建值,当前点的待解码属性的属性预测值为反射率预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the non-target neighbor point is the brightness reconstruction value of the current point, the first attribute reconstruction value of the target neighbor point is the brightness reconstruction value of the target neighbor point, the attribute reference value of the attribute to be decoded at the current point is the reflectivity reconstruction value of the target neighbor point, and the attribute prediction value of the attribute to be decoded at the current point is the reflectivity prediction value.

示例性的,当前点的亮度预测值可以根据公式(15)和公式(16)确定:

For example, the brightness prediction value of the current point can be determined according to formula (15) and formula (16):

在公式(15)和公式(16)中,Coeffref表示当前点的反射率预测值(待解码属性的属性预测值),coeff_lumap表示非目标近邻点(当前点的第p近邻点)的亮度重建值(非目标近邻点的第一属性重建值),si表示目标近邻点(当前点的第i个近邻点)的第三系数,表示目标近邻点的反射率重建值(待解码属性的属性参考值),表示目标近邻点的亮度重建值(目标近邻点的第一属性 重建值)。In formula (15) and formula (16), Coeff ref represents the reflectivity prediction value of the current point (the attribute prediction value of the attribute to be decoded), coeff_lumap represents the brightness reconstruction value of the non-target neighbor point (the pth neighbor point of the current point) (the first attribute reconstruction value of the non-target neighbor point), si represents the third coefficient of the target neighbor point (the i-th neighbor point of the current point), Represents the reflectivity reconstruction value of the target neighbor point (the attribute reference value of the attribute to be decoded), Represents the brightness reconstruction value of the target neighbor point (the first attribute of the target neighbor point Rebuild value).

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,非目标近邻点的第一属性重建值为非目标近邻点第二属性的重建值,目标近邻点的第一属性重建值为目标近邻点第二属性的重建值,待解码属性的属性参考值为目标近邻点第一属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the non-target neighbor point is the reconstruction value of the second attribute of the non-target neighbor point, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighbor point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,当前点的第一属性重建值为当前点的反射率重建值,目标近邻点的第一属性重建值为目标近邻点的反射率重建值,当前点的待解码属性的属性参考值为目标近邻点的亮度重建值,当前点的待解码属性的属性预测值为亮度预测值。In an embodiment of the present application, when the attribute reconstruction order of the current point is that reflection precedes brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point, the first attribute reconstruction value of the target neighboring point is the reflectivity reconstruction value of the target neighboring point, the attribute reference value of the attribute to be decoded at the current point is the brightness reconstruction value of the target neighboring point, and the attribute prediction value of the attribute to be decoded at the current point is the brightness prediction value.

示例性的,当前点的亮度预测值可以根据公式(17)和公式(18)确定:

For example, the brightness prediction value of the current point can be determined according to formula (17) and formula (18):

在公式(17)和公式(18)中,表示非目标近邻点(当前点的第p近邻点)的反射率重建值(非目标邻近点的第一属性重建值),Coeffluma表示当前点的亮度预测值(待解码属性的属性参考值),si表示目标近邻点(当前点的第i个近邻点)的第三系数,表示目标近邻点的反射率重建值(目标近邻点的第一属性重建值),表示目标近邻点的亮度重建值(目标近邻点的第一属性重建值)。In formula (17) and formula (18), represents the reflectivity reconstruction value of the non-target neighboring point (the pth neighboring point of the current point) (the first attribute reconstruction value of the non-target neighboring point), Coeff luma represents the brightness prediction value of the current point (the attribute reference value of the attribute to be decoded), si represents the third coefficient of the target neighboring point (the i-th neighboring point of the current point), Represents the reflectivity reconstruction value of the target neighboring point (the first attribute reconstruction value of the target neighboring point), Represents the brightness reconstruction value of the target neighboring point (the first attribute reconstruction value of the target neighboring point).

可以理解的是,第三系数考虑了目标近邻点的第一属性重建值与非目标近邻点的第一属性重建值之间的比值关系,这种比值关系可以帮助评估目标近邻点和非目标近邻点之间的属性关联性,从而更好地理解数据的特征和规律。结合第三系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。第三系数的考虑使得预测过程更加综合和全面,可以更好地反映当前点与目标近邻点和非目标近邻点之间的属性关系,提高预测的准确性。准确的属性预测值可以减少不必要的数据传输,节省传输资源。通过考虑第三系数,可以更有效地利用目标近邻点和非目标近邻点之间的属性关联性,减少传输过程中的冗余信息,提高数据传输的效率。It is understandable that the third coefficient takes into account the ratio relationship between the first attribute reconstruction value of the target neighbor point and the first attribute reconstruction value of the non-target neighbor point. This ratio relationship can help evaluate the attribute correlation between the target neighbor point and the non-target neighbor point, so as to better understand the characteristics and laws of the data. Combining the third coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained. The consideration of the third coefficient makes the prediction process more comprehensive and comprehensive, which can better reflect the attribute relationship between the current point and the target neighbor point and the non-target neighbor point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the third coefficient, the attribute correlation between the target neighbor point and the non-target neighbor point can be more effectively utilized, the redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.

在本申请的一些实施例中,该解码方法还包括:In some embodiments of the present application, the decoding method further includes:

解析码流,确定第二语法元素信息;Parsing the code stream to determine the second syntax element information;

若第二语法元素信息的取值为第一值,则确定当前点的属性重建顺序为第一属性先于第二属性;或者,If the value of the second syntax element information is the first value, then determining the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or

若第二语法元素信息的取值为第二值,则确定当前点的属性重建顺序为第二属性先于第一属性。If the value of the second syntax element information is the second value, it is determined that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute.

在本申请实施例中,第二语法元素信息用于指示当前点的属性重建顺序。In the embodiment of the present application, the second syntax element information is used to indicate the attribute reconstruction order of the current point.

示例性的,第二语法元素信息可以是在属性参数APS的标志位,第二语法元素信息可以表示为muti_crosstype_pre,用于指示当前点的属性编码顺序。Exemplarily, the second syntax element information may be a flag bit in the attribute parameter APS, and the second syntax element information may be expressed as muti_crosstype_pre, which is used to indicate the attribute coding order of the current point.

需要说明的是,在本申请实施例中,第一值与第二值不同,而且第一值和第二值可以是参数形式,也可以是数字形式。具体地,第二语法标识信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。It should be noted that in the embodiment of the present application, the first value and the second value are different, and the first value and the second value can be in parameter form or in digital form. Specifically, the second syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.

示例性地,对于第一值和第二值而言,第一值可以设置为1,第二值可以设置为0;或者,第一值可以设置为0,第二值可以设置为1;或者,第一值可以设置为true,第二值可以设置为false;或者,第一值可以设置为false,第二值可以设置为true;但是这里并不作具体限定。Exemplarily, for the first value and the second value, the first value can be set to 1 and the second value can be set to 0; or, the first value can be set to 0 and the second value can be set to 1; or, the first value can be set to true and the second value can be set to false; or, the first value can be set to false and the second value can be set to true; but this is not specifically limited here.

在本申请实施例中,以写入码流中的flag为例,假设第一值设置为1(true),第二值设置为0(false),这时候如果第二语法标识信息的取值为1(true),那么可以确定当前点的属性重建顺序为第一属性(亮度)先于第二属性(反射率),则需要利用目标近邻节点的相关系数和当前点的亮度重建值来预测当前点的反射率预测值;如果第二语法标识信息的取值为0(false),那么可以确定当前点的属性重建顺序为第二属性(反射率)先于第一属性(亮度),则需要利用目标近邻节点的相关系数和当前点的反射率重建值来预测当前点的亮度预测值。In an embodiment of the present application, taking the flag written into the code stream as an example, assuming that the first value is set to 1 (true) and the second value is set to 0 (false), at this time if the value of the second syntax identification information is 1 (true), then it can be determined that the attribute reconstruction order of the current point is that the first attribute (brightness) precedes the second attribute (reflectivity), and it is necessary to use the correlation coefficient of the target neighbor node and the brightness reconstruction value of the current point to predict the reflectivity prediction value of the current point; if the value of the second syntax identification information is 0 (false), then it can be determined that the attribute reconstruction order of the current point is that the second attribute (reflectivity) precedes the first attribute (brightness), and it is necessary to use the correlation coefficient of the target neighbor node and the reflectivity reconstruction value of the current point to predict the brightness prediction value of the current point.

在本申请的一些实施例中,候选预测模式还包括第一预测模式,该解码方法还包括S107:In some embodiments of the present application, the candidate prediction mode further includes the first prediction mode, and the decoding method further includes S107:

S107、根据第一语法元素信息的取值,从候选预测模式中确定当前点的最佳预测模式为第一预测模式。S107 : Determine, according to the value of the first syntax element information, the best prediction mode at the current point from the candidate prediction modes as the first prediction mode.

在本申请实施例中,第一预测模式为非跨属性预测模式。In the embodiment of the present application, the first prediction mode is a non-cross-attribute prediction mode.

在本申请实施例中,第一预测模式与当前点的M个近邻点的重建属性值相关。示例性的,第一预测模式可以表示当前节点的M个近邻点的已重建属性的属性重建值加权平均。其中,M个近邻点的已重建属性与当前点的待解码属性相同。In this embodiment of the present application, the first prediction mode is associated with the reconstructed attribute values of the M neighboring points of the current point. For example, the first prediction mode may represent a weighted average of the reconstructed attribute values of the M neighboring points of the current node. The reconstructed attributes of the M neighboring points are identical to the attribute to be decoded of the current point.

在本申请实施例中,候选预测模式可分为两种情况: In the embodiment of the present application, candidate prediction modes can be divided into two cases:

情况1、候选预测模式包括:一个或多个跨属性预测模式。Case 1: The candidate prediction modes include: one or more cross-attribute prediction modes.

在本申请实施例中,候选预测模式如表2所示,一个或多个跨属性预测模式可以包括:预测模式1、预测模式2和预测模式3。其中,在目标跨属性预测模式为预测模式1的情况下,表示利用当前点的第1个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。在目标跨属性预测模式为预测模式2的情况下,表示利用当前点的第2个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。在目标跨属性预测模式为预测模式3的情况下,表示利用当前点的第3个近邻点进行跨属性指导预测,以推导当前点的待解码属性的属性预测值。In an embodiment of the present application, the candidate prediction modes are shown in Table 2, and one or more cross-attribute prediction modes may include: prediction mode 1, prediction mode 2, and prediction mode 3. Among them, when the target cross-attribute prediction mode is prediction mode 1, it means that the first neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point. When the target cross-attribute prediction mode is prediction mode 2, it means that the second neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point. When the target cross-attribute prediction mode is prediction mode 3, it means that the third neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be decoded of the current point.

情况2、候选预测模式包括:一个或多个跨属性预测模式以及一个或多个非跨属性预测模式。Case 2: the candidate prediction modes include: one or more cross-attribute prediction modes and one or more non-cross-attribute prediction modes.

在本申请实施例中,表3为本申请实施例提供的一种候选预测模式的示意表二,如表3所示,候选预测模式包括;3个跨属性预测模式和1个非跨属性预测模式(预测模式0)。在目标跨属性预测模式为预测模式0的情况下,表示利用当前点的3个近邻点的属性重建值,以推导当前点的待解码属性的属性预测值。示例性的,利用当前点的3个近邻点的亮度重建值的加权平均后的值作为当前点的亮度预测值,或者,利用当前点的3个近邻点的反射率重建值的加权平均后的值作为当前点的反射率预测值。In an embodiment of the present application, Table 3 is a schematic table 2 of a candidate prediction mode provided in an embodiment of the present application. As shown in Table 3, the candidate prediction modes include: 3 cross-attribute prediction modes and 1 non-cross-attribute prediction mode (prediction mode 0). When the target cross-attribute prediction mode is prediction mode 0, it means that the attribute reconstruction values of the 3 neighboring points of the current point are used to derive the attribute prediction value of the attribute to be decoded of the current point. Exemplarily, the weighted average value of the brightness reconstruction values of the 3 neighboring points of the current point is used as the brightness prediction value of the current point, or the weighted average value of the reflectivity reconstruction values of the 3 neighboring points of the current point is used as the reflectivity prediction value of the current point.

表3
Table 3

在本申请的一些实施例中,如图10所示,该解码方法还包括S201至S203:In some embodiments of the present application, as shown in FIG10 , the decoding method further includes S201 to S203:

S201、根据当前点的M个近邻点各自的已重建属性的属性重建值,确定当前点是否满足预设条件;S201, determining whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point;

S202、在当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行解码码流,确定当前点的第一语法元素信息的步骤。S202: When the reconstructed attribute values of the respective reconstructed attributes of the M neighboring points of the current point meet a preset condition, perform decoding of the code stream to determine the first syntax element information of the current point.

S203、在当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定当前点采用第二预测模式。S203 : When the reconstructed attribute values of the respective reconstructed attributes of the M neighboring points of the current point do not meet a preset condition, determine that the current point adopts the second prediction mode.

在本申请实施例中,预设条件为编码器和解码器双方规定好的,编码器和解码器两端都需要执行S201的判断步骤。In the embodiment of the present application, the preset condition is specified by both the encoder and the decoder, and both the encoder and the decoder need to execute the judgment step S201.

在本申请实施例中,已重建属性与待解码属性相同。In the embodiment of the present application, the reconstructed attribute is the same as the attribute to be decoded.

在本申请的一些实施例中,M为大于或等于2的正整数;预设条件包括:M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值。In some embodiments of the present application, M is a positive integer greater than or equal to 2; the preset condition includes: the maximum attribute difference between the reconstructed attributes of the M neighboring points is greater than or equal to a preset threshold.

在本申请实施例中,预设阈值为解码器和编码器双方规定好的值,或者,预设阈值由编码器端进行设定,编码器将预设阈值写入码流,解码器解码码流之后,获得预设阈值。本申请对预设阈值的设定方式不做任何限定。In the embodiments of the present application, the preset threshold is a value specified by both the decoder and the encoder, or the preset threshold is set by the encoder, the encoder writes the preset threshold into the bitstream, and the decoder obtains the preset threshold after decoding the bitstream. This application does not impose any restrictions on the method for setting the preset threshold.

在本申请实施例中,预设阈值为自适应阈值,比如,可以根据当前点云的相关信息(大小、属性复杂度、点数量等)自适应调整,预设阈值可以表示为adaptive_threshold。In an embodiment of the present application, the preset threshold is an adaptive threshold, for example, it can be adaptively adjusted according to relevant information of the current point cloud (size, attribute complexity, number of points, etc.), and the preset threshold can be expressed as adaptive_threshold.

示例性的,已重建属性和待解码属性为亮度为例,假设当前点的近邻点包括:近邻点1、近邻点2和近邻点3。当前点的3个近邻点各自的已重建属性的属性重建值包括:近邻点1的亮度重建luma1、近邻点2的亮度重建luma2、近邻点3的亮度重建luma3。当前点的3个近邻点相互之间的属性重建差值包括:|luma1-luma2|、|luma1-luma3|、|luma2-luma3|。若|luma1-luma3|>|luma1-luma2|>|luma2-luma3|,则将|luma1-luma3|作为最大属性差值。若最大属性差值大于预设阈值,则解码器执行S101中解码码流,确定当前点的第一语法元素信息的步骤。若最大属性差值小于预设阈值,则确定当前点采用第二预测模式。Exemplarily, taking the reconstructed attribute and the attribute to be decoded as brightness as an example, it is assumed that the neighboring points of the current point include: neighboring point 1, neighboring point 2, and neighboring point 3. The attribute reconstruction values of the reconstructed attributes of the three neighboring points of the current point include: brightness reconstruction luma1 of neighboring point 1, brightness reconstruction luma2 of neighboring point 2, and brightness reconstruction luma3 of neighboring point 3. The attribute reconstruction differences between the three neighboring points of the current point include: |luma1-luma2|, |luma1-luma3|, |luma2-luma3|. If |luma1-luma3|>|luma1-luma2|>|luma2-luma3|, then |luma1-luma3| is used as the maximum attribute difference. If the maximum attribute difference is greater than the preset threshold, the decoder executes the step of decoding the code stream in S101 to determine the first syntax element information of the current point. If the maximum attribute difference is less than the preset threshold, it is determined that the current point adopts the second prediction mode.

在本申请实施例中,第二预测模式与第一预测模式相同或不同。在第二预测模式与第一预测模式相同的情况下,第二预测模式为利用当前点的M个近邻点的已重建属性的属性重建值预测当前点的待解码属性的属性预测值。示例性的,第二预测模式为利用当前点的M个近邻点的已重建属性的属性重建值的加权平均重建值预测当前点的待解码属性的属性预测值。In an embodiment of the present application, the second prediction mode is the same as or different from the first prediction mode. When the second prediction mode is the same as the first prediction mode, the second prediction mode predicts the attribute prediction value of the attribute to be decoded at the current point using the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point. Exemplarily, the second prediction mode predicts the attribute prediction value of the attribute to be decoded at the current point using the weighted average reconstruction value of the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point.

需要说明的是,S202和S203为并列实现步骤,S202和S203择一执行,即解码器可以执行S202,也可以执行S203,本申请对此不作限定。It should be noted that S202 and S203 are parallel implementation steps, and either S202 or S203 can be executed, that is, the decoder can execute S202 or S203, and this application does not limit this.

可以理解的是,一方面,通过判断当前点的M个近邻点的属性重建值是否满足预设条件,可以进行数据决策优化。如果满足条件,则执行解码码流过程,可以更精确地确定当前点的第一语法元素信息,提高解码的准确性和效率;如果不满足条件,则选择第二预测模式,使得数据处理更加智能和适应性更 强。另一方面,根据预设条件进行判断,可以避免对不符合条件的数据进行解码,节约了解码过程中的计算资源和时间,有助于提高资源利用效率,使得解码过程更加高效。根据预设条件进行数据处理和决策,可以保障数据的质量和完整性。只对满足条件的数据进行解码或选择第二预测模式,有助于避免不必要的数据处理错误或误判,提高数据处理的准确性和可靠性。再一方面,预设条件的应用可以使得系统运行更加智能化和高效化。根据具体条件的判断,灵活地选择解码或预测模式,有助于提升系统运行效率,满足不同数据处理需求。It can be understood that, on the one hand, by judging whether the attribute reconstruction values of the M neighboring points of the current point meet the preset conditions, data decision optimization can be performed. If the conditions are met, the decoding code stream process is executed, which can more accurately determine the first syntax element information of the current point and improve the accuracy and efficiency of decoding; if the conditions are not met, the second prediction mode is selected, making the data processing more intelligent and more adaptable. Strong. On the other hand, judging based on preset conditions can avoid decoding data that does not meet the conditions, saving computing resources and time during the decoding process, helping to improve resource utilization efficiency and making the decoding process more efficient. Data processing and decision-making based on preset conditions can ensure data quality and integrity. Decoding only data that meets the conditions or selecting the second prediction mode helps avoid unnecessary data processing errors or misjudgments, and improves the accuracy and reliability of data processing. Furthermore, the application of preset conditions can make system operation more intelligent and efficient. Flexible selection of decoding or prediction modes based on specific conditions helps improve system efficiency and meet different data processing requirements.

可以理解的是,根据当前点的M个近邻点各自的已重建属性的属性重建值,进行预设条件的判断并执行解码码流或选择第二预测模式,可以在数据决策优化、资源利用效率提升、数据传输成本降低、数据质量保障和系统运行效率提高等方面产生有益效果,这对于数据编解码和传输过程中的效率和准确性都具有重要意义。It can be understood that, based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point, the preset conditions are judged and the decoding code stream is executed or the second prediction mode is selected. This can produce beneficial effects in terms of data decision optimization, resource utilization efficiency improvement, data transmission cost reduction, data quality assurance and system operation efficiency improvement, which is of great significance to the efficiency and accuracy in the data encoding and decoding and transmission process.

在本申请的一些实施例中,该解码方法还包括:In some embodiments of the present application, the decoding method further includes:

在确定当前点采用第二预测模式的情况下,根据M个近邻点各自的空间位置以及当前点的空间位置,确定M个近邻点各自的空间几何权重;When it is determined that the current point adopts the second prediction mode, determining the spatial geometric weights of the M neighboring points according to their respective spatial positions and the spatial position of the current point;

根据M个近邻点各自的已重建属性的属性重建值和M个近邻点各自的空间几何权重,确定待解码属性的属性预测值。The attribute prediction value of the attribute to be decoded is determined according to the attribute reconstruction value of each of the reconstructed attributes of the M neighboring points and the spatial geometric weights of each of the M neighboring points.

在本申请实施例中,采用第二预测模式确定待解码属性的属性预测值的过程可以通过公式(19)和公式(20)表示:

In the embodiment of the present application, the process of determining the attribute prediction value of the attribute to be decoded using the second prediction mode can be expressed by formula (19) and formula (20):

在公式(19)和公式(20)中,表示当前点i的待解码属性的属性预测值,j表示M个近邻点的索引,表示M个近邻点中近邻点i的已重建属性的属性重建值,表示M个近邻点中近邻点j到当前点i的空间几何权重,xi、yij和zij表示近邻点j的几何位置坐标,xi、yi和zi表示当前点i的几何位置坐标(空间位置)。In formula (19) and formula (20), represents the attribute prediction value of the attribute to be decoded at the current point i, j represents the index of M neighboring points, represents the attribute reconstruction value of the reconstructed attribute of the neighbor point i among the M neighbor points, represents the spatial geometric weight of the neighbor point j to the current point i among the M neighbor points, x i , y ij and z ij represent the geometric position coordinates of the neighbor point j, and x i , y i and z i represent the geometric position coordinates (spatial position) of the current point i.

可以理解的是,通过考虑M个近邻点的空间位置和当前点的空间位置,确定空间几何权重,可以更充分地利用空间信息,有助于反映数据之间的空间关联性,提高数据预测的准确性和可靠性。结合空间几何权重和属性重建值,可以更好地评估M个近邻点的属性与当前点属性之间的关联性,这种优化可以使得预测过程更加综合和全面,提高预测的准确性和稳定性。It can be understood that by considering the spatial positions of the M nearest neighbors and the current point to determine the spatial geometric weight, we can more fully utilize spatial information, help reflect the spatial correlation between data, and improve the accuracy and reliability of data prediction. Combining spatial geometric weights with attribute reconstruction values can better assess the correlation between the attributes of the M nearest neighbors and the current point. This optimization can make the prediction process more comprehensive and holistic, improving the accuracy and stability of predictions.

在本申请的一些实施例中,该解码方法还包括:In some embodiments of the present application, the decoding method further includes:

解码码流,确定第三语法元素信息;Decoding the code stream to determine third syntax element information;

在第三语法元素信息指示当前点允许采用跨属性预测模式的情况下,确定候选预测模式包括一个或多个跨属性预测模式;或者,In a case where the third syntax element information indicates that the current point allows the use of the cross-attribute prediction mode, determining that the candidate prediction modes include one or more cross-attribute prediction modes; or

在第三语法元素信息指示当前点不允许采用跨属性预测模式的情况下,确定候选预测模式包括一个或多个非跨属性预测模式;In a case where the third syntax element information indicates that the current point does not allow the cross-attribute prediction mode to be adopted, determining that the candidate prediction modes include one or more non-cross-attribute prediction modes;

根据第一语法元素信息的取值,从一个或多个非跨属性预测模式中确定当前点的目标预测模式。According to the value of the first syntax element information, a target prediction mode of the current point is determined from one or more non-cross-attribute prediction modes.

在本申请实施例中,第三语法元素信息用于指示当前点是否允许采用跨属性预测模式。In the embodiment of the present application, the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

在本申请实施例中,候选预测模式与第三语法元素指示的当前点是否允许采用跨属性预测模式相关,具体包括以下两种情况:In the embodiment of the present application, the candidate prediction mode is related to whether the current point indicated by the third syntax element allows the use of the cross-attribute prediction mode, specifically including the following two cases:

情况1、第三语法元素信息指示当前点允许采用跨属性预测模式。Case 1: The third syntax element information indicates that the cross-attribute prediction mode is allowed at the current point.

在本申请实施例中,若当前点允许采用跨属性预测模式,则候选预测模式至少包括:一个或多个跨属性预测模式。以表3所示的候选预测模式为例,当前点的候选预测模式包括:预测模式0(第一预测模式)、预测模式1、预测模式2和预测模式3。其中,预测模式0为非跨属性预测模式,预测模式1、预测模式2和预测模式3为跨属性预测模式。第一语法元素信息用于指示当前点采用的目标预测模式,其中,目标预测模式可以为目标跨属性预测模式(预测模式1~3中的任一个)或非跨属性预测模式(预测模式0)。In an embodiment of the present application, if the current point allows the use of a cross-attribute prediction mode, the candidate prediction modes include at least: one or more cross-attribute prediction modes. Taking the candidate prediction modes shown in Table 3 as an example, the candidate prediction modes of the current point include: prediction mode 0 (first prediction mode), prediction mode 1, prediction mode 2, and prediction mode 3. Among them, prediction mode 0 is a non-cross-attribute prediction mode, and prediction mode 1, prediction mode 2, and prediction mode 3 are cross-attribute prediction modes. The first syntax element information is used to indicate the target prediction mode adopted by the current point, wherein the target prediction mode can be a target cross-attribute prediction mode (any one of prediction modes 1 to 3) or a non-cross-attribute prediction mode (prediction mode 0).

示例性的,以当前点的待解码属性为亮度为例,若第一语法元素信息的取值为0,则确定当前点的目标预测模式为0,此时,解码器利用当前点的3个近邻点的亮度重建值的加权平均亮度重建值作为当前点的亮度预测值。若第一语法元素信息的取值为1,则确定当前点的目标预测模式为预测模式1,此时,解码器利用当前点的反射率重建值和当前点的第1个近邻点的相关系数,确定当前点的亮度预测值。若第一语法元素信息的取值为2,则确定当前点的目标预测模式为预测模式2,此时,解码器利用当前点的反射率重建值和当前点的第2个近邻点的相关系数,确定当前点的亮度预测值。若第一语法元素信息的取值为3,则确定当前点的目标预测模式为预测模式3,此时,解码器利用当前点的反射率重建值 和当前点的第3个近邻点的相关系数,确定当前点的亮度预测值。Exemplarily, taking the attribute to be decoded of the current point as brightness as an example, if the value of the first syntax element information is 0, the target prediction mode of the current point is determined to be 0. At this time, the decoder uses the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point as the brightness prediction value of the current point. If the value of the first syntax element information is 1, the target prediction mode of the current point is determined to be prediction mode 1. At this time, the decoder uses the reflectivity reconstruction value of the current point and the correlation coefficient of the first neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 2, the target prediction mode of the current point is determined to be prediction mode 2. At this time, the decoder uses the reflectivity reconstruction value of the current point and the correlation coefficient of the second neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 3, the target prediction mode of the current point is determined to be prediction mode 3. At this time, the decoder uses the reflectivity reconstruction value of the current point The correlation coefficient with the third neighboring point of the current point is used to determine the brightness prediction value of the current point.

情况2、第三语法元素信息指示当前点不允许采用跨属性预测模式。Case 2: The third syntax element information indicates that the cross-attribute prediction mode is not allowed at the current point.

在本申请实施例中,若当前点允许采用跨属性预测模式,则候选预测模式至少包括:一个或多个非跨属性预测模式。以1所示的候选预测模式为例,当前点的候选预测模式包括:预测模式0、预测模式1、预测模式2和预测模式3。其中,预测模式0~3均为非跨属性预测模式。In this embodiment of the present application, if the current point allows the use of a cross-attribute prediction mode, the candidate prediction modes include at least one or more non-cross-attribute prediction modes. Taking the candidate prediction modes shown in 1 as an example, the candidate prediction modes for the current point include: prediction mode 0, prediction mode 1, prediction mode 2, and prediction mode 3. Among them, prediction modes 0 to 3 are all non-cross-attribute prediction modes.

示例性的,以当前点的待解码属性为亮度为例,若第一语法元素信息的取值为0,则确定当前点的目标预测模式为0,此时,解码器利用当前点的3个近邻点的亮度重建值的加权平均亮度重建值作为当前点的亮度预测值。若第一语法元素信息的取值为1,则确定当前点的目标预测模式为预测模式1,此时,解码器利用当前点的第1个近邻点的亮度重建值,确定当前点的亮度预测值。若第一语法元素信息的取值为2,则确定当前点的目标预测模式为预测模式2,此时,解码器利用当前点的第2个近邻点的亮度重建值,确定当前点的亮度预测值。若第一语法元素信息的取值为3,则确定当前点的目标预测模式为预测模式3,此时,解码器利用当前点的第3个近邻点的亮度重建值,确定当前点的亮度预测值。Exemplarily, taking the attribute to be decoded of the current point as brightness as an example, if the value of the first syntax element information is 0, the target prediction mode of the current point is determined to be 0. At this time, the decoder uses the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point as the brightness prediction value of the current point. If the value of the first syntax element information is 1, the target prediction mode of the current point is determined to be prediction mode 1. At this time, the decoder uses the brightness reconstruction value of the first neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 2, the target prediction mode of the current point is determined to be prediction mode 2. At this time, the decoder uses the brightness reconstruction value of the second neighboring point of the current point to determine the brightness prediction value of the current point. If the value of the first syntax element information is 3, the target prediction mode of the current point is determined to be prediction mode 3. At this time, the decoder uses the brightness reconstruction value of the third neighboring point of the current point to determine the brightness prediction value of the current point.

可以理解的是,一方面,根据第一语法元素信息的取值,在允许采用跨属性预测模式的情况下,确定候选预测模式包括一个或多个跨属性预测模式;或者,在不允许采用跨属性预测模式的情况下,确定候选预测模式包括一个或多个非跨属性预测模式,这样可以更准确地匹配当前点的属性预测需求,提高预测的准确性和可靠性。另一方面,根据第三语法元素信息确定当前点允许采用跨属性预测模式或非跨属性预测模式,有助于提高数据预测的效率。采用合适的预测模式可以更快速地进行数据预测,降低计算成本和时间成本。合理选择预测模式可以减少不必要的数据传输量,节约传输资源。通过匹配目标预测模式,可以减少预测过程中的冗余信息,优化数据传输效率。合适的预测模式选择可以避免预测过程中的错误或误判,保障数据处理的准确性和可靠性。It can be understood that, on the one hand, according to the value of the first syntax element information, when the cross-attribute prediction mode is allowed, it is determined that the candidate prediction mode includes one or more cross-attribute prediction modes; or, when the cross-attribute prediction mode is not allowed, it is determined that the candidate prediction mode includes one or more non-cross-attribute prediction modes, so that the attribute prediction requirements of the current point can be matched more accurately, and the accuracy and reliability of the prediction can be improved. On the other hand, determining whether the cross-attribute prediction mode or the non-cross-attribute prediction mode is allowed at the current point according to the third syntax element information helps to improve the efficiency of data prediction. Using a suitable prediction mode can make data prediction faster and reduce computing and time costs. Reasonable selection of a prediction mode can reduce unnecessary data transmission and save transmission resources. By matching the target prediction mode, redundant information in the prediction process can be reduced and data transmission efficiency can be optimized. Appropriate prediction mode selection can avoid errors or misjudgments in the prediction process and ensure the accuracy and reliability of data processing.

在本申请的一些实施例中,该解码方法还包括:In some embodiments of the present application, the decoding method further includes:

若第三语法元素信息的取值为第三值,则确定当前点允许采用跨属性预测模式;或者,If the value of the third syntax element information is the third value, it is determined that the cross-attribute prediction mode is allowed at the current point; or

若第三语法元素信息的取值为第四值,则确定当前点不允许采用跨属性预测模式。If the value of the third syntax element information is the fourth value, it is determined that the cross-attribute prediction mode is not allowed at the current point.

在本申请实施例中,第三语法元素信息用于指示当前点是否允许采用跨属性预测模式。In the embodiment of the present application, the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

示例性的,第三语法元素信息可以是在属性参数APS的标志位,第三法元素信息可以表示为crosstype_enable_flag,用于指示当前点是否允许采用跨属性预测模式。Exemplarily, the third syntax element information may be a flag in the attribute parameter APS, and the third syntax element information may be expressed as crosstype_enable_flag, which is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

需要说明的是,在本申请实施例中,第三值与第四值不同,而且第三值和第四值可以是参数形式,也可以是数字形式。具体地,第三语法标识信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。It should be noted that in the embodiment of the present application, the third value is different from the fourth value, and the third value and the fourth value can be in parameter form or in numerical form. Specifically, the third syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.

示例性地,对于第三值和第四值而言,第三值可以设置为1,第四值可以设置为0;或者,第三值可以设置为0,第四值可以设置为1;或者,第三值可以设置为true,第四值可以设置为false;或者,第三值可以设置为false,第四值可以设置为true;但是这里并不作具体限定。Exemplarily, for the third value and the fourth value, the third value can be set to 1 and the fourth value can be set to 0; or, the third value can be set to 0 and the fourth value can be set to 1; or, the third value can be set to true and the fourth value can be set to false; or, the third value can be set to false and the fourth value can be set to true; but this is not specifically limited here.

在本申请实施例中,以写入码流中的flag为例,假设第三值设置为1(true),第四值设置为0(false),这时候如果第三语法标识信息的取值为0(false),那么可以确定当前点不允许采用跨属性预测模式;如果第三语法标识信息的取值为1(true),那么可以确定当前点允许采用跨属性预测模式。In an embodiment of the present application, taking the flag written into the bitstream as an example, assuming that the third value is set to 1 (true) and the fourth value is set to 0 (false), if the value of the third syntax identification information is 0 (false), then it can be determined that the cross-attribute prediction mode is not allowed at the current point; if the value of the third syntax identification information is 1 (true), then it can be determined that the cross-attribute prediction mode is allowed at the current point.

第二方面,本申请实施例提供了一种编码方法,一方面,通过候选跨属性预测模式和候选近邻点的相关系数确定当前点的待编码属性的属性预测值,可以更准确地预测当前点的属性值,避免了传输冗余的信息,这样可以在编码时减少需要传输的数据量,从而降低了码率的浪费。一方面,在对当前点的待编码属性的属性重建值进行预测的过程中,是基于当前点的候选近邻点的相关系数和当前点的待编码属性的属性参考值确定的,可以提高码率的利用率,避免码率的浪费,可以减少数据传输时的冗余和成本,从而可以提升编码的效率和性能。On the second aspect, an embodiment of the present application provides a coding method. On the one hand, by determining the attribute prediction value of the attribute to be coded of the current point through the correlation coefficient of the candidate cross-attribute prediction mode and the candidate neighboring points, the attribute value of the current point can be predicted more accurately, avoiding the transmission of redundant information. This can reduce the amount of data to be transmitted during coding, thereby reducing the waste of code rate. On the one hand, in the process of predicting the attribute reconstruction value of the attribute to be coded of the current point, it is determined based on the correlation coefficient of the candidate neighboring points of the current point and the attribute reference value of the attribute to be coded of the current point, which can improve the utilization of the code rate, avoid the waste of code rate, reduce the redundancy and cost during data transmission, and thus improve the efficiency and performance of coding.

下面将结合附图对本申请各实施例进行详细说明。The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

在本申请的一实施例中,图11为本申请实施例提供的一种编码方法的流程示意图。如图11所示,该方法可以包括S301至S307:In one embodiment of the present application, FIG11 is a flow chart of an encoding method provided by the embodiment of the present application. As shown in FIG11 , the method may include S301 to S307:

S301、从候选预测模式中确定当前点的候选跨属性预测模式。S301: Determine a candidate cross-attribute prediction mode for the current point from candidate prediction modes.

需要说明的是,本申请实施例的编码方法应用于编码器。另外,该编码方法具体可以是指一种面向激光雷达点云跨属性预测方法。其中,在属性预测模式中,这里主要是针对一种单邻居跨属性预测的PT编码方法的改进,以避免相关技术中当一个属性信息已经编码完成,对另一种属性信息进行编码时,两种属性信息之间还存在着大量的冗余的问题。It should be noted that the encoding method of the embodiment of the present application is applied to an encoder. In addition, the encoding method can specifically refer to a method for cross-attribute prediction of lidar point clouds. Among them, in the attribute prediction mode, this is mainly an improvement of a PT encoding method for single-neighbor cross-attribute prediction, so as to avoid the problem of a large amount of redundancy between the two attribute information when one attribute information has been encoded and another attribute information is encoded in the related art.

在本申请实施例中,当前点也称为当前节点、当前待编码点、待编码点、当前待检测点、待编码节点等,本申请实施例对此不作任何限定。In the embodiment of the present application, the current point is also called the current node, the current point to be encoded, the point to be encoded, the current point to be detected, the node to be encoded, etc., and the embodiment of the present application does not impose any limitations on this.

在本申请实施例中,候选跨属性预测模式为候选预测模式中的一个或多个候选跨属性预测模式中的 任一个。这里,候选跨属性预测模式也称为跨属性预测模式。In the embodiment of the present application, the candidate cross-attribute prediction mode is one or more candidate cross-attribute prediction modes in the candidate prediction mode. Here, the candidate cross-attribute prediction mode is also referred to as a cross-attribute prediction mode.

示例性的,候选预测模式包括3个候选跨属性预测模式:预测模式1、预测模式2和预测模式3,则候选跨属性预测模式指的是预测模式1、预测模式2和预测模式3中的任意一个。Exemplarily, the candidate prediction mode includes three candidate cross-attribute prediction modes: prediction mode 1, prediction mode 2, and prediction mode 3. The candidate cross-attribute prediction mode refers to any one of prediction mode 1, prediction mode 2, and prediction mode 3.

S302、根据候选跨属性预测模式,确定当前点的候选近邻点的一个或多个属性重建值。S302: Determine one or more attribute reconstruction values of candidate neighboring points of the current point according to the candidate cross-attribute prediction mode.

在本申请实施例中,对于候选预测模式的每一个候选跨属性预测模式来说,需要确定当前点的候选近邻点的一个或多个属性重建值。候选近邻点与候选跨属性预测模式相对应。In the embodiment of the present application, for each candidate cross-attribute prediction mode of the candidate prediction modes, it is necessary to determine one or more attribute reconstruction values of candidate neighboring points of the current point. The candidate neighboring points correspond to the candidate cross-attribute prediction modes.

示例性的,根据预测模式1,确定当前点的第1个候选近邻点的一个或多个属性重建值;根据预测模式2,确定当前点的第2个候选近邻点的一个或多个属性重建值;根据预测模式3,确定当前点的第3个候选近邻点的一个或多个属性重建值。Exemplarily, according to prediction mode 1, one or more attribute reconstruction values of the first candidate neighbor point of the current point are determined; according to prediction mode 2, one or more attribute reconstruction values of the second candidate neighbor point of the current point are determined; according to prediction mode 3, one or more attribute reconstruction values of the third candidate neighbor point of the current point are determined.

需要说明的是,关于S302的描述可以参照前文中S103的描述,在此不再赘述。It should be noted that the description of S302 can refer to the description of S103 in the previous text, and will not be repeated here.

S303、根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数。S303: Determine the correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points.

在本申请实施例中,候选近邻点的相关系数有以下3种情况:In the embodiment of the present application, the correlation coefficients of candidate neighbor points have the following three cases:

情况1、候选近邻点的相关系数表征候选近邻点的多个属性重建值之间的相关性。Case 1: The correlation coefficient of the candidate neighbor points represents the correlation between multiple attribute reconstruction values of the candidate neighbor points.

示例性的,候选近邻点的多个属性重建值可以包括:亮度重建值和反射率重建值。这时,候选近邻点的相关系数可以表征候选近邻点的亮度重建值和反射率重建值之间的相关性。For example, the multiple attribute reconstruction values of the candidate neighboring points may include: a brightness reconstruction value and a reflectivity reconstruction value. In this case, the correlation coefficient of the candidate neighboring points may represent the correlation between the brightness reconstruction value and the reflectivity reconstruction value of the candidate neighboring points.

情况2、候选近邻点的相关系数表征候选近邻点的属性重建值和当前点的属性重建值之间的相关性。Case 2: The correlation coefficient of the candidate neighboring points represents the correlation between the attribute reconstruction value of the candidate neighboring points and the attribute reconstruction value of the current point.

示例性的,在候选近邻点的属性重建值为亮度重建值的情况下,候选近邻点的相关系数可以表征候选近邻点的亮度重建值和当前点的亮度重建值之间的相关性。或者,在候选近邻点的属性重建值为反射率重建值的情况下,候选近邻点的相关系数可以表征候选近邻点的反射率重建值和当前点的反射率重建值之间的相关性。For example, when the attribute reconstruction value of the candidate neighbor point is a brightness reconstruction value, the correlation coefficient of the candidate neighbor point can represent the correlation between the brightness reconstruction value of the candidate neighbor point and the brightness reconstruction value of the current point. Alternatively, when the attribute reconstruction value of the candidate neighbor point is a reflectivity reconstruction value, the correlation coefficient of the candidate neighbor point can represent the correlation between the reflectivity reconstruction value of the candidate neighbor point and the reflectivity reconstruction value of the current point.

情况3、候选近邻点的相关系数表征候选近邻点的属性重建值和当前点的非候选近邻点的属性重建值之间的相关性。Case 3: The correlation coefficient of the candidate neighbor points represents the correlation between the attribute reconstruction values of the candidate neighbor points and the attribute reconstruction values of the non-candidate neighbor points of the current point.

示例性的,非候选近邻点为当前点的M个近邻点中的除候选近邻点之外的任一个近邻点。非候选近邻点可以为当前点的M个近邻点中的除候选近邻点之外距离当前点最近的近邻点。For example, the non-candidate neighbor point is any neighbor point other than the candidate neighbor point among the M neighbor points of the current point. The non-candidate neighbor point can be the neighbor point closest to the current point other than the candidate neighbor point among the M neighbor points of the current point.

示例性的,候选近邻点的相关系数可以表征候选近邻点的亮度重建值和非候选近邻点的亮度重建值之间的相关性。或者,候选近邻点的相关系数可以表征候选近邻点的亮度重建值和非候选近邻点的反射率重建值之间的相关性。或者,候选近邻点的相关系数可以表征候选近邻点的反射率重建值和非候选近邻点的反射率重建值之间的相关性。For example, the correlation coefficient of the candidate neighbor point may represent the correlation between the brightness reconstructed value of the candidate neighbor point and the brightness reconstructed value of the non-candidate neighbor point. Alternatively, the correlation coefficient of the candidate neighbor point may represent the correlation between the brightness reconstructed value of the candidate neighbor point and the reflectivity reconstructed value of the non-candidate neighbor point. Alternatively, the correlation coefficient of the candidate neighbor point may represent the correlation between the reflectivity reconstructed value of the candidate neighbor point and the reflectivity reconstructed value of the non-candidate neighbor point.

S304、根据当前点的待编码属性的属性参考值和相关系数,确定当前点的待编码属性的属性预测值。S304: Determine the attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value and the correlation coefficient of the attribute to be encoded at the current point.

在本申请实施例中,待编码属性可以包括:亮度和反射率。In the embodiment of the present application, the attributes to be encoded may include: brightness and reflectivity.

在本申请的一些实施例中,将当前点的待编码属性的属性参考值和相关系数相乘,确定待编码属性的属性预测值。In some embodiments of the present application, the attribute reference value of the attribute to be encoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be encoded.

S305、根据一个或多个候选跨属性预测模式对应的当前点的待编码属性的属性预测值进行编码决策,确定当前点的最佳预测模式为目标跨属性预测模式。S305 : Make a coding decision based on the attribute prediction value of the to-be-coded attribute of the current point corresponding to one or more candidate cross-attribute prediction modes, and determine the best prediction mode of the current point as the target cross-attribute prediction mode.

在本申请实施例中,将一个或多个候选跨属性预测模式对应的当前点的待编码属性的属性预测值进行率失真代价(Rate-Distortion Optimation,RDO)计算,得到一个或多个率失真代价值;将一个或多个率失真代价值中的最小代价值对应的候选跨属性预测模式作为当前点的最佳预测模式。In an embodiment of the present application, a rate-distortion optimization (RDO) is performed on the attribute prediction value of the attribute to be encoded of the current point corresponding to one or more candidate cross-attribute prediction modes to obtain one or more rate-distortion cost values; and the candidate cross-attribute prediction mode corresponding to the minimum cost value among the one or more rate-distortion cost values is used as the optimal prediction mode for the current point.

S306、根据最佳预测模式,确定当前点的第一语法元素信息的取值。S306: Determine the value of the first syntax element information at the current point according to the optimal prediction mode.

在本申请实施例中,第一语法元素信息用于指示当前点的最佳预测模式。其中,当前点的最佳预测模式可以为跨属性预测模式或非跨属性预测模式。In the embodiment of the present application, the first syntax element information is used to indicate the best prediction mode for the current point, wherein the best prediction mode for the current point can be a cross-attribute prediction mode or a non-cross-attribute prediction mode.

在本申请实施例中,第一语法元素信息的取值可以为参数形式,也可以是数字形式。具体地,第一语法元素信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。In the embodiment of the present application, the value of the first syntax element information can be in parameter form or in digital form. Specifically, the first syntax element information can be a parameter written in the profile or a flag value, which is not specifically limited here.

示例性的,若确定当前点的最佳预测模式为预测模式0,则将第一语法元素信息的取值设置为0;若确定当前点的最佳预测模式为预测模式1,则将第一语法元素信息的取值设置为1。Exemplarily, if it is determined that the best prediction mode of the current point is prediction mode 0, the value of the first syntax element information is set to 0; if it is determined that the best prediction mode of the current point is prediction mode 1, the value of the first syntax element information is set to 1.

S307、对第一语法元素信息进行编码处理,将所得到的编码比特写入码流。S307: Encode the first syntax element information, and write the obtained coded bits into a bitstream.

本申请实施例提供了一种编码方法,该编码方法包括:从候选预测模式中确定当前点的候选跨属性预测模式;根据候选跨属性预测模式,确定当前点的候选近邻点的一个或多个属性重建值;根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数;根据当前点的待编码属性的属性参考值和相关系数,确定当前点的待编码属性的属性预测值;根据一个或多个候选跨属性预测模式对应的当前点的待编码属性的属性预测值进行编码决策,确定当前点的最佳预测模式为目标跨属性预测模式;根据最 佳预测模式,确定当前点的第一语法元素信息的取值;对第一语法元素信息进行编码处理,将所得到的编码比特写入码流。待编码属性的属性预测值是根据当前点的邻近点的相关性信息和已知属性值计算得出的,可以作为当前点属性的预测值。相关系数可以帮助衡量待编码属性与已知属性之间的相关程度。如果相关系数较高,意味着两者之间存在较强的线性关系,预测值可以更准确地反映出待编码属性的实际值。通过利用相关系数进行预测,可以避免不必要的数据传输和存储。如果待编码属性与已知属性之间相关性较低,预测值会更加接近待编码属性的实际值,减少了冗余数据的传输和存储。从而可以提高码率的利用率,避免码率浪费,进而可以提高编码性能。An embodiment of the present application provides a coding method, which includes: determining a candidate cross-attribute prediction mode for a current point from candidate prediction modes; determining one or more attribute reconstruction values of candidate neighboring points of the current point based on the candidate cross-attribute prediction mode; determining the correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points; determining the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value and the correlation coefficient of the attribute to be encoded at the current point; making a coding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the best prediction mode for the current point as the target cross-attribute prediction mode; and determining the best prediction mode for the current point as the target cross-attribute prediction mode based on the best The optimal prediction mode is used to determine the value of the first syntax element information at the current point; the first syntax element information is encoded, and the resulting coded bits are written into the bitstream. The attribute prediction value of the attribute to be coded is calculated based on the correlation information of the neighboring points of the current point and the known attribute values, and can be used as the predicted value of the attribute at the current point. The correlation coefficient can help measure the degree of correlation between the attribute to be coded and the known attributes. If the correlation coefficient is high, it means that there is a strong linear relationship between the two, and the predicted value can more accurately reflect the actual value of the attribute to be coded. By using the correlation coefficient for prediction, unnecessary data transmission and storage can be avoided. If the correlation between the attribute to be coded and the known attributes is low, the predicted value will be closer to the actual value of the attribute to be coded, reducing the transmission and storage of redundant data. This can improve the utilization of the bit rate, avoid bit rate waste, and thus improve coding performance.

下面对前文中提到的目标近邻点的相关系数的3种情况下,如何对当前点的待解码属性的属性预测值进行跨属性预测分别说明,具体分为以下3点。The following describes how to perform cross-attribute prediction on the attribute prediction value of the attribute to be decoded at the current point in the three cases of correlation coefficients of the target neighbor points mentioned above. The details are divided into the following three points.

1、针对情况1中相关系数表征候选近邻点的多个属性重建值之间的相关性。1. For case 1, the correlation coefficient represents the correlation between multiple attribute reconstruction values of candidate neighbor points.

在本申请的一些实施例中,相关系数包括第一系数;S303中根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a first coefficient; and the implementation of determining the correlation coefficient of the candidate neighboring point based on one or more attribute reconstruction values of the candidate neighboring point in S303 may include:

根据候选近邻点的第一属性重建值和候选近邻点的第二属性重建值,确定第一系数。A first coefficient is determined according to the first attribute reconstruction value of the candidate neighbor point and the second attribute reconstruction value of the candidate neighbor point.

在本申请实施例中,在情况1中,候选近邻点的第一属性重建值对应的属性与候选近邻点的第二属性重建值对应的属性不同,且第一属性重建值对应的属性与第二属性重建值对应的属性具有相关性。In an embodiment of the present application, in situation 1, the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is different from the attribute corresponding to the second attribute reconstruction value of the candidate neighbor point, and the attribute corresponding to the first attribute reconstruction value is correlated with the attribute corresponding to the second attribute reconstruction value.

需要说明的是,第一属性重建值对应的属性与第二属性重建值对应的属性不同且具有相关性,意味着第一属性重建值和第二属性重建值为两种不同属性(第一属性和第二属性)的重建值,但是第一属性和第二属性具有相关性。示例性的,第一属性可以为亮度,第二属性可以为反射率。It should be noted that the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction value are different and correlated, meaning that the first attribute reconstruction value and the second attribute reconstruction value are reconstruction values of two different attributes (the first attribute and the second attribute), but the first attribute and the second attribute are correlated. For example, the first attribute can be brightness and the second attribute can be reflectivity.

这里,对亮度和反射率之间具有相关性进行说明。在物体的光学特性方面,亮度通常指的是人眼感知到的光的强度或者光的明暗程度。而反射率则是表征物体表面对光的反射程度,即表面反射光的相对强度。在通常情况下,较高的反射率通常会导致更高的亮度。根据光学理论,物体的亮度属性和反射率属性具有较强的相关性,经统计,Am-fused类别点云中的多数点之间的反射率和亮度信息也有着较强的相关性,特别是对于近邻点,它们的相关关系基本相同。因此使用当前点已经编码好的属性信息去预测未编码属性值,便可起到减少残差、去除冗余的效果。示例性的,如图9所示,当前点云的亮度信息(luma)已编码完成,当前点(待预测点)为P0,当前点的三个近邻点分别为P1、P2和P3。当前点的候选近邻点为P1,则利用P1的亮度重建值(luma=40)和P1的反射率重建值(ref=40)之间的关系建立线性模型(第一系数),作为当前点P0的亮度信息与反射率信息的相关关系,从而利用P0的亮度重建值和P1的第一系数预测当前点的待解码属性(反射率)的属性预测值,或者,利用P0的反射率重建值和P1的第一系数预测当前点的待解码属性(亮度率)的属性预测值。Here, the correlation between brightness and reflectivity is explained. In terms of the optical properties of an object, brightness generally refers to the intensity or brightness of light perceived by the human eye. Reflectivity, on the other hand, characterizes the degree of light reflection from an object's surface, that is, the relative intensity of light reflected from the surface. Generally speaking, higher reflectivity results in higher brightness. According to optical theory, an object's brightness and reflectivity properties are strongly correlated. Statistics show that the reflectivity and brightness information of most points in the Am-fused point cloud also have a strong correlation, especially for neighboring points, where the correlation is essentially the same. Therefore, using the encoded attribute information of the current point to predict the unencoded attribute value can reduce residual errors and remove redundancy. For example, as shown in Figure 9, the brightness information (luma) of the current point cloud has been encoded. The current point (the point to be predicted) is P0, and its three neighboring points are P1, P2, and P3. If the candidate neighbor point of the current point is P1, the relationship between the brightness reconstruction value of P1 (luma=40) and the reflectivity reconstruction value of P1 (ref=40) is used to establish a linear model (first coefficient) as the correlation between the brightness information and reflectivity information of the current point P0, so as to use the brightness reconstruction value of P0 and the first coefficient of P1 to predict the attribute prediction value of the attribute to be decoded (reflectivity) of the current point, or use the reflectivity reconstruction value of P0 and the first coefficient of P1 to predict the attribute prediction value of the attribute to be decoded (brightness rate) of the current point.

可以理解的是,第一系数可以反映候选近邻点的不同属性之间的关联程度。如果第一系数接近于1,表示第一属性和第二属性之间存在强烈的正相关关系;如果接近于0,表示两者之间几乎没有相关性,这有助于评估属性之间的关联性,从而更好地理解数据的特征和规律。It can be understood that the first coefficient can reflect the degree of correlation between the different attributes of the candidate neighbor points. If the first coefficient is close to 1, it indicates a strong positive correlation between the first attribute and the second attribute; if it is close to 0, it indicates that there is almost no correlation between the two. This helps to assess the correlation between attributes and better understand the characteristics and patterns of the data.

在本申请的一些实施例中,第一系数包括候选近邻点的第一属性重建值和候选近邻点的第二属性重建值的比值。In some embodiments of the present application, the first coefficient includes a ratio of a first attribute reconstruction value of the candidate neighbor point to a second attribute reconstruction value of the candidate neighbor point.

在本申请实施例中,第一属性重建值对应的属性和第二属性重建对应的属性与当前节点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value and the attribute corresponding to the second attribute reconstruction are related to the attribute coding order of the current node.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第一系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the first coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,候选近邻点的第一属性重建值为候选近邻点第二属性的重建值,候选近邻点的第二属性重建值为候选近邻点第一属性的重建值,待解码属性的属性参考值为当前点第一属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,候选近邻点的第一属性重建值为候选近邻点的反射率重建值,候选近邻点的第二属性重建值为候选近邻点的亮度重建值,当前点的待解码属性的属性参考值为当前点的亮度重建值,当前点的待解码属性的属性预测值为反射率预测值。示例性的,当前点的反射率预测值可以参照前文中的公式(7)和公式(8)的描述。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the candidate neighbor point is the reflectivity reconstruction value of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the brightness reconstruction value of the candidate neighbor point, the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the current point, and the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value. For example, the reflectivity prediction value of the current point can refer to the description of formulas (7) and (8) above.

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,候选近邻点的第一属性重建值为候选近邻点第一属性的重建值,候选近邻点的第二属性重建值为候选近邻点第二属性的重建值,待解码属性的属性参考值为当前点第二属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,候选近邻点的第一属性重建值为候选近邻点的亮度重建值,候选近邻点的第二属性重建值为候选近邻点的反射率重建值,当前点的待解码属性的属性参考值为当前点的反射率重建值,当前点的待解 码属性的属性预测值为亮度预测值。示例性的,当前点的亮度预测值可以参照前文中的公式(9)和公式(10)的描述。In the embodiment of the present application, when the attribute reconstruction order of the current point is that reflection precedes brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point, the second attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point, the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the current point, and the attribute to be decoded of the current point is the reflectivity reconstruction value of the current point. The attribute prediction value of the code attribute is a brightness prediction value. For example, the brightness prediction value of the current point can refer to the description of formula (9) and formula (10) in the above text.

可以理解的是,一方面,通过第一系数,可以将候选近邻点的第一属性重建值和第二属性重建值的相关性纳入预测过程中。如果第一系数较大,表示两个属性之间存在强烈的相关性,那么在预测当前点的待解码属性时,可以更准确地利用第一属性和第二属性之间的关系,提高预测的准确性。再一方面,结合第一系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。这种基于相关性信息的预测方法可以避免不必要的误差,并提高解码过程的准确性。又一方面,基于第一系数和属性参考值的属性预测值计算过程相对简单且准确,不需要过多的计算资源,可以减少数据传输过程中的冗余信息,提高数据传输的效率。特别是在带宽有限或传输成本较高的情况下,有效利用相关性信息可以节省传输数据资源。It can be understood that, on the one hand, the correlation between the first attribute reconstruction value and the second attribute reconstruction value of the candidate neighbor point can be incorporated into the prediction process through the first coefficient. If the first coefficient is large, indicating that there is a strong correlation between the two attributes, then when predicting the attribute to be decoded at the current point, the relationship between the first attribute and the second attribute can be more accurately utilized to improve the accuracy of the prediction. On the other hand, combining the first coefficient and the attribute reference value can obtain a more accurate attribute prediction value of the attribute to be decoded. This prediction method based on correlation information can avoid unnecessary errors and improve the accuracy of the decoding process. On the other hand, the attribute prediction value calculation process based on the first coefficient and the attribute reference value is relatively simple and accurate, does not require excessive computing resources, can reduce redundant information in the data transmission process, and improve the efficiency of data transmission. Especially in the case of limited bandwidth or high transmission costs, the effective use of correlation information can save transmission data resources.

2、针对情况2中相关系数表征候选近邻点的属性重建值和当前点的属性重建值之间的相关性。2. For case 2, the correlation coefficient represents the correlation between the attribute reconstruction value of the candidate neighbor point and the attribute reconstruction value of the current point.

在本申请的一些实施例中,相关系数包括第二系数;S303中根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a second coefficient; and the implementation of determining the correlation coefficient of the candidate neighbor point based on one or more attribute reconstruction values of the candidate neighbor point in S303 may include:

根据当前点的第一属性重建值和候选近邻点的第一属性重建值,确定第二系数。The second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point.

在本申请实施例中,在情况2中,候选近邻点的第一属性重建值对应的属性与当前点的属性重建值对应的属性相同。In the embodiment of the present application, in case 2, the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the current point.

在本申请的一些实施例中,第二系数包括当前点的第一属性重建值和候选近邻点的第一属性重建值的比值。In some embodiments of the present application, the second coefficient includes a ratio of a first attribute reconstruction value of the current point to a first attribute reconstruction value of a candidate neighboring point.

在本申请实施例中,第一属性重建值对应的属性与当前点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第二系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the second coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,当前点的第一属性重建值为当前点第一属性的重建值,候选近邻点的第一属性重建值为候选近邻点第一属性的重建值,待解码属性的属性参考值为候选近邻点第二属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the first attribute of the candidate neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the candidate neighboring point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,当前点的第一属性重建值为当前点的亮度重建值,候选近邻点的第一属性重建值为候选近邻点的亮度重建值,当前点的待解码属性的属性参考值为候选近邻点的反射率重建值,当前点的待解码属性的属性预测值为反射率预测值。示例性的,当前点的亮度预测值可以参照前文中的公式(11)和公式(12)的描述。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the current point is the brightness reconstruction value of the current point, the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point, the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the candidate neighboring point, and the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value. For example, the brightness prediction value of the current point can refer to the description of formula (11) and formula (12) in the previous text.

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,当前点的第一属性重建值为当前点第二属性的重建值,候选近邻点的第一属性重建值为候选近邻点第二属性的重建值,待解码属性的属性参考值为候选近邻点第一属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the second attribute of the candidate neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the candidate neighboring point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,当前点的第一属性重建值为当前点的反射率重建值,候选近邻点的第一属性重建值为候选近邻点的反射率重建值,当前点的待解码属性的属性参考值为候选近邻点的亮度重建值,当前点的待解码属性的属性预测值为亮度预测值。示例性的,当前点的亮度预测值可以参照前文中的公式(13)和公式(14)的描述。In an embodiment of the present application, when the attribute reconstruction order of the current point is reflectance before brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point, the first attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point, the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the candidate neighboring point, and the attribute prediction value of the attribute to be decoded of the current point is the brightness prediction value. For example, the brightness prediction value of the current point can refer to the description of formula (13) and formula (14) above.

可以理解的是,第二系数考虑了当前点的第一属性重建值与候选近邻点的第一属性重建值之间的比值关系,这种关系可以帮助考虑当前点属性与候选近邻点属性之间的相关性,从而更准确地预测当前点的属性值。结合第二系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。第二系数的考虑使得预测过程更加针对性,可以更好地反映当前点与候选近邻点之间的属性关系,提高预测的准确性。准确的属性预测值可以减少不必要的数据传输,节省传输资源。通过考虑第二系数,可以更有效地利用属性之间的相关性,减少传输过程中的冗余信息,提高数据传输的效率。It can be understood that the second coefficient takes into account the ratio between the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point. This relationship can help consider the correlation between the attributes of the current point and the attributes of the candidate neighboring points, thereby more accurately predicting the attribute value of the current point. Combining the second coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained. Consideration of the second coefficient makes the prediction process more targeted, can better reflect the attribute relationship between the current point and the candidate neighboring points, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the second coefficient, the correlation between attributes can be more effectively utilized, redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.

3、针对情况2中相关系数表征候选近邻点的属性重建值和当前点的非候选近邻点的属性重建值之间的相关性。3. The correlation coefficient in case 2 represents the correlation between the attribute reconstruction values of the candidate neighbor points and the attribute reconstruction values of the non-candidate neighbor points of the current point.

在本申请的一些实施例中,相关系数包括第三系数;S303中根据候选近邻点的一个或多个属性重建值,确定候选近邻点的相关系数的实现,可以包括:In some embodiments of the present application, the correlation coefficient includes a third coefficient; and the implementation of determining the correlation coefficient of the candidate neighbor point based on one or more attribute reconstruction values of the candidate neighbor point in S303 may include:

根据非候选近邻点的第一属性重建值和候选近邻点的第一属性重建值,确定第三系数。The third coefficient is determined according to the first attribute reconstruction value of the non-candidate neighbor point and the first attribute reconstruction value of the candidate neighbor point.

在本申请实施例中,在情况3中,候选近邻点的第一属性重建值对应的属性与非候选近邻点的属性重建值对应的属性相同。In the embodiment of the present application, in case 3, the attribute corresponding to the first attribute reconstruction value of the candidate neighbor point is the same as the attribute corresponding to the attribute reconstruction value of the non-candidate neighbor point.

在本申请实施例中,非候选近邻点为当前点的M个近邻点中除候选近邻点之外的任一个近邻点, 比如,非候选近邻点可以为当前点的M个近邻点中除候选近邻点之外的距离当前点最近的近邻点,或者,非候选近邻点可以为当前点的M个近邻点中除候选近邻点之外的距离候选近邻点最近的近邻点,本申请对此不作任何限定。In the embodiment of the present application, a non-candidate neighbor point is any neighbor point among the M neighbor points of the current point except the candidate neighbor point. For example, the non-candidate neighbor point can be the neighbor point closest to the current point among the M neighbor points of the current point excluding the candidate neighbor point, or the non-candidate neighbor point can be the neighbor point closest to the candidate neighbor point among the M neighbor points of the current point excluding the candidate neighbor point. This application does not impose any restrictions on this.

在本申请的一些实施例中,第三系数包括候选近邻点的第一属性重建值和非候选近邻点的第一属性重建值的比值。In some embodiments of the present application, the third coefficient includes a ratio of the first attribute reconstructed value of the candidate neighbor point to the first attribute reconstructed value of the non-candidate neighbor point.

在本申请实施例中,第一属性重建值对应的属性与当前点的属性编码顺序相关。In the embodiment of the present application, the attribute corresponding to the first attribute reconstruction value is related to the attribute coding order of the current point.

在本申请实施例中,以第一属性为亮度(luma),第二属性为反射率(ref)为例,第三系数包括以下两种情况:In the embodiment of the present application, taking the first attribute as brightness (luma) and the second attribute as reflectivity (ref) as an example, the third coefficient includes the following two cases:

(1)、当前点的属性重建顺序为第一属性先于第二属性的情况下,待解码属性为第二属性,非候选近邻点的第一属性重建值为非候选近邻点第一属性的重建值,候选近邻点的第一属性重建值为候选近邻点第一属性的重建值,待解码属性的属性参考值为候选近邻点第二属性的重建值。(1) When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the non-candidate neighbor point is the reconstruction value of the first attribute of the non-candidate neighbor point, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the candidate neighbor point.

在本申请实施例中,在当前点的属性重建顺序为亮度先于反射率的情况下,当前节点的待解码属性为反射率,非候选近邻点的第一属性重建值为当前点的亮度重建值,候选近邻点的第一属性重建值为候选近邻点的亮度重建值,当前点的待解码属性的属性参考值为候选近邻点的反射率重建值,当前点的待解码属性的属性预测值为反射率预测值。示例性的,当前点的亮度预测值可以参照前文中的公式(15)和公式(16)的描述。In an embodiment of the present application, when the attribute reconstruction order of the current point is brightness before reflectivity, the attribute to be decoded of the current node is reflectivity, the first attribute reconstruction value of the non-candidate neighboring point is the brightness reconstruction value of the current point, the first attribute reconstruction value of the candidate neighboring point is the brightness reconstruction value of the candidate neighboring point, the attribute reference value of the attribute to be decoded of the current point is the reflectivity reconstruction value of the candidate neighboring point, and the attribute prediction value of the attribute to be decoded of the current point is the reflectivity prediction value. For example, the brightness prediction value of the current point can refer to the description of formula (15) and formula (16) in the previous text.

(2)、当前点的属性重建顺序为第二属性先于第一属性的情况下,待解码属性为第一属性,非候选近邻点的第一属性重建值为非候选近邻点第二属性的重建值,候选近邻点的第一属性重建值为候选近邻点第二属性的重建值,待解码属性的属性参考值为候选近邻点第一属性的重建值。(2) When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the non-candidate neighbor point is the reconstruction value of the second attribute of the non-candidate neighbor point, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the candidate neighbor point.

在本申请实施例中,在当前点的属性重建顺序为反射率先于亮度的情况下,当前节点的待解码属性为亮度,当前点的第一属性重建值为当前点的反射率重建值,候选近邻点的第一属性重建值为候选近邻点的反射率重建值,当前点的待解码属性的属性参考值为候选近邻点的亮度重建值,当前点的待解码属性的属性预测值为亮度预测值。示例性的,当前点的亮度预测值可以参照前文中的公式(17)和公式(18)的描述。In an embodiment of the present application, when the attribute reconstruction order of the current point is reflectance before brightness, the attribute to be decoded of the current node is brightness, the first attribute reconstruction value of the current point is the reflectivity reconstruction value of the current point, the first attribute reconstruction value of the candidate neighboring point is the reflectivity reconstruction value of the candidate neighboring point, the attribute reference value of the attribute to be decoded of the current point is the brightness reconstruction value of the candidate neighboring point, and the attribute prediction value of the attribute to be decoded of the current point is the brightness prediction value. For example, the brightness prediction value of the current point can refer to the description of formulas (17) and (18) above.

可以理解的是,第三系数考虑了候选近邻点的第一属性重建值与非候选近邻点的第一属性重建值之间的比值关系,这种比值关系可以帮助评估候选近邻点和非候选近邻点之间的属性关联性,从而更好地理解数据的特征和规律。结合第三系数和属性参考值,可以得到更加精确的待解码属性的属性预测值。第三系数的考虑使得预测过程更加综合和全面,可以更好地反映当前点与候选近邻点和非候选近邻点之间的属性关系,提高预测的准确性。准确的属性预测值可以减少不必要的数据传输,节省传输资源。通过考虑第三系数,可以更有效地利用候选近邻点和非候选近邻点之间的属性关联性,减少传输过程中的冗余信息,提高数据传输的效率。It can be understood that the third coefficient takes into account the ratio relationship between the first attribute reconstruction value of the candidate neighbor point and the first attribute reconstruction value of the non-candidate neighbor point. This ratio relationship can help evaluate the attribute correlation between the candidate neighbor point and the non-candidate neighbor point, so as to better understand the characteristics and laws of the data. Combining the third coefficient and the attribute reference value, a more accurate attribute prediction value of the attribute to be decoded can be obtained. The consideration of the third coefficient makes the prediction process more comprehensive and comprehensive, which can better reflect the attribute relationship between the current point and the candidate neighbor point and the non-candidate neighbor point, and improve the accuracy of the prediction. Accurate attribute prediction values can reduce unnecessary data transmission and save transmission resources. By considering the third coefficient, the attribute correlation between the candidate neighbor point and the non-candidate neighbor point can be more effectively utilized, the redundant information in the transmission process can be reduced, and the efficiency of data transmission can be improved.

在本申请的一些实施例中,该编码方法还包括:In some embodiments of the present application, the encoding method further includes:

确定第二语法元素信息;determining second syntax element information;

若第二语法元素信息的取值为第一值,则确定当前点的属性重建顺序为第一属性先于第二属性;或者,If the value of the second syntax element information is the first value, then determining the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or

若第二语法元素信息的取值为第二值,则确定当前点的属性重建顺序为第二属性先于第一属性;If the value of the second syntax element information is the second value, determining that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute;

方法还包括:The method also includes:

将第二语法标识信息进行编码处理,将所得到的编码比特写入码流。The second syntax identification information is coded, and the obtained coded bits are written into the bitstream.

在本申请实施例中,第二语法元素信息用于指示当前点的属性重建顺序。In the embodiment of the present application, the second syntax element information is used to indicate the attribute reconstruction order of the current point.

示例性的,第二语法元素信息可以是在属性参数APS的标志位,第二语法元素信息可以表示为muti_crosstype_pre,用于指示当前点的属性编码顺序。Exemplarily, the second syntax element information may be a flag bit in the attribute parameter APS, and the second syntax element information may be expressed as muti_crosstype_pre, which is used to indicate the attribute coding order of the current point.

需要说明的是,在本申请实施例中,第一值与第二值不同,而且第一值和第二值可以是参数形式,也可以是数字形式。具体地,第二语法标识信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。It should be noted that in the embodiment of the present application, the first value and the second value are different, and the first value and the second value can be in parameter form or in digital form. Specifically, the second syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.

在本申请的一些实施例中,候选预测模式还包括第一预测模式,该编码方法还包括S401至S403:In some embodiments of the present application, the candidate prediction mode further includes the first prediction mode, and the encoding method further includes S401 to S403:

S401、从候选预测模式中确定当前点的第一预测模式;S401, determining a first prediction mode for a current point from candidate prediction modes;

S402、根据第一预测模式,确定当前点的待编码属性的属性预测值;S402: Determine an attribute prediction value of the attribute to be encoded at the current point according to the first prediction mode;

S403、根据一个或多个候选跨属性预测模式和第一预测模式各自对应的当前点的待编码属性的属性预测值进行编码决策,确定当前点的最佳预测模式为第一预测模式。S403 : Make a coding decision based on the attribute prediction values of the to-be-coded attribute of the current point corresponding to each of the one or more candidate cross-attribute prediction modes and the first prediction mode, and determine that the best prediction mode for the current point is the first prediction mode.

在本申请实施例中,第一预测模式为非跨属性预测模式。In the embodiment of the present application, the first prediction mode is a non-cross-attribute prediction mode.

在本申请实施例中,第一预测模式与当前点的M个近邻点的重建属性值相关。示例性的,第一预测模式可以表示当前节点的M个近邻点的已重建属性的属性重建值加权平均。其中,M个近邻点的已 重建属性与当前点的待编码属性相同。In the embodiment of the present application, the first prediction mode is related to the reconstructed attribute values of the M neighboring points of the current point. For example, the first prediction mode can represent the weighted average of the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current node. The reconstructed attributes are the same as the attributes to be encoded of the current point.

在本申请实施例中,候选预测模式可分为两种情况:In the embodiment of the present application, candidate prediction modes can be divided into two cases:

情况1、候选预测模式包括:一个或多个候选跨属性预测模式。Case 1: The candidate prediction modes include: one or more candidate cross-attribute prediction modes.

示例性的,一个或多个候选跨属性预测模式可以包括:预测模式1、预测模式2和预测模式3。其中,预测模式1指示利用当前点的第1个候选近邻点进行跨属性指导预测,以推导当前点的待编码属性的属性预测值。预测模式2指示利用当前点的第2个候选近邻点进行跨属性指导预测,以推导当前点的待编码属性的属性预测值。预测模式3指示利用当前点的第3个候选近邻点进行跨属性指导预测,以推导当前点的待编码属性的属性预测值。在这种情况下,编码器会对预测模式1、预测模式2和预测模式3各自对应的当前点的待编码属性的属性预测值进行编码决策,以确定当前点的最佳预测模式。Exemplarily, one or more candidate cross-attribute prediction modes may include: prediction mode 1, prediction mode 2, and prediction mode 3. Prediction mode 1 indicates that the first candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point. Prediction mode 2 indicates that the second candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point. Prediction mode 3 indicates that the third candidate neighboring point of the current point is used to perform cross-attribute guided prediction to derive the attribute prediction value of the attribute to be encoded at the current point. In this case, the encoder will make encoding decisions on the attribute prediction values of the attribute to be encoded of the current point corresponding to prediction mode 1, prediction mode 2, and prediction mode 3, respectively, to determine the optimal prediction mode for the current point.

情况2、候选预测模式包括:一个或多个候选跨属性预测模式以及一个或多个非跨属性预测模式。Case 2: the candidate prediction modes include: one or more candidate cross-attribute prediction modes and one or more non-cross-attribute prediction modes.

示例性的,候选预测模式包括;3个候选跨属性预测模式(预测模式1、预测模式2和预测模式3)和1个非跨属性预测模式(预测模式0)。预测模式0指示利用当前点的3个候选近邻点的属性重建值,以推导当前点的待编码属性的属性预测值。示例性的,预测模式0指示利用当前点的3个候选近邻点的亮度重建值的加权平均后的值作为当前点的亮度预测值,或者,利用当前点的3个近邻点的反射率重建值的加权平均后的值作为当前点的反射率预测值。在这种情况下,编码器会对预测模式0、预测模式1、预测模式2和预测模式3各自对应的当前点的待编码属性的属性预测值进行编码决策,以确定当前点的最佳预测模式。Exemplarily, the candidate prediction modes include; 3 candidate cross-attribute prediction modes (prediction mode 1, prediction mode 2 and prediction mode 3) and 1 non-cross-attribute prediction mode (prediction mode 0). Prediction mode 0 indicates the use of the attribute reconstruction values of the 3 candidate neighboring points of the current point to derive the attribute prediction value of the attribute to be encoded of the current point. Exemplarily, prediction mode 0 indicates the use of the weighted average of the brightness reconstruction values of the 3 candidate neighboring points of the current point as the brightness prediction value of the current point, or the use of the weighted average of the reflectivity reconstruction values of the 3 neighboring points of the current point as the reflectivity prediction value of the current point. In this case, the encoder will make encoding decisions on the attribute prediction values of the attribute to be encoded of the current point corresponding to prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3, respectively, to determine the best prediction mode for the current point.

在本申请的一些实施例中,该编码方法还包括S501至S503:In some embodiments of the present application, the encoding method further includes S501 to S503:

S501、根据当前点的M个近邻点各自的已重建属性的属性重建值,确定当前点是否满足预设条件;S501, determining whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point;

S502、在当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行从候选预测模式中确定当前点的候选跨属性预测模式的步骤,或者,S502: When the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point meet the preset conditions, determine the candidate cross-attribute prediction mode of the current point from the candidate prediction modes, or

S503、在当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定当前点采用第二预测模式。S503: When the reconstructed attribute values of the respective reconstructed attributes of the M neighboring points of the current point do not meet a preset condition, determine that the current point adopts the second prediction mode.

在本申请的一些实施例中,M为大于或等于2的正整数;预设条件包括:M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值;已重建属性与待编码属性相同。In some embodiments of the present application, M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference of the attribute reconstruction values of the reconstructed attributes between the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be encoded.

在本申请的一些实施例中,该编码方法还包括:In some embodiments of the present application, the encoding method further includes:

在确定当前点采用第二预测模式的情况下,根据M个近邻点各自的空间位置以及当前点的空间位置,确定M个近邻点各自的空间几何权重;When it is determined that the current point adopts the second prediction mode, determining the spatial geometric weights of the M neighboring points according to their respective spatial positions and the spatial position of the current point;

根据M个近邻点各自的已重建属性的属性重建值和M个近邻点各自的空间几何权重,确定待编码属性的属性预测值。The attribute prediction value of the attribute to be encoded is determined according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weight of each of the M neighboring points.

可以理编的是,一方面,通过判断当前点的M个近邻点的属性重建值是否满足预设条件,可以进行数据决策优化。如果满足条件,则执行编码码流过程,可以更精确地确定当前点的第一语法元素信息,提高编码的准确性和效率;如果不满足条件,则选择第二预测模式,使得数据处理更加智能和适应性更强。另一方面,根据预设条件进行判断,可以避免对不符合条件的数据进行编码,节约了编码过程中的计算资源和时间,有助于提高资源利用效率,使得编码过程更加高效。根据预设条件进行数据处理和决策,可以保障数据的质量和完整性。只对满足条件的数据进行编码或选择第二预测模式,有助于避免不必要的数据处理错误或误判,提高数据处理的准确性和可靠性。再一方面,预设条件的应用可以使得系统运行更加智能化和高效化。根据具体条件的判断,灵活地选择编码或预测模式,有助于提升系统运行效率,满足不同数据处理需求。It's sensible to understand that, on the one hand, by determining whether the attribute reconstructed values of the current point's M neighboring points meet preset conditions, data decision optimization can be performed. If the conditions are met, the bitstream encoding process is executed, more accurately determining the first syntax element information of the current point, improving encoding accuracy and efficiency. If the conditions are not met, the second prediction mode is selected, making data processing more intelligent and adaptable. Furthermore, making decisions based on preset conditions avoids encoding data that doesn't meet the conditions, saving computing resources and time during the encoding process, helping to improve resource utilization and making the encoding process more efficient. Data processing and decision-making based on preset conditions ensures data quality and integrity. Encoding only data that meets the conditions or selecting the second prediction mode helps avoid unnecessary data processing errors or misjudgments, improving data processing accuracy and reliability. Furthermore, the application of preset conditions can make system operation more intelligent and efficient. Flexible selection of encoding or prediction modes based on specific conditions helps improve system efficiency and meet diverse data processing requirements.

需要说明的是,关于S501至S503的解释可以参照前文中S201至S203的描述,在此不再赘述。It should be noted that the explanation of S501 to S503 can refer to the description of S201 to S203 in the previous text, and will not be repeated here.

在本申请的一些实施例中,该编码方法还包括:In some embodiments of the present application, the encoding method further includes:

确定第三语法元素信息;determining third syntax element information;

在第三语法元素信息指示当前点允许采用跨属性预测模式的情况下,确定候选预测模式包括一个或多个跨属性预测模式;或者,In a case where the third syntax element information indicates that the current point allows the use of the cross-attribute prediction mode, determining that the candidate prediction modes include one or more cross-attribute prediction modes; or

在第三语法元素信息指示当前点禁止跨属性预测模式的情况下,确定候选预测模式包括一个或多个非跨属性预测模式;In a case where the third syntax element information indicates that the current point prohibits the cross-attribute prediction mode, determining that the candidate prediction modes include one or more non-cross-attribute prediction modes;

根据一个或多个非跨属性预测模式,确定当前点的一个或多个属性预测值;Determining one or more attribute prediction values of the current point according to one or more non-cross-attribute prediction modes;

根据当前点的一个或多个属性预测值编码决策,确定当前点采用的最佳预测模式;Determine the best prediction mode for the current point based on the encoding decision of one or more attribute prediction values of the current point;

根据最佳预测模式,确定第一语法元素信息的取值;Determining a value of the first syntax element information according to the optimal prediction mode;

对第一语法元素信息进行编码处理,将所得到的编码比特写入码流;Performing encoding processing on the first syntax element information, and writing the obtained encoding bits into a bitstream;

该编码方法还包括:The encoding method also includes:

对第三语法标识信息进行编码处理,将所得到的编码比特写入码流。 The third syntax identification information is coded, and the obtained coded bits are written into the bitstream.

在本申请实施例中,第三语法元素信息用于指示当前点是否允许采用跨属性预测模式。In the embodiment of the present application, the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

在本申请实施例中,候选预测模式与第三语法元素指示的当前点是否允许采用跨属性预测模式相关,具体包括以下两种情况:In the embodiment of the present application, the candidate prediction mode is related to whether the current point indicated by the third syntax element allows the use of the cross-attribute prediction mode, specifically including the following two cases:

情况1、第三语法元素信息指示当前点允许采用跨属性预测模式。Case 1: The third syntax element information indicates that the cross-attribute prediction mode is allowed at the current point.

示例性的,若当前点允许采用跨属性预测模式,则候选预测模式至少包括:一个或多个候选跨属性预测模式。当前点的候选预测模式包括:预测模式0(第一预测模式)、预测模式1、预测模式2和预测模式3。其中,预测模式0为非跨属性预测模式,预测模式1、预测模式2和预测模式3为跨属性预测模式。第一语法元素信息用于指示当前点采用的最佳预测模式,其中,最佳预测模式可以为目标跨属性预测模式(预测模式1~3中的任一个)或非跨属性预测模式(预测模式0)。Exemplarily, if the current point allows the use of a cross-attribute prediction mode, the candidate prediction modes include at least: one or more candidate cross-attribute prediction modes. The candidate prediction modes of the current point include: prediction mode 0 (first prediction mode), prediction mode 1, prediction mode 2, and prediction mode 3. Among them, prediction mode 0 is a non-cross-attribute prediction mode, and prediction mode 1, prediction mode 2, and prediction mode 3 are cross-attribute prediction modes. The first syntax element information is used to indicate the best prediction mode adopted by the current point, wherein the best prediction mode can be a target cross-attribute prediction mode (any one of prediction modes 1 to 3) or a non-cross-attribute prediction mode (prediction mode 0).

情况2、第三语法元素信息指示当前点不允许采用跨属性预测模式。Case 2: The third syntax element information indicates that the cross-attribute prediction mode is not allowed at the current point.

在本申请实施例中,若当前点允许采用跨属性预测模式,则候选预测模式至少包括:一个或多个非跨属性预测模式。当前点的候选预测模式包括:预测模式0、预测模式1、预测模式2和预测模式3。其中,预测模式0~3均为非跨属性预测模式。In this embodiment of the present application, if the current point allows the use of a cross-attribute prediction mode, the candidate prediction modes include at least one or more non-cross-attribute prediction modes. The candidate prediction modes for the current point include: prediction mode 0, prediction mode 1, prediction mode 2, and prediction mode 3. Prediction modes 0 to 3 are all non-cross-attribute prediction modes.

示例性的,以当前点的待编码属性为亮度为例,当前点的候选预测模式包括:预测模式0、预测模式1、预测模式2和预测模式3。预测模式0指示利用当前点的3个近邻点的亮度重建值的加权平均亮度重建值作为当前点的亮度预测值。预测模式1指示利用当前点的第1个近邻点的亮度重建值,确定当前点的亮度预测值。预测模式2指示利用当前点的第2个近邻点的亮度重建值,确定当前点的亮度预测值。预测模式3致死利用当前点的第3个近邻点的亮度重建值,确定当前点的亮度预测值。进一步,编码器根据预测模式0、预测模式1、预测模式2和预测模式3对应的当前点的亮度预测值进行编码决策,确定当前点的最佳预测模式。Exemplarily, taking the attribute to be encoded of the current point as brightness as an example, the candidate prediction modes of the current point include: prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3. Prediction mode 0 indicates that the weighted average brightness reconstruction value of the brightness reconstruction values of the three neighboring points of the current point is used as the brightness prediction value of the current point. Prediction mode 1 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the first neighboring point of the current point. Prediction mode 2 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the second neighboring point of the current point. Prediction mode 3 indicates that the brightness prediction value of the current point is determined by using the brightness reconstruction value of the third neighboring point of the current point. Further, the encoder makes an encoding decision based on the brightness prediction value of the current point corresponding to prediction mode 0, prediction mode 1, prediction mode 2 and prediction mode 3 to determine the best prediction mode for the current point.

在本申请的一些实施例中,该编码方法还包括:In some embodiments of the present application, the encoding method further includes:

若当前点允许采用跨属性预测模式,则确定第三语法元素信息的取值为第三值;或者,If the cross-attribute prediction mode is allowed at the current point, determining the value of the third syntax element information to be a third value; or

若当前点不允许采用跨属性预测模式,则确定第三语法元素信息的取值为第四值。If the cross-attribute prediction mode is not allowed at the current point, the value of the third syntax element information is determined to be the fourth value.

在本申请实施例中,第三语法元素信息用于指示当前点是否允许采用跨属性预测模式。In the embodiment of the present application, the third syntax element information is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

示例性的,第三语法元素信息可以是在属性参数APS的标志位,第三法元素信息可以表示为crosstype_enable_flag,用于指示当前点是否允许采用跨属性预测模式。Exemplarily, the third syntax element information may be a flag in the attribute parameter APS, and the third syntax element information may be expressed as crosstype_enable_flag, which is used to indicate whether the cross-attribute prediction mode is allowed at the current point.

需要说明的是,在本申请实施例中,第三值与第四值不同,而且第三值和第四值可以是参数形式,也可以是数字形式。具体地,第三语法标识信息可以是写入在概述(profile)中的参数,也可以是一个标志(flag)的取值,这里对此不作具体限定。It should be noted that in the embodiment of the present application, the third value is different from the fourth value, and the third value and the fourth value can be in parameter form or in numerical form. Specifically, the third syntax identification information can be a parameter written in the profile or a flag value, which is not specifically limited here.

示例性地,对于第三值和第四值而言,第三值可以设置为1,第四值可以设置为0;或者,第三值可以设置为0,第四值可以设置为1;或者,第三值可以设置为true,第四值可以设置为false;或者,第三值可以设置为false,第四值可以设置为true;但是这里并不作具体限定。Exemplarily, for the third value and the fourth value, the third value can be set to 1 and the fourth value can be set to 0; or, the third value can be set to 0 and the fourth value can be set to 1; or, the third value can be set to true and the fourth value can be set to false; or, the third value can be set to false and the fourth value can be set to true; but this is not specifically limited here.

在本申请实施例中,以写入码流中的flag为例,假设第三值设置为1(true),第四值设置为0(false),这时候如果第三语法标识信息的取值为0(false),那么可以确定当前点不允许采用跨属性预测模式;如果第三语法标识信息的取值为1(true),那么可以确定当前点允许采用跨属性预测模式。In an embodiment of the present application, taking the flag written into the bitstream as an example, assuming that the third value is set to 1 (true) and the fourth value is set to 0 (false), if the value of the third syntax identification information is 0 (false), then it can be determined that the cross-attribute prediction mode is not allowed at the current point; if the value of the third syntax identification information is 1 (true), then it can be determined that the cross-attribute prediction mode is allowed at the current point.

下面在一个具体的实施例中对本申请提供的编解码方法进行解释。The encoding and decoding method provided by this application is explained below in a specific embodiment.

本申请实施例提供的编解码方法也称为单邻居跨属性预测的PT编码改进方法,如图12所示,确定最佳预测模式的流程包括S21至S29:The encoding and decoding method provided in the embodiment of the present application is also called an improved PT encoding method for single-neighbor cross-attribute prediction. As shown in FIG12 , the process of determining the optimal prediction mode includes S21 to S29:

S21、计算3个候选邻居的最大属性差值。S21. Calculate the maximum attribute difference of the three candidate neighbors.

在一些实施例中,LoD构建完成以后,根据LoD的生成顺序,首先从已编码的数据点中找到当前待编码点的三个最近邻点。将这三个最近邻点(3近邻点)的属性重建值,作为当前待编码点的候选预测值。In some embodiments, after the LoD is constructed, the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the LoD generation order. The attribute reconstructed values of these three nearest neighboring points (3 nearest neighboring points) are used as candidate prediction values for the current point to be encoded.

S22、最大属性差值是否大于预设阈值。S22: Whether the maximum attribute difference is greater than a preset threshold.

在一些实施例中,计算三个候选邻居的最大属性差值max_difference,如果最大属性差值大于预设阈值(自适应阈值adaptive_threshold),则执行23,若最大属性差值小于或等于预设阈值(自适应阈值adaptive_threshold),则执行S24。In some embodiments, the maximum attribute difference max_difference of the three candidate neighbors is calculated. If the maximum attribute difference is greater than a preset threshold (adaptive threshold adaptive_threshold), step 23 is executed. If the maximum attribute difference is less than or equal to the preset threshold (adaptive threshold adaptive_threshold), step S24 is executed.

S23、分别计算3近邻点两种属性的相关系数s。S23. Calculate the correlation coefficient s of the two attributes of the three nearest neighbor points respectively.

S24、最佳预测模式=0。S24, optimal prediction mode = 0.

在一些实施例中,如果max_difference的值小于自适应阈值adaptive_threshold,则认为三个邻居点是与被预测点属性值相近的,因此采用模式0加权预测。In some embodiments, if the value of max_difference is less than the adaptive threshold adaptive_threshold, the three neighboring points are considered to have attribute values close to the predicted point, and thus mode 0 weighted prediction is adopted.

S25、利用相关系数重新计算模式1~3的属性预测值。S25. Recalculate the attribute prediction values of patterns 1 to 3 using the correlation coefficient.

S26、利用RDO计算预测模式0~3的分数。 S26. Calculate the scores of prediction modes 0 to 3 using RDO.

在一些实施例中,如果max_difference的值大于自适应阈值adaptive_threshold,则根据率失真优化(Rate-Distortion Optimal,RDO)从中选择最优的预测值。计算模式0~3的得分,并寻找最小代价得分作为最佳预测模式。In some embodiments, if the value of max_difference is greater than the adaptive threshold adaptive_threshold, the optimal prediction value is selected according to Rate-Distortion Optimal (RDO). The scores of modes 0 to 3 are calculated, and the minimum cost score is found as the optimal prediction mode.

S27、找到最小分数。S27. Find the minimum score.

在一些实施例中,将模式0~3的得分中的最小代价得分对应的模式作为最佳预测模式。In some embodiments, the mode corresponding to the minimum cost score among the scores of modes 0 to 3 is taken as the best prediction mode.

S28、设置最佳预测模式。S28. Set the optimal prediction mode.

S29、最佳预测模式=0~3。S29, optimal prediction mode = 0 to 3.

在本申请实施例中,在当前的预测变换(Predicting Transform,PT)编码方案中,LoD构建完成以后,根据LoD的生成顺序,首先从已编码的数据点中找到当前待编码点的三个最近邻点。随后计算三个候选邻居的最大属性差值max_difference,如果max_difference的值小于自适应阈值,则认为三个邻居点是与被预测点属性值相近的,因此采用模式0加权预测;如果max_difference的值大于自适应阈值,则根据RDO从4种预测模式中选择最优的预测值:其中模式0为平均预测,模式1、2、3分别为将这三个最近邻点的属性重建值,作为当前待编码点的属性预测值。当多属性点云的一种属性信息已经编码完成时,将预测模式1、2、3修改为利用每个最近邻点的两种属性间的相关关系,作为当前点两种属性的相关关系(相当于相关系数),从而能够使用当前点已编码好的第一种属性值(相当于当前点的待解码属性的属性参考值),对当前点第二种待编码属性值(相当于当前点的待解码属性的属性预测值)进行预测。In an embodiment of the present application, in the current Predicting Transform (PT) coding scheme, after the LoD is constructed, the three nearest neighboring points of the current point to be encoded are first found from the encoded data points according to the generation order of the LoD. The maximum attribute difference max_difference of the three candidate neighbors is then calculated. If the value of max_difference is less than the adaptive threshold, the three neighboring points are considered to be close to the attribute values of the predicted point, and thus mode 0 weighted prediction is adopted. If the value of max_difference is greater than the adaptive threshold, the optimal prediction value is selected from four prediction modes according to RDO: mode 0 is average prediction, and modes 1, 2, and 3 respectively reconstruct the attribute values of the three nearest neighboring points as the attribute prediction value of the current point to be encoded. When one attribute information of the multi-attribute point cloud has been encoded, the prediction modes 1, 2, and 3 are modified to use the correlation between the two attributes of each nearest neighbor point as the correlation between the two attributes of the current point (equivalent to the correlation coefficient), so that the first attribute value encoded at the current point (equivalent to the attribute reference value of the attribute to be decoded at the current point) can be used to predict the second attribute value to be encoded at the current point (equivalent to the attribute prediction value of the attribute to be decoded at the current point).

在当前的PT编码方案中,如表1所示,预测模式1~3直接将当前点的三个最近邻点的属性重建值,作为当前待编码点的属性预测值。由于点云的亮度信息与反射率信息具有相关性,特别是近邻点之间,两种属性的相关关系是大致相同的。假如点云的亮度信息已经编码好,则使用跨属性预测去除冗余,当前待预测点的反射率值可表示为:其中Coeffref和Coeffluma分别代表当前点的反射率值和亮度值,s为相关系数。本申请把预测模式1~3分别替换为计算当前点的三个最近邻点亮度重建值和反射率重建值的相关系数,随后将这三个相关系数作为当前点的属性相关系数,从而实现单邻居指导跨属性预测的目的。因此属性编码的改进预测模式修改如表3所示。邻居节点的亮度和反射率的相关系数计算可表示为:其中分别代表第i个邻居的重建反射率值和亮度值,si表示第i个邻居亮度和反射率属性的相关系数。In the current PT encoding scheme, as shown in Table 1, prediction modes 1 to 3 directly use the attribute reconstruction values of the three nearest neighbors of the current point as the attribute prediction value of the current point to be encoded. Since the brightness information and reflectivity information of the point cloud are correlated, especially between neighboring points, the correlation between the two attributes is roughly the same. If the brightness information of the point cloud has already been encoded, cross-attribute prediction is used to remove redundancy. The reflectivity value of the current point to be predicted can be expressed as: Where Coeff ref and Coeff luma represent the reflectivity value and brightness value of the current point respectively, and s is the correlation coefficient. This application replaces prediction modes 1 to 3 with the correlation coefficients of the brightness reconstruction values and reflectivity reconstruction values of the three nearest neighboring points of the current point, and then uses these three correlation coefficients as the attribute correlation coefficients of the current point, thereby achieving the purpose of single neighbor guidance cross-attribute prediction. Therefore, the improved prediction mode modification of attribute coding is shown in Table 3. The calculation of the correlation coefficient of the brightness and reflectivity of the neighboring nodes can be expressed as: in and represent the reconstructed reflectance value and brightness value of the ith neighbor, respectively, and si represents the correlation coefficient of the brightness and reflectance attributes of the ith neighbor.

在本申请实施例中,在编码端的操作流程如图13所示,以亮度(相当于第一属性)预测反射率(相当于第二属性)为例,原始点云的亮度信息按照原来的模式编码,待亮度属性编码完成后,对于反射率,首先根据LoD的生成顺序,首先从已编码的数据点(当前点的近邻点)中找到当前待编码点(当前点)的三个最近邻点(3个近邻点)。随后计算三个最近邻点的最大属性距离(最大属性差值),若满足最大属性距离小于自适应阈值(预设阈值),则选择预测模式0(第一预测模式)的平均预测;若最大属性距离大于自适应阈值,则分别计算三个最近邻点的亮度与属性信息的相关系数s(第一系数),随后利用当前待编码点的亮度信息(亮度重建值),和计算所得的相关系数s,计算反射率的预测值(当前点的反射率预测值),利用RDO技术选择最佳预测值,对预测残差(当前点反射率预测残差)进行量化,熵编码,形成属性码流。In the embodiment of the present application, the operation flow at the encoding end is shown in FIG13. Taking brightness (equivalent to the first attribute) as an example to predict reflectivity (equivalent to the second attribute), the brightness information of the original point cloud is encoded according to the original mode. After the brightness attribute encoding is completed, for the reflectivity, first, according to the generation order of LoD, first find the three nearest neighboring points (3 nearest neighboring points) of the current point to be encoded (current point) from the encoded data points (the nearest neighboring points of the current point). Then calculate the maximum attribute distance (maximum attribute difference) of the three nearest neighboring points. If the maximum attribute distance is less than the adaptive threshold (preset threshold), select the average prediction of prediction mode 0 (first prediction mode); if the maximum attribute distance is greater than the adaptive threshold, calculate the correlation coefficient s (first coefficient) of the brightness and attribute information of the three nearest neighboring points respectively. Then use the brightness information of the current point to be encoded (brightness reconstruction value) and the calculated correlation coefficient s to calculate the predicted value of the reflectivity (the predicted value of the reflectivity of the current point). Use RDO technology to select the best predicted value, quantize the prediction residual (the predicted residual of the reflectivity of the current point), entropy code, and form an attribute code stream.

在本申请实施例中,未改变原始的码流结构,仅在属性参数APS中增添标志位crosstype_enable_flag(相当于第三语法元素信息),并编码。其值为1表示开始允许跨属性预测,其值为0表示禁用跨属性预测。In the embodiment of the present application, the original code stream structure is not changed, and only the flag crosstype_enable_flag (equivalent to the third syntax element information) is added to the attribute parameter APS and encoded. Its value is 1 to enable cross-attribute prediction, and its value is 0 to disable cross-attribute prediction.

在本申请实施例中,在解码端的操作流程如图14所示,以亮度(相当于第一属性)预测反射率(相当于第二属性)为例,原始点云的亮度信息按照原来的模式解码,待亮度属性解码重建完成后,对于反射率,解码端读取属性码流,首先通过熵解码,解出属性量化残差,对解码的量化残差进行反量化,得到属性残差(反射率预测残差)。随后根据已经生成的LoD顺序,从已解码重建完成的数据点(当前点的近邻点)中找到当前点的三个最近邻点(3个近邻点)。随后计算三个最近邻点的最大属性距离(最大属性差值),若满足最大属性距离小于自适应阈值(预设阈值),则推测预测模式为0(第一预测模式)的平均预测;若最大属性距离大于自适应阈值,则从码流中解码出最佳预测模式i(第一语法元素信息),若i的值为1~3,则计算第i个邻居(目标近邻点)亮度和反射率的相关系数(第一系数),随后利用当前点的亮度信息(当前点的亮度重建值),与相关系数s(第一系数),计算出反射率的预测值(当前点的反射率预测值)。得到属性预测值(当前点的反射率预测值)之后,与反量化得到的属性残差(当前点的反射率预测残差)相加,得到真实的重建属性值(当前点的反射率重建值),当前点的反射率信息解码完成。依次遍历所有点集,直到所有点的反射率信息全部重建完成。In the embodiment of the present application, the operation process at the decoding end is shown in Figure 14. Taking brightness (equivalent to the first attribute) to predict reflectivity (equivalent to the second attribute) as an example, the brightness information of the original point cloud is decoded according to the original mode. After the brightness attribute decoding and reconstruction are completed, for reflectivity, the decoding end reads the attribute code stream, first solves the attribute quantization residual through entropy decoding, and dequantizes the decoded quantization residual to obtain the attribute residual (reflectivity prediction residual). Then, according to the generated LoD order, the three nearest neighbors (3 neighboring points) of the current point are found from the decoded and reconstructed data points (the neighboring points of the current point). The maximum attribute distance (maximum attribute difference) between the three nearest neighbor points is then calculated. If the maximum attribute distance is less than an adaptive threshold (preset threshold), the prediction mode is inferred to be the average prediction of 0 (the first prediction mode). If the maximum attribute distance is greater than the adaptive threshold, the optimal prediction mode i (the first syntax element information) is decoded from the bitstream. If the value of i is 1 to 3, the correlation coefficient (the first coefficient) between the brightness and reflectivity of the i-th neighbor (the target neighbor point) is calculated. The reflectivity prediction value (the current point's reflectivity prediction value) is then calculated using the current point's brightness information (the current point's brightness reconstruction value) and the correlation coefficient s (the first coefficient). After obtaining the attribute prediction value (the current point's reflectivity prediction value), it is added to the attribute residual obtained by inverse quantization (the current point's reflectivity prediction residual) to obtain the true reconstructed attribute value (the current point's reflectivity reconstruction value). The reflectivity information decoding of the current point is completed. This process is repeated through all point sets until the reflectivity information of all points is fully reconstructed.

在本申请的案例中,解码端的程序具体实现如下所示,若距离(最大属性差值)大于自适应阈值(预 设阈值),则从码流中解码出最佳预测模式i,若i的值为1~3,则计算第i个邻居亮度和反射率的相关系数,随后利用当前点的亮度信息与目标近邻点的相关系数s(第一系数),计算出反射率的预测值。计算过程体现在解码端函数predictReflectance中,程序中s即为第i个邻居(目标近邻点)亮度和反射率关系的相关系数。
In the case of this application, the specific implementation of the decoding end program is as follows: if the distance (maximum attribute difference) is greater than the adaptive threshold (predicted value), (a threshold is set), the optimal prediction mode i is decoded from the bitstream. If the value of i is 1 to 3, the correlation coefficient between the brightness and reflectivity of the i-th neighbor is calculated. The predicted reflectivity is then calculated using the brightness information of the current point and the correlation coefficient s (the first coefficient) of the target neighbor. This calculation process is implemented in the decoder function predictReflectance, where s is the correlation coefficient between the brightness and reflectivity of the i-th neighbor (the target neighbor).

在本申请实施例中,在G-PCC参考软件TMC13 V24.0,在CTC-C1、CTC-C2测试条件下进行了测试,所用配置条件为octree-predcting,r01,r02,r03码率。与原PT方案相比,本申请在TMC13、CTC-C1测试条件下Am-fused average数据集Reflectance分量上获得了-2.9%的增益,在CTC-C2测试条件下Am-fused average数据集Reflectance分量上获得了-3.0%的增益。同时,本申请没有改变G-PCC运行的时间复杂度。其中,C1条件为几何无损、属性有损编码方式(lossless geometry,lossy attribute),C2条件为几何有损、属性有损编码方式(lossy geometry,lossy attribute)。End-to-End BD-AttrRate表示端到端属性值针对属性码流的BD-Rate。BD-Rate反映的是两种情况下(有无滤波)PSNR曲线的差异,BD-Rate减少时,表示在PSNR相等的情况下,码率减少,性能提高;反之性能下降。即BD-Rate下降越多则压缩效果越好。Am-fused average数据集代表融合点云数据集,Overall average为所有序列测试效果的平均值。In this embodiment, tests were conducted using the G-PCC reference software TMC13 V24.0 under the CTC-C1 and CTC-C2 test conditions, using octree-predicting and bitrates of r01, r02, and r03. Compared to the original PT solution, this application achieved a -2.9% gain in the reflectance component of the Am-fused average dataset under the TMC13 and CTC-C1 test conditions, and a -3.0% gain under the CTC-C2 test conditions. Furthermore, this application did not change the runtime complexity of G-PCC. The C1 condition is lossless geometry, lossy attribute coding, while the C2 condition is lossy geometry, lossy attribute coding. End-to-End BD-AttrRate represents the BD-Rate of the end-to-end attribute value for the attribute bitstream. BD-Rate reflects the difference in PSNR curves between two scenarios (with and without filtering). A decrease in BD-Rate indicates improved performance with a reduced bitrate while maintaining the same PSNR; conversely, performance decreases. The greater the decrease in BD-Rate, the better the compression. The Am-fused average dataset represents the fused point cloud dataset, and Overall average is the average of all sequence test results.

在本申请实施例中,可在LT提升变换(在PT基础上的改进)上仿照相同的相关系数预测方法,进行邻居指导跨属性预测去冗余。In the embodiment of the present application, the same correlation coefficient prediction method can be imitated on the LT lifting transformation (an improvement based on the PT) to perform neighbor-guided cross-attribute prediction redundancy removal.

以上结合附图详细描述了本申请的优选实施方式,但是,本申请并不限于上述实施方式中的具体细节,在本申请的技术构思范围内,可以对本申请的技术方案进行多种简单变型,这些简单变型均属于本申请的保护范围。例如,在上述具体实施方式中所描述的各个具体技术特征,在不矛盾的情况下,可以通过任何合适的方式进行组合,为了避免不必要的重复,本申请对各种可能的组合方式不再另行说明。又例如,本申请的各种不同的实施方式之间也可以进行任意组合,只要其不违背本申请的思想,其同样应当视为本申请所公开的内容。又例如,在不冲突的前提下,本申请描述的各个实施例和/或各个实施例中的技术特征可以和现有技术任意的相互组合,组合之后得到的技术方案也应落入本申请的保护范围。The preferred embodiments of the present application are described in detail above in conjunction with the accompanying drawings. However, the present application is not limited to the specific details in the above embodiments. Within the technical concept of the present application, the technical solution of the present application can be subjected to a variety of simple modifications, and these simple modifications all fall within the scope of protection of the present application. For example, the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, the present application will no longer describe the various possible combinations separately. For another example, the various different embodiments of the present application can also be arbitrarily combined, as long as they do not violate the idea of the present application, they should also be regarded as the contents disclosed in the present application. For another example, under the premise of no conflict, the various embodiments and/or the technical features in each embodiment described in the present application can be arbitrarily combined with the prior art, and the technical solution obtained after the combination should also fall within the scope of protection of the present application.

应理解,在本申请的各种方法实施例中,上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that in the various method embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

在本申请的一实施例中,基于前述实施例相同的发明构思,提供一种码流,所述码流是根据待编码信息进行比特编码生成的;其中,所述待编码信息包括下述至少一项:In one embodiment of the present application, based on the same inventive concept as the aforementioned embodiment, a code stream is provided, wherein the code stream is generated by bit encoding based on information to be encoded; wherein the information to be encoded includes at least one of the following:

第一语法元素信息、第二语法元素信息和第三语法元素信息;所述第一语法元素信息用于指示所述当前点采用的预测模式,所述第二语法元素信息用于指示所述当前点的属性重建顺序,所述第三语法元素信息用于指示所述当前点是否允许采用跨属性预测模式。First syntax element information, second syntax element information, and third syntax element information; the first syntax element information is used to indicate the prediction mode adopted by the current point, the second syntax element information is used to indicate the attribute reconstruction order of the current point, and the third syntax element information is used to indicate whether the current point allows the use of a cross-attribute prediction mode.

在本申请的再一实施例中,基于前述实施例相同的发明构思,参见图15,其示出了本申请实施例提供的一种解码器的组成结构示意图。如图15所示,所述解码器1000包括解码部分1001和第一确定部分1002,其中:In yet another embodiment of the present application, based on the same inventive concept as the aforementioned embodiment, referring to FIG15 , a schematic diagram of the structure of a decoder provided in an embodiment of the present application is shown. As shown in FIG15 , the decoder 1000 includes a decoding part 1001 and a first determining part 1002, wherein:

所述解码部分1001,被配置为解码码流,确定当前点的第一语法元素信息;The decoding part 1001 is configured to decode the code stream and determine the first syntax element information of the current point;

所述第一确定部分1002,被配置为根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻 点的相关系数;根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值。The first determining part 1002 is configured to determine, from the candidate prediction modes, the best prediction mode of the current point as the target cross-attribute prediction mode according to the value of the first grammatical element information; determine one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determine the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points. determining the attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient.

在一些实施例中,所述相关系数表征所述目标近邻点的多个属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between multiple attribute reconstruction values of the target neighboring points.

在一些实施例中,所述相关系数包括第一系数;所述第一确定部分1002,还被配置为根据所述目标近邻点的第一属性重建值和所述目标近邻点的第二属性重建值,确定所述第一系数。In some embodiments, the correlation coefficient includes a first coefficient; the first determining portion 1002 is further configured to determine the first coefficient based on a first attribute reconstruction value of the target neighbor point and a second attribute reconstruction value of the target neighbor point.

在一些实施例中,所述第一系数包括所述目标近邻点的第一属性重建值和所述目标近邻点的第二属性重建值的比值。In some embodiments, the first coefficient includes a ratio of a first attribute reconstructed value of the target neighbor point to a second attribute reconstructed value of the target neighbor point.

在一些实施例中,所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待解码属性为所述第二属性,所述目标近邻点的第一属性重建值为所述目标近邻点第二属性的重建值,所述目标近邻点的第二属性重建值为所述目标近邻点第一属性的重建值,所述待解码属性的属性参考值为所述当前点第一属性的重建值;或者,所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待解码属性为所述第一属性,所述目标近邻点的第一属性重建值为所述目标近邻点第一属性的重建值,所述目标近邻点的第二属性重建值为所述目标近邻点第二属性的重建值,所述待解码属性的属性参考值为所述当前点第二属性的重建值。In some embodiments, when the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the current point; or, when the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the target neighbor point is the reconstruction value of the first attribute of the target neighbor point, the second attribute reconstruction value of the target neighbor point is the reconstruction value of the second attribute of the target neighbor point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the current point.

在一些实施例中,所述相关系数表征所述目标近邻点的属性重建值和所述当前点的属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between the attribute reconstruction value of the target neighbor point and the attribute reconstruction value of the current point.

在一些实施例中,所述相关系数包括第二系数;所述第一确定部分1002,还被配置为根据所述当前点的第一属性重建值和所述目标近邻点的第一属性重建值,确定所述第二系数。In some embodiments, the correlation coefficient includes a second coefficient; the first determining part 1002 is further configured to determine the second coefficient based on the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point.

在一些实施例中,所述第二系数包括所述当前点的第一属性重建值和所述目标近邻点的第一属性重建值的比值。In some embodiments, the second coefficient includes a ratio of the first attribute reconstruction value of the current point to the first attribute reconstruction value of the target neighboring point.

在一些实施例中,所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待解码属性为所述第二属性,所述当前点的第一属性重建值为所述当前点第一属性的重建值,所述目标近邻点的第一属性重建值为所述目标近邻点第一属性的重建值,所述待解码属性的属性参考值为所述目标近邻点第二属性的重建值;或者,所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待解码属性为所述第一属性,所述当前点的第一属性重建值为所述当前点第二属性的重建值,所述目标近邻点的第一属性重建值为所述目标近邻点第二属性的重建值,所述待解码属性的属性参考值为所述目标近邻点第一属性的重建值。In some embodiments, when the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstruction value of the first attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the second attribute of the target neighboring point; or, when the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstruction value of the second attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighboring point.

在一些实施例中,所述解码部分1001,还被配置为解析码流,确定第二语法元素信息。In some embodiments, the decoding part 1001 is further configured to parse the code stream to determine the second syntax element information.

在一些实施例中,所述第一确定部分1002,还被配置为若所述第二语法元素信息的取值为第一值,则确定所述当前点的属性重建顺序为第一属性先于第二属性;或者,若所述第二语法元素信息的取值为第二值,则确定所述当前点的属性重建顺序为第二属性先于第一属性。In some embodiments, the first determining part 1002 is further configured to, if the value of the second grammatical element information is a first value, determine that the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or, if the value of the second grammatical element information is a second value, determine that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute.

在一些实施例中,所述相关系数表征所述目标近邻点的属性重建值和所述当前点的非目标近邻点的属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between the attribute reconstructed value of the target neighbor point and the attribute reconstructed value of the non-target neighbor point of the current point.

在一些实施例中,所述第一确定部分1002,还被配置为将所述当前点的待解码属性的属性参考值和所述相关系数相乘,确定所述待解码属性的属性预测值。In some embodiments, the first determining portion 1002 is further configured to multiply the attribute reference value of the attribute to be decoded at the current point by the correlation coefficient to determine the attribute prediction value of the attribute to be decoded.

在一些实施例中,所述候选预测模式还包括第一预测模式,所述第一确定部分1002,还被配置为根据所述第一语法元素信息的取值,从所述候选预测模式中确定所述当前点的最佳预测模式为所述第一预测模式。In some embodiments, the candidate prediction mode also includes a first prediction mode, and the first determination part 1002 is further configured to determine that the best prediction mode of the current point from the candidate prediction modes is the first prediction mode based on the value of the first syntax element information.

在一些实施例中,所述第一确定部分1002,还被配置为根据所述当前点的M个近邻点各自的已重建属性的属性重建值,确定所述当前点是否满足预设条件;在所述当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行解码码流,确定当前点的第一语法元素信息的步骤;或者,在所述当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定所述当前点采用第二预测模式。In some embodiments, the first determination part 1002 is further configured to determine whether the current point meets a preset condition based on the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point; when the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point meet the preset condition, perform the step of decoding the code stream and determining the first syntax element information of the current point; or, when the attribute reconstruction values of the respective reconstructed attributes of the M neighboring points of the current point do not meet the preset condition, determine that the current point adopts the second prediction mode.

在一些实施例中,M为大于或等于2的正整数;所述预设条件包括:所述M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值;所述已重建属性与所述待解码属性相同。In some embodiments, M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference between the attribute reconstruction values of the reconstructed attributes of the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be decoded.

在一些实施例中,所述第一确定部分1002,还被配置为在确定所述当前点采用所述第二预测模式的情况下,根据所述M个近邻点各自的空间位置以及所述当前点的空间位置,确定所述M个近邻点各自的空间几何权重;根据所述M个近邻点各自的已重建属性的属性重建值和所述M个近邻点各自的空间几何权重,确定所述待解码属性的属性预测值。In some embodiments, the first determination part 1002 is further configured to, when it is determined that the current point adopts the second prediction mode, determine the spatial geometric weights of the M neighboring points according to the spatial positions of the M neighboring points and the spatial position of the current point; and determine the attribute prediction value of the attribute to be decoded according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weights of each of the M neighboring points.

在一些实施例中,所述解码部分1001,还被配置为解码码流,确定第三语法元素信息。In some embodiments, the decoding part 1001 is further configured to decode the code stream and determine third syntax element information.

在一些实施例中,所述第一确定部分1002,还被配置为在所述第三语法元素信息指示所述当前点允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个跨属性预测模式;或者,在 所述第三语法元素信息指示所述当前点不允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个非跨属性预测模式;根据所述第一语法元素信息的取值,从所述一个或多个非跨属性预测模式中确定所述当前点的目标预测模式。In some embodiments, the first determining part 1002 is further configured to determine that the candidate prediction mode includes one or more cross-attribute prediction modes when the third syntax element information indicates that the current point allows the cross-attribute prediction mode; or When the third syntax element information indicates that the current point does not allow the cross-attribute prediction mode, it is determined that the candidate prediction modes include one or more non-cross-attribute prediction modes; and according to the value of the first syntax element information, the target prediction mode of the current point is determined from the one or more non-cross-attribute prediction modes.

在一些实施例中,若所述第三语法元素信息的取值为第三值,则确定所述当前点允许采用跨属性预测模式;或者,若所述第三语法元素信息的取值为第四值,则确定所述当前点不允许采用跨属性预测模式。In some embodiments, if the value of the third syntax element information is a third value, it is determined that the current point allows the use of a cross-attribute prediction mode; or, if the value of the third syntax element information is a fourth value, it is determined that the current point does not allow the use of a cross-attribute prediction mode.

可以理解地,在本申请实施例中,“部分”可以是部分电路、部分处理器、部分程序或软件等等,当然也可以是模块,还可以是非模块化的。而且在本实施例中的各组成部分可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。It is understandable that in the embodiments of the present application, a "part" can be a part of a circuit, a part of a processor, a part of a program or software, etc., and of course it can also be a module, or it can be non-modular. Moreover, the various components in this embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into a single unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional modules.

所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中,基于这样的理解,本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或processor(处理器)执行本实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated unit is implemented in the form of a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment, or the part that contributes to the existing technology, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the method described in this embodiment. The aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

因此,本申请实施例提供了一种计算机可读存储介质,应用于解码器1000,该计算机可读存储介质存储有计算机程序,所述计算机程序被第一处理器执行时实现前述实施例中任一项所述的方法。Therefore, an embodiment of the present application provides a computer-readable storage medium, which is applied to the decoder 1000. The computer-readable storage medium stores a computer program, and when the computer program is executed by the first processor, it implements the method described in any one of the aforementioned embodiments.

基于上述解码器1000的组成以及计算机可读存储介质,参见图16,其示出了本申请实施例提供的解码器1000的具体硬件结构示意图。如图16所示,解码器1000可以包括:第一通信接口1101、第一存储器1102和第一处理器1103;各个组件通过第一总线系统1104耦合在一起。可理解,第一总线系统1104用于实现这些组件之间的连接通信。第一总线系统1104除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图16中将各种总线都标为第一总线系统1104。Based on the above-mentioned components of the decoder 1000 and the computer-readable storage medium, refer to Figure 16, which shows a schematic diagram of the specific hardware structure of the decoder 1000 provided in an embodiment of the present application. As shown in Figure 16, the decoder 1000 may include: a first communication interface 1101, a first memory 1102, and a first processor 1103; these components are coupled together via a first bus system 1104. It will be understood that the first bus system 1104 is used to achieve connection and communication between these components. In addition to including a data bus, the first bus system 1104 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, in Figure 16, all various buses are labeled as the first bus system 1104.

其中,in,

第一通信接口1101,用于在与其他外部网元之间进行收发信息过程中,信号的接收和发送;The first communication interface 1101 is used to receive and send signals when sending and receiving information with other external network elements;

第一存储器1102,用于存储能够在第一处理器1103上运行的计算机程序;A first memory 1102 is used to store computer programs that can be run on the first processor 1103;

第一处理器1103,用于在运行所述计算机程序时,执行:The first processor 1103 is configured to, when running the computer program, execute:

解码码流,确定当前点的第一语法元素信息;Decode the code stream and determine the first syntax element information of the current point;

根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;Determining, according to the value of the first syntax element information, the best prediction mode for the current point from the candidate prediction modes as the target cross-attribute prediction mode;

根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of target neighboring points of the current point according to the target cross-attribute prediction mode;

根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数;Determining a correlation coefficient of the target neighboring point based on one or more attribute reconstruction values of the target neighboring point;

根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值。Determine an attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient.

可以理解,本申请实施例中的第一存储器1102可以是易失性存储器或非易失性存储器,或可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(Read-Only Memory,ROM)、可编程只读存储器(Programmable ROM,PROM)、可擦除可编程只读存储器(Erasable PROM,EPROM)、电可擦除可编程只读存储器(Electrically EPROM,EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory,RAM),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(Static RAM,SRAM)、动态随机存取存储器(Dynamic RAM,DRAM)、同步动态随机存取存储器(Synchronous DRAM,SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM,DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM,ESDRAM)、同步连接动态随机存取存储器(Synchlink DRAM,SLDRAM)和直接内存总线随机存取存储器(Direct Rambus RAM,DRRAM)。本申请描述的系统和方法的第一存储器1102旨在包括但不限于这些和任意其它适合类型的存储器。It is understood that the first memory 1102 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate synchronous DRAM (DDR SDRAM), enhanced synchronous DRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DRRAM). The first memory 1102 of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

而第一处理器1103可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过第一处理器1103中的硬件的集成逻辑电路或者软件形式的指令完成。上述的第一处理器1103可以是通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。可以实现或者执行本申请实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器 等。结合本申请实施例所公开的方法的步骤可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于随机存储器,闪存、只读存储器,可编程只读存储器或者电可擦写可编程存储器、寄存器等本领域成熟的存储介质中。该存储介质位于第一存储器1102,第一处理器1103读取第一存储器1102中的信息,结合其硬件完成上述方法的步骤。The first processor 1103 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the first processor 1103 or the instructions in the form of software. The above-mentioned first processor 1103 can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The various methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor Etc. The steps of the method disclosed in conjunction with the embodiments of this application can be directly implemented as execution by a hardware decoding processor, or can be implemented using a combination of hardware and software modules within the decoding processor. The software module can be located in a storage medium well-established in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the first memory 1102, and the first processor 1103 reads the information in the first memory 1102 and, in conjunction with its hardware, completes the steps of the above method.

可以理解的是,本申请描述的这些实施例可以用硬件、软件、固件、中间件、微码或其组合来实现。对于硬件实现,处理单元可以实现在一个或多个专用集成电路(Application Specific Integrated Circuits,ASIC)、数字信号处理器(Digital Signal Processing,DSP)、数字信号处理设备(DSP Device,DSPD)、可编程逻辑设备(Programmable Logic Device,PLD)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、通用处理器、控制器、微控制器、微处理器、用于执行本申请所述功能的其它电子单元或其组合中。对于软件实现,可通过执行本申请所述功能的模块(例如过程、函数等)来实现本申请所述的技术。软件代码可存储在存储器中并通过处理器执行。存储器可以在处理器中或在处理器外部实现。It is understood that the embodiments described in this application can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in this application, or a combination thereof. For software implementation, the technology described in this application can be implemented by modules (such as processes, functions, etc.) that perform the functions described in this application. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

可选地,作为另一个实施例,第一处理器1103还配置为在运行所述计算机程序时,执行前述实施例中任一项所述的方法。Optionally, as another embodiment, the first processor 1103 is further configured to execute any one of the methods described in the foregoing embodiments when running the computer program.

在本申请的再一实施例中,基于前述实施例相同的发明构思,参见图17,其示出了本申请实施例提供的一种编码器的组成结构示意图。如图17所示,该编码器2000可以包括第二确定部分2001和编码部分2002;其中,In another embodiment of the present application, based on the same inventive concept as the above embodiment, see FIG17 , which shows a schematic diagram of the composition structure of an encoder provided by an embodiment of the present application. As shown in FIG17 , the encoder 2000 may include a second determining part 2001 and an encoding part 2002; wherein,

所述第二确定部分2001,被配置为从候选预测模式中确定所述当前点的候选跨属性预测模式;根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值;根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;The second determining part 2001 is configured to determine a candidate cross-attribute prediction mode for the current point from the candidate prediction modes; determine one or more attribute reconstruction values of candidate neighboring points of the current point based on the candidate cross-attribute prediction mode; determine the correlation coefficient of the candidate neighboring points based on the one or more attribute reconstruction values of the candidate neighboring points; determine the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; make a coding decision based on the attribute prediction values of the attribute to be encoded at the current point corresponding to the one or more candidate cross-attribute prediction modes, and determine the best prediction mode for the current point as the target cross-attribute prediction mode; and determine the value of the first syntax element information of the current point based on the best prediction mode;

所述编码部分2002,被配置为对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The encoding part 2002 is configured to perform encoding processing on the first syntax element information and write the obtained encoded bits into a bitstream.

在一些实施例中,所述相关系数表征所述候选近邻点的多个属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between multiple attribute reconstruction values of the candidate neighboring points.

在一些实施例中,所述相关系数包括第一系数;所述第二确定部分2001,还被配置为根据所述候选近邻点的第一属性重建值和所述候选近邻点的第二属性重建值,确定所述第一系数。In some embodiments, the correlation coefficient includes a first coefficient; the second determining part 2001 is further configured to determine the first coefficient according to the first attribute reconstruction value of the candidate neighbor point and the second attribute reconstruction value of the candidate neighbor point.

在一些实施例中,所述第一系数包括所述候选近邻点的第一属性重建值和所述候选近邻点的第二属性重建值的比值。In some embodiments, the first coefficient includes a ratio of a first attribute reconstruction value of the candidate neighbor point to a second attribute reconstruction value of the candidate neighbor point.

在一些实施例中,所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待编码属性为所述第二属性,所述候选近邻点的第一属性重建值为所述候选近邻点第二属性的重建值,所述候选近邻点的第二属性重建值为所述候选近邻点第一属性的重建值,所述待编码属性的属性参考值为所述当前点第一属性的重建值;或者,所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待编码属性为所述第一属性,所述候选近邻点的第一属性重建值为所述候选近邻点第一属性的重建值,所述候选近邻点的第二属性重建值为所述候选近邻点第二属性的重建值,所述待编码属性的属性参考值为所述当前点第二属性的重建值。In some embodiments, when the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be encoded is the second attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point, and the attribute reference value of the attribute to be encoded is the reconstruction value of the first attribute of the current point; or, when the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be encoded is the first attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstruction value of the first attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstruction value of the second attribute of the candidate neighbor point, and the attribute reference value of the attribute to be encoded is the reconstruction value of the second attribute of the current point.

在一些实施例中,所述相关系数表征所述候选近邻点的属性重建值和所述当前点的属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between the attribute reconstruction value of the candidate neighbor point and the attribute reconstruction value of the current point.

在一些实施例中,所述相关系数包括第二系数;所述第二确定部分2001,还被配置为根据所述当前点的第一属性重建值和所述候选近邻点的第一属性重建值,确定所述第二系数。In some embodiments, the correlation coefficient includes a second coefficient; the second determination part 2001 is further configured to determine the second coefficient according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point.

在一些实施例中,所述第二系数包括所述当前点的第一属性重建值和所述候选近邻点的第一属性重建值的比值。In some embodiments, the second coefficient includes a ratio of the first attribute reconstruction value of the current point to the first attribute reconstruction value of the candidate neighboring point.

在一些实施例中,所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待编码属性为所述第二属性,所述当前点的第一属性重建值为所述当前点第一属性的重建值,所述候选近邻点的第一属性重建值为所述候选近邻点第一属性的重建值,所述待编码属性的属性参考值为所述候选近邻点第二属性的重建值;或者,所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待编码属性为所述第一属性,所述当前点的第一属性重建值为所述当前点第二属性的重建值,所述候选近邻点的第一属性重建值为所述候选近邻点第二属性的重建值,所述待编码属性的属性参考值为所述候选近邻点第一属性的重建值。In some embodiments, when the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be encoded is the second attribute, the first attribute reconstruction value of the current point is the reconstruction value of the first attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the first attribute of the candidate neighboring point, and the attribute reference value of the attribute to be encoded is the reconstruction value of the second attribute of the candidate neighboring point; or, when the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be encoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the second attribute of the candidate neighboring point, and the attribute reference value of the attribute to be encoded is the reconstruction value of the first attribute of the candidate neighboring point.

在一些实施例中,所述第二确定部分2001,还被配置为确定第二语法元素信息;若所述第二语法元素信息的取值为第一值,则确定所述当前点的属性重建顺序为第一属性先于第二属性;或者,若所述第二语法元素信息的取值为第二值,则确定所述当前点的属性重建顺序为第二属性先于第一属性。 In some embodiments, the second determination part 2001 is further configured to determine second grammatical element information; if the value of the second grammatical element information is a first value, the attribute reconstruction order of the current point is determined to be the first attribute before the second attribute; or, if the value of the second grammatical element information is a second value, the attribute reconstruction order of the current point is determined to be the second attribute before the first attribute.

在一些实施例中,所述编码部分2002,还被配置为将所述第二语法标识信息进行编码处理,将所得到的编码比特写入码流。In some embodiments, the encoding part 2002 is further configured to encode the second syntax identification information and write the obtained encoded bits into a bitstream.

在一些实施例中,所述相关系数表征所述候选近邻点的属性重建值和所述当前点的非候选近邻点的属性重建值之间的相关性。In some embodiments, the correlation coefficient represents the correlation between the attribute reconstruction values of the candidate neighboring points and the attribute reconstruction values of the non-candidate neighboring points of the current point.

在一些实施例中,所述第二确定部分2001,还被配置为将所述当前点的待编码属性的属性参考值和所述相关系数相乘,确定所述待编码属性的属性预测值。In some embodiments, the second determining portion 2001 is further configured to multiply the attribute reference value of the attribute to be encoded at the current point by the correlation coefficient to determine the attribute prediction value of the attribute to be encoded.

在一些实施例中,所述候选预测模式还包括第一预测模式,所述第二确定部分2001,还被配置为从所述候选预测模式中确定所述当前点的所述第一预测模式;根据所述第一预测模式,确定所述当前点的待编码属性的属性预测值;根据所述一个或多个候选跨属性预测模式和所述第一预测模式各自对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为所述第一预测模式。In some embodiments, the candidate prediction mode also includes a first prediction mode, and the second determination part 2001 is further configured to determine the first prediction mode of the current point from the candidate prediction mode; determine the attribute prediction value of the attribute to be encoded of the current point based on the first prediction mode; make an encoding decision based on the attribute prediction value of the attribute to be encoded of the current point corresponding to each of the one or more candidate cross-attribute prediction modes and the first prediction mode, and determine that the best prediction mode of the current point is the first prediction mode.

在一些实施例中,所述第二确定部分2001,还被配置为根据所述当前点的M个近邻点各自的已重建属性的属性重建值,确定所述当前点是否满足预设条件;在所述当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行从候选预测模式中确定所述当前点的候选跨属性预测模式的步骤,或者,在所述当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定所述当前点采用第二预测模式。In some embodiments, the second determination part 2001 is further configured to determine whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point; when the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point meet the preset condition, perform the step of determining the candidate cross-attribute prediction mode of the current point from the candidate prediction modes, or, when the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point do not meet the preset condition, determine that the current point adopts the second prediction mode.

在一些实施例中,M为大于或等于2的正整数;所述预设条件包括:所述M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值;所述已重建属性与所述待编码属性相同。In some embodiments, M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference of the attribute reconstruction values of the reconstructed attributes between the M neighboring points is greater than or equal to a preset threshold; the reconstructed attribute is the same as the attribute to be encoded.

在一些实施例中,所述第二确定部分2001,还被配置为在确定所述当前点采用所述第二预测模式的情况下,根据所述M个近邻点各自的空间位置以及所述当前点的空间位置,确定所述M个近邻点各自的空间几何权重;根据所述M个近邻点各自的已重建属性的属性重建值和所述M个近邻点各自的空间几何权重,确定所述待编码属性的属性预测值。In some embodiments, the second determination part 2001 is further configured to, when it is determined that the current point adopts the second prediction mode, determine the spatial geometric weights of the M neighboring points according to the spatial positions of the M neighboring points and the spatial position of the current point; and determine the attribute prediction value of the attribute to be encoded according to the attribute reconstruction value of the reconstructed attribute of each of the M neighboring points and the spatial geometric weights of each of the M neighboring points.

在一些实施例中,所述第二确定部分2001,还被配置为确定第三语法元素信息;在所述第三语法元素信息指示所述当前点允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个跨属性预测模式;或者,在所述第三语法元素信息指示所述当前点禁止跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个非跨属性预测模式;根据所述一个或多个非跨属性预测模式,确定所述当前点的一个或多个属性预测值;根据所述当前点的一个或多个属性预测值编码决策,确定所述当前点采用的最佳预测模式;根据所述最佳预测模式,确定所述第一语法元素信息的取值。In some embodiments, the second determination part 2001 is further configured to determine third syntax element information; when the third syntax element information indicates that the current point allows the use of a cross-attribute prediction mode, determine that the candidate prediction mode includes one or more cross-attribute prediction modes; or, when the third syntax element information indicates that the current point prohibits the use of a cross-attribute prediction mode, determine that the candidate prediction mode includes one or more non-cross-attribute prediction modes; determine one or more attribute prediction values of the current point based on the one or more non-cross-attribute prediction modes; determine the optimal prediction mode adopted by the current point based on the encoding decision of the one or more attribute prediction values of the current point; and determine the value of the first syntax element information based on the optimal prediction mode.

在一些实施例中,所述编码部分2002,还被配置为对第三语法标识信息进行编码处理,将所得到的编码比特写入码流。In some embodiments, the encoding part 2002 is further configured to perform encoding processing on the third syntax identification information and write the obtained encoded bits into the bitstream.

可以理解地,在本实施例中,“部分”可以是部分电路、部分处理器、部分程序或软件等等,当然也可以是模块,还可以是非模块化的。而且在本实施例中的各组成部分可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。It is understood that in this embodiment, a "portion" may be a circuit portion, a processor portion, a program portion, or software portion, and may also be a module or non-modular. Furthermore, the various components in this embodiment may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional modules.

所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本实施例提供了一种计算机可读存储介质,应用于编码器2000,该计算机可读存储介质存储有计算机程序,所述计算机程序被第二处理器执行时实现前述实施例中任一项所述的方法。If the integrated unit is implemented as a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, this embodiment provides a computer-readable storage medium, which is applied to the encoder 2000 and stores a computer program. When the computer program is executed by the second processor, it implements any of the methods in the aforementioned embodiments.

基于上述编码器2000的组成以及计算机可读存储介质,参见图18,其示出了本申请实施例提供的编码器2000的具体硬件结构示意图。如图18所示,编码器2000可以包括:第二通信接口2101、第二存储器2102和第二处理器2103;各个组件通过第二总线系统2104耦合在一起。可理解,第二总线系统2104用于实现这些组件之间的连接通信。第二总线系统2104除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。但是为了清楚说明起见,在图18中将各种总线都标为第二总线系统2104。其中,Based on the composition of the above-mentioned encoder 2000 and the computer-readable storage medium, refer to Figure 18, which shows a specific hardware structure diagram of the encoder 2000 provided in an embodiment of the present application. As shown in Figure 18, the encoder 2000 may include: a second communication interface 2101, a second memory 2102 and a second processor 2103; each component is coupled together through a second bus system 2104. It can be understood that the second bus system 2104 is used to realize the connection and communication between these components. In addition to the data bus, the second bus system 2104 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, various buses are marked as the second bus system 2104 in Figure 18. Among them,

第二通信接口2101,用于在与其他外部网元之间进行收发信息过程中,信号的接收和发送;The second communication interface 2101 is used to receive and send signals during the process of sending and receiving information between other external network elements;

第二存储器2102,用于存储能够在第二处理器2103上运行的计算机程序;The second memory 2102 is used to store computer programs that can be run on the second processor 2103;

第二处理器2103,用于在运行所述计算机程序时,执行:The second processor 2103 is configured to, when running the computer program, execute:

从候选预测模式中确定所述当前点的候选跨属性预测模式;Determining a candidate cross-attribute prediction mode for the current point from candidate prediction modes;

根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of candidate neighboring points of the current point according to the candidate cross-attribute prediction mode;

根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;Determining a correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points;

根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值; Determining an attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient;

根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;Performing a coding decision based on the attribute prediction values of the to-be-coded attribute of the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the best prediction mode of the current point as a target cross-attribute prediction mode;

根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;Determining, according to the optimal prediction mode, a value of the first syntax element information of the current point;

对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The first syntax element information is coded and the obtained coded bits are written into a bitstream.

可选地,作为另一个实施例,第二处理器2103还配置为在运行所述计算机程序时,执行前述实施例中任一项所述的方法。Optionally, as another embodiment, the second processor 2103 is further configured to execute any one of the methods described in the foregoing embodiments when running the computer program.

可以理解,第二存储器2102与第一存储器1102的硬件功能类似,第二处理器2103与第一处理器1103的硬件功能类似;这里不再详述。It can be understood that the hardware functions of the second memory 2102 are similar to those of the first memory 1102, and the hardware functions of the second processor 2103 are similar to those of the first processor 1103; they will not be described in detail here.

在本申请的再一实施例中,参见图19,其示出了本申请实施例提供的一种编解码系统的组成结构示意图。如图19所示,编解码系统3000可以包括解码器3001和编码器3002。In yet another embodiment of the present application, referring to FIG19 , a schematic diagram of the structure of a coding and decoding system provided by an embodiment of the present application is shown. As shown in FIG19 , the coding and decoding system 3000 may include a decoder 3001 and an encoder 3002 .

在本申请实施例中,解码器3001可以是前述实施例中任一项所述的解码器,编码器3002可以是前述实施例中任一项所述的编码器。In the embodiment of the present application, the decoder 3001 may be the decoder described in any one of the aforementioned embodiments, and the encoder 3002 may be the encoder described in any one of the aforementioned embodiments.

需要说明的是,在本申请中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this application, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

本申请所提供的几个方法实施例中所揭露的方法,在不冲突的情况下可以任意组合,得到新的方法实施例。The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

本申请所提供的几个产品实施例中所揭露的特征,在不冲突的情况下可以任意组合,得到新的产品实施例。The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

本申请所提供的几个方法或设备实施例中所揭露的特征,在不冲突的情况下可以任意组合,得到新的方法实施例或设备实施例。The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述本申请实施例的保护范围为准。 The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the embodiments of the present application.

Claims (41)

一种解码方法,应用于解码器,所述方法包括:A decoding method, applied to a decoder, comprising: 解码码流,确定当前点的第一语法元素信息;Decode the code stream and determine the first syntax element information of the current point; 根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;Determining, according to the value of the first syntax element information, the best prediction mode for the current point from the candidate prediction modes as the target cross-attribute prediction mode; 根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of target neighboring points of the current point according to the target cross-attribute prediction mode; 根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数;Determining a correlation coefficient of the target neighboring point based on one or more attribute reconstruction values of the target neighboring point; 根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值。Determine an attribute prediction value of the attribute to be decoded at the current point according to the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient. 根据权利要求1所述的方法,其中,所述相关系数表征所述目标近邻点的多个属性重建值之间的相关性。The method according to claim 1, wherein the correlation coefficient represents the correlation between multiple attribute reconstruction values of the target neighboring points. 根据权利要求2所述的方法,其中,所述相关系数包括第一系数;所述根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数,包括:The method according to claim 2, wherein the correlation coefficient includes a first coefficient; and determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point comprises: 根据所述目标近邻点的第一属性重建值和所述目标近邻点的第二属性重建值,确定所述第一系数。The first coefficient is determined according to the first attribute reconstruction value of the target neighboring point and the second attribute reconstruction value of the target neighboring point. 根据权利要求3所述的方法,其中,所述第一系数包括所述目标近邻点的第一属性重建值和所述目标近邻点的第二属性重建值的比值。The method according to claim 3, wherein the first coefficient comprises a ratio of a first attribute reconstructed value of the target neighbor point to a second attribute reconstructed value of the target neighbor point. 根据权利要求4所述的方法,其中,The method according to claim 4, wherein 所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待解码属性为所述第二属性,所述目标近邻点的第一属性重建值为所述目标近邻点第二属性的重建值,所述目标近邻点的第二属性重建值为所述目标近邻点第一属性的重建值,所述待解码属性的属性参考值为所述当前点第一属性的重建值;或者,When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the target neighboring point is the reconstructed value of the second attribute of the target neighboring point, the second attribute reconstruction value of the target neighboring point is the reconstructed value of the first attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstructed value of the first attribute of the current point; or 所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待解码属性为所述第一属性,所述目标近邻点的第一属性重建值为所述目标近邻点第一属性的重建值,所述目标近邻点的第二属性重建值为所述目标近邻点第二属性的重建值,所述待解码属性的属性参考值为所述当前点第二属性的重建值。When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the target neighboring point is the reconstructed value of the first attribute of the target neighboring point, the second attribute reconstruction value of the target neighboring point is the reconstructed value of the second attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstructed value of the second attribute of the current point. 根据权利要求1所述的方法,其中,所述相关系数表征所述目标近邻点的属性重建值和所述当前点的属性重建值之间的相关性。The method according to claim 1, wherein the correlation coefficient represents the correlation between the attribute reconstructed value of the target neighbor point and the attribute reconstructed value of the current point. 根据权利要求6所述的方法,其中,所述相关系数包括第二系数;所述根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数,包括:The method according to claim 6, wherein the correlation coefficient includes a second coefficient; and determining the correlation coefficient of the target neighbor point based on one or more attribute reconstruction values of the target neighbor point comprises: 根据所述当前点的第一属性重建值和所述目标近邻点的第一属性重建值,确定第二系数。A second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the target neighboring point. 根据权利要求7所述的方法,其中,所述第二系数包括所述当前点的第一属性重建值和所述目标近邻点的第一属性重建值的比值。The method according to claim 7, wherein the second coefficient comprises a ratio of the first attribute reconstructed value of the current point to the first attribute reconstructed value of the target neighboring point. 根据权利要求8所述的方法,其中,The method according to claim 8, wherein 所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待解码属性为所述第二属性,所述当前点的第一属性重建值为所述当前点第一属性的重建值,所述目标近邻点的第一属性重建值为所述目标近邻点第一属性的重建值,所述待解码属性的属性参考值为所述目标近邻点第二属性的重建值;或者,When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be decoded is the second attribute, the first attribute reconstruction value of the current point is the reconstructed value of the first attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstructed value of the first attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstructed value of the second attribute of the target neighboring point; or 所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待解码属性为所述第一属性,所述当前点的第一属性重建值为所述当前点第二属性的重建值,所述目标近邻点的第一属性重建值为所述目标近邻点第二属性的重建值,所述待解码属性的属性参考值为所述目标近邻点第一属性的重建值。When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be decoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the target neighboring point is the reconstruction value of the second attribute of the target neighboring point, and the attribute reference value of the attribute to be decoded is the reconstruction value of the first attribute of the target neighboring point. 根据权利要求5或9所述的方法,其中,所述方法还包括:The method according to claim 5 or 9, wherein the method further comprises: 解析码流,确定第二语法元素信息;Parsing the code stream to determine the second syntax element information; 若所述第二语法元素信息的取值为第一值,则确定所述当前点的属性重建顺序为第一属性先于第二属性;或者,If the value of the second syntax element information is the first value, determining that the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or 若所述第二语法元素信息的取值为第二值,则确定所述当前点的属性重建顺序为第二属性先于第一属性。If the value of the second syntax element information is the second value, it is determined that the attribute reconstruction order of the current point is that the second attribute precedes the first attribute. 根据权利要求1至10任一项所述的方法,其中,所述相关系数表征所述目标近邻点的属性重建值和所述当前点的非目标近邻点的属性重建值之间的相关性。The method according to any one of claims 1 to 10, wherein the correlation coefficient represents the correlation between the attribute reconstructed value of the target neighbor point and the attribute reconstructed value of the non-target neighbor point of the current point. 根据权利要求1至11任一项所述的方法,其中,所述根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值,包括: The method according to any one of claims 1 to 11, wherein determining the attribute prediction value of the attribute to be decoded at the current point based on the attribute reference value of the attribute to be decoded at the current point and the correlation coefficient comprises: 将所述当前点的待解码属性的属性参考值和所述相关系数相乘,确定所述待解码属性的属性预测值。The attribute reference value of the attribute to be decoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be decoded. 根据权利要求1所述的方法,其中,所述候选预测模式还包括第一预测模式,所述方法还包括:The method according to claim 1, wherein the candidate prediction mode further includes a first prediction mode, and the method further includes: 根据所述第一语法元素信息的取值,从所述候选预测模式中确定所述当前点的最佳预测模式为所述第一预测模式。According to the value of the first syntax element information, the best prediction mode for the current point is determined from the candidate prediction modes as the first prediction mode. 根据权利要求1至13任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 13, wherein the method further comprises: 根据所述当前点的M个近邻点各自的已重建属性的属性重建值,确定所述当前点是否满足预设条件;Determining whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point; 在所述当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行解码码流,确定当前点的第一语法元素信息的步骤;或者,When the reconstructed attribute values of the respective reconstructed attributes of the M neighboring points of the current point meet a preset condition, performing a step of decoding the code stream to determine the first syntax element information of the current point; or 在所述当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定所述当前点采用第二预测模式。When the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point do not meet a preset condition, it is determined that the current point adopts the second prediction mode. 根据权利要求14所述的方法,其中,M为大于或等于2的正整数;所述预设条件包括:所述M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值;所述已重建属性与所述待解码属性相同。The method according to claim 14, wherein M is a positive integer greater than or equal to 2; the preset conditions include: a maximum attribute difference between the attribute reconstruction values of the reconstructed attributes of the M neighboring points is greater than or equal to a preset threshold; and the reconstructed attribute is the same as the attribute to be decoded. 根据权利要求14所述的方法,其中,所述方法还包括:The method according to claim 14, wherein the method further comprises: 在确定所述当前点采用所述第二预测模式的情况下,根据所述M个近邻点各自的空间位置以及所述当前点的空间位置,确定所述M个近邻点各自的空间几何权重;When it is determined that the second prediction mode is adopted for the current point, determining a spatial geometric weight of each of the M neighboring points according to the spatial positions of each of the M neighboring points and the spatial position of the current point; 根据所述M个近邻点各自的已重建属性的属性重建值和所述M个近邻点各自的空间几何权重,确定所述待解码属性的属性预测值。An attribute prediction value of the attribute to be decoded is determined according to the attribute reconstruction value of each of the reconstructed attributes of the M neighboring points and the spatial geometric weight of each of the M neighboring points. 根据权利要求1至16任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 1 to 16, wherein the method further comprises: 解码码流,确定第三语法元素信息;Decoding the code stream to determine third syntax element information; 在所述第三语法元素信息指示所述当前点允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个跨属性预测模式;或者,In a case where the third syntax element information indicates that the current point allows the use of the cross-attribute prediction mode, determining that the candidate prediction modes include one or more cross-attribute prediction modes; or 在所述第三语法元素信息指示所述当前点不允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个非跨属性预测模式;In a case where the third syntax element information indicates that the current point does not allow the cross-attribute prediction mode to be adopted, determining that the candidate prediction modes include one or more non-cross-attribute prediction modes; 根据所述第一语法元素信息的取值,从所述一个或多个非跨属性预测模式中确定所述当前点的最佳预测模式。According to the value of the first syntax element information, the optimal prediction mode for the current point is determined from the one or more non-cross-attribute prediction modes. 根据权利要求17所述的方法,其中,所述方法还包括:The method according to claim 17, wherein the method further comprises: 若所述第三语法元素信息的取值为第三值,则确定所述当前点允许采用跨属性预测模式;或者,If the value of the third syntax element information is the third value, it is determined that the current point allows the cross-attribute prediction mode; or 若所述第三语法元素信息的取值为第四值,则确定所述当前点不允许采用跨属性预测模式。If the value of the third syntax element information is the fourth value, it is determined that the cross-attribute prediction mode is not allowed to be adopted at the current point. 一种编码方法,应用于编码器,所述方法包括:A coding method, applied to an encoder, comprising: 从候选预测模式中确定所述当前点的候选跨属性预测模式;Determining a candidate cross-attribute prediction mode for the current point from candidate prediction modes; 根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;Determining one or more attribute reconstruction values of candidate neighboring points of the current point according to the candidate cross-attribute prediction mode; 根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;Determining a correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points; 根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值;Determining an attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; 根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;Performing a coding decision based on the attribute prediction values of the to-be-coded attribute of the current point corresponding to one or more candidate cross-attribute prediction modes, and determining the best prediction mode of the current point as a target cross-attribute prediction mode; 根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;Determining, according to the optimal prediction mode, a value of the first syntax element information of the current point; 对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The first syntax element information is coded and the obtained coded bits are written into a bitstream. 根据权利要求19所述的方法,其中,所述相关系数表征所述候选近邻点的多个属性重建值之间的相关性。The method according to claim 19, wherein the correlation coefficient represents the correlation between multiple attribute reconstruction values of the candidate neighbor points. 根据权利要求20所述的方法,其中,所述相关系数包括第一系数;所述根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数,包括:The method according to claim 20, wherein the correlation coefficient includes a first coefficient; and determining the correlation coefficient of the candidate neighboring points based on one or more attribute reconstruction values of the candidate neighboring points comprises: 根据所述候选近邻点的第一属性重建值和所述候选近邻点的第二属性重建值,确定所述第一系数。The first coefficient is determined according to the first attribute reconstruction value of the candidate neighbor point and the second attribute reconstruction value of the candidate neighbor point. 根据权利要求21所述的方法,其中,所述第一系数包括所述候选近邻点的第一属性重建值和所述候选近邻点的第二属性重建值的比值。The method according to claim 21, wherein the first coefficient comprises a ratio of a first attribute reconstruction value of the candidate neighbor point to a second attribute reconstruction value of the candidate neighbor point. 根据权利要求22所述的方法,其中,The method according to claim 22, wherein 所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待编码属性为所述第二属性,所述候选近邻点的第一属性重建值为所述候选近邻点第二属性的重建值,所述候选近邻点的第二属性重建值为所述候选近邻点第一属性的重建值,所述待编码属性的属性参考值为所述当前点第一属性的重建值;或者, When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be encoded is the second attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstructed value of the second attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstructed value of the first attribute of the candidate neighbor point, and the attribute reference value of the attribute to be encoded is the reconstructed value of the first attribute of the current point; or 所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待编码属性为所述第一属性,所述候选近邻点的第一属性重建值为所述候选近邻点第一属性的重建值,所述候选近邻点的第二属性重建值为所述候选近邻点第二属性的重建值,所述待编码属性的属性参考值为所述当前点第二属性的重建值。When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be encoded is the first attribute, the first attribute reconstruction value of the candidate neighbor point is the reconstructed value of the first attribute of the candidate neighbor point, the second attribute reconstruction value of the candidate neighbor point is the reconstructed value of the second attribute of the candidate neighbor point, and the attribute reference value of the attribute to be encoded is the reconstructed value of the second attribute of the current point. 根据权利要求19所述的方法,其中,所述相关系数表征所述候选近邻点的属性重建值和所述当前点的属性重建值之间的相关性。The method according to claim 19, wherein the correlation coefficient represents the correlation between the attribute reconstructed value of the candidate neighboring point and the attribute reconstructed value of the current point. 根据权利要求24所述的方法,其中,所述相关系数包括第二系数;所述根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数,包括:The method according to claim 24, wherein the correlation coefficient includes a second coefficient; and determining the correlation coefficient of the candidate neighboring point based on one or more attribute reconstruction values of the candidate neighboring point comprises: 根据所述当前点的第一属性重建值和所述候选近邻点的第一属性重建值,确定第二系数。A second coefficient is determined according to the first attribute reconstruction value of the current point and the first attribute reconstruction value of the candidate neighboring point. 根据权利要求25所述的方法,其中,所述第二系数包括所述当前点的第一属性重建值和所述候选近邻点的第一属性重建值的比值。The method according to claim 25, wherein the second coefficient comprises a ratio of the first attribute reconstruction value of the current point to the first attribute reconstruction value of the candidate neighboring point. 根据权利要求26所述的方法,其中,The method according to claim 26, wherein 所述当前点的属性重建顺序为第一属性先于第二属性的情况下,所述待编码属性为所述第二属性,所述当前点的第一属性重建值为所述当前点第一属性的重建值,所述候选近邻点的第一属性重建值为所述候选近邻点第一属性的重建值,所述待编码属性的属性参考值为所述候选近邻点第二属性的重建值;或者,When the attribute reconstruction order of the current point is that the first attribute precedes the second attribute, the attribute to be encoded is the second attribute, the first attribute reconstruction value of the current point is the reconstructed value of the first attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstructed value of the first attribute of the candidate neighboring point, and the attribute reference value of the attribute to be encoded is the reconstructed value of the second attribute of the candidate neighboring point; or 所述当前点的属性重建顺序为第二属性先于第一属性的情况下,所述待编码属性为所述第一属性,所述当前点的第一属性重建值为所述当前点第二属性的重建值,所述候选近邻点的第一属性重建值为所述候选近邻点第二属性的重建值,所述待编码属性的属性参考值为所述候选近邻点第一属性的重建值。When the attribute reconstruction order of the current point is that the second attribute precedes the first attribute, the attribute to be encoded is the first attribute, the first attribute reconstruction value of the current point is the reconstruction value of the second attribute of the current point, the first attribute reconstruction value of the candidate neighboring point is the reconstruction value of the second attribute of the candidate neighboring point, and the attribute reference value of the attribute to be encoded is the reconstruction value of the first attribute of the candidate neighboring point. 根据权利要求23或27所述的方法,其中,所述方法还包括:The method according to claim 23 or 27, wherein the method further comprises: 确定第二语法元素信息;determining second syntax element information; 若所述第二语法元素信息的取值为第一值,则确定所述当前点的属性重建顺序为第一属性先于第二属性;或者,If the value of the second syntax element information is the first value, determining that the attribute reconstruction order of the current point is that the first attribute precedes the second attribute; or 若所述第二语法元素信息的取值为第二值,则确定所述当前点的属性重建顺序为第二属性先于第一属性;If the value of the second syntax element information is the second value, determining that the attribute reconstruction order of the current point is such that the second attribute precedes the first attribute; 所述方法还包括:The method further comprises: 将所述第二语法标识信息进行编码处理,将所得到的编码比特写入码流。The second syntax identification information is coded, and the obtained coded bits are written into a bitstream. 根据权利要求19至28任一项所述的方法,其中,所述相关系数表征所述候选近邻点的属性重建值和所述当前点的非候选近邻点的属性重建值之间的相关性。The method according to any one of claims 19 to 28, wherein the correlation coefficient represents the correlation between the attribute reconstructed values of the candidate neighboring points and the attribute reconstructed values of the non-candidate neighboring points of the current point. 根据权利要求19至29任一项所述的方法,其中,所述根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值,包括:The method according to any one of claims 19 to 29, wherein determining the attribute prediction value of the attribute to be encoded at the current point based on the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient comprises: 将所述当前点的待编码属性的属性参考值和所述相关系数相乘,确定所述待编码属性的属性预测值。The attribute reference value of the attribute to be encoded at the current point is multiplied by the correlation coefficient to determine the attribute prediction value of the attribute to be encoded. 根据权利要求1所述的方法,其中,所述候选预测模式还包括第一预测模式,所述方法还包括:The method according to claim 1, wherein the candidate prediction mode further includes a first prediction mode, and the method further includes: 从所述候选预测模式中确定所述当前点的所述第一预测模式;Determining the first prediction mode of the current point from the candidate prediction modes; 根据所述第一预测模式,确定所述当前点的待编码属性的属性预测值;determining, according to the first prediction mode, an attribute prediction value of the attribute to be encoded at the current point; 根据所述一个或多个候选跨属性预测模式和所述第一预测模式各自对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为所述第一预测模式。An encoding decision is made based on the attribute prediction values of the to-be-encoded attributes of the current point corresponding to each of the one or more candidate cross-attribute prediction modes and the first prediction mode, and the best prediction mode for the current point is determined to be the first prediction mode. 根据权利要求19至31任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 19 to 31, further comprising: 根据所述当前点的M个近邻点各自的已重建属性的属性重建值,确定所述当前点是否满足预设条件;Determining whether the current point meets a preset condition based on the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point; 在所述当前点的M个近邻点各自的已重建属性的属性重建值满足预设条件的情况下,执行从候选预测模式中确定所述当前点的候选跨属性预测模式的步骤,或者,When the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point meet a preset condition, performing a step of determining a candidate cross-attribute prediction mode of the current point from the candidate prediction modes, or 在所述当前点的M个近邻点各自的已重建属性的属性重建值不满足预设条件的情况下,确定所述当前点采用第二预测模式。When the attribute reconstruction values of the reconstructed attributes of the M neighboring points of the current point do not meet a preset condition, it is determined that the current point adopts the second prediction mode. 根据权利要求32所述的方法,其中,M为大于或等于2的正整数;所述预设条件包括:所述M个近邻点相互之间的已重建属性的属性重建值的最大属性差值大于或等于预设阈值;所述已重建属性与所述待编码属性相同。The method according to claim 32, wherein M is a positive integer greater than or equal to 2; the preset conditions include: the maximum attribute difference of the attribute reconstruction values of the reconstructed attributes between the M neighboring points is greater than or equal to a preset threshold; and the reconstructed attribute is the same as the attribute to be encoded. 根据权利要求32所述的方法,其中,所述方法还包括:The method according to claim 32, wherein the method further comprises: 在确定所述当前点采用所述第二预测模式的情况下,根据所述M个近邻点各自的空间位置以及所述当前点的空间位置,确定所述M个近邻点各自的空间几何权重;When it is determined that the second prediction mode is adopted for the current point, determining a spatial geometric weight of each of the M neighboring points according to the spatial positions of each of the M neighboring points and the spatial position of the current point; 根据所述M个近邻点各自的已重建属性的属性重建值和所述M个近邻点各自的空间几何权重,确定所述待编码属性的属性预测值。 An attribute prediction value of the attribute to be encoded is determined according to the attribute reconstruction value of each of the reconstructed attributes of the M neighboring points and the spatial geometric weight of each of the M neighboring points. 根据权利要求19至34任一项所述的方法,其中,所述方法还包括:The method according to any one of claims 19 to 34, further comprising: 确定第三语法元素信息;determining third syntax element information; 在所述第三语法元素信息指示所述当前点允许采用跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个跨属性预测模式;或者,In a case where the third syntax element information indicates that the current point allows the use of the cross-attribute prediction mode, determining that the candidate prediction modes include one or more cross-attribute prediction modes; or 在所述第三语法元素信息指示所述当前点禁止跨属性预测模式的情况下,确定所述候选预测模式包括一个或多个非跨属性预测模式;In a case where the third syntax element information indicates that the current point prohibits the cross-attribute prediction mode, determining that the candidate prediction modes include one or more non-cross-attribute prediction modes; 根据所述一个或多个非跨属性预测模式,确定所述当前点的一个或多个属性预测值;determining one or more attribute prediction values of the current point according to the one or more non-cross-attribute prediction modes; 根据所述当前点的一个或多个属性预测值编码决策,确定所述当前点采用的最佳预测模式;Determining an optimal prediction mode for the current point based on one or more attribute prediction value encoding decisions of the current point; 根据所述最佳预测模式,确定所述第一语法元素信息的取值;Determining a value of the first syntax element information according to the optimal prediction mode; 对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流;performing encoding processing on the first syntax element information, and writing the obtained encoding bits into a bitstream; 所述方法还包括:The method further comprises: 对第三语法标识信息进行编码处理,将所得到的编码比特写入码流。The third syntax identification information is coded, and the obtained coded bits are written into the bitstream. 一种码流,所述码流是根据待编码信息进行比特编码生成的;其中,所述待编码信息包括下述至少一项:A code stream is generated by bit-coding information to be coded; wherein the information to be coded includes at least one of the following: 第一语法元素信息、第二语法元素信息和第三语法元素信息;所述第一语法元素信息用于指示所述当前点采用的预测模式,所述第二语法元素信息用于指示所述当前点的属性重建顺序,所述第三语法元素信息用于指示所述当前点是否允许采用跨属性预测模式。First syntax element information, second syntax element information, and third syntax element information; the first syntax element information is used to indicate the prediction mode adopted by the current point, the second syntax element information is used to indicate the attribute reconstruction order of the current point, and the third syntax element information is used to indicate whether the current point allows the use of a cross-attribute prediction mode. 一种解码器,所述解码器包括解码部分和第一确定部分,其中:A decoder comprising a decoding part and a first determining part, wherein: 所述解码部分,被配置为解码码流,确定当前点的第一语法元素信息;The decoding part is configured to decode the code stream and determine the first syntax element information of the current point; 所述第一确定部分,被配置为根据所述第一语法元素信息的取值,从候选预测模式中确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述目标跨属性预测模式,确定所述当前点的目标近邻点的一个或多个属性重建值;根据所述目标近邻点的一个或多个属性重建值,确定所述目标近邻点的相关系数;根据所述当前点的待解码属性的属性参考值和所述相关系数,确定所述当前点的待解码属性的属性预测值。The first determination part is configured to determine, from the candidate prediction modes, the best prediction mode of the current point as the target cross-attribute prediction mode according to the value of the first syntax element information; determine one or more attribute reconstruction values of the target neighboring points of the current point according to the target cross-attribute prediction mode; determine the correlation coefficient of the target neighboring points according to the one or more attribute reconstruction values of the target neighboring points; and determine the attribute prediction value of the attribute to be decoded of the current point according to the attribute reference value of the attribute to be decoded of the current point and the correlation coefficient. 一种编码器,所述编码器包括编码部分和第二确定部分,其中:An encoder comprising an encoding part and a second determining part, wherein: 所述第二确定部分,被配置为从候选预测模式中确定所述当前点的候选跨属性预测模式;根据所述候选跨属性预测模式,确定所述当前点的候选近邻点的一个或多个属性重建值;根据所述候选近邻点的一个或多个属性重建值,确定所述候选近邻点的相关系数;根据所述当前点的待编码属性的属性参考值和所述相关系数,确定所述当前点的待编码属性的属性预测值;根据一个或多个候选跨属性预测模式对应的所述当前点的待编码属性的属性预测值进行编码决策,确定所述当前点的最佳预测模式为目标跨属性预测模式;根据所述最佳预测模式,确定所述当前点的第一语法元素信息的取值;The second determination part is configured to determine the candidate cross-attribute prediction mode of the current point from the candidate prediction modes; determine one or more attribute reconstruction values of the candidate neighboring points of the current point according to the candidate cross-attribute prediction mode; determine the correlation coefficient of the candidate neighboring points according to the one or more attribute reconstruction values of the candidate neighboring points; determine the attribute prediction value of the attribute to be encoded at the current point according to the attribute reference value of the attribute to be encoded at the current point and the correlation coefficient; make a coding decision based on the attribute prediction value of the attribute to be encoded at the current point corresponding to the one or more candidate cross-attribute prediction modes, and determine the best prediction mode of the current point as the target cross-attribute prediction mode; determine the value of the first syntax element information of the current point according to the best prediction mode; 所述编码部分,被配置为对所述第一语法元素信息进行编码处理,将所得到的编码比特写入码流。The encoding part is configured to perform encoding processing on the first syntax element information and write the obtained encoded bits into a bitstream. 一种解码器,所述解码器包括第一存储器和第一处理器,其中:A decoder comprising a first memory and a first processor, wherein: 所述第一存储器,被配置为存储能够在所述第一处理器上运行的计算机程序;The first memory is configured to store a computer program that can be executed on the first processor; 所述第一处理器,被配置为在运行所述计算机程序时,执行如权利要求1至18中任一项所述的方法。The first processor is configured to perform the method according to any one of claims 1 to 18 when running the computer program. 一种编码器,所述编码器包括第二存储器和第二处理器,其中:An encoder comprising a second memory and a second processor, wherein: 所述第二存储器,被配置为存储能够在所述第二处理器上运行的计算机程序;The second memory is configured to store a computer program that can be executed on the second processor; 所述第二处理器,被配置为在运行所述计算机程序时,执行如权利要求19至35中任一项所述的方法。The second processor is configured to perform the method according to any one of claims 19 to 35 when running the computer program. 一种计算机可读存储介质,其中,所述计算机可读存储介质存储有计算机程序,所述计算机程序被执行时实现如权利要求1至18中任一项所述的方法,或者实现如权利要求19至35中任一项所述的方法。 A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed, the method according to any one of claims 1 to 18 is implemented, or the method according to any one of claims 19 to 35 is implemented.
PCT/CN2024/087747 2024-04-15 2024-04-15 Encoding method, decoding method, bit stream, decoder, encoder, and storage medium Pending WO2025217757A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2024/087747 WO2025217757A1 (en) 2024-04-15 2024-04-15 Encoding method, decoding method, bit stream, decoder, encoder, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2024/087747 WO2025217757A1 (en) 2024-04-15 2024-04-15 Encoding method, decoding method, bit stream, decoder, encoder, and storage medium

Publications (1)

Publication Number Publication Date
WO2025217757A1 true WO2025217757A1 (en) 2025-10-23

Family

ID=97402781

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/087747 Pending WO2025217757A1 (en) 2024-04-15 2024-04-15 Encoding method, decoding method, bit stream, decoder, encoder, and storage medium

Country Status (1)

Country Link
WO (1) WO2025217757A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112385238A (en) * 2019-07-10 2021-02-19 深圳市大疆创新科技有限公司 Data encoding method, data decoding method, equipment and storage medium
US20220109888A1 (en) * 2019-04-03 2022-04-07 Lg Electronics Inc. Video or image coding method and device therefor
CN115720272A (en) * 2021-08-24 2023-02-28 西安电子科技大学 Point cloud prediction method, point cloud encoding method, point cloud decoding method and point cloud prediction equipment
WO2023023918A1 (en) * 2021-08-23 2023-03-02 Oppo广东移动通信有限公司 Decoding method, encoding method, decoder and encoder
US20230290012A1 (en) * 2020-12-28 2023-09-14 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Point cloud encoding method and system, point cloud decoding method and system, point cloud encoder, and point cloud decoder

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220109888A1 (en) * 2019-04-03 2022-04-07 Lg Electronics Inc. Video or image coding method and device therefor
CN112385238A (en) * 2019-07-10 2021-02-19 深圳市大疆创新科技有限公司 Data encoding method, data decoding method, equipment and storage medium
US20230290012A1 (en) * 2020-12-28 2023-09-14 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Point cloud encoding method and system, point cloud decoding method and system, point cloud encoder, and point cloud decoder
WO2023023918A1 (en) * 2021-08-23 2023-03-02 Oppo广东移动通信有限公司 Decoding method, encoding method, decoder and encoder
CN115720272A (en) * 2021-08-24 2023-02-28 西安电子科技大学 Point cloud prediction method, point cloud encoding method, point cloud decoding method and point cloud prediction equipment

Similar Documents

Publication Publication Date Title
CN116325731A (en) Point cloud encoding and decoding method and system, and point cloud encoder and point cloud decoder
CN117321991A (en) Prediction method, device and codec for point cloud attributes
WO2025217757A1 (en) Encoding method, decoding method, bit stream, decoder, encoder, and storage medium
WO2024174086A1 (en) Decoding method, encoding method, decoders and encoders
WO2024065406A1 (en) Encoding and decoding methods, bit stream, encoder, decoder, and storage medium
WO2025007360A1 (en) Coding method, decoding method, bit stream, coder, decoder, and storage medium
WO2024212042A1 (en) Coding method, decoding method, code stream, coder, decoder, and storage medium
WO2025213421A1 (en) Encoding method, decoding method, bitstream, encoder, decoder, and storage medium
WO2025076668A9 (en) Encoding method, decoding method, encoder, decoder and storage medium
WO2024216476A1 (en) Encoding/decoding method, encoder, decoder, code stream, and storage medium
WO2025007349A1 (en) Encoding and decoding methods, bit stream, encoder, decoder, and storage medium
WO2025007355A9 (en) Encoding method, decoding method, code stream, encoder, decoder, and storage medium
WO2024212038A1 (en) Encoding method, decoding method, code stream, encoder, decoder, and storage medium
WO2025213480A1 (en) Encoding method and apparatus, decoding method and apparatus, point cloud encoder, point cloud decoder, bit stream, device, and storage medium
WO2023173238A1 (en) Encoding method, decoding method, code stream, encoder, decoder, and storage medium
WO2024187380A1 (en) Encoding method, decoding method, code stream, encoder, decoder and storage medium
WO2025145330A1 (en) Point cloud coding method, point cloud decoding method, coders, decoders, code stream and storage medium
WO2025010601A9 (en) Coding method, decoding method, coders, decoders, code stream and storage medium
WO2025148027A1 (en) Coding method and apparatus, decoding method and apparatus, and point cloud coder, point cloud decoder, bitstream, device and storage medium
TW202431856A (en) Coding and decoding method, code stream, encoder, decoder and storage medium
WO2025010604A1 (en) Point cloud encoding method, point cloud decoding method, encoder, decoder, code stream, and storage medium
WO2025217849A1 (en) Encoding/decoding method, point cloud encoder, point cloud decoder, and storage medium
WO2025076672A1 (en) Encoding method, decoding method, encoder, decoder, code stream, and storage medium
WO2025076659A1 (en) Point cloud encoding method, point cloud decoding method, code stream, encoder, decoder and storage medium
WO2025010600A9 (en) Encoding method, decoding method, code stream, encoder, decoder, and storage medium