[go: up one dir, main page]

CN112991179B - Method, apparatus, device and storage medium for outputting information - Google Patents

Method, apparatus, device and storage medium for outputting information Download PDF

Info

Publication number
CN112991179B
CN112991179B CN202110322610.3A CN202110322610A CN112991179B CN 112991179 B CN112991179 B CN 112991179B CN 202110322610 A CN202110322610 A CN 202110322610A CN 112991179 B CN112991179 B CN 112991179B
Authority
CN
China
Prior art keywords
sequence
image
simulated
homography matrix
feature point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110322610.3A
Other languages
Chinese (zh)
Other versions
CN112991179A (en
Inventor
陈曲
叶晓青
谭啸
孙昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202110322610.3A priority Critical patent/CN112991179B/en
Publication of CN112991179A publication Critical patent/CN112991179A/en
Application granted granted Critical
Publication of CN112991179B publication Critical patent/CN112991179B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4038Image mosaicing, e.g. composing plane images from plane sub-images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/30Determination of transform parameters for the alignment of images, i.e. image registration
    • G06T7/33Determination of transform parameters for the alignment of images, i.e. image registration using feature-based methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00Indexing scheme for image data processing or generation, in general
    • G06T2200/32Indexing scheme for image data processing or generation, in general involving image mosaicing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本公开提供了用于输出信息的方法、装置、设备以及存储介质,涉及人工智能领域,具体为计算机视觉和深度学习技术领域,可用在图像拼接场景下。具体实现方案为:获取目标图像对应的图像序列以及与图像序列对应的模拟单应矩阵序列;利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列;根据模拟单应矩阵序列以及估计单应矩阵序列,确定针对目标特征点识别算法的评估信息;输出评估信息。本实现方式可以对特征点识别算法进行评估,从而能够为优化特征点识别算法提供依据以及为图像拼接提供基础。

Figure 202110322610

The present disclosure provides methods, devices, devices and storage media for outputting information, which relate to the field of artificial intelligence, specifically the technical fields of computer vision and deep learning, and can be used in image splicing scenarios. The specific implementation plan is: obtain the image sequence corresponding to the target image and the simulated homography matrix sequence corresponding to the image sequence; use the target feature point recognition algorithm to determine the feature points of each image frame in the image sequence, and based on the feature points of each image frame, Determine the estimated homography matrix sequence between any two adjacent image frames in the image sequence; determine the evaluation information for the target feature point recognition algorithm according to the simulated homography matrix sequence and the estimated homography matrix sequence; output the evaluation information. This implementation can evaluate the feature point recognition algorithm, thereby providing a basis for optimizing the feature point recognition algorithm and providing a basis for image splicing.

Figure 202110322610

Description

用于输出信息的方法、装置、设备以及存储介质Method, device, device and storage medium for outputting information

技术领域technical field

本公开涉及人工智能领域,具体为计算机视觉和深度学习技术领域,尤其涉及用于输出信息的方法、装置、设备以及存储介质,可用在图像拼接场景下。The present disclosure relates to the field of artificial intelligence, specifically to the technical fields of computer vision and deep learning, and in particular to methods, devices, equipment and storage media for outputting information, which can be used in image stitching scenarios.

背景技术Background technique

图像拼接(image mosaic)是一个日益流行的研究领域,它已经成为照相绘图学、计算机视觉、图像处理和计算机图形学研究中的热点。在对图像拼接过程中,可以首先识别图像中的特征点。但特征点识别算法的性能直接影响到图像拼接的效果。Image mosaic (image mosaic) is an increasingly popular research field, which has become a hot topic in photogrammetry, computer vision, image processing and computer graphics research. In the process of image stitching, the feature points in the image can be identified first. But the performance of the feature point recognition algorithm directly affects the effect of image stitching.

发明内容Contents of the invention

提供了一种用于输出信息的方法、装置、设备以及存储介质。Provided are a method, device, device and storage medium for outputting information.

根据第一方面,提供了一种用于输出信息的方法,包括:获取目标图像对应的图像序列以及与图像序列对应的模拟单应矩阵序列;利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列;根据模拟单应矩阵序列以及估计单应矩阵序列,确定针对目标特征点识别算法的评估信息;输出评估信息。According to the first aspect, a method for outputting information is provided, including: acquiring an image sequence corresponding to a target image and a simulated homography matrix sequence corresponding to the image sequence; using a target feature point recognition algorithm to determine each image frame in the image sequence , and based on the feature points of each image frame, determine the estimated homography matrix sequence between any two adjacent image frames in the image sequence; according to the simulated homography matrix sequence and the estimated homography matrix sequence, determine the target feature point Identify the evaluation information of the algorithm; output the evaluation information.

根据第二方面,提供了一种用于输出信息的装置,包括:获取单元,被配置成获取目标图像对应的图像序列以及与图像序列对应的模拟单应矩阵序列;估计单元,被配置成利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列;生成单元,被配置成根据模拟单应矩阵序列以及估计单应矩阵序列,确定针对目标特征点识别算法的评估信息;输出单元,被配置成输出评估信息。According to a second aspect, there is provided an apparatus for outputting information, comprising: an acquisition unit configured to acquire an image sequence corresponding to a target image and a simulated homography matrix sequence corresponding to the image sequence; an estimation unit configured to utilize The target feature point recognition algorithm determines the feature points of each image frame in the image sequence, and based on the feature points of each image frame, determines the estimated homography matrix sequence between any two adjacent image frames in the image sequence; the generating unit is configured as According to the simulated homography matrix sequence and the estimated homography matrix sequence, the evaluation information for the target feature point recognition algorithm is determined; the output unit is configured to output the evaluation information.

根据第三方面,提供了一种用于输出信息的电子设备,包括:至少一个处理器;以及与上述至少一个处理器通信连接的存储器;其中,存储器存储有可被至少一个处理器执行的指令,上述指令被至少一个处理器执行,以使至少一个处理器能够执行如第一方面所描述的方法。According to a third aspect, there is provided an electronic device for outputting information, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the at least one processor , the above instructions are executed by at least one processor, so that the at least one processor can execute the method as described in the first aspect.

根据第四方面,提供了一种存储有计算机指令的非瞬时计算机可读存储介质,上述计算机指令用于使计算机执行如第一方面所描述的方法。According to a fourth aspect, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the method described in the first aspect.

根据第五方面,一种计算机程序产品,包括计算机程序,上述计算机程序在被处理器执行时实现如第一方面所描述的方法。According to a fifth aspect, a computer program product includes a computer program, and when executed by a processor, the computer program implements the method as described in the first aspect.

根据本公开的技术可以对特征点识别算法进行评估,从而能够为优化特征点识别算法提供依据以及为图像拼接提供基础。According to the technology of the present disclosure, the feature point recognition algorithm can be evaluated, thereby providing a basis for optimizing the feature point recognition algorithm and providing a basis for image splicing.

应当理解,本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征,也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will be readily understood through the following description.

附图说明Description of drawings

附图用于更好地理解本方案,不构成对本公开的限定。其中:The accompanying drawings are used to better understand the present solution, and do not constitute a limitation to the present disclosure. in:

图1是根据本公开的用于输出信息的方法的一个实施例的流程图;FIG. 1 is a flowchart of one embodiment of a method for outputting information according to the present disclosure;

图2是根据本公开的用于输出信息的方法的一个应用场景的示意图;Fig. 2 is a schematic diagram of an application scenario of a method for outputting information according to the present disclosure;

图3是根据本公开的用于输出信息的方法的另一个实施例的流程图;FIG. 3 is a flowchart of another embodiment of a method for outputting information according to the present disclosure;

图4是根据本公开的用于输出信息的装置的一个实施例的结构示意图;Fig. 4 is a schematic structural diagram of an embodiment of an apparatus for outputting information according to the present disclosure;

图5是用来实现本公开实施例的用于输出信息的方法的电子设备的框图。FIG. 5 is a block diagram of an electronic device for implementing a method for outputting information of an embodiment of the present disclosure.

具体实施方式Detailed ways

以下结合附图对本公开的示范性实施例做出说明,其中包括本公开实施例的各种细节以助于理解,应当将它们认为仅仅是示范性的。因此,本领域普通技术人员应当认识到,可以对这里描述的实施例做出各种改变和修改,而不会背离本公开的范围和精神。同样,为了清楚和简明,以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

需要说明的是,在不冲突的情况下,本公开中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本公开。It should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.

继续参考图1,示出了根据本公开的用于输出信息的方法的一个实施例的流程100。本实施例的用于输出信息的方法,包括以下步骤:Continuing to refer to FIG. 1 , a flow 100 of an embodiment of a method for outputting information according to the present disclosure is shown. The method for outputting information in this embodiment includes the following steps:

步骤101,获取目标图像对应的图像序列以及与图像序列对应的模拟单应矩阵序列。Step 101, acquiring an image sequence corresponding to a target image and a simulated homography matrix sequence corresponding to the image sequence.

本实施例中,执行主体可以获取目标图像对应的图像序列。这里,目标图像可以是任意广角图像或者全景图像,或者像素宽度大于一定数值的图像。图像序列可以是对目标图像进行模拟连续扫描得到的图像序列,或者是对图像序列进行划分得到的图像序列。图像序列中的相邻的两图像帧之间可以包括重叠区域。In this embodiment, the execution subject may acquire the image sequence corresponding to the target image. Here, the target image may be any wide-angle image or panoramic image, or an image whose pixel width is greater than a certain value. The image sequence may be an image sequence obtained by simulating continuous scanning of the target image, or an image sequence obtained by dividing the image sequence. An overlapping area may be included between two adjacent image frames in the image sequence.

执行主体还可以获取与图像序列对应的模拟单应矩阵序列。这里,模拟单应矩阵序列可以通过性能较优的特征点识别算法提取图像序列中的各图像帧的特征点后进行配准确定。上述性能较优的特征点识别算法可以是预先训练的卷积神经网络。或者,上述目标图像中可以包括标定点,划分得到的图像序列中可以包括上述标定点,通过相邻的两图像帧中的标定点位置,确定模拟单应矩阵序列。The execution subject can also obtain a simulated homography matrix sequence corresponding to the image sequence. Here, the simulated homography matrix sequence can be determined by matching after extracting the feature points of each image frame in the image sequence through a feature point recognition algorithm with better performance. The aforementioned feature point recognition algorithm with better performance may be a pre-trained convolutional neural network. Alternatively, the above-mentioned target image may include marking points, and the divided image sequence may include the above-mentioned marking points, and the simulated homography matrix sequence is determined through the positions of the marking points in two adjacent image frames.

单应矩阵也可以称为单应性矩阵,用来描述物体在世界坐标系和像素坐标系之间的位置映射关系。The homography matrix can also be called the homography matrix, which is used to describe the position mapping relationship between the object in the world coordinate system and the pixel coordinate system.

步骤102,利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列。Step 102, using the target feature point recognition algorithm to determine the feature points of each image frame in the image sequence, and based on the feature points of each image frame, determine the estimated homography matrix sequence between any two adjacent image frames in the image sequence.

执行主体在获取图像序列后,可以利用目标特征点识别算法对图像序列中各图像帧进行特征点识别,得到各图像帧的特征点。目标特征点识别算法可以是各种能够提取特征的算法,例如括SIFT(Scale-invariant feature transform,尺度不变特征变换)、SURF(Speeded Up Robust Features,加速稳健特征)、ORB(Oriented FAST and RotatedBRIEF)、基于深度学习的特征点识别(卷积神经网络)等算法。在得到各图像帧的特征点后,可以对相邻图像帧的特征点进行匹配。并利用匹配的特征点确定两相邻图像帧之间的单应矩阵。根据单应矩阵对应的图像帧在图像序列中的位置,对各单应矩阵进行排序,得到单应矩阵序列,记为估计单应矩阵序列。After the execution subject acquires the image sequence, it can use the target feature point recognition algorithm to perform feature point recognition on each image frame in the image sequence to obtain the feature point of each image frame. The target feature point recognition algorithm can be a variety of algorithms that can extract features, such as SIFT (Scale-invariant feature transform, scale-invariant feature transformation), SURF (Speeded Up Robust Features, accelerated robust features), ORB (Oriented FAST and RotatedBRIEF ), feature point recognition based on deep learning (convolutional neural network) and other algorithms. After the feature points of each image frame are obtained, the feature points of adjacent image frames can be matched. And use the matched feature points to determine the homography matrix between two adjacent image frames. According to the position of the image frame corresponding to the homography matrix in the image sequence, the homography matrices are sorted to obtain the homography matrix sequence, which is recorded as the estimated homography matrix sequence.

步骤103,根据模拟单应矩阵序列以及估计单应矩阵序列,确定针对目标特征点识别算法的评估信息。Step 103: Determine the evaluation information for the target feature point recognition algorithm according to the simulated homography matrix sequence and the estimated homography matrix sequence.

由于模拟单应矩阵序列中的各单应矩阵准确度较高,可以将其作为标准来评述估计单应矩阵序列。可以理解的是,如果估计单应矩阵序列与模拟单应矩阵序列越相似,则目标特征点识别算法的性能就越好。本实施例中,执行主体可以计算模拟单应矩阵序列以及估计单应矩阵序列的相似度,并根据上述相似度,生成评估信息。或者,执行主体可以分别计算模拟单应矩阵序列中的各单应矩阵与估计单应矩阵序列中对应的单应矩阵之间的相似度,得到相似度序列。并基于上述相似度序列生成评估信息。或者,执行主体还可以直接将上述模拟单应矩阵序列以及估计单应矩阵序列作为评估信息输出。评估信息中可以包括上述两单应矩阵序列以及对应的相似度或相似度序列,还可以包括基于上述相似度或相似度序列生成的结论,例如“当前特征点识别算法的性能较好”等等。Since each homography in the simulated homography sequence has high accuracy, it can be used as a standard to evaluate the estimated homography sequence. It can be understood that if the estimated homography matrix sequence is more similar to the simulated homography matrix sequence, the performance of the target feature point recognition algorithm is better. In this embodiment, the execution subject can calculate the similarity of the simulated homography matrix sequence and the estimated homography matrix sequence, and generate evaluation information according to the above similarity. Alternatively, the execution subject may separately calculate the similarity between each homography matrix in the simulated homography matrix sequence and the corresponding homography matrix in the estimated homography matrix sequence to obtain a similarity sequence. And generate evaluation information based on the above similarity sequence. Alternatively, the execution subject may also directly output the above simulated homography matrix sequence and estimated homography matrix sequence as evaluation information. The evaluation information may include the above two homography matrix sequences and the corresponding similarity or similarity sequences, and may also include conclusions generated based on the above similarity or similarity sequences, such as "the performance of the current feature point recognition algorithm is better", etc. .

本实施例中,单应矩阵的计算可以采用RANSAC(RANdom SAmple Consensus,随机抽样一致)、LMeDS(最小中值法)等算法。In this embodiment, algorithms such as RANSAC (RANdom SAmple Consensus, random sampling consensus) and LMeDS (least median method) may be used for calculation of the homography matrix.

步骤104,输出评估信息。Step 104, output evaluation information.

执行主体还可以将评估信息输出,以供技术人员查看,技术人员可以根据评估信息对目标特征点识别算法进行优化,或选用合适的特征点识别算法进行数据处理等。The executive body can also output the evaluation information for technicians to view, and the technicians can optimize the target feature point recognition algorithm according to the evaluation information, or select an appropriate feature point recognition algorithm for data processing, etc.

继续参见图2,其示出了根据本公开的用于输出信息的方法的一个应用场景的示意图。在图2的应用场景中,终端设备201可以对目标图像进行划分,得到图像序列。图像序列中的相邻图像帧之间有重叠区域。通过利用性能较优的特征点识别算法对图像序列中各图像帧进行特征点识别,并对识别出的特征点进行匹配。基于匹配的特征点计算每两个相邻图像帧之间的单应矩阵,将得到的单应矩阵序列记为模拟单应矩阵序列。然后,利用目标特征点识别算法识别出各图像帧中的特征点进行匹配。基于匹配的特征点计算每两个相邻图像帧之间的单应矩阵,将得到的单应矩阵序列记为估计单应矩阵序列。计算模拟单应矩阵序列和估计单应矩阵序列之间的相似度,基于相似度生成目标特征点识别算法的评估信息。并将评估信息显示出来,技术人员可以基于评估信息对目标特征点识别算法进行优化。Continue referring to FIG. 2 , which shows a schematic diagram of an application scenario of the method for outputting information according to the present disclosure. In the application scenario in FIG. 2 , the terminal device 201 may divide the target image to obtain an image sequence. There are overlapping regions between adjacent image frames in the image sequence. By using the feature point recognition algorithm with better performance, the feature point recognition is carried out for each image frame in the image sequence, and the recognized feature points are matched. The homography matrix between every two adjacent image frames is calculated based on the matched feature points, and the obtained homography matrix sequence is recorded as the simulated homography matrix sequence. Then, the target feature point recognition algorithm is used to identify the feature points in each image frame for matching. The homography matrix between every two adjacent image frames is calculated based on the matched feature points, and the obtained homography matrix sequence is recorded as the estimated homography matrix sequence. Calculate the similarity between the simulated homography matrix sequence and the estimated homography matrix sequence, and generate evaluation information for the target feature point recognition algorithm based on the similarity. And the evaluation information is displayed, and technicians can optimize the target feature point recognition algorithm based on the evaluation information.

本公开的上述实施例提供的用于输出信息的方法,可以利用目标图像对应的图像序列以及对应的模拟单应矩阵序列和基于目标特征点识别算法得到的估计单应矩阵序列进行比较,从而实现对目标特征点识别算法进行评估,为图像拼接提供算法基础。The method for outputting information provided by the above-mentioned embodiments of the present disclosure can use the image sequence corresponding to the target image and the corresponding simulated homography matrix sequence to compare with the estimated homography matrix sequence obtained based on the target feature point recognition algorithm, thereby realizing Evaluate the target feature point recognition algorithm to provide the algorithm basis for image stitching.

继续参见图3,其示出了根据本公开的用于输出信息的方法的另一个实施例的流程300。本实施例的方法可以包括以下步骤:Continue referring to FIG. 3 , which shows a flow 300 of another embodiment of the method for outputting information according to the present disclosure. The method of this embodiment may include the following steps:

步骤301,根据模拟相机以及目标图像,确定目标图像对应的图像序列。Step 301, according to the simulated camera and the target image, determine the image sequence corresponding to the target image.

本实施例中,执行主体可以利用模拟相机对目标图像进行连续扫描,得到目标图像对应的图像序列。在扫描时,执行主体可以控制模拟相机在预设的多个位置对目标图像进行模拟扫描,得到多个图像帧。In this embodiment, the execution subject may use the analog camera to continuously scan the target image to obtain an image sequence corresponding to the target image. During scanning, the execution subject can control the simulated camera to simulate scan the target image at multiple preset positions to obtain multiple image frames.

在本实施例的一些可选的实现方式中,执行主体可以通过图3中未示出的以下步骤来得到目标图像对应的图像序列:利用模拟相机以预设姿态沿预设路线移动,对目标图像进行模拟连续扫描得到图像序列。In some optional implementations of this embodiment, the execution subject can obtain the image sequence corresponding to the target image through the following steps not shown in FIG. The image is simulated and scanned continuously to obtain an image sequence.

本实现方式中,执行主体可以利用模拟相机以预设姿态沿预设路线移动对目标图像进行模拟连续扫描得到图像序列。例如,模拟相机可以在目标图像上方高h处,与目标图像之间的夹角为θ。预设路线可以是与目标图像的中线平行的线条,这样可以最大限度的拍摄到目标图像中的内容。具体的,模拟相机在对目标图像进行连续扫描时可以以预设的频率对目标图像进行拍摄,得到图像序列。In this implementation manner, the execution subject may use the simulated camera to move along the preset route with a preset posture to perform simulated continuous scanning of the target image to obtain an image sequence. For example, the simulated camera may be at a height h above the target image, and the angle between the simulated camera and the target image is θ. The preset route may be a line parallel to the center line of the target image, so that the contents of the target image can be photographed to the greatest extent. Specifically, when the analog camera continuously scans the target image, it can capture the target image at a preset frequency to obtain an image sequence.

假设虚拟相机沿扫描方向x和纸面的夹角是θ,随机抖动的角度是α,(y,z方向同理)则可以确定不同姿态下相机平面上4个点。以4个点作为起始点,任意固定矩形框的4个顶点作为目标点,可以得到真实的单应矩阵序列。Assuming that the angle between the virtual camera along the scanning direction x and the paper surface is θ, and the angle of random shaking is α, (the y and z directions are the same), then 4 points on the camera plane under different attitudes can be determined. With 4 points as the starting point and 4 vertices of any fixed rectangular frame as the target point, the real homography matrix sequence can be obtained.

步骤302,确定图像序列中任意两相邻图像帧之间的模拟单应矩阵序列。Step 302, determining a simulated homography matrix sequence between any two adjacent image frames in the image sequence.

执行主体在得到图像序列后,可以确定图像序列中任意两相邻图像帧之间的单应矩阵。将得到的各单应矩阵进行排序,得到单应矩阵序列,记为模拟单应矩阵序列。本实施例中,目标图像中可以包括标定点,利用标定点可以对相邻图像帧进行匹配,从而计算得到该相邻图像帧之间的单应矩阵。After the execution subject obtains the image sequence, it can determine the homography matrix between any two adjacent image frames in the image sequence. The obtained homography matrices are sorted to obtain a sequence of homography matrices, which is denoted as a sequence of simulated homography matrices. In this embodiment, the target image may include marking points, and adjacent image frames may be matched using the marking points, so as to calculate a homography matrix between the adjacent image frames.

在本实施例的一些可选的实现方式中,执行主体还可以根据模拟相机在连续扫描过程中的姿态变换,确定模拟单应矩阵序列。In some optional implementation manners of this embodiment, the execution subject may also determine the simulated homography matrix sequence according to the pose transformation of the simulated camera during continuous scanning.

本实施例中,由于相机是模拟的,相机的姿态可以是预先设定的。即,模拟相机以预设姿态沿预设路线移动时,也可以计算出模拟相机的姿态变换。上述姿态可以包括位置和俯仰角。执行主体可以根据模拟相机的姿态确定出相邻图像帧之间的单应矩阵。并根据各单应矩阵对应的图像帧在图像序列中的位置,得到单应矩阵序列,记为模拟单应矩阵序列。In this embodiment, since the camera is simulated, the pose of the camera can be preset. That is, when the simulated camera moves along the preset route with the preset pose, the pose transformation of the simulated camera can also be calculated. The attitude above may include position and pitch angle. The execution subject can determine the homography matrix between adjacent image frames according to the pose of the simulated camera. And according to the positions of the image frames corresponding to each homography matrix in the image sequence, a homography matrix sequence is obtained, which is denoted as a simulated homography matrix sequence.

在本实施例的一些可选的实现方式中,执行主体还可以首先根据模拟相机在连续扫描过程中的姿态变换,确定相机姿态序列。然后,根据相机姿态序列,确定模拟单应矩阵序列。In some optional implementation manners of this embodiment, the execution subject may firstly determine the camera pose sequence according to the pose transformation of the simulated camera during the continuous scanning process. Then, based on the sequence of camera poses, the sequence of simulated homography matrices is determined.

本实现方式中,执行主体可以首先根据模拟相机在对目标图像连续扫描过程中的姿态,确定图像序列中各图像帧对应的相机姿态。这样,就可以得到图像序列对应的相机姿态序列。然后,对应每个相机姿态,确定单应矩阵,得到模拟单应矩阵序列。In this implementation manner, the execution subject may first determine the camera pose corresponding to each image frame in the image sequence according to the pose of the simulated camera during continuous scanning of the target image. In this way, the camera pose sequence corresponding to the image sequence can be obtained. Then, corresponding to each camera pose, a homography matrix is determined to obtain a sequence of simulated homography matrices.

步骤303,利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列。Step 303, using the target feature point recognition algorithm to determine the feature points of each image frame in the image sequence, and based on the feature points of each image frame, determine the estimated homography matrix sequence between any two adjacent image frames in the image sequence.

步骤304,确定模拟单应矩阵序列以及估计单应矩阵序列之间的距离;根据距离,确定针对目标特征点识别算法的评估信息。Step 304, determining the distance between the simulated homography matrix sequence and the estimated homography matrix sequence; according to the distance, determining the evaluation information for the target feature point recognition algorithm.

本实施例中,执行主体可以计算模拟单应矩阵序列以及估计单应矩阵序列之间的距离。具体的,执行主体可以分别计算模拟单应矩阵序列中的各单应矩阵与对应的估计单应矩阵序列中单应矩阵之间的距离,然后计算各距离的平均值。将上述平均值作为模拟单应矩阵序列以及估计单应矩阵序列的相似度值。根据上述距离,确定针对目标特征点识别算法的评估信息。具体的,上述评估信息中可以包括上述距离值,还可以包括与上述距离值对应的结论信息。In this embodiment, the execution subject can calculate the simulated homography matrix sequence and estimate the distance between the homography matrix sequences. Specifically, the execution subject may separately calculate the distance between each homography matrix in the simulated homography matrix sequence and the corresponding homography matrix in the estimated homography matrix sequence, and then calculate the average value of each distance. The above average value is used as the similarity value of the simulated homography matrix sequence and the estimated homography matrix sequence. According to the above distance, the evaluation information for the target feature point recognition algorithm is determined. Specifically, the above-mentioned evaluation information may include the above-mentioned distance value, and may also include conclusion information corresponding to the above-mentioned distance value.

步骤305,输出评估信息。Step 305, output evaluation information.

本公开的上述实施例提供的用于输出信息的方法,对目标图像进行模拟扫描,生成了模拟图片序列,避免了真实图片的采集和标注的过程,只要有原始图像,就可以任意生成图像。并基于模拟相机的姿态变换,计算图像序列对应的单应矩阵序列。避免了基于真实扫描图片序列进行计算单应矩阵难以准确估计的问题,且可以通过人为设定模拟相机的姿态,覆盖所有真实姿态及其序列组合。直接基于单应矩阵序列和单应矩阵估计序列之间的距离均值,评估目标特征点匹配算法,避免了重投影误差方法在射影变换上的缺陷。In the method for outputting information provided by the above embodiments of the present disclosure, a simulated scan is performed on the target image to generate a sequence of simulated pictures, which avoids the process of collecting and labeling real pictures, and can generate images arbitrarily as long as there are original images. And based on the pose transformation of the simulated camera, the homography matrix sequence corresponding to the image sequence is calculated. It avoids the problem that it is difficult to estimate the homography matrix accurately based on the real scan picture sequence, and can cover all real poses and their sequence combinations by artificially setting the pose of the simulated camera. The target feature point matching algorithm is evaluated directly based on the homography matrix sequence and the distance mean between the homography matrix estimation sequences, which avoids the defects of the reprojection error method on projective transformation.

进一步参考图4,作为对上述各图所示方法的实现,本公开提供了一种用于输出信息的装置的一个实施例,该装置实施例与图1所示的方法实施例相对应,该装置具体可以应用于各种电子设备中。Further referring to FIG. 4 , as an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of a device for outputting information. The device embodiment corresponds to the method embodiment shown in FIG. 1 . The device can be specifically applied to various electronic devices.

如图4所示,本实施例的用于输出信息的装置400包括:获取单元401、估计单元402、生成单元403和输出单元404。As shown in FIG. 4 , the apparatus 400 for outputting information in this embodiment includes: an acquiring unit 401 , an estimating unit 402 , a generating unit 403 and an output unit 404 .

获取单元401,被配置成获取目标图像对应的图像序列以及与图像序列对应的模拟单应矩阵序列。The acquiring unit 401 is configured to acquire an image sequence corresponding to the target image and a simulated homography matrix sequence corresponding to the image sequence.

估计单元402,被配置成利用目标特征点识别算法确定图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定图像序列中任意两相邻图像帧之间的估计单应矩阵序列。The estimation unit 402 is configured to use the target feature point recognition algorithm to determine the feature points of each image frame in the image sequence, and based on the feature points of each image frame, determine the estimated homography matrix between any two adjacent image frames in the image sequence sequence.

生成单元403,被配置成根据模拟单应矩阵序列以及估计单应矩阵序列,确定针对目标特征点识别算法的评估信息;The generation unit 403 is configured to determine evaluation information for the target feature point recognition algorithm according to the simulated homography matrix sequence and the estimated homography matrix sequence;

输出单元404,被配置成输出评估信息。The output unit 404 is configured to output evaluation information.

在本实施例的一些可选的实现方式中,获取单元401可以进一步被配置成:根据模拟相机以及目标图像,确定目标图像对应的图像序列;确定图像序列中任意两相邻图像帧之间的单应矩阵,得到模拟单应矩阵序列。In some optional implementations of this embodiment, the acquisition unit 401 may be further configured to: determine the image sequence corresponding to the target image according to the simulated camera and the target image; determine the image sequence between any two adjacent image frames in the image sequence homography matrix, get the simulated homography matrix sequence.

在本实施例的一些可选的实现方式中,获取单元401可以进一步被配置成:利用模拟相机以预设姿态沿预设路线移动,对目标图像进行模拟连续扫描得到图像序列。In some optional implementation manners of this embodiment, the acquisition unit 401 may be further configured to: use a simulated camera to move along a preset route with a preset posture, and perform simulated continuous scanning on the target image to obtain an image sequence.

在本实施例的一些可选的实现方式中,获取单元401可以进一步被配置成:根据模拟相机在连续扫描过程中的姿态变换,确定模拟单应矩阵序列。In some optional implementation manners of this embodiment, the acquiring unit 401 may be further configured to: determine a simulated homography matrix sequence according to pose transformation of the simulated camera during continuous scanning.

在本实施例的一些可选的实现方式中,获取单元401可以进一步被配置成:根据模拟相机在连续扫描过程中的姿态变换,确定相机姿态序列;根据相机姿态序列,确定模拟单应矩阵序列。In some optional implementations of this embodiment, the acquisition unit 401 may be further configured to: determine the camera pose sequence according to the pose transformation of the simulated camera in the continuous scanning process; determine the simulated homography matrix sequence according to the camera pose sequence .

在本实施例的一些可选的实现方式中,生成单元403可以进一步被配置成:确定模拟单应矩阵序列以及估计单应矩阵序列之间的距离;根据距离,确定针对目标特征点识别算法的评估信息。In some optional implementations of this embodiment, the generation unit 403 may be further configured to: determine the simulated homography matrix sequence and estimate the distance between the homography matrix sequences; according to the distance, determine the target feature point recognition algorithm Evaluation information.

应当理解,用于输出信息的装置400中记载的单元401至单元405分别与参考图1中描述的方法中的各个步骤相对应。由此,上文针对用于输出信息的方法描述的操作和特征同样适用于装置400及其中包含的单元,在此不再赘述。It should be understood that the units 401 to 405 recorded in the apparatus 400 for outputting information respectively correspond to the steps in the method described with reference to FIG. 1 . Therefore, the operations and features described above for the method for outputting information are also applicable to the device 400 and the units contained therein, and will not be repeated here.

本公开的技术方案中,所涉及的用户个人信息的获取、存储和应用等,均符合相关法律法规的规定,且不违背公序良俗。In the technical solution of the present disclosure, the acquisition, storage and application of the user's personal information involved are in compliance with relevant laws and regulations, and do not violate public order and good customs.

根据本公开的实施例,本公开还提供了还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to the embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

图5示出了根据本公开实施例的执行用于输出信息的方法的电子设备500的框图。电子设备旨在表示各种形式的数字计算机,诸如,膝上型计算机、台式计算机、工作台、个人数字助理、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置,诸如,个人数字处理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例,并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 5 shows a block diagram of an electronic device 500 performing a method for outputting information according to an embodiment of the present disclosure. Electronic device is intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

如图5所示,电子设备500包括处理器501,其可以根据存储在只读存储器(ROM)502中的计算机程序或者从存储器508加载到随机访问存储器(RAM)503中的计算机程序,来执行各种适当的动作和处理。在RAM 503中,还可存储电子设备500操作所需的各种程序和数据。处理器501、ROM 502以及RAM 503通过总线504彼此相连。I/O接口(输入/输出接口)505也连接至总线504。As shown in FIG. 5 , an electronic device 500 includes a processor 501 that can execute according to a computer program stored in a read-only memory (ROM) 502 or loaded from a memory 508 into a random access memory (RAM) 503. Various appropriate actions and treatments. In the RAM 503, various programs and data necessary for the operation of the electronic device 500 can also be stored. The processor 501 , ROM 502 , and RAM 503 are connected to each other through a bus 504 . An I/O interface (input/output interface) 505 is also connected to the bus 504 .

电子设备500中的多个部件连接至I/O接口505,包括:输入单元506,例如键盘、鼠标等;输出单元507,例如各种类型的显示器、扬声器等;存储器508,例如磁盘、光盘等;以及通信单元509,例如网卡、调制解调器、无线通信收发机等。通信单元509允许电子设备500通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Multiple components in the electronic device 500 are connected to the I/O interface 505, including: an input unit 506, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of displays, speakers, etc.; a memory 508, such as a magnetic disk, an optical disk, etc. ; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, and the like. The communication unit 509 allows the electronic device 500 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

处理器501可以是各种具有处理和计算能力的通用和/或专用处理组件。处理器501的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的处理器、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。处理器501执行上文所描述的各个方法和处理,例如用于输出信息的方法。例如,在一些实施例中,用于输出信息的方法可被实现为计算机软件程序,其被有形地包含于机器可读存储介质,例如存储器508。在一些实施例中,计算机程序的部分或者全部可以经由ROM 502和/或通信单元509而被载入和/或安装到电子设备500上。当计算机程序加载到RAM 503并由处理器501执行时,可以执行上文描述的用于输出信息的方法的一个或多个步骤。备选地,在其他实施例中,处理器501可以通过其他任何适当的方式(例如,借助于固件)而被配置为执行用于输出信息的方法。Processor 501 may be various general and/or special purpose processing components having processing and computing capabilities. Some examples of processor 501 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various dedicated artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 501 executes various methods and processes described above, such as a method for outputting information. For example, in some embodiments, the method for outputting information may be implemented as a computer software program tangibly embodied on a machine-readable storage medium, such as memory 508 . In some embodiments, part or all of the computer program may be loaded and/or installed on the electronic device 500 via the ROM 502 and/or the communication unit 509 . When the computer program is loaded into RAM 503 and executed by processor 501, one or more steps of the method for outputting information described above may be performed. Alternatively, in other embodiments, the processor 501 may be configured in any other suitable manner (for example, by means of firmware) to execute the method for outputting information.

本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips Implemented in a system of systems (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。上述程序代码可以封装成计算机程序产品。这些程序代码或计算机程序产品可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器,使得程序代码当由处理器501执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行,作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program codes for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. The above program code can be packaged into a computer program product. These program codes or computer program products may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus, so that the program codes, when executed by the processor 501, make the flow diagrams and/or block diagrams specified The function/operation is implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

在本公开的上下文中,机器可读存储介质可以是有形的介质,其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读存储介质可以是机器可读信号存储介质或机器可读存储介质。机器可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备,或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学存储设备、磁存储设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable storage medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. The machine-readable storage medium may be a machine-readable signal storage medium or a machine-readable storage medium. A machine-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer discs, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

为了提供与用户的交互,可以在计算机上实施此处描述的系统和技术,该计算机具有:用于向用户显示信息的显示装置(例如,CRT(阴极射线管)或者LCD(液晶显示器)监视器);以及键盘和指向装置(例如,鼠标或者轨迹球),用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互;例如,提供给用户的反馈可以是任何形式的传感反馈(例如,视觉反馈、听觉反馈、或者触觉反馈);并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide for interaction with the user, the systems and techniques described herein can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user. ); and a keyboard and pointing device (eg, a mouse or a trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and can be in any form (including Acoustic input, speech input or, tactile input) to receive input from the user.

可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如,作为数据服务器)、或者包括中间件部件的计算系统(例如,应用服务器)、或者包括前端部件的计算系统(例如,具有图形用户界面或者网络浏览器的用户计算机,用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如,通信网络)来将系统的部件相互连接。通信网络的示例包括:局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., as a a user computer having a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system can be interconnected by any form or medium of digital data communication, eg, a communication network. Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN) and the Internet.

计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器,又称为云计算服务器或云主机,是云计算服务体系中的一项主机产品,以解决了传统物理主机与VPS服务(“Virtual Private Server”,或简称“VPS”)中,存在的管理难度大,业务扩展性弱的缺陷。服务器也可以是分布式系统的服务器,或者是结合了区块链的服务器。A computer system may include clients and servers. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the problem of traditional physical host and VPS service ("Virtual Private Server", or "VPS") Among them, there are defects such as difficult management and weak business scalability. The server can also be a server of a distributed system, or a server combined with a blockchain.

应该理解,可以使用上面所示的各种形式的流程,重新排序、增加或删除步骤。例如,本公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行,只要能够实现本公开的技术方案所期望的结果,本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, each step described in the present disclosure may be executed in parallel, sequentially, or in a different order, as long as the desired result of the technical solution of the present disclosure can be achieved, no limitation is imposed herein.

上述具体实施方式,并不构成对本公开保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等,均应包含在本公开的保护范围之内。The specific implementation manners described above do not limit the protection scope of the present disclosure. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present disclosure shall fall within the protection scope of the present disclosure.

Claims (8)

1.一种用于输出信息的方法,包括:1. A method for outputting information, comprising: 利用模拟相机以预设姿态沿预设路线移动,对目标图像进行模拟连续扫描得到图像序列;Use the simulated camera to move along the preset route with a preset attitude, and simulate and continuously scan the target image to obtain an image sequence; 确定所述图像序列中任意两相邻图像帧之间的单应矩阵,得到模拟单应矩阵序列;Determining the homography matrix between any two adjacent image frames in the image sequence to obtain a simulated homography matrix sequence; 利用目标特征点识别算法确定所述图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定所述图像序列中任意两相邻图像帧之间的估计单应矩阵序列;Using the target feature point recognition algorithm to determine the feature points of each image frame in the image sequence, and based on the feature points of each image frame, determine the estimated homography matrix sequence between any two adjacent image frames in the image sequence; 确定所述模拟单应矩阵序列以及所述估计单应矩阵序列之间的距离;determining a distance between the sequence of simulated homography matrices and the sequence of estimated homography matrices; 根据所述距离,确定针对所述目标特征点识别算法的评估信息;determining evaluation information for the target feature point recognition algorithm according to the distance; 输出所述评估信息。The evaluation information is output. 2.根据权利要求1所述的方法,其中,所述确定所述图像序列中任意两相邻图像帧之间的单应矩阵,得到模拟单应矩阵序列,包括:2. The method according to claim 1, wherein the determination of the homography matrix between any two adjacent image frames in the image sequence obtains a simulated homography matrix sequence, comprising: 根据所述模拟相机在连续扫描过程中的姿态变换,确定所述模拟单应矩阵序列。The simulated homography matrix sequence is determined according to the pose transformation of the simulated camera during continuous scanning. 3.根据权利要求2所述的方法,其中,所述根据所述模拟相机在连续扫描过程中的姿态变换,确定所述模拟单应矩阵序列,包括:3. The method according to claim 2, wherein, according to the attitude transformation of the simulated camera in the continuous scanning process, determining the simulated homography matrix sequence comprises: 根据所述模拟相机在连续扫描过程中的姿态变换,确定相机姿态序列;Determine the camera pose sequence according to the pose transformation of the simulated camera during the continuous scanning process; 根据所述相机姿态序列,确定所述模拟单应矩阵序列。According to the camera pose sequence, the simulated homography matrix sequence is determined. 4.一种用于输出信息的装置,包括:4. A device for outputting information, comprising: 获取单元,被配置成利用模拟相机以预设姿态沿预设路线移动,对目标图像进行模拟连续扫描得到图像序列;以及确定所述图像序列中任意两相邻图像帧之间的单应矩阵,得到模拟单应矩阵序列;The acquiring unit is configured to use the simulated camera to move along a preset route with a preset posture, simulate and continuously scan the target image to obtain an image sequence; and determine a homography matrix between any two adjacent image frames in the image sequence, Obtain the simulated homography matrix sequence; 估计单元,被配置成利用目标特征点识别算法确定所述图像序列中各图像帧的特征点,并基于各图像帧的特征点,确定所述图像序列中任意两相邻图像帧之间的估计单应矩阵序列;The estimation unit is configured to determine the feature points of each image frame in the image sequence by using the target feature point recognition algorithm, and determine an estimated value between any two adjacent image frames in the image sequence based on the feature points of each image frame sequence of homography matrices; 生成单元,被配置成确定所述模拟单应矩阵序列以及所述估计单应矩阵序列之间的距离;以及根据所述距离,确定针对所述目标特征点识别算法的评估信息;a generating unit configured to determine a distance between the simulated homography matrix sequence and the estimated homography matrix sequence; and determine evaluation information for the target feature point recognition algorithm according to the distance; 输出单元,被配置成输出所述评估信息。an output unit configured to output the evaluation information. 5.根据权利要求4所述的装置,其中,所述获取单元进一步被配置成:5. The device according to claim 4, wherein the acquiring unit is further configured to: 根据所述模拟相机在连续扫描过程中的姿态变换,确定所述模拟单应矩阵序列。The simulated homography matrix sequence is determined according to the pose transformation of the simulated camera during continuous scanning. 6.根据权利要求5所述的装置,其中,所述获取单元进一步被配置成:6. The device according to claim 5, wherein the acquiring unit is further configured to: 根据所述模拟相机在连续扫描过程中的姿态变换,确定相机姿态序列;Determine the camera pose sequence according to the pose transformation of the simulated camera during the continuous scanning process; 根据所述相机姿态序列,确定所述模拟单应矩阵序列。According to the camera pose sequence, the simulated homography matrix sequence is determined. 7.一种执行用于输出信息的方法的电子设备,包括:7. An electronic device for performing a method for outputting information, comprising: 至少一个处理器;以及at least one processor; and 与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein, 所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-3中任一项所述的方法。The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1-3. Methods. 8.一种存储有计算机指令的非瞬时计算机可读存储介质,所述计算机指令用于使所述计算机执行权利要求1-3中任一项所述的方法。8. A non-transitory computer-readable storage medium storing computer instructions, the computer instructions being used to cause the computer to execute the method according to any one of claims 1-3.
CN202110322610.3A 2021-03-25 2021-03-25 Method, apparatus, device and storage medium for outputting information Active CN112991179B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110322610.3A CN112991179B (en) 2021-03-25 2021-03-25 Method, apparatus, device and storage medium for outputting information

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110322610.3A CN112991179B (en) 2021-03-25 2021-03-25 Method, apparatus, device and storage medium for outputting information

Publications (2)

Publication Number Publication Date
CN112991179A CN112991179A (en) 2021-06-18
CN112991179B true CN112991179B (en) 2023-06-27

Family

ID=76333694

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110322610.3A Active CN112991179B (en) 2021-03-25 2021-03-25 Method, apparatus, device and storage medium for outputting information

Country Status (1)

Country Link
CN (1) CN112991179B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115661478A (en) * 2022-11-02 2023-01-31 北京百度网讯科技有限公司 Image processing method, device, electronic device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170066014A (en) * 2015-12-04 2017-06-14 광운대학교 산학협력단 A feature matching method which is robust to the viewpoint change
CN108230248A (en) * 2018-01-23 2018-06-29 深圳普捷利科技有限公司 A kind of assessment of viewing system splicing effect and automatic fine tuning method based on self-adaptive features point registration
CN108781267A (en) * 2016-03-24 2018-11-09 索尼公司 Image processing equipment and method
CN109166077A (en) * 2018-08-17 2019-01-08 广州视源电子科技股份有限公司 Image alignment method and device, readable storage medium and computer equipment
CN112365470A (en) * 2020-11-12 2021-02-12 中运科技股份有限公司 SIFT-based automatic matching evaluation method for advertisement materials and live photos, storage medium and computer equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20170066014A (en) * 2015-12-04 2017-06-14 광운대학교 산학협력단 A feature matching method which is robust to the viewpoint change
CN108781267A (en) * 2016-03-24 2018-11-09 索尼公司 Image processing equipment and method
CN108230248A (en) * 2018-01-23 2018-06-29 深圳普捷利科技有限公司 A kind of assessment of viewing system splicing effect and automatic fine tuning method based on self-adaptive features point registration
CN109166077A (en) * 2018-08-17 2019-01-08 广州视源电子科技股份有限公司 Image alignment method and device, readable storage medium and computer equipment
CN112365470A (en) * 2020-11-12 2021-02-12 中运科技股份有限公司 SIFT-based automatic matching evaluation method for advertisement materials and live photos, storage medium and computer equipment

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
基于ORB特征的单目视觉定位算法研究;朱永丰;朱述龙;张静静;朱永康;;计算机科学(第S1期);209-213 *
改进尺度不变特征变换算法的图像配准;范雪婷等;计算机与数字工程;1185-1190 *

Also Published As

Publication number Publication date
CN112991179A (en) 2021-06-18

Similar Documents

Publication Publication Date Title
CN112991180B (en) Image splicing method, device, equipment and storage medium
CN111767853B (en) Lane line detection method and device
CN113177472B (en) Dynamic gesture recognition method, device, equipment and storage medium
CN115082639A (en) Image generation method and device, electronic equipment and storage medium
JP2020507850A (en) Method, apparatus, equipment, and storage medium for determining the shape of an object in an image
CN113781653B (en) Object model generation method and device, electronic equipment and storage medium
CN113139905B (en) Image stitching methods, devices, equipment and media
CN112381183B (en) Target detection method and device, electronic equipment and storage medium
CN115578515B (en) Training method of three-dimensional reconstruction model, three-dimensional scene rendering method and device
CN112652057A (en) Method, device, equipment and storage medium for generating human body three-dimensional model
CN113657518B (en) Training method, target image detection method, device, electronic device and medium
CN114093006A (en) Training method, device and equipment of living human face detection model and storage medium
CN112529097B (en) Sample image generation method, device and electronic equipment
CN113688907A (en) Model training method, video processing method, device, equipment and storage medium
CN116246026B (en) Training method of three-dimensional reconstruction model, three-dimensional scene rendering method and device
CN113961746B (en) Video generation method, device, electronic equipment and readable storage medium
CN113393468A (en) Image processing method, model training device and electronic equipment
CN110782390A (en) Image correction processing method and device, electronic equipment
CN112634366B (en) Location information generation method, related devices and computer program products
CN114445825A (en) Character detection method, device, electronic device and storage medium
CN114792355A (en) Virtual image generation method and device, electronic equipment and storage medium
CN113658035A (en) Face transformation method, device, device, storage medium and product
CN116129069A (en) Calculation method, device, electronic equipment and storage medium of planar area
CN113888635B (en) Visual positioning method and related device
CN112991179B (en) Method, apparatus, device and storage medium for outputting information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant