CN111325798A - Camera model correction method, device, AR implementation device and readable storage medium - Google Patents

Abstract

The application provides a camera model correction method, a camera model correction device, AR implementation equipment and a readable storage medium. The method is applied to an AR implementation device connected with a real camera, wherein the AR implementation device stores a virtual camera model with synchronous shooting operation and the real camera shooting operation, and the method comprises the following steps: detecting the current imaging magnification numerical value of a real camera in real time; acquiring target correction shooting parameters matched with the current imaging magnification value of the real camera according to a stored parameter correction curve between the imaging magnification of the real camera and the correction shooting parameters of the virtual camera model; the shooting parameter value currently used by the virtual camera model is adjusted according to the target correction shooting parameter, so that the virtual camera model is matched with the real camera in real time, the fusion deviation between the virtual camera model and the real camera is reduced, the AR fusion accuracy is increased, and the AR effect is improved.

Description

Camera model correction method, device, AR implementation device and readable storage medium

technical field

The present application relates to the technical field of AR (Augmented Reality, augmented reality) implementation, and in particular, to a camera model correction method, apparatus, AR implementation device, and readable storage medium.

Background technique

With the continuous development of science and technology, the application fields of AR technology are becoming more and more extensive, among which the field of video surveillance is an important part of many application fields of AR technology. At present, AR effects usually need to extract panoramic features from images collected by real cameras, and fully match the extracted panoramic features to the virtual scene constructed by the virtual camera model. The existing AR effect implementation method will try to standardize the virtual camera model as much as possible in the implementation process, so as to obtain better AR effect through the standardization of the virtual camera model, but this AR effect implementation method does not take into account the real camera itself. There is a fusion deviation between the virtual camera model and the real camera due to the physical difference (for example, different shooting accuracy of the lens), which leads to the deviation of the AR overlay effect on the final real-time video, and the specific AR effect is not good.

SUMMARY OF THE INVENTION

In order to overcome the above deficiencies in the prior art, the purpose of this application is to provide a camera model correction method, device, AR implementation device and readable storage medium, the camera model correction method can The camera model is corrected to match the virtual camera model with the real camera in real time, so as to increase the accuracy of AR fusion and improve the AR effect.

In terms of method, an embodiment of the present application provides a camera model correction method, the method is applied to an augmented reality AR implementation device, the AR implementation device is connected with a real camera used for capturing images, and the AR implementation device stores There is a virtual camera model whose shooting operation is synchronized with the shooting operation of the real camera, and the method includes:

Real-time detection of the current imaging magnification value of the real camera;

According to the stored parameter correction curve between the imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model, obtain target correction shooting parameters that match the current imaging magnification value of the real camera;

The values of the shooting parameters currently used by the virtual camera model are adjusted according to the target-corrected shooting parameters, so that the virtual camera model is correspondingly matched with the real camera.

Optionally, in this embodiment of the present application, the above method further includes:

testing the corrected shooting parameters of the virtual camera model under different imaging magnifications of the real camera;

The parameter correction curve is drawn and formed based on the corrected shooting parameters obtained by testing.

Optionally, in the embodiment of the present application, the above-mentioned step of testing the correction shooting parameters corresponding to the virtual camera model under different imaging magnifications of the real camera includes:

After each adjustment of the imaging magnification of the real camera, obtain the first shooting position corresponding to the object object under the current imaging magnification in the screen coordinate system corresponding to the real camera;

Controlling the real camera and the virtual camera model to rotate and shoot according to the same shooting operation, so that the first shooting position corresponding to the real object in the screen coordinate system is moved to the first shooting position of the target;

When the target object is at the first shooting position of the target in the screen coordinate system, obtain the world coordinate system corresponding to the virtual camera model of the target object under the shooting parameters currently used by the virtual camera model The corresponding second shooting position in ;

Obtaining the second shooting position of the target corresponding to the second shooting position in the screen coordinate system according to the conversion relationship between the world coordinates and the screen coordinates;

Comparing the first shooting position of the target with the second shooting position of the target under the current shooting parameters, and adjusting the shooting parameters currently used by the virtual camera model when the positions do not overlap, until the adjusted shooting The second shooting position of the target under the parameter coincides with the first shooting position of the target;

The shooting parameters used when the second shooting position of the target coincides with the first shooting position of the target are used as the corrected shooting parameters corresponding to the current imaging magnification.

Optionally, in the embodiment of the present application, the above-mentioned step of drawing and forming the parameter correction curve based on the corrected shooting parameters obtained by testing includes:

Sort all the corrected shooting parameters obtained by the test according to the imaging magnification value corresponding to each corrected shooting parameter, and obtain multiple sets of parameter correction data after sorting, wherein each group of parameter correction data includes the corresponding imaging magnification value and corrected shooting parameters;

Drawing linear change curves between adjacent two groups of parameter correction data in the sorted sets of parameter correction data, and performing curve adjustment on the drawn linear change curves to obtain the parameter correction curves.

As far as the device is concerned, an embodiment of the present application provides a camera model correction device, the device is applied to an AR implementation device, the AR implementation device is connected to a real camera used for capturing images, and the AR implementation device stores the captured images. Operating a virtual camera model synchronized with the shooting operation of the real camera, the apparatus includes:

A magnification detection module, used for real-time detection of the current imaging magnification value of the real camera;

A parameter acquisition module, configured to obtain a target correction shooting parameter that matches the current imaging magnification value of the real camera according to the stored parameter correction curve between the imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model ;

A parameter adjustment module, configured to correct the shooting parameters according to the target and adjust the values of the shooting parameters currently used by the virtual camera model, so that the virtual camera model corresponds to the real camera.

Optionally, in this embodiment of the present application, the above-mentioned device further includes:

a parameter testing module, used for testing the corrected shooting parameters of the virtual camera model under different imaging magnifications of the real camera;

The curve drawing module is used for drawing and forming the parameter correction curve based on the corrected shooting parameters obtained by the test.

Optionally, in the embodiment of the present application, the above-mentioned parameter testing module is specifically used for:

After each adjustment of the imaging magnification of the real camera, obtain the first shooting position corresponding to the object object under the current imaging magnification in the screen coordinate system corresponding to the real camera;

Controlling the real camera and the virtual camera model to rotate and shoot according to the same shooting operation, so that the first shooting position corresponding to the real object in the screen coordinate system is moved to the first shooting position of the target;

When the target object is at the first shooting position of the target in the screen coordinate system, obtain the world coordinate system corresponding to the virtual camera model of the target object under the shooting parameters currently used by the virtual camera model The corresponding second shooting position in ;

Obtaining the second shooting position of the target corresponding to the second shooting position in the screen coordinate system according to the conversion relationship between the world coordinates and the screen coordinates;

Comparing the first shooting position of the target with the second shooting position of the target under the current shooting parameters, and adjusting the shooting parameters currently used by the virtual camera model when the positions do not overlap, until the adjusted shooting The second shooting position of the target under the parameter coincides with the first shooting position of the target;

The shooting parameters used when the second shooting position of the target coincides with the first shooting position of the target are used as the corrected shooting parameters corresponding to the current imaging magnification.

Optionally, in this embodiment of the present application, the above-mentioned curve drawing module is specifically used for:

Sort all the corrected shooting parameters obtained by the test according to the imaging magnification value corresponding to each corrected shooting parameter, and obtain multiple sets of parameter correction data after sorting, wherein each group of parameter correction data includes the corresponding imaging magnification value and corrected shooting parameters;

Drawing linear change curves between adjacent two groups of parameter correction data in the sorted sets of parameter correction data, and performing curve adjustment on the drawn linear change curves to obtain the parameter correction curves.

As far as the device is concerned, an embodiment of the present application also provides an AR implementation device, where the AR implementation device includes a processor and a non-volatile memory storing computer instructions. When the computer instructions are executed by the processor, the The AR implementation device executes any one of the above-mentioned camera model correction methods, wherein the AR implementation device is connected to a real camera for capturing images, and the AR implementation device stores a shooting operation synchronized with the shooting operation of the real camera virtual camera model.

As far as the storage medium is concerned, an embodiment of the present application also provides a readable storage medium, where the readable storage medium includes a computer program, and when the computer program runs, it controls the AR implementation device where the readable storage medium is located to execute any one of the The camera model correction method described above.

Compared with the prior art, the camera model correction method, device, AR implementation device, and readable storage medium provided by the embodiments of the present application have the following beneficial effects: the camera model correction method can The camera model is corrected to match the virtual camera model with the real camera in real time, so as to increase the accuracy of AR fusion and improve the AR effect. First, the method detects the current imaging magnification value of the real camera in real time; then, the method obtains a parameter correction curve between the stored imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model. The target correcting shooting parameters that match the current imaging magnification value of the real camera; finally, the method adjusts the shooting parameter values currently used by the virtual camera model according to the target correcting shooting parameters, so that the virtual camera The model is matched with the real camera in real time, the fusion deviation between the virtual camera model and the real camera is reduced, the AR fusion accuracy is increased, and the corresponding AR effect is improved.

In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the preferred embodiments of the present application are exemplified below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following drawings will briefly introduce the drawings that need to be used in the embodiments. It should be understood that the following drawings only show some embodiments of the present application, and therefore do not It should be regarded as a limitation on the protection scope of the claims of the present application. For those of ordinary skill in the art, other related drawings can also be obtained from these drawings without any creative effort.

FIG. 1 is a schematic block diagram of an AR implementation device provided by an embodiment of the present application.

FIG. 2 is a schematic flowchart of a first type of camera model correction method provided by an embodiment of the present application.

FIG. 3 is a schematic flowchart of a second type of camera model correction method provided by an embodiment of the present application.

FIG. 4 is a schematic flowchart of sub-steps included in step S210 shown in FIG. 3 .

FIG. 5 is a schematic flowchart of sub-steps included in step S220 shown in FIG. 3 .

FIG. 6 is a first block schematic diagram of the apparatus for correcting a camera model provided by an embodiment of the present application.

FIG. 7 is a second schematic block diagram of the apparatus for correcting a camera model provided by an embodiment of the present application.

Icon: 10-AR realization device; 11-memory; 12-processor; 13-communication unit; 100-camera model correction device; 130-magnification detection module; 140-parameter acquisition module; 150-parameter adjustment module; 110-parameter Test module; 120-Curve drawing module.

Detailed ways

In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. The components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in a variety of different configurations.

Thus, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the application as claimed, but is merely representative of selected embodiments of the application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

It should be noted that like numerals and letters refer to like items in the following figures, so once an item is defined in one figure, it does not require further definition and explanation in subsequent figures.

In the description of the present application, it should be noted that the terms "first", "second", "third", etc. are only used to distinguish descriptions, and cannot be understood as indicating or implying relative importance.

In the description of this application, it should also be noted that, unless otherwise expressly specified and limited, the terms "arrangement", "installation", "connection" and "connection" should be interpreted in a broad sense, for example, it may be a fixed connection, It can also be a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or an indirect connection through an intermediate medium, or the internal communication between the two components. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood in specific situations.

Some embodiments of the present application will be described in detail below with reference to the accompanying drawings. The embodiments described below and features in the embodiments may be combined with each other without conflict.

Please refer to FIG. 1 , which is a schematic block diagram of an AR implementation device 10 provided by an embodiment of the present application. In the embodiment of the present application, the AR implementation device 10 is communicatively connected to a real camera for capturing images through a wired network or a wireless network, and the AR implementation device 10 stores a recording operation synchronized with that of the real camera. the virtual camera model, the AR implementation device 10 realizes the AR effect through the cooperation between the virtual camera model and the real camera. When the real camera rotates and shoots, the virtual camera model will also rotate and shoot accordingly, and the rotation direction and rotation range of the virtual camera model are respectively the same as the rotation direction and rotation range of the real camera, that is, The shooting operation of the virtual camera model is synchronized with the shooting operation of the real camera. In this embodiment, the AR implementation device 10 may correct the virtual camera model according to the physical characteristics currently exhibited by the real camera, such as the imaging magnification, so that the virtual camera model matches the real camera in real time, reducing the The fusion deviation between the virtual camera model and the real camera is reduced, the AR fusion accuracy is increased, and the corresponding AR effect is improved. The AR implementation device 10 may be, but not limited to, a smart phone, a personal computer (PC), a tablet computer, a personal digital assistant (PDA), a mobile Internet device (MID) )Wait.

In this embodiment, the AR implementation device 10 includes a camera model correction device 100 , a memory 11 , a processor 12 and a communication unit 13 . The elements of the memory 11 , the processor 12 and the communication unit 13 are directly or indirectly electrically connected to each other to realize data transmission or interaction. For example, the elements of the memory 11 , the processor 12 and the communication unit 13 can be electrically connected to each other through one or more communication buses or signal lines.

In this embodiment, the memory 11 is a non-volatile memory, and the memory 11 can be used to store a virtual camera model whose shooting operation is synchronized with that of the real camera, and the memory 11 can also be used to store the real camera. A parameter correction curve between the imaging magnification of the camera and the corrected shooting parameters of the virtual camera model, where the parameter correction curve is used to represent the change of the shooting parameters currently used by the virtual camera model with the imaging magnification of the real camera The adaptation rule changes to ensure that the virtual camera model can match the real camera in real time based on the parameter correction curve, thereby reducing the fusion deviation between the virtual camera model and the real camera, and increasing AR Fusion accuracy improves the corresponding AR effect. Wherein, the shooting parameter may be the shooting focal length of the virtual camera model, or may be the shooting field angle of the virtual camera model. In this embodiment, the memory 11 can also be used to store a program, and the processor 12 can execute the program accordingly after receiving the execution instruction.

In this embodiment, the processor 12 may be an integrated circuit chip with signal processing capability. The processor 12 may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU), a network processor (Network Processor, NP), and the like. The general-purpose processor may be a microprocessor, or the processor may also be any conventional processor, etc., and may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of this application.

In this embodiment, the communication unit 13 is configured to establish a communication connection between the AR implementation device 10 and other electronic devices through a network, and to send and receive data through the network.

In this embodiment, the camera model correction apparatus 100 includes at least one software function module that can be stored in the memory 11 in the form of software or firmware or fixed in the operating system of the AR implementation device 10 . The processor 12 may be configured to execute executable modules stored in the memory 11 , such as software function modules and computer programs included in the camera model correction apparatus 100 . The AR implementation device 10 corrects the virtual camera model in real time through the camera model correction device 100, so that the virtual camera model matches the real camera in real time and reduces the difference between the virtual camera model and the real camera. The fusion deviation between the two will increase the accuracy of AR fusion, thereby improving the corresponding AR effect.

It can be understood that the block diagram shown in FIG. 1 is only a schematic structural composition diagram of the AR implementation device 10, and the AR implementation device 10 may further include more or less components than those shown in FIG. Figure 1 shows the different configurations. Each component shown in FIG. 1 may be implemented in hardware, software, or a combination thereof.

Please refer to FIG. 2 , which is a schematic flowchart of a first method for correcting a camera model provided by an embodiment of the present application. In the embodiment of the present application, the camera model correction method is applied to the AR implementation device 10, the AR implementation device 10 is connected with a real camera for capturing images, and the AR implementation device 10 stores the shooting operation and the A virtual camera model synchronized with the shooting operation of the real camera. The specific flow and steps of the camera model correction method shown in FIG. 2 are described in detail below.

In step S230, the current imaging magnification value of the real camera is detected in real time.

In this embodiment, the AR implementation device 10 may detect and acquire the current real-time camera in real time by sending a magnification acquisition request for acquiring the imaging magnification value currently used by the real camera to the real camera in real time. to determine whether the imaging magnification value of the real camera has changed.

Step S240, according to the stored parameter correction curve between the imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model, obtain target correction shooting parameters that match the current imaging magnification value of the real camera.

In this embodiment, after the AR implementation device 10 obtains the current value of the imaging magnification of the real camera, the AR implementation device 10 uses the stored imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model to determine the value of the imaging magnification. In the parameter correction curve, a method of correcting shooting parameters that matches the current imaging magnification value of the real camera is searched to obtain target correction shooting parameters that match the current imaging magnification value of the real camera.

Step S250, adjusting the value of the shooting parameter currently used by the virtual camera model according to the target correction shooting parameter, so that the virtual camera model and the real camera are correspondingly matched.

In this embodiment, when the imaging magnification value of the real camera changes, and the AR implementation device 10 obtains the corrected shooting parameters from the parameter correction curve that match the current imaging magnification value of the real camera after the change , the AR implementation device 10 corrects the shooting parameters currently used by the virtual camera model by adjusting the values of the shooting parameters currently used by the virtual camera model to the values of the target correction shooting parameters, so as to Match the virtual camera model after the shooting parameters are corrected with the real camera in real time, and the position coordinates of the target object captured by the real camera in the screen coordinate system of the real camera are corrected with the shooting parameters of the target object. The fusion deviation between the position coordinates in the world coordinate system of the virtual camera model is smaller, so as to reduce the overall fusion deviation between the virtual camera model and the real camera, and increase the AR fusion accuracy. After the display page of the AR implementation device 10 is refreshed with the corrected shooting parameters and the current imaging magnification value, a display screen with a better AR effect can be correspondingly obtained.

Please refer to FIG. 3 , which is a schematic flowchart of a second type of camera model correction method provided by an embodiment of the present application. In this embodiment of the present application, before the step S230, the camera model correction method may further include steps S210 and S220.

Step S210, testing the corrected shooting parameters of the virtual camera model under different imaging magnifications of the real camera.

Optionally, please refer to FIG. 4 , which is a schematic flowchart of the sub-steps included in step S210 shown in FIG. 3 . In this embodiment, the step S210 may include sub-step S211-sub-step S216.

Sub-step S211, after each adjustment of the imaging magnification of the real camera, obtain the first shooting position corresponding to the real object under the current imaging magnification in the screen coordinate system corresponding to the real camera.

In this embodiment, the AR implementation device 10 may create an image recognition area at the center of the screen of the real camera, so as to determine the image of a certain target object through the image recognition area, and obtain the target object accordingly and the position coordinates of the first shooting position corresponding to the target object in the screen coordinate system corresponding to the real camera. After the AR implementation device 10 adjusts the current imaging magnification of the real camera according to different imaging magnification values each time, it will determine a target object whose current image is located in the image recognition area based on the image recognition area, And obtain the first shooting position of the target object in the screen coordinate system corresponding to the real camera under the current imaging magnification.

Sub-step S212, controlling the real camera and the virtual camera model to rotate and shoot according to the same shooting operation, so that the first shooting position corresponding to the real object in the screen coordinate system is moved to the first shooting position of the target location.

In this embodiment, the first shooting position of the target may be located at the edge of the screen of the real camera, or may be located at the upper left corner of the screen of the real camera, and the specific position information can be configured differently according to requirements.

Sub-step S213, when the target object is in the first shooting position of the target in the screen coordinate system, obtain the corresponding target object in the virtual camera model under the shooting parameters currently used by the virtual camera model. The corresponding second shooting position in the world coordinate system of .

In this embodiment, when the real camera and the virtual camera model rotate and shoot according to the same shooting operation, the actual target object under the action of shooting parameters currently used by the virtual camera model is displayed in the virtual camera. The corresponding position in the world coordinate system corresponding to the model must change. And when the target object is in the first shooting position of the target in the screen coordinate system and stops moving, the target object under the shooting parameters currently used by the virtual camera model is in the world coordinate system. The position will also stop moving. At this time, the position of the target object in the world coordinate system is the second shooting position.

Sub-step S214, obtaining a target second shooting position corresponding to the second shooting position in the screen coordinate system according to the conversion relationship between the world coordinates and the screen coordinates.

In this embodiment, the AR implementation device 10 obtains the second shooting position by performing coordinate transformation on the second shooting position according to the conversion relationship between the world coordinates and the screen coordinates the corresponding second shooting position of the target in the screen coordinate system. Wherein, if the coordinates (x1, y1) in the screen coordinate system correspond to the origin coordinates (0, 0) in the world coordinate system, the first target coordinates (X1, Y1) in the screen coordinate system ) when converted to the world coordinate system, the corresponding position coordinates are (X1-x1, Y1-y1), and the second target coordinate (X2, Y2) in the world coordinate system is converted to the screen coordinate system. The position coordinates corresponding to the middle time are (X2+x1, Y2+y1). In an implementation of this embodiment, the AR implementation device 10 uses the screen center coordinates of the real camera in the screen coordinate system to correspond to the origin coordinates of the virtual camera model in the world coordinate system.

Sub-step S215, compare the position of the first shooting position of the target with the second shooting position of the target under the current shooting parameters, and adjust the shooting parameters currently used by the virtual camera model when the positions do not overlap, until The second shooting position of the target under the adjusted shooting parameters and the first shooting position of the target coincide.

In this embodiment, when the second shooting position of the target under the current shooting parameters is within the screen coverage of the real camera and does not overlap with the first shooting position of the target, the AR implementation device 10 will Decrease the shooting field of view currently used by the virtual camera model or increase the shooting focal length currently used by the virtual camera model, and based on the adjusted shooting parameters, re-obtain the current second shooting position of the target object corresponding to the actual object, and again The position comparison between the target second shooting position and the target first shooting position is performed until the target second shooting position under the adjusted shooting parameters coincides with the target first shooting position.

When the second shooting position of the target under the current shooting parameters is outside the screen coverage of the real camera and does not coincide with the first shooting position of the target, the AR implementation device 10 will increase the size of the virtual camera The shooting field angle currently used by the model or the shooting focal length currently used by the virtual camera model is reduced, and based on the adjusted shooting parameters, the second shooting position of the target currently corresponding to the real object is obtained again, and the second shooting position of the target is performed again. The position between the shooting position and the first shooting position of the target is compared until the second shooting position of the target under the adjusted shooting parameters coincides with the first shooting position of the target.

Sub-step S216, taking the shooting parameters used when the second shooting position of the target coincides with the first shooting position of the target as the corrected shooting parameters corresponding to the current imaging magnification.

Please refer to FIG. 3 again, step S220, drawing and forming the parameter correction curve based on the corrected shooting parameters obtained by testing.

Optionally, please refer to FIG. 5 , which is a schematic flowchart of the sub-steps included in step S220 shown in FIG. 3 . In this embodiment, the step S220 may include sub-step S221 and sub-step S222.

Sub-step S221, sort all the corrected shooting parameters obtained by the test according to the imaging magnification value corresponding to each corrected shooting parameter, and obtain multiple sets of parameter correction data after sorting, wherein each group of parameter correction data includes the corresponding imaging magnification value and Correct the shooting parameters.

Sub-step S222, draw linear change curves between adjacent two groups of parameter correction data in the sorted sets of parameter correction data, and perform curve adjustment on the drawn multiple linear change curves to obtain the parameter correction curve.

In this embodiment, the linear change curve is a linear curve with the imaging magnification as the independent variable and the corrected shooting parameter as the dependent variable. The AR implementation device 10 obtains two adjacent sets of parameter correction data after obtaining After the linear change curves between the group parameter correction data, the parameter correction curve including all the linear change curves is obtained by performing curve splicing on the drawn linear change curves in the same coordinate system. The AR implementation device 10 can implement the sorting process of all the corrected shooting parameters obtained by the test in an ascending order, and can also implement the sorting process of all the corrected shooting parameters obtained by the test in a descending order. The specific sorting method can be Make different configurations according to your needs.

In an implementation of this embodiment, the curve adjustment includes curve smoothing in addition to curve splicing. When the AR implementation device 10 performs the curve splicing process on a plurality of linear change curves, The parameter correction curve is obtained by performing curve smoothing processing on the curve.

Please refer to FIG. 6 , which is a first block schematic diagram of a camera model correction apparatus 100 provided by an embodiment of the present application. In the embodiment of the present application, the camera model correction device 100 includes a magnification detection module 130 , a parameter acquisition module 140 and a parameter adjustment module 150 .

The magnification detection module 130 is used for real-time detection of the current imaging magnification value of the real camera.

In this embodiment, the magnification detection module 130 may execute step S230 in FIG. 2 , and for a specific description, refer to the detailed description of step S230 above.

The parameter acquisition module 140 is configured to obtain a target correction shot that matches the current imaging magnification value of the real camera according to the stored parameter correction curve between the imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model. parameter.

In this embodiment, the parameter acquisition module 140 may execute step S240 in FIG. 2 , and for a specific description, refer to the detailed description of step S240 above.

The parameter adjustment module 150 is configured to correct the shooting parameters according to the target and adjust the values of the shooting parameters currently used by the virtual camera model, so as to make the virtual camera model correspond to the real camera.

In this embodiment, the parameter adjustment module 150 may execute step S250 in FIG. 2 , and for a specific description, refer to the detailed description of step S250 above.

Please refer to FIG. 7 , which is a second block schematic diagram of a camera model correction apparatus 100 provided by an embodiment of the present application. In this embodiment of the present application, the camera model correction apparatus 100 may further include a parameter testing module 110 and a curve drawing module 120 .

The parameter testing module 110 is configured to test the corrected shooting parameters of the virtual camera model under different imaging magnifications of the real camera.

In this embodiment, the method for testing the correction shooting parameters of the virtual camera model under different imaging magnifications of the real camera by the parameter testing module 110 includes:

After each adjustment of the imaging magnification of the real camera, obtain the first shooting position corresponding to the object object under the current imaging magnification in the screen coordinate system corresponding to the real camera;

Controlling the real camera and the virtual camera model to rotate and shoot according to the same shooting operation, so that the first shooting position corresponding to the real object in the screen coordinate system is moved to the first shooting position of the target;

When the target object is at the first shooting position of the target in the screen coordinate system, obtain the world coordinate system corresponding to the virtual camera model of the target object under the shooting parameters currently used by the virtual camera model The corresponding second shooting position in ;

Obtaining the second shooting position of the target corresponding to the second shooting position in the screen coordinate system according to the conversion relationship between the world coordinates and the screen coordinates;

Comparing the first shooting position of the target with the second shooting position of the target under the current shooting parameters, and adjusting the shooting parameters currently used by the virtual camera model when the positions do not overlap, until the adjusted shooting The second shooting position of the target under the parameter coincides with the first shooting position of the target;

The shooting parameters used when the second shooting position of the target coincides with the first shooting position of the target are used as the corrected shooting parameters corresponding to the current imaging magnification.

Wherein, the parameter testing module 110 can execute step S210 in FIG. 3 and sub-step S211-sub-step S216 in FIG. 4 . For specific description, please refer to the detailed description of step S210 and sub-step S211-sub-step S216 above. .

The curve drawing module 120 is configured to draw and form the parameter correction curve based on the corrected shooting parameters obtained by testing.

In this embodiment, the manner in which the curve drawing module 120 draws and forms the parameter correction curve based on the corrected shooting parameters obtained by testing includes:

Sort all the corrected shooting parameters obtained by the test according to the imaging magnification value corresponding to each corrected shooting parameter, and obtain multiple sets of parameter correction data after sorting, wherein each group of parameter correction data includes the corresponding imaging magnification value and corrected shooting parameters;

Drawing linear change curves between adjacent two groups of parameter correction data in the sorted sets of parameter correction data, and performing curve adjustment on the drawn linear change curves to obtain the parameter correction curves.

The curve drawing module 120 may execute step S220 in FIG. 3 and sub-step S221 and sub-step S222 in FIG. 4 . For specific description, please refer to the detailed description of step S220, sub-step S221 and sub-step S222 above.

Embodiments of the present application further provide a readable storage medium, where a computer program is stored in the readable storage medium, and the computer program controls the AR implementation device 10 where the readable storage medium is located to execute the above reward distribution method when the computer program runs. The readable storage medium may be any available medium that can be accessed by the AR implementation device 10 (eg, personal computer, server, etc.) or a data storage device such as a server, data center, etc. that includes one or more available mediums integrated. The available media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)) and other media that can store program codes. .

To sum up, in the camera model correction method, device, AR implementation device, and readable storage medium provided in the embodiments of the present application, the camera model correction method can correct the virtual camera model according to the current physical characteristics of the real camera, In order to match the virtual camera model with the real camera in real time, the AR fusion accuracy can be increased, and the AR effect can be improved. First, the method detects the current imaging magnification value of the real camera in real time; then, the method obtains a parameter correction curve between the stored imaging magnification of the real camera and the corrected shooting parameters of the virtual camera model. The target correcting shooting parameters that match the current imaging magnification value of the real camera; finally, the method adjusts the shooting parameter values currently used by the virtual camera model according to the target correcting shooting parameters, so that the virtual camera The model is matched with the real camera in real time, the fusion deviation between the virtual camera model and the real camera is reduced, the AR fusion accuracy is increased, and the corresponding AR effect is improved.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application.

Claims (10)

1. A camera model correction method applied to an Augmented Reality (AR) implementation device connected to a real camera for capturing an image, the AR implementation device having stored therein a virtual camera model whose capturing operation is synchronized with that of the real camera, the method comprising:

detecting the current imaging magnification numerical value of the real camera in real time;

acquiring target correction shooting parameters matched with the current imaging magnification value of the real camera according to a stored parameter correction curve between the imaging magnification of the real camera and the correction shooting parameters of the virtual camera model;

and adjusting the current shooting parameter value used by the virtual camera model according to the target correction shooting parameter so as to enable the virtual camera model to be correspondingly matched with the real camera.

2. The method of claim 1, further comprising:

testing correction shooting parameters corresponding to the virtual camera model under different imaging magnifications of the real camera;

and drawing and forming the parameter correction curve based on the corrected shooting parameters obtained by the test.

3. The method of claim 2, wherein the step of testing the corresponding corrected shooting parameters of the virtual camera model at different imaging magnifications of the real camera comprises:

after the imaging magnification of the real camera is adjusted each time, acquiring a first shooting position of a target object under the current imaging magnification in a screen coordinate system corresponding to the real camera;

controlling the real camera and the virtual camera model to perform rotary shooting according to the same shooting operation, so that the target object is moved to a target first shooting position in the screen coordinate system at a corresponding first shooting position;

when the target real object is located at the target first shooting position in the screen coordinate system, acquiring a second shooting position, corresponding to the target real object, in a world coordinate system corresponding to the virtual camera model under the current shooting parameters of the virtual camera model;

obtaining a corresponding target second shooting position of the second shooting position in the screen coordinate system according to a conversion relation between the world coordinate and the screen coordinate;

comparing the position of the target first shooting position with the position of the target second shooting position under the current shooting parameters, and adjusting the shooting parameters currently used by the virtual camera model when the positions are not coincident until the target second shooting position under the adjusted shooting parameters is coincident with the target first shooting position;

and taking the shooting parameters used when the second target shooting position is superposed with the first target shooting position as correction shooting parameters corresponding to the current imaging magnification.

4. The method according to claim 2 or 3, wherein the step of forming the parametric correction curve based on the tested corrected shooting parameters drawing comprises:

sequencing all the tested corrected shooting parameters according to the imaging magnification value corresponding to each corrected shooting parameter to obtain a plurality of groups of sequenced parameter correction data, wherein each group of parameter correction data comprises the corresponding imaging magnification value and the corrected shooting parameter;

and drawing linear change curves between two adjacent groups of parameter correction data in the sorted multiple groups of parameter correction data, and performing curve adjustment on the drawn linear change curves to obtain the parameter correction curves.

5. A camera model correction apparatus applied to an AR implementation device connected to a real camera for capturing an image, the AR implementation device having stored therein a virtual camera model whose capturing operation is synchronized with that of the real camera, the apparatus comprising:

the magnification detection module is used for detecting the current imaging magnification numerical value of the real camera in real time;

the parameter acquisition module is used for acquiring target correction shooting parameters matched with the current imaging magnification value of the real camera according to a stored parameter correction curve between the imaging magnification of the real camera and the correction shooting parameters of the virtual camera model;

and the parameter adjusting module is used for adjusting the shooting parameter value currently used by the virtual camera model according to the target correction shooting parameter so as to enable the virtual camera model to be correspondingly matched with the real camera.

6. The apparatus of claim 5, further comprising:

the parameter testing module is used for testing the corrected shooting parameters corresponding to the virtual camera model under different imaging magnifications of the real camera;

and the curve drawing module is used for drawing and forming the parameter correction curve based on the corrected shooting parameters obtained by the test.

7. The apparatus of claim 6, wherein the parameter testing module is specifically configured to:

after the imaging magnification of the real camera is adjusted each time, acquiring a first shooting position of a target object under the current imaging magnification in a screen coordinate system corresponding to the real camera;

controlling the real camera and the virtual camera model to perform rotary shooting according to the same shooting operation, so that the target object is moved to a target first shooting position in the screen coordinate system at a corresponding first shooting position;

when the target real object is located at the target first shooting position in the screen coordinate system, acquiring a second shooting position, corresponding to the target real object, in a world coordinate system corresponding to the virtual camera model under the current shooting parameters of the virtual camera model;

obtaining a corresponding target second shooting position of the second shooting position in the screen coordinate system according to a conversion relation between the world coordinate and the screen coordinate;

comparing the position of the target first shooting position with the position of the target second shooting position under the current shooting parameters, and adjusting the shooting parameters currently used by the virtual camera model when the positions are not coincident until the target second shooting position under the adjusted shooting parameters is coincident with the target first shooting position;

and taking the shooting parameters used when the second target shooting position is superposed with the first target shooting position as correction shooting parameters corresponding to the current imaging magnification.

8. The apparatus according to claim 6 or 7, wherein the curve-plotting module is specifically configured to:

sequencing all the tested corrected shooting parameters according to the imaging magnification value corresponding to each corrected shooting parameter to obtain a plurality of groups of sequenced parameter correction data, wherein each group of parameter correction data comprises the corresponding imaging magnification value and the corrected shooting parameter;

and drawing linear change curves between two adjacent groups of parameter correction data in the sorted multiple groups of parameter correction data, and performing curve adjustment on the drawn linear change curves to obtain the parameter correction curves.

9. An AR implementation device comprising a processor and a non-volatile memory storing computer instructions, which when executed by the processor, perform the camera model correction method of any one of claims 1 to 4, wherein the AR implementation device is connected to a real camera for capturing an image, and the AR implementation device stores therein a virtual camera model whose capturing operation is synchronized with that of the real camera.

10. A readable storage medium, characterized in that the readable storage medium comprises a computer program which, when executed, controls an AR implementing device in which the readable storage medium is located to perform the camera model correction method according to any one of claims 1 to 4.

Images