CN106407977A - Method and device for positioning and searching target content - Google Patents

Abstract

The invention provides a method for positioning and searching target content, which comprises the following steps: receiving a photographing instruction, and acquiring an original image comprising an illumination area; searching a target image according to the position of the illumination area in the original image; according to the searched target image, identifying the content; and searching according to the identified content, and displaying a result matched with the content. The method can quickly determine the searched area through the illumination area, is more convenient to operate and has higher searching efficiency.

Description

Method and device for location search of target content

technical field

The invention belongs to the field of image processing, in particular to a method and device for positioning and searching for target content.

Background technique

With the development of science and technology, cameras are installed on more and more electronic devices. The images acquired by the camera can facilitate users to quickly and effectively collect on-site data. For example, the camera of the learning machine can capture the image containing the topic information, combined with the text recognition tool, the text information in the image can be obtained. Matching according to the acquired text information can effectively search for topics.

Among the images collected by the camera, the image required by the user may be a part of the area. For example, when recognizing text in an image, the user only needs to recognize part of the topic content information. Therefore, users usually intercept images. At present, the image capture method is usually that the user adjusts the area size of the marquee so that it can cover the topic that the user wants to capture. After the adjustment is completed, click the OK button to complete the screenshot, and then identify the content of the screenshot, and perform a corresponding search based on the recognition result. .

Because the size of the marquee needs to be adjusted for image interception in the prior art, it is necessary to click and confirm after the adjustment is completed. The interception operation process is cumbersome, which is not conducive to improving the efficiency of image interception and search.

Contents of the invention

The purpose of the present invention is to provide a method for locating and searching target content to solve the need to adjust the size of the marquee for image interception in the prior art. After the adjustment is completed, click to confirm the operation. The interception operation process is cumbersome and unnecessary. It is beneficial to improve the efficiency of image interception and search.

In a first aspect, an embodiment of the present invention provides a method for locating and searching for target content, the method comprising:

Receive the camera command and obtain the original image including the illuminated area;

Searching for a target image according to the position of the illuminated area in the original image;

Perform content identification according to the searched target image;

Searches based on identified content and displays results that match that content.

With reference to the first aspect, in a first possible implementation manner of the first aspect, the method further includes:

An illumination area adjustment instruction is received, and the size of the illumination area is determined according to the adjustment instruction.

With reference to the first possible implementation of the first aspect, in the second possible implementation of the first aspect, the step of receiving an illumination area adjustment instruction, and determining the size of the illumination area according to the adjustment instruction specifically includes:

Start the camera and emit the first light spot;

The target image is adjusted according to the position of the first light spot and the newline mark of the text at the position of the first light spot.

With reference to the first aspect, in a third possible implementation manner of the first aspect, the step of receiving an illumination area adjustment instruction, and determining the size of the illumination area according to the adjustment instruction specifically includes:

Start the camera and emit the first light spot;

A user's touch adjustment instruction is received, the width of the first light spot is adjusted according to the horizontal touch instruction, and the height of the first light spot is adjusted according to the vertical touch instruction.

With reference to the first aspect, in a fourth possible implementation manner of the first aspect, before the step of performing a search based on the identified content and displaying a result matching the content, the method further includes:

switching the shape of the illuminated area;

The steps of searching according to the identified content and displaying results matching the content are as follows:

Searching for a corresponding search type according to the shape of the illuminated area, performing a search according to the search type and identified content, and displaying a result matching the content.

In a second aspect, an embodiment of the present invention provides an apparatus for locating and searching target content, the apparatus comprising:

an original image acquisition unit, configured to receive a photographing instruction, and acquire an original image including the illuminated area;

a target image search unit, configured to search for a target image according to the position of the illuminated area in the original image;

An image recognition unit, configured to perform content recognition according to the searched target image;

The search unit is used for searching according to the identified content and displaying the result matching the content.

With reference to the second aspect, in a first possible implementation manner of the second aspect, the device further includes:

The illumination area adjustment unit is configured to receive an illumination area adjustment instruction, and determine the size of the illumination area according to the adjustment instruction.

With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner of the second aspect, the illumination area adjustment unit includes:

The first light spot emitting subunit is used to start the camera and emit the first light spot;

The intelligent adjustment subunit is configured to adjust the target image according to the position of the first light spot and the line break mark of the text at the position of the first light spot.

With reference to the first possible implementation manner of the second aspect, in a third possible implementation manner of the second aspect, the illumination area adjustment unit includes:

The second light spot emitting subunit starts the camera and emits the first light spot;

The touch adjustment subunit is configured to receive a user's touch adjustment instruction, adjust the width of the first light spot according to the horizontal touch instruction, and adjust the height of the first light spot according to the vertical touch instruction.

With reference to the second aspect, in a fourth possible implementation manner of the second aspect, the device further includes:

a shape switching unit, configured to switch the shape of the illumination area;

The search unit is specifically configured to find a corresponding search type according to the shape of the illuminated area, perform a search according to the search type and identified content, and display a result matching the content.

In the present invention, when the user searches for the location of the target content, he only needs to obtain the original image including the illuminated area by taking a photo, intercept the illuminated area in the original image, identify the intercepted illuminated area, and perform content matching according to the recognition result Search and display the matching results. The present invention can quickly determine the search area through the illumination area, and the operation is more convenient and the search efficiency is higher.

Description of drawings

Fig. 1 is the implementation flowchart of the method for locating and searching target content provided by the first embodiment of the present invention;

FIG. 2 is a flow chart of the implementation of the method for locating and searching for target content provided by the second embodiment of the present invention;

FIG. 3 is a flow chart of the implementation of the method for locating and searching for target content provided by the third embodiment of the present invention;

FIG. 4 is a flow chart of realizing a method for locating and searching for target content provided by the fourth embodiment of the present invention;

FIG. 5 is a schematic structural diagram of an apparatus for locating and searching for target content provided by a fifth embodiment of the present invention.

detailed description

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The purpose of the embodiments of the present invention is to provide a method for locating and searching target content, so as to solve the problem that in the process of obtaining images of target areas in the prior art, the user needs to select a frame on the captured image, and after the frame selection is completed, click Confirm the key, generate the required image, and then perform a recognition search based on the image. This method of content search requires multiple operation steps for the user, and the operation is cumbersome, so that the efficiency of content location and search is low. Below in conjunction with accompanying drawing, the present invention will be further described.

Embodiment one:

Figure 1 shows the implementation process of the method for positioning and searching target content provided by the first embodiment of the present invention, which is described in detail as follows:

In step S101, a photographing instruction is received, and the original image including the illuminated area is acquired;

In the embodiment of the present invention, the photographing instruction may be triggered by a photographing button under the camera application interface. The camera application program may be a camera program invoked by an application program that needs to acquire an image of the target area.

The illuminated area in the original image may be emitted by an LED light or a laser light set on the device. Two or more beam emitting tubes can be arranged on the device to form two or more illumination areas. When the application program for acquiring the image of the target area calls the camera program, the light beam emitting tube is turned on, and when the called camera program is closed, the light beam emitting tube is correspondingly closed. The size of the illuminated area can be controlled by the hardware structure.

In the embodiment of the present invention, before receiving the photographing instruction, the method may further include:

The starting instruction of the application program generated by the hardware switch is obtained, the camera is turned on according to the starting instruction, and the light beam emitting tube is turned on. The image-capturing application program may be an application program for searching by topic, and the like.

The hardware switch described in the embodiment of the present invention may be a preset special switch for starting an application program of image capture type. Certainly, the switch may be a new switch added to the terminal, or may be defined by a certain switch based on the switch of the existing terminal, or may be two or a combination of two switches of the existing terminal.

The start instruction may be triggered when the terminal is in a standby state or a power-off state, or may be triggered when the terminal is in an activated state of other applications. When it is finally in the shutdown state, the terminal is first triggered to start up, and then the start instruction of the image capture application is processed in the startup state.

Certainly, before this step, a step of receiving an illumination area adjustment instruction and determining the size of the illumination area according to the adjustment instruction may also be included. The illumination area adjustment instruction may be adjusted automatically, or may receive a user's fine adjustment to the illumination area. The size of the illuminated area can be preset. It is also possible to select a lighting area with more usage times according to the usage record data.

In step S102, searching for a target image according to the position of the illuminated area in the original image;

Specifically, the original image in the embodiment of the present invention refers to the image directly taken by the camera, and the original image includes some information needed by the user, and also includes some unnecessary information, so the original image needs to be subsequently intercepted deal with. In the original image, when searching for a title, in addition to the title screen required by the user, it also includes other non-title content screens. If the user uses all the content in the original image to search for the topic, it will not only reduce the search efficiency, but also go against improving the accuracy of the search.

The brightness of the illuminated area in the original image can be detected on the image, and when the brightness value obviously exceeds the average brightness value in the image, it can be confirmed as the position of the illuminated area.

In the embodiment of the present invention, the number of the illumination areas may be one, or two, or more than two. The original image can be compared and searched according to the preset number of illuminated areas. When the number of searched illuminated areas is the same as the predetermined number, a more accurate search for illuminated areas can be realized.

In step S103, content identification is performed according to the searched target image.

In the embodiment of the present invention, the identification of the content can be performed locally by image identification to obtain the content in the illuminated area, so that the content can be sent to the title server for title matching, or the title can be matched locally. The content includes text, barcode, etc.).

Of course, the content identification can also be identified by the server, and the target image is received by the server, and the subsequent matching operation is performed after the target image is identified.

In step S104, a search is performed according to the identified content, and results matching the content are displayed.

The target image to be searched will only occupy a part of the original image. Therefore, compared with the content of the entire original image, the search content determined by the illumination area has a higher accuracy rate of valid text to be matched. For example, the original image contains 100 characters, but there are only 20 valid characters. Then, when using the original image for searching, on the one hand, a lot of search resources need to be wasted to complete invalid matches; on the other hand, the matching accuracy will be greatly improved. decrease. However, the search content determined by the illumination area is only 20 characters required by the user, so that the search efficiency and search accuracy can be effectively improved.

When the user locates and searches the target content, the present invention only needs to obtain the original image including the illuminated area by taking a photo, intercept the illuminated area in the original image, identify the intercepted illuminated area, perform content matching search according to the identification result, and Display the matching results. The present invention can quickly determine the search area through the illumination area, and the operation is more convenient and the search efficiency is higher.

Embodiment two:

FIG. 2 shows the implementation flow of the target content location search method provided by the second embodiment of the present invention, which is described in detail as follows:

In step S201, start the camera and emit the first light spot.

Specifically, starting the camera in this embodiment of the present invention refers to the camera that is turned on when the search application adjusts the invoked camera application. When the camera is turned on to acquire the original image, the first light spot starts to be emitted, so that the original image acquired by the camera includes the illuminated area.

In step S202, a photographing instruction is received, and the target image is adjusted according to the position of the first light spot and the line break mark of the text at the position of the first light spot.

Under normal circumstances, the area covered by the first light spot may not completely include all the content that the user needs to find. In order to be able to search and identify content more intelligently, the present invention uses the position of the first light spot and the newline mark of the text at the position of the first light spot to search for the area, and determines the target image according to the search result, and the target image includes relatively Complete user needs.

Wherein, the search for the line break mark can determine whether there is a line break mark before the line according to whether the two characters at the beginning of the line are blank. If the first two characters of the line are blank, a newline is included before the line, otherwise there is no newline.

According to the position of the first light spot and the two newline markers adjacent to the first light spot, it can be used to determine the target image.

In step S203, content identification is performed according to the searched target image.

In step S204, a search is performed according to the identified content, and results matching the content are displayed.

On the basis of Embodiment 1, the embodiment of the present invention further introduces the automatic search process of the illumination area in detail. Through the search of the position of the first light spot and the line break mark at this position, the illumination area can be precisely adjusted, In this way, more complete content can be obtained and the search accuracy can be improved.

Embodiment three:

FIG. 3 shows the implementation process of the method for locating and searching target content provided by the third embodiment of the present invention, which is described in detail as follows:

In step S301, start the camera and emit the first light spot.

Specifically, starting the camera in this embodiment of the present invention refers to the camera that is turned on when the search application adjusts the invoked camera application. When the camera is turned on to acquire the original image, the first light spot starts to be emitted, so that the original image acquired by the camera includes the illuminated area.

In step S302, a user's touch adjustment instruction is received, the width of the first light spot is adjusted according to the horizontal touch instruction, and the height of the first light spot is adjusted according to the vertical touch instruction.

The position of the illumination area can be adjusted by adjusting the direction of the beam emitting tube. The emitting angle of the beam emitting tube can be adjusted by a driving motor, and the control end of the driving motor can be connected with a controller. The controller can generate control instructions corresponding to the touch direction by detecting a specific area of the screen or a specific area of the device, so as to effectively control the emission direction of the beam emitting tube and achieve the purpose of adjusting the position of the illuminated area.

Wherein, the touch command includes horizontal touch and vertical touch, and it can be defined that when sliding to the left, the width of the first light spot is reduced; when sliding to the right, the width of the first light spot is increased; when sliding upward, the height of the first light spot is increased. When swiping down, decrease the height of the first spot.

In step S303, a photographing instruction is received, and an original image including the illuminated area is acquired.

In step S304, the target image is searched according to the position of the illuminated area in the original image.

In step S305, content recognition is performed according to the searched target image.

In step S306, a search is performed according to the identified content, and results matching the content are displayed.

On the basis of Embodiment 1, the present invention can effectively adjust the illumination area by simply touching and sliding in the four directions of up, down, left, and right, so that the user can quickly and conveniently match the illumination area with the target , and the distance between the device and the shooting page can be adjusted, so that the position of the same beam emitting tube can be adapted to the search function of target areas at different heights. It is easy to use and has high accuracy.

Embodiment four:

FIG. 4 shows the implementation flow of the method for locating and searching for target content provided by the fourth embodiment of the present invention, which is described in detail as follows:

In step S401, the shape of the illumination area is switched.

In step S402, a photographing instruction is received, and an original image including the illuminated area is acquired.

In step S403, a target image is searched according to the position of the illuminated area in the original image.

The target image can be searched intelligently according to the combination of the position of the illuminated area and the newline mark.

In step S404, content identification is performed according to the searched target image.

Specifically, the shape of the illumination area described in the examples of the present invention may be a circle, a rectangle, a square or a triangle, and the like. The command to switch the shape of the illumination area can be triggered by the volume adjustment button of the device. For example, the shape of the illuminated area can be switched according to the first sequence by pressing the volume-up button, and the shape of the illuminated area can be switched according to the second sequence by pressing the volume-down button.

In step S405, search for a corresponding search type according to the shape of the illuminated area, perform a search according to the search type and identified content, and display a result matching the content.

By presetting the correspondence between the shape of the illumination area and the search type, the corresponding search type can be found. The search type includes a barcode search type, a text title search type, and the like. Perform barcode recognition or text recognition according to the corresponding search type. The search types can also be classified according to the subjects to which the questions belong, for example, including Chinese question search types, mathematics question search types, and the like.

The difference between the embodiment of the present invention and the second embodiment is that the embodiment of the present invention also includes switching the shape of the illuminated area, and correspondingly selects the search type according to the shape of the illuminated area, thereby effectively improving the content of the target image. search efficiency.

Embodiment five:

FIG. 5 is a schematic structural diagram of an apparatus for locating and searching target content provided by an embodiment of the present invention, which is described in detail as follows:

The device for locating and searching the target content described in the embodiment of the present invention includes:

An original image acquiring unit 501, configured to receive a photographing instruction, and acquire an original image including an illuminated area;

A target image search unit 502, configured to search for a target image according to the position of the illuminated area in the original image;

An image recognition unit 503, configured to perform content recognition according to the searched target image;

The search unit 504 is configured to perform a search according to the identified content, and display a result matching the content.

Preferably, the device also includes:

The illumination area adjustment unit is configured to receive an illumination area adjustment instruction, and determine the size of the illumination area according to the adjustment instruction.

Preferably, the illumination area adjustment unit includes:

The first light spot emitting subunit is used to start the camera and emit the first light spot;

The intelligent adjustment subunit is configured to adjust the target image according to the position of the first light spot and the line break mark of the text at the position of the first light spot.

Preferably, the illumination area adjustment unit includes:

The second light spot emitting subunit starts the camera and emits the first light spot;

The touch adjustment subunit is configured to receive a user's touch adjustment instruction, adjust the width of the first light spot according to the horizontal touch instruction, and adjust the height of the first light spot according to the vertical touch instruction.

Preferably, the device also includes:

a shape switching unit, configured to switch the shape of the illumination area;

The search unit is specifically configured to find a corresponding search type according to the shape of the illuminated area, perform a search according to the search type and identified content, and display a result matching the content.

The device for locating and searching for target content in the embodiments of the present invention corresponds to the method for locating and searching for target content in Embodiments 1 to 4, and will not be repeated here.

In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or May be integrated into another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes. .

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.

Claims (10)

1. a kind of positioning searching method of object content is it is characterised in that methods described includes：

Receive photographing instruction, obtain the original image including light area；

Location lookup target image according to the light area in described original image；

According to the described target image searched, carry out content recognition；

Content according to being identified scans for, and shows the result matching with described content.

2. according to claim 1 method it is characterised in that methods described also includes：

Receive light area adjust instruction, determine the size of light area according to described adjust instruction.

3. according to claim 2 method it is characterised in that described reception light area adjust instruction, according to described adjustment Instruction determines that the size step of light area specifically includes：

Start camera and launch the first hot spot；

According to the position of described first hot spot, and the line feed mark adjustment target image of the word of the first hot spot position.

4. according to claim 2 method it is characterised in that described reception light area adjust instruction, according to described adjustment Instruction determines that the size step of light area specifically includes：

Start camera and launch the first hot spot；

The touch adjust instruction of receive user, adjusts the width of the first hot spot according to horizontal touching instruction, is referred to according to longitudinally touch The height of order adjustment the first hot spot.

5. method, it is characterised in that being scanned for according to the content being identified described, and shows according to claim 1 Before the result step matching with described content, methods described also includes：

Switch the shape of described light area；

Described scanned for according to the content being identified, and show that the result step being matched with described content is specially：

Shape according to described light area searches corresponding search-type, is entered according to the content of described search-type and identification Line search, and show the result matching with described content.

6. a kind of positioning searcher of object content is it is characterised in that described device includes：

Original image acquiring unit, for receiving photographing instruction, obtains the original image including light area；

Target image searching unit, for the location lookup target image according to the light area in described original image；

Image identification unit, for according to the described target image searched, carrying out content recognition；

Search unit, for scanning for according to the content being identified, and shows the result matching with described content.

7. according to claim 6 device it is characterised in that described device also includes：

Light area adjustment unit, for receiving light area adjust instruction, determines light area according to described adjust instruction Size.

8. according to claim 7 device it is characterised in that described light area adjustment unit includes：

First hot spot transmitting subelement, for starting camera and launching the first hot spot；

Adjustment subelement, for the position according to described first hot spot, and the changing of the word of the first hot spot position Line identifier adjusts target image.

9. according to claim 7 device it is characterised in that described light area adjustment unit includes：

Second hot spot transmitting subelement, starts camera and launches the first hot spot；

Touch adjustment subelement, for the touch adjust instruction of receive user, the first hot spot is adjusted according to horizontal touching instruction Width, adjusts the height of the first hot spot according to longitudinal touching instruction.

10. according to claim 6 device it is characterised in that described device also includes：

Shape switch unit, for switching the shape of described light area；

Described search unit searches corresponding search-type specifically for the shape according to described light area, according to described search The content of type and identification scans for, and shows the result matching with described content.