JP2018151925A - Terminal, character recognition system, control method of terminal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal which realizes a high-precision and high-speed OCR function in a cloud system. SOLUTION: A terminal has an image pickup unit that captures an image of a subject and acquires an image, and a recognition range determination unit that determines a character recognition range for causing a character recognition device to perform character recognition from the area of the acquired image. , An output unit that outputs the data of the determined character recognition range to the character recognition device. The recognition range determination unit displays the acquired image, displays a screen for the user to input a predetermined range on the displayed image, and determines the input range as the character recognition range. May be good. [Selection diagram] Fig. 1

Description

  The present invention relates to a terminal, a character recognition system, a terminal control method, and a program.

  There is a technique called OCR (Optical Character Recognition). In the OCR, OCR application software is usually mounted on a dedicated device, and high recognition accuracy and high-speed response are realized while controlling imaging conditions when an image is acquired by the application software.

  A terminal such as a smartphone has a built-in camera, and there is a terminal that realizes an OCR function using the camera (see Patent Document 1). Furthermore, the OCR function is used not only in smartphones but also in various devices. For example, Patent Document 2 discloses a license plate reader using an OCR function. Patent Document 3 discloses a technique for implementing an OCR on a cloud server by implementing an OCR function in the cloud (cloud server).

JP 2005-094782 A JP 2009-015478 A JP-A-2015-204015

  Each disclosure of the above prior art document is incorporated herein by reference. The following analysis was made by the present inventors.

  As described above, OCR may be executed on the cloud server. However, there are many problems with actually realizing the OCR function in the cloud server. Specifically, it is impossible for the cloud server to determine whether all areas of the image area provided by the user are targeted for character recognition or whether some areas are targeted for character recognition. Therefore, in the cloud server, the entire area of the image is targeted for character recognition. However, with such a correspondence, a high-speed response by the cloud server cannot be expected. Further, in order to ensure a predetermined speed (response), it is conceivable to simplify an algorithm and the like related to character recognition. However, such correspondence causes deterioration in character recognition accuracy.

  In the system disclosed in Patent Document 3, a character area is divided into a plurality of partial areas, and character recognition is performed in each partial area. However, even with such a correspondence, a character (character area) that the user does not need is recognized, and a high-speed response cannot be expected.

  It is an object of the present invention to provide a terminal, a character recognition system, a terminal control method, and a program that realize a high-precision and high-speed OCR function in a cloud system.

  According to a first aspect of the present invention, an image capturing unit that captures an image of a subject and acquires an image, and a character recognition range that causes a character recognition device to perform character recognition are determined from the acquired image region. There is provided a terminal comprising: a recognition range determination unit; and an output unit that outputs data of the determined character recognition range to the character recognition device.

  According to a second aspect of the present invention, there is provided a character recognition device and a terminal that requests the character recognition device to perform character recognition, the terminal capturing an image of a subject and acquiring an image, Determining a character recognition range that causes the character recognition device to perform character recognition from the acquired image area; and outputting data of the determined character recognition range to the character recognition device. And a character recognition system comprising an output unit.

  According to a third aspect of the present invention, a step of capturing an image of a subject and acquiring an image, a step of determining a character recognition range for causing a character recognition device to perform character recognition from the region of the acquired image, A method for controlling a terminal is provided, including the step of outputting data of the determined character recognition range to the character recognition device.

According to a fourth aspect of the present invention, a process of capturing an image of a subject and acquiring an image, a process of determining a character recognition range for causing a character recognition device to perform character recognition from the area of the acquired image, There is provided a program for causing a computer to execute a process of outputting data of the determined character recognition range to the character recognition device.
This program can be recorded on a computer-readable storage medium. The storage medium may be non-transient such as a semiconductor memory, a hard disk, a magnetic recording medium, an optical recording medium, or the like. The present invention can also be embodied as a computer program product.

  According to each aspect of the present invention, a terminal, a character recognition system, a terminal control method, and a program that realize a high-precision and high-speed OCR function in a cloud system are provided.

It is a figure for demonstrating the outline | summary of one Embodiment. It is a figure which shows an example of a structure of the character recognition system which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the terminal which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of the character recognition server which concerns on 1st Embodiment. It is a figure which shows an example of the process structure of the terminal which concerns on 1st Embodiment. It is a figure which shows an example of the basic image acquired by a camera module. It is a figure which shows an example of the candidate image produced | generated by the image synthetic | combination part. It is a figure which shows an example of the user interface produced | generated by the image verification part. It is a figure which shows an example of the user interface provided by the recognition range determination part. It is a figure which shows an example of the user interface provided by the recognition range determination part. It is a figure which shows an example of the process structure of the character recognition server which concerns on 1st Embodiment. It is a sequence diagram which shows an example of operation | movement of the character recognition system which concerns on 1st Embodiment. It is a figure for demonstrating operation | movement of the recognition range determination part which concerns on 2nd Embodiment. It is a figure which shows an example of the process structure of the terminal which concerns on one Embodiment.

  First, an outline of one embodiment will be described. Note that the reference numerals of the drawings attached to the outline are attached to the respective elements for convenience as an example for facilitating understanding, and the description of the outline is not intended to be any limitation. In addition, the connection lines between the blocks in each drawing include both bidirectional and unidirectional directions. The unidirectional arrow schematically shows the main signal (data) flow and does not exclude bidirectionality.

  A terminal 100 according to an embodiment determines a character recognition range that causes a character recognition device to perform character recognition from an imaging unit 101 that captures an image of a subject and acquires an image, and a region of the acquired image. A determination unit 102; and an output unit 103 that outputs data of the determined character recognition range to the character recognition device.

  For example, the terminal 100 displays an acquired image on a screen and provides an interface for determining a range in which the user really wants to perform character recognition from the area of the image. Thereafter, the terminal 100 transmits a predetermined range instructed to be input by the user to an external character recognition device. In the character recognition device, the character recognition target is limited, and therefore the character recognition result can be output at high speed without taking measures such as simplifying the process for character recognition.

  Hereinafter, specific embodiments will be described in more detail with reference to the drawings. In addition, in each embodiment, the same code | symbol is attached | subjected to the same component and the description is abbreviate | omitted.

[First Embodiment]
The first embodiment will be described in more detail with reference to the drawings.

  FIG. 2 is a diagram illustrating an example of the configuration of the character recognition system according to the first embodiment. Referring to FIG. 2, the character recognition system includes a terminal 10 and a character recognition server 20.

  The terminal 10 is a terminal such as a smartphone or a mobile phone, and incorporates a camera.

  The character recognition server 20 is a character recognition device that performs character recognition on an image provided by the terminal 10 (an image taken by a camera) and responds to the result of the result.

  The character recognition server 20 is a server provided by a cloud system, and the terminal 10 and the character recognition server 20 are connected via a network. In FIG. 2, one terminal 10 is illustrated, but in reality, many terminals 10 use the character recognition server 20.

[Hardware configuration]
First, the hardware configuration of various devices constituting the character recognition system according to the first embodiment will be described.

  FIG. 3 is a diagram illustrating an example of a hardware configuration of the terminal 10. The terminal 10 includes, for example, a CPU (Central Processing Unit) 11, a memory 12, a camera module 13, a liquid crystal panel and touch panel 14, a wireless signal transmission / reception circuit 15, and the like that are connected to each other via an internal bus.

  However, the configuration illustrated in FIG. 3 is not intended to limit the hardware configuration of the terminal 10. The terminal 10 may include hardware not shown. Further, the number of CPUs and the like included in the terminal 10 is not limited to the example illustrated in FIG. 3. For example, a plurality of CPUs may be included in the terminal 10.

  The memory 12 includes one or more of a random access memory (RAM), a read only memory (ROM), an auxiliary storage device (such as a hard disk), and the like.

  The camera module 13 is a module including an imaging sensor such as a lens or a CCD (Charge Coupled Device).

  The liquid crystal panel and the touch panel 14 are input / output devices for providing a user with a GUI (Graphical User Interface). The user checks the screen and message displayed on the liquid crystal panel, and operates the touch panel to input information to the terminal 10.

  The wireless signal transmission / reception circuit 15 is connected to the antenna 16 and is a circuit for transmitting / receiving a wireless signal.

  The function of the terminal 10 is realized by a processing module described later. The processing module is realized, for example, by the CPU 11 executing a program stored in the memory 12. The program can be downloaded through a network or updated using a storage medium storing the program. Furthermore, the processing module may be realized by a semiconductor chip. In other words, the function performed by the processing module may be realized by some hardware and / or software.

  FIG. 4 is a diagram illustrating an example of a hardware configuration of the character recognition server 20. The character recognition server 20 can be realized by an information processing apparatus (so-called computer), and includes an input / output interface 17 and a NIC (Network Interface Card) 18 in addition to the above-described CPU, memory, and the like.

  The input / output interface 17 is an interface of a device such as a display device or an input device. The display device is, for example, a liquid crystal display. The input device is, for example, a device that accepts user operations such as a keyboard and a mouse, and a device that inputs information from an external storage device such as a USB (Universal Serial Bus) memory. A user (for example, a cloud system administrator) inputs necessary information to the character recognition server 20 using a keyboard, a mouse, or the like.

  The NIC 18 is a communication interface connected to a communication device such as a router.

[Process module]
Subsequently, processing modules of various devices constituting the character recognition system according to the first embodiment will be described.

[Terminal]
FIG. 5 is a diagram illustrating an example of a processing configuration of the terminal 10. Referring to FIG. 5, the terminal 10 includes a wireless communication control unit 201, an imaging unit 202, an image composition unit 203, an image verification unit 204, and a recognition range determination unit 205.

  The wireless communication control unit 201 is a means for realizing communication with the character recognition server 20. The wireless communication control unit 201 accesses the network by a communication method such as mobile communication such as LTE (Long Term Evolution) or wireless LAN (Local Area Network), and communicates with the character recognition server 20.

  The imaging unit 202 is means for capturing a subject and acquiring an image (image data) by controlling the camera module 13. The imaging unit 202 acquires an image serving as a basis (source) of an image for requesting character recognition to the character recognition server 20 (hereinafter referred to as a request image).

  The imaging unit 202 acquires a plurality of basic images from the same subject. More specifically, the imaging unit 202 acquires a plurality of basic images from the same subject while changing the exposure condition. That is, the imaging unit 202 continuously captures an object while changing the exposure condition, and acquires a plurality of basic images. At that time, the imaging unit 202 continuously captures the same object while changing exposure conditions such as exposure time and ISO (International Organization for Standardization) sensitivity.

  For example, the imaging unit 202 acquires a plurality of basic images as illustrated in FIG. Note that since the imaging unit 202 acquires a plurality of basic images, the user operates to acquire a necessary number of basic images once the user presses the shutter button.

  The image synthesizing unit 203 is a unit that generates a single image by synthesizing a plurality of basic images. More specifically, the image synthesis unit 203 synthesizes a plurality of basic images acquired by the imaging unit 202, and generates an image that is a candidate for the requested image (hereinafter referred to as a candidate image). For example, the image composition unit 203 performs HDR (High Dynamic Range) composition, and generates one image (candidate image; candidate request image) from data related to a plurality of basic images. For example, when a plurality of basic images shown in FIG. 6 are combined, a candidate image as shown in FIG. 7 is obtained.

  The image verification unit 204 is means for verifying the quality of the synthesized image (candidate image). Specifically, the image verification unit 204 verifies whether “camera shake” and “out of focus” have occurred in the candidate image. Various techniques can be used to detect “camera shake” and “out of focus”. For example, the image verification unit 204 can verify whether or not “camera shake” has occurred in a candidate image using a so-called image restoration method. In addition, the image verification unit 204 can verify whether or not the candidate image is out of focus using the in-focus state determination method disclosed in Patent Document 1. Regarding the method of detecting out-of-focus, the technique described in Section 3.3 of Reference 1 (JL Pech-Paceco & G. Cristobal Imaging & Vision Dept. “Diatom autofocusing in brightfield microscopy; a comparative study”) is used. It can also be used.

  For example, the image verification unit 204 determines that the quality of the candidate image is high when neither “shake” nor “out of focus” occurs in the candidate image. In other words, the image verification unit 204 determines that the quality of the candidate image is low when at least one of “shake” and “out of focus” occurs in the candidate image.

  The image verification unit 204 may request the user to verify the quality of the candidate image. For example, the image verification unit 204 displays a message requesting quality confirmation together with the candidate image on a liquid crystal panel or the like, and inputs an instruction regarding whether or not to set the candidate image as a requested image from the user. Specifically, the image verification unit 204 performs display as shown in FIG. 8 on a liquid crystal panel or the like, and inputs an instruction from the user.

  If there is a problem with the quality of the candidate image (if the quality is low), the image verification unit 204 notifies the user that the image is to be recaptured, and instructs the image capture unit 202 to recapture the object. That is, the imaging unit 202 re-acquires an image from a subject when the quality of a candidate image generated by combining a plurality of basic images is lower than a predetermined standard (there is camera shake or out of focus). To do. If there is no problem with the quality of the candidate image, the image verification unit 204 delivers the candidate image to the recognition range determination unit 205.

  The recognition range determination unit 205 is a means for determining a character recognition range that causes the character recognition server 20 to perform character recognition from the candidate image regions. Specifically, the recognition range determination unit 205 displays a candidate image on a liquid crystal panel or the like, displays a screen for inputting a predetermined range on the displayed image by the user, and inputs the predetermined range instructed to be input. Is determined as the character recognition range. That is, the recognition range determination unit 205 is a unit that extracts a character recognition range from the candidate image and determines the character recognition range.

  For example, the recognition range determination unit 205 provides a user interface that receives an operation for inputting a character recognition range while displaying a candidate image on a liquid crystal panel or the like. In other words, the recognition range determination unit 205 provides a user interface that displays candidate images on a liquid crystal panel or the like and performs image trimming by the user.

  Various forms of the user interface provided by the recognition range determination unit 205 are conceivable.

  For example, as shown in FIG. 9A, the recognition range determination unit 205 displays a message relating to the entire candidate image and character recognition range input. The user who is in contact with the display of FIG. 9A touches the upper left of the area to be recognized by OCR, and then touches the lower right. For example, it is assumed that the user touches the pressing point 21 and the pressing point 22 as shown in FIG. When the user touches two points, the recognition range determination unit 205 sets a region surrounded by a rectangular shape with the two points input from the user as vertices as a character recognition range. In the example of FIG. 9B, a range surrounded by a dotted line including the character “ABC” is set as the character recognition range.

  In addition to the above interface, an area surrounded by a single stroke written by the user can be set as a character recognition range. For example, as shown in FIG. 10A, the recognition range determination unit 205 displays a message relating to the entire candidate image and the character recognition range input. A user who is in contact with the display of FIG. 10A operates the touch panel so as to enclose a range for character recognition with a finger. For example, as shown in FIG. 10B, when a trajectory by the user's finger is drawn on the upper left via the upper left, lower right, and lower left of the area including the character “ABC”, the area is surrounded by a dotted line 23 The selected range is set as the character recognition range.

  The recognition range determination unit 205 determines a range designated by the user as a character recognition range, and cuts out the range from the candidate image. The recognition range determination unit 205 transmits an image related to the extracted character recognition range to the character recognition server 20 via the wireless communication control unit 201 (output unit). An image related to the character recognition range cut out from the candidate image is the request image. The recognition range determination unit 205 transmits the data related to the requested image to the character recognition server 20 with the identifier (for example, MAC (Media Access Control) address) of the own device (terminal 10).

[Character recognition server]
FIG. 11 is a diagram illustrating an example of a processing configuration of the character recognition server 20. Referring to FIG. 11, the character recognition server 20 includes a communication control unit 301, an image management unit 302, a character recognition control unit 303, and a character recognition unit 304.

  The communication control unit 301 is means for controlling communication with the terminal 10. When the communication control unit 301 acquires data related to the requested image from the terminal 10, the communication control unit 301 delivers the image data to the image management unit 302.

  The image management unit 302 is a means for managing request images received from the terminal 10. Specifically, when receiving image data from the terminal 10, the image management unit 302 classifies the received image data for each receiving terminal and stores it in a storage medium.

  The character recognition control unit 303 is a unit that causes the character recognition unit 304 to perform character recognition based on image data stored in the storage medium. Specifically, the character recognition control unit 303 reads the image data stored in the storage medium in the order in which it is stored, and provides the read data to the character recognition unit 304. Further, the character recognition control unit 303 transmits the result (recognized character string) output from the character recognition unit 304 to the terminal 10 that is the transmission source of the request image that has been character-recognized.

  The character recognition unit 304 is an execution engine for the OCR function, and executes processing related to image conversion, pattern matching and the like necessary for character recognition. The character recognition unit 304 outputs the result of character recognition to the character recognition control unit 303.

[System Operation]
Next, the operation of the character recognition system according to the first embodiment will be described with reference to FIG. FIG. 12 is a sequence diagram illustrating an example of the operation of the character recognition system according to the first embodiment.

  In step S01, the terminal 10 captures a subject by an operation from the user. At that time, the terminal 10 acquires a plurality of basic images by continuous shooting while changing the exposure conditions.

  In step S02, the terminal 10 combines a plurality of basic images and generates one candidate image.

  In step S03, the terminal 10 verifies the quality of the candidate image. Specifically, the terminal 10 verifies the quality of the candidate image, and verifies the quality of the candidate image by determining whether “camera shake”, “out of focus”, or the like has occurred in the candidate image.

  If it is a low-quality candidate image (step S04, N branch), the terminal 10 notifies the user that the object is to be re-photographed (step S05), and repeats the processing after step S01. If it is a high-quality candidate image (step S04, Y branch), the terminal 10 makes a determination related to the character authentication range (step S06). Specifically, the terminal 10 displays the interface screen shown in FIGS. 9 and 10 and determines the character recognition range by an operation from the user.

  The terminal 10 cuts out the character recognition range designated by the user from the candidate image, and creates data related to the requested image. The terminal 10 transmits data relating to the requested image to the character recognition server 20 (step S07). That is, the terminal 10 requests the cloud system for character recognition of the transmitted image.

  The character recognition server 20 performs character recognition on the received image (step S08).

  The character recognition server 20 transmits the recognition result (recognized character) to the terminal 10 (step S09).

  As described above, the terminal 10 according to the first embodiment acquires a plurality of basic images and combines the plurality of images to generate a high-quality candidate image. Then, the terminal 10 verifies whether there is a problem in the quality of the candidate image, and provides (displays) the candidate image having no problem to the user. Furthermore, the user determines a range in which the character recognition is to be truly performed in the candidate image area. As a result, character authentication in a useless area for the user is not executed by the character recognition server 20. Therefore, it is possible to achieve both a high-speed response of the character recognition server 20 and high recognition accuracy.

[Second Embodiment]
Next, a second embodiment will be described in detail with reference to the drawings.

  In the second embodiment, a case will be described in which the terminal 10 automatically determines a character recognition range from candidate images.

  In the second embodiment, a case will be described in which the terminal 10 automatically detects a range including a character string added to a standard document or the like, and uses the detected range as a request image. In the second embodiment, the system configuration, the hardware configuration of the terminal 10, etc., and the processing configuration can be the same as the configuration described in the first embodiment, so that the description corresponding to FIG. Is omitted.

  The recognition range determination unit 205 according to the second embodiment compares the template image of the standard document with an image (candidate image) photographed by the user, and characterizes different areas between the two images. Set to recognition range. For example, the image shown in FIG. 13A is a template image, and the image shown in FIG. 13B is a candidate image (an image with no problem in quality).

  The recognition range determination unit 205 calculates a difference between pixel values at corresponding positions (coordinates) of two images. As a result, at each point of the candidate image, the difference value at a point that does not change from the template image becomes a small value, and at a point where there is a change, the difference value increases. The recognition range determination unit 205 sets an area including many points having a difference value larger than a predetermined threshold as the character recognition range. For example, in the example of FIG. 13, an area 31 where a 12-digit number is written is set as the character recognition range.

  Actually, the size (number of dots) does not always match between the template image and the candidate image. Accordingly, the recognition range determination unit 205 executes a process related to extraction of the character recognition range after performing geometric conversion or the like for converting the size of the candidate image into the size of the template image in order to calculate the character recognition range with high accuracy. Is desirable.

  Further, in order to allow a subtle difference between two images, a plurality of pixels may be grouped into one group, a pixel value for each group may be calculated, and the two images may be compared. For example, four pixels are set as one group, and an average value of the four pixel values is set as a representative value of the group (set to a group pixel value). The recognition range determination unit 205 can absorb subtle differences between the two images by using the pixel values of the group calculated in the same manner from the two images for determining (extracting) the character recognition range. That is, the recognition range determination unit 205 absorbs subtle differences between images by reducing the resolution of the two images to be compared and making a rough comparison of the ranges.

  As described above, in the second embodiment, the terminal 10 automatically determines the character recognition range. As a result, it is not necessary for the user to determine the character recognition range, and convenience is improved.

  The configuration or the like of the character recognition system described in the above embodiment is an example, and is not intended to limit the configuration of the system. For example, not only the terminal 10 such as a smartphone but also an image acquired from a scanner by a stationary computer may be targeted. However, in this case, since it is considered that there is no problem such as camera shake in the candidate image acquired from the scanner, the processing related to the “image composition unit” or “image verification unit” may be omitted as necessary. That is, the image composition process and the image verification process described in the above embodiment may be omitted.

  Alternatively, some of the processes executed by the terminal 10 may be executed by an external server or the like. For example, the process of combining a plurality of images may be executed by an external server such as the character recognition server 20.

  In the above embodiment, the image verification unit 204 determines the quality of a candidate image, and when a low-quality candidate image is obtained, a plurality of new basic images are acquired by the imaging unit 202. However, before the image verification unit 204 requests the image capturing unit 202 to reacquire the image, if correction of the candidate image is attempted and a sufficiently high quality candidate image is obtained, the image capturing unit 202 must reacquire the image. You don't have to ask. In this case, the terminal 10 includes an image correction unit 206 (see FIG. 14).

  In the above embodiment, the terminal 10 checks the quality of the candidate image. However, as shown in FIG. 8, the user 10 may be asked to check the quality of the candidate image. In that case, the quality of the candidate image may be checked on the user interface screen for determining the character recognition range (FIGS. 9 and 10). That is, a “re-acquisition” button may be provided on the screen of FIG. 9 or the like, and the subject image may be re-acquired when the button is pressed.

  In the above embodiment, the imaging unit 202 acquires a plurality of basic images while changing the imaging conditions from the beginning, but may initially acquire a single basic image. Alternatively, the imaging unit 202 may acquire a plurality of basic images from the subject by setting conditions different from the previous imaging conditions when re-acquiring the subject image.

  In the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in each embodiment is not limited to the description order. In each embodiment, the order of the illustrated steps can be changed within a range that does not hinder the contents, for example, the processes are executed in parallel. Moreover, the matter demonstrated by the said embodiment can be combined in the range which does not conflict.

A part or all of the above embodiments can be described as in the following supplementary notes, but is not limited thereto.
[Appendix 1]
It is as the terminal which concerns on the above-mentioned 1st viewpoint.
[Appendix 2]
The recognition range determination unit
The acquired image is displayed, and a screen for the user to input a predetermined range on the displayed image is displayed, and the predetermined range instructed to input is determined as the character recognition range. Terminal.
[Appendix 3]
The recognition range determination unit
The terminal according to appendix 1, wherein the acquired image is compared with a predetermined template image, and an area where the acquired image and the template image are different is determined as the character recognition range.
[Appendix 4]
The imaging unit acquires a plurality of images from the same subject,
An image generation unit that generates one image by combining the plurality of images;
The terminal according to any one of appendices 1 to 3, wherein the recognition range determination unit determines the character recognition range from the combined image.
[Appendix 5]
The terminal according to appendix 4, wherein the imaging unit acquires a plurality of images from the same subject while changing an exposure condition.
[Appendix 6]
An image verification unit that verifies the quality of the synthesized image;
The terminal according to appendix 4 or 5, wherein the imaging unit reacquires an image from the subject when the quality of the synthesized image is lower than a predetermined reference.
[Appendix 7]
It is as the character recognition system concerning the above-mentioned 2nd viewpoint.
[Appendix 8]
The recognition range determination unit
The acquired image is displayed, a screen for a user to input a predetermined range on the displayed image is displayed, and the predetermined range instructed to input is determined as the character recognition range. Character recognition system.
[Appendix 9]
The recognition range determination unit
The character recognition system according to appendix 7, wherein the acquired image is compared with a predetermined template image, and an area where the acquired image and the template image are different is determined as the character recognition range.
[Appendix 10]
The imaging unit acquires a plurality of images from the same subject,
The terminal further includes an image generation unit that generates one image by combining the plurality of images,
The character recognition system according to any one of appendices 7 to 9, wherein the recognition range determination unit determines the character recognition range from the synthesized image.
[Appendix 11]
The character recognition system according to appendix 10, wherein the imaging unit acquires a plurality of images from the same subject while changing an exposure condition.
[Appendix 12]
The terminal further includes an image verification unit that verifies the quality of the synthesized image,
The character recognition system according to appendix 10 or 11, wherein the imaging unit re-acquires an image from the subject when the quality of the synthesized image is lower than a predetermined reference.
[Appendix 13]
This is the same as the terminal control method according to the third aspect described above.
[Appendix 14]
It is as the program which concerns on the above-mentioned 4th viewpoint.
Note that the form of Supplementary Note 13 and the form of Supplementary Note 14 can be expanded to the form of Supplementary Note 2 to the form of Supplementary Note 6, similarly to the form of Supplementary Note 1.

  Each disclosure of the cited patent documents and the like cited above is incorporated herein by reference. Within the scope of the entire disclosure (including claims) of the present invention, the embodiments and examples can be changed and adjusted based on the basic technical concept. In addition, various combinations or selections of various disclosed elements (including each element in each claim, each element in each embodiment or example, each element in each drawing, etc.) within the scope of the entire disclosure of the present invention. Is possible. That is, the present invention of course includes various variations and modifications that could be made by those skilled in the art according to the entire disclosure including the claims and the technical idea. In particular, with respect to the numerical ranges described in this document, any numerical value or small range included in the range should be construed as being specifically described even if there is no specific description.

10, 100 Terminal 11 CPU
12 memory 13 camera module 14 liquid crystal panel and touch panel 15 wireless signal transmission / reception circuit 16 antenna 17 input / output interface 18 NIC
20 Character recognition server 21, 22 Press point 23 Dotted line 31 Area 101, 202 Imaging unit 102, 205 Recognition range determination unit 103 Output unit 201 Wireless communication control unit 203 Image composition unit 204 Image verification unit 206 Image correction unit 301 Communication control unit 302 Image management unit 303 Character recognition control unit 304 Character recognition unit

Claims (14)

An imaging unit for capturing an image of a subject and acquiring an image;
A recognition range determination unit that determines a character recognition range that causes a character recognition device to perform character recognition from the acquired image region;
An output unit for outputting data of the determined character recognition range to the character recognition device;
Comprising a terminal. The recognition range determination unit
2. The acquired image is displayed, and a screen for a user to input a predetermined range on the displayed image is displayed, and the predetermined range instructed to input is determined as the character recognition range. Terminal. The recognition range determination unit
The terminal according to claim 1, wherein the acquired image is compared with a predetermined template image, and an area where the acquired image and the template image are different is determined as the character recognition range. The imaging unit acquires a plurality of images from the same subject,
An image generation unit that generates one image by combining the plurality of images;
The terminal according to any one of claims 1 to 3, wherein the recognition range determination unit determines the character recognition range from the synthesized image.   The terminal according to claim 4, wherein the imaging unit acquires a plurality of images from the same subject while changing an exposure condition. An image verification unit that verifies the quality of the synthesized image;
The terminal according to claim 4 or 5, wherein the imaging unit re-acquires an image from the subject when the quality of the synthesized image is lower than a predetermined reference. A character recognition device;
A terminal requesting character recognition to the character recognition device;
Including
The terminal
An imaging unit for capturing an image of a subject and acquiring an image;
A recognition range determination unit that determines a character recognition range that causes the character recognition device to perform character recognition from the acquired image region;
An output unit for outputting data of the determined character recognition range to the character recognition device;
A character recognition system. The recognition range determination unit
8. The acquired image is displayed and a screen for a user to input a predetermined range on the displayed image is displayed, and the predetermined range instructed to input is determined as the character recognition range. Character recognition system. The recognition range determination unit
The character recognition system according to claim 7, wherein the acquired image is compared with a predetermined template image, and an area where the acquired image and the template image are different is determined as the character recognition range. The imaging unit acquires a plurality of images from the same subject,
The terminal further includes an image generation unit that generates one image by combining the plurality of images,
The character recognition system according to any one of claims 7 to 9, wherein the recognition range determination unit determines the character recognition range from the synthesized image.   The character recognition system according to claim 10, wherein the imaging unit acquires a plurality of images from the same subject while changing an exposure condition. The terminal further includes an image verification unit that verifies the quality of the synthesized image,
The character recognition system according to claim 10 or 11, wherein the imaging unit re-acquires an image from the subject when the quality of the synthesized image is lower than a predetermined reference. Capturing a subject and capturing an image;
Determining a character recognition range for causing the character recognition device to perform character recognition from the acquired image area; and
Outputting data of the determined character recognition range to the character recognition device;
Including a terminal control method. Processing to capture an image of a subject and acquire an image;
A process for determining a character recognition range for causing a character recognition device to perform character recognition from the acquired image area;
A process of outputting data of the determined character recognition range to the character recognition device;
A program that causes a computer to execute.

Images