JP2018181243A - Information processor, information processor control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To inhibit waiting time between photographing of a document and display of a text read-out result from being felt long, and facilitate confirmation of the read-out result.SOLUTION: An information processor for displaying a result of reading text written in a document comprises: an image acquisition part for acquiring a still image of the document; an image display part for displaying the still image; an image extraction part for extracting a document image from the still image; and an image deformation part for deforming the document image into a front image. After displaying the still image, the image display part displays a portion of the document image so as to gradually change the portion thereof into the front image, moves the front image to a display column for displaying the result of reading the text, and display the read-out result in the display column.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing apparatus, a control method of the information processing apparatus, and a program.

  In recent years, various techniques have been developed for electronically managing business cards. For example, there is a technology that transmits an image of a business card taken using an information processing terminal such as a smart phone, a mobile phone, or a tablet equipped with a camera function to a server, and causes the server to read the entries of the business card and register it in the database It has been developed (see, for example, Patent Document 1).

JP 2003-296353 A

  By using such a technology, management of the business card can be facilitated, and, for example, the database can be searched on the go and the business card of the person in charge of the customer can be confirmed.

  If the read business card information is also registered in the contact book of the information processing terminal, it is possible to call the person in charge as it is. In this case, the user can also check on the screen whether there is an error in the reading result of the business card sent from the server.

  However, in this case, since the reading process of the business card in the server requires a certain amount of time including the communication time between the server and the information processing terminal, the user can receive the reading result of the business card from the server. I have to wait.

  In particular, when a plurality of business cards are photographed at once and an image is transmitted to the server, the amount of data to be transmitted to the server becomes large, and the time required to read the business cards on the server becomes long. The time will be longer. Furthermore, since all the plural reading results of the business card received from the server are displayed on the screen of the information processing terminal which has photographed the business card, it is difficult to know which is the reading result of which business card, and the user confirms The work is complicated.

  The present invention has been made in view of the above problems, and when reading a text described in a document such as a business card from a still image of the document, from when the document is photographed until the result of reading the text is displayed One purpose is to make it difficult for the user to feel the waiting time long and to easily confirm the result of reading the text by the user.

  An information processing apparatus according to one aspect is an information processing apparatus for displaying a reading result of a text described in a document, the image acquisition unit capturing an image of the document and acquiring a still image of the document; An image display unit for displaying an image, an image extraction unit for extracting a document image which is a portion surrounded by the outline of the document from the still image, and the document image obtained when the document is photographed from the front And the image display unit displays the still image so as to gradually change the portion of the document image in the still image to the front image. And moving the front image to a display field for displaying the reading result of the text, and displaying the reading result in the display field.

  In addition, the problems disclosed in the present application and the solution methods thereof will be clarified by the description of the section of the mode for carrying out the invention, the description of the drawings, and the like.

  It is possible to make it difficult to feel long waiting time until the result of reading the text by the server is displayed after photographing the document, and it is possible to easily confirm the result of reading the text.

BRIEF DESCRIPTION OF THE DRAWINGS It is a whole block diagram of the business card management system which concerns on one Embodiment of this invention. It is a figure which shows the hardware constitutions of the business card management server which concerns on one Embodiment of this invention. It is a figure which shows the hardware constitutions of the user terminal which concerns on one Embodiment of this invention. It shows a functional configuration of the business card management server according to an embodiment of the present invention. It is a figure which shows the business card management database which concerns on one Embodiment of this invention. It is a figure which shows the function structure of the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a flowchart which shows the flow of the whole process which concerns on one Embodiment of this invention. It is a flow chart which shows a flow of animation display processing concerning one embodiment of the present invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the dummy image which concerns on one Embodiment of this invention. It is a figure showing business card information concerning one embodiment of the present invention. It is a flowchart which shows the flow of the whole process which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention. It is a figure which shows the screen display in the user terminal which concerns on one Embodiment of this invention.

At least the following matters will be made clear by the present specification and the description of the accompanying drawings. Hereinafter, the present invention will be described according to one embodiment thereof with reference to the attached drawings.
== Business card management system ==
FIG. 1 shows the configuration of a business card management system 1000 according to an embodiment of the present invention. A business card management system 1000 according to the present embodiment is configured by communicably connecting a user terminal 100 and a business card management server 200 via a network 300, and functions as an embodiment of an information processing apparatus.

  The user terminal 100 is an information processing terminal equipped with a camera such as a smartphone, a mobile phone, a notebook computer, and a tablet. When the user terminal 100 captures a business card, the user terminal 100 transmits the still image 400 (described later) to the business card management server 200.

  When the still image 400 is sent from the user terminal 100, the business card management server 200 analyzes the still image 400, and prints the name, company name, address, telephone number, etc. printed on the business card (business card information described later) Read 620). Then, the business card management server 200 transmits the read business card information 620 to the user terminal 100.

  Then, the user terminal 100 displays the business card information 620 sent from the business card management server 200 on the screen.

  Then, the business card management server 200 registers the read business card information 620 in the business card management database 204 (described later). When the business card management server 200 receives a correction instruction of the business card information 620 from the user terminal 100, the business card management server 200 corrects the contents of the business card information 620 registered in the business card management database 204 according to the correction content.

Then, in the series of processes, the user terminal 100 displays the still image 400 of the business card on the screen, and then receives the result of reading the business card (business card information 620) from the business card management server 200 and displays it on the screen. It is devised to make it hard to make the waiting time of the staff feel as long as possible. In addition, the user terminal 100 is devised so that the user can easily confirm the business card information 620.
== Business card management server configuration ==
First, the configuration of the business card management server 200 will be described with reference to FIGS. 2 to 4.
<Hardware configuration>
The hardware configuration of the business card management server 200 is shown in FIG. The business card management server 200 is a computer including a central processing unit (CPU) 210, a memory 220, a communication device 230, a storage device 240, an input device 250, an output device 260, and a recording medium reading device 270.

  The storage device 240 stores a business card management server control program 710 executed by the business card management server 200 and various data. The business card management server control program 710 and data stored in the storage device 240 are read out to the memory 220 and executed by the CPU 210, whereby various functions of the business card management server 200 are realized. Here, the storage device 240 is a non-volatile storage device such as a hard disk drive or a solid state drive (SSD).

  The recording medium reading device 270 reads a business card management server control program 710 and data recorded on a recording medium 800 such as a CD-ROM, a DVD, a USB (registered trademark) memory, etc., and stores the data in the storage device 240.

  The communication device 230 exchanges various data and the business card management server control program 710 with the user terminal 100 and other computers (not shown) via the network 300 such as the Internet, LAN (Local Area Network), and telephone network. For example, the business card management server control program 710 and data described above may be stored in another computer, and the business card management server 200 may download these data and the business card management server control program 710 from this computer. Alternatively, a business card management database 204 described later may be constructed on another computer.

The input device 250 is an input user interface such as a keyboard and a mouse, for example. The output device 260 is, for example, an output user interface such as a display or a printer.
<Functional configuration>
Next, a functional block diagram of the business card management server 200 is shown in FIG. A business card management server 200 according to the present embodiment is configured to include an image reception unit 201, an image analysis unit 202, a reading result transmission unit 203, and a business card management database 204. Each of these functions is realized by executing the business card management server control program 710 according to the present embodiment by the hardware of the business card management server 200.

  The image reception unit 201 receives the still image 400 from the user terminal 100 via the network 300. The still image 400 is an image captured by the user terminal 100.

  The image receiving unit 201 may receive a business card image (document image) 410 or a front image 420 described later from the user terminal 100.

  The business card image 410 is an image of a portion of the business card shown in the still image 400 (an image of a portion surrounded by the outline of the business card). The front image 420 is a transformation of the business card image 410 into an image that can be obtained when the business card is photographed from the front. The front image 420 can be generated by perspective transformation of a business card image.

  The image analysis unit 202 analyzes the image (the still image 400 in this embodiment) received by the image reception unit 201 from the user terminal 100, and describes texts such as a company name, name, address, and telephone number described in a business card. Read and output as business card information 620.

  The image analysis unit 202 extracts business card information 620 from the still image 400 by performing, for example, optical character recognition / reader (OCR) on the still image 400. Alternatively, the image analysis unit 202 may perform image analysis of the still image 400 using artificial intelligence or machine learning.

  When the image reception unit 201 receives the business card image 410 or the front image 420 from the user terminal 100, the image analysis unit 202 analyzes the business card image 410 or the front image 420 to obtain business card information 620. Extract.

  The reading result transmission unit 203 transmits the business card information 620 extracted from the still image 400 to the user terminal 100 via the network 300.

  The business card management database 204 is a database that stores business card information 620. An example of the business card management database 204 is shown in FIG.

  The business card management database 204 shown in FIG. 4 includes an “ID” field, a “name” field, a “company name” field, and an “address” field.

  The identification information of the business card information 620 is recorded in the “ID” column. The identification information of the business card information 620 is, for example, uniquely assigned to each of the business card information 620 by the image analysis unit 202. The name read from the name card is recorded in the "name" column. In the "company name" column, the company name read from the business card is described. In the "address" column, the address read from the business card is described. Although not shown in FIG. 4, the business card management database 204 stores various information described in the business card, such as a telephone number, an e-mail address, and a job title.

  Further, in the business card information 620, the front image 420 from which the business card information 620 was extracted is also stored. The front image 420 registered in the business card management database 204 is generated based on the business card image 410 extracted from the still image 400 by the image analysis unit 202, but the front image 420 is sent from the user terminal 100 May be the front image 420 acquired from the user terminal 100. Of course, the business card image 410 may be registered in the business card management database 204.

Further, as described above, the business card management database 204 may be constructed on another computer (not shown) communicably connected to the business card management server 200.
== Configuration of user terminal ==
Next, the configuration of the user terminal 100 will be described with reference to FIGS. 5 and 6.
<Hardware configuration>
The hardware block diagram of the user terminal 100 is shown in FIG. The user terminal 100 is a computer including a CPU 110, a memory 120, a communication device 130, a storage device 140, an input device 150, an output device 160, and a recording medium reading device 170.

  The storage device 140 stores a user terminal control program 700 executed by the user terminal 100 and various data. Various functions of the user terminal 100 are realized by the user terminal control program 700 and data stored in the storage device 140 being read out to the memory 120 and executed by the CPU 110. Here, the storage device 140 is a non-volatile storage device such as a hard disk, an SSD, or a flash memory.

  The recording medium reading device 170 reads the user terminal control program 700 and data recorded in the recording medium 800 such as an SD card, and stores the read data in the storage device 140.

  The communication device 130 exchanges various data and the user terminal control program 700 with the business card management server 200 and other computers (not shown) via the network 300. For example, the above-described user terminal control program 700 and data may be stored in another computer, and the user terminal 100 may download data and the user terminal control program 700 from this computer.

  The input device 150 includes various buttons and switches for receiving user commands and data, a keyboard, a touch sensor for detecting a touch position on a touch panel display, an input interface such as a microphone, an acceleration sensor, a temperature sensor, a camera 151 and the like. is there.

The output device 160 is, for example, a display device such as the display 161, an output user interface such as a speaker, a vibrator, or lighting.
<Functional configuration>
FIG. 6 shows a functional block diagram of the user terminal 100. The user terminal 100 includes an image acquisition unit 101, an image display unit 102, an image transmission unit 103, an image extraction unit 104, an image deformation unit 105, and a reading result reception unit 106. Each of these functions is realized by the hardware of the user terminal 100 executing the user terminal control program 700 according to the present embodiment.

  The image acquisition unit 101 captures a business card and acquires a still image 400. The image acquisition unit 101 is realized by using, for example, a camera 151.

  The still image 400 may include not only business cards but also objects other than business cards, such as the background of business cards and people. Further, a plurality of business cards may be shown in one still image 400.

  Furthermore, the business card in the still image 400 may not only be taken from the front, but may be taken from an oblique direction. In this case, the business card is deformed and photographed in the still image 400, but it is reshaped by the image deformation unit 105 described later into an image (front image 420) to be obtained when the business card is photographed from the front.

  The image display unit 102 displays the still image 400 of the business card acquired by the image acquisition unit 101. The image display unit 102 is realized using, for example, a touch panel type display 161.

  A state in which the still image 400 is displayed on the display 161 of the user terminal 100 is shown in FIG. 7 (A). The example shown in FIG. 7A shows how three business cards are photographed at the same time. As shown in FIG. 7A, in the present embodiment, when photographing a plurality of business cards at the same time, the orientations of the respective business cards may not be aligned.

  Note that an image of a portion of a business card copied in the still image 400 (an image of a portion surrounded by the outline of the business card) is referred to as a business card image 410.

  Returning to FIG. 6, the image transmission unit 103 transmits the still image 400 to the business card management server 200. Then, as described above, the business card management server 200 analyzes the still image 400, reads a text such as a company name, a name, an address, and a telephone number described in the business card, and outputs it as business card information 620. Further, the image transmission unit 103 may transmit the business card image 410 or the front image 420 instead of transmitting the still image 400 to the business card management server 200.

  The image extraction unit 104 extracts the business card image 410 from the still image 400. The image extracting unit 104 performs various types of image processing and image analysis on the still image 400 to identify a portion where a business card is shown, and extracts the portion as a business card image 410. Image processing and image processing used by the image extraction unit 104 to extract the business card image 410 may be known techniques.

  The image transformation unit 105 transforms the business card image 410 into a front image 420 obtained when the business card is photographed from the front. The image transformation unit 105 obtains the orientation of the camera 151 when the business card is photographed based on, for example, the inclinations of the four sides which are the outline portion of the business card image 410, and performs perspective conversion to front the business card image 410. Transform to an image 420.

  The reading result receiving unit 106 receives the business card information 620 from the business card management server 200.

Here, as described above, the image display unit 102 displays the still image 400 of the business card acquired by the image acquisition unit 101 on the screen, but after displaying the still image 400 of the business card, the business card information from the business card management server 200 Until 620 is sent, animation display as shown below is performed. With such an aspect, the user terminal 100 according to the present embodiment makes it difficult to make the waiting time until the result of reading the business card information 620 sent from the business card management server 200 be displayed longer, and the business card by the user It is possible to easily check the reading results of
== Animation display process = =
Next, the flow of processing when the image display unit 102 performs the above-described animation display will be described in detail with reference to FIGS. 7 to 18.
<Overview of processing>
FIGS. 7A to 7C are diagrams showing a rough flow of animation display.

  FIG. 7A shows a state immediately after the user presses the shutter in a state where the three business cards placed on the desk are stored in the field of view of the camera 151, and the still image 400 is displayed on the display 161 of the user terminal 100. Shows how it is displayed. As shown in FIG. 7A, the image display unit 102 is a business card having a frame line of a predetermined shape (circular in the present embodiment) so as to be superimposed on the three business cards shown in the still image 400. The marker 500 is displayed.

  By such an aspect, the user can easily know that the photographed business card is correctly recognized by the user terminal 100.

  The business card marker 500 is displayed by the image display unit 102 based on the extraction result of the business card image 410 by the image extraction unit 104. Then, the image extraction unit 104 performs extraction processing of the business card image 410 before the user presses the shutter. Therefore, the business card marker 500 is displayed on the position of the business card shown in the display 161 before the user presses the shutter, and the user moves the field of view of the camera 151 to position the business card in the display 161. When changed, the position of the business card marker 500 also moves in accordance with the position of the business card.

  According to such an aspect, since the user can press the shutter after confirming that the business card in the field of view is correctly recognized by the user terminal 100, it is possible to prevent a failure in photographing.

  Next, FIG. 7B shows a state in which the portion of the business card image 410 in the still image 400 is changed to the front image 420 as a result of the image display unit 102 displaying an animation. As described above, the front image 420 is an image generated from the business card image 410 by the image transformation unit 105, and is an image that should be obtained when the business card is photographed from the front.

  When displaying the front image 420, the image display unit 102 displays the portion of the business card image 410 in the still image 400 so as to gradually change to the front image 420.

  The image display unit 102 performs perspective transformation in such a manner that the orientation of the camera 151 when photographing the business card image 410 gradually approaches perpendicular to the surface of the business card, and a plurality of front images obtained respectively by the perspective transformation By gradually displaying 420 at the position of the original business card image 410, the business card image 410 is displayed to be gradually changed to the front image 420.

  At this time, the image display unit 102 further rotates the direction of the front image 420 so that the four sides of the front image 420 gradually become parallel to the directions of the four sides of the display 161 of the user terminal 100. Is gradually enlarged by a predetermined factor (1.1 in this embodiment). A state in which the front image 420 is displayed in this manner is shown in FIG. 7 (B).

  As described above, after the user presses the shutter to obtain the still image 400 and the still image 400 is transmitted to the business card management server 200 and the image analysis is performed, the portion of the business card image 410 in the still image 400 is By performing animation display that gradually changes to the front image 420, it is possible to intuitively indicate to the user that the image recognition processing of the business card is normally in progress.

  Further, by displaying the size of the front image 420 so as to be enlarged relative to the size of the original business card image 410, even if the original business card image 410 is tilted with respect to the orientation of the display 161, Since the portion where the original business card image 410 protrudes from the front image 420 can be reduced, the user can recognize the business card image 410 without a sense of discomfort as it changes to the front image 420.

  Subsequently, in FIG. 7C, after the image display unit 102 displays the screen shown in FIG. 7B, the front image 420 is moved to the business card information display column 610, and thereafter the front image 420 is erased. FIG. 16 is a diagram showing a state in which business card information 620 received from a business card management server 200 is displayed in a business card information display column 610.

  The business card information display field 610 is a display field set by the image display unit 102 to display the business card information 620 transmitted from the business card management server 200, and corresponds to the number of business cards shown in the still image 400. Number is provided. The list of the business card information 620 displayed in the business card information display column 610 is also referred to as a list view 600. FIG. 7C shows that three business card information 620 read from three business cards is displayed in the list view 600.

According to such an aspect, it is possible to visually indicate to the user where each business card information 620 displayed in the business card information display column 610 is information read from a business card originally displayed in the still image 400. it can. Thereby, the user can easily check the reading result of the business card even when photographing a plurality of business cards at one time.
<Detailed process flow>
Next, the flow of the process of reading a business card by the user terminal 100 and the business card management server 200 according to the present embodiment will be described with reference to the flowcharts of FIGS. In addition, a more detailed animation display which is not shown in FIGS. 7A to 7C will also be described with reference to FIGS. 10 to 15.

  First, the user terminal 100 activates an application (user terminal control program 700) for executing the business card reading process according to the present embodiment (S1000).

Then, the user terminal 100 activates the camera 151, acquires a still image 400 showing the appearance of the outside world at a predetermined frame rate, and displays the still image 400 on the display 161. At the same time, the user terminal 100 performs image analysis on each still image 400 to identify the business card image 410 (S1010).
When the user terminal 100 detects the business card image 410 in the still image 400, it draws a circular business card marker 500 so as to overlap with the business card image 410 (S1020). When a plurality of business card images 410 are detected from one still image 400, the user terminal 100 draws the business card marker 500 on each business card image 410. A state in which the business card marker 500 is displayed so as to overlap the business card image 410 is shown in FIG.

  If the user presses the shutter in such a state (S1030), the user terminal 100 transmits the still image 400 to the business card management server 200 (S1040).

  Then, the business card management server 200 analyzes the still image 400 sent from the user terminal 100, and reads the text information described in the business card (S1060).

  Meanwhile, the user terminal 100 starts the animation display process (S 1070). The user terminal 100 performs an animation display process as shown in FIG.

  First, the user terminal 100 gradually displays the business card marker 500 superimposed on the business card image 410 in an opaque manner so that the business card image 410 in the still image 400 is gradually filled, and the outer shape of the business card marker 500 gradually It is deformed so as to be close to the outer shape of (S2000).

  Specifically, as shown in FIGS. 11A and 11B, the user terminal 100 colors the inside of the business card marker 500 so that the inside of the business card marker 500 is gradually darkened, and the outline of the business card marker 500 is changed from circular to the outline of the business card. Get close to the shape of

  Thereafter, as shown in FIGS. 12A to 12C, the user terminal 100 gradually changes the inside of the business card marker 500 to be transparent and gradually displays the front image 420. At the same time, the user terminal 100 rotates the front image 420 so that the four sides of the front image 420 are parallel along the four sides of the display 161 of the user terminal 100 (S2010).

  As described above, after the user presses the shutter to obtain the still image 400 and the still image 400 is transmitted to the business card management server 200 and the image analysis is performed, the portion of the business card image 410 in the still image 400 is By performing animation display that gradually changes to the front image 420, it is possible to intuitively indicate to the user that the image recognition processing of the business card is normally in progress.

  In the example described above, when the user terminal 100 changes the business card image 410 in the still image 400 to the front image 420 (S2000 and S2010), the inside of the business card marker 500 is temporarily painted opaque while the business card marker 500 In this manner, the business card image 410 in the still image 400 is gradually changed to a predetermined display mode and then changed to the front image 420 in this manner. By displaying such an animation, the user's attention can be drawn more strongly to the animation, so that it is possible to make it even harder for the user to feel the passage of time.

  Thereafter, as shown in FIG. 13A to FIG. 13B, the user terminal 100 moves the front image 420 to the business card information display field 610. At that time, the user terminal 100 deforms the front image 420 so that the outer shape of the front image 420 approaches the outer shape of the business card information display column 610 as the front image 420 approaches the business card information display column 610 (S2020) .

  According to such an aspect, it is possible to give the user the impression that the image image of the business card is collected in the business card information display section 610. Thereby, when the business card information 620 is displayed in the business card information display column 610 later and the user tries to confirm the contents of the business card information 620, the user describes the written contents of the business card information 620 with the position of the image of the business card image. It can be confirmed in a visually connected state.

  Then, as shown in FIG. 13B, when the front image 420 arrives at the business card information display column 610, the user terminal 100 erases the front image 420 and specifies a predetermined dummy image 430 in the business card information display column 610. It displays during time (S2030). In the present embodiment, the dummy image 430 is a screen in which a blurred pattern 431 colored in another color (for example, gray) is displayed on the background of the predetermined color (for example, white) in an opaque manner, as shown in FIG. By displaying such a dummy image 430 in the business card image display column 610 for a predetermined time, it is possible to show the user that the reading process of the business card is about to be completed, and the user is notified to the user. It becomes possible to make it difficult to feel the waiting time.

  Thereafter, the user terminal 100 gradually displays the dummy image 430 in a transparent manner, and displays the business card information 620 sent from the business card management server 200 in the business card information display field 610 (S2040). An example of the business card information 620 displayed in the business card information display column 610 is shown in FIG.

  Thus, when displaying the business card information 620 in the business card information display section 620, the user terminal 100 displays the dummy image 430 so as to gradually switch to the business card information 620. By such an aspect, it is possible to obscure the timing when the business card information 620 is displayed, thereby giving the user an impression as if the business card information 620 was displayed on the business card information display column 510 before long. Therefore, it is possible to make it difficult for the user to feel the passage of time.

  When the user terminal 100 performs such animation display as described above, it is possible to make it difficult for the user to feel a long waiting time until the result of reading the business card is displayed after photographing the business card, and the business card It becomes possible to easily check the reading result of

The time from when the user terminal 100 shoots a business card until the reading result of the business card is displayed on the display 161 takes only about several seconds unless the communication line is very crowded. The above-mentioned animation display is performed in these few seconds. Therefore, for the user, it is felt that the reading result of the business card is displayed in a moment while being distracted by the change of the animation that starts immediately after pressing the shutter.
Other Embodiments
Next, as another embodiment, the flow of the animation display process in the case where the user photographs a plurality of business cards at the same time will be described with reference to FIGS. In addition, about the part which the content overlaps with FIGS. 7-15, description is abbreviate | omitted suitably.

  First, the user terminal 100 determines whether a plurality of business card images 410 are detected in the still image 400 (S3000). When the number of the detected business card images 410 is one, the user terminal 100 executes the processing of S2000 to S2040 shown in FIG. 9 (S3020).

  On the other hand, when a plurality of business card images 410 are detected, the user terminal 100 selects a predetermined one of the business card images 410, and executes the processing of S2000 and S2010 shown in FIG. That is, animation is displayed so that the portion of the selected business card image 410 gradually changes to the front image 420 (S3010).

  For example, as illustrated in (1), (2), and (3) of FIG. 17, the user terminal 100 according to the present embodiment selects the business card image 410 in the order such that the business card image 410 near the upper end of the display 161 is selected first. Choose Here, the user terminal 100 performs animation display such as changing to the front image 420 by selecting the business card image 1 (410) of FIG. 17 first.

  Then, after waiting for a predetermined time (S3030), the user terminal 100 performs animation display to change sequentially to the front image 420 similarly to the remaining business card images 410 (S3010, S3030, S3040).

  When all the business card images 410 are changed to the front image 420 (S3050), the user terminal 100 performs the processing of S2020 to S2040 in FIG. 9 on the front image 420 (S3060). That is, as shown in FIG. 18, the user terminal 100 displays the dummy image 430 after moving the three front images 420 to the respective business card information display fields 610 (FIGS. 18A to 18B). Thereafter, after the dummy image 430 is erased, the business card information 620 sent from the business card management server 200 is displayed (FIGS. 18B to 18C).

  As described above, when a plurality of business card images 410 are included in the still image 400, an animation is displayed such that the plurality of business card images 410 are sequentially changed to the front image 420 one by one. By doing this, it is possible to lengthen the time required for the entire animation display until the dummy image 430 is deleted, so that even if the user terminal 100 receives the business card information 620 from the business card management server 200 later, It is possible to prevent the user from feeling as if the waiting time has increased.

  Moreover, even in this case, the animation for moving the front image 420 shown in (A) to (C) of FIG. 18 to the business card information display column 610 is performed simultaneously and parallel to all the front images 420. Therefore, the user is not confused as to which business card information 620 corresponds to which business card.

  Next, still another embodiment will be described. In the above embodiment, the user terminal 100 is connected to the business card management server 200, and the business card management server 200 extracts the business card information 620. However, it is also possible for the user terminal 100 to extract the business card information 620 by itself.

  In this case, the user terminal 100 includes an image acquisition unit 101, an image display unit 102, an image extraction unit 104, an image deformation unit 105, and an image analysis unit 202, and functions as one mode of an information processing apparatus.

  The user terminal control program 700 executed by the user terminal 100 functions as a program for causing a computer to realize the functions described above according to the present embodiment.

  Then, when the user terminal 100 captures a business card, the user terminal 100 starts the above-described animation display, analyzes the still image 400 by itself, reads the business card information 620, and displays the read result on the display 161.

  According to such an aspect, it is possible to make it difficult to feel a long waiting time until the reading result of the business card is displayed after photographing the business card, and it is possible to easily confirm the reading result of the business card. Become.

  As mentioned above, although this embodiment was described in detail, according to this embodiment, it is difficult to make the user feel a long waiting time until the result of reading the business card is displayed after photographing the business card While being able to do, it becomes possible to verify the reading result of the business card easily.

  The embodiments described above are for the purpose of facilitating the understanding of the present invention, and are not for the purpose of limiting the present invention and interpreting the same. The present invention can be changed and improved without departing from the gist thereof, and the present invention also includes the equivalents thereof.

  For example, in the above embodiment, the case of reading a business card has been described as an example, but the present invention can be widely applied to document reading processing in addition to business cards.

  In the above embodiment, the case where the front image 420 is deleted when the front image 420 arrives at the business card information display column 610 has been described, but the front image 420 may not be deleted. In this case, for example, when displaying the business card information 620 in the business card information display section 620, the user terminal 100 displays the character portion of the front image 420 so as to replace the business card information 620.

  Further, as described above, the information processing apparatus according to the above-described embodiment may be realized by the business card management system 1000 including the user terminal 100 and the business card management server 200, or the information processing apparatus is realized by the user terminal 100 alone. However, the information processing apparatus may be realized by the business card management server 200 alone.

  In this case, the business card management server 200 includes the functions of the image acquisition unit 101, the image display unit 102, the image extraction unit 104, the image deformation unit 105, and the image analysis unit 202, and is an embodiment of the information processing apparatus. Function. Then, a business card management server control program 710 executed by the business card management server 200 functions as a program for causing a computer to realize the respective functions according to the present embodiment.

  In the above embodiment, one user terminal 100 is realized by one computer, but may be realized by a plurality of computers. Similarly, one business card management server 200 may be realized by a plurality of computers.

  Furthermore, although the case where the user terminal 100 executes the user terminal control program 700 and the business card management server 200 executes the business card management server control program 710 has been described in the above embodiment, in this case, the user terminal 100 and the business card management The business card management system 1000 functions as a whole as a whole by cooperation with the server 200, and the business card management system 1000 in which the user terminal control program 700 and the business card management server control program 710 function as this one computer. It functions as one program executed above.

100 User terminal 101 Image acquisition unit 102 Image display unit 103 Image transmission unit 104 Image extraction unit 105 Image deformation unit 106 Reading result reception unit 110 CPU
120 Memory 130 Communication Device 140 Storage Device 150 Input Device 151 Camera 160 Output Device 161 Display 170 Recording Medium Reading Device 200 Business Card Management Server 201 Image Reception Unit 202 Image Analysis Unit 203 Reading Result Transmission Unit 204 Business Card Management Database 210 CPU
220 Memory 230 Communication Device 240 Storage Device 250 Input Device 260 Output Device 270 Recording Medium Reading Device 300 Network 400 Still Image 410 Business Card Image (Document Image)
420 front image 430 dummy image 431 blurring pattern 500 business card marker 600 list view 610 business card information display column 620 business card information (document information)
700 user terminal control program 710 business card management server control program 800 recording medium 1000 business card management system

Claims (10)

An information processing apparatus for displaying a reading result of text described in a document,
An image acquisition unit that captures the document and acquires a still image of the document;
An image display unit for displaying the still image;
An image extracting unit for extracting a document image which is a portion surrounded by the outline of the document from the still image;
An image deformation unit that deforms the document image into a front image obtained when the document is photographed from the front;
Equipped with
After displaying the still image, the image display unit displays a portion of the document image in the still image to be gradually changed to the front image, and displays the front image as a result of reading the text. An information processing apparatus, wherein the information processing apparatus is moved to a display field for displaying the read result in the display field. The information processing apparatus according to claim 1, wherein
The image display unit gradually changes the document image to a predetermined display mode when gradually changing the portion of the document image in the still image to the front image, and then the image display unit performs the predetermined display mode. An information processing apparatus characterized by gradually changing to a front image. The information processing apparatus according to claim 2,
After the image display unit displays a frame line of a predetermined shape superimposed on the document image, the inside of the frame line is gradually darkened while the shape of the frame line is deformed so as to gradually approach the outline of the document. An information processing apparatus characterized by gradually changing a portion of the document image in the still image to the predetermined display mode by coloring the image in such a manner that The information processing apparatus according to any one of claims 1 to 3, wherein
When changing the document image to the front image, the image display unit rotates the direction of the front image so that the four sides of the front image are along the four sides of the image display unit, and the size of the front image An information processing apparatus characterized by enlarging the size. The information processing apparatus according to any one of claims 1 to 4, wherein
When moving the front image to the display field, the image display unit deforms the front image so that the outer shape of the front image approaches the outer shape of the display field as the front image approaches the display field. An information processing apparatus characterized by causing The information processing apparatus according to claim 5, wherein
The image display unit may display the reading result after displaying a predetermined dummy image corresponding to the outer shape of the display field in the display field for a predetermined time after moving the front image to the display field. Information processing apparatus characterized by the above. The information processing apparatus according to claim 6, wherein
The image display unit, when displaying the reading result in the display field, displays the dummy image so as to be gradually switched to the reading result. The information processing apparatus according to any one of claims 1 to 7, wherein
When a plurality of document images are extracted in the still image, the image display unit sequentially changes each of the document images into a corresponding front image while shifting each of the document images by a predetermined time, Each front image is moved to each of the plurality of display fields provided for each of the front images, and then the display results of the text extracted from the respective document images are displayed in the respective display fields. Information processing device. A control method of an information processing apparatus for displaying a reading result of text described in a document,
The information processing apparatus captures the document and acquires a still image of the document.
The information processing apparatus displays the still image on a display device;
The information processing apparatus extracts a document image which is a portion surrounded by the outline of the document from the still image;
The information processing apparatus transforms the document image into a front image obtained when the document is photographed from the front,
The information processing apparatus gradually changes the portion of the document image in the still image displayed on the display device to the front image, and then moves the front image to a predetermined display field to display the display A control method of an information processing apparatus, wherein a reading result of the text is displayed in a field. A program for displaying the reading result of the text described in the document, the computer comprising
A procedure for photographing the document and acquiring a still image of the document;
Displaying the still image on a display device;
Extracting a document image which is a portion surrounded by the outline of the document from the still image;
A procedure of transforming the document image into a front image obtained when the document is photographed from the front;
After gradually changing the portion of the document image in the still image displayed on the display device to the front image, the front image is moved to a predetermined display field, and the text is read in the display field The procedure to display the result,
A program to run a program.