WO2025134943A1 - Oral cavity state analysis system, oral cavity state analysis program, storage medium for storing oral cavity state analysis program, and oral cavity state analysis method - Google Patents

Abstract

[Problem] To provide an oral cavity state analysis system and an oral cavity state analysis program for analyzing the oral cavity state, the system and program making it possible to easily acquire an oral cavity image suitable for analyzing the oral cavity state. [Solution] The present invention comprises: a video reception unit 251 that continuously receives, as input from an imaging unit 21 of a user terminal 2, a facial image V of a user U captured by the imaging unit 21; an image detection unit 252 that detects a mouth image F from the facial image V; a teeth detection unit 253 that detects a teeth area TA in the mouth image F; a gum detection unit 254 that detects a gum area GA in the mouth image F; a determination unit 256 that determines whether at least one of the teeth area TA and the gum area GA included in the mouth image F satisfies a prescribed condition; an image acquisition unit 257 that acquires a single or a plurality of mouth images F determined by the determination unit 256 to satisfy the condition; and an analysis unit 258 that analyzes the oral cavity state on the basis of the mouth image F acquired by the image acquisition unit 257.

Description

Oral cavity condition analysis system, oral cavity condition analysis program, storage medium for storing oral cavity condition analysis program, and oral cavity condition analysis method

The present invention relates to an oral condition analysis system that analyzes the oral condition, an oral condition analysis program, a storage medium that stores the oral condition analysis program, and an oral condition analysis method.

In recent years, with the development of technology, analysis systems have been proposed that analyze the condition of the oral cavity based on images of the oral cavity captured by a camera on a mobile device such as a smartphone (see, for example, Patent Document 1).

International Publication No. 2015/016377

In such an analysis system, the user performs the operations of capturing a facial image as shown in FIG. 10(a) and acquiring an oral cavity image for analysis from the facial image as shown in FIG. 10(b). FIG. 10 is a schematic diagram showing the user's operations in a conventional analysis system. However, since both are facial images and oral cavity images selected by the user, they do not necessarily contain areas or ranges suitable for analyzing the oral cavity condition. In addition, the user must repeat the operations of capturing a facial image and acquiring an oral cavity image from the facial image until they acquire an oral cavity image that they consider suitable for analyzing the oral cavity condition, which is inconvenient.

The object of the present invention is to provide an oral condition analysis system and oral condition analysis program that can automatically obtain oral images suitable for analyzing the oral condition.

That is, the present invention includes the following inventions.
(1) An oral cavity condition analysis system comprising: a video receiving unit that continuously receives facial images of a user captured by an imaging unit of a user terminal as input from the imaging unit; an image detection unit that detects an image including a mouth area from the facial images received by the video receiving unit; a teeth detection unit that detects a dental area from the image including the mouth area; a gum detection unit that detects a gum area from the image including the mouth area; a determination unit that determines whether at least one of the dental area and the gum area included in the image including the mouth area satisfies predetermined conditions necessary for analyzing an oral cavity condition; an image acquisition unit that acquires one or more images including the mouth area that are determined by the determination unit to satisfy the conditions; and an analysis unit that analyzes the oral cavity condition based on the images including the mouth area acquired by the image acquisition unit.

With this configuration, oral cavity images suitable for analyzing the oral cavity condition can be automatically acquired without the user having to perform repeated operations, providing a convenient oral cavity condition analysis system.

(2) The oral cavity condition analysis system described in (1) is provided with an excluded object detection unit that detects excluded objects other than the tooth area and the gum area from an image including the mouth area.

With this configuration, areas other than the tooth and gum regions are detected as areas to be excluded when analyzing the condition of the oral cavity, making the tooth and gum regions clearer and improving the accuracy of analyzing the condition of the oral cavity.

(3) The oral cavity condition analysis system described in (1) in which the determination unit records at least one of the tooth region and the gum region, which changes for each image including the mouth region, as time-series data, and determines whether the image including the mouth region satisfies predetermined conditions necessary for analyzing the oral cavity condition based on the time-series data.

With this configuration, at least one of the tooth regions and gum regions detected by the tooth detection unit and gum detection unit is recorded as time-series data, allowing the determination unit to accurately determine whether or not the predetermined conditions required for analyzing the oral cavity state are met.

(4) The oral cavity condition analysis system described in (3) is provided with a guidance display unit that displays a guidance means for guiding the mouth area to a predetermined position on the display screen of the user terminal on which the facial image is displayed.

With this configuration, the guidance means displayed by the guidance display unit guides the user's mouth area on the display screen of the user terminal to a position where an image including the mouth area that satisfies the predetermined conditions necessary for analyzing the oral cavity state is likely to be acquired, thereby allowing an image including the mouth area to be acquired efficiently.

(5) The oral cavity condition analysis system described in (3) in which the tooth detection unit extracts the tooth region from the image including the mouth region by color space conversion and a predetermined threshold, and the gum detection unit applies a differential filter to the image including the mouth region and detects the gum region using a flattening filter and a predetermined threshold.

(6) An oral cavity condition analysis program for causing a computer to function as: a video reception unit that continuously receives, as input from an imaging unit of a user terminal, facial images of a user captured by the imaging unit; an image detection unit that detects an image including a mouth area from the facial images received by the video reception unit; a teeth detection unit that detects a dental area from among the images including the mouth area; a gum detection unit that detects a gum area from among the images including the mouth area; a determination unit that determines whether or not at least one of the dental area and the gum area included in the image including the mouth area satisfies a predetermined condition required for analyzing the oral cavity condition; an image acquisition unit that acquires one or more images including the mouth area that have been determined by the determination unit to satisfy the condition; and an analysis unit that analyzes the oral cavity condition based on the images including the mouth area acquired by the image acquisition unit.

(7) A computer-readable recording medium having recorded thereon an oral condition analysis program for causing a computer to function as: a video reception unit that continuously receives, as input from an imaging unit of a user terminal, facial images of a user captured by the imaging unit; an image detection unit that detects an image including a mouth area from the facial images received by the video reception unit; a teeth detection unit that detects a dental area from among the images including the mouth area; a gum detection unit that detects a gum area from among the images including the mouth area; a determination unit that determines whether or not at least one of the dental area and the gum area included in the image including the mouth area satisfies a predetermined condition required for analyzing an oral condition; an image acquisition unit that acquires one or more images including the mouth area that are determined by the determination unit to satisfy the condition; and an analysis unit that analyzes an oral condition based on the images including the mouth area acquired by the image acquisition unit.

(8) A method for analyzing an oral condition, comprising: continuously receiving, as input from an imaging unit of a user terminal, facial images of a user captured by the imaging unit; detecting an image including a mouth area from the facial images; detecting a tooth area and a gum area from the image including the mouth area; determining whether or not at least one of the tooth area and the gum area included in the image including the mouth area satisfies a predetermined condition required for analyzing the oral condition; acquiring one or more images including the mouth area that are determined to satisfy the condition; and analyzing the oral condition based on the acquired images including the mouth area.

This method makes it possible to automatically obtain oral cavity images suitable for analyzing the oral cavity condition without requiring the user to perform repeated operations, providing a convenient method for analyzing the oral cavity condition.

(9) The method for analyzing an oral condition according to (8), further comprising detecting excluded objects other than the tooth region and the gum region from the image including the mouth region.

With this method, areas other than the tooth and gum regions are detected as areas to be excluded when analyzing the condition of the oral cavity, making the tooth and gum regions clearer and improving the accuracy of analyzing the condition of the oral cavity.

(10) A method for analyzing an oral cavity condition described in (8), which records at least one of the tooth region and the gum region, which changes for each image including the mouth region, as time-series data, and further determines whether the image including the mouth region satisfies predetermined conditions necessary for analyzing the oral cavity condition based on the time-series data.

In this method, at least one of the tooth regions and gum regions detected by the tooth detection unit and gum detection unit is recorded as time-series data, allowing the determination unit to accurately determine whether or not the predetermined conditions required for analyzing the oral cavity state are met.

The present invention can automatically obtain oral images suitable for analyzing the oral condition, and can provide a convenient oral condition analysis system, an oral condition analysis program, a storage medium for storing the oral condition analysis program, and an oral condition analysis method.

FIG. 1 is a block diagram showing an oral cavity condition analyzing system according to an embodiment of the present invention. 3 is a schematic diagram showing a face image captured by an imaging unit; 3 is a schematic diagram showing a mouth image detected from the face image shown in FIG. 2; 4 is a schematic diagram showing a tooth region detected by a tooth detection unit in the mouth image shown in FIG. 3 . 4 is a schematic diagram showing a gum region detected by a gum detection unit in the mouth image shown in FIG. 3; 4 is a schematic diagram showing other regions detected by an exclusion target detection unit in the mouth image shown in FIG. 3 . 11 is a graph showing an example of time-series data in which a tooth region value and a gum region value are recorded at predetermined intervals by a determination unit. 8 is a graph showing an example of the amount of change in the tooth area TA value and the gum area GA value in the time-series data shown in FIG. 7 . 2 is a flowchart showing the flow of the oral cavity condition analysis system shown in FIG. 1 . FIG. 13 is a schematic diagram showing a user's operation in a conventional analysis system.

Below, an embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1, the oral condition analysis system 1 is implemented in a user terminal 2 used by a user.

The user terminal 2 is equipped with at least an imaging unit 21, a display unit 23, an information processing unit 25, and an information storage unit 27. The user terminal 2 may be a personal computer or a tablet terminal as long as it is a terminal that receives operations for analyzing the oral cavity condition, and a smartphone is preferable in terms of portability. In the following explanation, a smartphone will be described as the user terminal 2.

The imaging unit 21 is a camera that captures the user's face. The display unit 23 is a display screen such as a touch panel that accepts user operations and displays the face image V continuously captured by the imaging unit 21. The imaging unit 21 is preferably provided on the display unit 23 side that faces the user's face when the user operates the user terminal 2. The information processing unit 25 is a calculation device such as a CPU (Central Processing Unit). The information processing unit 25 performs operations and processing of the oral condition analysis system 1 in the user terminal 2. The information storage unit 27 is a storage device composed of storage memories such as RAM and ROM, a hard disk, etc. The information storage unit 27 stores various processes and information executed by the information processing unit 25 in the user terminal 2, and an oral condition analysis program that functions the oral condition analysis system 1 according to the present invention. In addition, the information storage unit 27 stores at least one type of information for analyzing the oral condition, such as the color and shape of teeth and gums, lips and skin around the lips that are not teeth and gums, and shading when imaging.

Next, the information processing unit 25 will be described. When the information processing unit 25 executes the oral cavity condition analysis program stored in the information storage unit 27, it at least functions as a video reception unit 251, an image detection unit 252, a tooth detection unit 253, a gum detection unit 254, an excluded target detection unit 255, a determination unit 256, an image acquisition unit 257, and an analysis unit 258.

First, when the user terminal 2 receives a predetermined action from the user U in an application, for example, the imaging unit 21 starts capturing images, and a facial video V consisting of multiple facial images of the user U is captured. The video receiving unit 251 receives the facial video V as input from the imaging unit. At this time, the facial video V received by the video receiving unit 251 may be temporarily stored in the information storage unit 27 for processing such as displaying on the display unit 23, but is not stored as an image for analyzing the oral cavity condition. The image detection unit 252 detects a mouth image F including the mouth area as shown in Figure 3 from the facial video V consisting of multiple facial images as shown in Figure 2. The image detection unit 252 can detect a mouth image F including the user's mouth and the mouth area around the mouth from the face image included in the face video V, for example, using an object detection algorithm such as SSD (Single Shot Multibox Detector) or semantic segmentation.

As shown in FIG. 4, the tooth detection unit 253 detects a tooth area TA indicating the location of teeth in the mouth image F. More specifically, the tooth detection unit 253 first converts the RGB color space of the pixels included in the mouth image F into an XYZ color space, and then converts the XYZ color space into a Lab color space. The tooth detection unit 253 extracts only the a-dimensional pixels from among the pixels included in the mouth image F converted into the Lab color space. The tooth detection unit 253 binarizes the a-dimensional pixels based on a predetermined threshold, and detects pixels with label 1 as the tooth area TA.

As shown in FIG. 5, the gum detection unit 254 detects a gum area GA indicating the gums in the mouth image F. More specifically, the gum detection unit 254 first applies a differential filter, such as a Sobel filter or a Prewitt filter, to each pixel constituting the mouth image F. This emphasizes edge and contour information. The gum detection unit 254 binarizes the mouth image F resulting from the application of the differential filter based on a predetermined threshold value, and flattens the pixels by applying a flattening filter. The gum detection unit 254 forms a polygon surrounded by pixels with label 0 on the outside and pixels with label 1 on the inside, and detects this as the gum area GA.

As shown in FIG. 6, the excluded target detection unit 255 detects other areas OA in the mouth image F that indicate areas other than the teeth and gums in the oral cavity. More specifically, the excluded target detection unit 255 detects objects that may be a cause of misidentification, such as the oral cavity wall or shadows in the oral cavity that are reflected when the face image V is captured, and are to be excluded in the judgment of the mouth image F performed by the judgment unit 256 or the analysis of the oral cavity state performed by the analysis unit 258, which will be described later. The excluded target detection unit 255 first converts the RGB color space of the pixels included in the mouth image F into the HSV color space. The excluded target detection unit 255 binarizes the pixels included in the mouth image F based on a predetermined threshold value, and detects pixels with label 1 as other areas OA. The excluded target detection unit 255 may also detect the lips and the skin around the lips included in the mouth image F as areas OA that indicate areas other than the teeth and gums in the oral cavity as excluded targets.

The determination unit 256 determines whether or not the mouth image F detected by the image detection unit 252 satisfies the analysis conditions required for analyzing the state of the oral cavity based on the tooth area TA, gum area GA, and other area OA detected by the tooth detection unit 253, gum detection unit 254, and exclusion target detection unit 255.

The image acquisition unit 257 acquires one or more mouth images F that the determination unit 256 has determined to satisfy the analysis conditions, and stores the mouth images F as accumulated data in the information storage unit 27. The analysis unit 258 may use, for example, simple image analysis or statistical methods as a method for analyzing the oral cavity state, and it is preferable to analyze the oral cavity state using a machine learning model that has been machine-learned on the accumulated data stored in the information storage unit 27.

If the amount of accumulated data that the machine learning model uses for machine learning is large, the accumulated data may be stored in an external storage device as a database, rather than being stored in the information storage unit 27 of the user terminal 2. Also, the analysis of the oral condition performed by the analysis unit 258 may be performed by an external arithmetic processing device. As another embodiment, the oral condition analysis system 1 may be configured such that the user terminal 2 is electrically connected to a server via a network such as the Internet.

In other embodiments, the oral cavity condition analysis system 1 executes an oral cavity condition analysis program on the server, and the server performs processes corresponding to the video reception unit 251, image detection unit 252, tooth detection unit 253, gum detection unit 254, exclusion target detection unit 255, judgment unit 256, image acquisition unit 257, and analysis unit 258.

Next, the determination unit 256 will be described. The determination unit 256 excludes other areas OA from the mouth image F as a determination target, and determines whether or not the tooth area TA and gum area GA in the mouth image F satisfy the analysis conditions. In other words, the determination unit 256 determines whether or not the analysis conditions are satisfied based on the transitions and amounts of change in the tooth area TA value and gum area GA value, as shown in Figures 7 and 8, in which the value indicating the proportion of the tooth area TA in the mouth image F (hereinafter, tooth area TA value) and the value indicating the proportion of the gum area GA in the mouth image F (hereinafter, gum area GA value) detected by the tooth detection unit 253 and gum detection unit 254 are recorded as time-series data.

There are various analysis conditions required to analyze the oral cavity state, and may include one or more conditions. At least one of the tooth area TA and gum area GA in the mouth image F must satisfy the analysis conditions, and it is preferable that both the tooth area TA and gum area GA satisfy the analysis conditions. Examples of analysis conditions include whether the tooth area TA in the mouth image F contains at least a predetermined number of teeth (crowns), whether the area of the gum area GA in the mouth image F reaches the area required to analyze the oral cavity state, etc., and the required numerical values and targets can be set depending on the analysis method.

Specific examples of the judgment by the judgment unit 256 and the acquisition of images by the image acquisition unit 257 are as follows. The judgment unit 256 sets the following analysis conditions to satisfy all of the following: (1) both the tooth area TA value and the gum area GA value reach a predetermined threshold value (e.g., 0.15) or more, (2) the state where the value reaches the predetermined threshold value or more is maintained for a predetermined period (e.g., 30 frames) or more, and (3) the amount of change in the tooth area TA value and the gum area GA value is within a predetermined range (e.g., ±0.5). In addition, the judgment unit 256 is set with a predetermined judgment period (e.g., 10 seconds, 300 frames). The mouth image F used for judgment by the judgment unit 256 is, for example, a mouth image F detected from a face video V captured at 30 fps.

If it is within a predetermined judgment period, the judgment unit 256 constantly repeats the judgment of whether the mouth image F satisfies the analysis conditions. The judgment of the judgment unit 256 from time point (a) to time point (d) during the predetermined judgment period will be explained below.

The determination unit 256 determines whether the mouth image F at time point (a) shown in Figures 7 and 8 satisfies the above analysis conditions. Although the mouth image F at time point (a) satisfies analysis condition (3), analysis conditions (1) and (2) are not satisfied. Therefore, the mouth image F at time point (a) is not acquired by the image acquisition unit 257.

The determination unit 256 determines whether or not the mouth image F at time point (b) shown in Figures 7 and 8 satisfies the above analysis conditions. Like the mouth image F at time point (a), the mouth image F at time point (b) satisfies the analysis condition (3), but does not satisfy the analysis conditions (1) and (2). Therefore, the mouth image F at time point (b) is not acquired by the image acquisition unit 257.

The determination unit 256 determines whether the mouth image F at time point (c) shown in Figures 7 and 8 satisfies the above analysis conditions. The mouth image F at time point (c) satisfies analysis condition (3), just like the mouth images F at time points (a) and (b). Furthermore, the tooth area TA value of the mouth image F at time point (c) reaches or exceeds the threshold value in analysis condition (1). However, the gum area GA value of the mouth image F at time point (c) does not reach the threshold value in analysis condition (1), and does not satisfy analysis condition (2). For this reason, the mouth image F at time point (c) is not acquired by the image acquisition unit 257.

In response to this, the determination unit 256 determines whether or not the mouth image F at time point (d) shown in Figures 7 and 8 satisfies the above analysis conditions. The mouth image F at time point (d) satisfies all of the analysis conditions (1) to (3). Therefore, the mouth image F at time point (d) is acquired by the image acquisition unit 257.

Note that there may be more than one mouth image F that satisfies the analysis conditions (1) to (3) as determined by the determination unit 256. The encircled line P shown in Figures 7 and 8 indicates a period during which there are multiple mouth images F that satisfy the analysis conditions (1) to (3). For this reason, during the period enclosed by the encircled line P, which includes time point (d), the image acquisition unit 257 acquires a single or multiple mouth images F.

If the judgment unit 256 judges that there is no mouth image F that satisfies the analysis conditions (1) to (3) even after the judgment period has elapsed, the judgment unit 256 ends the judgment of whether the mouth image F satisfies the analysis conditions.

The flow of the oral cavity condition analyzing system 1 according to the embodiment of the present invention will be described with reference to FIG.
First, the imaging unit 21 is activated to start imaging (step S1). For example, when a user operates an application on the user terminal 2, the application activates the imaging unit 21 included in the user terminal 2 to start imaging. When the imaging unit 21 starts imaging, a face video V consisting of a plurality of facial images of the user U is captured.

At this time, it is preferable that a guidance display unit (not shown) displays guidance means on the display unit 23 that guides the user to an open mouth posture suitable for analyzing the oral cavity condition, i.e., a posture in which the teeth and gums are exposed. The guidance means is displayed as a rectangular frame that is elongated in the horizontal direction, the same as the mouth, but it may be a frame of another shape, or may be a frame shaped to resemble teeth and gums. The guidance means may also be a frame that resembles the contours of the face.

The video receiving unit 251 receives the facial video V (step S2). The facial video V received by the video receiving unit 251 may be temporarily stored in the information storage unit 27 for processing to display on the display unit 23, but is not stored as an image for analyzing the oral cavity condition.

The image detection unit 252 detects the mouth image F (step S3). The image detection unit 252 detects the mouth image F by using a portion of the facial image V as its detection range. When the detection range detected by the image detection unit 252 is shown in the facial image V displayed on the display unit 23, the lower part of the facial image V divided into upper and lower halves, particularly the mouth area such as the user's mouth and its surroundings, is used as the detection range for the mouth image F, and the mouth image F is detected from the facial image V.

Of the mouth image F detected by the image detection unit 252, the tooth detection unit 253 detects the tooth area TA (step S4), the gum detection unit 254 detects the gum area GA (step S5), and the excluded target detection unit 255 detects other areas OA (step S6). Note that in the flowchart shown in FIG. 9, steps S4, 5, and 6 are performed simultaneously, but steps S4, 5, and 6 may be performed in this order, or steps S4, 5, and 6 may be performed in any order.

The determination unit 256 determines whether the mouth image F satisfies the analysis conditions (step S7). If the mouth image F satisfies the analysis conditions (step S7: Yes), the determination unit 256 proceeds to step S8, and if the mouth image F does not satisfy the analysis conditions (step S7: No), the determination unit 256 proceeds to step S9.

The image acquisition unit 257 acquires a mouth image F that satisfies the analysis conditions (step S8). If the determination unit 256 determines that the mouth image F satisfies the analysis conditions (Yes in step S7), the image acquisition unit 257 acquires one or more mouth images F that the determination unit 256 has determined to satisfy the analysis conditions. The mouth images F acquired by the image acquisition unit 257 are temporarily stored in the information storage unit 27. At this time, it is preferable that a communication means is used to inform the user U that the capture of the mouth image F suitable for analysis of the oral cavity state has been completed, such as by using a flash effect that temporarily illuminates the display unit 23.

It is determined whether the imaging time has elapsed a predetermined judgment period (step S9). If the judgment unit 256 determines that the mouth image F does not satisfy the analysis conditions (step S7 is No), the judgment unit 256 further determines whether the predetermined judgment period for judging whether the mouth image F satisfies the analysis conditions has elapsed. If the predetermined judgment period has not elapsed (step S9 is No), the process returns to step S2 and starts over from receiving the face image V. If the predetermined judgment period has elapsed (step S9 is Yes), the oral cavity condition analysis system 1 according to the present invention is terminated.

The analysis unit 258 analyzes the oral cavity condition (step S10). The analysis unit 258 retrieves the mouth image F acquired by the image acquisition unit 257 from the information storage unit 27, and analyzes the oral cavity condition, for example, using a machine learning model that performs machine learning on the accumulated data stored in the information storage unit 27. The analysis results obtained by the analysis unit 258 are displayed on the display unit 23 of the user terminal 2, and the oral cavity condition analysis system 1 according to the present invention is terminated. It is preferable that the analysis results obtained by the analysis unit 258 are stored in the information storage unit 27 as new learning data. The analysis unit 258 may also use other methods for analyzing the oral cavity condition, such as simple image analysis, such as binarization processing that binarizes the mouth image F, or statistical methods, such as histogram analysis.

As a result, the present invention can provide a convenient oral condition analysis system and oral condition analysis program that can automatically obtain oral images suitable for analyzing the oral condition.

The above describes embodiments of the present invention, but the present invention is not limited to these examples, and can of course be embodied in various forms without departing from the spirit of the present invention.

REFERENCE SIGNS LIST 1 Oral cavity condition analysis system 2 User terminal 21 Imaging unit 23 Display unit 25 Information processing unit 27 Information storage unit 251 Video reception unit 252 Image detection unit 253 Tooth detection unit 254 Gum detection unit 255 Exclusion target detection unit 256 Determination unit 257 Image acquisition unit 258 Analysis unit F Mouth image GA Gum area OA Other area P Encircling line TA Tooth area U User V Facial image

Claims (10)

an image receiving unit that continuously receives a facial image of a user captured by an imaging unit of the user terminal as an input from the imaging unit;
an image detection unit that detects an image including a mouth area from the face image received by the video receiving unit;
a teeth detection unit that detects a teeth region in the image including the mouth region;
a gum detection unit that detects a gum area in the image including the mouth area;
a determination unit that determines whether or not at least one of the tooth region and the gum region included in the image including the mouth region satisfies a predetermined condition necessary for analyzing an oral cavity state;
an image acquisition unit that acquires one or more images including the mouth area determined by the determination unit to satisfy the condition;
An oral cavity condition analysis system comprising: an analysis unit that analyzes the oral cavity condition based on the image including the mouth area acquired by the image acquisition unit. The oral cavity condition analysis system according to claim 1, further comprising an excluded object detection unit that detects excluded objects other than the tooth area and the gum area from the image including the mouth area. The oral cavity condition analysis system according to claim 1, wherein the determination unit records at least one of the tooth region and the gum region, which changes for each image including the mouth region, as time-series data, and determines whether the image including the mouth region satisfies predetermined conditions necessary for analyzing the oral cavity condition based on the time-series data. The oral cavity condition analysis system according to claim 3, further comprising a guidance display unit that displays a guidance means for guiding the mouth area to a predetermined position on the display screen of the user terminal on which the face image is displayed. the tooth detection unit extracts the tooth region from an image including the mouth region by color space conversion and a predetermined threshold value;
The oral cavity condition analyzing system according to claim 3 , wherein the gum detection unit applies a differential filter to the image including the mouth area, and detects the gum area using a flattening filter and a predetermined threshold value. a video receiving unit that continuously receives a facial image of a user captured by an imaging unit of a user terminal as an input from the imaging unit;
an image detection unit that detects an image including a mouth area from the face image received by the video receiving unit;
a teeth detection unit that detects a teeth region in the image including the mouth region;
a gum detection unit that detects a gum area in the image including the mouth area;
a determination unit that determines whether or not at least one of the tooth region and the gum region included in the image including the mouth region satisfies a predetermined condition necessary for analyzing an oral cavity state;
an image acquisition unit that acquires one or more images including the mouth area determined by the determination unit to satisfy the condition;
and an oral cavity condition analysis program for causing the image acquisition unit to function as an analysis unit that analyzes the oral cavity condition based on an image including the mouth area acquired by the image acquisition unit. a video receiving unit that continuously receives a facial image of a user captured by an imaging unit of a user terminal as an input from the imaging unit;
an image detection unit that detects an image including a mouth area from the face image received by the video receiving unit;
a teeth detection unit that detects a teeth region in the image including the mouth region;
a gum detection unit that detects a gum area in the image including the mouth area;
a determination unit that determines whether or not at least one of the tooth region and the gum region included in the image including the mouth region satisfies a predetermined condition necessary for analyzing an oral cavity state;
an image acquisition unit that acquires one or more images including the mouth area determined by the determination unit to satisfy the condition;
And a computer-readable recording medium having an oral cavity condition analysis program recorded thereon for functioning as an analysis unit that analyzes the oral cavity condition based on an image including the mouth area acquired by the image acquisition unit. continuously receiving, as an input from an imaging unit, a face image of a user captured by the imaging unit of the user terminal;
Detecting an image including a mouth region from the face image;
Detecting a tooth region and a gum region from the image including the mouth region;
determining whether or not at least one of the tooth region and the gum region included in the image including the mouth region satisfies a predetermined condition necessary for analyzing an oral cavity state;
acquiring one or more images including the mouth area determined to satisfy a condition;
The oral cavity condition analyzing method includes analyzing the oral cavity condition based on the acquired image including the mouth area. The oral cavity condition analysis method according to claim 8, further detecting exclusion targets other than the tooth region and the gum region from the image including the mouth region. 9. The method for analyzing an oral cavity condition according to claim 8, further comprising recording, as time-series data, at least one of the tooth area and the gum area, which changes for each image including the mouth area, and further determining, based on the time-series data, whether or not the image including the mouth area satisfies predetermined conditions necessary for analyzing the oral cavity condition.

Images