WO2025057353A1 - Display device using magnetic fluid - Google Patents

Abstract

[Problem] To provide a display device capable of interactive display using a magnetic fluid. [Solution] A display device 2A using a magnetic fluid is used, for example, while being affixed to an indoor wall surface W, and electric power is supplied thereto from an outlet 4. The display device 2A comprises: a magnetic force generation part which generates magnetic force; a display body 12 into which a magnetic fluid and a nonmagnetic fluid are sealed; and a control board as a control part which controls the magnetic force generation part on the basis of input information from the dialogist H side to change the shape of the magnetic fluid. For example, when the dialogist H utters "I'm back!", voice data based on the utterance of "I'm back!" of the dialogist H is inputted by a voice recognition means through a microphone 30 built in the display body 12, the magnetic force generation part is driven by display data created on the basis of the voice data, the magnetic fluid is changed, and a response display such as "Welcome back!" is performed.

Description

Display device using magnetic fluid

The present invention relates to a display device that uses a magnetic fluid, and more specifically to a display device that can provide interactive displays that enable communication with an interlocutor, as well as visual displays of the speaker's emotions, etc.

When a magnetic field is applied to a magnetic fluid sealed in a glass or other case, as described in Patent Document 1, disturbances occur at the interface of the magnetic fluid and the strength of the magnetic field fluctuates. As the magnetic field lines tend to concentrate at the peaks of the wave front, the magnetization at the peaks increases and decreases at the valleys, and the deformation progresses to a position where the magnetic pressure, gravity, and surface tension are balanced, eventually stabilizing by forming a number of regularly-arranged protrusions (pyramids) called spikes in a three-dimensional manner. The various spike shapes maintained by this magnetic force give viewers a unique aesthetic appearance that cannot be felt with ordinary fluids, and as disclosed in Patent Documents 1 and 2, etc., they are seen as objects of appreciation, and improving their aesthetic appeal is a technological trend.

On the other hand, as disclosed in Patent Document 3 and Patent Document 4, a display device has been proposed in which electromagnets are arranged in a matrix and the position at which a magnetic field is applied is controlled to display letters, numbers, figures, etc. In Patent Document 3, a magnetic field is applied from the back of a storage tray in which a magnetic fluid is stored, and letters, figures, etc. are formed by partially raising the magnetic fluid. In Patent Document 4, the property of magnetic particles that are aligned along the direction in which the magnetic field acts to transmit light is utilized, and a magnetic field according to image information is selectively applied to the magnetic fluid, causing both light-transmitting and non-light-transmitting parts (parts where the magnetic field does not act) to coexist, forming letters, figures, etc. with the transmitted light. Sealing structures using magnetic fluid are also known.

International Publication No. 2016/027535 JP 2018-155524 A JP 2005-91759 A Japanese Unexamined Patent Publication No. 7-146659

As mentioned above, magnetic fluids are used in a variety of fields, but their use is limited to simply changing the shape by changing the position or strength of the applied magnetic field. In other words, the basic property of magnetic fluids that react to magnetic fields is simply used as is. In other words, their use is "unidirectional," allowing people to enjoy watching the shape changes caused by the basic property of magnetic fluids and to recognize the displayed content. Patent Document 3 describes that voice can be input from a microphone or the like and then converted into text for display, which seems to suggest an expansion of the uses, but in this case too, the display data is simply input by voice, and it is still a unidirectional use.

If it were possible to change and even make the magnetic fluid responsive to input information from the person looking at the display device, it could be expected to be used as a communication tool with humans (two-way communication), which would contribute to expanding the range of applications.

The present invention has been made in consideration of the above points, and its purpose is to provide a display device that uses magnetic fluid to enable interactive display and visual display of the speaker's emotions, etc., in order to contribute to the expansion of fields of use.

In order to achieve the above object, the display device (2A) using the magnetic fluid of the present invention is characterized by having a magnetic force generating unit (6) that generates a magnetic force, a display body (12) in which a magnetic fluid (8) and a non-magnetic fluid (10) are sealed, and a control unit (14A) that controls the magnetic force generating unit (6) based on input information from the interlocutor (H) and changes the shape of the magnetic fluid (8).

The display device using the magnetic fluid of the present invention can display a response based on information input from the interlocutor, allowing communication to be established between the interlocutor and the device, expanding the range of applications.

Furthermore, in the display device (2A) using the magnetic fluid, the control unit (14A) may include a voice recognition means (38), and the control unit (14A) may change the shape of the magnetic fluid (8) based on data recognized by the voice recognition means (38). In this way, a response display is made to the speech of the interlocutor, making communication easy and smooth.

Furthermore, in the display device (2B) using the magnetic fluid, the control unit (14B) may change the shape of the magnetic fluid (8) based on the biometric information of the interlocutor (H). This makes it possible to use the device as a product for monitoring the health condition of the interlocutor.

The display device (2B) using the magnetic fluid may also include a receiving device (46) that receives biometric data transmitted from an external device, and the control unit (14B) may change the shape of the magnetic fluid (8) based on the data input via the receiving device (46). This allows for easy and smooth exchange of data on the health condition of the interlocutor.

Furthermore, in the display device (2B) using the magnetic fluid, the biometric data may be heart rate data transmitted from a wearable device (44). In this way, data can be transmitted from a device worn on the body, making it easy and smooth to exchange data on the health condition of the interlocutor.

Furthermore, in the display device (2C) using the magnetic fluid, the display body (12) may be equipped with a non-contact thermometer (50), and the control unit (14C) may change the shape of the magnetic fluid (8) based on the value measured by the non-contact thermometer (50). In this way, the interlocutor can input biometric information into the display device simply by bringing his/her forehead close to the display device, improving usability.

Furthermore, in the display device (2D) using the magnetic fluid, the display body (12) may be equipped with a pulse oximeter (52), and the control unit (14D) may change the shape of the magnetic fluid (8) based on the value measured by the pulse oximeter (52). This makes it easy and smooth to exchange data on the health condition of the interlocutor.

Furthermore, in the display device (2E) using the magnetic fluid, the display body (12) is equipped with a camera (54), and the control unit (14E) has an image analysis means (56) that analyzes changes in facial expression from an image captured by the camera (54), and the shape of the magnetic fluid (8) may be changed based on changes in the facial expression of the interlocutor (H) analyzed by the image analysis means (56). This makes it possible to grasp the interlocutor's state of fatigue, allowing encouragement and enhancing emotional communication functions.

Furthermore, in the display devices (2A to 2E) using the above-mentioned magnetic fluid, the control unit (14A to 14E) may change the shape of the magnetic fluid (8) into letters. This allows the response content to be reliably transmitted to the interlocutor.

Furthermore, in the display devices (2A to 2E) using the above-mentioned magnetic fluid, the control unit (14A to 14E) may change the shape of the magnetic fluid (8) to a shape that corresponds to the data of the input information. This makes it possible to easily display expressions that are difficult to convey using characters using simple figures, etc.

The display device (2F) using the magnetic fluid of the present invention includes a magnetic force generating unit (6) that generates a magnetic force, a display body (12) in which a magnetic fluid (8) and a non-magnetic fluid (10) are enclosed, a voice generating unit (31) that generates a voice, and a control unit (14A) that controls the voice generating unit (31) and the magnetic force generating unit (6) based on input information from the interlocutor (H), and the control unit (14A) determines the words of a reply to the interlocutor (H) and the emotion to be expressed when replying based on the input information from the interlocutor (H), and based on the determination, controls the voice generating unit (31) to output a reply voice that indicates the emotion toward the interlocutor (H), and controls the magnetic force generating unit (6) to change the magnetic fluid (8) to a shape that indicates the emotion toward the interlocutor (H).

With this display device that uses magnetic fluid, it is possible for the display device to change the shape and movement of the magnetic fluid in response to the voice of the interlocutor in response to what is said by the interlocutor, at the same time as the voice generating unit responds, thereby enabling pseudo-expression of emotions. In other words, when spoken to by an interlocutor, the display device can express emotions by changing the shape and movement of the magnetic fluid in response to the voice of the voice generating unit, allowing the interlocutor to enjoy the sensation of communicating with a human or pet that has emotions.

Furthermore, in the display device (2F) using the above-mentioned magnetic fluid, the control unit (14A) and the magnetic force generating unit (6) may change the strength of the magnetic force applied to the magnetic fluid (8) according to the emotion expressed when replying, thereby changing the magnetic fluid (8) to a shape that indicates the emotion toward the interlocutor (H).

In addition, in the display device (2F) using the above-mentioned magnetic fluid, the control unit (14A) may control the magnetic force generating unit (6) to change the strength of the magnetic force applied to the magnetic fluid (8) while emitting a voice from the voice generating unit (31), thereby simultaneously vocalizing a response to the interlocutor (H) and expressing an emotion by changing the shape of the magnetic fluid (8).

Furthermore, in the display device (2F) using the above-mentioned magnetic fluid, the control unit (14A) and the magnetic force generating unit (6) may apply a relatively weak magnetic force to the magnetic fluid (8) when the emotion expressed in the reply is mild, compared to when the emotion is strong anger, surprise, etc.

Furthermore, in the display device (2F) using the above-mentioned magnetic fluid, the control unit (14A) and the magnetic force generating unit (6) may apply a relatively strong magnetic force to the magnetic fluid (8) when the emotion expressed in the reply is strong anger or surprise, compared to when the emotion is mild.

The display device (2F) using the magnetic fluid may also include a voice input means (30) for inputting the voice of the interlocutor (H) as input information from the interlocutor (H), and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotion to be expressed when replying based on the voice input from the voice input means (30).

The display device (2F) using the magnetic fluid may also include a receiving device (46) that receives bioinformation data transmitted from an external device (44) as input information from the interlocutor (H), and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotions to be expressed when replying based on the data input via the receiving device (46).

Furthermore, in the display device (2F) using the above-mentioned magnetic fluid, the bioinformation data may be heart rate data transmitted from a wearable device (44) which is an external device (44).

The display device (2F) using the magnetic fluid may also include a non-contact thermometer (50) that measures the body temperature of the interlocutor (H) as input information from the interlocutor (H), and the control unit (14A) may determine the words to reply to the interlocutor (H) and the emotion to be expressed when replying based on the value measured by the non-contact thermometer (50).

The display device (2F) using the magnetic fluid described above is also provided with a camera (54) capable of capturing an image of the interlocutor (H) as input information from the interlocutor (H) side, and the control unit (14A) has an image analysis means (56) that analyzes changes in the interlocutor's (H) facial expression from the image captured by the camera (54), and may determine the words of a reply to the interlocutor (H) and the emotions to be expressed when replying based on the changes in the interlocutor's (H) facial expression analyzed by the image analysis means (56).

The present invention is expected to be used as a communication tool with the interlocutor (two-way communication), which will contribute to expanding the fields of use.

1 is a perspective view showing a state in which a display device using a magnetic fluid according to a first embodiment of the present invention is used. FIG. 2 is a schematic cross-sectional view taken along line XX in FIG. 1. 2 is a plan view of an electromagnet array in the display device shown in FIG. 1 . FIG. 4 is a side view showing one electromagnet of the electromagnet array shown in FIG. 3 . 2 is an enlarged view of a main portion for explaining the display mechanism using a magnetic fluid in the display device shown in FIG. 1 . FIG. 2 is a control block diagram of the display device shown in FIG. 1 . FIG. 11 is a control block diagram of a display device according to a second embodiment. FIG. 11 is a front view showing an example of a response display of a display device according to a second embodiment. FIG. 13 is a front view of a display device according to a third embodiment. FIG. 11 is a control block diagram of a display device according to a third embodiment. FIG. 13 is a front view of a display device according to a fourth embodiment. FIG. 13 is a control block diagram of a display device according to a fourth embodiment. FIG. 13 is a front view of a display device according to a fifth embodiment. FIG. 13 is a control block diagram of a display device according to a fifth embodiment. FIG. 13 is a front view of a display device according to a sixth embodiment. FIG. 13 is a control block diagram of a display device according to a sixth embodiment. 1A to 1C are diagrams showing specific examples of changes in shape of a magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. 11 is a timing chart showing a concrete example of a response voice from a speaker, a change in magnetic force applied to a magnetic fluid, and an associated change in shape of the magnetic fluid. FIG. 13 is a front view of a display device according to a seventh embodiment. FIG. 13 is a control block diagram of a display device according to a seventh embodiment.

Below, an embodiment of the present invention will be described in detail with reference to the attached drawings.

[First embodiment]
The first embodiment will be described with reference to Figs. 1 to 6. As shown in Fig. 1, a display device (hereinafter, simply referred to as a "display device") 2A capable of interactive display using a magnetic fluid according to this embodiment is fixed to, for example, a wall surface W in a room and is supplied with power (commercial power) from an outlet 4. As shown in Fig. 2, the display device 2A has a magnetic force generating unit 6 that generates a magnetic force, a display body 12 in which a magnetic fluid 8 and a non-magnetic fluid 10 are sealed, and a control board 14A as a control unit that controls the magnetic force generating unit 6 based on input information from the interlocutor H side and changes the shape of the magnetic fluid 8. Note that "changing the shape of the magnetic fluid 8" here means changing the shape of the magnetic fluid 8 to a character, a figure, or a mixture of these. Note that, although the outlet 4 is exemplified as a power supply source for the display device 2A here, other power supply sources can be used without being limited to this. For example, since the driving power of the magnetic fluid is relatively small, a built-in battery system, a solar cell system, a USB power supply system, or the like may be adopted as the power supply source for the display device 2A. With this power supply method, the display device 2A can be easily used in places in the house where there are no outlets or where the wiring from the outlet is difficult to reach, and since the display device 2A can be carried around, there are no restrictions on where it can be used.

The magnetic force generating unit 6 has an electromagnet array 16 and a circuit board 18 that selectively energizes (excites) each electromagnet 36 (see FIG. 3) of the electromagnet array 16. The display body 12 has a transparent glass plate 20 that forms the display surface, a glass plate 22 that is arranged facing the glass plate 20 at a distance, a rubber seal member 24 that seals the periphery between the glass plates 20 and 22, and a frame body 26 that covers these. Reference numeral 28 indicates a spacer. A magnetic fluid 8 and a non-magnetic fluid 10 are sealed in the sealed space between the glass plates 20 and 22, and an electromagnet array 16 is arranged on the back side of the glass plate 22. A microphone 30 that picks up the voice of the interlocutor H is built into the center of the upper end of the display body 12. The lower end of the glass plate 20 that forms the display surface is masked with a color coat 32 (shown by hatching) so that the settling and volume state of the magnetic fluid 8 cannot be seen from the outside. The front side of the glass plate 22 is coated with a white coating that allows magnetic lines of force to pass through in order to improve the display quality (contrast) of the black magnetic fluid 18.

As shown in FIG. 3, the electromagnet array 16 has a configuration in which a large number of electromagnets 36 with cylindrical outer shells are arranged in a matrix on a base plate 34. As shown in FIG. 4, each electromagnet 36 is formed as an air-core coil, with arrow i indicating the direction of current and arrow N indicating the direction of magnetic field lines. The electromagnets 36 may be coils with an iron core. The direction of the magnetic field is from the front side to the back side of the display device 2A, as shown by arrow B in FIG. 2. Although not shown, the circuit board 18 includes a signal driver that outputs a signal that instructs each electromagnet 36 to operate (apply a magnetic field), an amplifier circuit that amplifies the signal to a size required to operate the electromagnets 36, and the like.

The magnetic fluid 8 is a liquid in which ferrite-based magnetic particles are appropriately mixed with a surfactant solution, but the magnetic fluid used in the present invention is not limited to this. The non-magnetic fluid 10 is a liquid that does not mix with the oil-based magnetic fluid 8 and separates therefrom, and water is used here as an example.

FIG. 5 is a partially enlarged view for explaining the mechanism of display using magnetic fluid 8. When all electromagnets 36 are not energized, magnetic fluid 8 settles and accumulates at the bottom end of glass plate 20, which serves as the display surface. This is because the specific gravity of magnetic fluid 8 is greater than that of water, the non-magnetic fluid 10, and in combinations where the specific gravity of non-magnetic fluid 10 is greater than that of magnetic fluid 8, magnetic fluid 8 accumulates at the top end of the display surface.

As described above, the accumulation state of the magnetic fluid 8 is masked by, for example, a yellow color coat 32 (see FIG. 1) so that it cannot be seen from the outside. When the electromagnet 36 at the bottom is excited in this state, the magnetic force sucks up the magnetic fluid 8 in spots against gravity, and when the first electromagnet 36 is de-energized and the electromagnet 36 above it is energized repeatedly, the spots (droplets) of magnetic fluid 8a move upward as if relayed and are held at the target pixel position. At the held position, the surface tension of adjacent magnetic fluids 8a breaks and they join together to form a line 8b. In reality, the minute dots of magnetic fluid 8 join together or gather together based on the display data to form the target response character. The color of the spot-shaped magnetic fluid 8a is black, derived from ferrite-based magnetic microparticles, but is abbreviated by hatching in FIG. 5 (the same applies to other figures).

The movement of the spots of magnetic fluid 8a gives the viewer the impression that they are swimming tadpoles, which gives interlocutor H a sense of amusement and relaxation. The magnetic fluid 8 does not instantly form a response letter in response to interlocutor H's speech (input information). It takes time for the response letter to be formed, and during that time interlocutor H will enjoy the tadpole-like behavior of the spots of magnetic fluid 8a and will wait with interest to see what kind of response letter will be formed. Although letters and figures displayed using magnetic fluid 8 are less appealing than spikes, the novelty of the unique shape of magnetic fluid 8 can be fully felt. Furthermore, letters created by a series of spots of magnetic fluid 8a are not as sharp as type, but are three-dimensional and rounded, resulting in a familiar font as shown in Figure 1.

The control board 14A is a general computer equipped with a CPU, ROM, RAM, an I/O interface, a HDD, etc. As shown in FIG. 6, the control board 14A is equipped with a voice recognition means 38 that inputs voice data via the microphone 30, a data processing means 40 that processes the input voice data and creates display data to be displayed on the display body 12, and a data output means 42 that outputs the created display data to the magnetic force generating unit 6. The voice recognition means 38, the data processing means 40, and the data output means 42 are realized by computer programs in the computer. These programs are stored in advance, for example, in a HDD, loaded from the HDD to the RAM, and executed by the CPU. In the data processing means 40, a response expression corresponding to the input voice data is extracted from an expression pattern table T1 (not shown) and converted into display data, and the sound quality (high and low) etc. is analyzed from the input voice data, and a response expression corresponding to this is extracted from an expression pattern table T2 (not shown) and converted into display data. In other words, the control board 14 changes the shape of the magnetic fluid 8 based on the data recognized by the voice recognition means 38. The data processing means 40 can also acquire data as so-called frequency input by determining the frequency of a voice from voice data such as a voice recognized by the voice recognition means 38. Data acquired by such frequency input can more accurately (numerically or quantitatively) determine changes in the physical condition or emotions of the speaker who uttered a voice such as "I'm home," making it possible to reflect more appropriate judgments based on physical condition and emotions in the output data to the magnetic force generating unit 6.

1 shows a state in which the interlocutor H utters "I'm home," and the display device 2A responds by displaying "Welcome back." The utterance "I'm home" is input information from the interlocutor H side. The response display "Welcome back" is based on what is extracted from the expression pattern table T1. Furthermore, the CPU checks the sound quality of "I'm home," and if the level corresponds to a lack of energy, it also displays the response "You don't look well. What's wrong?". This response display is based on what is extracted from the expression pattern table T2. The expression pattern table T1 stores various response expressions in response to the interlocutor H's utterances, and the expression pattern table T2 stores various response expressions in response to the sound quality of the interlocutor H's utterances, such as high and low pitch. The CPU appropriately extracts a response expression from either one or both of the expression pattern tables T1 and T2 according to the input voice data. The control board 14A as a computer may improve the accuracy of the response expression (matching accuracy between the state of the interlocutor H and the expression pattern) by deep learning.

As described above, the display device 2A according to this embodiment can respond based on input from the outside or a mere display based on a pre-stored program, i.e., a message to the viewer, but can respond based on input information (voice in this case) from the interlocutor H side, so it can be used as a two-way communication tool (dialogue goods). This contributes to the expansion of the field of use. In this way, by enabling communication with people using the display device 2A, the person using the display device 2A can expect an effect similar to the effect of animal therapy as if they were keeping a pet animal. It is believed that keeping a pet such as a dog reduces stress and restores mental health, and there is also medical statistical data that shows that there is a large difference in the mortality rate between people who keep pets and those who do not. In addition, the display device 2A as a communication tool can be expected to have such healing and psychological counseling effects, and is therefore thought to be very useful for mental care such as dying alone or committing suicide. It has also been confirmed that communication has the effect of giving confidence, and the display device 2A with an interactive function as in this embodiment can also help with social reintegration for people who are withdrawn from society.

[Second embodiment]
The second embodiment will be described with reference to Figures 1, 7, and 8. The same parts as those in the first embodiment or parts that can be considered to be the same are indicated by the same reference numerals, and the explanations of the configuration and function already given will be omitted as appropriate (the same applies to the other embodiments described below).

As shown in FIG. 1, the interlocutor H is wearing a smart watch 44 as a wearable device on his left hand. As is well known, the smart watch 44 has a function of monitoring biometric information such as heart rate, and in this embodiment, the heart rate (biometric information) measured by the smart watch 44 is used as input information from the interlocutor H side. As shown in FIG. 7, the display device 2B is equipped with a general receiving device 46 using a short-range wireless communication standard for digital devices (e.g., Bluetooth), and receives heart rate data from a smart watch 44 equipped with a transmitting device of the same standard. The control board 14B is equipped with a data input means 48 that inputs heart rate data via the receiving device 46, a data processing means 40 that processes the input heart rate data to create display data, and a data output means 42 that outputs the created display data to the magnetic force generating unit 6. In the data processing means 40, a response expression (figure) corresponding to the input heart rate data is extracted from an expression pattern table T3 (not shown) and converted into display data, and a response expression corresponding to the input heart rate data is extracted from an expression pattern table T4 (not shown) and converted into display data. That is, the display device 2B has a receiving device 46 that receives biometric data transmitted from an external device (smart watch 44), and the control board 14B changes the shape of the magnetic fluid 8 based on the data input via the receiving device 46.

When the heart rate data (heart rate) is within the appropriate range, for example as shown in FIG. 8, a crown figure is displayed together with the word "good!". That is, the control board 14B changes the magnetic fluid 8 based on the heart rate data (biometric information) of interlocutor H to form a response display consisting of figures and letters. Here, heart rate is given as an example of input information from interlocutor H, but blood pressure, electrocardiogram information, etc. may also be used. When the data is within the appropriate range, interlocutor H will be encouraged by seeing the response display on the display device 2B.

[Third embodiment]
The third embodiment will be described with reference to Figures 9 and 10. As shown in Figure 9, the display device 2C in this embodiment is provided with a non-contact thermometer 50 at the upper center of the frame 26, and in this embodiment, the body temperature measured by the non-contact thermometer 50 is used as input information from the interlocutor H side. When the interlocutor H turns on the non-contact thermometer 50 by turning on a switch (not shown) and brings the forehead close to a predetermined distance, the non-contact thermometer 50 detects infrared rays emitted from the forehead and measures the body temperature (biological information). If the measured body temperature is within the appropriate range, the control board 14C changes the shape of the magnetic fluid 8 based on the value (body temperature) measured by the non-contact thermometer 50, and displays a response consisting of figures and characters similar to those shown in Figure 8, for example.

[Fourth embodiment]
The fourth embodiment will be described with reference to Fig. 11 and Fig. 12. As shown in Fig. 11, the display device 2D in this embodiment is provided with a pulse oximeter 52 at the lower right end of the frame body 26, and in this embodiment, the blood oxygen saturation measured by the pulse oximeter 52 is used as input information from the interlocutor H side. When the interlocutor H inserts his index finger into the pulse oximeter 52, measurement is started. The control board 14D changes the shape of the magnetic fluid 8 based on the value (blood oxygen saturation) measured by the pulse oximeter 52. When the measured blood oxygen saturation is within the appropriate range, the display device 2D changes the shape of the magnetic fluid 8 based on the measured value, and displays a response consisting of, for example, a banzai figure and the word "good!". Although not shown, the display device 2D may be provided with an odor sensor and an alarm. In this case, when a gas leak is detected by the odor sensor, the alarm may be activated and a word such as "Gas leak" may be displayed to warn the user.

[Fifth embodiment]
The fifth embodiment will be described with reference to Fig. 13 and Fig. 14. As shown in Fig. 13, the display device 2E in this embodiment is provided with a camera 54 having an image pickup element such as a CCD or CMOS at the upper center of the frame 26, and in this embodiment, the image data of the face captured by the camera 54 is used as input information from the interlocutor H side. The image of the face of the interlocutor H captured by the camera 54 is analyzed for facial expression by an image analysis means 56, which is a computer program stored in a HDD or the like in advance, and the facial expression data is input. The control board 14E changes the shape of the magnetic fluid 8 based on the change in the facial expression of the interlocutor H analyzed by the image analysis means 56. In the data processing means 40, a response expression corresponding to the input facial expression data is extracted from an expression pattern table T5 (not shown) and converted into display data. Here, the text "Fragrance is nice!!" is displayed as a response. If the facial expression data is a good pattern, it may be displayed together with a smiling face mark, for example. The display device 2E may also be configured to include a speaker (not shown). After displaying "Nice smell!!", the control board 14E can display, for example, "Listen to this music" and select and play uplifting music from a number of pre-stored songs. In this case, the control board 14E changes the magnetic fluid 8 using an algorithm corresponding to the music. In this way, the display device 2E functions as a visualizer that visualizes sound information, making it possible to further enjoy the unique behavior of the magnetic fluid 8.

Sixth Embodiment
The sixth embodiment will be described with reference to Fig. 15 and Fig. 16. As shown in Fig. 15, the display device 2F in this embodiment includes a microphone 30 for picking up the voice of the interlocutor H, which is provided at the center of the upper end of the display body 12, and a speaker (voice generating unit) 31 capable of outputting voice. In addition, the display device 2F in this embodiment does not include the color coat 32 provided in the display device 2A in the first embodiment, so that the state of the magnetic fluid 8 (magnetic fluid 8 to which no magnetic force is applied) that has settled and accumulated at the lower end of the sealed space between the glass plates 20 and 22 can be visually confirmed.

16, in the display device 2F of this embodiment, the control board 14F includes a voice recognition means 38 that inputs voice data via the microphone 30, a data processing means 40 that processes the input voice data to create display data for display on the display body 12 and reply voice data for outputting a reply voice from the speaker 31, and a data output means 42 that outputs the created display data and reply voice data to the magnetic force generating unit 6 and the speaker 31, respectively. In the data processing means 40, the response content for the response corresponding to the voice data input from the voice recognition means 38 is extracted from an expression pattern table T6 (not shown) and converted into reply voice data, and the sound quality (high and low) etc. is analyzed from the voice data input from the voice recognition means 38, and the corresponding emotional expression (specifically, the content of the emotion expressed when replying) is extracted from an expression pattern table T7 (not shown) and converted into display data. In other words, the control board 14 generates a reply voice to the interlocutor H based on the data recognized by the voice recognition means 38, and changes the magnetic fluid 8 so as to have a shape that shows the emotional expression toward the interlocutor H. This allows the display device 2F, when spoken to by the interlocutor H, to express emotions by changing the shape and movement of the magnetic fluid 8 along with the voice of the reply from the speaker 31, allowing the interlocutor H to enjoy the sensation of communicating with a human or pet that has emotions. Below, specific examples of voice output from the speaker 31 and changes in the shape and movement of the magnetic fluid 8 due to the application of magnetic force in replying to the interlocutor H using the display device 2F of this embodiment are described.

FIG. 17 is a diagram showing a specific example of the shape change of a magnetic fluid. As shown in the figure, the magnetic fluid 8 can change into the shape shown in each of the magnetic fluids 8a to 8f shown in the figure depending on the magnitude (strength) of the magnetic force applied by the electromagnet array 16. The magnetic force applied to the magnetic fluid 8a is substantially zero. The magnetic force applied to the magnetic fluids 8b to 8e gradually increases in the order, and the magnetic force applied to the magnetic fluid 8f is in a maximum state. As shown in the figure, when the magnitude of the magnetic force applied to the magnetic fluid 8 is zero or relatively small, the magnetic fluid 8 has a rounded shape with almost no spikes, giving an emotionally gentle and calm impression, whereas when the applied magnetic force becomes relatively large, the pointed shape of the spikes gradually becomes sharper and the number of spikes increases and becomes finer, causing the magnetic fluid 8 as a whole to change into a shape that gives an impression of being prickly, emotionally aggressive, and rough. In the display device 2F of this embodiment, such a characteristic of the shape change of the magnetic fluid 8 is utilized to express emotions when replying to the interlocutor H from the display device 2F. That is, the shape of magnetic fluid 8a in the figure indicates emotions and physical conditions such as a very calm state, a state of low energy, or a state of being very sleepy, while the shape of magnetic fluid 8f indicates a state accompanied by very strong anger or surprise. The shapes of magnetic fluids 8b to 8e indicate intermediate emotions and physical conditions in between. In this way, the weaker the magnetic force applied to magnetic fluid 8, the more calm the state of mind, the less energy there is, or the less healthy the state is, while the stronger the magnetic force applied to magnetic fluid 8, the more pronounced the state of emotions such as anger or surprise is.

18 to 23 are timing charts showing specific examples of the content of the reply from the speaker 31, the change in the magnetic force applied to the magnetic fluid 8, and the accompanying change in the shape of the magnetic fluid. In the timing charts shown in these figures, the horizontal axis represents the elapsed time t. First, the example of the timing chart shown in FIG. 18 is an example of a reply expression in response to a case where the speaker H says to the display device 2F words that will please the other person or give them great expectations. In this example, the speaker 31 emits sounds (words) such as "thump", "thump" ... that mimic the beating of the heart at regular intervals, and at the same timing, the magnetic force applied to the magnetic fluid 8 is increased, while the magnetic force is reduced between the sounds of "thump" and "thump", so that the shape of the magnetic fluid 8 changes periodically in sync with the sounds of "thump", "thump". As a result, in the reply from the display device 2F, it is possible to express, both audibly and visually, the state in which the heart is beating faster and emotions are heightened. In other words, by hearing the sounds "thump, thump" ... coming from the speaker 31 and visually recognizing that the magnetic fluid 8 in the display device 2F periodically changes between a rounded shape and a prickly shape with numerous spikes, the interlocutor H is able to have the sensation of communicating with the display device 2F as if he or she were talking to a person who is emotionally excited or upset.

The example of the timing chart shown in FIG. 19 is an example of a response expression in response to a situation where interlocutor H says something to the display device 2F that takes the other person by surprise. In this example, the speaker 31 outputs an onomatopoeic word indicating surprise such as "Surprise!" or a sound emitted when surprised such as "Huh!", and at the same timing, the magnetic force applied to the magnetic fluid 8 is increased to its maximum level and then the applied magnetic force is maintained. This makes it possible to change the shape of the magnetic fluid 8 to a shape indicating strong surprise in conjunction with the sound of "Surprise!" or "Huh!". Therefore, in the response by the display device 2F, it is possible to express, both audibly and visually, as if the person is very surprised and upset at what was said to the interlocutor H.

The example of the timing chart shown in FIG. 20 is an example of a response expression in response to interlocutor H's words to the display device 2F that are likely to anger the other party. In this example, the speaker 31 outputs a voice such as "Hey!" or "Hey!", which indicates anger, and at the same timing the magnetic force applied to the magnetic fluid 8 is increased to a maximum level, and then the magnetic force applied is reduced to a medium level. This allows the shape of the magnetic fluid 8 to change to a shape that indicates anger in conjunction with the voice of "Hey!" or "Hey!". Therefore, in the response by the display device 2F, it is possible to express, both audibly and visually, as if the display device is responding with anger to the words spoken to by interlocutor H.

The example timing chart shown in FIG. 21 is an example of a response to a situation where speaker H says something to the display device 2F that is disappointing to the other person. In this example, the speaker 31 outputs a voice that expresses disappointment, such as "Disappointing...", and at the same time, the magnetic force applied to the magnetic fluid 8, which had been at a moderate level up until that point, is reduced to essentially zero. This makes it possible to express, both audibly and visually, in the response by the display device 2F, as if the speaker is responding with feelings of disappointment to what was said to the interlocutor H.

In addition, in the example of the timing chart shown in FIG. 22, the display device 2F emits the voice "I'm so sleepy..." and at the same time, the magnetic force applied to the magnetic fluid 8, which had been medium until then, is reduced to essentially zero, causing the shape of the magnetic fluid 8 to change to a rounded shape without spikes. This makes it possible to effectively indicate to the interlocutor H that he is feeling sleepy and has lost his energy, both audibly and visually.

The example of the timing chart shown in FIG. 23 is an example of a response expression in response to a message from the interlocutor H to the display device 2F that will please the other person. In this example, the speaker 31 outputs a voice indicating joy, such as "Yay!" or "So happy!", and the strength of the magnetic force applied to the magnetic fluid 8 is changed in small increments (quickly), so that the magnetic fluid 8 appears to be dancing with joy. This allows the display device 2F to express, both visually and audibly, the state of responding with joy to the message spoken to by the interlocutor H. In this case, although not shown in the figure, it is also possible to express the magnetic fluid 8 flying freely in all directions in an enclosed space by changing the position of the magnetic force applied to the magnetic fluid 8 up and down or left and right, which makes it possible to more accurately express the feeling of joy. It is also possible to change the strength of the magnetic force in small increments and change the position of the magnetic force up and down or left and right at the same time.

In this way, in the display device 2F of this embodiment, the control unit 14A determines the words to reply to the interlocutor H and the emotion to be expressed when replying based on the input information from the interlocutor H side, and based on the determination, controls the speaker 31 to output a reply voice that indicates the emotion to the interlocutor H, and controls the magnetic force generating unit 6 to change the magnetic fluid 8 to a shape that indicates the emotion to the interlocutor H. This makes it possible for the display device 2F to change the shape and movement of the magnetic fluid 8 at the same time as the reply voice from the speaker 31 according to the content of the interlocutor H's voice, thereby making it possible to express pseudo-emotions. In addition, as a means for showing an unpleasant emotion (strong emotion) such as strong anger, great agitation, or great joy, the magnetic force applied to the magnetic fluid 8 is made relatively strong to make the shape of the magnetic fluid 8 a prickly shape with many spikes, while as a means for showing a calm emotion or a state of reduced energy such as a calm mind or a sleepy state, the magnetic force applied to the magnetic fluid 8 is made relatively weak to make the shape of the magnetic fluid 8 a rounded shape with almost no spikes.

[Seventh embodiment]
The seventh embodiment will be described with reference to Fig. 24 and Fig. 25. As shown in Fig. 24, the display device 2G in this embodiment is provided with a microphone 30 for picking up the voice of the interlocutor H at the center of the upper end of the display body 12. In addition, in the display device 2G in this embodiment, the sealed space between the glass plates 20 and 22 is separated into two chambers, an upper chamber and a lower chamber. That is, two chambers, an upper sealed space 24a and a lower sealed space 24b, are provided, and a partition wall 27 is disposed between them. Then, the upper sealed space 24a and the lower sealed space 24b each contain a magnetic fluid 8 (8A, 8B). In addition, in the display device 2G in this embodiment, instead of the voice response emitted from the speaker 31 in the sixth embodiment, a response is made by letters formed by the magnetic fluid 8A in the upper sealed space 24a. In addition, the expression of emotions by changing the shape of the magnetic fluid 8 performed in the sixth embodiment is performed by the magnetic fluid 8B in the lower sealed space 24b. In other words, in the display device 2G of this embodiment, when spoken to by the interlocutor H, the display device 2G replies with characters formed by the magnetic fluid 8A in the upper sealed space 24a, and at the same time expresses emotions by changing the shape and movement of the magnetic fluid 8B in the lower sealed space 24b.

In other words, in the display device 2G of this embodiment, as shown in FIG. 25, the control board 14G controls the magnetic force applied to the magnetic force generating unit 6 for the first sealed space 24a based on the data recognized by the voice recognition means 38, thereby changing the magnetic fluid 8A to generate letters for a reply to the interlocutor H, and controls the magnetic force applied to the magnetic force generating unit 6 for the second sealed space 24b to change the magnetic fluid 8B to a shape that shows an emotional expression toward the interlocutor H. This allows the display device 2F, when spoken to by the interlocutor H, to express emotions by changing the shape and movement of the magnetic fluid 8B as well as the letters formed by the magnetic fluid 8A, so that even in this embodiment, the interlocutor H can enjoy the sensation of communicating with a human or pet that has emotions.

In this embodiment, the only difference from the sixth embodiment is that the voice response from the speaker 31 is replaced with a text response formed from the magnetic fluid 8A in the upper sealed space 24a. Therefore, a detailed description of the letters in the magnetic fluid 8A in the upper sealed space 24a in the response to interlocutor H and the changes in shape and movement due to the application of magnetic force to the magnetic fluid 8B in the lower sealed space 24b will be omitted.

In the sixth and seventh embodiments, the microphone 30 picks up the voice of the interlocutor H, and a reply or emotional expression is made to the voice. However, the reply and emotional expression to the interlocutor H may be made based on biometric information of the interlocutor H inputted using various input means such as a smart watch 44, a non-contact thermometer 50, a pulse oximeter 52, or a camera 54.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications are possible within the scope of the technical ideas described in the claims, specifications, and drawings. For example, in the above-mentioned embodiments, the color of the magnetic fluid 8 was black, but as described in Patent Document 1, it may be a color other than black by containing soft magnetic light-shielding pieces such as glitter. In this way, the magnetic fluid 8 can be colored and displayed, so that various colors can be expressed by the magnetic fluid 8. In addition, in the above-mentioned embodiments, the magnetic fluid 8 is moved by magnetic force to form characters and figures, but as described in Patent Document 4, the entire space between the glass plates 20 and 22 may be filled with the magnetic fluid 8, and a backlight may be provided on the display body 12, and only the parts to which a magnetic field is applied by the electromagnet 36 may be aligned along the direction of the magnetic field, thereby utilizing the property of exhibiting light transparency, and characters and figures may be displayed by transmitted light. In addition, a vibrator may be provided on the display body 12, and the display effect of the characters and figures may be enhanced by vibrating the display body 12. In addition, although individual characteristic configurations have been described in the above-mentioned embodiments, characteristic configurations may be added and applied to each other between the respective embodiments.

Claims (8)

A magnetic force generating unit that generates a magnetic force;
A display body in which a magnetic fluid and a non-magnetic fluid are sealed;
a voice generating unit that generates a voice;
A control unit that controls the voice generating unit and the magnetic force generating unit based on input information from a conversation partner,
The control unit is
determining a reply word to the interlocutor and an emotion to be expressed when replying based on input information from the interlocutor, and based on the determination, controlling the voice generating unit to output a reply voice indicating the emotion to the interlocutor, and controlling the magnetic force generating unit to change the magnetic fluid into a shape indicating the emotion to the interlocutor;
A display device using a magnetic fluid, characterized in that the control unit and the magnetic force generating unit apply a relatively weak magnetic force to the magnetic fluid when the emotion expressed in the response is mild, compared to when the emotion is strong anger or surprise. A magnetic force generating unit that generates a magnetic force;
A display body in which a magnetic fluid and a non-magnetic fluid are sealed;
a voice generating unit that generates a voice;
A control unit that controls the voice generating unit and the magnetic force generating unit based on input information from a conversation partner,
The control unit is
determining a reply word to the interlocutor and an emotion to be expressed when replying based on input information from the interlocutor, and based on the determination, controlling the voice generating unit to output a reply voice indicating the emotion to the interlocutor, and controlling the magnetic force generating unit to change the magnetic fluid into a shape indicating the emotion to the interlocutor;
A display device using a magnetic fluid, characterized in that the control unit and the magnetic force generating unit apply a relatively strong magnetic force to the magnetic fluid when the emotion expressed in the response is strong anger or surprise, compared to when the emotion is mild. The display device using a magnetic fluid as described in claim 1, characterized in that the control unit controls the magnetic force generating unit to change the strength of the magnetic force applied to the magnetic fluid while emitting a voice from the voice generating unit, thereby simultaneously generating a response to the interlocutor and expressing an emotion by changing the shape of the magnetic fluid. 4. A display device using a magnetic fluid as claimed in any one of claims 1 to 3, further comprising a voice input means for inputting the voice of the interlocutor as input information from the interlocutor side, and the control unit determines the words of a reply to the interlocutor and the emotion to be expressed when replying based on the voice input from the voice input means. a receiving device for receiving biometric information data transmitted from an external device as input information from the interlocutor side,
The display device using a magnetic fluid according to any one of claims 1 to 3, characterized in that the control unit determines the words to reply to the interlocutor and the emotion to be expressed when replying based on the data input via the receiving device. The display device using a magnetic fluid according to claim 5 , wherein the bioinformation data is heart rate data transmitted from a wearable device which is the external device. A non-contact thermometer is provided for measuring the body temperature of the interlocutor as input information from the interlocutor side,
The display device using a magnetic fluid according to any one of claims 1 to 3, characterized in that the control unit determines the words to reply to the interlocutor and the emotion to be expressed when replying based on the value measured by the non-contact thermometer. a camera capable of capturing an image of the interlocutor as input information from the interlocutor side;
The display device using a magnetic fluid according to any one of claims 1 to 3, characterized in that the control unit has an image analysis means for analyzing changes in the interlocutor's facial expression from the image captured by the camera, and determines the words to reply to the interlocutor and the emotions to be expressed when replying based on the changes in the interlocutor's facial expression analyzed by the image analysis means.

Images