WO2025203755A1 - Control device, control method, and program - Google Patents

Abstract

The present disclosure relates to a control device, a control method, and a program that make it possible to improve user experience through scent. The present invention comprises a situation recognition unit that recognizes an activity state of a user, and a presentation control unit that controls the discharge of air containing a scent component to control the presentation of the scent to the user. On the basis of the activity state of the user, the presentation control unit sets an OFF period in which the discharge of the scent is set to OFF. For example, the OFF period in which the discharge of the scent is set to OFF is set in a fixed period after the start of an active period in which the user is active. The present technology can be applied to, for example, a scent presentation control system that controls the presentation of a scent in a vehicle.

Description

Control device, control method, and program

This disclosure relates to a control device, a control method, and a program, and in particular to a control device, a control method, and a program that can improve the user experience through scent.

Conventionally, development has been progressing on technology that presents scents inside vehicles, for purposes such as relaxing the driver or encouraging alertness in the driver.

Patent Document 1 discloses a vehicle fragrance device that intermittently sprays an air freshener scent in a specified cycle to suppress olfactory adaptation in passengers, repeating this cycle of spraying the scent and pausing a specified number of times, and then providing a pause period in which spraying the air freshener scent is stopped for a predetermined period of time, and then repeating this cycle repeatedly.

Patent Document 2 discloses a fragrance system that, when it detects that the driver is drowsy, emits a different fragrance if the time that has passed since the fragrance was first emitted has been short, and emits the same fragrance if the time that has passed since the fragrance was first emitted has not been short.

International Publication No. 2011/001808 Japanese Patent Application Laid-Open No. 2019-215669

By the way, it is believed that the user experience can be improved by realizing control that presents appropriate scents according to the user's activity status, compared to conventional technology.

This disclosure was made in light of these circumstances, and aims to improve the user experience through scent.

A control device according to one aspect of the present disclosure includes a situation recognition unit that recognizes the user's activity status, and a presentation control unit that controls the emission of air containing scent components to control the presentation of the scent to the user, and the presentation control unit sets an off period during which the emission of the scent is turned off based on the user's activity status.

A control method or program according to one aspect of the present disclosure includes recognizing a user's activity status and controlling the emission of air containing an odor component to control the presentation of the odor to the user, and sets an off period for turning off the emission of the odor based on the user's activity status.

In one aspect of the present disclosure, the user's activity status is recognized, and the emission of air containing scent components is controlled to control the presentation of scent to the user. An off period during which scent emission is turned off is then set based on the user's activity status.

1 is a block diagram showing a configuration example of an embodiment of an odor presentation control system to which the present technology is applied. 10 is a flowchart illustrating an odor presentation control process. 10A and 10B are diagrams illustrating an example of a control process in which a discharge period is set to coincide with a user's activity period. FIG. 10 is a diagram illustrating an example of a control process in which an active off period is set for a certain period after the start of a user's active period. FIG. 10 is a diagram illustrating an example of a control process in which an active off period is set for a certain period before the end of a user's active period. FIG. 10 is a diagram illustrating an example of a control process in which a fade-in period is set for a certain period after the start of a user activity period. FIG. 10 is a diagram illustrating an example of a control process in which a fade-out period is set to a certain period before the end of a user's activity period. 10 is a diagram showing an example of a UI screen display on which a GUI button for instructing the setting of an operation mode and a GUI button for instructing user settings are arranged. FIG. FIG. 10 is a diagram showing an example of a UI screen display on which UI buttons for selecting an operation mode for setting details are arranged. FIG. 10 is a diagram showing an example of a UI screen display on which a UI button for instructing detailed settings of an operation mode is arranged. FIG. 10 is a diagram showing an example of a UI screen display for specifying the intensity of an odor. FIG. 10 is a diagram showing an example of a UI screen display for selecting the type of odor to be presented in sleep mode. 10A and 10B are diagrams illustrating an example of a UI screen display for inputting an evaluation of a discharge condition. 10A and 10B are diagrams illustrating how customization settings based on learning results are reflected on a UI screen. 1 is a block diagram illustrating an example of the configuration of an embodiment of a computer to which the present technology is applied. 1 is a block diagram showing an example of a schematic configuration of a vehicle control system; FIG. 2 is an explanatory diagram showing an example of the installation positions of an outside-vehicle information detection unit and an imaging unit.

Specific embodiments applying this technology will be described in detail below with reference to the drawings.

<Configuration example of odor presentation control system>
FIG. 1 is a block diagram showing an example of the configuration of an embodiment of an odor presentation control system to which the present technology is applied.

As shown in FIG. 1, the odor presentation control system 11 is configured to include an input unit 21, a memory unit 22, a setting adjustment unit 23, a situation recognition unit 24, a determination unit 25, a receiving unit 26, a transmitting unit 27, a presentation control unit 28, an odor presentation unit 29, a linkage control unit 30, and a linkage unit 31. The odor presentation control system 11 can be mounted on a vehicle, for example, and can control the presentation of odors to passengers in the vehicle, including the driver of the vehicle (hereinafter also referred to as users), by emitting air containing odor components (aroma components) resulting from the volatilization of fragrance.

The input unit 21 is, for example, an information processing terminal equipped with a touch panel, and displays a UI (User Interface) screen such as those shown in Figures 8 to 13 (described below), which is used by the user to set the operating mode and input discharge conditions.

Using the input unit 21, the user can set the operating mode to be executed by the odor presentation control system 11 (e.g., automatic mode, meal mode, sleep mode, map mode, reading mode, children's mode, external environment (map/weather) mode, emotion mode, etc.). Using the input unit 21, the user can input detailed settings that are individual to each user. Using the input unit 21, the user can input the operating mode or the ejection conditions that are set for each user (e.g., odor intensity (air volume), type of odor (fragrance/aroma), etc.). Using the input unit 21, the user can input their evaluation of the ejection conditions.

The memory unit 22 stores the operating mode input using the input unit 21 or the ejection conditions set for each user (such as detailed settings such as the strength and type of odor, or settings adjusted to suit the user), and also stores the user's evaluation of the ejection conditions.

The setting adjustment unit 23 acquires additional information such as the temperature and humidity of the local area as needed to adjust the settings of the ejection conditions, and supplies this information to the presentation control unit 28.

The situation recognition unit 24 acquires detection data detected by, for example, a motion sensor that detects the movements of a person inside a vehicle equipped with the scent presentation control system 11, or an odor sensor that detects odors inside the vehicle. The situation recognition unit 24 also acquires images captured by an in-vehicle camera, an in-vehicle sensor, an exterior camera, and an exterior sensor that detect the interior and exterior of the vehicle. The situation recognition unit 24 then recognizes the user's activity status inside the vehicle based on the detection data acquired from each sensor and the images acquired from each camera. Additionally, the situation recognition unit 24 may use vehicle location information, weather information, or past data stored on a server to recognize the user's activity status inside the vehicle. The situation recognition unit 24 then supplies recognition information indicating the recognition results of the user's activity status inside the vehicle to the determination unit 25. The situation recognition unit 24 can also directly supply the recognition information to the presentation control unit 28 when changing the discharge conditions in response to changes in the user's activity status inside the vehicle.

For example, the situation recognition unit 24 can recognize the driver's activity status, such as driving, resting, waiting at a traffic light, eating or drinking, listening to music, having a conversation, or being car sick. Furthermore, the situation recognition unit 24 can recognize the activity status of users other than the driver, such as looking at the scenery, sleeping, helping with navigation, enjoying games, smartphones, music, etc., a crying child, eating or drinking, having a conversation, reading, working, exercising, a date, an event, or being car sick. The situation recognition unit 24 may also refer to the user's emotional information, vital signs, the content of the conversation, location information, etc.

The determination unit 25 determines whether a change in the user's activity status within the vehicle has been detected, based on the recognition information supplied from the situation recognition unit 24. If the determination unit 25 determines that a change in the user's activity status within the vehicle has been detected, it determines whether to change the ejection conditions in accordance with the change in the activity status, and instructs the presentation control unit 28 to change the ejection conditions.

Furthermore, the determination unit 25 can, for example, determine the operating mode to be executed by the odor presentation control system 11, or determine the user (person to whom the odor is to be presented) using the odor presentation control system 11, based on information input using the input unit 21.

The receiving unit 26 receives various types of information required by the presentation control unit 28 to control the presentation of odors from a control device external to the odor presentation control system 11 (for example, an ECU (Electronic Control Unit) mounted on the vehicle), and supplies the information to the presentation control unit 28. For example, if the vehicle on which the odor presentation control system 11 is mounted is a movable convertible, the receiving unit 26 can receive open/close information indicating the open/closed state of the vehicle's roof from the ECU and supply the information to the presentation control unit 28. Similarly, the receiving unit 26 can receive open/close information indicating the open/closed state of the vehicle's windows (including, for example, roof windows) from the ECU, and supply the information to the presentation control unit 28, not just when the vehicle is a convertible. Furthermore, the receiving unit 26 can receive information indicating the degree to which the vehicle windows are open (for example, information indicating the degree to which the windows are open (such as a fully open state, a half-open state, or a one-third open state) (open/close level information), information indicating how many windows are open at the same time (open window number information), and information indicating which windows are open/closed (open window position information or closed window position information)) from the ECU and supply this information to the presentation control unit 28.

The transmission unit 27 acquires from the presentation control unit 28 various pieces of information that need to be notified to a control device external to the presentation control system 11 as a result of the presentation control unit 28 controlling the presentation of the odor, and transmits this information to the control device external to the odor presentation control system 11.

The presentation control unit 28 controls the presentation of odors by the odor presentation unit 29 according to the user's activity status, operating mode, or emission conditions set for each user. For example, the presentation control unit 28 can set the type of odor, the time for presenting the odor, the intermittent operation of odor presentation, the air volume, the air direction, etc. for the odor presentation unit 29. The presentation control unit 28 can change the emission conditions when the determination unit 25 determines that the emission conditions should be changed. The presentation control unit 28 can control the presentation of odors to the driver based on the activity status of users other than the driver. The presentation control unit 28 can also control the emission pattern in which the odor presentation unit 29 emits air containing odor components. For example, the presentation control unit 28 can control the emission period and off period, or control the fade-in or fade-out during the emission period, based on the user's activity status, as will be described later with reference to Figures 3 to 7.

Furthermore, the presentation control unit 28 can control the intensity of the odor presented by the odor presentation unit 29 in accordance with the open/close information supplied from the receiving unit 26. For example, when a user opens the roof of a convertible and open/close information indicating that the vehicle roof is open is supplied via the receiving unit 26, the presentation control unit 28 controls the odor presentation unit 29 to increase the intensity of the odor. That is, when the vehicle roof is open, wind is more likely to enter the vehicle than when the vehicle roof is closed, and odor components are more likely to volatilize due to the influence of airflow disturbances. Therefore, the presentation control unit 28 can appropriately present an odor by controlling the intensity of the odor based on such open/close information, i.e., based on information indicating whether the environment in which the odor is presented is open. The presentation control unit 28 can also control the intensity of the odor presented by the odor presentation unit 29 based on normal open/close information indicating the open/closed state of the vehicle windows, or information indicating the degree to which the vehicle windows are opened, as described above.

The odor presentation unit 29 is composed of a single diffuser containing two or more different fragrances, or a physical or electrical combination of multiple diffusers containing one or more fragrances. Under the control of the presentation control unit 28, the odor presentation unit 29 opens and closes valves and orifices, and adjusts the air volume and direction of the blower, and emits air containing volatile odor components (aroma components) from the fragrance to present the odor to the user. The odor presentation unit 29 can adjust the intensity of the odor (the concentration of odor components contained in the emitted air) by setting the concentration of the cartridge containing the fragrance, the air speed, the aperture opening area, the ejection time per ejection, the ejection frequency, etc. For example, the intensity of the odor can be increased by increasing the air speed, opening area, ejection frequency, etc.

The interlocking control unit 30 controls the vehicle's interlocking unit 31, which operates in conjunction with the scent presented by the scent presentation unit 29.

The interlocking unit 31 may be configured to include, for example, the vehicle's windows and doors, interior and exterior vehicle lights, drive mechanisms for the vehicle's seat reclining and footrests, speakers that output music, a display unit that displays images, and air conditioning equipment for cooling, heating, and ventilation. The interlocking unit 31 may also be configured to include operating mechanisms for operating tables, cup holders, seat belts, wipers, washer fluid, etc.

The odor presentation control system 11 is configured as described above, and can control the presentation of odors to suit the preferences and state of each individual user, thereby improving the user experience with odors.

For example, the odor presentation control system 11 can extend the time for which odor presentation is turned off depending on the breathing and activity status of the user in the car (while driving, operating a smartphone, sleeping, etc.). Furthermore, the odor presentation control system 11 can appropriately present odors according to the user's activity status, such as turning off odor presentation when the user is sleeping and turning on odor presentation when the user is working and feeling tense.

In addition, the odor presentation control system 11 can be configured by providing each block constituting the odor presentation control system 11 on a single device, or, for example, by distributing the blocks across multiple devices. In this case, it is necessary to provide a communication unit for communication between the devices. For example, some of the functions of the odor presentation control system 11 can be integrated into a diffuser, which is the odor presentation unit 29, and the odor presentation unit 29 can control the interlocking unit 31 on the vehicle side. Furthermore, the odor presentation control system 11 can automatically execute the odor presentation control process in conjunction with a system that controls the vehicle, or the user can use the input unit 21 to instruct the execution of the odor presentation control process.

The odor presentation control process executed in the odor presentation control system 11 will be described with reference to the flowchart shown in Figure 2. For example, when a user in a vehicle operates the input unit 21 to instruct the odor presentation control system 11 to start up, the odor presentation control process is initiated.

In step S11, when the user sets an operation mode or inputs ejection conditions, the input unit 21 acquires the input operation mode or ejection conditions and supplies them to the presentation control unit 28. If the user does not set an operation mode or input ejection conditions, the presentation control unit 28 acquires the default operation mode or ejection conditions, or the operation mode or ejection conditions used in the previous odor presentation control process, from the memory unit 22.

In step S12, the situation recognition unit 24 begins recognizing the user's activity status within the vehicle and supplies recognition information indicating the recognition results to the determination unit 25.

In step S13, the determination unit 25 determines whether a change in the user's activity status within the vehicle has been detected based on the recognition information supplied from the situation recognition unit 24.

If the determination unit 25 determines in step S13 that a change in the user's activity status within the vehicle has been detected, processing proceeds to step S14.

In step S14, the determination unit 25 determines whether to change the discharge conditions in response to changes in the user's activity status within the vehicle.

If the determination unit 25 determines in step S14 that the discharge conditions should be changed, the process proceeds to step S15. In step S15, the determination unit 25 instructs the presentation control unit 28 to change the discharge conditions in response to changes in the user's activity status within the vehicle, and the presentation control unit 28 changes the discharge conditions based on the recognition information supplied from the situation recognition unit 24.

On the other hand, if it is determined in step S13 that no change in the user's activity status within the vehicle has been detected, if it is determined in step S14 that the discharge conditions should not be changed, or after processing in step S15, processing proceeds to step S16.

In step S16, the presentation control unit 28 controls the odor presentation unit 29 (e.g., emitting an odor, stopping odor emission, continuing these operations, etc.) so that the odor is presented in accordance with the emission conditions.

In step S17, the input unit 21 determines whether to record the ejection conditions and evaluation based on the user's input. For example, if the user likes the ejection conditions used to control the presentation of the scent in step S16, the user can use the input unit 21 to input an evaluation so that the ejection conditions are recorded. At this time, for example, a UI screen such as that shown in Figure 13, which will be described later, can be used.

If the input unit 21 determines in step S17 that the ejection conditions and evaluation should be recorded, processing proceeds to step S18. In step S18, the input unit 21 records the ejection conditions and evaluation and stores them in the memory unit 22.

On the other hand, if it is determined in step S17 that the ejection conditions and evaluation should not be recorded, or after processing in step S18, processing proceeds to step S19.

In step S19, the presentation control unit 28 determines whether or not to operate the linkage unit 31 in conjunction with the scent presented in step S16.

If, in step S19, the presentation control unit 28 determines that the interlocking unit 31 should operate in conjunction with the scent presented in step S16, the process proceeds to step S20. In step S20, the presentation control unit 28 instructs the interlocking control unit 30 to operate the interlocking unit 31, and the interlocking control unit 30 controls the operation of the interlocking unit 31 in accordance with that instruction.

On the other hand, if it is determined in step S19 that the interlocking unit 31 will not be operated, or after processing in step S20, processing proceeds to step S21.

In step S21, the input unit 21 determines whether or not to terminate the odor presentation control process in accordance with input from the user. For example, when the user operates the input unit 21 to turn off the odor presentation control system 11, the input unit 21 determines that the odor presentation control process should be terminated.

If the input unit 21 determines in step S21 not to terminate the odor presentation control process, the process returns to step S12, and the same process is repeated thereafter. On the other hand, if the input unit 21 determines in step S21 to terminate the odor presentation control process, the process is terminated.

By executing the above-described odor presentation control process, the odor presentation control system 11 can improve the user experience through odors. Furthermore, the odor presentation control system 11 allows the user to change the discharge conditions using the input unit 21, and provides feedback on the user's evaluation for future use.

<Example of use of the odor presentation control system>
An example of the use of the odor presentation control system 11 will be described.

For example, the odor presentation control system 11 can be used when the driver is taking a nap or a break.

First, the driver can operate the input unit 21 (or use voice input) to input that they would like to take a nap or rest. Alternatively, the odor presentation control system 11 can encourage the driver to take a nap or rest based on the length of time the vehicle has been driven, the level of accumulated stress based on vital information obtained from a device worn by the driver, map information indicating that a service area where a nap or rest is possible is nearby, and the driver can agree to this.

The driver checks whether the vehicle engine is stopped and operates the input unit 21 to turn on the rest mode. If multiple odor presentation units 29 are installed in the vehicle, the odor presentation unit 29 closest to the driver, who is the target user, can be controlled to present at least the odor.

Then, the odor presentation control system 11 begins presenting an odor with a relaxing effect to the driver. If an odor with an awakening effect has been presented while the driver is driving, the presentation of the odor with an awakening effect will be stopped and then the presentation of the odor with a relaxing effect will begin. Alternatively, if an odor with a relaxing effect has already been presented, the interval between odor presentations will be shortened and the intensity of the odor will be increased.

Then, when the driver operates the input unit 21 (or uses voice input) to indicate that the break is ending, the odor presentation control system 11 can turn off the rest mode. Alternatively, the odor presentation control system 11 can turn off the rest mode by determining that it is necessary to end the break based on, for example, recognizing the time required to reach the destination or the elapse of a pre-set rest time.

In this way, by using the odor presentation control system 11 for naps and resting, the quality of naps and resting while driving can be improved.

For example, the odor presentation control system 11 can be used by users other than drivers when they are sleeping or resting.

The scent presentation control system 11 can predict or detect situations in which the driver is likely to become drowsy. For example, the scent presentation control system 11 can recognize from images from an in-car camera if the user in the passenger seat or the user in the back seat is asleep, or if conversation with these users has decreased, and predict that the driver is likely to become drowsy.

In this case, the odor presentation control system 11 turns on the wake-up mode. Note that if multiple odor presentation units 29 are installed in the vehicle, control can be exercised so that only the odor presentation unit 29 closest to the target user, the driver, presents an odor; for example, control can be exercised so that an odor is not presented from the odor presentation unit 29 closest to the sleeping user.

Then, the odor presentation control system 11 begins presenting an odor with an awakening effect to the driver. If an odor with a relaxing effect has been presented, the system stops presenting the odor with a relaxing effect and then begins presenting an odor with an awakening effect. Alternatively, if an odor with an awakening effect has already been presented, the system shortens the interval at which the odor is presented and increases the intensity of the odor.

Thereafter, when the driver operates the input unit 21 (or may use voice input) to input that they wish to end driving, the scent presentation control system 11 can turn off the wakefulness mode. Alternatively, the scent presentation control system 11 can turn off the wakefulness mode when it recognizes that it is approaching the vicinity of the destination.

For example, the odor presentation control system 11 can be used by people other than drivers while they are eating.

When the odor presentation control system 11 recognizes through images from an in-vehicle camera or an odor sensor that another user in the passenger seat or back seat has started eating, it can predict or detect a situation in which the driver may be distracted from driving by the smell of the other user's meal.

In this case, the odor presentation control system 11 turns on the comfort mode. Note that if multiple odor presentation units 29 are installed in the vehicle, control can be exercised so that only the odor presentation unit 29 closest to the driver, who is the target user, presents an odor; for example, control can be exercised so that an odor is not presented from an odor presentation unit 29 closest to a user who is eating.

Then, the odor presentation control system 11 begins presenting an odor that the driver finds comfortable (for example, an odor that the driver has registered as a favorite, or an odor that does not cause nausea even when mixed with the odor of food). Alternatively, if that odor has already been presented, the system shortens the interval at which the odor is presented and increases the intensity of the odor.

Then, when the driver operates the input unit 21 (or uses voice input) to input that the other user has finished eating, the odor presentation control system 11 can turn off the comfort mode. Alternatively, when the odor presentation control system 11 recognizes, through an image from the in-vehicle camera or an odor sensor, that the other user has finished eating, it can turn off the wakefulness mode.

Next, we will explain the control flow of the odor presentation control system 11 when eating and drinking are taking place in a vehicle.

For example, the smell presentation control system 11 can be triggered by a human presence sensor or an in-car camera detecting that a hand has reached into a cup holder or that a table has been used. The smell presentation control system 11 can also be triggered by a sensor detecting the smell of food that has been learned in advance, or by detecting some kind of change in the smell inside the car. The smell presentation control system 11 can also be triggered by an in-car camera detecting eating and drinking situations inside the car based on images of food that have been learned in advance or human movements.

The odor presentation control system 11 can stop presenting the odor only in the area of the vehicle where eating and drinking is taking place, or throughout the entire vehicle, or can reduce the intensity of the odor presentation (for example, by suddenly or gradually reducing the airflow), or change the direction of the airflow presenting the odor. Furthermore, if the odor presentation control system 11 is presenting an odor that does not go well with food, it can switch to presenting a different odor (for example, switching from a floral scent to an orange scent).

Furthermore, when only a specific user is eating or drinking, the odor presentation control system 11 can control the airflow to create an air curtain (odorless airflow) so that the smell of the food or drink does not mix with the smell presented to other users.

Alternatively, the odor presentation control system 11 may operate a deodorizer only in the eating and drinking area or throughout the entire vehicle, or may enhance ventilation to eliminate food odors or present an odor that counteracts the food odor. In this case, the interlocking unit 31 can open the windows to encourage ventilation.

Next, we will explain the control flow of the odor presentation control system 11 after eating or drinking has been done in the vehicle.

For example, the smell presentation control system 11 can be triggered when a human presence sensor or an in-car camera detects that the user has stopped moving around a cup holder or table. The smell presentation control system 11 can also be triggered when a sensor detects that the smell of a previously learned food has weakened, or when some kind of change in the smell inside the car is detected. The smell presentation control system 11 can also be triggered when an in-car camera detects that eating and drinking inside the car has finished, based on images of previously learned food or human movements.

The odor presentation control system 11 can start presenting an odor only in the area of the vehicle where eating and drinking is taking place, or throughout the entire vehicle, increase the intensity of the odor presentation (for example, by suddenly or gradually increasing the airflow), or change the direction of the airflow presenting the odor. The odor presentation control system 11 can also switch to an odor that is optimal for falling asleep or waking up, according to the operating mode specified by the user.

Furthermore, when a specific user is eating or drinking alone, the odor presentation control system 11 can control the stopping of an air curtain (odorless airflow) that is being generated to prevent the smell of the food or drink from mixing with the smell presented to other users.

Alternatively, the odor presentation control system 11 may operate a deodorizer only in the eating and drinking area or throughout the entire vehicle, or may enhance ventilation to eliminate food odors or present an odor that counteracts the food odor. In this case, the interlocking unit 31 can open the windows to encourage ventilation.

Next, we'll explain the child mode, which presents scents that will soothe your baby.

For example, the scent presentation unit 29 can be installed on the child car seat's headrest, belt, or side of the main body. Furthermore, if the child car seat is installed in the rear seat, the headrest can be installed on the rear seat side of the driver's seat or passenger seat headrest.

The user can operate the input unit 21 to input that they wish to switch to child mode. Alternatively, the scent presentation control system 11 can automatically set child mode when it detects that the vehicle's engine has started and the vehicle has begun to move, and recognizes the presence of a baby from images taken by the in-vehicle camera. In child mode, scents that are soothing to babies, such as the scent of a mother or breast milk, are presented.

For example, rather than determining whether to present an odor based on the sound of a baby crying, the odor presentation control system 11 can determine whether to present an odor based on whether the vehicle is stopped (or about to stop) in order to determine whether to present an odor before the baby starts crying to stop it.

For example, the scent presentation control system 11 can determine whether a vehicle is stopped by acquiring vehicle speed information, acquiring position information or acceleration information from a device such as a smartphone carried by the user, detecting vehicle vibrations, and recognizing whether the vehicle windows are moving. The scent presentation control system 11 can make this determination by continuous monitoring or regular monitoring every second.

Furthermore, the odor presentation control system 11 can arbitrarily set the time between the first odor emission and the next decision. Furthermore, the odor presentation control system 11 can adjust the frequency and timing of decisions to present an odor while the vehicle is stopped.

The odor presentation control system 11 can then recognize the baby's condition and stop presenting the odor when the baby stops crying or when the vehicle starts moving.

Next, we will explain how the odor presentation control system 11 acquires information from the vehicle's operation and presents odors.

The odor presentation control system 11 measures the number of times the brakes are applied per unit time, and can recognize that a traffic jam is occurring if the number exceeds a threshold. Generally, drivers are under high stress when stuck in a traffic jam, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which an odor with a relaxing effect is presented, or decrease the intensity of the odor by lengthening the interval at which an odor with an awakening effect is presented.

The odor presentation control system 11 measures the angle at which the driver turns the steering wheel per unit time, and if that angle is below a threshold, it can recognize that the vehicle is traveling on a straight road. Generally, drivers become more drowsy when traveling on a straight road, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which an odor with an awakening effect is presented, or can decrease the intensity of the odor by lengthening the interval at which an odor with a relaxing effect is presented.

The odor presentation control system 11 compares the driving speed with the speed limit of the road on which the vehicle is traveling, detects sudden starts or stops of the vehicle, and can recognize that the vehicle is traveling at the very limit of the speed limit if the difference between the driving speed and the speed limit is below a threshold. Generally, drivers feel stressed when traveling at the very limit of the speed limit, so the odor presentation control system 11 can increase the intensity of the odor by shortening the interval at which an odor with a relaxing effect is presented, or decrease the intensity of the odor by lengthening the interval at which an odor with an awakening effect is presented.

In addition, the odor presentation control system 11 can obtain information from the vehicle, as described below, and present the odor.

For example, when driving in the rain, the driver uses the windshield wipers to ensure visibility and slows down to accommodate slippery road surfaces, so the odor presentation control system 11 can obtain information that the driver is driving in the rain based on the use of the windshield wipers and the deceleration of the vehicle.

For example, in dense fog, the driver will turn on the fog lights to improve visibility and significantly reduce their speed to ensure safety, so the odor presentation control system 11 can obtain information that the driver is driving in dense fog based on the use of the fog lights and the significant deceleration.

For example, on gravel or unpaved roads, the driver will drive slowly and carefully to respond to the instability of the road surface and ensure control of the vehicle, so the odor presentation control system 11 can acquire information that the vehicle is being driven on a gravel or unpaved road based on the driver's slowing down and careful steering.

For example, when driving to park, the driver puts the car in the appropriate gear and finely adjusts the accelerator and brake to fit into the parking space, so the odor presentation control system 11 can obtain information that the vehicle is being driven to park based on the gear change and precise accelerator and brake operation.

For example, when driving at night, drivers turn on their headlights to ensure visibility and adjust their speed appropriately to deal with the poor visibility that is typical of nighttime driving. Therefore, the odor presentation control system 11 can obtain information that driving is at night based on the use of headlights and the adjustment of speed.

For example, in a situation where sudden braking is required, the driver will quickly and strongly brake if there is a sudden obstacle or an emergency stop is required, so the odor presentation control system 11 can obtain information that a situation requires sudden braking based on the driver pressing the brake pedal strongly.

For example, when driving long distances, drivers take regular breaks to prevent fatigue and change their sitting posture to improve blood flow, so the odor presentation control system 11 can obtain information that the driver is driving a long distance based on the regular breaks and changes in posture.

For example, when driving in accordance with road signs and traffic lights, the driver adjusts their speed according to speed limit signs, stop signs, and traffic lights, so the odor presentation control system 11 can obtain information that the driver is driving in accordance with road signs and traffic lights based on the speed adjustments and direction changes.

With reference to Figures 3 to 7, we will explain the control process for controlling the presentation of odors by setting emission periods and off periods in accordance with the user's activity period.

Figure 3 shows an example of a control process that sets the discharge period to coincide with the user's activity period.

In the control process shown in FIG. 3, a first discharge period is set to coincide with a first active period, a first off period is set between the first active period and the second active period, a second discharge period is set to coincide with a second active period, a second off period is set between the second active period and the third active period, and a third discharge period is set to coincide with a third active period.

Here, the odor presentation control system 11 ejects air containing odor components in an ejection pattern in which multiple ejections (five ejections in the example shown in Figure 3) are performed intermittently. Therefore, one cycle is defined as the interval (unit time) during which multiple ejection periods and pause periods during which no ejection is performed are alternately repeated, and air containing odor components is ejected periodically during one ejection period.

Figure 4 shows an example of a control process in which the discharge period is set so that an active off period, which is an off period during the user's active period, is provided for a certain period after the user's active period begins.

In the control process shown in FIG. 4, a first ejection period is set to coincide with a first active period, a first off period is set between the first active period and the second active period, and a second ejection period is set to coincide with the second active period. The second off period, which begins after the second active period ends, is provided until a certain period has elapsed after the start of the third active period, and the second off period during the third active period becomes an active off period. After the second off period ends, the third ejection period begins. Also, as shown in the figure, ejection is performed intermittently multiple times per cycle (unit time) during each of the first to third ejection periods.

In this way, by setting aside a certain period of time after the start of a new activity period, you can use this time to change your mood for that activity.

For example, when switching from an activity that requires concentration, such as work or reading, or when switching after a meal (to prevent smells from mixing), if the two activities use the same type of smell (such as orange and lemon), when you have become accustomed to the smell you have been sensing up until that point, or in an environment where it is expected that the smell will not reach your nose (for example, when it is windy), it is preferable to set up an off period during the activity in this way to extend the off period.

Figure 5 shows an example of a control process in which the discharge period is set so that an active off period, which is an off period during the user's active period, is provided for a certain period before the end of the active period.

In the control process shown in FIG. 5, a first discharge period is set to coincide with a first active period, a first off period is set between the first active period and the second active period, and the second discharge period begins when the second active period begins. The second discharge period ends before the second active period ends, and the second off period begins, and the second off period during the second active period becomes an active off period. After the second off period ends, a third active period and a third discharge period begin. Also, as shown in the figure, multiple discharges are performed intermittently per cycle (unit time) during each of the first to third discharge periods.

In this way, by setting aside an off-period for a certain period before the end of an activity period, it can be used as a period to change mood for that activity. For example, in the odor presentation control system 11, the presentation control unit 28 can start the off-period before the end of the activity period by understanding the user's planned activities through a link with other information (for example, linking with a schedule). Then, the end of the activity period can be determined according to the recognition results by the situation recognition unit 24.

For example, when using a schedule to switch from an activity that requires concentration, such as work or reading, or when using the recognition results to switch after a meal (to prevent odors from mixing), or when using a schedule to emit the same type of odor (such as orange and lemon) for two activities, it is preferable to set up off periods during activities in this way and extend the off periods when you have become accustomed to the odors you have been sensing up until now, or in an environment where it is expected that the odors will not reach your nose (for example, when it is windy).

Figure 6 shows an example of a control process in which the emission period is set so that a fade-in period is provided, during which the scent gradually becomes stronger for a certain period after the user's activity period begins.

In the control process shown in FIG. 6, a first emission period is set to coincide with the first active period, and a first off period is set between the first active period and the second active period. Then, during the second emission period, which begins with the second active period, a fade-in period is set in which the odor is perceived as gradually becoming stronger. After that, after the second active period and the second emission period end, a second off period is set between the second active period and the third active period, and the third emission period is set to coincide with the third active period. Also, as shown in the figure, during each of the first to third emission periods, multiple emissions are performed intermittently for each cycle (unit time), and in the example shown, a fade-in period is set in the first cycle of the second emission period. Note that fade-in periods may also be set across multiple cycles.

In this way, by setting a fade-in period for a certain period after the start of a new activity period, it is possible to aim for a natural transition into that activity. For example, by gradually lengthening the intermittent emission time during the fade-in period, it is possible to achieve a fade-in in the way the smell is perceived.

For example, it is preferable to provide a fade-in period in this way when falling asleep while resting, when presenting scents to a baby (for example, fading in as the vehicle accelerates), when making the scent stronger as the driving situation approaches a dangerous one (speed, distance to the white line, etc.), when the sensitivity to scents associated with the activity state approaches a threshold, when listening to music or watching a movie and the music/movie starts or when the screen changes drastically, when a conversation is in full swing (you don't want to be interrupted), when working, reading or other activities that require concentration, or when presenting scents to evoke a meal in a specific environment (by the seaside/forest, near a flower bed, etc.) (fading in makes it easier to immerse yourself in that environment in a more natural way).

Figure 7 shows an example of a control process in which the emission period is set so that a fade-out period is provided, during which the scent gradually weakens for a certain period before the user's activity period ends.

In the control process shown in FIG. 7, when the first emission period, which starts at the same time as the first active period, ends, a fade-out period is set to make the odor seem to gradually weaken. Thereafter, a first off period is set between the first active period and the second active period, a second emission period is set to coincide with the second active period, a second off period is set between the second active period and the third active period, and a third emission period is set to coincide with the third active period. Also, as shown in the figure, in each of the first to third emission periods, multiple emissions are performed intermittently for each cycle (unit time), and in the example shown, a fade-out period is set in the last cycle of the first emission period. Note that fade-out periods may also be set across multiple cycles.

In this way, by setting a fade-out period a certain period before the end of an activity period, it is possible to aim for a natural ending to that activity. For example, by gradually lengthening the intermittent emission time during the fade-out period, it is possible to achieve a fade-out in the way the smell is perceived.

For example, when listening to music or watching a movie, it is preferable to fade out in time with the end of the music or movie (especially if there is little change on the screen at the end), when the conversation is getting lively, when the user is concentrating on work or reading, or when the scent presentation to a baby has ended.

Fade-in and fade-out can be achieved by controlling the duration of each emission during the emission period, or by controlling the concentration of the scent components contained in the emitted air so that it gradually becomes weaker or stronger. That is, fade-in and fade-out can be achieved by using cartridges containing fragrances of different concentrations, or by changing the wind speed at which the air containing the scent components is emitted. For example, if all conditions other than the wind speed are constant, increasing the wind speed can make the user perceive the scent as stronger, and decreasing the wind speed can make the user perceive the scent as weaker.

Furthermore, the switching of scents can be controlled by lengthening the emission period or the off period. Furthermore, the switching of scents can also be controlled by sharply switching between the emission period and the off period, or by fading in or out.

For example, if the discharge period and off period are 1:1, the latter half of the discharge period can be faded out, the discharge period and off period can be gradually lengthened, or the discharge period and off period can be kept the same. For example, it is preferable to gradually change the scent to one that has a relaxing effect when it comes to falling asleep. Also, if someone with an unpleasant smell gets into the vehicle, it is preferable to change the scent gradually so that the change is not noticeable. It is also possible to suddenly change the scent in line with the vehicle's acceleration, gradually switch scents to match the overall journey, quickly stop presenting the scent when eating or drinking begins, or control the scent to approach a comfort value based on feedback from previous use (user impressions or evaluations) or the sensed state.

Furthermore, the odor presentation control system 11 can control the interval between the emission period and the off period using a valve, fan, fragrance cartridge, etc., and can change the intensity of the odor. For example, the odor presentation control system 11 can rapidly change the odor by turning the valve and fan on and off, opening and closing the valve (or emission port), and changing the fan speed. The odor presentation control system 11 can also rapidly change the odor by changing the speed of the fan on the back of the fragrance cartridge and changing the opening and closing time of the valve on the fragrance cartridge. For example, even if the air volume remains the same when the valve is closed gently, changing the air velocity at which the odor is emitted will change the spread of the odor.

Furthermore, when there are multiple fragrance cartridges and valves, the odor presentation control system 11 can change the odor intensity (weak/medium/strong) by controlling the number of valves that are turned on, even if the system is designed to blow air using a single fan. Furthermore, by changing the way the wind that blows out the air containing the odor components spreads (the opening width of the outlet), the odor presentation control system 11 can control whether the odor is presented in a pinpointed manner or over a wide area, allowing the user to sense the difference in concentration.

Furthermore, the odor presentation control system 11 can set thresholds for sleep, car acceleration, and babies to monitor activity status, and can set the odor to fade in or out so that the intensity becomes stronger as the absolute value becomes smaller and the intensity becomes weaker as the absolute value becomes larger compared to the threshold. Similarly, the odor presentation control system 11 can set the odor to fade in or out when music ends, when the amount of video changes, when a conversation gets lively, when the person is immersed in something else such as reading or work, after a meal, before a meal (when the person wants to eat in a specific setting), etc.

Furthermore, the odor presentation control system 11 can abruptly turn odor presentation on and off during meals (when you want to eat without the aroma), when a threshold is suddenly exceeded, when the conversation is not going well, when you are feeling drunk, or at the start or end of a task that requires concentration.

Furthermore, the odor presentation control system 11 can set a longer off period based on internal factors, such as when the user wants to prevent habituation to the odor, and external factors, such as when the user wants to prevent other odors from mixing in and when the environment is such that the odor is not expected to reach the nose (e.g., strong winds).

<UI screen display example>
Display examples of the UI screen displayed on the touch panel of the input unit 21 will be described with reference to FIGS.

Figure 8 shows an example of a UI screen on which GUI (Graphical User Interface) buttons for instructing the setting of the operating mode and GUI buttons for instructing user settings are arranged. For example, this UI screen is displayed when an instruction is given to start the odor presentation control system 11.

On the UI screen shown in Figure 8, the name of the selected operation mode (in the example shown in Figure 8, "XX mode") is displayed next to the GUI button that instructs the user to set the operation mode. Also, on the UI screen, the name of the selected user (in the example shown in Figure 8, "User1") is displayed next to the GUI button that instructs the user to set the user.

When the user operates the GUI button that instructs setting the operation mode, a UI screen is displayed on which UI buttons for selecting the operation mode for setting details are arranged, as shown in Figure 9.

The UI screen shown in Figure 9 is arranged with a GUI button for selecting detailed settings for automatic mode, a GUI button for instructing the selection of detailed settings for meal mode, a GUI button for selecting detailed settings for sleep mode, a GUI button for selecting detailed settings for map mode, and a GUI button for selecting detailed settings for reading mode.

When the user operates one of the GUI buttons, a UI screen is displayed, as shown in Figure 10, on which UI buttons for instructing detailed settings for the selected operation mode are arranged.

The UI screen shown in Figure 10 includes a UI button for specifying detailed settings for the operation mode selected on the UI screen in Figure 9, and a GUI button for specifying switching between selected operation modes. The UI screen also displays the name of the selected operation mode (XX mode in the example shown in Figure 10) and the name of the selected user (User1 in the example shown in Figure 10).

Then, when the user operates a UI button that instructs detailed settings for an operation mode, for example, by selecting to set the intensity of the odor to be presented in that operation mode, a UI screen for specifying the intensity of the odor to be presented in that operation mode is displayed, as shown in Figure 11, for example.

The UI screen shown in Figure 11 features a GUI for specifying the odor intensity on a scale of 0 to 100, with 50 set as the reference level.

Furthermore, for example, if a user operates the GUI button that selects the detailed settings for sleep mode on the UI screen shown in FIG. 9 and selects to set the type of scent that will be presented in sleep mode, a UI screen for selecting the type of scent that will be presented in sleep mode will be displayed, as shown in FIG. 12.

The UI screen shown in Figure 12 has a GUI button for selecting lavender, a GUI button for selecting lemon, and a GUI button for selecting mint as the types of scents presented in sleep mode. For example, in sleep mode, the standard setting is 100% lavender scent (lemon and mint are set to 0%). The user can also operate the GUI button for selecting lemon to set the percentage of lemon scent, or the GUI button for selecting mint to set the percentage of mint scent.

For example, the smell of lavender has the effect of promoting relaxation and sleep, the smell of lemon has the effect of improving mood and refreshing, and the smell of mint has the effect of refreshing and increasing concentration.

Figure 13 shows an example of a UI screen for inputting evaluations of discharge conditions.

The UI screen shown in Figure 13 displays the name of the operating mode of the discharge conditions being evaluated (in the example shown in Figure 13, this is "XX mode") and the name of the user making the evaluation (in the example shown in Figure 13, this is "User1"). This UI screen also allows the user to rate the overall, strength, and fragrance items on a five-point scale (selecting the number of stars appropriate for the rating), and allows the user to enter notes for each item.

By performing the above-described operations on the UI screen, input can be made to the input unit 21 in the odor presentation control system 11.

The UI screen shown in Figure 11 above is displayed based on standard settings in accordance with the initial conditions where the scent intensity is set to 50, and the UI screen shown in Figure 12 above is displayed based on standard settings in accordance with the initial conditions where the lavender scent is set to 100%. By operating the UI screens displayed based on the respective standard settings, the user can adjust the desired scent intensity, desired scent ratio, etc.

The odor presentation control system 11 can store several of the user's usual operations to make adjustments to the UI screen, perform learning based on the user's operation history, and reflect customized settings based on the learning results on the UI screen. As a result, when the odor presentation control system 11 learns that the user makes similar adjustments to a UI screen based on standard settings in a certain operating mode, it can reflect the learning results and display a UI screen based on customized settings in which the user's desired adjustments have been set.

For example, as shown in the upper part of Figure 14, in sleep mode, a UI screen is displayed based on the standard settings according to the initial conditions, with the lavender scent set to 100%. Then, if the user performs an operation on this UI screen several times to adjust the lavender scent to 90% and the mint scent to 10%, learning is performed based on the user's operation history, and a UI screen based on customized settings according to the learning results is displayed. In other words, as shown in the lower part of Figure 14, a UI screen based on customized settings with the lavender scent set to 90% and the mint scent set to 10% is displayed.

In this way, the odor presentation control system 11 learns based on the user's operation history and displays a UI screen that reflects customized settings optimized for that user, making it possible to present odors that match the user's preferences, for example, without the user having to perform any operations on the UI screen.

In addition, the odor presentation control system 11 also learns the situation when the user operates the UI screen (for example, temperature, time, day of the week, driving information, music, lighting, number of passengers, departure point, destination, and other information), and can display a UI screen optimized for the user for each situation.

The odor presentation control system 11 has various operating modes available, including aggressive mode, relaxed mode, rainy mode, sunny mode, morning mode, and night mode, and the next time morning mode (or another mode similar to morning mode, such as aggressive mode) is selected, customized settings based on the learning results described above can be reflected on the UI screen.

In addition to the use case of being mounted on a vehicle and used as described above, the odor presentation control system 11 can also be applied to use cases such as presenting odors according to the user's activity status in places where people are staying, such as a room, living room, or workplace.

<Example of computer configuration>
Next, the above-described series of processes (control method) can be performed by hardware or software. When the series of processes is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

Figure 15 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes using a program.

In a computer, a CPU (Central Processing Unit) 101, ROM (Read Only Memory) 102, RAM (Random Access Memory) 103, and EEPROM (Electronically Erasable and Programmable Read Only Memory) 104 are interconnected by a bus 105. An input/output interface 106 is also connected to the bus 105, and the input/output interface 106 is connected to the outside.

In a computer configured as described above, the CPU 101 loads programs stored in, for example, ROM 102 and EEPROM 104 into RAM 103 via bus 105 and executes them, thereby performing the above-mentioned series of processes. Furthermore, programs executed by the computer (CPU 101) can be written in advance to ROM 102, or can be installed or updated in EEPROM 104 from the outside via input/output interface 106.

In this specification, the processing performed by a computer in accordance with a program does not necessarily have to be performed chronologically in the order described in the flowchart. In other words, the processing performed by a computer in accordance with a program also includes processing that is executed in parallel or individually (for example, parallel processing or object-based processing).

Furthermore, the program may be processed by a single computer (processor), or may be distributed across multiple computers. Furthermore, the program may be transferred to a remote computer for execution.

Furthermore, in this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device with multiple modules housed in a single housing, are both systems.

Furthermore, for example, a configuration described as a single device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as a single device (or processing unit). Furthermore, configurations other than those described above may of course be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the system as a whole are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

Furthermore, for example, this technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by multiple devices via a network.

Furthermore, for example, the above-mentioned program can be executed on any device. In that case, it is sufficient if the device has the necessary functions (functional blocks, etc.) and is able to obtain the necessary information.

Furthermore, for example, each step described in the flowchart above can be executed by a single device, or can be shared and executed by multiple devices. Furthermore, if a single step includes multiple processes, the multiple processes included in that single step can be executed by a single device, or can be shared and executed by multiple devices. In other words, multiple processes included in a single step can be executed as multiple step processes. Conversely, processes described as multiple steps can also be executed collectively as a single step.

In addition, the processing of the steps that describe a program executed by a computer may be executed chronologically in the order described in this specification, or may be executed in parallel, or individually at the required timing, such as when a call is made. In other words, as long as no contradictions arise, the processing of each step may be executed in an order different from that described above. Furthermore, the processing of the steps that describe this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

Note that the multiple present technologies described in this specification can be implemented independently and individually, provided no contradictions arise. Naturally, any multiple present technologies can also be implemented in combination. For example, some or all of the present technologies described in any embodiment can be implemented in combination with some or all of the present technologies described in other embodiments. Furthermore, some or all of any of the present technologies described above can also be implemented in combination with other technologies not described above.

<Application example>
The technology according to the present disclosure can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of moving body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, a robot, construction machinery, or agricultural machinery (tractor).

FIG. 16 is a block diagram showing a schematic configuration example of a vehicle control system 7000, which is an example of a mobile object control system to which the technology disclosed herein can be applied. The vehicle control system 7000 includes multiple electronic control units connected via a communication network 7010. In the example shown in FIG. 16, the vehicle control system 7000 includes a drive system control unit 7100, a body system control unit 7200, a battery control unit 7300, an outside-vehicle information detection unit 7400, an inside-vehicle information detection unit 7500, and an integrated control unit 7600. The communication network 7010 connecting these multiple control units may be an in-vehicle communication network that complies with any standard, such as CAN (Controller Area Network), LIN (Local Interconnect Network), LAN (Local Area Network), or FlexRay (registered trademark).

Each control unit includes a microcomputer that performs arithmetic processing in accordance with various programs, a memory unit that stores the programs executed by the microcomputer or parameters used in various calculations, and a drive circuit that drives various controlled devices. Each control unit includes a network I/F for communicating with other control units via the communication network 7010, as well as a communication I/F for communicating with devices or sensors inside and outside the vehicle via wired or wireless communication. Figure 16 illustrates the functional configuration of the integrated control unit 7600, including a microcomputer 7610, a general-purpose communication I/F 7620, a dedicated communication I/F 7630, a positioning unit 7640, a beacon receiving unit 7650, an in-vehicle device I/F 7660, an audio/video output unit 7670, an in-vehicle network I/F 7680, and a memory unit 7690. Other control units similarly include microcomputers, communication I/Fs, memory units, etc.

The drivetrain control unit 7100 controls the operation of devices related to the vehicle's drivetrain in accordance with various programs. For example, the drivetrain control unit 7100 functions as a control device for a driveforce generating device for generating vehicle driveforce, such as an internal combustion engine or drive motor, a driveforce transmission mechanism for transmitting driveforce to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating vehicle braking force. The drivetrain control unit 7100 may also function as a control device for an ABS (Antilock Brake System) or ESC (Electronic Stability Control), etc.

A vehicle state detection unit 7110 is connected to the drivetrain control unit 7100. The vehicle state detection unit 7110 includes at least one of the following: a gyro sensor that detects the angular velocity of the axial rotational movement of the vehicle body; an acceleration sensor that detects the acceleration of the vehicle; or a sensor for detecting the amount of accelerator pedal operation, the amount of brake pedal operation, the steering angle of the steering wheel, engine rotation speed, or wheel rotation speed. The drivetrain control unit 7100 performs arithmetic processing using signals input from the vehicle state detection unit 7110, and controls the internal combustion engine, drive motor, electric power steering device, brake device, etc.

The body system control unit 7200 controls the operation of various devices installed in the vehicle body according to various programs. For example, the body system control unit 7200 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 7200. The body system control unit 7200 accepts these radio waves or signal inputs and controls the vehicle's door lock device, power window device, lamps, etc.

The battery control unit 7300 controls the secondary battery 7310, which is the power supply source for the drive motor, in accordance with various programs. For example, information such as battery temperature, battery output voltage, or remaining battery capacity is input to the battery control unit 7300 from a battery device equipped with the secondary battery 7310. The battery control unit 7300 performs calculations using these signals, and controls the temperature regulation of the secondary battery 7310 or the cooling device or other components equipped in the battery device.

The outside vehicle information detection unit 7400 detects information outside the vehicle equipped with the vehicle control system 7000. For example, at least one of an imaging unit 7410 and an outside vehicle information detection unit 7420 is connected to the outside vehicle information detection unit 7400. The imaging unit 7410 includes at least one of a ToF (Time Of Flight) camera, a stereo camera, a monocular camera, an infrared camera, and other cameras. The outside vehicle information detection unit 7420 includes at least one of, for example, an environmental sensor for detecting the current weather or climate, or a surrounding information detection sensor for detecting other vehicles, obstacles, pedestrians, etc. around the vehicle equipped with the vehicle control system 7000.

The environmental sensor may be, for example, at least one of a raindrop sensor that detects rain, a fog sensor that detects fog, a sunshine sensor that detects the level of sunlight, and a snow sensor that detects snowfall. The surrounding information detection sensor may be at least one of an ultrasonic sensor, a radar device, and a LIDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging) device. The imaging unit 7410 and the outside vehicle information detection unit 7420 may each be provided as an independent sensor or device, or may be provided as a device that integrates multiple sensors or devices.

Here, Figure 17 shows an example of the installation locations of the imaging unit 7410 and the vehicle exterior information detection unit 7420. The imaging units 7910, 7912, 7914, 7916, and 7918 are installed, for example, at least one of the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 7900. The imaging unit 7910 installed on the front nose and the imaging unit 7918 installed on the top of the windshield inside the vehicle cabin mainly capture images of the front of the vehicle 7900. The imaging units 7912 and 7914 installed on the side mirrors mainly capture images of the sides of the vehicle 7900. The imaging unit 7916 installed on the rear bumper or back door mainly captures images of the rear of the vehicle 7900. The imaging unit 7918, which is mounted above the windshield inside the vehicle, is primarily used to detect preceding vehicles, pedestrians, obstacles, traffic lights, traffic signs, lane marks, etc.

Note that Figure 17 shows an example of the imaging ranges of each of the imaging units 7910, 7912, 7914, and 7916. Imaging range a indicates the imaging range of the imaging unit 7910 provided on the front nose, imaging ranges b and c indicate the imaging ranges of the imaging units 7912 and 7914 provided on the side mirrors, respectively, and imaging range d indicates the imaging range of the imaging unit 7916 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 7910, 7912, 7914, and 7916, an overhead image of the vehicle 7900 viewed from above can be obtained.

External vehicle information detection units 7920, 7922, 7924, 7926, 7928, and 7930 installed on the front, rear, sides, corners, and above the windshield inside the vehicle cabin of vehicle 7900 may be, for example, ultrasonic sensors or radar devices. External vehicle information detection units 7920, 7926, and 7930 installed on the front nose, rear bumper, back door, and above the windshield inside the vehicle cabin of vehicle 7900 may be, for example, LIDAR devices. These external vehicle information detection units 7920 to 7930 are primarily used to detect preceding vehicles, pedestrians, obstacles, etc.

Referring back to Figure 16, the explanation will continue. The outside vehicle information detection unit 7400 causes the imaging unit 7410 to capture images outside the vehicle and receives the captured image data. The outside vehicle information detection unit 7400 also receives detection information from the connected outside vehicle information detection unit 7420. If the outside vehicle information detection unit 7420 is an ultrasonic sensor, radar device, or LIDAR device, the outside vehicle information detection unit 7400 emits ultrasonic waves or electromagnetic waves, and receives information on the received reflected waves. Based on the received information, the outside vehicle information detection unit 7400 may perform object detection processing or distance detection processing for people, vehicles, obstacles, signs, text on the road, etc. Based on the received information, the outside vehicle information detection unit 7400 may also perform environmental recognition processing to recognize rainfall, fog, road conditions, etc. Based on the received information, the outside vehicle information detection unit 7400 may also calculate the distance to objects outside the vehicle.

The outside vehicle information detection unit 7400 may also perform image recognition processing or distance detection processing to recognize people, cars, obstacles, signs, or text on the road surface based on the received image data. The outside vehicle information detection unit 7400 may also perform processing such as distortion correction or alignment on the received image data, and may also generate an overhead image or panoramic image by combining image data captured by different image capture units 7410. The outside vehicle information detection unit 7400 may also perform viewpoint conversion processing using image data captured by different image capture units 7410.

The in-vehicle information detection unit 7500 detects information inside the vehicle. Connected to the in-vehicle information detection unit 7500 is, for example, a driver state detection unit 7510 that detects the driver's state. The driver state detection unit 7510 may include a camera that captures an image of the driver, a biosensor that detects the driver's biometric information, or a microphone that collects audio from within the vehicle cabin. The biosensor is provided, for example, on the seat or steering wheel, and detects the biometric information of a passenger sitting in the seat or the driver gripping the steering wheel. The in-vehicle information detection unit 7500 may calculate the driver's level of fatigue or concentration based on the detection information input from the driver state detection unit 7510, or may determine whether the driver is dozing off. The in-vehicle information detection unit 7500 may perform processing such as noise canceling on the collected audio signal.

The integrated control unit 7600 controls the overall operation of the vehicle control system 7000 in accordance with various programs. An input unit 7800 is connected to the integrated control unit 7600. The input unit 7800 is realized by a device that can be operated by the occupant for input, such as a touch panel, button, microphone, switch, or lever. Data obtained by voice recognition of voice input through a microphone may be input to the integrated control unit 7600. The input unit 7800 may be, for example, a remote control device that uses infrared or other radio waves, or an externally connected device such as a mobile phone or PDA (Personal Digital Assistant) that is compatible with the operation of the vehicle control system 7000. The input unit 7800 may be, for example, a camera, in which case the occupant can input information using gestures. Alternatively, data obtained by detecting the movement of a wearable device worn by the occupant may be input. Furthermore, the input unit 7800 may include, for example, an input control circuit that generates an input signal based on information input by a passenger or the like using the input unit 7800 and outputs the signal to the integrated control unit 7600. By operating this input unit 7800, the passenger or the like inputs various data to the vehicle control system 7000 and instructs it to perform processing operations.

The memory unit 7690 may include a ROM (Read Only Memory) that stores various programs executed by the microcomputer, and a RAM (Random Access Memory) that stores various parameters, calculation results, sensor values, etc. The memory unit 7690 may also be realized by a magnetic memory device such as an HDD (Hard Disc Drive), a semiconductor memory device, an optical memory device, or a magneto-optical memory device.

The general-purpose communication I/F 7620 is a general-purpose communication I/F that mediates communication between various devices present in the external environment 7750. The general-purpose communication I/F 7620 may implement cellular communication protocols such as GSM (registered trademark) (Global System of Mobile communications), WiMAX (registered trademark), LTE (registered trademark) (Long Term Evolution) or LTE-Advanced (LTE-A), or other wireless communication protocols such as wireless LAN (also known as Wi-Fi (registered trademark)) and Bluetooth (registered trademark). The general-purpose communication I/F 7620 may connect to devices (e.g., application servers or control servers) present on an external network (e.g., the Internet, a cloud network, or an operator-specific network) via, for example, a base station or access point. Additionally, the general-purpose communication I/F 7620 may connect to a terminal located near the vehicle (for example, a terminal of a driver, pedestrian, or store, or an MTC (Machine Type Communication) terminal) using, for example, P2P (Peer To Peer) technology.

The dedicated communication I/F 7630 is a communication I/F that supports communication protocols designed for use in vehicles. The dedicated communication I/F 7630 may implement standard protocols such as WAVE (Wireless Access in Vehicle Environment), which is a combination of the lower layer IEEE 802.11p and the upper layer IEEE 1609, DSRC (Dedicated Short Range Communications), or a cellular communication protocol. The dedicated communication I/F 7630 typically performs V2X communication, a concept that includes one or more of vehicle-to-vehicle communication, vehicle-to-infrastructure communication, vehicle-to-home communication, and vehicle-to-pedestrian communication.

The positioning unit 7640 performs positioning by receiving, for example, GNSS signals from GNSS (Global Navigation Satellite System) satellites (e.g., GPS signals from GPS (Global Positioning System) satellites), and generates location information including the vehicle's latitude, longitude, and altitude. The positioning unit 7640 may determine the current location by exchanging signals with a wireless access point, or may obtain location information from a terminal with positioning capabilities, such as a mobile phone, PHS, or smartphone.

The beacon receiver 7650 receives, for example, radio waves or electromagnetic waves transmitted from radio stations installed on the road, and acquires information such as the current location, congestion, road closures, and travel time. The functions of the beacon receiver 7650 may be included in the dedicated communication I/F 7630 described above.

The in-vehicle device I/F 7660 is a communication interface that mediates connections between the microcomputer 7610 and various in-vehicle devices 7760 present in the vehicle. The in-vehicle device I/F 7660 may establish wireless connections using wireless communication protocols such as wireless LAN, Bluetooth (registered trademark), NFC (Near Field Communication), or WUSB (Wireless USB). The in-vehicle device I/F 7660 may also establish a wired connection such as USB (Universal Serial Bus), HDMI (High-Definition Multimedia Interface), or MHL (Mobile High-Definition Link) via a connection terminal (and a cable, if necessary) not shown. The in-vehicle device 7760 may include, for example, at least one of a mobile device or wearable device owned by the passenger, or an information device carried into or attached to the vehicle. The in-vehicle device 7760 may also include a navigation device that searches for a route to an arbitrary destination. The in-vehicle device I/F 7660 exchanges control signals or data signals with these in-vehicle devices 7760.

The in-vehicle network I/F 7680 is an interface that mediates communication between the microcomputer 7610 and the communication network 7010. The in-vehicle network I/F 7680 sends and receives signals in accordance with a specific protocol supported by the communication network 7010.

The microcomputer 7610 of the integrated control unit 7600 controls the vehicle control system 7000 in accordance with various programs based on information acquired via at least one of the general-purpose communication I/F 7620, dedicated communication I/F 7630, positioning unit 7640, beacon receiving unit 7650, in-vehicle device I/F 7660, and in-vehicle network I/F 7680. For example, the microcomputer 7610 may calculate control target values for the driving force generating device, steering mechanism, or braking device based on acquired information from inside and outside the vehicle, and output control commands to the drivetrain control unit 7100. For example, the microcomputer 7610 may perform cooperative control aimed at realizing the functions of an Advanced Driver Assistance System (ADAS), including vehicle collision avoidance or impact mitigation, following driving based on inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, and vehicle lane departure warning. Furthermore, the microcomputer 7610 may perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation, by controlling the driving force generation device, steering mechanism, braking device, etc. based on the acquired information about the vehicle's surroundings.

The microcomputer 7610 may generate three-dimensional distance information between the vehicle and surrounding objects such as structures and people based on information acquired via at least one of the general-purpose communication I/F 7620, dedicated communication I/F 7630, positioning unit 7640, beacon receiving unit 7650, in-vehicle equipment I/F 7660, and in-vehicle network I/F 7680, and may create local map information including information about the area around the vehicle's current location. Furthermore, the microcomputer 7610 may predict dangers such as a vehicle collision, approaching pedestrians, or entering a closed road based on the acquired information, and generate a warning signal. The warning signal may be, for example, a signal to generate a warning sound or turn on a warning lamp.

The audio/video output unit 7670 transmits at least one audio and/or image output signal to an output device capable of visually or audibly notifying vehicle occupants or the outside of the vehicle of information. In the example of Figure 16, an audio speaker 7710, a display unit 7720, and an instrument panel 7730 are exemplified as output devices. The display unit 7720 may include, for example, at least one of an on-board display and a head-up display. The display unit 7720 may have an AR (Augmented Reality) display function. The output device may also be other devices such as headphones, wearable devices such as eyeglass-type displays worn by the occupants, projectors, or lamps. When the output device is a display device, the display device visually displays the results obtained by various processes performed by the microcomputer 7610 or information received from other control units in various formats such as text, images, tables, and graphs. When the output device is an audio output device, the audio output device converts audio signals consisting of reproduced audio data or acoustic data into analog signals and outputs them audibly.

In the example shown in FIG. 16, at least two control units connected via the communication network 7010 may be integrated into a single control unit. Alternatively, each control unit may be composed of multiple control units. Furthermore, the vehicle control system 7000 may include another control unit not shown. In addition, in the above description, some or all of the functions performed by one of the control units may be carried out by another control unit. In other words, as long as information is sent and received via the communication network 7010, predetermined calculation processing may be performed by one of the control units. Similarly, a sensor or device connected to one of the control units may be connected to another control unit, and multiple control units may send and receive detection information to each other via the communication network 7010.

<Configuration combination example>
The present technology can also be configured as follows.
(1)
a situation recognition unit that recognizes an activity situation of a user;
a presentation control unit that controls the emission of air containing an odor component to control the presentation of the odor to the user;
The presentation control unit sets an off period during which the emission of the odor is turned off based on the activity status of the user.
(2)
The control device according to (1) above, wherein the presentation control unit sets an off period in which the emission of the odor is turned off for a certain period after the start of an activity period in which the user is active.
(3)
The control device according to (1) or (2) above, wherein the presentation control unit sets an off period in which the emission of the odor is turned off for a certain period before the end of an activity period in which the user is active.
(4)
The control device described in any one of (1) to (3) above, wherein the presentation control unit sets a fade-in period in which the odor gradually becomes stronger for a certain period after the start of an activity period in which the user is active.
(5)
The control device according to any one of (1) to (4) above, wherein the presentation control unit sets a fade-out period in which the odor is gradually weakened during a certain period before the end of an activity period in which the user is active.
(6)
A control device described in any of (1) to (5) above, in which, during an emission period in which an odor is emitted based on the user's activity status, air containing odor components is emitted in an emission pattern in which multiple emissions are performed intermittently.
(7)
The control device according to any one of (1) to (6) above, wherein the presentation control unit controls the presentation of the odor to the user in accordance with an operation mode or a discharge condition set for each user.
(8)
a determination unit that determines whether a change in the user's activity status has been detected according to a recognition result by the status recognition unit, and, when it is determined that a change in the user's activity status has been detected, determines whether or not to change the ejection conditions in accordance with the change in the activity status;
The control device according to any one of (1) to (7) above, wherein the presentation control unit changes the discharge condition in accordance with a determination result by the determination unit.
(9)
a storage unit that stores an evaluation of the ejection conditions input by a user,
The control device according to any one of (1) to (8), wherein the presentation control unit feeds back the evaluation to the next time or later.
(10)
The control device according to any one of (1) to (9) above, further comprising: a linkage control unit that controls a linkage unit that operates in conjunction with the presented odor in accordance with control by the presentation control unit.
(11)
the situation recognition unit recognizes activity situations of users other than the user to whom the scent is to be presented,
The control device according to any one of (1) to (10) above, wherein the presentation control unit controls presentation of the odor to the user to whom the odor is to be presented, based on the activity status of other users.
(12)
The control device according to any one of (1) to (11) above, wherein the presentation control unit controls the intensity of the odor based on information indicating whether the environment in which the odor is presented is open or not.
(13)
A control device according to any one of (1) to (12) above, which performs learning based on a user's operation history on a UI (User Interface) screen with standard settings according to initial conditions, and reflects customized settings according to the learning results on the UI screen.
(14)
The control device
Recognizing a user's activity status;
and controlling the emission of air containing the odor component to control the presentation of the odor to the user;
A control method in which an off period for turning off the emission of odor is set based on the user's activity status.
(15)
The control device's computer
Recognizing a user's activity status;
and controlling the emission of air containing the odor component to control the presentation of the odor to the user;
A program for executing a process in which an off period for turning off the emission of odor is set based on the user's activity status.

Note that this embodiment is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of this disclosure. Furthermore, the effects described in this specification are merely examples and are not intended to be limiting, and other effects may also be present.

11. Odor presentation control system, 21. Input unit, 22. Memory unit, 23. Setting adjustment unit, 24. Situation recognition unit, 25. Judgment unit, 26. Receiving unit, 27. Transmitting unit

Claims (15)

a situation recognition unit that recognizes an activity situation of a user;
a presentation control unit that controls the emission of air containing an odor component to control the presentation of the odor to the user;
The presentation control unit sets an off period during which the emission of the odor is turned off based on the activity status of the user. The control device according to claim 1 , wherein the presentation control unit sets an off period in which the emission of the odor is turned off for a certain period after the start of an activity period in which the user is active. The control device according to claim 1 , wherein the presentation control unit sets an off period during which the emission of the odor is turned off for a certain period before an activity period during which the user is active ends. The control device according to claim 1 , wherein the presentation control unit sets a fade-in period in which the odor gradually becomes stronger for a certain period after the start of an activity period in which the user is active. The control device according to claim 1 , wherein the presentation control unit sets a fade-out period during which the odor is perceived as gradually weakening during a certain period before the end of an activity period during which the user is active. The control device according to claim 1 , wherein, during an emission period in which the odor is emitted based on the user's activity status, air containing the odor component is emitted in an emission pattern in which multiple emissions are performed intermittently. The control device according to claim 1 , wherein the presentation control unit controls the presentation of the odor to the user in accordance with an operation mode or a discharge condition set for each user. a determination unit that determines whether a change in the user's activity status has been detected according to a recognition result by the status recognition unit, and, when it is determined that a change in the user's activity status has been detected, determines whether or not to change the ejection conditions in accordance with the change in the activity status;
The control device according to claim 7 , wherein the presentation control unit changes the ejection conditions in accordance with a determination result by the determination unit. a storage unit that stores an evaluation of the ejection conditions input by a user,
The control device according to claim 8 , wherein the presentation control unit feeds back the evaluation from the next time onward. The control device according to claim 1 , further comprising: a linkage control unit that controls a linkage unit that operates in conjunction with the presented odor under control of the presentation control unit. the situation recognition unit recognizes activity situations of users other than the user to whom the scent is to be presented,
The control device according to claim 1 , wherein the presentation control unit controls presentation of the odor to the user who is the target of presentation of the odor, based on the activity status of other users. The control device according to claim 1 , wherein the presentation control unit controls the intensity of the odor based on information indicating whether the environment in which the odor is presented is open. The control device according to claim 1 , wherein learning is performed based on a user's operation history on a UI (User Interface) screen with standard settings according to initial conditions, and customized settings according to the learning results are reflected on the UI screen. The control device
Recognizing a user's activity status;
and controlling the emission of air containing the odor component to control the presentation of the odor to the user;
A control method in which an off period for turning off the emission of odor is set based on the user's activity status. The control device's computer
Recognizing a user's activity status;
and controlling the emission of air containing the odor component to control the presentation of the odor to the user;
A program for executing a process in which an off period for turning off the emission of odor is set based on the user's activity status.