GB2631691A

GB2631691A - Controlling output of alert signals to an occupant of a vehicle

Info

Publication number: GB2631691A
Application number: GB2310408.6A
Authority: GB
Inventors: Keenan Patrick; Lamond Colin
Original assignee: Nissan Motor Manufacturing UK Ltd
Current assignee: Nissan Motor Manufacturing UK Ltd
Priority date: 2023-07-06
Filing date: 2023-07-06
Publication date: 2025-01-15

Abstract

A controller for outputting alert signals to an occupant of a vehicle. The controller receives an input signal 801 and determines the status of the occupant assistance feature is an alert status to be communicated to the occupant 802. Retrieve a default alert signal set containing one or more alert signals including an audio alert to be output by the vehicle HMI 803. Identify that the default alert needs to be modified to include a further alert signal the further alert signal being a different modality to the default 804. Determine a modified alert signal set different from the default signal set with an output different to the default audio output 805. Control communicative output elements of the vehicle to communicate modified alert 806. Further alerts may include changing the size of the alert on a screen, audio or haptic outputs.

Description

CONTROLLING OUTPUT OF ALERT SIGNALS TO AN OCCUPANT OF A VEHICLE

TECHNICAL FIELD

The invention relates to controlling alert signals that are output to an occupant of a vehicle, e.g. a vehicle driver. In particular, the invention relates to modifying default alert signals associated with an occupant assistance feature of the vehicle, e.g. a seat belt not fastened alert feature, to make the alert signals more appropriate for specific occupants or environmental conditions.

BACKGROUND

Modern vehicles -in particular, road vehicles such as cars -typically include a number of different features for assisting one or more occupants of the vehicle in some manner.

Specifically, these occupant assistance features can include features aimed at improving the experience, comfort, safety, etc. of the occupants in the vehicle. An occupant assistance feature may involve monitoring a status of a feature associated with operation of the vehicle, and providing an alert to one or more relevant occupants when the status of the feature changes to an alert status, i.e. a status in which a warning or some other information needs to be communicated to the relevant occupants.

One example of such an occupant assistance feature is a seat belt status feature. In particular, sensors of the vehicle may monitor whether a seat belt associated with a specific occupied seat of the vehicle, e.g. driver seat, is fastened or not fastened. If the seat belt is not fastened, then the seat belt status feature may communicate an alert to the relevant occupant, i.e. the driver in this case, so that the occupant can take appropriate action, i.e. fasten the seat belt.

Another example of such an occupant assistance feature is a lane departure warning feature. In particular, sensors of the vehicle, e.g. camera and/or radar sensors on an external body of the vehicle, may monitor whether the vehicle starts to move out of its lane, e.g. as demarcated by road markings, without a turn signal in that direction being activated. If this occurs, the lane departure warning feature may communicate an alert to the driver so that the driver can take appropriate action, i.e. turn the steering wheel to change the vehicle direction.

In each of these cases, the means by which the alert is communicated to the vehicle occupant typically includes an audio alert, e.g. via one or more speakers of the vehicle, e.g. as part of a human-machine interface (HMI) or speaker system of the vehicle. However, there are certain cases in which such audio alerts can be missed by the occupant, such that the alert goes unnoticed and the issue identified by the occupant assistance feature goes unrectified. For instance, the vehicle occupant may be hearing impaired, meaning that they cannot hear -or are more likely not to hear -audio alerts. There is a need to ensure that alerts communicated to vehicle occupants can be readily noticed by the occupants in a variety of different contexts.

It is against this background to which the present invention is set.

SUMMARY OF THE INVENTION

According to an aspect of the invention there is provided a controller for outputting alert signals to an occupant of a vehicle. The controller is configured to receive an input signal, from one or more sensors of the vehicle, indicative of a status of an occupant assistance feature of the vehicle. The controller is configured to determine, based on the input signal, that the status of the occupant assistance feature is an alert status to be communicated to the occupant. The controller is configured to retrieve a default alert signal set for communicating the alert status of the occupant assistance feature. The default alert signal set comprises one or more default alert signals to be communicated to the occupant via communicative output elements of a human-machine interface (HMI) of the vehicle. The one or more default alert signals comprises a default audio alert signal to be communicated to the occupant via an audio output element of the HMI.

The controller is configured to identify that the default alert signal set is to be modified for communicating the alert status of the occupant assistance feature to the occupant of the vehicle. The controller is configured to determine a modified alert signal set by modifying the default signal set to include a further alert signal. The further alert signal is a different alert modality from the default audio alert signal. The further alert signal is to be communicated to the occupant via a further communicative output element of the vehicle different from the audio output element. The controller is configured to control communicative output elements of the vehicle, including the further communicative element and audio output element, to communicate the alert status of the occupant assistance feature to the occupant in accordance with the further alert signal and the one or more default alert signals in the modified alert signal set.

Modifying the default alert signal set may comprise modifying one of the default alert signals, other than the default audio alert signal, to obtain the further alert signal.

Said one of the default alert signals may be a default visual alert signal. The further alert signal may be a further visual alert signal. The controller may be configured to control a visual output element of the HMI to output a modified visual alert in accordance with the further visual alert signal.

The visual output element may be a display screen of the HMI. The modified visual alert in accordance with the further visual alert signal may be a modified icon displayed on the display screen. The modified icon may be larger than a default icon for display on the display screen in accordance with the default visual alert signal.

An area on the display screen covered by the modified icon may be at least an order of magnitude larger than an area of the display screen covered by the default icon.

The modified icon may cover a majority of a display area of the display screen. Optionally, the modified icon may cover substantially an entirety of the display area of the display screen.

Modifying the default alert signal set may comprise generating the further alert signal in addition to the one or more default alert signals.

The further alert signal may include a visual alert signal. The controller may be configured to control a visual output element of the HMI to output a visual alert in accordance with the visual alert signal.

The visual output element may be a display screen of the HMI. The visual output element may be one or more lights of the vehicle. Optionally, the one or more lights may include one or more LEDs positioned on a wing and/or door mirror of the vehicle.

The further alert signal may include a haptic alert signal. The controller may be configured to control a haptic output element of the vehicle to output a haptic alert in accordance with the haptic alert signal. Optionally, the haptic alert may include vibration of the haptic output element.

The haptic output element may be a steering wheel of the vehicle. The haptic output element may be a seat in which the occupant is seated. The haptic output element may be a seatbelt of the seat in which the occupant is seated.

The further communicative output element may be a wireless communication transmitter of the vehicle. The wireless communication transmitter may be configured to transmit the further alert signal to a further communication device configured to communicate the alert status of the occupant assistance feature to the occupant.

The further communication device may be a hearing aid of the occupant. The further communication device may be wireless headphones or earphones of the occupant. The further communication device may be a mobile phone of the occupant. The further communication device may be a smart watch of the occupant.

To determine the modified alert signal set, the controller may be configured to modify the default signal set in accordance with one or more defined preferences of the occupant to determine the further alert signal.

To identify that the default alert signal set is to be modified, the controller may be configured to retrieve a user profile associated with the occupant from a memory device of the vehicle, and may be configured to identify that the user profile comprises one or more user preferences for communicating the alert status of the occupant assistance feature. To determine the modified alert signal set, the controller may be configured to modify the default signal set in accordance with the one or more user preferences to determine the further alert signal.

The one or more user preferences may indicate that default alert signal sets for occupant assistance features need to be modified to account for a hearing impairment of the occupant.

The controller may be configured to receive (audible) noise sensor data, from one or more noise sensors of the vehicle, indicative of a noise level in the vicinity of the vehicle. The controller may identify that the default alert signal set is to be modified if the received noise sensor data indicates that the noise level is above a defined threshold noise level.

The received noise sensor data may be indicative of the noise level external to the vehicle.

The received noise sensor data may be indicative of a direction of noise relative to the vehicle. The further alert signal may be determined to communicate to the occupant the direction of noise relative to the vehicle. Optionally, the further alert signal may be a visual alert signal.

The received noise sensor data may be indicative of a vehicle horn external to the vehicle. The received noise sensor data may be indicative of an emergency siren external to the vehicle.

The occupant assistance feature may be an occupant seat belt status feature. The status of the seat belt status feature may be determined to be the alert status to be communicated to the occupant if the received sensor data indicates that a seat belt of a seat in which the occupant is seated is not fastened. Optionally, the further alert signal may be a visual alert signal communicated to the occupant via a display screen of the HMI. Optionally, the further alert signal may be a haptic feedback signal and a haptic output element in a seat of the vehicle in which the occupant is seated may be configured to output a haptic alert in accordance with the haptic alert signal.

The occupant may be a driver of the vehicle.

The occupant assistance feature may be an advanced driver assistance system (ADAS) feature of the vehicle. Optionally, the ADAS feature may be a lane departure warning feature. Optionally, the ADAS feature may be an object proximity feature. Optionally, the ADAS feature may be a hazard alert feature.

The ADAS feature may be the lane departure warning feature. The default alert signal set may include the default audio alert signal and a default visual alert signal.

To determine the further alert signal, the controller may be configured to modify the default visual alert signal. The default visual alert signal may be communicated to the driver as a default icon on a display screen of the HMI. The further alert signal may be a modified visual alert signal that is communicated to the driver as a modified icon on the display screen. Optionally, the modified icon may be one or more of: larger than the default icon; a different colour than the default icon; at a different position on the display screen than the default icon; and, a flashing icon.

To determine the further alert signal, the controller may be configured to generate the further alert signal in addition to the default alert signals. The further alert signal may be a visual alert signal that is communicated to the driver as an icon on the display screen.

According to another aspect of the invention there is provided a control system for a vehicle. The control system comprises the controller defined above. The control system comprises the communicative output elements of the vehicle.

According to another aspect of the invention there is provided a vehicle comprising a controller as defined above.

According to another aspect of the invention there is provided a vehicle comprising a control system as defined above.

According to another aspect of the invention there is provided a method of outputting alert signals to an occupant of a vehicle. The method comprises receiving an input signal, from one or more sensors of the vehicle, indicative of a status of an occupant assistance feature of the vehicle. The method comprises determining, based on the input signal, that the status of the occupant assistance feature is an alert status to be communicated to the occupant. The method comprises retrieving a default alert signal set for communicating the alert status of the occupant assistance feature. The default alert signal set comprises one or more default alert signals to be communicated to the occupant via communicative output elements of a human-machine interface (HMI) of the vehicle. The one or more default alert signals comprises a default audio alert signal to be communicated to the occupant via an audio output element of the HMI. The method comprises identifying that the default alert signal set is to be modified for communicating the alert status of the occupant assistance feature to the occupant of the vehicle. The method comprises determining a modified alert signal set by modifying the default signal set to include a further alert signal. The further alert signal is a different alert modality from the default audio alert signal. The further alert signal is to be communicated to the occupant via a further communicative output element of the vehicle different from the audio output element. The method comprises controlling communicative output elements of the vehicle, including the further communicative and audio output elements, to communicate the alert status of the occupant assistance feature to the occupant in accordance with the further alert signal and the one or more default alert signals in the modified alert signal set.

According to another aspect of the invention there is provided a non-transitory, computer-readable medium storing instructions thereon that, when implemented on one or more computer processors, cause the one or more computer processors to perform a method as defined above.

BRIEF DESCRIPTION OF THE DRAWINGS

Examples of the invention will now be described with reference to the accompanying drawings, in which: Figure 1 is a schematic diagram of a vehicle in accordance with an aspect of the invention; Figure 2 illustrates elements of a human-machine interface (HMI) of the vehicle of Figure 1; Figures 3(a) and 3(b) illustrate prior art examples of visual alert icons on HMIs of the vehicle of Figure 1; Figure 4 schematically illustrates an example of how the visual alert icon of Figure 3(b) is modified in accordance with the invention; Figures 5(a) and 5(b) illustrate prior art examples of visual alert icons on HMIs of the vehicle of Figure 1; Figure 6 schematically illustrates an example of how the visual alert icon of Figure 5(b) is modified in accordance with the invention; Figure 7 schematically illustrates an example of an alert icon of the vehicle of Figure 1 in accordance with an example of the invention; and, 10 15 20 Figure 8 shows the steps of a method performed by a controller of the vehicle of Figure 1 in accordance with an aspect of the invention.

DETAILED DESCRIPTION

The invention relates to providing or communicating alert signals to occupants of a vehicle such as a car. Warnings or notifications associated with operation of a vehicle are provided to the vehicle occupants via a number of different types of signal or modality. In particular, many warnings or notifications are communicated to the vehicle occupants via audio alert signals, e.g. a beeping tone via speakers of the vehicle. In some cases, the warnings or notifications are provided as audio alert signals only, whereas in other cases the warnings or notifications are provided additionally as different types of alert modality, e.g. a visual alert signal such as an icon displayed on a display screen of the vehicle.

In either case, there is a risk that the alert signals in relation to a particular warning or notification is missed by the relevant occupant of the vehicle, e.g. the driver. In a case in which the alert signal is an audio alert signal only, there are various reasons as to why the vehicle occupant(s) that the alert signal is aimed at may be missed. For instance, the occupant may be hearing impaired such that it is more difficult or even impossible for them to hear the audio alert signal. Range of hearing covers a wide spectrum. Some occupants may not be able to hear high-pitched sounds or sounds at a specific frequency, for instance. Audio alerts in vehicles tend to be within a relatively small frequency, and/or of relatively high pitch, which may increase the chance of them being missed by vehicle occupants. Furthermore, aging populations suffer from decreased hearing acuity.

Also, there may be relatively high levels of noise in the vicinity of the vehicle, which may mask or drown out the audio alert signals (a 'noise-compromised environment'). The noise source may be inside the vehicle cabin, e.g. from vehicle passengers or from a radio or other audio playback device of the vehicle or separate from the vehicle. On the other hand, the noise source may be external to the vehicle, for instance other traffic noise or emergency vehicle siren noise. A noisy environment may exacerbate any problems with hearing impairment of vehicle occupants.

In a case in which the alert signal includes signals of different modalities, if the audio alert signal is not heard by the vehicle occupant, e.g. for the reasons outlined above, then there is a risk that the occupant also misses the other type(s) of signal that is output to indicate the warning or notification. This may be because the other type of alert signal is not sufficiently conspicuous to be noticed by the occupant. For instance, the other type of signal may be a visual alert signal in the form of an icon or other graphical display element on a display screen of the vehicle; however, this icon may be relatively small or positioned such that the occupant/driver is less likely to notice it or more likely to not appreciate the relevance of the icon to the warning or notification being communicated.

Even in a case in which the vehicle occupant does hear the audio alert signal, they may not appreciate the significance of the warning or notification being communicated, and ignore the alert. In turn, this may make the occupant less likely to appreciate the significance of other types/modalities of alert signal indicating the warning.

The alert signals generated and communicated to vehicle occupants are typically preprogrammed or predefined to be of a certain signal type and form for the warnings or notifications of various features or functions of the vehicle. However, these 'default alert signals may or may not be suitable for different occupants that they are communicated to, and may or may not be suitable in different environmental conditions or contexts in which the vehicle is operating.

The present invention is advantageous in that it provides for modification or adaptation of default alert signals communicated to occupants of a vehicle to notify the occupants about an alert status of an occupant assistance feature of the vehicle. In particular, the present invention is advantageous in that it provides for modification or adaptation of default alert signals when needed, i.e. in a manner that is appropriate for the specific occupant(s) and/or environmental context in which the alert signals are being sent.

This is achieved by identifying, upon it being determined that an alert status of an occupant assistance feature of the vehicle needs to be communicated to the occupant, whether or not default (predefined) alert signals for communicating the alert status of the feature need to be modified. Specifically, it is determined whether or not default audio alert signals for communicating the alert status will not be heard, or are more likely to be missed or ignored, in the context in which they are being communicated (i.e. who they are being communicated to, a noise level of the surrounding environment, etc.).

If not, then the default alert signals are communicated as standard/normal. This can be beneficial as default settings align with what occupants expect to experience, and so they are not confused by unexpected types of alert signal.

If yes, however, then the default alert signals are modified or adapted in some appropriate manner to the context in order that the communicated alert signals are more suitable, e.g. they are more likely to be noticed and acted upon, if needed. The modification may involve modifying one or more of the default alert signals in some way, e.g. to make it more conspicuous. Alternatively, or in addition, the modification may involve generating a new/different type/modality of alert signal, relative to the default alert signal, that is more appropriate for the context in which it is being communicated, i.e. a modality that is more likely to be noticed or acted upon by the relevant vehicle occupant(s).

This will be explained in greater detail below, and further advantages and benefits associated with the described examples of the invention will become apparent in the following.

Figure 1 schematically illustrates a vehicle 10 in the form of a car or automobile. During operation, the vehicle 10 has at least one occupant including a driver 12. The vehicle includes a controller 101 for controlling various vehicle features or functions, e.g. to assist the driver or other occupants in terms of safety, experience, comfort, etc. The controller 101 may comprise one or more electronic control units (ECUs) for performing specific functions associated with the vehicle 10.

The various features or functions of the vehicle can include monitoring whether the seat belt of each occupied seat in the vehicle 10 is fastened, monitoring whether the vehicle doors are closed/secure during driving, monitoring tyre pressure, monitoring oil levels, etc. The functions or features can also include driving aids aimed at ensuring the vehicle 10 is being driven properly or appropriately. Such a feature may be a lane departure warning feature, in which sensors of the vehicle 10, e.g. radar sensors and/or cameras on an external body of the vehicle 10, monitor whether the vehicle 10 starts to move out of its lane, e.g. as demarcated by road markings, without a turn signal (indicator) in that direction being activated. Other such features may include proximity monitoring, for monitoring how close the vehicle 10 is to other objects such as other vehicles or walls, and hazard monitoring.

The vehicle driver 12 or other vehicle occupant may be provided with feedback indicative of a (current) state of the various functions and features in order to assist the occupant. In particular, the driver/occupant may be provided with feedback indicative that a certain occupant assistant feature is in an alert state, i.e. that there is some issue, such that action may need to be taken by the driver/occupant. That is, the occupant may be provided with a warning notification in connection with the occupant assistant feature.

The vehicle 10 includes various means for providing feedback to the vehicle occupants. In particular, the vehicle 10 includes means for providing feedback of different types or different modality to the occupants. The different types or modality may include audio feedback, visual feedback, haptic feedback, etc. With reference to Figure 2, the vehicle 10 includes a human-machine interface (HMI) 14 that allows for communication and interaction between the vehicle 10 and occupants including the driver 12. In particular, the vehicle 10 includes a head-up display (HUD) 141, i.e. display screen or graphical user interface (GUI), that is typically located on a dashboard in a cabin of the vehicle 10 behind the vehicle steering wheel 16. The HUD 141 typically provides information to the user in the form of visual feedback, such as icons or other graphical images, and typically includes information relating to a current vehicle speed, a current vehicle gear, fuel tank level, etc. The HMI 14 also includes a central console unit 142 (infotainment system/unit) for permitting interaction between the vehicle 10 and occupants. This unit typically includes a display screen, which may also be a touchscreen to permit user input. This unit may be for displaying and selecting information relating to a radio station, satellite navigation system, current weather updates, user profile selection (with various personalised settings for different functions of the vehicle 10 for a particular user/driver), etc. The HMI includes speakers that are configured to provide audio output. The speakers may be for providing radio playback or other audio entertainment. The same speakers, or separate speakers, may be provided for outputting warning or alert tones/sounds to the driver or other occupants in relation to various assistance features of the vehicle.

The vehicle 10 may also include haptic elements located in one or more components of the vehicle that may come into contact with one or more occupants of the vehicle 10. For instance, such elements may be located in seats of the vehicle, in seat belts of the vehicle, in the vehicle steering wheel, etc. In particular, the haptic elements may be configured to vibrate in order to provide sensory or tactile feedback to the relevant vehicle occupant, as appropriate. These haptic elements may be regarded as being part of the HMI.

The various elements for providing different types of output signal, e.g. display screen(s), speakers, haptic elements, etc., may be collectively referred to as communicative output elements of the vehicle 10 or vehicle HMI 14. The HMI 14, or vehicle 10 more generally, may include other interactive elements to allow occupants to input data, e.g. physical or electronic buttons, microphones for speech input, etc. The controller 101 may in some examples be a controller specifically for the HMI 14 (an HMI controller'). In other examples, the controller 101 may be a more general controller for controlling various aspects/functions of vehicle operation.

The communicative output elements of the vehicle 10 are configured to communicate the status of one or more occupant assistance features (described above) to appropriate occupants of the vehicle 10. In particular, the communicative output elements are configured to communicate an alert status of the occupant assistance features to the occupants. The alert status may be that the seat belt of an occupied vehicle seat is not fastened, the vehicle 10 is moving/drifting into an adjacent lane of the road without a turn signal on, etc. A status of the occupant assistance feature is monitored by appropriate sensors of the vehicle 10. For instance, one or more sensors may monitor whether a seat belt is fastened/buckled or not fastened (where seat occupancy may be monitored by different sensors, e.g. pressure sensors in the seat). As another example, radar sensors or cameras may monitor the position of the vehicle 10 relative to a lane in which the vehicle 10 is travelling.

Each occupant assistance feature has a default manner in which an alert status is communicated to the appropriate occupant. In particular, one or more default alert signals -collectively a default alert signal set -is retrieved/generated and output to the occupant(s) by the communicative output elements. The default alert signals in examples of the invention include one or more default audio alert signals. The default alert signals may include additional/different signal modalities, e.g. visual.

As described above, in examples of the present invention one or more default alert signals are modified prior to being communicated to the occupant/driver. An illustrative example of how the default alert signal set may be modified in a case in which the occupant assistance feature is a seat belt status feature is now described.

In some cases, the default alert signal set of a seat belt status feature may include only an auditory alert signal, e.g. a beeping tone output by the speakers.

Where an enhanced, adapted or modified alert signal set has been deemed to be needed or appropriate, additional alert signal modalities may be generated. For instance, a visual alert signal in the form of a message or icon may flash on the dashboard graphical user interface or HUD 141. A full screen visual alert may be used, where the usual/current display on the HUD 141 or other display screen is interrupted, and a full screen (or substantially full screen) visual alert appears on the screen.

Alternatively, or in addition, a haptic feedback device, e.g. a buzzer, may activate to indicate that the seat belt is not buckled. This haptic output element may be positioned in the seat associated with the unbuckled seat belt. The haptic output element may be in the vehicle steering wheel if the seat belt being monitored is the seat belt associated with the driver seat.

In some other cases, the default alert signal set of a seat belt status feature may include one or more other signals in addition to the audio alert signal. With reference to Figures 3(a) and 3(b), the default alert signal set may include a default visual alert or warning on a display screen of the vehicle 10, e.g. the HUD 141. In particular, Figures 3(a) and 3(b) illustrate respective examples of a default icon or graphic 30a, 30b that may appear on the HUD 141 when the alert status indicating that a seat belt is not fastened is determined. Figure 3(a) illustrates a HUD 141 that has individual lights in cut-out graphics for respective icons/information, whereas Figure 3(b) illustrates a digital HUD 141. In the examples illustrated in Figures 3(a) and 3(b), it will be appreciated that the illustrative default icons 30a, 30b are relatively small (compared to the total area of the HUD 141). Also, in the example of Figure 3(b) the default icon 30b is positioned in a corner of the HUD 141, which may be easily missed or ignored by the driver 12.

Figure 4 illustrates an example of how the default visual alert icon 30b of Figure 3(b) may be modified in accordance with an example of the invention. In particular, a modified or adapted alert icon 40 displayed on a display screen -specifically, the HUD 141 in the illustrated example -is larger than the default icon 30b. The modified icon 40 may be significantly larger than the default icon 30b. In the illustrated example, the modified icon 40 is at least one order of magnitude larger than the default icon 30b. In the illustrated example, the modified icon 40 is flashing, which can help draw the attention of the driver to it. In the illustrated example, the modified icon 40 is in a different position on the HUD 141 compared to the default icon 30b, which may also draw the attention of the driver to it. In the illustrated example, the modified icon 40 covers/obstructs some of the other icons/information on the HUD 141. Again, it may be regarded as being more likely that the driver will notice and act on such an icon so as to allow the obstructed information to again be visible. By modifying the default icon in one or more of these ways, the modified icon may be regarded as more conspicuous than the default icon.

Another illustrative example of how the default alert signal set may be modified is now described, in particular in a case in which the occupant assistance feature is a lane departure alert feature. Lane departure systems or features for vehicles are generally well known. In particular, if there is a risk of the vehicle 10 leaving the travelling lane unintentionally, a conventional/known feedback response may be to provide default audio and visual alerts to prompt the driver to act.

The system visually monitors the left and right hand side lane markers of the travelling lane using appropriate vehicle sensors, e.g. radar sensors, cameras, etc. If there is a risk of the vehicle 10 leaving the travelling lane unintentionally, the system/feature causes a flashing indicator to appear on a display screen of the vehicle 10 and sounds a warning chime or the like via a speaker of the vehicle 10.

Figures 5(a) and 5(b) schematically illustrate the default visual alert signals that may be displayed on the HUD 141 for the lane departure feature. Figure 5(a) illustrates a HUD 141 that has individual lights in cut-out graphics for respective icons/information, whereas Figure 5(b) illustrates a digital HUD 141. In the examples illustrated in Figures 5(a) and 5(b), it will be appreciated that the illustrative default icons 50a, 50b are relatively small (compared to the total area of the HUD 141). It will also be appreciated that it may be difficult to discern individual graphics -such as the default icon 50b -on the relatively large digital display of the HUD 141. The default alert signal set typically includes an audio alert signal to direct attention to the graphic/icon on the HUD 141; however, for the reasons described above, such an audio alert signal may be missed by the driver.

Figure 6 illustrates an example of how the default visual alert icon 50b of Figure 5(b) may be modified in accordance with an example of the invention. In particular, a modified or adapted alert icon 60 displayed on a display screen -specifically, the HUD 141 in the illustrated example -is larger than the default icon 50b. Indeed, it is significantly larger, e.g. at least one order of magnitude larger than the default icon 50b. Like in the previous example in Figure 4, the modified icon 60 is positioned more prominently than the default icon 50b, it may be flashing, and/or it may overlay other information displayed on the display screen 141. Therefore, even if the audio alert signal is missed, the driver's attention is more likely to be drawn to the more conspicuous modified visual alert, i.e. the modified icon 60.

Other occupant assistance features, advanced driver assistance systems (ADAS), of the vehicle may communicate an alert status of the feature in a similar manner. For instance, some features may use default visual alerts in the form of lights, e.g. LEDs, on one or more side mirrors of the vehicle, or may cause a change in colour in graphics on a display screen of the vehicle. However, even when accompanied by an audio alert signal, these alerts may be missed for the reasons outlined above. Appropriate modification to the default alert signals is therefore beneficial.

Modifications such as modified visual alerts (as above), additional visual alerts, and different alert modalities, e.g. haptic feedback alerts, can be utilised. The haptic feedback location can be indicative of what the alert relates to, e.g. a side of the seat in which a seat belt socket vibrates to indicate that the seat belt is not fastened, a side of the steering wheel or driver seat corresponding a side at which a lane departure is occurring, etc. Modifications to visual alerts to make them more attention grabbing can include using outsized graphics/icons, overlay of icons on other information on a screen, flashing graphics, moving graphics, changing graphic colour, changing graphic size, changing graphic positioning, descriptive text, interrupting a current/normal display with an alert, etc. Visual alerts in different locations that are highly conspicuous can also be beneficial, e.g. in a rear view mirror of the vehicle that has been fitted with display technology.

In examples of the invention, further alert modalities can include generating and transmitting alert signals to other devices not part of the vehicle 10, such as assistive devices or peripheral devices. For instance, in a case in which the vehicle occupant, e.g. the driver 12, is hearing impaired, a modified alert signal set for a certain occupant assistance feature may include a wireless communication signal that is transmitted by a wireless transmitter of the vehicle 10 to a hearing aid of the occupant. The wireless communication signal indicates the alert status of the occupant assistance feature and may instruct the hearing aid to output a warning tone or other appropriate audio output that the occupant will hear. Indeed, the vehicle 10 may be equipped with hearing aid related systems, e.g. a tele-coil or T-coil, so that audio signals can be transmitted to hearing aids so that occupants/users may hear audio signals clearly.

An example of a peripheral device in which a wireless communication signal can be transmitted to by the vehicle 10 is a Bluetooth® device (or other short-range wireless communication device) such as headphones or earphones. In particular, audio alert signals can be transmitted via Bluetooth® to the vehicle occupant. Such an alert modality can help when casual wearing of such wireless devices outside of hearing impairment cause difficulties in hearing default alert signals generated by the vehicle 10.

A (smart) mobile phone is an additional assistive or peripheral device that the vehicle 10 may transmit alert signals to as part of a modified alert signal set. In particular, mobile phones are often positioned in a prominent position in a vehicle cabin (by the driver or other occupant), and so alert notifications may beneficially be synchronised to such mobile phones to increase the likelihood of alert signals being noticed by the occupant.

A further example of an assistive or peripheral device that the vehicle 10 may transmit alert signals to as part of a modified alert signal set is a smart watch. For instance, a wireless signal may be transmitted to a smart watch of an occupant from the vehicle 10 to cause the smart watch to provide appropriate feedback to the occupant. This could be in the form of haptic feedback that directs the occupant to pay attention to visual notifications on the dashboard in relation to an alert status of an occupant assistance feature.

The controller 101 of the vehicle 10 is configured to determine or identify when a default alert signal set for an occupant assistance feature needs to be modified prior to being communicated to the appropriate vehicle occupant. In an example of the invention, this is performed with reference to a user profile associated with the occupant/driver that is loaded into the vehicle 10. In particular, different individuals that may travel in the vehicle 10 (which may typically be individuals who will drive the vehicle 10) may have different profiles associated therewith that can be loaded into the vehicle 10. Each user profile may include different customised or personalised settings for different features or functions of the vehicle 10. This can include various features such as preferred seat incline level, preferred radio station, etc. A user can select their preferred settings for various vehicle features via interaction with the vehicle HMI 14, e.g. the central console unit 142.

In the present context, creating the user profile can also include personalised or customised ways in which an alert status for one or more occupant assistance features is communicated to the respective user/occupant. For instance, a user who is hearing impaired may personalise a user profile such that alert signals to be communicated to the user are modified relative to default alert signals (e.g. of a default user profile) to make the alert signals more suitable for hearing impairment, e.g. as outlined above. It may be that a user can personalise in this way by making a single selection of a predefined 'hearing impaired' user profile of the vehicle 10. Alternatively, the user may be able to individually select modifications (e.g. from a list of possible modifications) to a default alert signal set for each occupant assistance feature as desired.

In another example of the invention, a determination or identification that a default alert signal set of an occupant assistance feature needs to be modified prior to being communicated to the occupant may be based on a (real-time) consideration of the environment in the vicinity of the vehicle 10. In particular, if the vehicle 10 is operating in a relatively noisy environment then it may be determined that a default alert signal set that includes a default audio alert signal may need to be modified, adapted or enhanced in some way to ensure that the alert is noticed and recognised by the relevant occupant.

In this example, the environmental noise level that is considered may be noise levels inside the vehicle cabin and/or noise levels external to the vehicle cabin. In the former case, if there is a plurality of occupants in the vehicle 10 then there may be an increased likelihood of higher levels of noise in the vehicle cabin, e.g. if occupants are talking to one another. Increased noise levels may also be more likely if there are young children in the vehicle 10. Noise levels in the vehicle cabin may be monitored by appropriate sensors, microphones, in the cabin.

In the latter case in which noise levels outside of the vehicle cabin are considered, several factors could contribute to external noise levels being such that audio alert signals in the vehicle 10 become difficult to discern for the relevant occupant. For instance, the vehicle may be passing through an area in which roadworks with loud noises, e.g. drilling, is occurring. If the detected noise level is above a defined threshold noise level, then it may be determined that modification to alert signals is needed.

In a specific example in which external noise is considered, alert signals may be communicated to the vehicle driver 12 to notify them of a horn of another vehicle in the vicinity being sounded or the siren of an emergency vehicle in the vicinity being sounded. Particularly in the case in which the vehicle driver is hearing impaired -such that they may not hear such a horn or siren -an alert signal may be communicated to the driver 12 to notify them of the horn or siren. For instance, this may in the form of a visual alert via the vehicle HMI 14.

It may be that the alert signal in this case may include a directional element. For instance, the vehicle 10 may include a plurality of microphones positioned at different parts of the vehicle 10 that can be used to monitor a direction and distance from the vehicle 10 of a horn or siren. This could be three or more microphones positioned internally in a lining of the vehicle roof, or microphones positioned in the vehicle side mirrors and tailgate. The noise monitored by such an arrangement of microphones could be used to triangulate a direction of the horn or siren relative to the vehicle 10.

The alert signal communicated to the vehicle driver 12 may include information indicative of the distance and direction of a horn or siren relative to the vehicle 10. Figure 7 schematically illustrates an example of a visual alert icon 70 that may be communicated to the vehicle driver 12 via the HMI 14 when a horn or siren is detected in the vicinity of the vehicle 10. The icon 70 can include information as to the type, distance and direction of noise being detected. In the illustrated example, the icon 70 includes one representation 701 of a vehicle in the centre with 8 further representations 702 of vehicles surrounding the central one 701. The central vehicle representation 701 corresponds to the vehicle 10.

It is seen that the peripheral vehicle representation 702a to the rear of the central vehicle representation 701 shows a horn graphic 703 overlaying it. This means that a horn noise has been detected behind / to the rear of the vehicle 10. Also, the size of the horn graphic 703 may indicate how close to the vehicle 10 the other vehicle making the horn noise is detected to be, e.g. the larger the horn graphic, the closer the other vehicle is. Furthermore, the horn graphic 703 may include an indication as to whether the detected noise is a horn of another vehicle or whether it is the siren of an emergency vehicle. For instance, if the detected noise is a siren then the horn graphic 703 may be output as a flashing graphic, whereas if it is a vehicle horn then it is not flashing.

When the controller 101 determines that that the status of an occupant assistance feature is an alert status that needs to be communicated to the occupant, the controller 101 retrieves the default alert signal set associated with said occupant assistance feature, e.g. from a data store of the vehicle 10 accessible by the controller 101. In the case of a personalised user profile, the controller 101 is configured to determine whether a personalised or customised user profile has been loaded (i.e. is operational) for the relevant occupant and, if so, whether the personalised user profile includes any modifications to the default manner in which the alert status of the occupant assistance feature is to be communicated to the occupant. If the controller 101 determines that modification is needed, a modification/adaption module/engine of the controller 101 is configured to generate the modifications to the default alert signal set, e.g. by changing one or more of the default alert signals or generating an additional alert signal/modality as described above. Similarly, in the case of a real-time determination as to whether modification is needed, e.g. whether the internal or external noise levels are above a defined threshold level, the controller 101 is configured to determine whether modification is needed and, if so, the modification/adaption module/engine determines how to modify the default alert signal set. In some cases, it may be considered that the default alert signals are interrupted, and modified according to the determination of the controller 101, before being sent to the appropriate communicative output elements for communicating to the occupant.

Figure 8 summarises the steps of a method 80 performed by the controller 101 of the vehicle 10 in accordance with the invention. The method 80 is for outputting or communicating alert signals to an occupant of the vehicle 10 such as the driver 12. At step 801, the method 80 involves receiving an input signal indicative of a status of an occupant assistance feature of the vehicle 10. The input signal is received from one or more sensors of the vehicle 10, e.g. a seat belt sensor to detect whether a seat belt is fastened, a radar sensor or camera on an external part of the vehicle 10 to detect the vehicle position relative to a lane it is currently travelling in, etc. At step 802, the method 80 involves determining, based on the received input signal, that the status of the occupant assistance feature is an alert status to be communicated to the occupant. The alert status may indicate that action needs to be taken by the occupant, e.g. fasten their seat belt.

At step 803, the method 80 involves retrieving e a default alert signal set for communicating the alert status of the occupant assistance feature, e.g. from a memory accessible by the controller 101. The default alert signal set includes at least one default alert signal to be communicated to the occupant via communicative output elements of the HMI 14 of the vehicle 10. Also, the at least one default alert signal includes a default audio alert signal to be communicated to the occupant via an audio output element, e.g. speaker, of the HMI 14. For instance, when an occupant seat belt is not fastened, the default audio alert signal may cause a speaker of the vehicle 10 to output a warning tone.

At step 804, the method 80 involves identifying or determining that the default alert signal set is to be modified for communicating the alert status of the occupant assistance feature to the occupant of the vehicle 10. In some examples, this identification is performed with reference to indicated preferences of the occupant, e.g. personalised settings in a user profile associated with the occupant and saved in the vehicle 10. In some examples, this identification is performed with reference to noise levels in the vicinity of the vehicle 10, which could be inside the vehicle cabin or external to the vehicle.

At step 805, the method 80 involves determining a modified alert signal set by modifying the default signal set to include a further alert signal. The further alert signal is a different alert modality from the default audio alert signal, i.e. a different type of alert such as visual, haptic, etc. Indeed, the further alert signal is to be communicated to the occupant via a further communicative output element of the vehicle 10 different from the audio output element. The modification to obtain the further alert signal may involve modifying one of the default alert signals (other than the default audio alert signal). For instance, a default visual alert signal could be modified to make it more conspicuous, as described above. Alternatively, or in addition, the modification to obtain the further alert signal may involve generating an additional alert signal, e.g. of a different modality to the default alert signals.

For instance, an additional visual or haptic alert signal could be generated, or a wireless transmission signal to be sent to a peripheral or assistive device could be generated.

Additional or modified visual alerts may be limited by regulation. For instance, the location of content on a head-up display (HUD) is limited by regulation. However, text or graphics related to audible warnings can be included. An LCD display on an instrument cluster of the vehicle can be formatted to have relatively large, clear displays of warning conditions while still displaying core functions. An LCD display of an infotainment display of a vehicle can be configured to have relatively large, clear displays of warning conditions.

At step 806, the method 80 involves controlling communicative output elements of the vehicle, including the further communicative element and audio output element, to communicate the alert status of the occupant assistance feature to the occupant in accordance with the further alert signal and the one or more default alert signals in the modified alert signal set. The further communicative element could be a display screen (e.g. of the HMI 14), haptic feedback elements in the vehicle seats, seat belts, steering wheel, etc., or a wireless communication transmitter of the vehicle 10.

Many modifications may be made to the described examples without departing from the scope of the appended claims.

Claims

CLAIMS1. A controller for outputting alert signals to an occupant of a vehicle, the controller being configured to: receive an input signal, from one or more sensors of the vehicle, indicative of a status of an occupant assistance feature of the vehicle; determine, based on the input signal, that the status of the occupant assistance feature is an alert status to be communicated to the occupant; retrieve a default alert signal set for communicating the alert status of the occupant assistance feature, the default alert signal set comprising one or more default alert signals to be communicated to the occupant via communicative output elements of a human-machine interface (HMI) of the vehicle, the one or more default alert signals comprising a default audio alert signal to be communicated to the occupant via an audio output element of the HMI; identify that the default alert signal set is to be modified for communicating the alert status of the occupant assistance feature to the occupant of the vehicle; determine a modified alert signal set by modifying the default signal set to include a further alert signal, the further alert signal being a different alert modality from the default audio alert signal, wherein the further alert signal is to be communicated to the occupant via a further communicative output element of the vehicle different from the audio output element; and, control communicative output elements of the vehicle, including the further communicative element and audio output element, to communicate the alert status of the occupant assistance feature to the occupant in accordance with the further alert signal and the one or more default alert signals in the modified alert signal set.
2. A controller according to Claim 1, wherein modifying the default alert signal set comprises modifying one of the default alert signals, other than the default audio alert signal, to obtain the further alert signal.
3. A controller according to Claim 2, wherein said one of the default alert signals is a default visual alert signal, wherein the further alert signal is a further visual alert signal, wherein the controller is configured to control a visual output element of the HMI to output a modified visual alert in accordance with the further visual alert signal.
4. A controller according to Claim 3, wherein the visual output element is a display screen of the HMI, wherein the modified visual alert in accordance with the further visual alert signal is a modified icon displayed on the display screen, and wherein the modified icon is larger than a default icon for display on the display screen in accordance with the default visual alert signal.
5. A controller according to Claim 4, wherein an area on the display screen covered by the modified icon is at least an order of magnitude larger than an area of the display screen covered by the default icon.
6. A controller according to Claim 5, wherein the modified icon covers a majority of a display area of the display screen; optionally, wherein the modified icon covers substantially an entirety of the display area of the display screen.
7. A controller according to Claim 1, wherein modifying the default alert signal set comprises generating the further alert signal in addition to the one or more default alert signals.
8. A controller according to Claim 7, wherein the further alert signal includes a visual alert signal, wherein the controller is configured to control a visual output element of the HMI to output a visual alert in accordance with the visual alert signal.
9. A controller according to Claim 8, wherein the visual output element is: a display screen of the HMI; or, one or more lights of the vehicle; optionally, wherein the one or more lights includes one or more LEDs positioned on a wing mirror of the vehicle.
10. A controller according to any of Claims 7 to 9, wherein the further alert signal includes a haptic alert signal, wherein the controller is configured to control a haptic output element of the vehicle to output a haptic alert in accordance with the haptic alert signal; optionally, wherein the haptic alert includes vibration of the haptic output element.
11. A controller according to Claim 10, wherein the haptic output element is: a steering wheel of the vehicle; a seat in which the occupant is seated; or, a seatbelt of the seat in which the occupant is seated.
12. A controller according to any of Claims 7 to 11, wherein the further communicative output element is a wireless communication transmitter of the vehicle, wherein the wireless communication transmitter is configured to transmit the further alert signal to a further communication device configured to communicate the alert status of the occupant assistance feature to the occupant.
13. A controller according to Claim 12, wherein the further communication device is one or more of: a hearing aid of the occupant; wireless headphones or earphones of the occupant; a mobile phone of the occupant; and, a smart watch of the occupant.
14. A controller according to any previous claim, wherein to determine the modified alert signal set the controller is configured to modify the default signal set in accordance with one or more defined preferences of the occupant to determine the further alert signal.
15. A controller according to any previous claim, wherein to identify that the default alert signal set is to be modified the controller is configured to: retrieve a user profile associated with the occupant from a memory device of the vehicle; and, identify that the user profile comprises one or more user preferences for communicating the alert status of the occupant assistance feature, wherein to determine the modified alert signal set the controller is configured to modify the default signal set in accordance with the one or more user preferences to determine the further alert signal.
16. A controller according to Claim 15, wherein the one or more user preferences indicates that default alert signal sets for occupant assistance features need to be modified to account for a hearing impairment of the occupant.
17. A controller according to any previous claim, wherein the controller is configured to receive noise sensor data, from one or more noise sensors of the vehicle, indicative of a noise level in the vicinity of the vehicle, and wherein the controller identifies that the default alert signal set is to be modified if the received noise sensor data indicates that the noise level is above a defined threshold noise level.
18. A controller according to Claim 17, wherein the received noise sensor data is indicative of the noise level external to the vehicle.
19. A controller according to Claim 18, wherein the received noise sensor data is indicative of a direction of noise relative to the vehicle, and wherein the further alert signal is determined to communicate to the occupant the direction of noise relative to the vehicle; optionally, wherein the further alert signal is a visual alert signal.
20. A controller according to Claim 19, wherein the received noise sensor data is indicative of a vehicle horn or an emergency siren external to the vehicle.
21. A controller according to any previous claim, wherein the occupant assistance feature is an occupant seat belt status feature, wherein the status of the seat belt status feature is determined to be the alert status to be communicated to the occupant if the received sensor data indicates that a seat belt of a seat in which the occupant is seated is not fastened; optionally, wherein the further alert signal is a visual alert signal communicated to the occupant via a display screen of the HMI; optionally, wherein the further alert signal is a haptic feedback signal and wherein a haptic output element in a seat of the vehicle in which the occupant is seated is configured to output a haptic alert in accordance with the haptic alert signal.
22. A controller according to any previous claim, wherein the occupant is a driver of the vehicle, and wherein the occupant assistance feature is an advanced driver assistance system (ADAS) feature of the vehicle; optionally, wherein the ADAS feature is one of: a lane departure warning feature; an object proximity feature; and, a hazard alert feature.
23. A controller according to Claim 22, wherein the ADAS feature is the lane departure warning feature, wherein the default alert signal set includes the default audio alert signal and a default visual alert signal, wherein to determine the further alert signal the controller is configured to: modify the default visual alert signal, wherein the default visual alert signal is communicated to the driver as a default icon on a display screen of the HMI, and wherein the further alert signal is a modified visual alert signal that is communicated to the driver as a modified icon on the display screen; optionally, wherein the modified icon is one or more of: larger than the default icon; a different colour than the default icon; at a different position on the display screen than the default icon; and, a flashing icon; or, generate the further alert signal in addition to the default alert signals, wherein the further alert signal is a visual alert signal that is communicated to the driver as an icon on the display screen.
24. A control system for a vehicle, the control system comprising: the controller of any previous claim; and, the communicative output elements of the vehicle.
25. A vehicle comprising a controller of any of Claims 1 to 23, or comprising a control system of Claim 24. 10
26. A method of outputting alert signals to an occupant of a vehicle, the method comprising: receiving an input signal, from one or more sensors of the vehicle, indicative of a status of an occupant assistance feature of the vehicle; determining, based on the input signal, that the status of the occupant assistance feature is an alert status to be communicated to the occupant; retrieving a default alert signal set for communicating the alert status of the occupant assistance feature, the default alert signal set comprising one or more default alert signals to be communicated to the occupant via communicative output elements of a human-machine interface (HMI) of the vehicle, the one or more default alert signals comprising a default audio alert signal to be communicated to the occupant via an audio output element of the HMI; identifying that the default alert signal set is to be modified for communicating the alert status of the occupant assistance feature to the occupant of the vehicle; determining a modified alert signal set by modifying the default signal set to include a further alert signal, the further alert signal being a different alert modality from the default audio alert signal, wherein the further alert signal is to be communicated to the occupant via a further communicative output element of the vehicle different from the audio output element; and, controlling communicative output elements of the vehicle, including the further communicative and audio output elements, to communicate the alert status of the occupant assistance feature to the occupant in accordance with the further alert signal and the one or more default alert signals in the modified alert signal set.
27. A non-transitory, computer-readable medium storing instructions thereon that, when implemented on one or more computer processors, cause the one or more computer processors to perform a method according to Claim 26.