KR20230108497A - Console display interlocking control method and vehicle system using the same - Google Patents

Abstract

The present invention relates to a console display interlocking control method and a shifter system utilizing the same. The method for controlling shifter and consol display linkage according to one embodiment of the present invention comprises the following steps of: determining a location of a console display; determining a linkage status of the console display; and controlling output displayed on the console display based on location information of the console display and the linkage status of the console display. Through the linkage of the console display and a shifter, display operation can be improved, thereby improving marketability.

Description

CONSOLE DISPLAY INTERLOCKING CONTROL METHOD AND VEHICLE SYSTEM USING THE SAME}

The present embodiments are applicable to vehicles in all fields, and more specifically, for example, may be applied to mobile devices supporting autonomous driving.

Research on autonomous driving, which enables a mobile device to move without user intervention, is being conducted. Autonomous driving devices are largely classified into five generations. Recently, third-generation autonomous driving devices that can change lanes with partial autonomous driving, and semi-autonomous driving that enable autonomous driving to the destination by responding to external hazards caused by the driving environment. Research is being conducted on the 4th generation autonomous driving device and the 5th generation autonomous driving device that can drive autonomously without user intervention in all routes with complete autonomous driving.

In order to solve the above-described problems, an embodiment of the present invention, as the display applied to a mobile device increases with the advancement and popularization of autonomous driving technology, it is out of the existing touchable area and can be easily used. A control system such as a remote control is required.

In addition, the mobile device needs to provide an environment necessary for the user, such as a package change suitable for a mode change of the mobile device and a screen UI change.

In addition, convenient usability needs to be provided in a mobile device so that a mode can be immediately switched when a user requests it.

The problems to be solved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

A console display interlocking method according to any one of the embodiments of the present invention for solving the above problems is a control method for interlocking a console display with a mobile device, comprising: determining a location of the console display; determining an interworking state of the console display; and controlling an output displayed on the console display based on the location information of the console display and an interworking state of the console display.

According to an embodiment, determining the location of the console display includes determining whether the location of the console display is inside or outside the mobile device.

According to an embodiment, the controlling of the output includes outputting an external control system from the console display when the location of the console display is outside the mobile device.

According to an embodiment, the determining of the location of the console display includes determining whether the console display is a front seat of the mobile device when the location of the console display is inside the mobile device.

According to an embodiment, the controlling of the output may include outputting a rear seat control system from the console display when the location of the console display is a rear seat of the mobile device.

Depending on the embodiment, the determining of the interlocking state of the console display may include determining whether the console display is in a state of interlocking with a steering wheel or a front display of the mobile device when the location of the console display is a front seat of the mobile device. Include steps.

Depending on the embodiment, the controlling of the output includes outputting a steering wheel control system by the console display when the console display is interlocked with the steering wheel.

According to the embodiment, the steering wheel control system includes a first steering wheel control system output when the console display is positioned in front of the steering wheel and a second steering wheel control system output when the console display is positioned behind the steering wheel. Includes operating system.

According to an embodiment, the controlling of the output includes outputting a front display control system by the console display when the console display is interlocked with the front display.

According to any one of the embodiments of the present invention, it is possible to improve marketability by improving display manipulation through linkage between a console display and a mobile device.

According to embodiments of the present invention, functions and notifications necessary for a user can be provided in a control system output from a console display.

According to embodiments of the present invention, a display user interface (UI) differentiated from a control system output from a console display may be provided to a user.

The effects obtainable in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 illustrates a schematic configuration of a mobile device system according to one embodiment of the present invention.
2 illustrates an internal configuration of a mobile device according to one embodiment of the present invention.
3 to 6 are diagrams for explaining internal components of a console display output corresponding to a device with which a console display in a mobile device is interlocked according to one embodiment of the present invention.
7 is a view for explaining a screen of a console display when the location of the console display is located outside the mobile device and interlocks with the front display according to an embodiment of the present invention.
8 is a flowchart illustrating a control method for interlocking a console display according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those skilled in the art can easily carry out the present invention. However, the present invention may be embodied in many different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a certain component is said to "include", it means that it may further include other components without excluding other components unless otherwise stated.

In addition, a 'mobile device' used in the following description assumes a mobile device used for transporting a passenger, but is not limited thereto, and may include UAM (Urban Air Mobility), a bus, and the like.

1 illustrates a schematic configuration of a mobile device system according to one embodiment of the present invention.

In one embodiment of the present invention, the mobile device may include a sensor unit 110, an interface unit 120, a driving unit 130 and a processor unit 140.

The sensor unit 110 may include at least one sensor capable of recognizing an internal and/or external state of the mobile device. The sensor unit 110 may include, for example, a camera sensor, an infrared sensor, a radar sensor, a voice sensor, a temperature sensor, a humidity sensor, and the like.

The interface unit 120 provides a user of the mobile device with various audio-visual data or information related or unrelated to the mobile device, and/or provides a control tool for the mobile device or its component(s). It can contain one interface. The interface unit 120 may include, for example, display(s) provided to the occupant(s) and/or audio device(s) provided to the occupant(s). The interface unit 120 may exchange signals with at least one electronic device in the mobile device by wire or wirelessly. The interface unit 120 may convert an input by a user of the mobile device into an electrical signal and provide the converted electrical signal to the processor unit 140 .

The driving unit 130 may physically drive and/or drive internal or external components of the mobile device based on the control of the processor unit 140 . The driving unit 130 may, for example, change the physical position(s) of the wheel(s), steering wheel, seat(s), and display(s) of the mobile device.

The processor unit 140 may include at least one processor. The at least one processor in the processor unit 140 may be electrically connected to and exchange signals with components (eg, a sensor unit, an interface unit, and a communication unit (not shown)) of the mobile device. components can be controlled. The processor unit 140 may further include at least one memory (not shown). The at least one processor may be referred to as a controller, microcontroller, microprocessor or microcomputer. The at least one processor may be implemented by hardware, firmware, software, or a combination thereof. For example, one or more Application Specific Integrated Circuits (ASICs), one or more Digital Signal Processors (DSPs), one or more Digital Signal Processing Devices (DSPDs), one or more Programmable Logic Devices (PLDs), or one or more Field Programmable Gate Arrays (FPGAs). may be included in the at least one processor. The functions, procedures, proposals and/or methods disclosed in this specification may be implemented using firmware or software, and firmware or software may be implemented to include modules, procedures, functions, and the like. Firmware or software set to perform the functions, procedures, suggestions and/or methods disclosed in this specification may be included in at least one processor or stored in at least one memory and driven by at least one processor. The functions, procedures, suggestions and/or methods disclosed in this specification may be implemented using firmware or software in the form of codes, instructions and/or sets of instructions.

The processor unit 140 operates the sensor unit 110, the interface unit 120 and/or the driving unit based on electrical signals received from the sensor unit 110 and/or the interface unit 120 ( 130) can generate control signals.

The at least one memory may be connected to at least one processor and may store various information related to operations of the at least one processor. For example, the at least one memory performs some or all of the processes controlled by the at least one processor, or software codes including instructions for performing procedures and/or methods described/suggested below. can be saved The at least one memory may store instructions, instructions or programs, which, when executed, result in at least one processor operably linked to the at least one memory. to perform operations in accordance with one embodiment of the present invention.

The mobile device may further include a communication unit. The communication unit may include one or more transceivers, and user data, control information, and radio signals referred to in functions, procedures, proposals, methods, and/or operation flowcharts disclosed in this specification are transmitted from one or more other devices through the one or more transceivers. / channel, etc. can be received. For example, one or more transceivers may be connected to the processor unit 140 and transmit and/or receive radio signals. For example, at least one processor in the processor unit 140 may control one or more transceivers to transmit user data, control information, or radio signals to at least one other device. Also, the processor unit 140 may control one or more transceivers to receive user data, control information, or radio signals from one or more other devices. In addition, one or more transceivers may be connected to one or more antennas, and one or more transceivers may be configured to transmit and/or receive user data, control information, radio signals/channels, etc., with other device(s) through one or more antennas. there is.

2 illustrates an internal configuration of a mobile device according to one embodiment of the present invention. Referring to FIG. 2, a mobile device includes at least one camera capable of detecting a state in the mobile device, a head-up display (HUD), and a front display (which provides audio-visual information to occupant(s)). s), a console display that provides status information of the mobile device to the occupant and/or controls for the gear, air conditioning, and/or seat(s) of the mobile device. The mobile device also includes a steering wheel, seat(s), and light(s). A table used in the office mode according to one embodiment of the present invention may be included. The table may include one or more touch buttons. A cockpit of a mobile device for embodiments of the present invention may include a steering wheel, front display(s), and a table. The cockpit is also referred to as an instrument panel (IP) or dashboard. In embodiments of the present invention, the cockpit is located in front of the driver inside the mobile device and may include an inner space for accommodating a steering wheel and an inner space for accommodating a table. The cockpit is configured to move a steering wheel and a table according to a boarding mode according to an embodiment of the present invention. In one embodiment of the present invention, the console display may be disposed on one side of the driver's seat or in a space between the driver's seat and the passenger's seat if there is a passenger seat.

3 to 6 are diagrams for explaining internal components of a console display output corresponding to a device with which a console display in a mobile device is interlocked according to one embodiment of the present invention.

The mobile device system may be interlocked with a front display, steering wheel, and console display.

The mobile device system according to the present embodiment can be interlocked to be operable regardless of the size and position of the display through the console display located inside the mobile device when it is difficult for the occupant to easily use the front display in the mobile device.

When the console display is located in the front seat of the mobile device, it can be interlocked with the front display or steering wheel. When the console display is located in the back seat of the mobile device, it can be interlocked with the front display. The UI displayed on the console display may be changed according to a location in the mobile device and an interlocking state.

FIG. 3 is a view for explaining a screen of a console display when the location of the console display is located at a front seat in a mobile device and interlocks with a front display according to an embodiment of the present invention.

Referring to FIG. 3 , when the console display is located in a front seat and interlocks with the front display, the front display control system may be displayed on the console display. In this case, the front display control system may include at least one of media, navigation, phone, mobile device setting, temperature setting, air conditioning function, touch pad, and dial.

The console display may display a first area in which a front display control system is displayed and a second area in which widgets are displayed in association with an app running on the front display. In FIG. 3, information displayed on the console display is divided into two areas and provided, but it is not necessary to be limited thereto, and information may be provided in various numbers of areas to provide various information of the mobile device.

The touch pad and dial of the front display control system displayed on the console display preferably provide a UI displayed in the central area of the first area, but need not be limited thereto.

Depending on the embodiment, a touch pad and dial capable of manipulating the front display and an app button for easily entering functions may be displayed in the first area of the front display control system.

Depending on the embodiment, when two apps (eg, navigation/media) are displayed on the front display in the second area of the front display control system, the console display also displays two widgets, which are simplified versions of the apps, so that it is easy to use the large display. You can manipulate the app. When three apps are displayed on the large display, it is preferable to display widgets corresponding to each app on the large display so that the three widgets are displayed on the small display, but the widget is not limited thereto.

4 and 5 are diagrams for explaining a screen of a console display when the console display is positioned at a front seat in a mobile device and interlocked with a steering wheel according to an embodiment of the present invention.

When the console display approaches the steering wheel within a preset distance, it may interlock with the steering wheel. Depending on the embodiment, when the console display is positioned within 10 cm from the steering wheel, it may automatically interlock with the steering wheel.

The console display can be displayed as a steering wheel control system. 4 and 5 , the steering wheel control system displayed on the console display may include at least one of speed, trip, moving device setting buttons, ADAS, and ADAS setting buttons. Also, the steering wheel control system may include at least one of a volume function, a media function, and an ADAS function. The ADAS preferably provides a UI displayed in the central area of the second area, but is not limited thereto.

Referring to FIG. 4 , when the console display is located behind the steering wheel, a first steering wheel control system capable of displaying cluster, trip, and ADAS functions may be displayed. The first steering wheel control system may display ADAS control buttons (adjustment of the distance to the preceding moving device, speed setting, etc.) and buttons for setting the moving device (lamp control, wiper control, etc.).

Referring to FIG. 5 , when the console display is located in front of the steering wheel (driver's side), a second steering wheel control system capable of controlling media, volume, and ADAS may be displayed on the console display.

6 is a view for explaining a screen of a console display when the location of the console display is located in a rear seat in a mobile device according to an embodiment of the present invention.

When the console display is located in a rear seat, the console display may display a rear seat control system. In this case, the rear seat control system may include at least one of media, navigation, phone, mobile device setting, temperature setting, air conditioning function, touch pad, and dial.

The console display may display a first area in which the rear seat control system is displayed and a second area in which widgets are displayed in conjunction with an app running on the front display. In FIG. 6, information displayed on the console display is divided into two areas and provided, but it is not necessary to be limited thereto, and information may be provided in various numbers of areas to provide various information of the mobile device.

The console display can be used as a stand-alone device as well as operating as a rear seat control system.

Depending on the embodiment, the rear seat control system may include at least one of a media function, a passenger seat air conditioning function, and a passenger seat seat function. That is, the console display may also provide a rear seat seat and an air conditioning control system.

When the console display is linked with a single device, it is desirable to display a large screen by linking the personal device and to provide a UI corresponding to web browsing or media playback, but it is not necessary to be limited thereto.

7 is a view for explaining a screen of a console display when the location of the console display is located outside the mobile device and interlocks with the front display according to an embodiment of the present invention.

When the console display is located outside the moving vehicle, the console display may display an external control system providing a manipulation function outside the moving vehicle. Depending on the embodiment, it may operate as a smart key capable of operating the vehicle from the outside.

In this case, the external control system may display at least one function such as vehicle window/door locking, vehicle headlight operation, vehicle gas fuel system operation, location transmission, air conditioning, parking, and the like.

In addition, the console display may display a monitoring function for displaying surrounding conditions using a camera. One or more pieces of monitoring information selected by a user among control information on an image displayed on the console display may be displayed.

8 is a flowchart illustrating a control method for interlocking a console display according to an embodiment of the present invention.

Referring to FIG. 8 , in a control method for interlocking a mobile device and a console display, the location of the console display is determined by receiving the location of the console display, and the interlocking state of the console display is determined to determine the location information of the console display and the console display. An output displayed on the console display may be controlled based on an interlocking state. In this case, the location information of the console display may be divided into a front seat of the mobile device and a rear seat of the mobile device.

By receiving the location of the console display (S110), it may be determined whether the location of the console display is inside the mobile device (S120).

After the step S120, if the location of the console display is not inside the mobile device, it may be determined that the location of the console display is outside the mobile device. When the console display is located outside, the console display may operate as an external control system (S130).

After the step S130, it may be determined whether the location of the console display is inside the mobile device. When the console display is located inside, it may be determined whether the console display is located in the front seat of the mobile device (S140).

After the step S140, if the location of the console display is not in the front seat of the mobile device, it may be determined that the console display is located in the rear seat of the mobile device. When the console display is located in the rear seat, the console display may operate as a rear seat control system (S150).

After the step S140, when the position of the console display is the front seat of the mobile device, it may be determined whether the console display is in a state of interlocking with the steering wheel (S160).

After the step S160, when the console display is not interlocked with the steering wheel, it may be determined that the console display is interlocked with the front display. When the console display is interlocked with the front display, the console display may operate as a front display control system (S170).

After the step S160, when the location of the console display is interlocked with the steering wheel, the console display may operate as a steering wheel control system (S180).

As another aspect of the present invention, the operation of the above-described proposal or invention is implemented, implemented, or implemented by a "computer" (a comprehensive concept including a system on chip (SoC) or a microprocessor) It may also be provided as executable code or an application that stores or includes the code, a computer-readable storage medium, or a computer program product, which also falls within the scope of the present invention.

Detailed descriptions of the preferred embodiments of the present invention disclosed as described above are provided to enable those skilled in the art to implement and practice the present invention. Although the above has been described with reference to preferred embodiments of the present invention, those skilled in the art will understand that the present invention can be variously modified and changed without departing from the scope of the present invention. For example, those skilled in the art can use each configuration described in the above-described embodiments in a manner of combining with each other.

Accordingly, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

110: sensor unit
120: interface unit
130: driving unit
140: processor unit

Claims (19)

In the control method for interlocking a mobile device and a console display,
determining the location of the console display;
determining an interworking state of the console display; and
Controlling an output displayed on the console display based on location information of the console display and an interlocking state of the console display.
Console display interlock control method. According to claim 1,
Determining the position of the console display
Determining whether the location of the console display is inside or outside the mobile device
Console display interlock control method. According to claim 2,
Controlling the output
When the location of the console display is outside the mobile device, the console display outputs an external control system.
Console display interlock control method. According to claim 2,
Determining the position of the console display
When the location of the console display is inside the mobile device, determining whether the console display is the front seat of the mobile device.
Console display interlock control method. According to claim 4,
Controlling the output
When the position of the console display is a rear seat of the mobile device, the console display outputting a rear seat control system.
Console display interlock control method. According to claim 4,
The step of determining the interlocking state of the console display
When the console display is located in the front seat of the mobile device, determining whether the console display is interlocked with a steering wheel or a front display of the mobile device.
Console display interlock control method. According to claim 6,
Controlling the output
When the console display is interlocked with the steering wheel, the console display outputting a steering wheel control system.
Console display interlock control method. According to claim 7,
The step of outputting the steering wheel control system
outputting a first steering wheel control system output when the console display is positioned behind the steering wheel; and
And outputting a second steering wheel control system that is output when the console display is located in front of the steering wheel.
Console display interlock control method. According to claim 6,
Controlling the output
When the console display is interlocked with the front display, the console display outputting a front display control system.
Console display interlock control method. In the control of the console display of the mobile device,
at least one processor; and
comprising at least one memory, wherein the at least one memory stores at least one program that, when executed, causes the at least one processor to perform operations;
The processor
determining the location of the console display;
Determining the interlocking state of the console display;
Controlling the output displayed on the console display based on the location information of the console display and the interlocking state of the console display
mobile device system. According to claim 10,
The processor
Determining whether the location of the console display is inside or outside the mobile device
mobile device system. According to claim 11,
The processor
When the location of the console display is outside the mobile device, the console display outputs an external control system.
mobile device system. According to claim 11,
The processor
When the location of the console display is inside the mobile device, determining whether the console display is a front seat of the mobile device
mobile device system. According to claim 13,
The processor
When the position of the console display is in the rear seat of the mobile device, the console display outputs a rear seat control system.
mobile device system. According to claim 13,
The processor
Determining whether the console display is interlocked with a steering wheel or a front display of the mobile device when the location of the console display is a front seat of the mobile device
mobile device system. According to claim 15,
The processor
When the console display is interlocked with the steering wheel, the console display outputs a steering wheel control system.
mobile device system. According to claim 16,
The steering wheel control system
A first steering wheel control system output when the console display is located behind the steering wheel and a second steering wheel control system output when the console display is located in front of the steering wheel.
mobile device system. According to claim 16,
The processor
When the console display is interlocked with the front display, the console display outputs the front display control system.
mobile device system. In a computer readable storage medium,
the storage medium stores at least one program code containing instructions that, when executed, cause at least one processor to perform operations;
The above actions are:
determining the position of the console display;
determining an interworking state of the console display; and
Controlling an output displayed on the console display based on location information of the console display and an interlocking state of the console display.
storage medium.