[go: up one dir, main page]

WO2022030893A1 - Dispositif électronique pour la prise en charge du partage audio - Google Patents

Dispositif électronique pour la prise en charge du partage audio Download PDF

Info

Publication number
WO2022030893A1
WO2022030893A1 PCT/KR2021/009973 KR2021009973W WO2022030893A1 WO 2022030893 A1 WO2022030893 A1 WO 2022030893A1 KR 2021009973 W KR2021009973 W KR 2021009973W WO 2022030893 A1 WO2022030893 A1 WO 2022030893A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
electronic device
communication circuit
audio output
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2021/009973
Other languages
English (en)
Korean (ko)
Inventor
박진기
최광용
김미선
김상헌
서미라
박성기
임연욱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Publication of WO2022030893A1 publication Critical patent/WO2022030893A1/fr
Priority to US18/156,036 priority Critical patent/US20230289128A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724—User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/165—Management of the audio stream, e.g. setting of volume, audio stream path
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725—Cordless telephones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/34—Microprocessors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M2201/00—Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/38—Displays

Definitions

  • Various embodiments of the present invention relate to an electronic device configured to reproduce audio and to support playing the same audio in another electronic device.
  • the electronic device eg, a smartphone
  • the electronic device may be wirelessly connected to multiple audio output devices (eg, wireless earphones), and may simultaneously output audio reproduced by the electronic device through the audio output devices .
  • the electronic device may share audio with other electronic devices so that the other electronic devices can independently reproduce the audio.
  • the electronic device may share audio with other electronic devices except for a specified audio (eg, an alarm).
  • a specified audio eg, an alarm
  • An electronic device may easily change an audio path through another electronic device.
  • an electronic device may include a communication circuit for short-range wireless communication with an external electronic device; touch-sensitive display; and a processor connected to the communication circuit and the display, wherein the processor receives a list of at least one audio output device wirelessly connected to the external electronic device from the external electronic device through the communication circuit, displaying a list on the display, selecting a target device from among the at least one audio output device based on a user input received from the display while the list is being displayed, and displaying information about the target device and the target device and transmit audio to be output through the communication circuit to the external electronic device.
  • an electronic device may include a first communication circuit for short-range wireless communication with an external electronic device; a second communication circuit for short-range wireless communication with the audio output device; and a processor connected to the first communication circuit and the second communication circuit, wherein the processor displays a list of at least one audio output device connected to the electronic device via the second communication circuit to the first communication circuit. transmits to the external electronic device through It may be configured to output the audio received from the second communication circuit to the target device.
  • the electronic device may share audio with other electronic devices except for the specified audio (eg, an alarm).
  • An electronic device may easily change an audio path through another electronic device.
  • FIG. 1 is a block diagram of an electronic device in a network environment, according to various embodiments of the present disclosure
  • FIG. 2 is a block diagram illustrating a program according to various embodiments.
  • FIG. 3 is a block diagram of an audio sharing system according to various embodiments.
  • FIG. 4 illustrates a hierarchical architecture of an electronic device, according to various embodiments.
  • FIG. 5 illustrates a configuration of an audio sharing manager according to various embodiments.
  • 6A, 6B, 6C, and 6D illustrate GUI screens of a playback application displayed on a guest device according to an exemplary embodiment.
  • FIGS. 7A and 7B illustrate GUI screens of a playback application displayed on a host device according to an exemplary embodiment.
  • FIG. 8 is a diagram for explaining an operation of determining shared audio by an audio sharing manager according to an embodiment.
  • FIG. 9 is a diagram for explaining an operation in which the audio sharing manager brings shared audio from an audio mixer, according to an embodiment.
  • FIG. 10 is a diagram for describing an operation in which an audio sharing manager determines a volume of shared audio to be transmitted to a host device, according to an exemplary embodiment.
  • 11 is a diagram for explaining a method of outputting the same audio through a plurality of audio output devices in an audio sharing system, according to an embodiment.
  • FIG. 12 is a diagram for explaining a method of outputting the same audio through a plurality of audio output devices in an audio sharing system, according to an embodiment.
  • FIG. 13 is a diagram for explaining a method of outputting different audios through a plurality of audio output devices in an audio sharing system, according to an embodiment.
  • FIG. 14 is a diagram for explaining a method of outputting different audios through a plurality of audio output devices in an audio sharing system, according to an embodiment.
  • 15 is a flowchart illustrating operations 1500 for sharing audio according to various embodiments of the present disclosure.
  • FIG. 1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • a second network 199 e.g., a second network 199
  • the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178
  • may be omitted or one or more other components may be added to the electronic device 101 .
  • some of these components are integrated into one component (eg, display module 160 ). can be
  • the processor 120 for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120 . It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • software eg, a program 140
  • the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 .
  • the volatile memory 132 may be stored in the volatile memory 132 , and may process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 .
  • the processor 120 is the main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit) a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor).
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit
  • NPU neural processing unit
  • an image signal processor e.g., a sensor hub processor, or a communication processor.
  • the main processor 121 e.g, a central processing unit or an application processor
  • a secondary processor 123
  • the auxiliary processor 123 is, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the coprocessor 123 eg, an image signal processor or a communication processor
  • may be implemented as part of another functionally related component eg, the camera module 180 or the communication module 190. have.
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example.
  • the artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.
  • the memory 130 may store various data used by at least one component of the electronic device 101 (eg, the processor 120 or the sensor module 176 ).
  • the data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto.
  • the memory 130 may include a volatile memory 132 or a non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used in a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 .
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output a sound signal to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • the receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.
  • the display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 .
  • the display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device.
  • the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.
  • the audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . A sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • an external electronic device eg, a sound output module 155
  • a sound may be output through the electronic device 102 (eg, a speaker or headphones).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.
  • the interface 177 may support one or more designated protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD card interface Secure Digital Card
  • the connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a LAN (local area network) communication module, or a power line communication module).
  • GNSS global navigation satellite system
  • a corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a first network 198 eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)
  • a second network 199 eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a WAN).
  • a telecommunication network
  • the wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 .
  • the electronic device 101 may be identified or authenticated.
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR).
  • NR access technology includes high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency) -latency communications)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low-latency
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • a high frequency band eg, mmWave band
  • the wireless communication module 192 includes various technologies for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as full dimensional MIMO (FD-MIMO), an array antenna, analog beam-forming, or a large scale antenna.
  • the wireless communication module 192 may support various requirements specified in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ).
  • the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less).
  • a peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern.
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC)
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, underside) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • GPIO general purpose input and output
  • SPI serial peripheral interface
  • MIPI mobile industry processor interface
  • the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or a part of operations executed in the electronic device 101 may be executed in one or more external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 may perform the function or service itself instead of executing the function or service itself.
  • one or more external electronic devices may be requested to perform at least a part of the function or the service.
  • One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 .
  • the electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an Internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks.
  • the external electronic device 104 or the server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • FIG. 2 is a block diagram 200 illustrating a program 140 in accordance with various embodiments.
  • the program 140 executes an operating system 142 for controlling one or more resources of the electronic device 101 , middleware 144 , or an application 146 executable in the operating system 142 .
  • Operating system 142 may include, for example, Android TM , iOS TM , Windows TM , Symbian TM , Tizen TM , or Bada TM .
  • At least some of the programs 140 are, for example, preloaded into the electronic device 101 at the time of manufacture, or an external electronic device (eg, the electronic device 102 or 104 ), or a server (eg, the electronic device 102 or 104 ) when used by a user ( 108)) or may be updated.
  • the operating system 142 may control management (eg, allocation or retrieval) of one or more system resources (eg, a process, memory, or power) of the electronic device 101 .
  • the operating system 142 may additionally or alternatively include other hardware devices of the electronic device 101 , for example, the input device 150 , the sound output device 155 , the display device 160 , and the audio module 170 . , sensor module 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or It may include one or more driver programs for driving the antenna module 197 .
  • the middleware 144 may provide various functions to the application 146 so that functions or information provided from one or more resources of the electronic device 101 may be used by the application 146 .
  • the middleware 144 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 . ), a connectivity manager 215 , a notification manager 217 , a location manager 219 , a graphics manager 221 , a security manager 223 , a call manager 225 , or a voice recognition manager 227 .
  • an application manager 201 includes, for example, an application manager 201 , a window manager 203 , a multimedia manager 205 , a resource manager 207 , a power manager 209 , a database manager 211 , and a package manager 213 .
  • a connectivity manager 215 a notification manager 217 , a
  • the application manager 201 may manage the life cycle of the application 146 , for example.
  • the window manager 203 may manage one or more GUI resources used in the screen, for example.
  • the multimedia manager 205 for example, identifies one or more formats required for playback of media files, and encodes or decodes a corresponding media file among the media files using a codec suitable for the selected format. can be done
  • the resource manager 207 may manage the space of the source code of the application 146 or the memory of the memory 130 , for example.
  • the power manager 209 may, for example, manage the capacity, temperature, or power of the battery 189 , and determine or provide related information necessary for the operation of the electronic device 101 by using the corresponding information. . According to an embodiment, the power manager 209 may interwork with a basic input/output system (BIOS) (not shown) of the electronic device 101 .
  • BIOS basic input/output system
  • the database manager 211 may create, retrieve, or change a database to be used by the application 146 , for example.
  • the package manager 213 may manage installation or update of an application distributed in the form of a package file, for example.
  • the connectivity manager 215 may manage, for example, a wireless connection or a direct connection between the electronic device 101 and an external electronic device.
  • the notification manager 217 may provide, for example, a function for notifying the user of the occurrence of a specified event (eg, an incoming call, a message, or an alarm).
  • the location manager 219 may manage location information of the electronic device 101 , for example.
  • the graphic manager 221 may manage, for example, one or more graphic effects to be provided to a user or a user interface related thereto.
  • Security manager 223 may provide, for example, system security or user authentication.
  • the telephony manager 225 may manage, for example, a voice call function or a video call function provided by the electronic device 101 .
  • the voice recognition manager 227 for example, transmits the user's voice data to the server 108, based at least in part on the voice data, a command corresponding to a function to be performed in the electronic device 101; Alternatively, the converted text data may be received from the server 108 based at least in part on the voice data.
  • the middleware 244 may dynamically delete some existing components or add new components.
  • at least a portion of the middleware 144 may be included as a part of the operating system 142 or implemented as software separate from the operating system 142 .
  • Application 146 includes, for example, home 251 , dialer 253 , SMS/MMS 255 , instant message (IM) 257 , browser 259 , camera 261 , alarm 263 . , contacts 265, voice recognition 267, email 269, calendar 271, media player 273, album 275, watch 277, health 279 (such as exercise or blood sugar) measuring biometric information), or environmental information 281 (eg, measuring atmospheric pressure, humidity, or temperature information).
  • the application 146 may further include an information exchange application (not shown) capable of supporting information exchange between the electronic device 101 and an external electronic device.
  • the information exchange application may include, for example, a notification relay application configured to transmit specified information (eg, call, message, or alarm) to an external electronic device, or a device management application configured to manage the external electronic device.
  • the notification relay application for example, transmits notification information corresponding to a specified event (eg, mail reception) generated in another application (eg, the email application 269 ) of the electronic device 101 to the external electronic device.
  • the notification relay application may receive notification information from the external electronic device and provide it to the user of the electronic device 101 .
  • the device management application is, for example, a power source (eg, turn-on or turn-on) of an external electronic device that communicates with the electronic device 101 or some components thereof (eg, the display device 160 or the camera module 180 ). -off) or a function (eg, brightness, resolution, or focus of the display device 160 or the camera module 180 ) may be controlled.
  • the device management application may additionally or alternatively support installation, deletion, or update of an application operating in an external electronic device.
  • the electronic device may have various types of devices.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a wearable device e.g., a smart bracelet
  • a home appliance device e.g., a home appliance
  • first, second, or first or second may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit.
  • a module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • one or more instructions stored in a storage medium may be implemented as software (eg, the program 140) including
  • a processor eg, processor 120
  • a device eg, electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.
  • a signal eg, electromagnetic wave
  • the method according to various embodiments disclosed in this document may be included in a computer program product (computer program product) and provided.
  • Computer program products may be traded between sellers and buyers as commodities.
  • the computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones).
  • a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.
  • each component (eg, module or program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have.
  • one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg, a module or a program
  • the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. .
  • operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.
  • the audio sharing system includes a first electronic device (eg, a guest device, a server device) 310, a second wirelessly connected to the first electronic device 310 through a short-range wireless communication (eg, Bluetooth) circuit.
  • a short-range wireless communication eg, Bluetooth
  • 1 at least one audio output device 311 , a second electronic device (eg, a host device, a client device) 320 , and at least one wirelessly connected to the second electronic device 320 through a short-range wireless communication (eg, Bluetooth) circuit may include a second audio output device 321 of
  • the first electronic device 310 and the second electronic device 320 may be the same in whole or in part as the electronic device 101 of FIG. 1 .
  • the first electronic device 310 and the second electronic device 320 may be wirelessly connected through a short-range wireless communication (eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware) circuit.
  • a short-range wireless communication eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware
  • Wi-Fi direct after a negotiation process in which electronic devices determine a group owner, a group owner (eg, the first electronic device 310) and at least one group client (eg, Direct data communication between the second electronic devices 320 may be supported.
  • Wi-Fi Aware may support direct data communication between electronic devices (eg, the first electronic device 310 and the second electronic device 320 ) without a negotiation process.
  • the first electronic device 310 and the first audio output device 311 may be owned by the user A, and the second electronic device 320 and the second audio output device 321 may be owned by the user B. Connecting the second audio output device 321 to the first electronic device 310 using, for example, Bluetooth may be an inconvenient or time-consuming task for user B who owns the second audio output device 321 . have.
  • the first electronic device 310 may output audio to the second audio output device 321 through the second electronic device 320 without being directly connected to the second audio output device 321 .
  • the user A may request the activation of the audio sharing function from the user B in order to listen to the music that the user A likes or is currently listening to through the first audio output device 311 with the user B.
  • the second electronic device 320 may activate an audio sharing function according to a user B input received through an input device (eg, a touch sensitive display).
  • the first electronic device 310 may request from the second electronic device 320 information about the audio output device that has been established in connection with the second electronic device 320 according to the input of the user A.
  • the second electronic device 320 may transmit an audio output device list related to at least one or more second audio output devices 321 to the first electronic device 310 .
  • the first electronic device 310 may display the received list on the display.
  • the list includes identification information (eg, user name) for identifying user B, and identification information (eg, product name) of each of the second audio output devices 321 connected to the second electronic device 320 .
  • identification information eg, product name
  • the first electronic device 310 displays the name of a user (eg, user B) who owns the corresponding product for each product name (eg, Galaxy Buds) of the second audio output device 321 adjacent to the product name. can do.
  • the first electronic device 310 may select an audio output device (hereinafter, referred to as a target device) to output audio from a list based on a user input.
  • the first electronic device 310 may transmit audio to be shared with the second electronic device 320 (hereinafter, shared audio) and identification information of the target device to the second electronic device 320 .
  • the second electronic device 320 may play back or regenerate the shared audio received from the first electronic device 310 using the target device.
  • the playback operation may include, for example, an operation of storing the shared audio received from the first electronic device 310 in a memory (eg, a buffer), an operation of decoding the stored shared audio, and an operation of storing the decoded shared audio in a short-range wireless manner. It may include outputting the output to the target device through the communication circuit.
  • the first electronic device 310 may change the target device based on a user input. For example, after a target device is selected, the first electronic device 310 displays the list again as a user input for reselection is received through the input device, and sets the audio output device selected by the user in the list as a new target. It can be selected again as a device.
  • the first electronic device 310 may select a specified audio among a plurality of audios as the shared audio. For example, the first electronic device 310 may select audio output through the first audio output device 311 as shared audio. The first electronic device 310 may select audio(s) of a playlist waiting to be output to the first audio output device 311 as shared audio. If there is currently no audio being played or audio waiting to be played, the first electronic device 310 may display an audio list (eg, a music list) on the display and select audio selected by the user from the list as shared audio. The first electronic device 310 may transmit the selected shared audio to the second electronic device 320 . For example, the first electronic device 310 may copy the selected shared audio and transmit the copy to the second electronic device 320 . The copy may include volume data to enable the second electronic device 320 to determine the audio volume independently of the volume policy established in the first electronic device 310 when the second electronic device 320 reproduces the copy. can
  • the first electronic device 310 may perform an operation of limiting the audio to be shared with the second electronic device 320 to the specified audio.
  • the first electronic device 310 may limit the shared audio to audio played using a specified application (eg, a music playback app).
  • a specified application eg, a music playback app
  • only a specified type of audio eg, music
  • the first audio output device 311 can output all the audio generated by the first electronic device 310 and the second audio output device 321 suppresses the sound that the first user A is reluctant to share. Except for the specified audio, only the specified audio can be output.
  • the first electronic device 310 may display an interface for controlling reproduction of shared audio on the display.
  • the first electronic device 310 may include a volume control bar, a reproduction controller, and/or a button for releasing audio sharing in an interface and display it on the display.
  • the playback controller may include a pause/restart playback button, a previous song playback button, and/or a next song playback button.
  • the second electronic device 320 provides information indicating that the audio being reproduced using the target device is the shared audio received from the first electronic device 310 (eg, identification indicating the first user A). information) can be displayed on the display.
  • an electronic device may include software 401 and hardware 402 .
  • the software 401 (eg, the program 140 of FIG. 1 ) may be loaded into the volatile memory 132 from the non-volatile memory 134 and executed by the processor 120 .
  • the software 401 may include an application layer 410 , a framework 420 , a hardware abstraction layer (HAL) 430 , and/or a kernel 440 .
  • the hardware 402 may include a sensor controller 450 , a display driver integrated circuit (IC) 460 , and/or an audio controller 470 .
  • the application layer 410 (eg, the application 146 of FIG. 1 or 2 ) is at least one application 411 (eg, the first application 411a, the second application 411b) executable by the processor 120 . ), a third application 411c) and/or a system UI 412 .
  • the type of the at least one application 411 is not limited and may be various, such as an Internet browser, a video application, and a game.
  • the at least one application 411 may include a playback application or an audio sharing application.
  • the system user interface (UI) 412 may refer to an application constituting various graphic user interface (GUI) screens implemented in the electronic device 101 , such as a notification bar and a quick view. .
  • GUI graphic user interface
  • the framework 420 (eg, the middleware 144 of FIG. 1 or FIG. 2 ) provides various functions or information provided from one or more resources of the electronic device 101 to be used by at least one application 411 . Functions may be provided to at least one application 411 .
  • the framework 420 includes an activity manager 421 , a window manager 422 , a view system 423 , a sensor manager 424 , an audio service manager 425 , or an audio sharing manager (ASM). share manager) 426 .
  • ASM audio sharing manager
  • the activity manager 421 may control the life cycle and activity of the application layer 410 .
  • the window manager 422 may manage one or more GUI resources used in the screen.
  • the view system 423 may be a set of extensible views used to create a user interface of the application 411 .
  • the sensor manager 424 may provide sensor data to the application 411 so that the application 411 can use data generated by a sensor (eg, the sensor module 176 of FIG. 1 ).
  • the audio service manager 425 may identify one or more formats required for reproduction of audio files, and encode or decode an audio file using a codec suitable for a format selected from among them.
  • the audio sharing manager 426 may support a function of sharing audio between electronic devices.
  • the audio sharing manager 426 may support a function for allowing the electronic device 101 to operate as a guest device (eg, the first electronic device 310 of FIG. 3 ).
  • the audio sharing manager 426 may perform an operation of setting shared audio based on a predefined policy.
  • the audio sharing manager 426 based on an audio sharing function (or an audio sharing mode, a dual mode) being an enabled state (or an active state), is configured by the host device (eg, the second electronic device of FIG. 3 ).
  • An operation of setting a target device to output shared audio among at least one or more audio output devices wirelessly connected to the device 320 may be performed.
  • the audio sharing manager 426 may perform an operation of transmitting the shared audio to the host device.
  • the audio sharing manager 426 may support a function for allowing the electronic device 101 to operate as a host device.
  • the audio sharing manager 426 may include at least one or more wirelessly connected to the electronic device 101 so that the guest device can select a target device for outputting shared audio based on the audio sharing function being enabled.
  • An operation of transmitting information about the audio output device (audio output device list) to the guest device may be performed.
  • the audio sharing manager 426 may output the shared audio received from the guest device to the target device.
  • Some modules eg, a data communication module in the audio sharing manager 426 may be included in the application layer 410 or implemented as separate software.
  • the HAL 430 may refer to an abstracted layer between the hardware 402 and the software 401 .
  • the HAL 430 may include an input dispatcher 433 or an event hub 431 that provides an interface for standardizing events occurring in sensors.
  • the input dispatcher 433 may perform a function of determining an application to receive the generated event.
  • the HAL 430 may include a surface finger 432 .
  • the surface flinger 432 may perform a function of providing an execution screen to be displayed on a display among execution screens generated by an application. When the configuration of the display is changed, the surface flinger 432 may request the application 411 to process the change in resolution and density according to the changed display configuration.
  • the kernel 440 may include various drivers for driving various hardware included in the electronic device.
  • the kernel 440 includes a sensor driver 441 for driving a sensor controller 450 configured to control a sensor, a display driver 442 for driving a DDI 460 configured to control a display panel, and / or an audio driver 443 for driving the audio controller 470 configured to control the audio output device through a wireless communication circuit (eg, the wireless communication module 192 of FIG. 1 ).
  • the electronic device 500 may include the audio sharing manager 426 of FIG. 4 .
  • the audio sharing manager 426 may include an audio hooking system 510 belonging to the framework 420 and an audio sharing application 520 belonging to the application layer 410 .
  • the audio hooking system 510 may determine a policy for sharing audio.
  • the audio hooking system 510 may include a hooking policy module 511 and a volume policy module 512 .
  • the hooking policy module 511 is configured to share among audios 550 (eg, audios 551 , 552 , 553 , 554 ) mixed in the audio mixer 530 based on a predefined hooking policy 511a . You can decide which audio to intercept as audio.
  • the playback application 540 may provide the audio track 560 encoded by, for example, a pulse coding modulation (PCM) method to the audio mixer 530 . Audio mixer 530 can select music #1 553 and music #2 554 from audio track 560 and mix with notification 551 and alarm 552 . have.
  • PCM pulse coding modulation
  • the audio mixer 530 may mix the audios 551 , 552 , 553 , and 554 with volume data selected from the audio volume table 555 and provide it to the HAL 430 .
  • the hooking policy module 511 is configured to, when the audio sharing application 520 requests the provision of shared audio, based on the hooking policy 511a, among the audios 550, music (eg, music #1 553). , and music #2 (554)) as the shared audio to be intercepted. Accordingly, the hooking policy module 511 may add hookers 571 and 572 to which the shared audio is to be copied to the audio mixer 530 .
  • the hooking policy module 511 may receive shared audio from the hookers 571 and 572 included in the audio mixer 530 , and may provide the received shared audio to the audio sharing application 520 .
  • the volume policy module 512 may determine the volume of the shared audio based on the predefined volume policy 512a. The volume policy module 512 may add volume data according to the determination to the shared audio provided to the audio sharing application 520 .
  • the audio sharing application 520 requests the audio hooking system 510 to provide shared audio, and the audio hooking system
  • the shared audio received from the 510 may be provided to the audio sharing application 581 of the external electronic device 580 through a network (eg, the first network 198 of FIG. 1 ).
  • the audio sharing application 520 may receive shared audio from the external electronic device 580 through a network.
  • the audio sharing application 520 may control the playback application 540 to reproduce the shared audio received from the external electronic device 580 using the target device selected by the external electronic device 580 .
  • 6A, 6B, 6C, and 6D illustrate GUI screens of a playback application displayed on a guest device according to an exemplary embodiment.
  • a guest device displays a GUI screen of a playback application (eg, the playback application 540 of FIG. 5 ).
  • 610 may be displayed on a display (eg, the display module 160 of FIG. 1 ).
  • the guest device may display a GUI screen 610 including a representative image 611 of a currently playing song, a song name 612 , and a playback controller 613 on the display.
  • the guest device may further include the audio output device list 614 on the GUI screen 610 to display it on the display.
  • the list 614 may include identification information 614a of an audio output device (eg, the first audio output device 311 of FIG.
  • the guest device displays an icon 615 for initiating audio sharing with the host device (eg, the second electronic device 320 of FIG. 3 ) and an icon 617 for calling an audio volume control bar on the GUI screen 610 . It can be further included and displayed on the display.
  • the guest device may display a tip 616 in the GUI screen 610 informing the user of the guest device that the function that can be entered through the icon 615 is an audio sharing function. For example, the guest device may display the tip 616 on a display upon initial connection with the host device.
  • the guest device may receive the user input for the icon 615 from the display, and in response may display the pop-up window 620 of FIG. 6B on the display.
  • the guest device displays a tip 621 in a pop-up window ( 620) can be displayed.
  • the guest device may display the audio output device list 622 received from the host device through the pop-up window 620 .
  • the guest device receives the product name 622a of the audio output device (eg Galaxy Buds) or the product name 622b of the device equipped with the audio output device (eg BMW Mini) from the host device and lists ( 622) can be included.
  • the owner (user) profile eg mobile phone number
  • the guest device checks the owner's name (eg Jane) in the contact list and assigns the verified name to the corresponding contact list.
  • the guest device may display identification information (eg, product name) of the host device instead of the owner's name.
  • the guest device includes first information (eg, with) 622a-1 indicating that audio can be output substantially simultaneously from the audio output device of the guest device and the audio output device of the host device, and the audio path (or audio output) of the song being played
  • the second information eg, via) 622b - 1 indicating that the path
  • can be changed from the audio output device of the guest device to the audio output device of the host device may be included in the list 622 and displayed on the display.
  • the guest device recognizes the type of the audio output device connected to the host device, for example, through its product name, and based on the recognized type, the first information 622a-1 or the second information 622b-1 ) can be displayed together with the product name.
  • the guest device may recognize from the product name 622a that the type of the audio output device is a wireless earphone, and accordingly, display the first information 622a-1 at a location close to the product name 622a.
  • the guest device is a type of audio output device other than wireless earphone (eg, an audio output device installed in a vehicle, TV, or refrigerator, or a speaker (eg, artificial intelligence (AI) speaker)) , and accordingly, the second information 622b-1 may be displayed at a position close to the product name 622b.
  • the guest device receives from the display the user's selection of the target device from the list 622 (eg, a touch input for the product name 622a), and in response displays the GUI screen 610 of FIG. 6C on the display.
  • the guest device may display the audio output device list 614 further including identification information 614b of the target device on the GUI screen 610 on the display.
  • the guest device may remove the icon 617 from the GUI screen 610 .
  • the guest device includes a bar 614a-1 for adjusting the volume of audio output from the audio output device corresponding to the identification information 614a, and an audio output device corresponding to the identification information 614b.
  • the audio volume control bar 614b - 1 may be further included in the audio output device list 614 to be displayed on the display.
  • the guest device may display the volume control bar 614a-1 adjacent to the identification information 614a and display the volume control bar 614b-1 adjacent to the identification information 614b.
  • the guest device may further include check boxes 614a-2 and 614b-2 for executing or terminating audio playback in each audio output device in the list 614 to be displayed on the display.
  • the guest device may display a check box 614a-2 adjacent to the identification information 614a and display a check box 614b-2 adjacent to the identification information 614b.
  • the audio sharing function with the host device may be released.
  • the guest device removes the identification information 614b and the audio control bars 614a-1 and 614b-1 from the list 614 and displays the icon 617 on the GUI screen 610 again.
  • the GUI screen 610 of FIG. 6A may be displayed on the display.
  • the guest device may remove a check box from a check box according to a user input, and accordingly, may end audio output from the corresponding audio output device and output audio only through another audio output device.
  • the check of the first check box 614a - 2 is removed, and accordingly, audio output from the audio output device of the guest device is terminated, and audio may be output only through the audio output device of the host device.
  • the guest device may remove the volume control bars 614a - 1 and 614b - 1 from the list 614 and display the icon 617 on the GUI screen 610 again.
  • FIGS. 7A and 7B illustrate GUI screens of a playback application displayed on a host device according to an exemplary embodiment.
  • the host device displays a GUI screen of a playback application (eg, the playback application 540 of FIG. 5 ) ( 710) may be displayed on a display (eg, the display module 160 of FIG. 1 ).
  • a playback application eg, the playback application 540 of FIG. 5
  • the host device may display the GUI screen 710 including the representative image 711 of the currently playing song, the song name 712 , and the playback controller 713 on the display.
  • the host device may further include the audio output device list 714 on the GUI screen 710 to display it on the display.
  • the list 714 may include identification information 714a of an audio output device (eg, the second audio output device 321 of FIG.
  • the audio output device may be set as a device usable by a guest device. Accordingly, the host device may display information 714a - 1 indicating that the corresponding audio output device is a shared device with the guest device at a location close to the identification information 714a.
  • a short-range wireless communication eg, Bluetooth
  • the host device may receive audio from the guest device, decode the received audio, and output the decoded audio to the audio output device through a short-range wireless communication circuit. For example, when the audio sharing function is activated, the host device may stop outputting currently playing audio to the audio output device and output audio received from the guest device to the audio output device.
  • the host device may receive the representative image 711 and the song name 712 from the guest device and replace the representative image 721 and the song name 722 of audio output to the audio output device for display. Additionally, the host device may display identification information (eg, an owner's name) 723 of the guest device as a source providing the song being played in the vicinity of the song name 722 .
  • identification information eg, an owner's name
  • the audio sharing application 520 may perform an operation 810 of transmitting a message requesting the audio hooking system 510 to provide the shared audio.
  • the audio sharing application 520 may receive the user's selection of the target device (eg, a touch input for the product name 622a in FIG. 6B ) from the display.
  • the audio sharing application 520 may request audio to be provided to the host device (eg, the second electronic device 320 of FIG. 3 ) from the audio hooking system 510 .
  • the audio hooking system 510 may perform an operation 820 of fetching specified audio from among the audios mixed by the audio mixer 530 from the audio mixer 530 .
  • the hooking policy module 511 may include, based on the hooking policy 511a, various types of audio (eg, a clock alarm, a message reception notification tone, a call reception notification tone, a call voice, or music). A specified type of audio (eg, music) may be imported from the audio mixer 530 .
  • the hooking policy module 511 may retrieve playable audio from the audio mixer 530 using a specified application (eg, a music playback application) based on the hooking policy 511a.
  • the hooking policy module 511 may retrieve all audio mixed in the audio mixer 530 .
  • FIG. 9 is a diagram for explaining an operation (eg, operation 820 ) in which the audio sharing manager 426 retrieves shared audio from an audio mixer according to an embodiment.
  • the audio sharing manager 426 may perform an operation 910 of adding hookers 571 and 572 from which audio determined as shared audio will be copied to the audio mixer 530 .
  • the hookers 571 and 572 may perform an operation 920 of copying the corresponding audio and transferring the copy to the audio sharing manager 426 .
  • Audios (eg, alarm, notification, and music) mixed by the audio mixer 530 may be decoded and output to an audio output device of the guest device. At least some of the audio to be mixed (eg, music) may be copied to the hookers 571 and 572 and delivered to the host device. Audio transmitted to the host device may be decoded by the host device and output through an audio output device of the host device.
  • FIG. 10 is a diagram for explaining an operation in which the audio sharing manager 426 determines a volume of shared audio to be transmitted to a host device, according to an embodiment.
  • the hooking policy module 511 may perform an operation 1010 of transferring audios fetched from the audio mixer 530 to the volume policy module 512 based on the hooking policy 511a.
  • the volume policy module 512 may determine the volume of the shared audio based on the predefined volume policy 512a.
  • the volume policy module 512 may determine the volume of the copy to be the same as the volume of the original sound played in the guest device. Accordingly, the original sound and the copy may be output at the same volume.
  • the volume policy module 512 may determine the volume of the copy to be a different value (eg, a preset value) from the volume of the original sound played in the guest device. Accordingly, the original sound and the copy may be output at different volumes. For example, even if the original sound is set to be output in a low volume, the volume of the copy may be set to be output in a high volume independently of this.
  • the volume policy module 512 may apply the volume according to the determination to the audio received from the hooking policy module 511 . For example, the volume policy module 512 may set the determined value indicating the volume of the audio as the volume of the audio.
  • the volume policy module 512 may perform an operation 1030 of delivering audios whose volume is set according to the volume policy as shared audio 1020 to the audio sharing application 520 .
  • the first electronic device 1110 (eg, the first electronic device 310 of FIG. 3 ) transmits the audio ( 1113) can be printed.
  • the user 1122 of the second electronic device 1120 may activate the audio sharing function of the second electronic device 1120 according to the request of the user 1112 of the first electronic device 1110 .
  • the second electronic device 1120 (eg, the second electronic device 320 of FIG. 3 ) performs short-range wireless communication (eg, Bluetooth, Wi-Fi direct, or Wi-Fi Aware).
  • the second electronic device 1120 may output the audio 1113 to the second audio output device 1121 through a short-range wireless communication (eg, Bluetooth) circuit. Accordingly, the same audio as the audio output from the first audio output device 1111 may be substantially simultaneously output through the second audio output device 1121 .
  • a short-range wireless communication eg, Bluetooth
  • the first electronic device 1110 may change an audio path (or an audio output path) from the first audio output device 1111 to the second audio output device 1121 .
  • the first electronic device 1110 may display a GUI screen for controlling audio reproduction (eg, the GUI screen 610 of FIG. 6C ) on the display.
  • the first electronic device 1110 receives a user input requesting to stop audio output from the first audio output device 1111 (eg, a touch input for the check box 614a-2 of FIG. 6C ) through the GUI screen. can do. Accordingly, audio output from the first audio output device 1111 may be stopped, and audio may be output only from the second audio output device 1121 .
  • the first electronic device 1110 stops audio output to the first audio output device 1111 . and may maintain audio transmission to the second electronic device 1120 .
  • the first electronic device 1110 may resume audio output to the first audio output device 1111 .
  • the second electronic device 1120 may stop receiving audio from the first electronic device 1110 .
  • the second electronic device 1120 may resume audio reception from the first electronic device 1110 .
  • a first electronic device 1210 (eg, the first electronic device 310 of FIG. 3 ) includes a plurality of first audio output devices 1211 through a short-range wireless communication (eg, Bluetooth) circuit. 1212), the audio 1213 may be output.
  • the second electronic device 1220 Based on at least that the audio sharing function is activated in the second electronic device 1220 (eg, the second electronic device 320 of FIG. 3 ), the second electronic device 1220 performs short-range wireless communication (eg, Bluetooth, Wi-Fi).
  • short-range wireless communication eg, Bluetooth, Wi-Fi
  • the audio 1213 may be received from the first electronic device 1210 through a -Fi direct or Wi-Fi Aware circuit.
  • the second electronic device 1220 may be connected to at least one of the plurality of second audio output devices 1221 , 1222 , 1223 , 1224 , and 1225 through a short-range wireless communication (eg, Bluetooth) circuit.
  • a short-range wireless communication eg, Bluetooth
  • an audio output device mounted on a home appliance eg, a TV, a refrigerator
  • an audio output device mounted on a vehicle eg, an AI speaker
  • the second electronic device 1220 may output the audio 1213 received from the first electronic device 1210 to at least one target device selected by the first electronic device 1210 from among at least one connected audio output device. have.
  • a first electronic device 1310 (eg, the first electronic device 310 of FIG. 3 ) may be implemented as a foldable portable electronic device or a rollable portable device.
  • the foldable portable electronic device may have, for example, a folding shaft and a foldable housing that can be folded and unfolded around the folding shaft.
  • the foldable housing can be divided into two housings about a folding axis.
  • a first portion 1311 of the flexible display may be disposed in the first housing, and a second portion 1312 of the flexible display may be disposed in the second housing, and in a folded state of the portable electronic device, the first portion ( 1311) and the second portion 1312 may face each other or may face opposite directions.
  • a rollable electronic device may refer to, for example, an electronic device capable of bending and deforming a display, so that at least a part of it can be wound or rolled or accommodated in a housing (not shown). .
  • the first electronic device 1310 may output the first audio 1314 to the first audio output device 1313 through a wireless communication (eg, Bluetooth) circuit.
  • the first electronic device 1310 displays information about the first audio 1314 (eg, a song name or a representative image), a controller for controlling reproduction of the first audio 1314, and/or a volume control bar as part of the display. (eg, the first part 1311).
  • information about the first audio 1314 eg, a song name or a representative image
  • a controller for controlling reproduction of the first audio 1314 e.g., a song name or a representative image
  • a volume control bar e.g, the first part 1311).
  • the first electronic device 1310 transmits audio different from the first audio 1314 to the second audio output device 1321 through the second electronic device 1320 (eg, the first electronic device 320 of FIG. 2 ). can be printed
  • the first electronic device 1310 provides information on the second audio 1322 to be output to the second audio output device 1321 through the second electronic device 1320 (eg, a song name or a representative image).
  • a controller for controlling reproduction of the second audio 1322, and a volume control bar may be displayed on another portion of the display (eg, the second portion 1312).
  • the first electronic device 1310 transmits the short-range
  • the second audio 1322 may be transmitted to the second electronic device 1320 through a wireless communication (eg, Bluetooth, Wi-Fi direct, or Wi-Fi Aware) circuit.
  • the second electronic device 1320 may output the second audio 1322 to the second audio output device 1321 through a short-range wireless communication (eg, Bluetooth) circuit.
  • a first electronic device 1410 (eg, the first electronic device 310 of FIG. 3 ) may be implemented as a foldable portable electronic device or a rollable portable electronic device.
  • the first electronic device 1410 may output the first audio 1412 to the first audio output device 1411 connected through a wireless communication (eg, Bluetooth) circuit.
  • the first electronic device 1410 displays information about the first audio 1412 (eg, a song name, a representative image), a controller for controlling reproduction of the first audio 1412, and a volume control bar as part of the display (eg: may be displayed on the first portion 1413).
  • the first electronic device 1410 may output a plurality of audios different from the first audio 1314 to the outside using a plurality of external electronic devices.
  • the first electronic device 1410 provides information about the second audio 1414 to be output to the second audio output device 1421 through the second electronic device 1420 (eg, song name, representative image);
  • a controller for controlling reproduction of the second audio 1414 and a volume control bar may be displayed on another portion of the display (eg, the second portion 1415 ).
  • the first electronic device 1410 provides information about the third audio 1416 to be output to the third audio output device 1431 through the third electronic device 1430 (eg, song name, representative image), the third audio ( A controller for controlling playback of 1416 and a volume control bar may be displayed on another part of the display (eg, the third part 1417 ).
  • the first electronic device 1410 transmits the short-range
  • the second audio 1414 may be transmitted to the second electronic device 1420 through a wireless communication (eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware) circuit.
  • the second electronic device 1420 may output the second audio 1414 to the second audio output device 1421 through a short-range wireless communication (eg, Bluetooth) circuit.
  • the first electronic device 1410 transmits the short-range
  • the third audio 1416 may be transmitted to the third electronic device 1430 through a wireless communication (eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware) circuit.
  • the third electronic device 1430 may output the third audio 1416 to the third audio output device 1431 through a short-range wireless communication (eg, Bluetooth) circuit.
  • the operations 1500 may be performed by a processor of the guest device (eg, the processor 120 of FIG. 1 ).
  • the memory eg, the memory 130 of FIG. 1
  • the operations 1500 may be performed by a processor of the guest device (eg, the processor 120 of FIG. 1 ).
  • the memory eg, the memory 130 of FIG. 1
  • the operations 1500 may be performed by a processor of the guest device (eg, the processor 120 of FIG. 1 ).
  • the memory eg, the memory 130 of FIG. 1 ) may store instructions that, when executed, cause the processor to perform the operations 1500 .
  • the processor may transmit a message requesting information regarding an audio output device wirelessly connected to the host device to the host device through a short-range wireless communication (eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware) circuit.
  • a short-range wireless communication eg, Bluetooth, Wi-Fi direct, Wi-Fi Aware
  • the guest device may display an icon for starting audio playback using the host device (eg, icon 617 in FIG. 6A ) on the display, and in response to a user input to the displayed icon, a request message can be sent to the host device.
  • the host device may transmit a list of at least one audio output device to the guest device in response to the request.
  • the processor may display the audio output device list (eg, the list 622 of FIG. 6B ) received from the host device through the short-range wireless communication circuit on the display.
  • the audio output device list eg, the list 622 of FIG. 6B
  • the processor may transmit identification information (eg, the product name 622a of FIG. 6B ) of a target device to output the shared audio selected by the user from the list to the host device.
  • identification information eg, the product name 622a of FIG. 6B
  • the processor may transmit the shared audio to the host device so that the shared audio is output through the target device.
  • the processor may determine at least one of the audios as shared audio to be transmitted to the target device based on a predefined policy for audio sharing (eg, the hooking policy 511a of FIG. 5 ).
  • the processor may select audio being output through an audio output device wirelessly connected to the guest device as shared audio.
  • the processor may select the audio(s) of the list awaiting playback as shared audio.
  • the processor may exclude a specified type of audio (eg, a clock alarm, a message reception notification tone, a call reception notification tone, and a call voice) when the shared audio is selected.
  • the processor may include audio reproduced using a specified application (eg, a music playback application) as the shared audio.
  • the processor may determine the volume based on a predefined volume policy (eg, the volume policy 512a of FIG. 5 ) and add a value indicating the determined volume to the shared audio to be transmitted to the host device.
  • the electronic device may include a communication circuit for short-range wireless communication with an external electronic device; touch-sensitive display; and a processor connected to the communication circuit and the display, wherein the processor receives a list of at least one audio output device wirelessly connected to the external electronic device from the external electronic device through the communication circuit, displaying a list on the display, selecting a target device from among the at least one audio output device based on a user input received from the display while the list is being displayed, and displaying information about the target device and the target device and transmit audio to be output through the communication circuit to the external electronic device.
  • the processor receives a list of at least one audio output device wirelessly connected to the external electronic device from the external electronic device through the communication circuit, displaying a list on the display, selecting a target device from among the at least one audio output device based on a user input received from the display while the list is being displayed, and displaying information about the target device and the target device and transmit audio to be output through the communication circuit to the external electronic device.
  • the processor may be configured to copy audio to be output to a first audio output device wirelessly connected to the electronic device through the communication circuit as shared audio to be transmitted to the external electronic device.
  • the processor may be configured to copy a designated audio among a plurality of audios to be output to the first audio output device as the shared audio.
  • the processor may be configured to select music from among the plurality of audios as the shared audio.
  • the processor may be configured to exclude at least one of a clock alarm, a message reception notification tone, a call reception notification tone, and a call voice from the shared audio.
  • the processor may be configured to determine the volume of the copy, set a value indicating the determined volume as the volume of the copy, and transmit it to the external electronic device.
  • the processor may be configured to set the volume of the copy to be different from a volume set when the original sound of the copy is output.
  • the processor may be configured to stop outputting the audio to a first audio output device wirelessly connected to the electronic device through the communication circuit.
  • the processor is configured to output the audio to the first audio output device based on a user input received from the display while simultaneously outputting the audio to the first audio output device and transmitting the audio to the external electronic device can be configured to abort.
  • the processor is configured to: at least based on selection of the target device as a second audio output device to which the audio is to be output while outputting the audio to the first audio output device via the communication circuit, the audio is output to the first audio output device. It may be configured to stop outputting to the device.
  • the processor is configured to recognize a type of the target device based on a product name of the target device included in the list, and when the recognized type is a wireless earphone, output the audio to the first audio output device and the second audio output to the output device at the same time, and when the recognized type is a device different from the wireless earphone, stop outputting the audio to the first audio output device.
  • the device other than the wireless earphone may be a home appliance, a vehicle, or a speaker.
  • the processor may include a first volume control bar configured to adjust a volume of audio output to an audio output device wirelessly connected to the electronic device through the communication circuit, and a volume of audio output to the target device through the external electronic device It may be configured to display a second volume control bar for adjusting the display on the display.
  • the communication circuit includes a Bluetooth communication circuit and a Wi-Fi communication circuit, wherein the processor outputs the audio to a first audio output device through the Bluetooth communication circuit, and the external electronic device through the Wi-Fi communication circuit and transmit a copy of the audio to the device.
  • the communication circuit includes a Bluetooth communication circuit and a Wi-Fi communication circuit, wherein the processor outputs a first audio to a first audio output device through the Bluetooth communication circuit and the external through the Wi-Fi communication circuit It may be configured to transmit a second audio different from the first audio to the electronic device.
  • the electronic device may include a first communication circuit for short-range wireless communication with an external electronic device; a second communication circuit for short-range wireless communication with the audio output device; and a processor connected to the first communication circuit and the second communication circuit, wherein the processor displays a list of at least one audio output device connected to the electronic device via the second communication circuit to the first communication circuit. transmits to the external electronic device through It may be configured to output the audio received from the second communication circuit to the target device.
  • the processor is configured to stop outputting the first audio to the audio output device and output the second audio received from the external electronic device to the audio output device based on at least that the audio sharing function is activated in the electronic device. can be configured.
  • the electronic device may further include a display, and the processor may be configured to display information about the external electronic device as a source of the second audio on the display.
  • the processor may be configured to communicate data with a Wi-Fi communication circuit as the first communication circuit and output the audio to the target device through a Bluetooth communication circuit as the second communication circuit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Telephone Function (AREA)

Abstract

Dans divers modes de réalisation de l'invention, un dispositif électronique comprend : un circuit de communication pour une communication sans fil à courte portée avec un dispositif électronique externe ; un écran tactile ; et un processeur connecté au circuit de communication et à l'écran, le processeur pouvant être configuré pour recevoir, à partir du dispositif électronique externe, par l'intermédiaire du circuit de communication, une liste associée à un ou plusieurs dispositifs de sortie audio connectés sans fil au dispositif électronique externe, afficher la liste sur l'écran, sélectionner un dispositif cible parmi le ou les dispositifs de sortie audio sur la base d'une entrée d'utilisateur reçue depuis l'écran pendant l'affichage de la liste, et transmettre, au dispositif électronique externe, par l'intermédiaire du circuit de communication, des informations relatives au dispositif cible et à l'audio à émettre à travers le dispositif cible. Divers autres modes de réalisation sont possibles.
PCT/KR2021/009973 2020-08-03 2021-07-30 Dispositif électronique pour la prise en charge du partage audio Ceased WO2022030893A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US18/156,036 US20230289128A1 (en) 2020-08-03 2023-01-18 Electronic device for supporting audio sharing

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020200096567A KR20220016544A (ko) 2020-08-03 2020-08-03 오디오 공유를 지원하는 전자 장치
KR10-2020-0096567 2020-08-03

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/156,036 Continuation US20230289128A1 (en) 2020-08-03 2023-01-18 Electronic device for supporting audio sharing

Publications (1)

Publication Number Publication Date
WO2022030893A1 true WO2022030893A1 (fr) 2022-02-10

Family

ID=80118148

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2021/009973 Ceased WO2022030893A1 (fr) 2020-08-03 2021-07-30 Dispositif électronique pour la prise en charge du partage audio

Country Status (3)

Country Link
US (1) US20230289128A1 (fr)
KR (1) KR20220016544A (fr)
WO (1) WO2022030893A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024016948A1 (fr) * 2022-07-21 2024-01-25 Oppo广东移动通信有限公司 Procédé et appareil de mise à jour d'informations, procédé et système de partage audio, et dispositif électronique
WO2024067170A1 (fr) * 2022-09-30 2024-04-04 华为技术有限公司 Procédé de gestion de dispositif et dispositif électronique

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024071871A1 (fr) * 2022-09-27 2024-04-04 삼성전자주식회사 Dispositif électronique permettant de fournir un service audio, et son procédé de fonctionnement
KR20240056177A (ko) 2022-10-21 2024-04-30 삼성전자주식회사 오디오 재생장치의 음향 출력 제어 방법 및 그러한 방법을 수행하는 전자 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018098136A1 (fr) * 2016-11-22 2018-05-31 Bose Corporation Système d'attache de dispositif audio sans fil
KR20180106231A (ko) * 2017-03-17 2018-10-01 삼성전자주식회사 오디오 출력을 제어하기 위한 전자 장치 및 그의 동작 방법
KR20180108310A (ko) * 2017-03-24 2018-10-04 삼성전자주식회사 복수의 외부 장치들로 오디오 데이터를 전송하는 방법 및 전자 장치
KR20190013062A (ko) * 2017-07-31 2019-02-11 삼성전자주식회사 외부 장치를 통해 오디오 신호를 재생하기 위한 전자 장치 및 그의 동작 방법
EP3668070A2 (fr) * 2019-05-31 2020-06-17 Apple Inc. Diffusion audio simultanée vers plusieurs dispositifs de sortie audio sans fil

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018098136A1 (fr) * 2016-11-22 2018-05-31 Bose Corporation Système d'attache de dispositif audio sans fil
KR20180106231A (ko) * 2017-03-17 2018-10-01 삼성전자주식회사 오디오 출력을 제어하기 위한 전자 장치 및 그의 동작 방법
KR20180108310A (ko) * 2017-03-24 2018-10-04 삼성전자주식회사 복수의 외부 장치들로 오디오 데이터를 전송하는 방법 및 전자 장치
KR20190013062A (ko) * 2017-07-31 2019-02-11 삼성전자주식회사 외부 장치를 통해 오디오 신호를 재생하기 위한 전자 장치 및 그의 동작 방법
EP3668070A2 (fr) * 2019-05-31 2020-06-17 Apple Inc. Diffusion audio simultanée vers plusieurs dispositifs de sortie audio sans fil

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024016948A1 (fr) * 2022-07-21 2024-01-25 Oppo广东移动通信有限公司 Procédé et appareil de mise à jour d'informations, procédé et système de partage audio, et dispositif électronique
WO2024067170A1 (fr) * 2022-09-30 2024-04-04 华为技术有限公司 Procédé de gestion de dispositif et dispositif électronique

Also Published As

Publication number Publication date
KR20220016544A (ko) 2022-02-10
US20230289128A1 (en) 2023-09-14

Similar Documents

Publication Publication Date Title
WO2021075786A1 (fr) Dispositif électronique et procédé de traitement d'une fenêtre surgissante utilisant une multi-fenêtre de celui-ci
WO2022030893A1 (fr) Dispositif électronique pour la prise en charge du partage audio
US12375852B2 (en) Electronic device and multichannel audio output method using same
WO2022030891A1 (fr) Procédé permettant de restaurer des données de sauvegarde et dispositif électronique associé
WO2022211389A1 (fr) Dispositif électronique pour la prise en charge du partage de contenus audio
KR20220014519A (ko) 외부 장치들이 출력하는 컨텐츠의 출력 시점을 동기화하는 전자 장치 및 전자 장치의 동작 방법
WO2022031055A1 (fr) Dispositif électronique et procédé permettant de commander une sortie de vibrations de celui-ci
WO2022030774A1 (fr) Procédé de gestion de mémoire et dispositif électronique
WO2022025692A1 (fr) Procédé de commande de diffusion en continu basée sur l'entrée et dispositif électronique correspondant
WO2022071665A1 (fr) Dispositif électronique pour la synchronisation d'une fonction de mise en attente d'appel dans un environnement de réseau, et procédé associé à celui-ci
KR102878797B1 (ko) 전자 장치 및 이를 이용한 영상 데이터와 오디오 데이터 동기화 방법
WO2024075929A1 (fr) Dispositif électronique pour fournir un environnement d'exécution de confiance
WO2022245116A1 (fr) Appareil électronique et procédé de fonctionnement d'appareil électronique
WO2023146173A1 (fr) Procédé de fourniture d'écran et dispositif électronique le prenant en charge
WO2022124646A1 (fr) Dispositif électronique permettant de fournir un service de confidentialité
WO2023048404A1 (fr) Procédé d'affichage d'écran d'exécution d'application, et dispositif électronique le prenant en charge
WO2022065845A1 (fr) Procédé de traitement de données d'entrée et dispositif électronique le prenant en charge
KR20230023486A (ko) 복수의 진동 패턴을 조합하여 제공하는 전자 장치 및 그의 동작 방법
WO2022177061A1 (fr) Dispositif électronique préchargeant une application anormale en arrière-plan, et son procédé de fonctionnement
WO2024072117A1 (fr) Dispositif électronique et procédé de communication entre des applications
WO2022244961A1 (fr) Procédé de commande et dispositif l'utilisant
KR102854581B1 (ko) 전자 장치 및 이를 이용한 멀티 채널 오디오 출력 방법
WO2024071861A1 (fr) Procédé de mise à jour et dispositif électronique associé
WO2022025375A1 (fr) Dispositif électronique de conversion d'un certain nombre de canaux audio et procédé de fonctionnement de dispositif électronique
WO2024112057A1 (fr) Dispositif électronique pour stocker des données sécurisées et son procédé de fonctionnement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21852836

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21852836

Country of ref document: EP

Kind code of ref document: A1