[go: up one dir, main page]

WO2019102885A1 - Dispositif électronique avec section d'affichage d'image modifiable - Google Patents

Dispositif électronique avec section d'affichage d'image modifiable Download PDF

Info

Publication number
WO2019102885A1
WO2019102885A1 PCT/JP2018/041811 JP2018041811W WO2019102885A1 WO 2019102885 A1 WO2019102885 A1 WO 2019102885A1 JP 2018041811 W JP2018041811 W JP 2018041811W WO 2019102885 A1 WO2019102885 A1 WO 2019102885A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
target image
displayed
change
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2018/041811
Other languages
English (en)
Japanese (ja)
Inventor
潤子 伊藤
奈里 三好
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2018207347A external-priority patent/JP2019096305A/ja
Application filed by Canon Inc filed Critical Canon Inc
Priority to CN201880075235.3A priority Critical patent/CN111373359A/zh
Publication of WO2019102885A1 publication Critical patent/WO2019102885A1/fr
Priority to US16/860,931 priority patent/US20200257396A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/34—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof

Definitions

  • the present invention relates to an electronic device capable of changing a display portion of an image and a control method thereof.
  • Japanese Patent Laid-Open No. 2012-75018 discloses that when the digital camera is rotationally moved in the panoramic reproduction mode, a partial range of the panoramic image in the direction in which the digital camera faces is displayed. There is also a method of switching the image displayed on the display screen.
  • JP-A-2014-222829 discloses that a plurality of images are arranged in the vertical direction of the display area, and images displayed in the display area can be switched by scrolling.
  • JP 2012-75018 A when the display of an image is started, the range of the image corresponding to the direction of the digital camera at that time is displayed, so for example, the image is selected from the reference range or the user's desired range. It can not be confirmed, and the user needs to change the display range by changing the direction of the digital camera.
  • Japanese Patent Application Laid-Open No. 2014-222829 when it is desired to display a part of the image in a large size when starting to display the image, the user needs to perform an enlargement operation.
  • An object of the present invention is to improve operability for displaying a partial range of an image when it is possible to arrange and display a plurality of images in a display area.
  • an electronic device comprises: detection means capable of detecting a change in the attitude of display means; switching means for switching an image to be displayed on a display surface among a plurality of images; Among the plurality of images, recording means for recording information related to the portion of the image displayed on the display surface when switched by the switching means, and the plurality of images.
  • the change according to the change in the posture in response to the detection means detecting the change in the posture of the display means The means changes a portion to be displayed, and when switching the image to be displayed from the first image to the second image, if the second image satisfies a predetermined condition, the second Information of the image of Control means for changing the information according to the change in posture and not to change the information of the second image when the second image does not satisfy the predetermined condition; It features.
  • FIG. 1 An external view of a smartphone as an example of an apparatus to which the configuration of the present embodiment can be applied
  • Block diagram showing a configuration example of a smartphone as an example of an apparatus to which the configuration of the present embodiment can be applied A diagram showing a display example of a screen in the present embodiment A diagram showing a display example of a screen in the present embodiment A diagram showing a display example of a screen in the present embodiment Flow chart showing display processing in the present embodiment Flow chart showing active image determination processing in the present embodiment Flow chart showing display range change processing in the present embodiment Flow chart showing update processing in the present embodiment
  • a diagram showing a display example of an image in the present embodiment A diagram showing a display example of an image in the present embodiment
  • a diagram showing a display example of an image in the present embodiment A diagram showing a display example of an image in the present embodiment
  • a diagram showing a display example of an image in the present embodiment A diagram showing a display example of an image in the present embodiment A diagram showing a display example of an image in the present embodiment A diagram showing
  • the structure of the smart phone 100 as an example of the electronic device in this embodiment is shown to FIG.
  • the example of the external view of the smart phone 100 is shown to FIG. 1A.
  • the display unit 105 is a display unit that displays an image and various information.
  • the display unit 105 is configured integrally with the touch panel 106 a, and can detect a touch operation on the display surface of the display unit 105.
  • the operation unit 106 includes the operation units 106b, 106c, 106d, and 106e as illustrated.
  • the operation unit 106 b is a power button that receives an operation of switching on and off the power of the smartphone 100.
  • the operation unit 106 c and the operation unit 106 d are volume buttons for increasing and decreasing the volume of the sound output from the sound output unit 112.
  • the operation unit 106 e is a home button for displaying the home screen on the display unit 105.
  • the audio output unit 112 includes an audio output terminal 112a for connecting an earphone or the like, and a speaker 112b for outputting a voice of a call. Further, on the surface opposite to the display unit 105 and the surface on the display unit 105 side, there is an imaging unit 22 for performing imaging.
  • the CPU 101, the memory 102, the non-volatile memory 103, the image processing unit 104, the display unit 105, the imaging unit 22, the operation unit 106, the storage medium I / F 107, the external I / F 109, Communication I / F 110 is connected. Further, an audio output unit 112, an attitude detection unit 113, and a system memory 52 are also connected to the internal bus 150. The units connected to the internal bus 150 can exchange data with one another via the internal bus 150.
  • the CPU 101 is a control unit that controls the entire smartphone 100, and includes at least one processor.
  • the memory 102 is made of, for example, a RAM (a volatile memory using a semiconductor element or the like).
  • the memory 102 stores image data obtained by the imaging unit 22 and converted into digital data, and image data to be displayed on the display unit 105.
  • the memory 102 has a sufficient storage capacity to store a predetermined number of still images and moving images and sounds for a predetermined time.
  • the memory 102 also serves as a memory (video memory) for displaying an image.
  • a RAM is used as the system memory 52. In the system memory 52, constants and variables for the operation of the CPU 101, programs read out from the non-volatile memory 103, and the like are expanded.
  • the CPU 101 controls each part of the smartphone 100 using the memory 102 as a work memory in accordance with, for example, a program stored in the non-volatile memory 103.
  • the non-volatile memory 103 stores image data, audio data, other data, various programs for the CPU 101 to operate, and the like.
  • the non-volatile memory 103 is configured by, for example, a flash memory or a ROM.
  • the image processing unit 104 is an image stored in the non-volatile memory 103 or the storage medium 108, a video signal acquired through the external I / F 109, or an image acquired through the communication I / F 110 based on control of the CPU 101.
  • the image processing unit 104 may be configured by a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 can perform image processing according to a program without using the image processing unit 104.
  • the display unit 105 displays an image or a GUI screen that configures a graphical user interface (GUI) based on the control of the CPU 101.
  • the CPU 101 generates a display control signal according to a program, generates an image signal to be displayed on the display unit 105, and controls each unit of the smartphone 100 to output the image signal to the display unit 105.
  • the display unit 105 displays a video based on the output video signal.
  • the smartphone 100 itself may include an interface for outputting a video signal to be displayed on the display unit 105, and the display unit 105 may be configured of an external monitor (such as a television).
  • an external monitor such as a television
  • the operation unit 106 is an input device for receiving a user operation including a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, and the like.
  • a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, and the like.
  • the touch panel is an input device that is planarly configured to be superimposed on the display unit 105, and coordinate information corresponding to the touched position is output.
  • the storage medium I / F 107 can be loaded with a storage medium 108 such as a memory card, a CD, or a DVD, and reads data from the loaded storage medium 108 or writes data to the storage medium 108 under control of the CPU 101. I do.
  • a storage medium 108 such as a memory card, a CD, or a DVD
  • the external I / F 109 is an interface that is connected to an external device by a wired cable or wirelessly to input and output video signals and audio signals.
  • the communication I / F 110 is an interface for communicating with an external device or the Internet 111 to transmit and receive various data such as files and commands.
  • the sound output unit 112 outputs sounds of moving images and music data, operation sounds, ring tones, various notification sounds, and the like.
  • the voice output unit 112 may perform voice output by wireless communication or the like.
  • the posture detection unit 113 detects the posture of the smartphone 100 (display unit 105) with respect to the gravity direction. Based on the posture detected by the posture detection unit 113, whether the smartphone 100 is held horizontally, vertically, upward, downward, or obliquely, etc. Can be determined.
  • the posture detection unit 113 at least one of an acceleration sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, and the like can be used, and a plurality can be used in combination.
  • the operation unit 106 includes a touch panel 106 a.
  • the CPU 101 can detect the following operation or state on the touch panel 106a.
  • a finger or pen that has not touched the touch panel 106 a newly touches the touch panel 106 a, that is, the start of touch (hereinafter referred to as touch-down)
  • touch-on A state in which a finger or a pen is touching the touch panel 106a (hereinafter referred to as touch-on) -A finger or pen moving while touching the touch panel 106a (hereinafter referred to as "Touch-Move") -A finger or pen touching the touch panel 106a being separated from the touch panel 106a, that is, the end of the touch (hereinafter referred to as touch-up) ⁇
  • touch-up A state in which nothing is touched on the touch panel 106a
  • touch on is also detected at the same time. After touch down, touch on normally continues to be detected unless touch up is detected.
  • touch on is detected simultaneously. Even if the touch on is detected, if the touch position is not moved, the touch move is not detected.
  • touch-off is detected.
  • the movement direction of the finger or pen moving on the touch panel 106a can also be determined for each vertical component and horizontal component on the touch panel 106a based on the change in position coordinates.
  • it is detected that the touch move is performed for a predetermined distance or more it is determined that the slide operation has been performed.
  • flicking is an operation of tracing quickly on the touch panel 106 a so as to flip it with a finger.
  • pinch in a touch operation in which multiple touch positions (for example, 2 points) are simultaneously touched to bring the touch positions closer to each other
  • pinch out a touch operation to move the touch positions away from each other
  • the touch panel 106a may be any of various touch panels such as resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, optical sensor type, etc. Good.
  • FIGS. 2A to 2C show display examples of the screen in the present embodiment.
  • FIGS. 2A and 2B show display examples of screens of the social network service (SNS).
  • FIG. 2A shows the state of the list screen in which the list item 201 is selected among the list item 201, the notification item 202, and the setting item 203.
  • the list item 201 is selected, the updated image of each user, a comment, and the like can be confirmed, and the user performs touch move along the Y-axis direction of the display unit 105 to display according to touch move. You can scroll (move) images and comments.
  • a summary of the updated information for example, the post 204 or 205 on which a portion of the updated image or a portion of the comment is displayed is displayed on the list screen.
  • the notification item 202 is touched, a notification to the user is displayed, and when the setting item 203 is touched, various settings such as user settings and login information can be performed.
  • the post 204 shows a post where Hanako has updated the 360 ° image as shown in the guidance 204c.
  • An item 204b displayed in the image indicates that the displayed image is a 360 ° image.
  • the details of the post 204 that is, a list of images updated as the post 204 can be displayed.
  • the post 205 indicates that Mr. Taro has updated the image, as indicated by the guidance 205a.
  • FIG. 2B shows that the item 204a is touched in FIG. 2A and the details of the post 204 are displayed.
  • a partial area of each image included in the post 204 is displayed with a width that matches the width of the display area in the X-axis direction, and a plurality of images are displayed side by side in the Y-axis direction .
  • partial regions of the images 206 and 207 are displayed side by side in the Y-axis direction.
  • the items 211 and 212 indicate which range of the 360 ° image is displayed, and the items 211 and 212 indicate that the range of the reference direction is displayed.
  • items 208 to 210 corresponding to each image are displayed.
  • the item 208 is an item (good) for indicating praise for each image, and touching the item 208 can notify the updated user of the praise for the image.
  • An item 209 is an item for describing a comment such as an impression or an opinion for each updated image, and when the item 209 is touched, a keyboard for entering a comment is displayed.
  • the item 210 is an item for sharing the updated image, and by touching the item 210, it is possible to transmit an image on another SNS or transmit an image by e-mail. In addition, acquisition of an image, notification of good, entry of a comment, and sharing are performed via the Internet.
  • FIG. 2C is a diagram for describing that a partial region of the entire 360 ° image is displayed on the display unit 105.
  • the 360 ° image is an image with a 360 ° field of view, and a part of the area can be displayed on the display unit 105.
  • the image 214 simply shows a 360 ° image, and the user can switch the area displayed on the display unit 105 according to the detection result of the posture detection unit 113.
  • a circle 213 switching the area to be displayed according to the direction of the display unit 105 as if the user were on the spot is referred to as VR (virtual reality) display.
  • VR virtual reality
  • a VR image is an image capable of VR display.
  • the VR image includes an omnidirectional image (all-sky image) captured by an omnidirectional camera (all-sky camera) or a panoramic image having a video range (effective video range) wider than the display range that can be displayed on the display means at one time Shall be included.
  • images that can be VR-displayed are included in VR images (VR content) even if the images are created using computer graphics (CG) as well as images captured by a camera.
  • the VR image includes not only a still image, but also a moving image and a live view image (an image obtained by acquiring an image signal continuously read from an imaging device of a camera in substantially real time and output to a display unit).
  • the VR image has an image range (effective image range) at the maximum in the vertical direction (vertical angle, angle from zenith, elevation angle, depression angle, altitude angle) 360 degrees, and horizontal direction (horizontal angle, azimuth angle) 360 degrees Have. Also, even if the VR image is less than 360 degrees vertically and less than 360 degrees horizontally, it can be displayed on a wide angle of view (field of view range) wider than the angle of view that can be photographed with a normal camera It also includes an image having a video range (effective video range) wider than the display range.
  • an image taken with a omnidirectional camera capable of shooting an object with a field of view (for angle of view) of 360 ° in the horizontal direction (horizontal angle, azimuth angle) and a vertical angle of 210 ° centered on zenith is It is a kind of VR image. That is, an image range having a field of view of 180 degrees ( ⁇ 90 degrees) or more in each of the vertical direction and the horizontal direction, and an image range larger than the range that can be visually recognized by human at one time is a VR image It is a kind of When this VR image is displayed in VR, by changing the posture in the left and right rotation direction, it is possible to view an omnidirectional video without joint in the left and right direction (horizontal rotation direction).
  • the VR image can also be referred to as an “image whose image range is at least a part of a virtual space (VR space)”.
  • the VR display is a display method capable of changing the display range to display an image of a visual field range according to the attitude of the smartphone 100 detected by the attitude detection unit 113 among the VR images.
  • an image in a visual field range corresponding to the direction of the user's face is displayed.
  • an image of a viewing angle (field angle) centered at 0 degrees in a horizontal direction (a specific azimuth, for example, north) and 90 degrees in a vertical direction (90 degrees from the zenith, that is, horizontal) Shall be displayed.
  • the attitude of the smartphone 100 is reversed (for example, when the display surface is changed from south to north), 180 degrees in the horizontal direction (reverse orientation, for example, south) of the same VR image
  • the display range is changed to an image of a viewing angle centered on 90 degrees (horizontal) in the vertical direction. If the user views the smartphone 100 mounted on the VR goggles, if the user turns his face from north to south (that is, if he faces the back), the image displayed on the smartphone 100 is also a video of the north. It is to change to the picture of the south. With such a VR display, it is possible to provide the user with a feeling as if it were visually present in the VR image (in the VR space).
  • the display angle ⁇ indicating the display range on the display unit 105 will be described.
  • the angle of the circle in the XY plane is indicated by ⁇
  • the angle of the circle in the XZ plane is indicated by ⁇ .
  • This processing is realized by developing the program recorded in the non-volatile memory 103 in the system memory 52 and executing the program by the CPU 101. This process starts when the smartphone 100 is powered on and a plurality of 360 ° images can be displayed.
  • the CPU 101 acquires a plurality of images to be displayed, that is, images of image numbers 1 to N through the communication I / F 110.
  • the image number indicates the display order of a plurality of images included in one post. That is, in S301, image data is acquired so that each image of a plurality of images to be displayed can be VR-displayed.
  • the image data acquired via the communication I / F 110 is expanded in the system memory 52.
  • the CPU 101 acquires display information such as display angles ⁇ 1 to ⁇ N indicating the display start positions of the images of image numbers 1 to N, and the presence or absence of a tag via the communication I / F 110.
  • the tag indicates whether or not a display range to be displayed when the user starts to display each image is defined in advance. That is, the tag is present when the display range is set in order for the user to start displaying the 360 ° image from the portion where the main subject, the subject of interest, etc. are captured in the 360 ° image.
  • the CPU 101 determines whether to change the display image. If it is determined that the display image is to be changed, the process proceeds to step S306. If not, the process proceeds to step S307.
  • the display image can be performed by a scroll operation (scrolling instruction) to the touch panel 206 a, that is, the display surface of the display unit 105. When the display unit 105 is scrolled upward, an image with a larger image number is displayed, and when it is scrolled downward, an image with a smaller image number is displayed.
  • 7A to 7H show display examples of images in the present embodiment. Image numbers M to M + 2 are displayed in FIG.
  • FIGS. 8A and 8B are diagrams for explaining display of a 360 ° image included in one post in the present embodiment.
  • images of image numbers M to M + 4 of the 360 ° images included in one post are shown side by side.
  • a frame 105B in FIG. 8B is a frame indicating an area including the range in the Y-axis direction of the display unit 105, and the display image or display in the frame 105B by the user changing the display image by performing a scroll operation or the like in S305. The area is changed in the Y-axis direction.
  • step S306 the CPU 101 performs active image determination processing.
  • the active image determination process will be described later with reference to FIG.
  • the CPU 101 determines whether or not an instruction to switch the display angle (display range) has been issued by the user's touch operation or button operation.
  • the display angle switching instruction is an operation of switching the display range (the center of the display range) on the display unit 105 of the 360 ° image currently displayed.
  • the active image and the inactive image are both displayed on the display unit 105, the active image is the largest image of the display area on the display unit 105, and the inactive image is an image smaller than the active image. is there.
  • the CPU 101 turns on the user operation flag of the active image and records it in the system memory 52.
  • the user operation flag is a flag for not intentionally changing the display angle of the current image, and when the user operation flag is turned on, the display angles of the other images other than the related image are changed by the change of the attitude of the display unit 105 Even if you change it, the display angle will not change. That is, when another image other than the related image is an active image, the display angle of the image of the user operation flag ON is not changed even if the change in the attitude of the display unit 105 changes.
  • the CPU 101 turns on the user operation flag of the inactive image, and records it in the system memory 52.
  • the CPU 101 records the currently active image display angle ⁇ as the display start position, and simultaneously records the active image and the inactive image touched in the system memory 52 as related images.
  • the CPU 101 determines whether to end the display processing.
  • the display process ends with a touch operation on a back item such as the item 703 shown in FIG. 7C, or pressing of the operation unit 106 e (home button), or the power of the smartphone 100 is turned off. If it is determined that the display process is to be ended, the display process is ended, and if not, the process returns to S304 and further returns to S305. It returns to the list screen as shown in FIG. 2A in which the touch operation to the item 703 is performed. When the display process ends, the user operation flag of all the images included in the displayed post is turned off.
  • the CPU 101 switches the display angle of the image (target image) instructed to be switched in S307. As described with reference to FIGS. 7B and 7C in S307, in S313, the display angle is switched only for the image instructed to be switched.
  • the CPU 101 turns on the user operation flag of the image (target image) instructed to be switched in S307, advances to S304, and advances to S305.
  • the display range change process is a process of changing the display angle ⁇ of the active image in accordance with the attitude of the display unit 105, and will be described later with reference to FIG.
  • the CPU 101 acquires the display state of the image of image number 1.
  • the display state of the image indicates whether the image is displayed or not and the size of the region displayed in the display area of the display unit 105.
  • An image to be subjected to the determination is indicated by an image number n.
  • the CPU 101 determines whether the image of the image number n is currently being displayed. If it is determined that the image number n is being displayed, the process proceeds to step S404. If not, the process proceeds to step S407.
  • step S404 the CPU 101 determines whether the area of the area displaying the image of image number n is larger than the area of the areas displaying other display images among the images displayed on the display unit 105. Determine if If it is determined that the area displaying the image of image number n is the largest, the process proceeds to step S405. If not, the process proceeds to step S406.
  • the CPU 101 sets the state of the image of image number n to active.
  • the CPU 101 deactivates the state of the image of image number n.
  • the CPU 101 determines whether or not the determination of S403 has been made for the images up to the image number N. That is, it is determined whether it has been determined whether all the images included in the post are active images, inactive images, or non-displayed images. If it is determined that the image of the image number n is the image number N and the above-described determination is completed, the active image determination process is ended, and if not, the process proceeds to S408.
  • the CPU 101 acquires the display state of the image number n as in S401, proceeds to S402, and further proceeds to S403.
  • the process in FIG. 4 may detect the active image by detecting an image having the largest display area among the images being displayed.
  • step S404 it may be determined whether or not the display target image is closest to a predetermined position (for example, upper left or center) of the display area, and the closest image may be determined as the active image in step S405. .
  • a predetermined position for example, upper left or center
  • step S404 it may be determined whether an image is being selected, and in step S405, if an image is being selected, it may be determined as an active image.
  • the display range changing process is a process of changing the display angle ⁇ of the active image according to the attitude of the display unit 105 (smartphone 100), and is started when the process proceeds to S315 in FIG.
  • the CPU 101 determines whether or not the attitude of the smartphone 100 has been changed by detecting the attitude of the smart phone 100 by the attitude detection unit 113. If it is determined that the attitude of the smart phone 100 has been changed, the process proceeds to S502, and if not, the process proceeds to S505. In S502, the CPU 101 acquires the posture change amount ⁇ .
  • the display range of the image is changed as shown in FIG. 7F.
  • the item indicating the display angle also changes in display along with the change in the attitude of the smartphone 100.
  • An item 704 shown in FIG. 7E showing a display angle shows a display angle of 0 degrees, but after a change in posture, an item 705 shown in FIG.
  • the item indicating the display angle also changes with the change of the attitude of the smartphone 100, and the display angle indicated by the item changes, so that the user can easily recognize which part of the 360 ° image the user is looking at.
  • the display mode of the item indicating the display angle is also changed when the user changes the display range by a touch operation or the like in S307 and S313.
  • the frame 105A shown in FIG. 8A has been described as indicating the range that can be displayed on the display unit 105, when the attitude of the smartphone 100 changes or when the display range is changed due to a touch operation or the like, FIG.
  • the display range is changed as shown. That is, the display angle is changed as shown in FIG.
  • FIG. 8B when the display image is switched to a larger image number as in S305, the range in which the frame 105B is moved downward is displayed on the display unit 105.
  • the update process is a process for updating the display angles of the other images based on the change of the display range of the active image due to the change of the attitude of the smartphone 100.
  • the update processing will be described later with reference to FIG.
  • the CPU 101 determines whether or not the active image is displayed on the entire display area of the display unit 105. If it is determined that the active image is displayed on the entire display unit 105, the process proceeds to step S506. If not, the process proceeds to step S304 in FIG. FIGS. 8C and 8D show display examples when the image with the image number M + 4 is displayed on the entire display unit 105.
  • FIGS. 8C and 8D show display examples when the image with the image number M + 4 is displayed on the entire display unit 105.
  • step S506 the CPU 101 determines whether a display angle switching instruction has been issued by the user's touch operation or button operation, as in step S307. If it is determined that the display angle switching instruction has been issued, the process proceeds to step S507. If not, the process proceeds to step S509.
  • step S508 the CPU 101 determines whether the full screen display has ended. The full screen display ends when the user taps on the image again. If it is determined that the full screen display is to be ended, the process proceeds to step S512. If not, the process returns to step S506.
  • S509 to S511 are similar to the processes of S501 to S503 of FIG. In S509 to S511, since the image (active image) is displayed on the entire surface, if the attitude of the smartphone 100 changes on the XY plane from the state displayed at the display angle of 90 ° as shown in FIG. The angle is 270 °.
  • the CPU 101 determines whether or not the active image is displayed by 360 ° or more by the determination in S506 or S509 in the immediately preceding S505 to S511. That is, it is determined whether or not all the XY planes of the image have been displayed in the state of full display. If it is determined that the full 360.degree. Display has been performed, the process proceeds to step S513. If not, the process proceeds to step S514. In step S512, it may be determined whether the range is displayed in almost all of the images. Therefore, if the active image is 180 °, it is determined whether or not 180 ° or more is displayed. In addition, the determination may be performed at any display angle such as 350 ° or 160 ° instead of 360 ° or 180 °.
  • the CPU 101 sets the display angle ⁇ a of the active image to the angle updated in S507 or S511.
  • the CPU 101 returns the display angle ⁇ a of the active image to the angle before displaying the entire surface.
  • the user views a range of 360 ° or more in the full display, that is, the entire range, there is a high possibility that the user's desired subject is in the display range of the display angle currently displayed.
  • the image displayed on the entire screen was not the image that the user wanted to see, or that only a portion was enlarged and displayed. Display at the display angle.
  • the update process is a process for determining whether or not to change the display angles of other 360 ° images when the display angle ⁇ of the active image is changed according to the attitude of the display unit 105 (smartphone 100).
  • the process is started when the process proceeds to step S504 in FIG. Whether to change the display angle of the other 360 ° images depends on whether the conditions described later are satisfied.
  • the CPU 101 acquires the display angle of the image of image number 1 and display information.
  • the display information of the image includes whether or not it is an active image, time information displayed, tag information, related image information, and the like.
  • the process of updating the display angle of each image is sequentially performed on image numbers 1 to N.
  • An object image to be subjected to the determination is indicated by an image number f.
  • the CPU 101 determines whether the image of the image number f is an active image. If it is determined that the image is an active image, the process advances to step S606; otherwise, the process advances to step S604.
  • S604 to S607 show the conditions as to whether or not the display angle of each image is to be changed along with the change of the display angle according to the posture change of the smartphone 100 of the active image.
  • the CPU 101 determines whether the user operation flag of the image f of the target image is ON. If it is determined that the image f is the user operation flag ON, the process advances to step S605; otherwise, the process advances to step S606.
  • the CPU 101 determines whether a predetermined time has passed since the image f was not displayed.
  • the predetermined time is, for example, a time such as 3 minutes or 10 minutes, and determination is made in a period after the currently displayed post starts to be displayed, and an elapsed time from the time the image of the currently displayed post is displayed last time Will not make a decision. If it is determined that the predetermined time has elapsed since the image f is not displayed, the process advances to step S608; otherwise, the process advances to step S609.
  • the CPU 101 determines whether the image f is an image with a tag. If it is determined from the display information that the image has a tag, the process advances to step S609; otherwise, the process advances to step S607.
  • the CPU 101 determines whether the image f is an active image and a related image. If it is determined that the image is an active image and a related image, the process proceeds to step S608. If not, the process proceeds to step S609.
  • the CPU 101 determines whether or not the determination of S403 has been made for the images up to the image number N. That is, it is determined whether it has been determined whether all the images included in the post are active images, inactive images, or non-displayed images.
  • the CPU 101 acquires the display state of the image number f in the same manner as in S601, proceeds to S402, and further proceeds to S403.
  • the display angle is not changed for an image for which a predetermined time has not elapsed, an image with a tag, an image without tag and an active image and no related image.
  • the fact that the user operation flag is ON means that the user changed the display angle by a touch operation or the like, and if the display angle is changed according to the change of the display angle of another image (active image), the user sees The display range shifts.
  • the flag is turned on again.
  • the image it is better to see the desired subject viewed immediately before.
  • the user can compare the same subject of a plurality of images, and view the display range desired to be confirmed in each image without performing an operation to search for each displayed image. be able to.
  • the display angle of the image number M of the active image changes.
  • FIG. 7F when the attitude of the smartphone 100 is rotated clockwise by 90 °, the display angle of the image number M which is the active image changes, and the image of the image number M-1 which is the inactive image is changed.
  • the display angle remains unchanged at 0 °.
  • the display angle of the active image is changed in accordance with the change in the orientation of the smartphone 100
  • the image in which the user is made to perform the touch operation and the desired subject is displayed on the display unit 105
  • the other display angle since the other display angle also changes in accordance with the change in one display angle with the change in the posture of the smart phone 100, it is easy to confirm the same subject in the two images.
  • the user does not have to change the display angle by performing a touch operation to display a desired subject on the display area of the display unit 105.
  • the active image display angle is changed according to the change of the attitude of the smartphone 100 among the display images
  • the display angle of the inactive image when the inactive image and the active image are related images. You may change at the same time.
  • the image is regarded as the related image It is also good. Further, an image having a difference in shooting date and time within a predetermined time or an image having a difference in shooting location within a predetermined distance may be used as the related image.
  • the user when the user sequentially displays a plurality of images, the user can confirm desired portions of the respective images with good operability. Even if the display angle of one of the plurality of images changes with the change in the attitude of the smartphone 100, the user does not change the display angle if the display angle is adjusted in advance, so the intention The display angle never changes.
  • determinations in S605, S606, and S607 described in FIG. 6 may not be performed, and it may be determined whether to update the display angle according to the presence or absence of the user operation flag in S604.
  • the determination in S604 to S607 may be any one or a combination of any.
  • the image numbers 1 to N are displayed in order, when an image not displayed yet is displayed according to the switching operation of the display image in S305 of FIG. 3, regardless of the determination in S604.
  • the initial display angle may be displayed as 0 without updating the display angle.
  • the 360 ° image is described as an example, but a part is displayed on the display unit 105, and the display part is changed along with the change of the attitude of the smartphone 100. It may be an image, such as a panoramic image or a 180 ° image.
  • the display angle is changed according to the change of the attitude of the smart phone 100 in the XY plane.
  • the present invention is not limited to this, the display angle is changed according to the change of the attitude of the smart phone 100 in the XZ plane. May be changed.
  • the present invention is not limited thereto.
  • An image file is selected and a plurality of images in an image file It is applicable also when an image is displayed.
  • a plurality of images are arranged in the Y-axis direction of the display unit 105, and when each image is displayed, a part of each image is displayed on the display unit 105. You may line up in the direction.
  • the present invention is also applicable to the case where not the part of each image but the whole is displayed and a part of the selected image is displayed according to the selection of each image. In that case, the above-described processing is performed for the display angle displayed in response to the selection.
  • the above-described various controls described as being performed by the CPU 101 may be performed by a single piece of hardware, or a plurality of pieces of hardware may share processing to control the entire apparatus.
  • the present invention is not limited to this example, and any electronic device capable of changing the display portion of an image is applicable. It is possible. That is, the present invention is applicable to a mobile phone terminal, a portable image viewer, a printer device provided with a finder, a digital photo frame, a music player, a game machine, an electronic book reader, and the like.
  • the present invention is also realized by performing the following processing. That is, software (program) for realizing the functions of the above-described embodiment is supplied to a system or apparatus via a network or various recording media, and a computer (or CPU, MPU or the like) of the system or apparatus reads out the program code It is a process to execute.
  • the program and the recording medium storing the program constitute the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un dispositif électronique permettant d'afficher une pluralité d'images dans une zone d'affichage et de détecter un changement d'orientation d'un moyen d'affichage. Parmi chaque image de la pluralité d'images affichées dans la zone d'affichage, une plage d'affichage affichée dans l'image est modifiée. Lorsqu'une première image à afficher et une seconde image à afficher sont affichées dans la zone d'affichage, la plage d'affichage de la première image à afficher est modifiée en fonction d'un changement d'orientation du moyen d'affichage et, si une condition prescrite est remplie, la plage d'affichage de la seconde image à afficher est modifiée en fonction du changement d'orientation de la zone d'affichage mais, si la condition prescrite n'est pas remplie, la plage d'affichage de la seconde image à afficher n'est pas modifiée.
PCT/JP2018/041811 2017-11-21 2018-11-12 Dispositif électronique avec section d'affichage d'image modifiable Ceased WO2019102885A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201880075235.3A CN111373359A (zh) 2017-11-21 2018-11-12 能够改变图像的显示部分的电子装置
US16/860,931 US20200257396A1 (en) 2017-11-21 2020-04-28 Electronic device and control method therefor

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2017223649 2017-11-21
JP2017-223649 2017-11-21
JP2018207347A JP2019096305A (ja) 2017-11-21 2018-11-02 電子機器およびその制御方法およびプログラムおよび記録媒体
JP2018-207347 2018-11-02

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/860,931 Continuation US20200257396A1 (en) 2017-11-21 2020-04-28 Electronic device and control method therefor

Publications (1)

Publication Number Publication Date
WO2019102885A1 true WO2019102885A1 (fr) 2019-05-31

Family

ID=66631928

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/041811 Ceased WO2019102885A1 (fr) 2017-11-21 2018-11-12 Dispositif électronique avec section d'affichage d'image modifiable

Country Status (1)

Country Link
WO (1) WO2019102885A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021144599A (ja) * 2020-03-13 2021-09-24 キヤノン株式会社 電子機器及びその制御方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013250470A (ja) * 2012-06-01 2013-12-12 Nintendo Co Ltd 情報処理プログラム、情報処理装置、情報処理システム、および情報処理方法

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013250470A (ja) * 2012-06-01 2013-12-12 Nintendo Co Ltd 情報処理プログラム、情報処理装置、情報処理システム、および情報処理方法

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2021144599A (ja) * 2020-03-13 2021-09-24 キヤノン株式会社 電子機器及びその制御方法
JP7512055B2 (ja) 2020-03-13 2024-07-08 キヤノン株式会社 電子機器及びその制御方法

Similar Documents

Publication Publication Date Title
JP6151157B2 (ja) 電子機器および制御プログラム並びに電子機器の動作方法
US20120032988A1 (en) Display control apparatus that displays list of images onto display unit, display control method, and storage medium storing control program therefor
JP7005161B2 (ja) 電子機器及びその制御方法
US20150186009A1 (en) Electronic device, method and storage medium
JP7154789B2 (ja) 表示制御装置、その制御方法、プログラム及び記憶媒体
JPWO2015072194A1 (ja) 表示制御装置、表示制御方法およびプログラム
JP2012217101A (ja) 情報処理装置及びその制御方法、プログラム、並びに記憶媒体
US11354031B2 (en) Electronic apparatus, computer-readable non-transitory recording medium, and display control method for controlling a scroll speed of a display screen
KR102278229B1 (ko) 전자기기 및 그 제어 방법
JP7005160B2 (ja) 電子機器及びその制御方法
JP2019191988A (ja) 電子機器、電子機器の制御方法、プログラム、及び、記憶媒体
WO2019102885A1 (fr) Dispositif électronique avec section d'affichage d'image modifiable
US11036287B2 (en) Electronic device, control method for electronic device, and non-transitory computer readable medium
JP2019096305A (ja) 電子機器およびその制御方法およびプログラムおよび記録媒体
US12032754B2 (en) Information processing apparatus, information processing method, and non-transitory computer readable medium
US10937217B2 (en) Electronic device and control method thereof for generating edited VR content
US12436660B2 (en) Information processing apparatus, program, and method
JP6542451B2 (ja) 電子機器
US20200033959A1 (en) Electronic apparatus, computer-readable non-transitory recording medium, and display control method
CN115209203A (zh) 电子装置、电子装置的控制方法以及存储介质
JP6408641B2 (ja) 電子機器
US20230254555A1 (en) Electronic apparatus, control method therefor, and computer-readable storage medium storing program
JP7289208B2 (ja) プログラム、情報処理装置、および方法
JP6377307B2 (ja) ユーザーインターフェース制御装置及びユーザーインターフェース制御方法
CN120215860A (zh) 一种显示方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18880790

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18880790

Country of ref document: EP

Kind code of ref document: A1