US20130050249A1 - Selective rendering of off-screen content - Google Patents
Selective rendering of off-screen content Download PDFInfo
- Publication number
- US20130050249A1 US20130050249A1 US13/223,272 US201113223272A US2013050249A1 US 20130050249 A1 US20130050249 A1 US 20130050249A1 US 201113223272 A US201113223272 A US 201113223272A US 2013050249 A1 US2013050249 A1 US 2013050249A1
- Authority
- US
- United States
- Prior art keywords
- screen
- content
- rendering
- viewport
- displayable portion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/20—Perspective computation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/10—Geometric effects
- G06T15/40—Hidden part removal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
- G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/34—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling
- G09G5/346—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators for rolling or scrolling for systems having a bit-mapped display memory
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/393—Arrangements for updating the contents of the bit-mapped memory
Definitions
- the present disclosure generally relates to the transmission of data over a network, and more particularly to the use of a computing device to view data communicated over a network.
- Mobile devices are particularly constrained by display size.
- web browsers for mobile devices often display only a portion of a web page within their limited device screen space (“viewport”).
- the dimensions of the viewport are determined based on the web browser's determination of screen space (e.g., pixels) available to display the web page.
- screen space e.g., pixels
- a computer-implemented method for selectively pre-rendering off-screen content for display before the content comes on-screen on a device includes receiving a request to display content on a device and dividing the content into a first displayable portion that is based on a size of a viewport of the device and a second displayable portion that is outside the viewport. The method also includes rendering and displaying the first displayable portion of content within the viewport, and selecting a subset of the second displayable portion of content for rendering off-screen based on a predetermined rule.
- a system for selectively pre-rendering off-screen content for display before the content comes on-screen on a device includes a memory comprising content for display, and a processor.
- the processor is configured to receive a request to display content on a device and divide the content into a first displayable portion that is based on a size of a viewport of the device and a second displayable portion that is outside the viewport.
- the processor is also configured to render and display the first displayable portion of content within the viewport, and select a subset of the second displayable portion of content for rendering off-screen based on a predetermined rule, wherein the predetermined rule is based on at least one of the content, a viewing history of a user, and a proximity of the subset of the second displayable portion to the viewport.
- a web browser that selectively pre-renders off-screen content for display before the content comes on-screen on a device.
- the web browser includes a display area, based on the size of a viewport of the device, configured to display content on the device.
- the content is divided into a first displayable portion that is based on a size of the display area and a second displayable portion that is outside the display area.
- the first displayable portion of content is rendered and displayed within the display area, and a subset of the second displayable portion of content for rendering off-screen is selected based on a predetermined rule.
- the predetermined rule is based on at least one of the content, a viewing history of a user, and a proximity of the subset of the second displayable portion to the viewport.
- the first displayable portion and the second displayable portion are each divided into equally sized tiles.
- a machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for selectively pre-rendering off-screen content for display before the content comes on-screen on a device.
- the method includes receiving a request to display content on a device, dividing the content into equally sized tiles, and rendering and displaying tiles located within a viewport of the device.
- the method also includes selecting a subset of the remaining tiles for rendering off-screen based on at least one of the content of a tile, a viewing history of a user, and a proximity of the tile to the viewport.
- FIG. 1 illustrates an exemplary architecture for selectively pre-rendering off-screen content for display before the content comes on-screen on a device.
- FIG. 2 is a block diagram illustrating an exemplary client and server from the architecture of FIG. 1 according to certain aspects of the disclosure.
- FIG. 3 illustrates an exemplary process for selectively pre-rendering off-screen content for display before the content comes on-screen using an exemplary client of FIG. 2 .
- FIG. 4 is an exemplary illustration, associated with the exemplary process of FIG. 3 , in which displayable content is divided into a first portion displayed within a viewport and a second portion outside the viewport that has a subset selectively pre-rendered off-screen.
- FIG. 5 is a block diagram illustrating an exemplary computer system with which the client of FIG. 2 can be implemented.
- the disclosed system divides a web page into tiles, and selectively renders tiles outside a device's viewport (“pre-rendering”) based on a likelihood that a user will later scroll left right, up, or down to view those tiles within the viewport.
- pre-rendering a device's viewport
- the tiles outside the viewport can be selected and prioritized for pre-rendering based on their proximity to the viewport, the user's past scrolling history, and the content of the web page. As a result, display latency of the web page content is reduced. If the user scrolls the viewport into an area containing tiles that have not been pre-rendered, then these tiles are rendered at that point in time.
- tiles below the viewport are pre-rendered before tiles above the viewport, and tiles to the right of the viewport are pre-rendered before tiles outside to the left of the viewport.
- Tiles that are closer to the viewport are pre-rendered before tiles that are farther away from the viewport.
- Tiles vertically outside (e.g., above or below) the viewport are pre-rendered before tiles horizontally outside (e.g., to the right or left) the viewport, because, for example, a user is more likely to browse downward than to the side.
- Tiles that are diagonally outside the viewport may be rendered last.
- tiles below the viewport are pre-rendered before tiles above the viewport. If the user is reading a script that reads from right to left, such as Arabic, then content to the left of the viewport is pre-rendered before content to the right of the viewport.
- FIG. 1 illustrates an exemplary architecture 100 for selectively pre-rendering off-screen content for display before the content comes on-screen on a device.
- the architecture 100 includes servers 130 and clients 110 connected over a network 150 .
- Each of the clients 130 is configured to download, install, and run a web browser as disclosed herein.
- the web browser is configured to run on clients 130 that are mobile or non-mobile.
- the clients 110 can be, for example, desktop computers, laptop computers, mobile devices (e.g., a smartphone, tablet computer, or PDA), set top boxes (e.g., for a television), video game consoles, or any other devices having appropriate processor, memory, and communications capabilities.
- mobile devices e.g., a smartphone, tablet computer, or PDA
- set top boxes e.g., for a television
- video game consoles e.g., for a television
- certain advantages of the web browser such as increased web page display time in response to a scroll, are most salient on clients 110 that are mobile devices or that otherwise have slower processing speeds.
- the web browser can be downloaded over the network 150 from one of the many servers 130 .
- multiple servers 130 can also host the data for downloading the web browser.
- different versions and/or configurations of the web browser that include the features disclosed herein are available for download from a server 130 and subsequent installation depending on whether the client 130 is a mobile device or non-mobile device.
- the web browser once installed on a client 130 , is configured to load web pages from any one or multiple client servers 130 hosting the web pages.
- the servers 130 can be any device having an appropriate processor, memory, and communications capability for hosting the data for installing the web browser and for hosting the web pages.
- the network 150 can include, for example, any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Further, the network 150 can include, but is not limited to, any one or more of the following network topologies, including a bus network, a star network, a ring network, a mesh network, a star-bus network, tree or hierarchical network, and the like.
- PAN personal area network
- LAN local area network
- CAN campus area network
- MAN metropolitan area network
- WAN wide area network
- BBN broadband network
- the Internet and the like.
- the network 150 can include, but is not limited to, any one or more of the following network topologies, including a bus network, a star network, a ring network, a mesh network, a star-bus network, tree or hierarchical network, and the like.
- the disclosed web browser once downloaded from a server 130 and installed and executed on a client 130 , is configured to display a downloaded web page in a web browser.
- the web page is divided by the web browser into equally sized tiles organized by whether those tiles appear within the viewport of the client 130 or outside of the viewport of the client 130 (e.g., when the height or width of the web page at a certain zoom level exceeds the height or width of the viewport).
- Tiles of the web page within the viewport are rendered and displayed within the viewport for the user.
- a limited subset of the remaining tiles e.g., the tiles outside the viewport
- are selected for pre-rendering so that they are ready to be displayed if the user scrolls the web page to have them appear within the viewport.
- the subset of the remaining tiles designated for pre-rendering are selected based on, for example, the proximity of the tiles to the viewport, the user's past scrolling history (e.g., immediate past or over time), and the content of the web page (e.g., the text in the web page reads from right to left).
- FIG. 2 is a block diagram 200 illustrating an exemplary server 130 and client 110 in the architecture 100 of FIG. 1 according to certain aspects of the disclosure.
- the client and the server 130 are connected over the network 150 via respective communications modules 218 and 238 .
- the communications modules 218 and 238 are configured to interface with the network 150 to send and receive information, such as data, requests, responses, and commands to other devices on the network.
- the communications modules 218 and 238 can be, for example, modems or Ethernet cards.
- the client 110 includes a processor 212 , the communications module 218 , and a memory 220 that includes a web browser 222 and a client copy of a web page 224 b (or other displayable content) to display in the web browser 222 using the output device 214 (e.g., a display) of the client 110 .
- the client copy of the web page 224 b is received from the server 130 over the network 150 using respective communications modules 218 and 238 of the client 110 and server 130 .
- the server 130 provides a copy of a web page 224 a in memory 232 to the client 110 in response to a request from the client 110 .
- the client 110 also includes an input device 216 , such as a keyboard, touchscreen, or mouse, to receive user scroll/viewing inputs.
- the processor 212 of the client 110 is configured to execute instructions, such as instructions physically coded into the processor 212 , instructions received from software in memory 240 , or a combination of both.
- the processor 212 of the client 110 executes instructions from the web browser 222 to receive a request to display content, such as the web page 224 b , and divide the content into a first displayable portion that is based on a size of a viewport of the client 110 and a second displayable portion that is outside the viewport.
- the displayable portions can each be divided into equally sized tiles of arbitrary length.
- the first displayable portion e.g., the portion within the viewport
- the first displayable portion can be divided into a two by three row of tiles, with each tile being 240 pixels in width and 267 pixels in height.
- the processor 212 renders (e.g., prepares for display) and displays the first displayable portion of the web page 224 b within the viewport.
- the processor 212 is also configured to select a subset of the second displayable portion of the web page 224 b , i.e., the displayable portion of the web page 224 b that is outside the viewport, for rendering off-screen based on a predetermined rule, and render off-screen the selected subset of the second displayable portion of content.
- the predetermined rule can include one or many constraints for determining which off-screen tiles to select for pre-rendering and the order in which the selected off-screen tiles will be pre-rendered.
- the predetermined rule can be based on the content of the web page 224 b , a viewing history of a user, and/or a proximity of the subset of the second displayable portion to the viewport.
- the processor 212 can, for example, select a tile located off-screen below the viewport for rendering off-screen before selecting a tile located off-screen above the viewport for rendering off-screen, and select a tile located off-screen to the right of the viewport for rendering off-screen before selecting a tile located off-screen to the left of the viewport for rendering off-screen.
- the processor 212 can thus selecting a tile located off-screen in the reading direction of the content for rendering off-screen before a tile located off-screen in the direction opposite of the reading direction of the content.
- the processor 212 can also select a first tile located off-screen for rendering off-screen that is closer to the viewport before selecting a second tile located off-screen for rendering off-screen that is farther from the viewport than the first tile. This is advantageous because a user tends to scroll off screen to content that is closer off screen to the content the user is viewing that content that is farther away from the content the user is viewing.
- the processor 212 can select a tile located off-screen in the direction of the last scrolling input by the user for rendering off-screen before a tile located off-screen in the direction opposite of the direction of the last scrolling input by the user. This is advantageous because a user tends to continue scrolling in a single direction when viewing content.
- the processor 212 can also predict the scrolling velocity of the user to determine the predicted scrolling target of a user's next scroll, and render tiles associated with the target content accordingly. For example, if a user has been scrolling very rapidly to target content substantially far away from the viewport, then the processor 212 can predict the next target content substantially far away from the viewport and render tiles for that content off-screen in advance.
- the number of tiles that are pre-rendered can be limited based on the amount of memory, processing capacity, and battery power available to the client 110 . For example, if the memory limit allows a total of six tiles to be rendered off-screen, than four tiles below the viewport and two tiles above the viewport can be selected for rendering off-screen. Similarly, if the memory limit, processing capacity, and battery power allow a large number of tiles to be rendered off-screen, then two or more tiles outside of the viewport in any direction (e.g., above, below, to the left, to the right, and in diagonal directions) can be rendered off-screen.
- FIG. 3 illustrates an exemplary process 300 using the exemplary client 110 of FIG. 2 for selectively pre-rendering off-screen content for display before the content comes on-screen.
- the process 300 begins by proceeding from step 301 when a user loads an application, such as a web browser 222 on the client 110 , which has content, such as a downloaded web page 224 b , available for display.
- an application such as a web browser 222 on the client 110
- content such as a downloaded web page 224 b
- step 302 a request to display the content on the client 110 is received.
- the content is divided into a first displayable portion that is based on a size of a viewport of the device, and a second displayable portion that is outside the viewport.
- the first displayable portion of content is rendered and displayed within the viewport in step 304 , and in step 305 a subset of the second displayable portion of content is selected for rendering off-screen based on a predetermined rule. Finally, in step 306 , the selected subset of the second displayable portion of content is rendered off-screen, and the process 300 ends in step 307 .
- FIG. 3 set forth an exemplary process 300 for selectively pre-rendering off-screen content for display before the content comes on-screen using the exemplary client 110 of FIG. 2 .
- An example will now be described using the exemplary process 300 of FIG. 3 , a smartphone client 110 having a small viewport, a mobile web browser 222 , and client copy of a web page 224 b.
- the process 300 begins by proceeding from step 301 when a user loads a mobile web browser 222 on the user's smartphone 110 .
- the mobile web browser 222 has downloaded a web page 224 b that the user wishes to view.
- the user requests to display the web page 224 b in the mobile web browser 222 .
- the mobile web browser 222 divides the web page 224 b into a first displayable portion that is based on a size of a viewport of the smartphone 110 , and a second displayable portion that is outside the viewport of the smartphone 110 .
- each of the first and second displayable portions is divided into equally sized tiles, as illustrated in FIG. 4 , an exemplary illustration of the web page 224 b .
- the tiles from the first displayable portion of content namely tiles 404 , 406 , 408 , 410 , 412 , and 414 are rendered and displayed within the viewport 402 in step 304 .
- a subset of the second displayable portion of content is selected according to the following constraints.
- Tiles of the web page 224 b located off-screen below the viewport 402 namely tiles 420 and 422 , are selected for rendering off-screen before tiles located off-screen above the viewport 402 , namely tiles 416 and 418 , are selected for rendering off-screen.
- tiles located off-screen to the right of the viewport 402 namely tiles 424 , 426 , and 428 , are selected for rendering off-screen before tiles located off-screen to the left of the viewport 402 , namely 430 , 432 , and 434 , are selected for rendering off-screen.
- step 306 the selected subset of tiles, namely tiles 416 to 438 , is rendered off-screen, and the process 300 ends in step 307 .
- FIG. 5 is a block diagram illustrating an exemplary computer system 500 with which the client 110 and server 130 of FIG. 2 can be implemented.
- the computer system 500 may be implemented using hardware or a combination of software and hardware, either in a dedicated server, or integrated into another entity, or distributed across multiple entities.
- Computer system 500 (e.g., client 110 and server 130 ) includes a bus 508 or other communication mechanism for communicating information, and a processor 502 (e.g., processor 212 and 236 ) coupled with bus 508 for processing information.
- processor 502 e.g., processor 212 and 236
- the computer system 500 may be implemented with one or more processors 502 .
- Processor 502 may be a general-purpose microprocessor, a microcontroller, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a state machine, gated logic, discrete hardware components, or any other suitable entity that can perform calculations or other manipulations of information.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field Programmable Gate Array
- PLD Programmable Logic Device
- Computer system 500 can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them stored in an included memory 504 (e.g., memory 220 and 232 ), such as a Random Access Memory (RAM), a flash memory, a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable PROM (EPROM), registers, a hard disk, a removable disk, a CD-ROM, a DVD, or any other suitable storage device, coupled to bus 508 for storing information and instructions to be executed by processor 502 .
- the processor 502 and the memory 504 can be supplemented by, or incorporated in, special purpose logic circuitry.
- the instructions may be stored in the memory 504 and implemented in one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer readable medium for execution by, or to control the operation of, the computer system 500 , and according to any method well known to those of skill in the art, including, but not limited to, computer languages such as data-oriented languages (e.g., SQL, dBase), system languages (e.g., C, Objective-C, C++, Assembly), architectural languages (e.g., Java, .NET), and application languages (e.g., PHP, Ruby, Perl, Python).
- data-oriented languages e.g., SQL, dBase
- system languages e.g., C, Objective-C, C++, Assembly
- architectural languages e.g., Java, .NET
- application languages e.g., PHP, Ruby, Perl, Python.
- Instructions may also be implemented in computer languages such as array languages, aspect-oriented languages, assembly languages, authoring languages, command line interface languages, compiled languages, concurrent languages, curly-bracket languages, dataflow languages, data-structured languages, declarative languages, esoteric languages, extension languages, fourth-generation languages, functional languages, interactive mode languages, interpreted languages, iterative languages, list-based languages, little languages, logic-based languages, machine languages, macro languages, metaprogramming languages, multiparadigm languages, numerical analysis, non-English-based languages, object-oriented class-based languages, object-oriented prototype-based languages, off-side rule languages, procedural languages, reflective languages, rule-based languages, scripting languages, stack-based languages, synchronous languages, syntax handling languages, visual languages, wirth languages, and xml-based languages.
- Memory 504 may also be used for storing temporary variable or other intermediate information during execution of instructions to be executed by processor 502 .
- a computer program as discussed herein does not necessarily correspond to a file in a file system.
- a program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, subprograms, or portions of code).
- a computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network.
- the processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.
- Computer system 500 further includes a data storage device 506 such as a magnetic disk or optical disk, coupled to bus 508 for storing information and instructions.
- Computer system 500 may be coupled via input/output module 510 to various devices.
- the input/output module 510 can be any input/output module.
- Exemplary input/output modules 510 include data ports such as USB ports.
- the input/output module 510 is configured to connect to a communications module 512 .
- Exemplary communications modules 512 e.g., communications modules 218 and 238
- networking interface cards such as Ethernet cards and modems.
- the input/output module 510 is configured to connect to a plurality of devices, such as an input device 514 (e.g., input device 216 ) and/or an output device 516 (e.g., output device 214 ).
- exemplary input devices 514 include a keyboard and a pointing device, e.g., a mouse or a trackball, by which a user can provide input to the computer system 500 .
- Other kinds of input devices 514 can be used to provide for interaction with a user as well, such as a tactile input device, visual input device, audio input device, or brain-computer interface device.
- feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, tactile, or brain wave input.
- exemplary output devices 516 include display devices, such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user.
- the client 110 and server 130 can be implemented using a computer system 500 in response to processor 502 executing one or more sequences of one or more instructions contained in memory 504 .
- Such instructions may be read into memory 504 from another machine-readable medium, such as data storage device 506 .
- Execution of the sequences of instructions contained in main memory 504 causes processor 502 to perform the process steps described herein.
- processors in a multi-processing arrangement may also be employed to execute the sequences of instructions contained in memory 504 .
- hard-wired circuitry may be used in place of or in combination with software instructions to implement various aspects of the present disclosure.
- aspects of the present disclosure are not limited to any specific combination of hardware circuitry and software.
- a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back end, middleware, or front end components.
- the components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network.
- the communication network can include, for example, any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like.
- PAN personal area network
- LAN local area network
- CAN campus area network
- MAN metropolitan area network
- WAN wide area network
- BBN broadband network
- the communication network can include, but is not limited to, for example, any one or more of the following network topologies, including a bus network, a star network, a ring network, a mesh network, a star-bus network, tree or hierarchical network, or the like.
- the communications modules can be, for example, modems or Ethernet cards.
- Computing system 500 can include clients and servers.
- a client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
- Computer system 500 can be, for example, and without limitation, a desktop computer, laptop computer, or tablet computer.
- Computer system 500 can also be embedded in another device, for example, and without limitation, a mobile telephone, a personal digital assistant (PDA), a mobile audio player, a Global Positioning System (GPS) receiver, a video game console, and/or a television set top box.
- PDA personal digital assistant
- GPS Global Positioning System
- machine-readable storage medium or “computer readable medium” as used herein refers to any medium or media that participates in providing instructions to processor 502 for execution. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, and transmission media.
- Non-volatile media include, for example, optical or magnetic disks, such as data storage device 506 .
- Volatile media include dynamic memory, such as memory 504 .
- Transmission media include coaxial cables, copper wire, and fiber optics, including the wires that comprise bus 508 .
- machine-readable media include, for example, floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH EPROM, any other memory chip or cartridge, or any other medium from which a computer can read.
- the machine-readable storage medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them.
- An application obtains content to display on a device.
- the space required to display the entire content exceeds the space provided by the viewport of the device.
- the application pre-renders a subset of the content that appears off-screen in advance of that content appearing on screen in order to save loading time for the user.
- the subset of the content is selected for pre-rendering based on certain constraints, such as what the content is, the proximity of the subset of the off-screen content to the viewport, and the user's viewing history.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Computer Graphics (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Information Transfer Between Computers (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- 1. Field
- The present disclosure generally relates to the transmission of data over a network, and more particularly to the use of a computing device to view data communicated over a network.
- 2. Description of the Related Art
- Mobile devices are particularly constrained by display size. As a result, web browsers for mobile devices often display only a portion of a web page within their limited device screen space (“viewport”). The dimensions of the viewport are determined based on the web browser's determination of screen space (e.g., pixels) available to display the web page. A user must scroll to read content for the web page that is not displayed within the viewport.
- Two approaches are commonly taken to rendering content outside the viewport: (1) content outside of the viewport is rendered when it comes within the viewport, or (2) all web page content, including content outside of the viewport, is rendered immediately when the web page is loaded by the web browser. Each approach has its drawbacks. If the content outside the viewport is rendered when it comes within the viewport, there may be a delay in rendering the content outside the viewport for display within the viewport, and as a result the user may see a blank screen or a part of a blank screen. If all of the content outside the viewport is rendered when the web page is loaded, it may cause unnecessary delay and result in inefficient use of battery power, processing capacity, and memory, especially if the user does not view the content outside viewport.
- According to one embodiment of the disclosure, a computer-implemented method for selectively pre-rendering off-screen content for display before the content comes on-screen on a device is provided. The method includes receiving a request to display content on a device and dividing the content into a first displayable portion that is based on a size of a viewport of the device and a second displayable portion that is outside the viewport. The method also includes rendering and displaying the first displayable portion of content within the viewport, and selecting a subset of the second displayable portion of content for rendering off-screen based on a predetermined rule.
- According to another embodiment of the disclosure, a system for selectively pre-rendering off-screen content for display before the content comes on-screen on a device is provided. The system includes a memory comprising content for display, and a processor. The processor is configured to receive a request to display content on a device and divide the content into a first displayable portion that is based on a size of a viewport of the device and a second displayable portion that is outside the viewport. The processor is also configured to render and display the first displayable portion of content within the viewport, and select a subset of the second displayable portion of content for rendering off-screen based on a predetermined rule, wherein the predetermined rule is based on at least one of the content, a viewing history of a user, and a proximity of the subset of the second displayable portion to the viewport.
- According to a further embodiment of the disclosure, a web browser that selectively pre-renders off-screen content for display before the content comes on-screen on a device is provided. The web browser includes a display area, based on the size of a viewport of the device, configured to display content on the device. The content is divided into a first displayable portion that is based on a size of the display area and a second displayable portion that is outside the display area. The first displayable portion of content is rendered and displayed within the display area, and a subset of the second displayable portion of content for rendering off-screen is selected based on a predetermined rule. The predetermined rule is based on at least one of the content, a viewing history of a user, and a proximity of the subset of the second displayable portion to the viewport. The first displayable portion and the second displayable portion are each divided into equally sized tiles.
- According to yet a further embodiment of the disclosure, a machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for selectively pre-rendering off-screen content for display before the content comes on-screen on a device is provided. The method includes receiving a request to display content on a device, dividing the content into equally sized tiles, and rendering and displaying tiles located within a viewport of the device. The method also includes selecting a subset of the remaining tiles for rendering off-screen based on at least one of the content of a tile, a viewing history of a user, and a proximity of the tile to the viewport.
- The accompanying drawings, which are included to provide further understanding and are incorporated in and constitute a part of this specification, illustrate disclosed embodiments and together with the description serve to explain the principles of the disclosed embodiments. In the drawings:
-
FIG. 1 illustrates an exemplary architecture for selectively pre-rendering off-screen content for display before the content comes on-screen on a device. -
FIG. 2 is a block diagram illustrating an exemplary client and server from the architecture ofFIG. 1 according to certain aspects of the disclosure. -
FIG. 3 illustrates an exemplary process for selectively pre-rendering off-screen content for display before the content comes on-screen using an exemplary client ofFIG. 2 . -
FIG. 4 is an exemplary illustration, associated with the exemplary process ofFIG. 3 , in which displayable content is divided into a first portion displayed within a viewport and a second portion outside the viewport that has a subset selectively pre-rendered off-screen. -
FIG. 5 is a block diagram illustrating an exemplary computer system with which the client ofFIG. 2 can be implemented. - In the following detailed description, numerous specific details are set forth to provide a full understanding of the present disclosure. It will be apparent, however, to one ordinarily skilled in the art that the embodiments of the present disclosure may be practiced without some of these specific details. In other instances, well-known structures and techniques have not been shown in detail so as not to obscure the disclosure.
- The disclosed system divides a web page into tiles, and selectively renders tiles outside a device's viewport (“pre-rendering”) based on a likelihood that a user will later scroll left right, up, or down to view those tiles within the viewport. The tiles outside the viewport can be selected and prioritized for pre-rendering based on their proximity to the viewport, the user's past scrolling history, and the content of the web page. As a result, display latency of the web page content is reduced. If the user scrolls the viewport into an area containing tiles that have not been pre-rendered, then these tiles are rendered at that point in time.
- For instance, tiles below the viewport are pre-rendered before tiles above the viewport, and tiles to the right of the viewport are pre-rendered before tiles outside to the left of the viewport. Tiles that are closer to the viewport are pre-rendered before tiles that are farther away from the viewport. Tiles vertically outside (e.g., above or below) the viewport are pre-rendered before tiles horizontally outside (e.g., to the right or left) the viewport, because, for example, a user is more likely to browse downward than to the side. Tiles that are diagonally outside the viewport may be rendered last.
- As another example, if the user has been scrolling downwards to view content below the viewport, tiles below the viewport are pre-rendered before tiles above the viewport. If the user is reading a script that reads from right to left, such as Arabic, then content to the left of the viewport is pre-rendered before content to the right of the viewport.
- While many examples are provided herein in the context of a web page, the principles of the present disclosure contemplate other types of displayable content as well. For example, word processing, mobile applications, graphic editing software, maps, and any other form of visual rendering are all considered within the scope of the present disclosure.
- Turning to the drawings,
FIG. 1 illustrates anexemplary architecture 100 for selectively pre-rendering off-screen content for display before the content comes on-screen on a device. Thearchitecture 100 includesservers 130 andclients 110 connected over anetwork 150. - Each of the
clients 130 is configured to download, install, and run a web browser as disclosed herein. The web browser is configured to run onclients 130 that are mobile or non-mobile. Theclients 110 can be, for example, desktop computers, laptop computers, mobile devices (e.g., a smartphone, tablet computer, or PDA), set top boxes (e.g., for a television), video game consoles, or any other devices having appropriate processor, memory, and communications capabilities. In certain aspects, certain advantages of the web browser, such as increased web page display time in response to a scroll, are most salient onclients 110 that are mobile devices or that otherwise have slower processing speeds. - The web browser can be downloaded over the
network 150 from one of themany servers 130. For purposes of load balancing,multiple servers 130 can also host the data for downloading the web browser. In certain instances, different versions and/or configurations of the web browser that include the features disclosed herein are available for download from aserver 130 and subsequent installation depending on whether theclient 130 is a mobile device or non-mobile device. The web browser, once installed on aclient 130, is configured to load web pages from any one ormultiple client servers 130 hosting the web pages. Theservers 130 can be any device having an appropriate processor, memory, and communications capability for hosting the data for installing the web browser and for hosting the web pages. Thenetwork 150 can include, for example, any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Further, thenetwork 150 can include, but is not limited to, any one or more of the following network topologies, including a bus network, a star network, a ring network, a mesh network, a star-bus network, tree or hierarchical network, and the like. - The disclosed web browser, once downloaded from a
server 130 and installed and executed on aclient 130, is configured to display a downloaded web page in a web browser. The web page is divided by the web browser into equally sized tiles organized by whether those tiles appear within the viewport of theclient 130 or outside of the viewport of the client 130 (e.g., when the height or width of the web page at a certain zoom level exceeds the height or width of the viewport). Tiles of the web page within the viewport are rendered and displayed within the viewport for the user. On the other hand, a limited subset of the remaining tiles (e.g., the tiles outside the viewport) are selected for pre-rendering so that they are ready to be displayed if the user scrolls the web page to have them appear within the viewport. The subset of the remaining tiles designated for pre-rendering are selected based on, for example, the proximity of the tiles to the viewport, the user's past scrolling history (e.g., immediate past or over time), and the content of the web page (e.g., the text in the web page reads from right to left). -
FIG. 2 is a block diagram 200 illustrating anexemplary server 130 andclient 110 in thearchitecture 100 ofFIG. 1 according to certain aspects of the disclosure. The client and theserver 130 are connected over thenetwork 150 via 218 and 238. Therespective communications modules 218 and 238 are configured to interface with thecommunications modules network 150 to send and receive information, such as data, requests, responses, and commands to other devices on the network. The 218 and 238 can be, for example, modems or Ethernet cards.communications modules - The
client 110 includes aprocessor 212, thecommunications module 218, and amemory 220 that includes aweb browser 222 and a client copy of aweb page 224 b (or other displayable content) to display in theweb browser 222 using the output device 214 (e.g., a display) of theclient 110. The client copy of theweb page 224 b is received from theserver 130 over thenetwork 150 using 218 and 238 of therespective communications modules client 110 andserver 130. Specifically, theserver 130 provides a copy of aweb page 224 a inmemory 232 to theclient 110 in response to a request from theclient 110. Theclient 110 also includes aninput device 216, such as a keyboard, touchscreen, or mouse, to receive user scroll/viewing inputs. - The
processor 212 of theclient 110 is configured to execute instructions, such as instructions physically coded into theprocessor 212, instructions received from software in memory 240, or a combination of both. For example, theprocessor 212 of theclient 110 executes instructions from theweb browser 222 to receive a request to display content, such as theweb page 224 b, and divide the content into a first displayable portion that is based on a size of a viewport of theclient 110 and a second displayable portion that is outside the viewport. The displayable portions can each be divided into equally sized tiles of arbitrary length. For example, if the viewport of the device is 480 pixels by 800 pixels, then the first displayable portion (e.g., the portion within the viewport) can be divided into a two by three row of tiles, with each tile being 240 pixels in width and 267 pixels in height. Theprocessor 212 renders (e.g., prepares for display) and displays the first displayable portion of theweb page 224 b within the viewport. - The
processor 212 is also configured to select a subset of the second displayable portion of theweb page 224 b, i.e., the displayable portion of theweb page 224 b that is outside the viewport, for rendering off-screen based on a predetermined rule, and render off-screen the selected subset of the second displayable portion of content. The predetermined rule can include one or many constraints for determining which off-screen tiles to select for pre-rendering and the order in which the selected off-screen tiles will be pre-rendered. The predetermined rule can be based on the content of theweb page 224 b, a viewing history of a user, and/or a proximity of the subset of the second displayable portion to the viewport. - A list of exemplary constraints for the predetermined rule will now be provided. The
processor 212 can, for example, select a tile located off-screen below the viewport for rendering off-screen before selecting a tile located off-screen above the viewport for rendering off-screen, and select a tile located off-screen to the right of the viewport for rendering off-screen before selecting a tile located off-screen to the left of the viewport for rendering off-screen. This is advantageous because a user tends to scroll to the right and downwards to view additional content due to the nature of the direction of content (e.g., English text reads from left to right, and a new line of English text proceeds from below a current line of text), thus it is more likely that a user will scroll theweb page 224 b right rather than left, and down rather than up. In certain aspects, theprocessor 212 can thus selecting a tile located off-screen in the reading direction of the content for rendering off-screen before a tile located off-screen in the direction opposite of the reading direction of the content. - The
processor 212 can also select a first tile located off-screen for rendering off-screen that is closer to the viewport before selecting a second tile located off-screen for rendering off-screen that is farther from the viewport than the first tile. This is advantageous because a user tends to scroll off screen to content that is closer off screen to the content the user is viewing that content that is farther away from the content the user is viewing. Similarly, theprocessor 212 can select a tile located off-screen in the direction of the last scrolling input by the user for rendering off-screen before a tile located off-screen in the direction opposite of the direction of the last scrolling input by the user. This is advantageous because a user tends to continue scrolling in a single direction when viewing content. Theprocessor 212 can also predict the scrolling velocity of the user to determine the predicted scrolling target of a user's next scroll, and render tiles associated with the target content accordingly. For example, if a user has been scrolling very rapidly to target content substantially far away from the viewport, then theprocessor 212 can predict the next target content substantially far away from the viewport and render tiles for that content off-screen in advance. - The number of tiles that are pre-rendered can be limited based on the amount of memory, processing capacity, and battery power available to the
client 110. For example, if the memory limit allows a total of six tiles to be rendered off-screen, than four tiles below the viewport and two tiles above the viewport can be selected for rendering off-screen. Similarly, if the memory limit, processing capacity, and battery power allow a large number of tiles to be rendered off-screen, then two or more tiles outside of the viewport in any direction (e.g., above, below, to the left, to the right, and in diagonal directions) can be rendered off-screen. -
FIG. 3 illustrates anexemplary process 300 using theexemplary client 110 ofFIG. 2 for selectively pre-rendering off-screen content for display before the content comes on-screen. Theprocess 300 begins by proceeding fromstep 301 when a user loads an application, such as aweb browser 222 on theclient 110, which has content, such as a downloadedweb page 224 b, available for display. Instep 302, a request to display the content on theclient 110 is received. Instep 303, the content is divided into a first displayable portion that is based on a size of a viewport of the device, and a second displayable portion that is outside the viewport. The first displayable portion of content is rendered and displayed within the viewport instep 304, and in step 305 a subset of the second displayable portion of content is selected for rendering off-screen based on a predetermined rule. Finally, instep 306, the selected subset of the second displayable portion of content is rendered off-screen, and theprocess 300 ends instep 307. -
FIG. 3 set forth anexemplary process 300 for selectively pre-rendering off-screen content for display before the content comes on-screen using theexemplary client 110 ofFIG. 2 . An example will now be described using theexemplary process 300 ofFIG. 3 , asmartphone client 110 having a small viewport, amobile web browser 222, and client copy of aweb page 224 b. - The
process 300 begins by proceeding fromstep 301 when a user loads amobile web browser 222 on the user'ssmartphone 110. Themobile web browser 222 has downloaded aweb page 224 b that the user wishes to view. Instep 302, the user requests to display theweb page 224 b in themobile web browser 222. Instep 303, themobile web browser 222 divides theweb page 224 b into a first displayable portion that is based on a size of a viewport of thesmartphone 110, and a second displayable portion that is outside the viewport of thesmartphone 110. Specifically, each of the first and second displayable portions is divided into equally sized tiles, as illustrated inFIG. 4 , an exemplary illustration of theweb page 224 b. The tiles from the first displayable portion of content, namely 404, 406, 408, 410, 412, and 414 are rendered and displayed within thetiles viewport 402 instep 304. - In
step 305, a subset of the second displayable portion of content is selected according to the following constraints. Tiles of theweb page 224 b located off-screen below theviewport 402, namely 420 and 422, are selected for rendering off-screen before tiles located off-screen above thetiles viewport 402, namely 416 and 418, are selected for rendering off-screen. Next, tiles located off-screen to the right of thetiles viewport 402, namely 424, 426, and 428, are selected for rendering off-screen before tiles located off-screen to the left of thetiles viewport 402, namely 430, 432, and 434, are selected for rendering off-screen. Because there is sufficient memory, processing capacity, and battery power remaining for the rendering of additional tiles off screen, additional tiles below theviewport 402, namely 436 and 438, are selected for rendering off-screen. Finally, intiles step 306, the selected subset of tiles, namelytiles 416 to 438, is rendered off-screen, and theprocess 300 ends instep 307. -
FIG. 5 is a block diagram illustrating anexemplary computer system 500 with which theclient 110 andserver 130 ofFIG. 2 can be implemented. In certain aspects, thecomputer system 500 may be implemented using hardware or a combination of software and hardware, either in a dedicated server, or integrated into another entity, or distributed across multiple entities. - Computer system 500 (e.g.,
client 110 and server 130) includes a bus 508 or other communication mechanism for communicating information, and a processor 502 (e.g.,processor 212 and 236) coupled with bus 508 for processing information. By way of example, thecomputer system 500 may be implemented with one ormore processors 502.Processor 502 may be a general-purpose microprocessor, a microcontroller, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a state machine, gated logic, discrete hardware components, or any other suitable entity that can perform calculations or other manipulations of information. -
Computer system 500 can include, in addition to hardware, code that creates an execution environment for the computer program in question, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them stored in an included memory 504 (e.g.,memory 220 and 232), such as a Random Access Memory (RAM), a flash memory, a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable PROM (EPROM), registers, a hard disk, a removable disk, a CD-ROM, a DVD, or any other suitable storage device, coupled to bus 508 for storing information and instructions to be executed byprocessor 502. Theprocessor 502 and thememory 504 can be supplemented by, or incorporated in, special purpose logic circuitry. - The instructions may be stored in the
memory 504 and implemented in one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer readable medium for execution by, or to control the operation of, thecomputer system 500, and according to any method well known to those of skill in the art, including, but not limited to, computer languages such as data-oriented languages (e.g., SQL, dBase), system languages (e.g., C, Objective-C, C++, Assembly), architectural languages (e.g., Java, .NET), and application languages (e.g., PHP, Ruby, Perl, Python). Instructions may also be implemented in computer languages such as array languages, aspect-oriented languages, assembly languages, authoring languages, command line interface languages, compiled languages, concurrent languages, curly-bracket languages, dataflow languages, data-structured languages, declarative languages, esoteric languages, extension languages, fourth-generation languages, functional languages, interactive mode languages, interpreted languages, iterative languages, list-based languages, little languages, logic-based languages, machine languages, macro languages, metaprogramming languages, multiparadigm languages, numerical analysis, non-English-based languages, object-oriented class-based languages, object-oriented prototype-based languages, off-side rule languages, procedural languages, reflective languages, rule-based languages, scripting languages, stack-based languages, synchronous languages, syntax handling languages, visual languages, wirth languages, and xml-based languages.Memory 504 may also be used for storing temporary variable or other intermediate information during execution of instructions to be executed byprocessor 502. - A computer program as discussed herein does not necessarily correspond to a file in a file system. A program can be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple coordinated files (e.g., files that store one or more modules, subprograms, or portions of code). A computer program can be deployed to be executed on one computer or on multiple computers that are located at one site or distributed across multiple sites and interconnected by a communication network. The processes and logic flows described in this specification can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.
-
Computer system 500 further includes adata storage device 506 such as a magnetic disk or optical disk, coupled to bus 508 for storing information and instructions.Computer system 500 may be coupled via input/output module 510 to various devices. The input/output module 510 can be any input/output module. Exemplary input/output modules 510 include data ports such as USB ports. The input/output module 510 is configured to connect to acommunications module 512. Exemplary communications modules 512 (e.g.,communications modules 218 and 238) include networking interface cards, such as Ethernet cards and modems. In certain aspects, the input/output module 510 is configured to connect to a plurality of devices, such as an input device 514 (e.g., input device 216) and/or an output device 516 (e.g., output device 214).Exemplary input devices 514 include a keyboard and a pointing device, e.g., a mouse or a trackball, by which a user can provide input to thecomputer system 500. Other kinds ofinput devices 514 can be used to provide for interaction with a user as well, such as a tactile input device, visual input device, audio input device, or brain-computer interface device. For example, feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback; and input from the user can be received in any form, including acoustic, speech, tactile, or brain wave input.Exemplary output devices 516 include display devices, such as a CRT (cathode ray tube) or LCD (liquid crystal display) monitor, for displaying information to the user. - According to one aspect of the present disclosure, the
client 110 andserver 130 can be implemented using acomputer system 500 in response toprocessor 502 executing one or more sequences of one or more instructions contained inmemory 504. Such instructions may be read intomemory 504 from another machine-readable medium, such asdata storage device 506. Execution of the sequences of instructions contained inmain memory 504 causesprocessor 502 to perform the process steps described herein. One or more processors in a multi-processing arrangement may also be employed to execute the sequences of instructions contained inmemory 504. In alternative aspects, hard-wired circuitry may be used in place of or in combination with software instructions to implement various aspects of the present disclosure. Thus, aspects of the present disclosure are not limited to any specific combination of hardware circuitry and software. - Various aspects of the subject matter described in this specification can be implemented in a computing system that includes a back end component, e.g., as a data server, or that includes a middleware component, e.g., an application server, or that includes a front end component, e.g., a client computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the subject matter described in this specification, or any combination of one or more such back end, middleware, or front end components. The components of the system can be interconnected by any form or medium of digital data communication, e.g., a communication network. The communication network (e.g., network 150) can include, for example, any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Further, the communication network can include, but is not limited to, for example, any one or more of the following network topologies, including a bus network, a star network, a ring network, a mesh network, a star-bus network, tree or hierarchical network, or the like. The communications modules can be, for example, modems or Ethernet cards.
-
Computing system 500 can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.Computer system 500 can be, for example, and without limitation, a desktop computer, laptop computer, or tablet computer.Computer system 500 can also be embedded in another device, for example, and without limitation, a mobile telephone, a personal digital assistant (PDA), a mobile audio player, a Global Positioning System (GPS) receiver, a video game console, and/or a television set top box. - The term “machine-readable storage medium” or “computer readable medium” as used herein refers to any medium or media that participates in providing instructions to
processor 502 for execution. Such a medium may take many forms, including, but not limited to, non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, optical or magnetic disks, such asdata storage device 506. Volatile media include dynamic memory, such asmemory 504. Transmission media include coaxial cables, copper wire, and fiber optics, including the wires that comprise bus 508. Common forms of machine-readable media include, for example, floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH EPROM, any other memory chip or cartridge, or any other medium from which a computer can read. The machine-readable storage medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter effecting a machine-readable propagated signal, or a combination of one or more of them. - Systems, methods, applications, and machine-readable storage media for selectively pre-rendering off-screen content for display before the content comes on-screen on a device have been described. An application obtains content to display on a device. The space required to display the entire content, however, exceeds the space provided by the viewport of the device. The application pre-renders a subset of the content that appears off-screen in advance of that content appearing on screen in order to save loading time for the user. The subset of the content is selected for pre-rendering based on certain constraints, such as what the content is, the proximity of the subset of the off-screen content to the viewport, and the user's viewing history.
- While this specification contains many specifics, these should not be construed as limitations on the scope of what may be claimed, but rather as descriptions of particular implementations of the subject matter. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
- Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the aspects described above should not be understood as requiring such separation in all aspects, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
- The subject matter of this specification has been described in terms of particular aspects, but other aspects can be implemented and are within the scope of the following claims. For example, the actions recited in the claims can be performed in a different order and still achieve desirable results. As one example, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous. Other variations are within the scope of the following claims.
- These and other implementations are within the scope of the following claims.
Claims (23)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/223,272 US8384726B1 (en) | 2011-08-31 | 2011-08-31 | Selective rendering of off-screen content |
| US13/245,667 US8314809B1 (en) | 2011-08-31 | 2011-09-26 | Selective rendering of off-screen content |
| DE202011108505U DE202011108505U1 (en) | 2011-08-31 | 2011-11-30 | Computer system for selectively pre-rendering an off-screen content |
| AU2011101579A AU2011101579B4 (en) | 2011-08-31 | 2011-11-30 | Selective rendering of off-screen content |
| NL2008222A NL2008222C2 (en) | 2011-08-31 | 2012-02-03 | Selective rendering of off-screen content. |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/223,272 US8384726B1 (en) | 2011-08-31 | 2011-08-31 | Selective rendering of off-screen content |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/245,667 Continuation US8314809B1 (en) | 2011-08-31 | 2011-09-26 | Selective rendering of off-screen content |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US8384726B1 US8384726B1 (en) | 2013-02-26 |
| US20130050249A1 true US20130050249A1 (en) | 2013-02-28 |
Family
ID=45841598
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/223,272 Active US8384726B1 (en) | 2011-08-31 | 2011-08-31 | Selective rendering of off-screen content |
| US13/245,667 Active US8314809B1 (en) | 2011-08-31 | 2011-09-26 | Selective rendering of off-screen content |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/245,667 Active US8314809B1 (en) | 2011-08-31 | 2011-09-26 | Selective rendering of off-screen content |
Country Status (4)
| Country | Link |
|---|---|
| US (2) | US8384726B1 (en) |
| AU (1) | AU2011101579B4 (en) |
| DE (1) | DE202011108505U1 (en) |
| NL (1) | NL2008222C2 (en) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130033523A1 (en) * | 2011-08-04 | 2013-02-07 | Research In Motion Limited | Orientation-dependent processing of input files by an electronic device |
| US20130208012A1 (en) * | 2012-02-15 | 2013-08-15 | Cenk Ergan | Speculative Render Ahead and Caching in Multiple Passes |
| US20140164985A1 (en) * | 2012-12-12 | 2014-06-12 | Adobe Systems Incorporated | Predictive Directional Content Queue |
| US20140189487A1 (en) * | 2012-12-27 | 2014-07-03 | Qualcomm Innovation Center, Inc. | Predictive web page rendering using a scroll vector |
| US9177533B2 (en) | 2012-05-31 | 2015-11-03 | Microsoft Technology Licensing, Llc | Virtual surface compaction |
| US9230517B2 (en) | 2012-05-31 | 2016-01-05 | Microsoft Technology Licensing, Llc | Virtual surface gutters |
| US9235925B2 (en) | 2012-05-31 | 2016-01-12 | Microsoft Technology Licensing, Llc | Virtual surface rendering |
| US9286122B2 (en) | 2012-05-31 | 2016-03-15 | Microsoft Technology Licensing, Llc | Display techniques using virtual surface allocation |
| US9307007B2 (en) | 2013-06-14 | 2016-04-05 | Microsoft Technology Licensing, Llc | Content pre-render and pre-fetch techniques |
| US20160124598A1 (en) * | 2013-05-29 | 2016-05-05 | Rakuten, Inc. | Information processing apparatus, information processing method, and information processing program |
| US9575998B2 (en) | 2012-12-12 | 2017-02-21 | Adobe Systems Incorporated | Adaptive presentation of content based on user action |
| US9720888B1 (en) | 2014-05-22 | 2017-08-01 | Amazon Technologies, Inc. | Distributed browsing architecture for the delivery of graphics commands to user devices for assembling a plurality of layers of a content page |
| US20180052943A1 (en) * | 2016-08-18 | 2018-02-22 | Qualcomm Incorporated | Systems and methods for controlling webpage pre-rendering |
| US9922007B1 (en) | 2014-05-22 | 2018-03-20 | Amazon Technologies, Inc. | Split browser architecture capable of determining whether to combine or split content layers based on the encoding of content within each layer |
| US20180088744A1 (en) * | 2016-09-26 | 2018-03-29 | Wp Company Llc | Method and system for delivering real-time content |
| US10031891B2 (en) | 2012-11-14 | 2018-07-24 | Amazon Technologies Inc. | Delivery and display of page previews during page retrieval events |
| US10042521B1 (en) | 2014-05-22 | 2018-08-07 | Amazon Technologies, Inc. | Emulation of control resources for use with converted content pages |
| US10248633B2 (en) | 2014-06-17 | 2019-04-02 | Amazon Technologies, Inc. | Content browser system using multiple layers of graphics commands |
| US10379593B2 (en) * | 2015-10-23 | 2019-08-13 | Samsung Electronics Co., Ltd. | Image displaying apparatus and method of operating the same |
| US20200050428A1 (en) * | 2012-02-03 | 2020-02-13 | Sony Corporation | Information processing device, information processing method, and program |
| US10600091B2 (en) * | 2016-05-05 | 2020-03-24 | Predict Interactive, Inc. | Systems and methods for view-based advertisement selection |
| US11169666B1 (en) | 2014-05-22 | 2021-11-09 | Amazon Technologies, Inc. | Distributed content browsing system using transferred hardware-independent graphics commands |
| US20220050975A1 (en) * | 2019-04-30 | 2022-02-17 | Huawei Technologies Co., Ltd. | Content Translation Method and Terminal |
Families Citing this family (95)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8225231B2 (en) | 2005-08-30 | 2012-07-17 | Microsoft Corporation | Aggregation of PC settings |
| US20120159395A1 (en) | 2010-12-20 | 2012-06-21 | Microsoft Corporation | Application-launching interface for multiple modes |
| US8612874B2 (en) | 2010-12-23 | 2013-12-17 | Microsoft Corporation | Presenting an application change through a tile |
| US8689123B2 (en) | 2010-12-23 | 2014-04-01 | Microsoft Corporation | Application reporting in an application-selectable user interface |
| US9423951B2 (en) | 2010-12-31 | 2016-08-23 | Microsoft Technology Licensing, Llc | Content-based snap point |
| US9383917B2 (en) | 2011-03-28 | 2016-07-05 | Microsoft Technology Licensing, Llc | Predictive tiling |
| US9104307B2 (en) | 2011-05-27 | 2015-08-11 | Microsoft Technology Licensing, Llc | Multi-application environment |
| US9658766B2 (en) | 2011-05-27 | 2017-05-23 | Microsoft Technology Licensing, Llc | Edge gesture |
| US20120304132A1 (en) | 2011-05-27 | 2012-11-29 | Chaitanya Dev Sareen | Switching back to a previously-interacted-with application |
| US8893033B2 (en) | 2011-05-27 | 2014-11-18 | Microsoft Corporation | Application notifications |
| US9158445B2 (en) | 2011-05-27 | 2015-10-13 | Microsoft Technology Licensing, Llc | Managing an immersive interface in a multi-application immersive environment |
| US9104440B2 (en) | 2011-05-27 | 2015-08-11 | Microsoft Technology Licensing, Llc | Multi-application environment |
| US20130057587A1 (en) | 2011-09-01 | 2013-03-07 | Microsoft Corporation | Arranging tiles |
| US8922575B2 (en) | 2011-09-09 | 2014-12-30 | Microsoft Corporation | Tile cache |
| US10353566B2 (en) | 2011-09-09 | 2019-07-16 | Microsoft Technology Licensing, Llc | Semantic zoom animations |
| US9557909B2 (en) | 2011-09-09 | 2017-01-31 | Microsoft Technology Licensing, Llc | Semantic zoom linguistic helpers |
| US9244802B2 (en) | 2011-09-10 | 2016-01-26 | Microsoft Technology Licensing, Llc | Resource user interface |
| US9146670B2 (en) | 2011-09-10 | 2015-09-29 | Microsoft Technology Licensing, Llc | Progressively indicating new content in an application-selectable user interface |
| US8933952B2 (en) * | 2011-09-10 | 2015-01-13 | Microsoft Corporation | Pre-rendering new content for an application-selectable user interface |
| US9043722B1 (en) | 2012-06-19 | 2015-05-26 | Surfwax, Inc. | User interfaces for displaying relationships between cells in a grid |
| US9123030B2 (en) | 2012-07-30 | 2015-09-01 | Sap Se | Indication of off-screen calendar objects |
| US9658672B2 (en) | 2012-07-30 | 2017-05-23 | Sap Se | Business object representations and detail boxes display |
| US9483086B2 (en) | 2012-07-30 | 2016-11-01 | Sap Se | Business object detail display |
| US9262389B2 (en) * | 2012-08-02 | 2016-02-16 | International Business Machines Corporation | Resource-adaptive content delivery on client devices |
| CN103631824B (en) * | 2012-08-28 | 2016-03-30 | 腾讯科技(深圳)有限公司 | A kind of Webpage display process and device |
| US8832583B2 (en) | 2012-08-31 | 2014-09-09 | Sap Se | Visualizing entries in a calendar using the third dimension |
| US9081466B2 (en) | 2012-09-10 | 2015-07-14 | Sap Se | Dynamic chart control that triggers dynamic contextual actions |
| US9250781B2 (en) | 2012-10-17 | 2016-02-02 | Sap Se | Method and device for navigating time and timescale using movements |
| US8972883B2 (en) | 2012-10-19 | 2015-03-03 | Sap Se | Method and device for display time and timescale reset |
| CN105359094A (en) | 2014-04-04 | 2016-02-24 | 微软技术许可有限责任公司 | Extensible Application Representation |
| KR20160143784A (en) | 2014-04-10 | 2016-12-14 | 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 | Slider cover for computing devices |
| KR102107275B1 (en) | 2014-04-10 | 2020-05-06 | 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 | Collapsible shell cover for computing device |
| US10402472B2 (en) * | 2014-07-30 | 2019-09-03 | Bluebeam, Inc. | Optimized rendering of shared documents on client devices with document raster representations |
| US10592080B2 (en) | 2014-07-31 | 2020-03-17 | Microsoft Technology Licensing, Llc | Assisted presentation of application windows |
| US10254942B2 (en) | 2014-07-31 | 2019-04-09 | Microsoft Technology Licensing, Llc | Adaptive sizing and positioning of application windows |
| US10678412B2 (en) | 2014-07-31 | 2020-06-09 | Microsoft Technology Licensing, Llc | Dynamic joint dividers for application windows |
| US10642365B2 (en) | 2014-09-09 | 2020-05-05 | Microsoft Technology Licensing, Llc | Parametric inertia and APIs |
| CN106662891B (en) | 2014-10-30 | 2019-10-11 | 微软技术许可有限责任公司 | Multi-configuration input equipment |
| US10606859B2 (en) | 2014-11-24 | 2020-03-31 | Asana, Inc. | Client side system and method for search backed calendar user interface |
| CN105701106A (en) * | 2014-11-27 | 2016-06-22 | 广州市动景计算机科技有限公司 | Web page refreshment method and device |
| US10777164B2 (en) * | 2014-12-19 | 2020-09-15 | Qualcomm Incorporated | Power optimization by rendering low-resolution tiles during page load |
| US10592070B2 (en) * | 2015-10-12 | 2020-03-17 | Microsoft Technology Licensing, Llc | User interface directional navigation using focus maps |
| US10685029B2 (en) * | 2015-11-23 | 2020-06-16 | Google Llc | Information ranking based on properties of a computing device |
| US10409565B2 (en) * | 2017-03-30 | 2019-09-10 | Ice Tea Group Llc | Pixel perfect real-time web application framework |
| US10620815B2 (en) | 2017-04-12 | 2020-04-14 | Microsoft Technology Licensing, Llc | Continued selection during scrolling past screen edge thresholds |
| US10977434B2 (en) | 2017-07-11 | 2021-04-13 | Asana, Inc. | Database model which provides management of custom fields and methods and apparatus therfor |
| US10623359B1 (en) | 2018-02-28 | 2020-04-14 | Asana, Inc. | Systems and methods for generating tasks based on chat sessions between users of a collaboration environment |
| US11138021B1 (en) | 2018-04-02 | 2021-10-05 | Asana, Inc. | Systems and methods to facilitate task-specific workspaces for a collaboration work management platform |
| US10613735B1 (en) | 2018-04-04 | 2020-04-07 | Asana, Inc. | Systems and methods for preloading an amount of content based on user scrolling |
| US10642441B2 (en) * | 2018-04-27 | 2020-05-05 | International Business Machines Corporation | Optimal window placement system |
| US10785046B1 (en) | 2018-06-08 | 2020-09-22 | Asana, Inc. | Systems and methods for providing a collaboration work management platform that facilitates differentiation between users in an overarching group and one or more subsets of individual users |
| US10616151B1 (en) | 2018-10-17 | 2020-04-07 | Asana, Inc. | Systems and methods for generating and presenting graphical user interfaces |
| US10779014B2 (en) * | 2018-10-18 | 2020-09-15 | At&T Intellectual Property I, L.P. | Tile scheduler for viewport-adaptive panoramic video streaming |
| US10956845B1 (en) | 2018-12-06 | 2021-03-23 | Asana, Inc. | Systems and methods for generating prioritization models and predicting workflow prioritizations |
| US11568366B1 (en) | 2018-12-18 | 2023-01-31 | Asana, Inc. | Systems and methods for generating status requests for units of work |
| US11113667B1 (en) | 2018-12-18 | 2021-09-07 | Asana, Inc. | Systems and methods for providing a dashboard for a collaboration work management platform |
| US11782737B2 (en) | 2019-01-08 | 2023-10-10 | Asana, Inc. | Systems and methods for determining and presenting a graphical user interface including template metrics |
| US10684870B1 (en) | 2019-01-08 | 2020-06-16 | Asana, Inc. | Systems and methods for determining and presenting a graphical user interface including template metrics |
| US11204683B1 (en) | 2019-01-09 | 2021-12-21 | Asana, Inc. | Systems and methods for generating and tracking hardcoded communications in a collaboration management platform |
| CN112347380B (en) * | 2019-08-07 | 2024-12-17 | 腾讯科技(深圳)有限公司 | Window rendering method and related equipment |
| US11341445B1 (en) | 2019-11-14 | 2022-05-24 | Asana, Inc. | Systems and methods to measure and visualize threshold of user workload |
| US11783253B1 (en) | 2020-02-11 | 2023-10-10 | Asana, Inc. | Systems and methods to effectuate sets of automated actions outside and/or within a collaboration environment based on trigger events occurring outside and/or within the collaboration environment |
| US11599855B1 (en) | 2020-02-14 | 2023-03-07 | Asana, Inc. | Systems and methods to attribute automated actions within a collaboration environment |
| US11763259B1 (en) | 2020-02-20 | 2023-09-19 | Asana, Inc. | Systems and methods to generate units of work in a collaboration environment |
| US11455601B1 (en) | 2020-06-29 | 2022-09-27 | Asana, Inc. | Systems and methods to measure and visualize workload for completing individual units of work |
| US11449836B1 (en) | 2020-07-21 | 2022-09-20 | Asana, Inc. | Systems and methods to facilitate user engagement with units of work assigned within a collaboration environment |
| US11568339B2 (en) | 2020-08-18 | 2023-01-31 | Asana, Inc. | Systems and methods to characterize units of work based on business objectives |
| US11769115B1 (en) | 2020-11-23 | 2023-09-26 | Asana, Inc. | Systems and methods to provide measures of user workload when generating units of work based on chat sessions between users of a collaboration environment |
| US11405435B1 (en) | 2020-12-02 | 2022-08-02 | Asana, Inc. | Systems and methods to present views of records in chat sessions between users of a collaboration environment |
| US11694162B1 (en) | 2021-04-01 | 2023-07-04 | Asana, Inc. | Systems and methods to recommend templates for project-level graphical user interfaces within a collaboration environment |
| US11676107B1 (en) | 2021-04-14 | 2023-06-13 | Asana, Inc. | Systems and methods to facilitate interaction with a collaboration environment based on assignment of project-level roles |
| US11553045B1 (en) | 2021-04-29 | 2023-01-10 | Asana, Inc. | Systems and methods to automatically update status of projects within a collaboration environment |
| US11803814B1 (en) | 2021-05-07 | 2023-10-31 | Asana, Inc. | Systems and methods to facilitate nesting of portfolios within a collaboration environment |
| US11792028B1 (en) | 2021-05-13 | 2023-10-17 | Asana, Inc. | Systems and methods to link meetings with units of work of a collaboration environment |
| US12141756B1 (en) | 2021-05-24 | 2024-11-12 | Asana, Inc. | Systems and methods to generate project-level graphical user interfaces within a collaboration environment |
| US11809222B1 (en) | 2021-05-24 | 2023-11-07 | Asana, Inc. | Systems and methods to generate units of work within a collaboration environment based on selection of text |
| US12093859B1 (en) | 2021-06-02 | 2024-09-17 | Asana, Inc. | Systems and methods to measure and visualize workload for individual users |
| US12182505B1 (en) | 2021-06-10 | 2024-12-31 | Asana, Inc. | Systems and methods to provide user-generated project-level graphical user interfaces within a collaboration environment |
| US11756000B2 (en) | 2021-09-08 | 2023-09-12 | Asana, Inc. | Systems and methods to effectuate sets of automated actions within a collaboration environment including embedded third-party content based on trigger events |
| US12159262B1 (en) | 2021-10-04 | 2024-12-03 | Asana, Inc. | Systems and methods to provide user-generated graphical user interfaces within a collaboration environment |
| US11635884B1 (en) | 2021-10-11 | 2023-04-25 | Asana, Inc. | Systems and methods to provide personalized graphical user interfaces within a collaboration environment |
| US12093896B1 (en) | 2022-01-10 | 2024-09-17 | Asana, Inc. | Systems and methods to prioritize resources of projects within a collaboration environment |
| US11997425B1 (en) | 2022-02-17 | 2024-05-28 | Asana, Inc. | Systems and methods to generate correspondences between portions of recorded audio content and records of a collaboration environment |
| US12190292B1 (en) | 2022-02-17 | 2025-01-07 | Asana, Inc. | Systems and methods to train and/or use a machine learning model to generate correspondences between portions of recorded audio content and work unit records of a collaboration environment |
| US12118514B1 (en) | 2022-02-17 | 2024-10-15 | Asana, Inc. | Systems and methods to generate records within a collaboration environment based on a machine learning model trained from a text corpus |
| US11836681B1 (en) | 2022-02-17 | 2023-12-05 | Asana, Inc. | Systems and methods to generate records within a collaboration environment |
| US12051045B1 (en) | 2022-04-28 | 2024-07-30 | Asana, Inc. | Systems and methods to characterize work unit records of a collaboration environment based on stages within a workflow |
| US12288171B1 (en) | 2022-07-18 | 2025-04-29 | Asana, Inc. | Systems and methods to provide records for new users of a collaboration environment |
| US12412156B1 (en) | 2022-07-21 | 2025-09-09 | Asana, Inc. | Systems and methods to characterize work unit records of a collaboration environment based on freeform arrangement of visual content items |
| US12307072B2 (en) * | 2022-09-14 | 2025-05-20 | Microsoft Technology Licensing, Llc | System and method of rendering user interface components based on priority |
| US11863601B1 (en) | 2022-11-18 | 2024-01-02 | Asana, Inc. | Systems and methods to execute branching automation schemes in a collaboration environment |
| US12287849B1 (en) | 2022-11-28 | 2025-04-29 | Asana, Inc. | Systems and methods to automatically classify records managed by a collaboration environment |
| CN115908674A (en) * | 2022-11-30 | 2023-04-04 | 北京百度网讯科技有限公司 | Quantum circuit diagram rendering method, device, equipment, storage medium and program product |
| US12401655B1 (en) | 2023-04-24 | 2025-08-26 | Asana, Inc. | Systems and methods to manage access to assets of a computer environment based on user and asset grouping |
| US12423121B1 (en) | 2023-11-09 | 2025-09-23 | Asana, Inc. | Systems and methods to customize a user interface of a collaboration environment based on ranking of work unit records managed by the collaboration environment |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040217980A1 (en) * | 2003-02-19 | 2004-11-04 | Radburn Andrew John | Image streaming |
| US20100281402A1 (en) * | 2009-04-29 | 2010-11-04 | Torch Mobile Inc. | Software-based asynchronous tiled backingstore |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6842777B1 (en) * | 2000-10-03 | 2005-01-11 | Raja Singh Tuli | Methods and apparatuses for simultaneous access by multiple remote devices |
| CN101553778B (en) | 2006-02-13 | 2011-11-23 | 德卡尔塔公司 | Method for reappearring numerical map and tile therein |
-
2011
- 2011-08-31 US US13/223,272 patent/US8384726B1/en active Active
- 2011-09-26 US US13/245,667 patent/US8314809B1/en active Active
- 2011-11-30 AU AU2011101579A patent/AU2011101579B4/en not_active Expired
- 2011-11-30 DE DE202011108505U patent/DE202011108505U1/en not_active Expired - Lifetime
-
2012
- 2012-02-03 NL NL2008222A patent/NL2008222C2/en active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040217980A1 (en) * | 2003-02-19 | 2004-11-04 | Radburn Andrew John | Image streaming |
| US20100281402A1 (en) * | 2009-04-29 | 2010-11-04 | Torch Mobile Inc. | Software-based asynchronous tiled backingstore |
Cited By (35)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130033523A1 (en) * | 2011-08-04 | 2013-02-07 | Research In Motion Limited | Orientation-dependent processing of input files by an electronic device |
| US9311426B2 (en) * | 2011-08-04 | 2016-04-12 | Blackberry Limited | Orientation-dependent processing of input files by an electronic device |
| US20200050428A1 (en) * | 2012-02-03 | 2020-02-13 | Sony Corporation | Information processing device, information processing method, and program |
| US20130208012A1 (en) * | 2012-02-15 | 2013-08-15 | Cenk Ergan | Speculative Render Ahead and Caching in Multiple Passes |
| US9384711B2 (en) * | 2012-02-15 | 2016-07-05 | Microsoft Technology Licensing, Llc | Speculative render ahead and caching in multiple passes |
| US9230517B2 (en) | 2012-05-31 | 2016-01-05 | Microsoft Technology Licensing, Llc | Virtual surface gutters |
| US9235925B2 (en) | 2012-05-31 | 2016-01-12 | Microsoft Technology Licensing, Llc | Virtual surface rendering |
| US9286122B2 (en) | 2012-05-31 | 2016-03-15 | Microsoft Technology Licensing, Llc | Display techniques using virtual surface allocation |
| US9959668B2 (en) | 2012-05-31 | 2018-05-01 | Microsoft Technology Licensing, Llc | Virtual surface compaction |
| US9177533B2 (en) | 2012-05-31 | 2015-11-03 | Microsoft Technology Licensing, Llc | Virtual surface compaction |
| US9940907B2 (en) | 2012-05-31 | 2018-04-10 | Microsoft Technology Licensing, Llc | Virtual surface gutters |
| US10043489B2 (en) | 2012-05-31 | 2018-08-07 | Microsoft Technology Licensing, Llc | Virtual surface blending and BLT operations |
| US10031891B2 (en) | 2012-11-14 | 2018-07-24 | Amazon Technologies Inc. | Delivery and display of page previews during page retrieval events |
| US10095663B2 (en) | 2012-11-14 | 2018-10-09 | Amazon Technologies, Inc. | Delivery and display of page previews during page retrieval events |
| US20140164985A1 (en) * | 2012-12-12 | 2014-06-12 | Adobe Systems Incorporated | Predictive Directional Content Queue |
| US9575998B2 (en) | 2012-12-12 | 2017-02-21 | Adobe Systems Incorporated | Adaptive presentation of content based on user action |
| US9569083B2 (en) * | 2012-12-12 | 2017-02-14 | Adobe Systems Incorporated | Predictive directional content queue |
| US20140189487A1 (en) * | 2012-12-27 | 2014-07-03 | Qualcomm Innovation Center, Inc. | Predictive web page rendering using a scroll vector |
| US9367641B2 (en) * | 2012-12-27 | 2016-06-14 | Qualcomm Innovation Center, Inc. | Predictive web page rendering using a scroll vector |
| US10346021B2 (en) * | 2013-05-29 | 2019-07-09 | Rakuten, Inc. | Automatic list scrolling apparatus, method and program based on a selected item |
| US20160124598A1 (en) * | 2013-05-29 | 2016-05-05 | Rakuten, Inc. | Information processing apparatus, information processing method, and information processing program |
| US9307007B2 (en) | 2013-06-14 | 2016-04-05 | Microsoft Technology Licensing, Llc | Content pre-render and pre-fetch techniques |
| US9832253B2 (en) | 2013-06-14 | 2017-11-28 | Microsoft Technology Licensing, Llc | Content pre-render and pre-fetch techniques |
| US10542106B2 (en) | 2013-06-14 | 2020-01-21 | Microsoft Technology Licensing, Llc | Content pre-render and pre-fetch techniques |
| US9720888B1 (en) | 2014-05-22 | 2017-08-01 | Amazon Technologies, Inc. | Distributed browsing architecture for the delivery of graphics commands to user devices for assembling a plurality of layers of a content page |
| US10042521B1 (en) | 2014-05-22 | 2018-08-07 | Amazon Technologies, Inc. | Emulation of control resources for use with converted content pages |
| US9922007B1 (en) | 2014-05-22 | 2018-03-20 | Amazon Technologies, Inc. | Split browser architecture capable of determining whether to combine or split content layers based on the encoding of content within each layer |
| US11169666B1 (en) | 2014-05-22 | 2021-11-09 | Amazon Technologies, Inc. | Distributed content browsing system using transferred hardware-independent graphics commands |
| US10248633B2 (en) | 2014-06-17 | 2019-04-02 | Amazon Technologies, Inc. | Content browser system using multiple layers of graphics commands |
| US10379593B2 (en) * | 2015-10-23 | 2019-08-13 | Samsung Electronics Co., Ltd. | Image displaying apparatus and method of operating the same |
| US10600091B2 (en) * | 2016-05-05 | 2020-03-24 | Predict Interactive, Inc. | Systems and methods for view-based advertisement selection |
| US20180052943A1 (en) * | 2016-08-18 | 2018-02-22 | Qualcomm Incorporated | Systems and methods for controlling webpage pre-rendering |
| US20180088744A1 (en) * | 2016-09-26 | 2018-03-29 | Wp Company Llc | Method and system for delivering real-time content |
| US20220050975A1 (en) * | 2019-04-30 | 2022-02-17 | Huawei Technologies Co., Ltd. | Content Translation Method and Terminal |
| US12333263B2 (en) * | 2019-04-30 | 2025-06-17 | Huawei Technologies Co., Ltd. | Content translation method and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2011101579B4 (en) | 2012-10-04 |
| US8384726B1 (en) | 2013-02-26 |
| AU2011101579A4 (en) | 2012-02-02 |
| NL2008222C2 (en) | 2014-10-08 |
| DE202011108505U1 (en) | 2012-03-02 |
| US8314809B1 (en) | 2012-11-20 |
| NL2008222A (en) | 2013-03-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8384726B1 (en) | Selective rendering of off-screen content | |
| US10216388B2 (en) | Graphical user interface window spacing mechanisms | |
| US8266544B1 (en) | HTML pop-up control | |
| US10812564B1 (en) | Preloading content for requesting applications | |
| US8612418B2 (en) | Mobile web browser for pre-loading web pages | |
| US8726189B2 (en) | Multiple tab stack user interface | |
| US9329764B2 (en) | Overscroll visual effects | |
| US9645733B2 (en) | Mechanism for switching between document viewing windows | |
| US8972886B2 (en) | Methods and apparatus for window displaying | |
| US8881032B1 (en) | Grouped tab document interface | |
| US9792383B2 (en) | Unload and display content placeholders with versions | |
| US20130151937A1 (en) | Selective image loading in mobile browsers | |
| US9021352B2 (en) | Methods and apparatus for predictive document rendering | |
| WO2015164440A1 (en) | Pre-fetching grid blocks by user intent | |
| CN105867752B (en) | Method and system for pinning areas on a user interface | |
| US8621381B1 (en) | System and method for adaptive use of keyboard or search term based on recent use | |
| US20170169599A1 (en) | Methods and electronic devices for displaying picture | |
| US9106762B2 (en) | Associating content with a graphical interface window using a fling gesture | |
| US9727212B2 (en) | Full screen content viewing interface entry | |
| CN114510309B (en) | Animation effect setting method, device, equipment and medium | |
| US20150205478A1 (en) | Content location interface | |
| US9733783B1 (en) | Controlling a user interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: GOOGLE INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GRABOWSKI, JOHN RALPH;KLOBA, GRACE HUA;SIGNING DATES FROM 20110829 TO 20110830;REEL/FRAME:026847/0841 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| FPAY | Fee payment |
Year of fee payment: 4 |
|
| AS | Assignment |
Owner name: GOOGLE LLC, CALIFORNIA Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044101/0299 Effective date: 20170929 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |