US20020019913A1 - Coherency protocol - Google Patents
Coherency protocol Download PDFInfo
- Publication number
- US20020019913A1 US20020019913A1 US09/411,453 US41145399A US2002019913A1 US 20020019913 A1 US20020019913 A1 US 20020019913A1 US 41145399 A US41145399 A US 41145399A US 2002019913 A1 US2002019913 A1 US 2002019913A1
- Authority
- US
- United States
- Prior art keywords
- cache
- memory
- transaction
- policy
- bus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
- G06F12/0815—Cache consistency protocols
- G06F12/0831—Cache consistency protocols using a bus scheme, e.g. with bus monitoring or watching means
- G06F12/0835—Cache consistency protocols using a bus scheme, e.g. with bus monitoring or watching means for main memory peripheral accesses (e.g. I/O or DMA)
Definitions
- the present invention relates in general to microprocessor systems and, more particularly, to a system, method, and mechanism providing cache coherency in microprocessor systems with cache support.
- Microprocessors manipulate data according to instructions specified by a computer program.
- the instructions and data in a conventional system are stored in main memory which is coupled to the processor by a memory bus.
- the ability of processors to execute instructions has typically outpaced the ability of memory subsystems to supply instructions and data to the processors.
- processors include complete instruction set computers (CISC), reduced instruction set computers (RISC) and hybrids.
- Cache memory comprises one or more levels of dedicated high-speed memory holding recently accessed data and instructions, designed to speed up subsequent access to the same data and instructions.
- Cache technology is based on a premise that programs frequently re-execute the same instructions and data.
- instructions and data exhibit a trait called “spatial locality” which means that instructions and data to be used in the future tend to be located in the same general region of memory as recently used instructions and data.
- spatial locality which means that instructions and data to be used in the future tend to be located in the same general region of memory as recently used instructions and data.
- the cache then monitors subsequent requests for data to see if the information needed has already been stored in the cache. If the data had indeed been stored in the cache, the data is delivered immediately to the processor while the attempt to fetch the information from main memory is aborted (or not started). If, on the other hand, the data had not been previously stored In cache then it is fetched directly from main memory and also saved in cache for future access.
- Cache memory comprises memory devices that have lower latency than the main memory,
- one or more levels of on-chip cache memory provide particularly low-latency storage.
- On-chip cache memory can be implemented in memory structures and devices having latency of only one or two clock cycles.
- Cache memory, particularly on-chip cache memory is particularly suited to being accessed by the microprocessor at high speed.
- Cache coherency refers to the task of ensuring that the contents of cache memory are consistent with the corresponding locations in main memory.
- main memory cache coherency is a relatively simple task. However, this restriction forces all accesses to main memory to be routed through the microprocessor.
- Many devices such as graphics modules, mulitimedia modules and network interface modules, for example, can make use of system memory for efficient operation. However, if these modules must tie up the processor in order to use system memory, overall performance is lowered.
- the system bus in a typical computer system architecture couples to the microprocessor and to a direct memory access (DMA) controller.
- DMA direct memory access
- Other modules and peripherals coupled to the bus can access main memory without tying up the microprocessor using the DMA controller.
- This may also be referred to as a shared memory system as all or part of the main memory is shared amongst the variety or devices, including the microprocessor, that can access the memory.
- One solution is to partition the main memory into cacheable and uncacheable portions. DMA devices are restricted to using only uncacheable portions of memory. In this manner, the DMA device can be unconcerned with the cache contents. However, for the data stored in the uncacheable portions all of the benefits of cache technology are lost.
- PCI peripheral component interconnect
- Another solution is to enable the DMA controller or other hardware coupled to the system bus to “snoop” the cache before the access to shared memory is allowed.
- An example of this is in the peripheral component interconnect (PCI) bus that enables the PCI bridge device to snoop the CPU cache automatically as a part of any DMA device transaction.
- PCI peripheral component interconnect
- This allows shared memory to be cached, however, also adds latency to every DMA transaction.
- Systems having a single system bus on which all DMA transactions are performed can implement snooping protocols efficiently. This is because a single bus system enables any device to broadcast a signal to all other devices quickly and efficiently to indicate that a shared memory access is occurring.
- Another solution used for more complex networks uses a centralized or distributed directory structure to hold cache status information. These may be seen, for example, in multiprocessor architectures. Any device accessing shared memory first accesses the directory to determine whether the target memory address is currently cached. When the address is not cached, a direct access to the shared memory location is made. When the address is cached, the cached data is written back to main memory before the direct access is completed. Directory-based solutions are faster than snoop operations, but also add latency to each DMA access as well as hardware overhead to support the directory structure.
- the present invention involves a computer system having a memory system where at least some of the memory is designated as shared memory.
- a transaction-based bus mechanism couples to the memory system and includes a cache coherency transaction defined within its transaction set.
- a processor having a cache memory is coupled to the memory system through the transaction based bus mechanism.
- a system component coupled to the bus mechanism includes logic for specifying cache coherency policy. Logic within the system component initiates a cache transaction according to the specified cache policy on the bus mechanism. Logic within the processor responds to the initiated cache transaction by executing a cache operation specified by the cache transaction.
- FIG. 1 shows in block diagram form a computer system incorporating an apparatus and system in accordance with the present invention
- FIG. 2 shows a processor in block diagram form incorporating the apparatus and method in accordance with the present invention
- FIG. 3 illustrates a bus transaction in accordance with the present invention
- FIG. 4 shows a flow diagram illustrating shared memory access operation in accordance with the present invention
- FIG. 5 illustrates an exemplary control register format in accordance with the present invention.
- FIG. 6 illustrates an exemplary snoop address register format in accordance with the present invention.
- the preferred implementation of the present invention comprises a system that may be implemented as a single integrated circuit system-on-a-chip solution or as multiple integrated circuits with varying levels of integration. In either case, sub-components of the system are interconnected by a bus network that may comprise one or more types of bus technologies.
- the bus network implements a transaction set comprising a plurality of defined transactions that can be communicated over the bus network. Each transaction comprises a request/response pair or a set of request/response pairs.
- the transaction set includes cache transaction primitives.
- One of the system components coupled to the bus network is a central processing unit (CPU).
- the CPU includes a cache management or memory management unit that allows the CPU to cache instructions and data from main memory.
- Modules, devices and sub-components coupled to the bus network use the cache transactions to cause the CPU to perform cache management activities on their behalf. In this manner, when a module desires to access main memory directly, cache coherency can be ensured by issuing a cache transaction prior to the direct memory access. In the preferred implementation, these cache transactions are interpreted by the CPU as explicit commands.
- Any system is usefully described as a collection of processes or modules communicating via data objects or messages as shown in FIG. 1.
- the modules may be large collections of circuitry whose properties are somewhat loosely defined, and may vary in size or composition significantly.
- the data object or message is a communication between modules that make up the system. To actually connect a module within the system it is necessary to define an interface between the system and the component module.
- the present invention is illustrated in terms of a media system 100 shown in FIG. 1.
- the present invention supports systems requiring a number of components that use and benefit from direct memory access, such as media system 100 .
- Media processor 100 comprises, for example, a “set-top box” for video processing, a video game controller, a digital video disk (DVD) player, and the like.
- system 100 is a special purpose data processing system targeted at high throughput multimedia applications.
- processor 101 that operates to communicate and process data received through a high speed bus 102 , peripheral bus 104 , and memory bus 106 .
- Video controller 105 receives digital data from system bus 102 and generates video signals to display information on an external video monitor, television set, and the like.
- the generated video signals may be analog or digital.
- video controller may receive analog and/or digital video signals from external devices as well.
- Audio controller 107 operates in a manner akin to video controller 105 , but differs in that it controls audio information rather than video.
- Network I/O controller 109 may be a conventional network card, ISDN connection, modem, and the like for communicating digital information.
- Mass storage device 111 coupled to high speed bus 102 may comprise magnetic disks, tape drives, CDROM, DVD, banks of random access memory, and the like. A wide variety of random access and read only memory technologies are available and are equivalent for purposes of the present invention. Mass storage 111 may include computer programs and data stored therein.
- high speed bus 102 is implemented as a peripheral component interconnect (PCI) industry standard bus.
- PCI peripheral component interconnect
- An advantage of using an industry standard bus is that a wide variety of expansion units such as controller's 105 , 107 , 109 and 111 are readily available.
- PCI bus 102 supports direct memory access components using a snooping protocol.
- Peripherals 113 include a variety of general purpose I/O devices that may require lower bandwidth communication than provided by high speed bus 102 .
- Typical I/O devices include read only memory (ROM) devices such as game program cartridges, serial input devices such as a mouse or joystick, keyboards, and the like.
- Processor 101 includes corresponding serial port(s), parallel port(s), printer ports, and external timer ports to communicate with peripherals 113 . Additionally, ports may be included to support communication with on-board ROM, such as a BIOS ROM, integrated with processor 101 .
- External memory 103 is typically required to provide working storage for processor 101 and may be implemented using dynamic or static RAM, ROM, synchronous DRAM, or any of a wide variety of equivalent devices capable of storing digital data in a manner accessible to processor 101 .
- Processor 101 is illustrated in a greater detail in the functional diagram of FIG. 2.
- One module in a data processing system is a central processor unit (CPU) core 201 .
- the CPU core 201 includes, among other components (not shown), execution resources (e.g., arithmetic logic units, registers, control logic) and cache memory. These functional units, discussed in greater detail below, perform the functions of fetching instructions and data from memory, preprocessing fetched instructions, scheduling instructions to be executed, executing the instructions, managing memory transactions, and interfacing with external circuitry and devices.
- CPU core 201 communicates with other components shown in FIG. 2 through a system bus 202 .
- system bus 202 is a proprietary, high-speed network bus using packet technology and is referred to herein as a “super highway”.
- Bus 202 couples to a variety of system components. Of particular importance are components that implement interfaces with external hardware such as external memory interface unit 203 , PCI bridge 207 , and peripheral bus 204 .
- Each component coupled to bus 202 may be a target of a transaction packet on bus 202 as specified by an address within the transaction packet.
- External memory interface 203 provides an interface between the system bus 202 and the external main memory subsystem 103 (shown in FIG. 1).
- the external memory interface comprises a port to system bus 202 and a DRAM controller.
- An important feature of the present invention is that the memory accessed through external memory interface 203 is coherent as viewed from the system bus 202 . All requests are processed sequentially on external memory interface 203 in the order of receipt of those requests by EMI unit 203 . However the corresponding Store response packets may not be returned to the initiator on system bus 202 until the write operations are actually completed to DRAM. Since all the requests to the same address are processed in order (as they are received from the SuperHyway interface) on the DRAM interface, the coherency of the memory is achieved.
- the organization of interconnects in the system illustrated in FIG. 2 is guided by the principle of optimizing each interconnect for its specific purpose.
- the bus system 202 interconnect facilitates the integration of several different types of sub-systems. It is used for closely coupled subsystems which have stringent memory latency/bandwidth requirements.
- the peripheral subsystem 204 supports bus standards which allow easy integration of hardware of types indicated in reference to FIG. 1 through interface ports 213 .
- PCI bridge 207 provides a standard interface that supports expansion using a variety of PCI standard devices that demand higher performance that available through peripheral port 204 .
- the system bus 202 may be outfitted with an expansion port which supports the rapid integration of application modules without changing the other components of system 101 .
- system bus 202 provides a protocol in accordance with the present invention that maps cache commands from, for example PCI bridge 207 onto a cache transaction within the transaction set of bus 202 .
- CPU 201 responds to the cache transaction by implementing the expected cache command.
- FIG. 3 illustrates an exemplary transaction 300 comprising a request packet 301 and a response packet 303 for communication across superhighway 202 .
- Packets 301 and 303 comprise a unit of data transfer through the packet-router 305 .
- Communication between modules 307 and 309 is achieved by the exchange of packets between those modules.
- Each module 307 and 307 is assigned or negotiates with packet router 305 for a unique address.
- each address is an unsigned integral value that corresponds to a location in the physical memory space of processor 201 .
- Some of the address bits indicate the destination module and some of the address bits (called “offset bits”) indicate a particular location within that destination module.
- the size of the physical address, the number of destination bits, and the number of offset bits are implementation dependent selected to meet the needs of a particular implementation.
- Packet router 305 uses the destination bits to perform routing. Packet router 305 inspects the destination bits of a received packet, determines the appropriate port to which the packet is to be routed, and routes the packet to the specified module. Packet router 305 may be implemented as a bus, crossbar, packet routing network, or equivalent packet transport mechanism to meet the needs of a particular application.
- a packet comprises a plurality of fields indicating information such as the type of transaction, target address of the transaction, and/or data needed or produced by the transaction. Each field has a number of possible values to characterize that packet. Every packet contains a destination field which is used by packet router 305 to determine which module the packet should be routed to. In the particular implementation, every packet has a class and a type. A packet's class is either a request or a response. A response packet class is subdivided into either an ordinary response or an error response. A packet's type indicates the kind of transaction associated with that packet. The packet class and type together form a packet opcode.
- Each packet is associated with a source module and a destination module.
- the source sends a packet 301 or 303 over a port into a packet-router 305 within bus 202 .
- Packet-router 305 arranges for the packet to be routed to a p-port connected to the destination.
- the destination then receives this packet over that p-port from the packet-router. It is possible for the source and destination to be the same module. It is also possible for a packet to be decomposed into multiple “cells” where each cell of the packet has the same source and destination module and same packet type. The multiple cells are combined into a packet at the destination.
- a “transaction” 300 is an exchange of packets that allows a module to access the state of another module using the super highway bus 202 .
- a transaction comprises a transfer of a request packet 301 from a requesting module 307 (also called an “initiator”) to a responding module 309 (also called a “target”) followed by a response packet 303 from that responding module 309 back to the requesting module 307 .
- the request packet 301 initiates the transaction and its contents determine the access to be made.
- the response packet 303 completes the transaction and its contents indicate the result of the access.
- a response packet 303 may also indicate whether the request was valid or not.
- the response packet 303 can be formatted as an ordinary response if the request was valid or an error response if the request was invalid.
- request packet 301 and response packet 303 are asynchronous with respect to each other.
- Requests can be pipelined in that a requesting module 307 can generate multiple request packets 301 before any response packets 303 are received so as to overlap latencies associated with transactions.
- Responding 309 modules process requests in the order received, and do not generate a response packet 303 until the requested action is committed. In this manner, apart from internal latency inside the destination module, the access is completed as viewed by all modules coupled to bus 202 when a request packet 301 is received. Any subsequently received requests to that target module will act after that access This guarantees that time-ordering of access at a destination can be imposed by waiting for the corresponding response.
- Cache coherency transactions include a “flush” and a “purge” transaction. These are provided primarily to support the integration of DMA type modules such as PCI bridge 207 shown in FIG. 2, but more generally support any module that uses main memory provided through external memory interface 203 .
- the flush transaction has a single operand which is the physical address which is to be flushed from the cache.
- a flush transaction is received from bus 202 by the cache/MMU within CPU 201 it causes the cache/MKU to lookup the address in the cache. If the lookup yields a miss or a hit to a cache line that is unmodified with regard to main memory, the cache/MMU issues a response to the flush request immediately following the lookup. If the lookup yields a hit to a cache line that is modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. Following the writeback the cache/MMU issues a response to the flush request.
- the response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered.
- the purge transaction has a single operand which is the physical address which is to be purged from the cache
- a purge transaction is received from bus 202 by the cache/MMU within CPU 201 it causes the cache/MMU to lookup the address in the cache. If the lookup yields a miss the cache/MMU issues a response to the purge request immediately following the lookup. If the lookup yields a hit to the cache line modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. If the lookup yields a hit the cache line is invalidated whether or not the line is modified with respect to main memory. Following the invalidation the cache/MMU issues a response to the purge request.
- the response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered and that the specified memory location is no longer valid in the cache.
- flush and purge by a module provides a level of cache coherency. These operations guarantee that a read operation by a module to an address in a shared memory system will receive the value last written to that address.
- the time of access is given as the time at which the flush is received by the cache controller.
- the module read operation is guaranteed to get a data value coherent with the value of the system memory no earlier than the time of access.
- the purge operation guarantees that the written data is readable by all memory users after the time of access.
- the time of access is given as the time at which the write operation is performed to system memory following the purge of the data cache(s).
- a component coupled to PCI bus 205 wishes to access a shared memory location, it asserts the memory request using PCI standard DMA signaling protocol to PCI bridge 207 . Because CPU 201 is not coupled to the PCI bus 205 directly, this signaling protocol is not recognized by CPU 201 .
- PCI module 207 it should be understood that any module coupled to bus 202 that desires to use shared memory can implement the steps outlined below.
- step 401 the module splits up the memory request into a plurality of non-cache line straddling system interconnect requests. In this manner each request is ensured of affecting a single cache line and the cache/MMU does not need to implement special behavior to recognize and implement cache straddling requests.
- Both flush requests and purge requests are packetized and addressed to a port associated with cache/MMU in CPU 201 in step 403 .
- the requesting module then waits to receive a response from the cache/MMU in step 404 .
- a load request is then made in step 405 in a packet addressed to the memory interface unit 203 .
- a store request packet is addressed to memory interface unit 203 in step 407 .
- external memory interface unit generates a response packet indicating completion of the coherent access.
- the present invention provides cache control instructions that are integrated into the basic transaction set of bus 202 .
- This feature enables any module coupled to bus 202 to implement cache control and ensure coherent use of shared memory resources.
- Corresponding logic in the cache/MMU of CPU 201 responds to the cache control transactions to perform the cache control operation on behalf of the requesting module.
- the coherency logic within the requesting module e.g., PCI bridge 207 preferably can specify one or more caching windows and allow remote specification of the caching policy for a particular region in cache to increase coherency performance.
- This is implemented by providing control register space 501 , shown in FIG. 5, that specifies a snoop policy or mode and an address range for snooping.
- Snoop address register 601 (shown in FIG. 6) within PCI module 207 that stores one or more addresses. Both snoop control register 501 and snoop address register 601 have any number of lines specifying any number of cache regions with different snoop policies. Each snoop control register has a corresponding snoop address register.
- a 2-bit mode field indicates that whether and how the address in a PCI request is compared to the address stored in the snoop address register.
- An example encoding is summarized in Table 1.
- TABLE 1 00 Snoop address register is not compared 01 Reserved 10 Address is compared, and upon a match the snoop command is not issued.
- snoop command is issued 11 Address is compared, and upon a match the snoop command is issued.
- snoop command is not issued.
- the range field has eight possible values in the particular implementation with each value indicating a range of addresses that will result in a match during the comparison of the memory address in the PCI request and the stored snoop address in register 601 . Essentially, each value of the range field indicates how many bits of the stored snoop address will take part in the comparison.
- Table 2 summarizes an exemplary encoding. TABLE 2 Value Interpretation Range 000 Compare address bits 31:12 4 kB 001 Compare address bits 31:16 64 kB 010 Compare address bits 31:20 1 MB 011 Compare address bits 31:24 16 MB 100 Compare address bits 31:25 32 MB 101 Compare address bits 31:26 64 Mb 110 Compare address bits 31:27 128 MB 111 Compare address bits 31:28 256 MB
- a cache partition can be implemented by storing an address within a snoop address register 601 with the size of the partition specified by a value stored in the range field of snoop control register 501 .
- the cache coherency policy for that partition can be controlled by setting the value in the corresponding mode field of snoop control register 501 .
- This feature of the present invention enables the remote specification of the caching policy in a manner that does not require any manipulation of control registers within CPU 201 . Whether or not a flush or purge command is issued is determined by the PCI module 207 and the cache/MMU within CPU 201 merely responds to execute and acknowledge issued cache control commands.
- PCI module 207 will precede step 401 in FIG. 4 with a step of checking whether the shared memory address requested matches an address specified in the snoop address register 601 within the bounds specified by the snoop control register 501 .
- the stored addresses may indicate that a snoop is to be performed, in which case the process proceeds to step 401 .
- the process will proceed to steps 405 and 407 accordingly
- a particular implementation may implement an optimization based on cache policy. For each defined snoop range a single bit can be used to indicate a selection between two optional behaviors. For example, each snoop range can be assigned a policy of “flush on read, purge on write” or “nothing on read, purge on write”. A single bit in the mode field can allow the choice of policy independently for each cache region. This optional feature reduces the number of unnecessary coherency transaction. Specifically, when the CPU caching policy is write-through then there is no possibility of dirty data existing in the cache and so remote-initiated flushes are redundant. The optimization enables these redundant operations to be avoided.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
Description
- 1. Field of the Invention
- The present invention relates in general to microprocessor systems and, more particularly, to a system, method, and mechanism providing cache coherency in microprocessor systems with cache support.
- 2. Relevant Background
- Microprocessors manipulate data according to instructions specified by a computer program. The instructions and data in a conventional system are stored in main memory which is coupled to the processor by a memory bus. The ability of processors to execute instructions has typically outpaced the ability of memory subsystems to supply instructions and data to the processors. As used herein the terms “microprocessor” and “processor” include complete instruction set computers (CISC), reduced instruction set computers (RISC) and hybrids.
- Most processors use a cache memory system to speed memory access. Cache memory comprises one or more levels of dedicated high-speed memory holding recently accessed data and instructions, designed to speed up subsequent access to the same data and instructions. Cache technology is based on a premise that programs frequently re-execute the same instructions and data. Also, instructions and data exhibit a trait called “spatial locality” which means that instructions and data to be used in the future tend to be located in the same general region of memory as recently used instructions and data. When data is read from main system memory, a copy is also saved in the cache memory, along with an index to the associated location in main memory. Often the cache entry includes not only the data specifically requested, but data surrounding the specifically requested data.
- The cache then monitors subsequent requests for data to see if the information needed has already been stored in the cache. If the data had indeed been stored in the cache, the data is delivered immediately to the processor while the attempt to fetch the information from main memory is aborted (or not started). If, on the other hand, the data had not been previously stored In cache then it is fetched directly from main memory and also saved in cache for future access.
- Microprocessor performance is greatly enhanced by the use of cache memory. Cache memory comprises memory devices that have lower latency than the main memory, In particular, one or more levels of on-chip cache memory provide particularly low-latency storage. On-chip cache memory can be implemented in memory structures and devices having latency of only one or two clock cycles. Cache memory, particularly on-chip cache memory, is particularly suited to being accessed by the microprocessor at high speed.
- An task for the cache subsystem is to maintain cache coherency. Cache coherency refers to the task of ensuring that the contents of cache memory are consistent with the corresponding locations in main memory. When only the microprocessor can access main memory cache coherency is a relatively simple task. However, this restriction forces all accesses to main memory to be routed through the microprocessor. Many devices such as graphics modules, mulitimedia modules and network interface modules, for example, can make use of system memory for efficient operation. However, if these modules must tie up the processor in order to use system memory, overall performance is lowered.
- To make more efficient use of the processor, many systems allow modules and peripherals other than the microprocessor to access main memory directly. The system bus in a typical computer system architecture couples to the microprocessor and to a direct memory access (DMA) controller. Other modules and peripherals coupled to the bus can access main memory without tying up the microprocessor using the DMA controller. This may also be referred to as a shared memory system as all or part of the main memory is shared amongst the variety or devices, including the microprocessor, that can access the memory.
- Shared memory systems complicate the cache coherency task significantly. DMA devices access main memory directly, but usually do not access the cache memory directly. To ensure that the DMA device obtains correct data steps must be taken to verify that the contents of the shared memory location being accessed by a DMA device have not been changed in the cached copy of that location being used by the microprocessor. Moreover, the latency imposed by this coherency check cannot be such as to outweigh the benefits of either caching or direct memory access.
- One solution is to partition the main memory into cacheable and uncacheable portions. DMA devices are restricted to using only uncacheable portions of memory. In this manner, the DMA device can be unconcerned with the cache contents. However, for the data stored in the uncacheable portions all of the benefits of cache technology are lost.
- Another solution is to enable the DMA controller or other hardware coupled to the system bus to “snoop” the cache before the access to shared memory is allowed. An example of this is in the peripheral component interconnect (PCI) bus that enables the PCI bridge device to snoop the CPU cache automatically as a part of any DMA device transaction. This allows shared memory to be cached, however, also adds latency to every DMA transaction. Systems having a single system bus on which all DMA transactions are performed can implement snooping protocols efficiently. This is because a single bus system enables any device to broadcast a signal to all other devices quickly and efficiently to indicate that a shared memory access is occurring.
- However, there is an increasing demand for systems with robust, complex, multi-path communications subsystems for interconnecting system components. Complex communications networks enable greater expansion potential and customization. Moreover, such systems enable existing, proven subsystem and module designs (often referred to as intellectual property or “IP”) to be reused. In systems with more complex bus networks that enable multiple independent paths a network broadcast can be slow making conventional snoop protocols impractical.
- Another solution used for more complex networks uses a centralized or distributed directory structure to hold cache status information. These may be seen, for example, in multiprocessor architectures. Any device accessing shared memory first accesses the directory to determine whether the target memory address is currently cached. When the address is not cached, a direct access to the shared memory location is made. When the address is cached, the cached data is written back to main memory before the direct access is completed. Directory-based solutions are faster than snoop operations, but also add latency to each DMA access as well as hardware overhead to support the directory structure.
- A need exists for a mechanism, method and system that enables efficient shared memory access in a cached memory system. A need specifically exists for a mechanism to perform cache coherency in a system have a complex, multipath system bus.
- The present invention involves a computer system having a memory system where at least some of the memory is designated as shared memory. A transaction-based bus mechanism couples to the memory system and includes a cache coherency transaction defined within its transaction set. A processor having a cache memory is coupled to the memory system through the transaction based bus mechanism. A system component coupled to the bus mechanism includes logic for specifying cache coherency policy. Logic within the system component initiates a cache transaction according to the specified cache policy on the bus mechanism. Logic within the processor responds to the initiated cache transaction by executing a cache operation specified by the cache transaction.
- The foregoing and other features, utilities and advantages of the invention will be apparent from the following more particular description of a preferred embodiment of the invention as illustrated in the accompanying drawings.
- FIG. 1 shows in block diagram form a computer system incorporating an apparatus and system in accordance with the present invention;
- FIG. 2 shows a processor in block diagram form incorporating the apparatus and method in accordance with the present invention;
- FIG. 3 illustrates a bus transaction in accordance with the present invention;
- FIG. 4 shows a flow diagram illustrating shared memory access operation in accordance with the present invention;
- FIG. 5 illustrates an exemplary control register format in accordance with the present invention; and
- FIG. 6 illustrates an exemplary snoop address register format in accordance with the present invention.
- The preferred implementation of the present invention comprises a system that may be implemented as a single integrated circuit system-on-a-chip solution or as multiple integrated circuits with varying levels of integration. In either case, sub-components of the system are interconnected by a bus network that may comprise one or more types of bus technologies. The bus network implements a transaction set comprising a plurality of defined transactions that can be communicated over the bus network. Each transaction comprises a request/response pair or a set of request/response pairs.
- In the particular implementation, the transaction set includes cache transaction primitives. One of the system components coupled to the bus network is a central processing unit (CPU). Among other features, the CPU includes a cache management or memory management unit that allows the CPU to cache instructions and data from main memory. Modules, devices and sub-components coupled to the bus network use the cache transactions to cause the CPU to perform cache management activities on their behalf. In this manner, when a module desires to access main memory directly, cache coherency can be ensured by issuing a cache transaction prior to the direct memory access. In the preferred implementation, these cache transactions are interpreted by the CPU as explicit commands.
- Any system is usefully described as a collection of processes or modules communicating via data objects or messages as shown in FIG. 1. The modules may be large collections of circuitry whose properties are somewhat loosely defined, and may vary in size or composition significantly. The data object or message is a communication between modules that make up the system. To actually connect a module within the system it is necessary to define an interface between the system and the component module.
- The present invention is illustrated in terms of a
media system 100 shown in FIG. 1. The present invention supports systems requiring a number of components that use and benefit from direct memory access, such asmedia system 100.Media processor 100 comprises, for example, a “set-top box” for video processing, a video game controller, a digital video disk (DVD) player, and the like. Essentially,system 100 is a special purpose data processing system targeted at high throughput multimedia applications. Features of the present invention are embodied inprocessor 101 that operates to communicate and process data received through ahigh speed bus 102,peripheral bus 104, andmemory bus 106. -
Video controller 105 receives digital data fromsystem bus 102 and generates video signals to display information on an external video monitor, television set, and the like. The generated video signals may be analog or digital. Optionally, video controller may receive analog and/or digital video signals from external devices as well.Audio controller 107 operates in a manner akin tovideo controller 105, but differs in that it controls audio information rather than video. Network I/O controller 109 may be a conventional network card, ISDN connection, modem, and the like for communicating digital information.Mass storage device 111 coupled tohigh speed bus 102 may comprise magnetic disks, tape drives, CDROM, DVD, banks of random access memory, and the like. A wide variety of random access and read only memory technologies are available and are equivalent for purposes of the present invention.Mass storage 111 may include computer programs and data stored therein. - In a particular example,
high speed bus 102 is implemented as a peripheral component interconnect (PCI) industry standard bus. An advantage of using an industry standard bus is that a wide variety of expansion units such as controller's 105, 107, 109 and 111 are readily available.PCI bus 102 supports direct memory access components using a snooping protocol. -
Peripherals 113 include a variety of general purpose I/O devices that may require lower bandwidth communication than provided byhigh speed bus 102. Typical I/O devices include read only memory (ROM) devices such as game program cartridges, serial input devices such as a mouse or joystick, keyboards, and the like.Processor 101 includes corresponding serial port(s), parallel port(s), printer ports, and external timer ports to communicate withperipherals 113. Additionally, ports may be included to support communication with on-board ROM, such as a BIOS ROM, integrated withprocessor 101.External memory 103 is typically required to provide working storage forprocessor 101 and may be implemented using dynamic or static RAM, ROM, synchronous DRAM, or any of a wide variety of equivalent devices capable of storing digital data in a manner accessible toprocessor 101. -
Processor 101 is illustrated in a greater detail in the functional diagram of FIG. 2. One module in a data processing system is a central processor unit (CPU)core 201. TheCPU core 201 includes, among other components (not shown), execution resources (e.g., arithmetic logic units, registers, control logic) and cache memory. These functional units, discussed in greater detail below, perform the functions of fetching instructions and data from memory, preprocessing fetched instructions, scheduling instructions to be executed, executing the instructions, managing memory transactions, and interfacing with external circuitry and devices. -
CPU core 201 communicates with other components shown in FIG. 2 through asystem bus 202. In the preferredimplementation system bus 202 is a proprietary, high-speed network bus using packet technology and is referred to herein as a “super highway”.Bus 202 couples to a variety of system components. Of particular importance are components that implement interfaces with external hardware such as externalmemory interface unit 203,PCI bridge 207, andperipheral bus 204. Each component coupled tobus 202 may be a target of a transaction packet onbus 202 as specified by an address within the transaction packet. -
External memory interface 203 provides an interface between thesystem bus 202 and the external main memory subsystem 103 (shown in FIG. 1). The external memory interface comprises a port tosystem bus 202 and a DRAM controller. An important feature of the present invention is that the memory accessed throughexternal memory interface 203 is coherent as viewed from thesystem bus 202. All requests are processed sequentially onexternal memory interface 203 in the order of receipt of those requests byEMI unit 203. However the corresponding Store response packets may not be returned to the initiator onsystem bus 202 until the write operations are actually completed to DRAM. Since all the requests to the same address are processed in order (as they are received from the SuperHyway interface) on the DRAM interface, the coherency of the memory is achieved. - The organization of interconnects in the system illustrated in FIG. 2 is guided by the principle of optimizing each interconnect for its specific purpose. The
bus system 202 interconnect facilitates the integration of several different types of sub-systems. It is used for closely coupled subsystems which have stringent memory latency/bandwidth requirements. Theperipheral subsystem 204 supports bus standards which allow easy integration of hardware of types indicated in reference to FIG. 1 throughinterface ports 213.PCI bridge 207 provides a standard interface that supports expansion using a variety of PCI standard devices that demand higher performance that available throughperipheral port 204. Thesystem bus 202 may be outfitted with an expansion port which supports the rapid integration of application modules without changing the other components ofsystem 101. - It should be noted that in the system of the present invention, the
PCI bridge 207 is not coupled directly toCPU 201 and so cannot support snooping in the conventional manner specified by the PCI standards. Instead,system bus 202 provides a protocol in accordance with the present invention that maps cache commands from, forexample PCI bridge 207 onto a cache transaction within the transaction set ofbus 202.CPU 201 responds to the cache transaction by implementing the expected cache command. - FIG. 3 illustrates an
exemplary transaction 300 comprising arequest packet 301 and aresponse packet 303 for communication acrosssuperhighway 202. 301 and 303 comprise a unit of data transfer through the packet-Packets router 305. Communication between 307 and 309 is achieved by the exchange of packets between those modules. Eachmodules 307 and 307 is assigned or negotiates withmodule packet router 305 for a unique address. In the particular example, each address is an unsigned integral value that corresponds to a location in the physical memory space ofprocessor 201. Some of the address bits indicate the destination module and some of the address bits (called “offset bits”) indicate a particular location within that destination module. The size of the physical address, the number of destination bits, and the number of offset bits are implementation dependent selected to meet the needs of a particular implementation. -
Packet router 305 uses the destination bits to perform routing.Packet router 305 inspects the destination bits of a received packet, determines the appropriate port to which the packet is to be routed, and routes the packet to the specified module.Packet router 305 may be implemented as a bus, crossbar, packet routing network, or equivalent packet transport mechanism to meet the needs of a particular application. - A packet comprises a plurality of fields indicating information such as the type of transaction, target address of the transaction, and/or data needed or produced by the transaction. Each field has a number of possible values to characterize that packet. Every packet contains a destination field which is used by
packet router 305 to determine which module the packet should be routed to. In the particular implementation, every packet has a class and a type. A packet's class is either a request or a response. A response packet class is subdivided into either an ordinary response or an error response. A packet's type indicates the kind of transaction associated with that packet. The packet class and type together form a packet opcode. - Each packet is associated with a source module and a destination module. The source sends a
301 or 303 over a port into a packet-packet router 305 withinbus 202. Packet-router 305 arranges for the packet to be routed to a p-port connected to the destination. The destination then receives this packet over that p-port from the packet-router. It is possible for the source and destination to be the same module. It is also possible for a packet to be decomposed into multiple “cells” where each cell of the packet has the same source and destination module and same packet type. The multiple cells are combined into a packet at the destination. - A “transaction” 300, suggested by the dashed line box in FIG. 3, is an exchange of packets that allows a module to access the state of another module using the
super highway bus 202. A transaction comprises a transfer of arequest packet 301 from a requesting module 307 (also called an “initiator”) to a responding module 309 (also called a “target”) followed by aresponse packet 303 from that respondingmodule 309 back to the requestingmodule 307. Therequest packet 301 initiates the transaction and its contents determine the access to be made. Theresponse packet 303 completes the transaction and its contents indicate the result of the access. Aresponse packet 303 may also indicate whether the request was valid or not. Theresponse packet 303 can be formatted as an ordinary response if the request was valid or an error response if the request was invalid. - In the preferred implementation there is a 1:1 correspondence between request and response packets. The transaction protocol in the preferred implementation is “split phase” because the
request packet 301 andresponse packet 303 are asynchronous with respect to each other. Requests can be pipelined in that a requestingmodule 307 can generatemultiple request packets 301 before anyresponse packets 303 are received so as to overlap latencies associated with transactions. - Responding 309 modules process requests in the order received, and do not generate a
response packet 303 until the requested action is committed. In this manner, apart from internal latency inside the destination module, the access is completed as viewed by all modules coupled tobus 202 when arequest packet 301 is received. Any subsequently received requests to that target module will act after that access This guarantees that time-ordering of access at a destination can be imposed by waiting for the corresponding response. - One of the packet types of particular importance to the present invention is a cache coherency packet type associated with a cache coherency transaction. Cache coherency transactions include a “flush” and a “purge” transaction. These are provided primarily to support the integration of DMA type modules such as
PCI bridge 207 shown in FIG. 2, but more generally support any module that uses main memory provided throughexternal memory interface 203. - The flush transaction has a single operand which is the physical address which is to be flushed from the cache. When a flush transaction is received from
bus 202 by the cache/MMU withinCPU 201 it causes the cache/MKU to lookup the address in the cache. If the lookup yields a miss or a hit to a cache line that is unmodified with regard to main memory, the cache/MMU issues a response to the flush request immediately following the lookup. If the lookup yields a hit to a cache line that is modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. Following the writeback the cache/MMU issues a response to the flush request. The response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered. - The purge transaction has a single operand which is the physical address which is to be purged from the cache When a purge transaction is received from
bus 202 by the cache/MMU withinCPU 201 it causes the cache/MMU to lookup the address in the cache. If the lookup yields a miss the cache/MMU issues a response to the purge request immediately following the lookup. If the lookup yields a hit to the cache line modified with regard to main memory, the cache controller causes a writeback of the specified line to main memory. If the lookup yields a hit the cache line is invalidated whether or not the line is modified with respect to main memory. Following the invalidation the cache/MMU issues a response to the purge request. The response generated by the cache/MMU in either case is a simple acknowledgement that does not carry any data indicating that main memory and cache are cohered and that the specified memory location is no longer valid in the cache. - The use of flush and purge by a module provides a level of cache coherency. These operations guarantee that a read operation by a module to an address in a shared memory system will receive the value last written to that address. The time of access is given as the time at which the flush is received by the cache controller. The module read operation is guaranteed to get a data value coherent with the value of the system memory no earlier than the time of access. In the case of a write operation by a module to an address in shared memory, the purge operation guarantees that the written data is readable by all memory users after the time of access. The time of access is given as the time at which the write operation is performed to system memory following the purge of the data cache(s).
- In a typical operation, a component coupled to
PCI bus 205 wishes to access a shared memory location, it asserts the memory request using PCI standard DMA signaling protocol toPCI bridge 207. BecauseCPU 201 is not coupled to thePCI bus 205 directly, this signaling protocol is not recognized byCPU 201. Although the operation in accordance with the present invention is described with particular reference toPCI module 207, it should be understood that any module coupled tobus 202 that desires to use shared memory can implement the steps outlined below. - When
PCI module 207 wishes to complete the coherent request to shared memory,module 207 performs the steps shown generally in FIG. 4. Instep 401 the module splits up the memory request into a plurality of non-cache line straddling system interconnect requests. In this manner each request is ensured of affecting a single cache line and the cache/MMU does not need to implement special behavior to recognize and implement cache straddling requests. Both flush requests and purge requests are packetized and addressed to a port associated with cache/MMU inCPU 201 instep 403. The requesting module then waits to receive a response from the cache/MMU instep 404. - For a read operation from shared memory, a load request is then made in
step 405 in a packet addressed to thememory interface unit 203. In the case of a write operation, a store request packet is addressed tomemory interface unit 203 instep 407. Instep 409 external memory interface unit generates a response packet indicating completion of the coherent access. - In this manner the present invention provides cache control instructions that are integrated into the basic transaction set of
bus 202. This feature enables any module coupled tobus 202 to implement cache control and ensure coherent use of shared memory resources. Corresponding logic in the cache/MMU ofCPU 201 responds to the cache control transactions to perform the cache control operation on behalf of the requesting module. - The coherency logic within the requesting module (e.g.,
PCI bridge 207 preferably can specify one or more caching windows and allow remote specification of the caching policy for a particular region in cache to increase coherency performance. This is implemented by providingcontrol register space 501, shown in FIG. 5, that specifies a snoop policy or mode and an address range for snooping. Snoop address register 601 (shown in FIG. 6) withinPCI module 207 that stores one or more addresses. Both snoop control register 501 and snoop address register 601 have any number of lines specifying any number of cache regions with different snoop policies. Each snoop control register has a corresponding snoop address register. - In the particular implementation a 2-bit mode field indicates that whether and how the address in a PCI request is compared to the address stored in the snoop address register. An example encoding is summarized in Table 1.
TABLE 1 00 Snoop address register is not compared 01 Reserved 10 Address is compared, and upon a match the snoop command is not issued. Upon a miss, snoop command is issued 11 Address is compared, and upon a match the snoop command is issued. Upon a miss, snoop command is not issued. - The range field has eight possible values in the particular implementation with each value indicating a range of addresses that will result in a match during the comparison of the memory address in the PCI request and the stored snoop address in
register 601. Essentially, each value of the range field indicates how many bits of the stored snoop address will take part in the comparison. Table 2 summarizes an exemplary encoding.TABLE 2 Value Interpretation Range 000 Compare address bits 31:12 4 kB 001 Compare address bits 31:16 64 kB 010 Compare address bits 31:20 1 MB 011 Compare address bits 31:24 16 MB 100 Compare address bits 31:25 32 MB 101 Compare address bits 31:26 64 Mb 110 Compare address bits 31:27 128 MB 111 Compare address bits 31:28 256 MB - The actual encoding and range sizes as well as the number of discrete ranges that are enabled are a matter of design choice selected to meet the needs of a particular application. In this manner, a cache partition can be implemented by storing an address within a snoop address register 601 with the size of the partition specified by a value stored in the range field of snoop
control register 501. The cache coherency policy for that partition can be controlled by setting the value in the corresponding mode field of snoopcontrol register 501. This feature of the present invention enables the remote specification of the caching policy in a manner that does not require any manipulation of control registers withinCPU 201. Whether or not a flush or purge command is issued is determined by thePCI module 207 and the cache/MMU withinCPU 201 merely responds to execute and acknowledge issued cache control commands. - To implement the above feature,
PCI module 207 will precede step 401 in FIG. 4 with a step of checking whether the shared memory address requested matches an address specified in the snoop address register 601 within the bounds specified by the snoopcontrol register 501. The stored addresses may indicate that a snoop is to be performed, in which case the process proceeds to step 401. Alternatively, when a snoop is not to be performed the process will proceed to 405 and 407 accordinglysteps - The implementation described above can be extended by adding additional bits to the mode field. For example, a particular implementation may implement an optimization based on cache policy. For each defined snoop range a single bit can be used to indicate a selection between two optional behaviors. For example, each snoop range can be assigned a policy of “flush on read, purge on write” or “nothing on read, purge on write”. A single bit in the mode field can allow the choice of policy independently for each cache region. This optional feature reduces the number of unnecessary coherency transaction. Specifically, when the CPU caching policy is write-through then there is no possibility of dirty data existing in the cache and so remote-initiated flushes are redundant. The optimization enables these redundant operations to be avoided.
- While the invention has been particularly shown and described with reference to a preferred embodiment thereof, it will be understood by those skills in the art that various other changes in the form and details may be made without departing from the spirit and scope of the invention. The various embodiments have been described using hardware examples, but the present invention can be readily implemented in software. For example, it is contemplated that a programmable logic device, hardware emulator, software simulator, or the like of sufficient complexity could implement the present invention as a computer program product including a computer usable medium having computer readable code embodied therein to perform precise architectural update in an emulated or simulated out-of-order machine. Accordingly, these and other variations are equivalent to the specific implementations and embodiments described herein.
Claims (15)
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/411,453 US6412047B2 (en) | 1999-10-01 | 1999-10-01 | Coherency protocol |
| JP2000301559A JP5265827B2 (en) | 1999-10-01 | 2000-10-02 | Hybrid coherence protocol |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US09/411,453 US6412047B2 (en) | 1999-10-01 | 1999-10-01 | Coherency protocol |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US09/411,453 Continuation US6412047B2 (en) | 1999-10-01 | 1999-10-01 | Coherency protocol |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US09/411,453 Continuation US6412047B2 (en) | 1999-10-01 | 1999-10-01 | Coherency protocol |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20020019913A1 true US20020019913A1 (en) | 2002-02-14 |
| US6412047B2 US6412047B2 (en) | 2002-06-25 |
Family
ID=23628993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US09/411,453 Expired - Lifetime US6412047B2 (en) | 1999-10-01 | 1999-10-01 | Coherency protocol |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US6412047B2 (en) |
| JP (1) | JP5265827B2 (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030046356A1 (en) * | 1999-11-08 | 2003-03-06 | Alvarez Manuel Joseph | Method and apparatus for transaction tag assignment and maintenance in a distributed symmetric multiprocessor system |
| US20050033919A1 (en) * | 2003-08-07 | 2005-02-10 | International Business Machines Corportioa | Dynamic allocation of shared cach directory for optimizing performanc |
| US20120233409A1 (en) * | 2011-03-11 | 2012-09-13 | Microsoft Corporation | Managing shared memory used by compute nodes |
| US20140040563A1 (en) * | 2012-01-03 | 2014-02-06 | Seoul National University R&Db Foundation | Shared virtual memory management apparatus for providing cache-coherence |
| US20170004084A1 (en) * | 2015-07-01 | 2017-01-05 | Samsung Electronics Co., Ltd. | Cache coherent system including master-side filter and data processing system including same |
| US20170083441A1 (en) * | 2015-09-23 | 2017-03-23 | Qualcomm Incorporated | Region-based cache management |
| US11169921B2 (en) * | 2019-05-09 | 2021-11-09 | Hewlett Packard Enterprise Development Lp | Ternary content addressable memory-enhanced cache coherency acceleration |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6763034B1 (en) * | 1999-10-01 | 2004-07-13 | Stmicroelectronics, Ltd. | Connection ports for interconnecting modules in an integrated circuit |
| DE60226106T2 (en) * | 2001-08-28 | 2009-05-14 | Brother Kogyo K.K., Nagoya | Ink jet recording apparatus |
| US7062609B1 (en) * | 2001-09-19 | 2006-06-13 | Cisco Technology, Inc. | Method and apparatus for selecting transfer types |
| US8185695B2 (en) * | 2008-06-30 | 2012-05-22 | Advanced Micro Devices, Inc. | Snoop filtering mechanism |
| US9280468B2 (en) | 2011-10-26 | 2016-03-08 | Qualcomm Technologies, Inc. | Three channel cache-coherency socket protocol |
| US9424192B1 (en) | 2015-04-02 | 2016-08-23 | International Business Machines Corporation | Private memory table for reduced memory coherence traffic |
| US9842050B2 (en) * | 2015-04-30 | 2017-12-12 | International Business Machines Corporation | Add-on memory coherence directory |
| CN109101439B (en) * | 2017-06-21 | 2024-01-09 | 深圳市中兴微电子技术有限公司 | Message processing method and device |
Family Cites Families (84)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3584690D1 (en) * | 1984-06-20 | 1992-01-02 | Convex Computer Corp | INPUT / OUTPUT BUS FOR COMPUTER. |
| US4935867A (en) | 1986-03-04 | 1990-06-19 | Advanced Micro Devices, Inc. | Signal processor memory management unit with indirect addressing using selectable offsets and modulo values for indexed address calculations |
| US4814981A (en) | 1986-09-18 | 1989-03-21 | Digital Equipment Corporation | Cache invalidate protocol for digital data processing system |
| US4905141A (en) * | 1988-10-25 | 1990-02-27 | International Business Machines Corporation | Partitioned cache memory with partition look-aside table (PLAT) for early partition assignment identification |
| US5483518A (en) | 1992-06-17 | 1996-01-09 | Texas Instruments Incorporated | Addressable shadow port and protocol for serial bus networks |
| JPH0666056B2 (en) | 1989-10-12 | 1994-08-24 | 甲府日本電気株式会社 | Information processing system |
| JPH03217949A (en) | 1990-01-23 | 1991-09-25 | Hitachi Ltd | computer system |
| US5432918A (en) * | 1990-06-29 | 1995-07-11 | Digital Equipment Corporation | Method and apparatus for ordering read and write operations using conflict bits in a write queue |
| US5452432A (en) | 1990-08-14 | 1995-09-19 | Chips And Technologies, Inc. | Partially resettable, segmented DMA counter |
| JP2984463B2 (en) | 1991-06-24 | 1999-11-29 | 株式会社日立製作所 | Microcomputer |
| US5423050A (en) | 1991-11-27 | 1995-06-06 | Ncr Corporation | Intermodule test across system bus utilizing serial test bus |
| US5875464A (en) * | 1991-12-10 | 1999-02-23 | International Business Machines Corporation | Computer system with private and shared partitions in cache |
| JPH0727494B2 (en) * | 1992-01-02 | 1995-03-29 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Computer system with cache snoop / data invalidation function |
| US5724549A (en) | 1992-04-06 | 1998-03-03 | Cyrix Corporation | Cache coherency without bus master arbitration signals |
| US5524212A (en) * | 1992-04-27 | 1996-06-04 | University Of Washington | Multiprocessor system with write generate method for updating cache |
| GB2266606B (en) | 1992-04-27 | 1996-02-14 | Intel Corp | A microprocessor with an external command mode |
| US5448576A (en) | 1992-10-29 | 1995-09-05 | Bull Hn Information Systems Inc. | Boundary scan architecture extension |
| JPH06150023A (en) | 1992-11-06 | 1994-05-31 | Hitachi Ltd | Microcomputer and system thereof |
| JP3231429B2 (en) | 1992-11-06 | 2001-11-19 | 株式会社日立製作所 | Semiconductor integrated circuit device having central processing unit and multiplier |
| JP3524110B2 (en) | 1992-11-06 | 2004-05-10 | 株式会社ルネサステクノロジ | Microcomputer system |
| US5627842A (en) | 1993-01-21 | 1997-05-06 | Digital Equipment Corporation | Architecture for system-wide standardized intra-module and inter-module fault testing |
| JP2731692B2 (en) | 1993-04-28 | 1998-03-25 | 日本電気アイシーマイコンシステム株式会社 | Debug device |
| US5598551A (en) | 1993-07-16 | 1997-01-28 | Unisys Corporation | Cache invalidation sequence system utilizing odd and even invalidation queues with shorter invalidation cycles |
| DE69415600T2 (en) | 1993-07-28 | 1999-07-15 | Koninklijke Philips Electronics N.V., Eindhoven | Microcontroller with hardware troubleshooting support based on the boundary scan method |
| JP3904244B2 (en) | 1993-09-17 | 2007-04-11 | 株式会社ルネサステクノロジ | Single chip data processor |
| EP0652516A1 (en) * | 1993-11-03 | 1995-05-10 | Advanced Micro Devices, Inc. | Integrated microprocessor |
| US5596734A (en) | 1993-12-17 | 1997-01-21 | Intel Corporation | Method and apparatus for programming embedded memories of a variety of integrated circuits using the IEEE test access port |
| US5828825A (en) | 1993-12-22 | 1998-10-27 | Intel Corporation | Method and apparatus for pseudo-direct access to embedded memories of a micro-controller integrated circuit via the IEEE test access port |
| US5519846A (en) * | 1993-12-23 | 1996-05-21 | Unisys Corporation | Multiprocessor system with scheme for managing allocation and reservation of cache segments in a cache system employing round-robin replacement and exclusive access |
| US5434804A (en) | 1993-12-29 | 1995-07-18 | Intel Corporation | Method and apparatus for synchronizing a JTAG test control signal to an on-chip clock signal |
| US5488688A (en) | 1994-03-30 | 1996-01-30 | Motorola, Inc. | Data processor with real-time diagnostic capability |
| US5537635A (en) * | 1994-04-04 | 1996-07-16 | International Business Machines Corporation | Method and system for assignment of reclaim vectors in a partitioned cache with a virtual minimum partition size |
| JPH07287668A (en) | 1994-04-19 | 1995-10-31 | Hitachi Ltd | Data processing device |
| US5577226A (en) * | 1994-05-06 | 1996-11-19 | Eec Systems, Inc. | Method and system for coherently caching I/O devices across a network |
| GB9417602D0 (en) * | 1994-09-01 | 1994-10-19 | Inmos Ltd | A controller for implementing scan testing |
| JPH08329687A (en) * | 1995-06-05 | 1996-12-13 | Hitachi Ltd | Semiconductor integrated circuit |
| JP3713312B2 (en) | 1994-09-09 | 2005-11-09 | 株式会社ルネサステクノロジ | Data processing device |
| JP3740195B2 (en) | 1994-09-09 | 2006-02-01 | 株式会社ルネサステクノロジ | Data processing device |
| JP3672634B2 (en) * | 1994-09-09 | 2005-07-20 | 株式会社ルネサステクノロジ | Data processing device |
| US5848247A (en) | 1994-09-13 | 1998-12-08 | Hitachi, Ltd. | Microprocessor having PC card interface |
| US5613153A (en) | 1994-10-03 | 1997-03-18 | International Business Machines Corporation | Coherency and synchronization mechanisms for I/O channel controllers in a data processing system |
| US5751621A (en) | 1994-11-17 | 1998-05-12 | Hitachi, Ltd. | Multiply-add unit and data processing apparatus using it |
| TW330265B (en) | 1994-11-22 | 1998-04-21 | Hitachi Ltd | Semiconductor apparatus |
| JP2752592B2 (en) * | 1994-12-28 | 1998-05-18 | 日本ヒューレット・パッカード株式会社 | Microprocessor, signal transmission method between microprocessor and debug tool, and tracing method |
| US5778237A (en) | 1995-01-10 | 1998-07-07 | Hitachi, Ltd. | Data processor and single-chip microcomputer with changing clock frequency and operating voltage |
| DE69628079T2 (en) * | 1995-03-31 | 2004-02-26 | Sun Microsystems, Inc., Santa Clara | System level mechanism to devalue data stored in the external cache of a processor in a computer system |
| US5664197A (en) | 1995-04-21 | 1997-09-02 | Intel Corporation | Method and apparatus for handling bus master channel and direct memory access (DMA) channel access requests at an I/O controller |
| US5867726A (en) | 1995-05-02 | 1999-02-02 | Hitachi, Ltd. | Microcomputer |
| US5570375A (en) | 1995-05-10 | 1996-10-29 | National Science Council Of R.O.C. | IEEE Std. 1149.1 boundary scan circuit capable of built-in self-testing |
| US5860127A (en) | 1995-06-01 | 1999-01-12 | Hitachi, Ltd. | Cache memory employing dynamically controlled data array start timing and a microcomputer using the same |
| US5774701A (en) | 1995-07-10 | 1998-06-30 | Hitachi, Ltd. | Microprocessor operating at high and low clok frequencies |
| US5708773A (en) | 1995-07-20 | 1998-01-13 | Unisys Corporation | JTAG interface system for communicating with compliant and non-compliant JTAG devices |
| US5704034A (en) | 1995-08-30 | 1997-12-30 | Motorola, Inc. | Method and circuit for initializing a data processing system |
| US5737516A (en) | 1995-08-30 | 1998-04-07 | Motorola, Inc. | Data processing system for performing a debug function and method therefor |
| JP3655403B2 (en) | 1995-10-09 | 2005-06-02 | 株式会社ルネサステクノロジ | Data processing device |
| US5680571A (en) * | 1995-12-28 | 1997-10-21 | Unisys Corporation | Multi-processor data processing system with multiple, separate instruction and operand second level caches |
| JP3623840B2 (en) * | 1996-01-31 | 2005-02-23 | 株式会社ルネサステクノロジ | Data processing apparatus and microprocessor |
| US5950012A (en) | 1996-03-08 | 1999-09-07 | Texas Instruments Incorporated | Single chip microprocessor circuits, systems, and methods for self-loading patch micro-operation codes and patch microinstruction codes |
| US5978874A (en) | 1996-07-01 | 1999-11-02 | Sun Microsystems, Inc. | Implementing snooping on a split-transaction computer system bus |
| JPH09311786A (en) | 1996-03-18 | 1997-12-02 | Hitachi Ltd | Data processing device |
| GB2311880A (en) * | 1996-04-03 | 1997-10-08 | Advanced Risc Mach Ltd | Partitioned cache memory |
| JP3269967B2 (en) * | 1996-04-24 | 2002-04-02 | 株式会社日立製作所 | Cache coherency control method and multiprocessor system using the same |
| JP3579205B2 (en) | 1996-08-06 | 2004-10-20 | 株式会社ルネサステクノロジ | Semiconductor storage device, semiconductor device, data processing device, and computer system |
| GB9617033D0 (en) | 1996-08-14 | 1996-09-25 | Int Computers Ltd | Diagnostic memory access |
| US5768152A (en) | 1996-08-28 | 1998-06-16 | International Business Machines Corp. | Performance monitoring through JTAG 1149.1 interface |
| WO1998013759A1 (en) | 1996-09-27 | 1998-04-02 | Hitachi, Ltd. | Data processor and data processing system |
| JP3790307B2 (en) | 1996-10-16 | 2006-06-28 | 株式会社ルネサステクノロジ | Data processor and data processing system |
| JPH10177520A (en) | 1996-10-16 | 1998-06-30 | Hitachi Ltd | Data processor and data processing system |
| JP3641327B2 (en) | 1996-10-18 | 2005-04-20 | 株式会社ルネサステクノロジ | Data processor and data processing system |
| GB9622686D0 (en) | 1996-10-31 | 1997-01-08 | Sgs Thomson Microelectronics | A test port controller and a method of effecting communication using the same |
| US5983017A (en) | 1996-11-12 | 1999-11-09 | Lsi Logic Corporation | Virtual monitor debugging method and apparatus |
| US5953538A (en) | 1996-11-12 | 1999-09-14 | Digital Equipment Corporation | Method and apparatus providing DMA transfers between devices coupled to different host bus bridges |
| US5771240A (en) | 1996-11-14 | 1998-06-23 | Hewlett-Packard Company | Test systems for obtaining a sample-on-the-fly event trace for an integrated circuit with an integrated debug trigger apparatus and an external pulse pin |
| US5956477A (en) | 1996-11-25 | 1999-09-21 | Hewlett-Packard Company | Method for processing information in a microprocessor to facilitate debug and performance monitoring |
| JP3849951B2 (en) * | 1997-02-27 | 2006-11-22 | 株式会社日立製作所 | Main memory shared multiprocessor |
| US5896550A (en) | 1997-04-03 | 1999-04-20 | Vlsi Technology, Inc. | Direct memory access controller with full read/write capability |
| US5978902A (en) | 1997-04-08 | 1999-11-02 | Advanced Micro Devices, Inc. | Debug interface including operating system access of a serial/parallel debug port |
| US5937172A (en) * | 1997-04-14 | 1999-08-10 | International Business Machines Corporation | Apparatus and method of layering cache and architectural specific functions to permit generic interface definition |
| US5944841A (en) | 1997-04-15 | 1999-08-31 | Advanced Micro Devices, Inc. | Microprocessor with built-in instruction tracing capability |
| JPH11149410A (en) * | 1997-11-17 | 1999-06-02 | Nec Corp | System for transmitting cancel signal for transaction exclusively hit to copy tag memory |
| US6292705B1 (en) * | 1998-09-29 | 2001-09-18 | Conexant Systems, Inc. | Method and apparatus for address transfers, system serialization, and centralized cache and transaction control, in a symetric multiprocessor system |
| GB9802097D0 (en) * | 1998-01-30 | 1998-03-25 | Sgs Thomson Microelectronics | DMA controller |
| GB9806184D0 (en) * | 1998-03-23 | 1998-05-20 | Sgs Thomson Microelectronics | A cache coherency mechanism |
| GB9809203D0 (en) * | 1998-04-29 | 1998-07-01 | Sgs Thomson Microelectronics | Packet distribution in a microcomputer |
-
1999
- 1999-10-01 US US09/411,453 patent/US6412047B2/en not_active Expired - Lifetime
-
2000
- 2000-10-02 JP JP2000301559A patent/JP5265827B2/en not_active Expired - Lifetime
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030046356A1 (en) * | 1999-11-08 | 2003-03-06 | Alvarez Manuel Joseph | Method and apparatus for transaction tag assignment and maintenance in a distributed symmetric multiprocessor system |
| US7529799B2 (en) * | 1999-11-08 | 2009-05-05 | International Business Machines Corporation | Method and apparatus for transaction tag assignment and maintenance in a distributed symmetric multiprocessor system |
| US20050033919A1 (en) * | 2003-08-07 | 2005-02-10 | International Business Machines Corportioa | Dynamic allocation of shared cach directory for optimizing performanc |
| US7089361B2 (en) * | 2003-08-07 | 2006-08-08 | International Business Machines Corporation | Dynamic allocation of shared cache directory for optimizing performance |
| US20120233409A1 (en) * | 2011-03-11 | 2012-09-13 | Microsoft Corporation | Managing shared memory used by compute nodes |
| US8832388B2 (en) * | 2011-03-11 | 2014-09-09 | Microsoft Corporation | Managing shared memory used by compute nodes |
| US20140040563A1 (en) * | 2012-01-03 | 2014-02-06 | Seoul National University R&Db Foundation | Shared virtual memory management apparatus for providing cache-coherence |
| US9208088B2 (en) * | 2012-01-03 | 2015-12-08 | Seoul National University R&Db Foundation | Shared virtual memory management apparatus for providing cache-coherence |
| US20170004084A1 (en) * | 2015-07-01 | 2017-01-05 | Samsung Electronics Co., Ltd. | Cache coherent system including master-side filter and data processing system including same |
| US9864687B2 (en) * | 2015-07-01 | 2018-01-09 | Samsung Electronics Co., Ltd. | Cache coherent system including master-side filter and data processing system including same |
| US20170083441A1 (en) * | 2015-09-23 | 2017-03-23 | Qualcomm Incorporated | Region-based cache management |
| US11169921B2 (en) * | 2019-05-09 | 2021-11-09 | Hewlett Packard Enterprise Development Lp | Ternary content addressable memory-enhanced cache coherency acceleration |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2001147858A (en) | 2001-05-29 |
| JP5265827B2 (en) | 2013-08-14 |
| US6412047B2 (en) | 2002-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7000078B1 (en) | System and method for maintaining cache coherency in a shared memory system | |
| US11822786B2 (en) | Delayed snoop for improved multi-process false sharing parallel thread performance | |
| US6366984B1 (en) | Write combining buffer that supports snoop request | |
| US6721848B2 (en) | Method and mechanism to use a cache to translate from a virtual bus to a physical bus | |
| JP3365433B2 (en) | Cache memory structures and their use | |
| TWI391821B (en) | Processor unit, data processing system and method for issuing a request on an interconnect fabric without reference to a lower level cache based upon a tagged cache state | |
| US5561779A (en) | Processor board having a second level writeback cache system and a third level writethrough cache system which stores exclusive state information for use in a multiprocessor computer system | |
| US6470429B1 (en) | System for identifying memory requests as noncacheable or reduce cache coherence directory lookups and bus snoops | |
| US6463510B1 (en) | Apparatus for identifying memory requests originating on remote I/O devices as noncacheable | |
| US5797026A (en) | Method and apparatus for self-snooping a bus during a boundary transaction | |
| US6412047B2 (en) | Coherency protocol | |
| US20040039880A1 (en) | Method and apparatus for shared cache coherency for a chip multiprocessor or multiprocessor system | |
| US20130080709A1 (en) | System and Method for Performing Memory Operations In A Computing System | |
| JP2010507160A (en) | Processing of write access request to shared memory of data processor | |
| JPH10187645A (en) | Multi-process system configured to store in coherence within multiple sub-nodes of a process node | |
| US6321307B1 (en) | Computer system and method employing speculative snooping for optimizing performance | |
| US7360031B2 (en) | Method and apparatus to enable I/O agents to perform atomic operations in shared, coherent memory spaces | |
| US5829027A (en) | Removable processor board having first, second and third level cache system for use in a multiprocessor computer system | |
| JPH06318174A (en) | Cache memory system and method for performing cache for subset of data stored in main memory | |
| JPH04102948A (en) | Data processing system and method | |
| KR100322223B1 (en) | Memory controller with oueue and snoop tables | |
| CA2148186A1 (en) | Processor board having a second level writeback cache system and a third level writethrough cache system which stores exclusive state information for use in a multiprocessor computer system | |
| US6976130B2 (en) | Cache controller unit architecture and applied method | |
| US6629213B1 (en) | Apparatus and method using sub-cacheline transactions to improve system performance | |
| CN110737407A (en) | data buffer memory realizing method supporting mixed writing strategy |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: STMICROELECTRONICS, INC., TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHIMIZU, D.;JONES, ANDREW;REEL/FRAME:011020/0373 Effective date: 19991109 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| AS | Assignment |
Owner name: STMICROELECTRONICS LIMITED, UNITED KINGDOM Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:STMICROELECTRONICS, INC.;REEL/FRAME:014294/0156 Effective date: 20040126 |
|
| FPAY | Fee payment |
Year of fee payment: 4 |
|
| FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
| FPAY | Fee payment |
Year of fee payment: 8 |
|
| SULP | Surcharge for late payment |
Year of fee payment: 7 |
|
| FPAY | Fee payment |
Year of fee payment: 12 |