[go: up one dir, main page]

WO1997046029A1 - Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral - Google Patents

Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral Download PDF

Info

Publication number
WO1997046029A1
WO1997046029A1 PCT/US1996/009539 US9609539W WO9746029A1 WO 1997046029 A1 WO1997046029 A1 WO 1997046029A1 US 9609539 W US9609539 W US 9609539W WO 9746029 A1 WO9746029 A1 WO 9746029A1
Authority
WO
WIPO (PCT)
Prior art keywords
spectral components
image
group
polarization state
perspective
Prior art date
Application number
PCT/US1996/009539
Other languages
English (en)
Inventor
Sadeg M. Faris
Original Assignee
Reveo, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Reveo, Inc. filed Critical Reveo, Inc.
Priority to AU62621/96A priority Critical patent/AU6262196A/en
Priority to PCT/US1996/009539 priority patent/WO1997046029A1/fr
Publication of WO1997046029A1 publication Critical patent/WO1997046029A1/fr

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/337Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using polarisation multiplexing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/22Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type
    • G02B30/25Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes of the stereoscopic type using polarisation techniques
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/161Encoding, multiplexing or demultiplexing different image signal components
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/214Image signal generators using stereoscopic image cameras using a single 2D image sensor using spectral multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/239Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/257Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/275Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/296Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/324Colour aspects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/334Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using spectral multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/341Displays for viewing with the aid of special glasses or head-mounted displays [HMD] using temporal multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/363Image reproducers using image projection screens
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/15Processing image signals for colour aspects of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/189Recording image signals; Reproducing recorded image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194Transmission of image signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/211Image signal generators using stereoscopic image cameras using a single 2D image sensor using temporal multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • H04N13/207Image signal generators using stereoscopic image cameras using a single 2D image sensor
    • H04N13/218Image signal generators using stereoscopic image cameras using a single 2D image sensor using spatial multiplexing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/286Image signal generators having separate monoscopic and stereoscopic modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/597Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding specially adapted for multi-view video sequence encoding

Definitions

  • the present invention relates to a method and apparatus for producing and displaying spectrally-multiplexed images of three- dimensional imagery for use in stereoscopic viewing thereof free of spectrally-produced image flicker.
  • each of these stereo imaging techniques involve image recording (i.e. generation) and image display processes. During the image generation process, left and right perspective images (or sequences of perspective images) of 3-D scenery are produced and subsequently recorded on a suitable recording medium.
  • the recorded left and right perspective images are produced as if actually viewed with the inter-pupil distance of a human observer. Then, during the image display process, the visible light associated with the left and right perspective images is visually presented to the left and right eyes of viewers, respectively, while minimizing the amount of visible light from the left and right perspective images that impinge upon the right and left eyes of the viewer, respectively.
  • the left and right perspective images of the 3-D scenery are viewed by the left and right eyes of the viewer, a stereoscopic image of the 3-D scenery is perceived, complete with full spatial and depth information of the actual 3-D scenery.
  • the left and right perspective images of the 3-D scenery are displayed to viewers during different display periods (i.e. left and right perspective display periods).
  • left and right perspective display periods To ensure that only left perspective images of the 3-D scenery are presented to the left eyes of viewers, the right eye of each viewer is not allowed to view the left perspective image during the left perspective image display period.
  • the left eye of each viewer is not allowed to view the right perspective image during the right
  • this perspective image "blocking" or selective viewing process is achieved using a pair of liquid crystal light valves (LCLV) as the lenses in special eye wear (e.g. shutter glasses) worn by each viewer using a 3-D image viewing system based on such principles.
  • LCLV liquid crystal light valves
  • a controller is required in order to drive the left LCLV lens during each left perspective image display period, and drive the right LCLV lens during each right perspective image display period.
  • left and right perspective images of 3-D scenery are spatially multiplexed during the image generation process in order to produce a spatially multiplexed composite image.
  • this perspective image "blocking" or selective-viewing process is achieved using a pair of spatially different polarizing lenses mounted in eye wear (e.g. spectacles) worn by each viewer using a 3-D video display system based on such principles of operation.
  • 3-D image display systems based upon time- multiplexing principles are notoriously plagued by "image flicker" problems.
  • 3-D video display systems based upon spatial- multiplexing principles are inherently free from the "image flicker" problem associated with time-multiplexed 3-D display systems
  • spatial-multiplexed 3-D display systems require the use of micropolarizers mounted onto display surfaces (e.g. CRT displays, flat panel liquid-crystal displays, light valve projectors, etc.) from which the polarized light of spatially-multiplexed images emanates. Consequently, this requirement necessitates specially manufactured display and projection surfaces which, in particular applications, can impose undesirable limitations upon the stereoscopic viewing process.
  • these RGB signals are combined such that (i) the green and blue spectral components of a left perspective image (of a 3-D object) are combined with the red spectral components of a right perspective image for display in Field A of the display screen during a first display period, and that (ii) the red spectral component of the left perspective image are combined with the green and blue spectral components of the right perspective image for display in Field Bof the display screen during a second display period.
  • the viewer sees the display screen through one of several disclosed viewing means 24, driven by an amplifier 24A in synchronism with gating signal 22. As disclosed at lines 49-62 in Col.
  • the viewing device ensures that left eye 6 first sees the information in Field A which corresponds to the left perspective image (G2 and B2), while the right eye 7 sees the information contained in Field A which corresponds to the right perspective image (RI). Then during the viewing of Field B, the left eye sees R2 and the right eye sees GI and Bl.
  • Figs. 2A and 2B of U.S. Patent No. 4,641 ,178, Street discloses an electro-mechanical type viewing device comprising two rotating cylinders 32, 37 having color transmissive properties which selectively transmit the required spectral components to the viewers eyes during each first and second display period, as the cylinders are rotated in synchronism with the gating signal 22.
  • Street discloses an opto-mechanical viewing device positionable in front of a CRT screen and viewable through a pair of passive polarizing spectacles 59.
  • Fig. 6A of U.S. Patent No. 4,641 ,178, Street discloses a pair of mechanical shutters for viewing spectrally multiplexed images produced by the system of Fig. 1.
  • each mechanical shutter comprises an alternating array of red stripes 89 and blue/green transmitting stripes 90 situated immediately behind a slotted lightweight plate 91 rapidly oscillated by an actuator 92 fed by electrical signals synchronized to the frame rate of the system.
  • Street discloses in Fig. 6B a pair of electro-optical shutter assemblies shutters for viewing spectrally multiplexed images produced the system of Fig. 1.
  • each electro- optical shutter assembly comprises an alternating array of red transmitting stripes and blue/green transmitting stripes 93 , situated behind an electro-optical shutter panel formed by a layer of liquid crystal material 97 sandwiched between a series of electrically isolated fingers 95A and 95B and a transparent sheet electrode 94.
  • striped filter material 93 and electro-optical shutter panel are sandwiched between sheets of polarizing layers 93A and 93B.
  • fingers 95A are positioned in front of all transmitting stripes made of one color filter material, while the fingers 95B are positioned in front of the other transmitting stripes made of the other color filter material.
  • U.S. Patent No. 4,995,718 to Jachimowicz, et al. proposes a 3-D color video projection display system which supports both image recording (i.e. generation) and display processes.
  • image recording i.e. generation
  • display processes In particular, during the image generation process, left and right perspective color video images of 3-D scenery are recorded. Then during a first display period in the image projection process, the red and blue spectral components (i.e. magenta) of the left perspective color image are imparted with a first light polarization state and
  • the separately projected left and right perspective images must be spatially superimposed (i.e. aligned) in order that these differently polarized spectral components are recombined or "multiplexed" on the projection display screen, which is adapted to preserve the polarization states of the multiplexed spectral components.
  • the viewers are each required to wear spectacles having a left lens characterized by the first polarization state, and a right lens characterized by the second polarization state.
  • the green spectral components of the left perspective color image are imparted with a first light polarization state and then projected onto the display screen using the first image projector, while the magenta spectral components of the right perspective color image are imparted with a second light polarization state and then projected onto the display screen using the second image projector.
  • the separately projected left and right perspective images must be spatially superimposed (i.e. aligned) in order that these differently polarized spectral components are recombined (i.e. multiplexed) on the projection display screen.
  • the polarized spectacles worn by each viewer ensure that only the green spectral components of the left perspective image are visually presented to the left eyes of viewers during the first display period, while only the magenta spectral components of the right perspective image are visually presented to the right eyes of the viewers.
  • a stereoscopic image of the 3-D scenery is perceived, complete with full spatial and depth information of the actual 3-D scenery .
  • a further object of the present invention is to provide a method and system for producing and displaying spectrally- multiplexed color images of 3-D scenery for use in stereoscopic viewing thereof substantially free of spectrally-produced image flicker.
  • a further object of the present invention is to provide a method of producing a pair of spectrally-multiplexed color images of 3-D scenery which have spectral characteristics that avoid spectrally-produced image flicker during display processes.
  • a further object of the present invention is to provide such an improved method and system for producing pairs of spatially- multiplexed composite images of 3-D imagery, wherein the spectral components of spatially corresponding pixels in the left and right perspective images are multiplexed (i.e. combined) on a
  • a further object of the present invention is to provide a method and system for direct stereoscopic viewing of 3-D imagery using pairs of spectrally-multiplexed composite images produced by the method and system described above.
  • a further object of the present invention is to provide a method of producing spectrally-multiplexed color images of 3-D scenery, from a diverse array of devices, including computer systems, camera systems, laser-disc playback units, video-tape recording and playback units, color image scanners, television signal receivers and the like.
  • a further object of the present invention is to provide an electro-optical device for multiplexing selected spectral components in perspective color images of 3-D scenery, during the production of spectrally-multiplexed color images(SMCI) thereof substantially free of spectrally-produced flicker.
  • a further object of the present invention is to provide a system and method for displaying pairs of spectrally-multiplexed color images of 3-D scenery in order to permit color stereoscopic viewing thereof.
  • a further object of the present invention is to provide a method and apparatus for displaying spectrally-multiplexed color images of 3-D scenery on diverse display surfaces including CRT display surfaces, flat-panel liquid-crystal display (LCD) surfaces, electro-luminescent panel display surfaces, projection screen surfaces, and other display surfaces capable of displaying gray-
  • a further object of the present invention is to embody such a method and apparatus within conventional desktop, laptop, and notebook computer systems in order to provide full 3-D color display capabilities to users thereof.
  • An even further object of the present invention is to provide a portable computer system capable of displaying pairs of spectrally-multiplexed color images of 3-D scenery in order to permit color stereoscopic viewing thereof while wearing a pair of electrically passive or electrically-active polarized spectacles during the display process.
  • a further object of the present invention is to provide such a color stereoscopic display system and method, in which stereoscopic viewing of 3-D scenery is achievable while wearing a pair of electrically-passive polarized spectacles during the display process.
  • a further object of the present invention is to provide such a color stereoscopic display system and method, in which viewing of 3-D scenery is achievable while wearing a pair of electrically- active polarized spectacles during the display process.
  • An even further object of the present invention is to provide a an electro-optical device for use in polarizing selected spectral components in spectrally-multiplexed color images of 3-D scenery during the stereoscopic display thereof.
  • a further object of the present invention is to provide a method of and system for recording and displaying spectrally- multiplexed color images of 3-D scenery, which can be readily utilized in conventional television transmission and distribution l( systems, such as cable television systems and networks, without substantial modification to the same.
  • Fig. 1 is a block schematic diagram of the apparatus for producing and displaying spectrally-multiplexed color images (SMCI) of 3-D scenery for use in stereoscopic viewing thereof in accordance with the present invention
  • SMCI spectrally-multiplexed color images
  • Fig 2 is a block schematic diagram of a generic device for producing spectrally-multiplexed color images of 3-D scenery from pairs of left and right perspective color images thereof;
  • Fig 3 is a block schematic diagram of a computer system programmed in accordance with the principles of the present invention and capable of producing pairs of spectrally-multiplexed color images of 3-D scenery from pairs of left and right perspective color images thereof;
  • Figs 3A to 3D provide a schematic representation of the pixel-data processing method carried out by the computer system of Fig. 3 in order to produce pairs of spectrally-multiplexed color images of 3-D scenery from pairs of left and right perspective color images thereof;
  • Fig. 4 is a schematic block diagram of a first embodiment of the camera system of the present invention which produces spectrally-multiplexed color images of 3-D scenery from pairs of left and right perspective color images thereof;
  • Fig. 4A is a perspective view of a generic optical-image spectrum multiplexer (OISM) in accordance with the present invention;
  • OISM optical-image spectrum multiplexer
  • Figs. 4B and 4C taken together, show a flow chart illustrating an optical image processing method carried out by the camera system of Fig.4 in order to produce pairs of spectrally- multiplexed color images from pairs of left and right perspective color images thereof;
  • Fig. 5 A is a detailed schematic diagram showing an exploded view of a first illustrative embodiment of the optical-image spectrum multiplexer shown in Fig.4A;
  • Fig.5B is a perspective view of the optical image spectrum multiplexer of the present invention, shown fully assembled
  • Fig. 5C is a schematic representation illustrating the magnitude versus wavelength response characteristics of an exemplary optical image having multiple groups of spectral components, which are provided to the input surface of the optical image spectrum multiplexer shown in Fig.5A;
  • Fig.5D is a schematic representation illustrating the magnitude versus wavelength response characteristics of the optical image emerging from the output surface of the optical image spectrum multiplexer shown in Fig.5A, when the control voltage provided thereto has a first pre specified value;
  • Fig.5E is a schematic representation illustrating the magnitude versus wavelength response characteristics of the optical image emerging from the output surface of the optical image spectrum multiplexer shown in Fig.5A, when the control voltage provided thereto has a second pre specified value
  • Fig.5F is a particular embodiment of the optical-image spectrum multiplexer of the present invention shown in Fig.5A, particularly adapted for multiplexing the spectral component groups associated with the colors green, red and blue;
  • Fig.5G is a schematic representation illustrating the transmission versus wavelength response characteristics of an exemplary optical image provided to the input surface of the optical image spectrum multiplexer shown in Fig.5F ;
  • Fig. 5H is a schematic representation illustrating the transmission versus wavelength response characteristics of the optical image emerging from the output surface of the optical image spectrum multiplexer shown in Fig.5E, when the control voltage provided thereto has a first value;
  • Fig.5I is a schematic representation illustrating the transmission versus wavelength response characteristics of the optical image emerging from the output surface of the optical image spectrum multiplexer shown in Fig.5;
  • Figs.6 A and 6B are schematic representations of a first illustrative embodiment of the solid-state camera system of the present invention, employing a pair of optical-image spectrum multiplexers of the type shown in Fig.5C in order to produce a pair of spectrally-multiplexed color images of 3-D scenery from two pairs of left and right perspective images thereof;
  • Fig.6C is a table illustrating which spectral components are multiplexed, optically combined, and subsequently recorded /
  • Fig.7A is a schematic block diagram of a second illustrative embodiment of the solid-state camera system of the present invention, employing digital signal processing in order to produce a pair a pair of spectrally-multiplexed color images of 3-D scenery from a single pair of left and right perspective color images thereof;
  • Figs.7B through 7E taken together, provide a schematic representation of a digital image processing method carried out by the camera system shown in Fig.7A in order to produce a pair of spectrally-multiplexed color images of 3-D scenery from a single pair of left and right perspective images thereof;
  • Figs. ⁇ A and 8B taken together, provide a schematic representation of a system and method for displaying a pair of spectrally-multiplexed color images of 3-D scenery, stereoscopically viewable through a pair of electrically-active polarized lenses, each incorporating either the optical-image spectrum polarizer of the present invention shown in Figs.9 A or 9C;
  • Fig.9A is an exploded schematic diagram of a first embodiment of the optical-image spectrum polarizer of the present invention employed in the display system of Figs. ⁇ A and 8B, and particularly adapted to impart one of two possible polarization states to the multiple spectral component groups present in the spectrally-multiplexed color images being displayed;
  • Fig.9B is a schematic representation illustrating the magnitude versus wavelength response characteristics of an exemplary optical image of arbitrary spectral intensity, provided to the input surface of the optical image spectrum polarizer shown in Fig.9A ;
  • Figs 9C and 9D are schematic representations illustrating the polarization versus wavelength response characteristics of the optical-image spectrum polarizer shown in Fig.9A during the first and second cyclical display periods of the stereoscopic image display process of the present invention
  • Fig.9E is an exploded schematic diagram of a second illustrative embodiment of the optical-image spectrum polarizer of the present invention, particularly adapted to impart one of two possible polarization states to the spectral component groups .associated with the colors green, red and blue typically present in spectrally-multiplexed color images being displayed;
  • Fig.9F is a schematic representation illustrating the polarization versus wavelength response characteristics of an exemplary color optical image provided to the input surface of the optical image spectrum polarizer shown in Fig.9E;
  • Figs.9G and 9H are schematic representations illustrating the polarization versus wavelength response characteristics of the optical-image spectrum polarizer shown in Fig.9E, exhibited during the first and second cyclical display periods of the image display process of the present invention
  • Fig.lOA is a schematic representation of a system adapted for receiving a pair of spectrally-multiplexed color images of 3-D scenery from a selected SCMI generating device of the present invention, and for displaying the same so that the 3-D imagery is stereoscopically viewable through a pair of electrically-active polarized spectacles worn by the viewer;
  • Fig.lOB is a table illustrating which spectral components are displayed by the system of Fig.lOA during the cyclical display periods of the spectral-polarizing display process of the present invention
  • Fig. IOC is a perspective view of an electrically-active pair of polarizing spectacles constructed in accordance with the present invention
  • Fig.l l A is a schematic representation of a projection-type system for displaying a pair of spectrally-multiplexed color images of 3-D scenery, stereoscopically viewable through a pair of electrically-active, radio-frequency linked, polarized lenses worn by the viewer and embodying the optical-image spectrum polarizers shown in Fig.9E;
  • Fig.l lB is a table illustrating which spectral components are displayed by the system of Fig.l lA during the cyclical display periods of the image display process of the present invention
  • Figs.l2A and 12B taken together, provide a schematic representation of a method and system for displaying pairs of spectrally-multiplexed color images of 3-D scenery, stereoscopically viewable through a pair of electrically-passive polarized spectacles worn by the viewer;
  • Fig.l2C is a table illustrating which spectral components are displayed by the system of Figs.l2A and 12B during the cyclical display periods of the image display process of the present invention
  • Fig.l3A is a schematic representation of an LCLV type projection system for displaying a pair of spectrally-multiplexed
  • Fig.l 3B is a table illustrating which spectral components are displayed by the system of Fig.l 3A during the cyclical display periods of the spectral-polarizing display process of the present invention
  • Fig.l4A is a perspective diagram of a portable computer having a color stereoscopic display system constructed in accordance with the principles of the present invention
  • Fig.l4B is a block diagram of the portable computer shown in Fig. 14A;
  • Fig.15 is a table illustrating the magnitude values for the spectral component groups of exemplary left and right perspective color images which, when processed to produce spectrally- multiplexed color images, may result in potential image-flicker during stereoscopic viewing thereof;
  • Figs.l6A and 16B are schematic representations illustrating the pixel-data processing operations performed during a modified method of producing spectrally-multiplexed color images according to the present invention, such that the potential of image-flicker is eliminated during the stereoscopic viewing process of the present invention;
  • Figs.l7A to 17G taken together, provide a flow chart illustrating the steps performed during the modified method of producing spectrally-multiplexed color images according to the present invention
  • Fig.18 is a block schematic diagram of a 3-D color television signal transmission and distribution system constructed in accordance with the principles of the present invention.
  • FIG. 19 is schematic diagram illustrating a conventional color television system adapted with the spectral polarization panel of the present invention and interconnected with a cable television signal receiving device within the 3-D color television signal transmission and distribution of the present invention.
  • the present invention embraces both the production and display of spectrally-multiplexed images of 3- D imagery in a manner which permit viewers to stereoscopically view the same with the perception of full depth and three dimensionality, yet free of spectrally-produced image flicker.
  • 3-D imagery shall be understood to include any form of imagery, real or synthetic, concrete or abstract, having structural, graphical or ornamental features representable within three or more dimensions, which may include, but certainly is not limited to, three-dimensional physical space in which the spatial dimensionality of object are conventionally represented.
  • the term “spectrally-multiplexed” and “spectral-multiplexing” shall be understood to include the selective combining of spectral components of two or more perspective optical images of 3-D scenery, as well as the selective combining of pixel color values (i.e. codes) of perspective image data.
  • the present invention can be used to produce and display either color or gray-scaled spectrally-multiplexed images of 3-D scenery
  • the illustrative embodiments of the present invention shall be described hereinafter using color perspective images, although it shall be understood that gray-scaled (e.g. black and white) perspective images can be utilized with excellent results to produce and display spectrally-multiplexed gray-scaled images of 3-D scenery.
  • spectrally-multiplexed color images can be produced using a spectrally-multiplexed color image producing camera system 1 , a SMCI producing computer system 2, or any other SMCI producing device 4 constructed and operated in accordance with the principles of the present invention.
  • SMCI spectrally-multiplexed color images
  • Such apparatus and processes will be described in great detail with reference to Figs.2 through 7E.
  • spectrally-multiplexed gray- scaled and color images can be stereoscopically displayed using a number of different type display systems constructed and operated in accordance with the principles of the present invention.
  • Such display systems are generally represented by the block designated by reference numeral 3 in Fig.l .
  • Such apparatus and processes will be described in great detail hereinafter with reference to Figs. 8A through 14B.
  • a spectrally-multiplexed image generator 4 is schematically illustrated.
  • pairs of spectrally-multiplexed color images, I S M ⁇ (l,k) and I sM ⁇ (2,k) are sequentially displayed at a video frame display rate in excess of the flicker frequency (e.g. , 30 frames per second) in order to enable a viewer to perceive 3-D scenery with full three dimensionality and depth perception, along a particular point of view.
  • each such spectrally-multiplexed color image displayed contains a selected group of spectral components (e.g. red and blue color related spectral components or green color related spectral components) taken from the left and right perspective color images K and I.
  • spectral components e.g. red and blue color related spectral components or green color related spectral components
  • the SMCI computer system (e.g. workstation) 5 of the illustrative embodiment comprises a number of integrated system components, namely: one or more central processing units 6 (e.g. microprocessor); program memory storage 7 for storing an operating system program, application programs, and various image processing routines of the present invention; random access data storage memory (e.g.
  • VRAM 8 for storing left and right color perspective images of a 3-D object or scene, upon which spectral multiplexing is to be performed; a mass-type data storage memory 9 for storing produced pairs of spectrally- multiplexed color images ⁇ lsM ⁇ (l,k),IsMct(2,k) ⁇ ; a visual display unit 10 having a visual display screen or surface; a keyboard or other text input device 11 ; a pointing and selecting device (.e.g. mouse or track-ball) 12; and one or more video output devices 13, such as CD-ROM or stereo-video camera.
  • processor 6 by way of one or more system buses 14 in a manner known in the art.
  • the operating system may be Unix® X-Windows, allowing the processor to support at least two input/output windows, pointing and selecting device 12, and multi-media input and output devices 13. It is understood, however, that other suitable operating system programs can be used with acceptable results.
  • conventional computational algorithms can be used to generated left and right color perspective images with the computer system.
  • graphics software is commercially available for creating high resolution 3-D color models, renderings and animations , as well as performing perspective image generation functions upon Intel 386/486 microprocessor based personal computer systems.
  • Exemplary software is available from Autodesk, Inc. of Sausalito, California under the trademark "Autodesk 3D Studio," Release 2.
  • each such perspective color image produced within the SMCI computer system comprises a matrix of pixels.
  • Each pixel in the image matrix is designated as
  • the color value of each pixel contains a magnitude for each of the spectral components, e.g. ⁇ g ⁇ ../ ⁇ , ⁇ fc../ ⁇ , ⁇ r ⁇ .., ⁇ , constituting the system of color representation being used in the illustrative embodiment.
  • the left and right color perspective images are stored in data storage memory (e.g. frame buffers) 7 and are then processed by processor 6 in accordance with the spectral- multiplexing algorithm schematically illustrated in Fig 3 A.
  • the spectral-multiplexing algorithm comprises six stages of data processing which together produce pairs of spectrally-
  • the processor selects the color value (i.e.
  • Block C the processor writes the selected pixel color value to the corresponding pixel location in a first image buffer set up in data storage memory 8.
  • the processor selects the color value (i.e.
  • the processor processes the spectrally filtered images residing in the first and second image buffers so as to produce a first spectrally-multiplexed color image I sMd(l,k) .
  • the processor adds together the corresponding color values ⁇ r.., ⁇ , ⁇ g... ⁇ , ⁇ &., ⁇ in order to yield the
  • the processor proceeds to perform pixel-data processing operations -
  • the first step in the fourth stage of the spectral-multiplexing algorithm involves accessing once again from data storage memory 8, the frame of digital data representative of the left perspective color image L where each pixel therein is designated as
  • the processor selects the color value (i.e. color code) associated with the second predefined spectral component group SCG2 (i.e. ⁇ g ⁇ ). Then at Block K the processor writes the selected pixel color value to the corresponding pixel location in a fourth image buffer set up in data storage memory 8.
  • the processor performs the pixel- data processing operations set forth at Blocks M through P.
  • the processor is carrying out the pixel-data processing operations set forth at Blocks I through L, it also carries out in parallel corresponding operations at Blocks I' through L'. For purposes of completion, these pixel-data processing operations will be described below.
  • the first step in the fifth stage of the spectral-multiplexing algorithm involves accessing once again from data storage memory 8, the frame of digital data representative of the right perspective color image I » where each pixel therein is designated as
  • the processor selects the color value (i.e. color codes) associated with the first predefined spectral component group SCG1 (i.e. ⁇ r ⁇ , ⁇ b ⁇ ). Then at Block K 1 the processor writes the selected pixel color value to the corresponding pixel location in a fifth image buffer set up in data storage memory 8.
  • the processor processes the spectrally filtered images residing in the fourth and fifth image buffers so as to produce the second spectrally-multiplexed color image L M ⁇ (2,k).
  • the processor adds together the corresponding color codes (r,,, ⁇ , ⁇ g,. k ⁇ , ⁇ b.. y ⁇ in order to yield the (i,j)- th spectrally-multiplexed pixel PsM ⁇ (x ⁇ ,yj) in the second spectrally- multiplexed color image Is M ⁇ (2,k). in the k-th stereo image pair thereof.
  • the processor writes the spectrally- multiplexed pixel Ps M ⁇ (x ⁇ ,yj) into its spatially corresponding pixel location in a sixth image buffer set up in data storage memory 8.
  • these pixel-data processing operations are performed for each set of spatially corresponding pixels residing in the fourth and fifth image buffers until the entire second spectrally-multiplexed color image IsM ⁇ (2,k). is generated .
  • the second spectrally-multiplexed color image L M ⁇ (2,k). is stored in a second image buffer set up in data storage memory 9 along with the first spectrally-multiplexed color image I_M ⁇ (l,k). for future access and display.
  • UP spectrally-multiplexed color images comprise a spectrally- multiplexed color image pair ⁇ lsM ⁇ (l,k),IsM ⁇ (2,k) ⁇ , containing sufficient visual information for stereoscopic viewing of the original 3-D scene or object modeled in the computer system.
  • the above- described data processing method can be repeated upon left and right perspective color images of either real or synthetic 3-D scenery and objects in order to produce spectrally-multiplexed color image pairs at a sufficiently high rate to support 3-D stereoscopic display and animation processes. Novel techniques for stereoscopically displaying pairs of spectrally-multiplexed color images produced by the SMCI computer system hereof, will be described in detail hereinafter.
  • each pixel in the spectrally-multiplexed image contains spectral component information regarding both left and right perspective images, and these combined spectral components are simultaneously presented during the stereoscopic display process of the present invention.
  • spatially-multiplexed composite images spatially corresponding left and right pixels are spatially separated and presented simultaneously during the display process.
  • time-multiplexed imaging techniques all of the pixels in the left perspective image and all of the pixels in the right perspective image are displayed sequentially during different display periods.
  • the stereoscopic display imaging technique of the present invention can be used in direct stereoscopic viewing applications without suffering from (i) image-flicker commonly associated with prior art time-multiplexing techniques or (ii) the loss of image resolution associated with prior art spatial- multiplexing techniques.
  • the present invention avoids
  • SMCI camera system 15 utilizes optical processing techniques in order to produce pairs of spectrally-multiplexed color images of 3-D scenery, from left and right perspective color images thereof.
  • SMCI producing camera system 15 comprises a number of components, namely: first and second color image producing elements 16A and 16B, for producing left and right perspective color images I I and I n , respectively; an optical image combining element 17 for spatially combining pairs of optical images; a color image recording element (e.g., a CCD color image detecting array and scanning electronics) 18 and an image frame buffer 19 for detecting and recording gray-scaled or color images formed on the image detecting array; first and second optical-image spectrum multiplexers 20A and 20B for selectively multiplexing (i.e.
  • optical image combining element 17 transmitting) groups of spectral components from the left and right perspective color images, to optical combining element 17; and an image recording controller 21 for providing control signals to the first and second optical-image spectrum multiplexers 20A and 20B., and also to the color image detector 18 in order to control the operation thereof as hereinafter described.
  • the function of optical image combining element 17 is to assemble multiplexed spectral components in order to form a first spectrally-multiplexed color image during a first recording period, and also to assemble multiplexed spectral components in order to form a second spectrally-multiplexed color image during a second recording period.
  • the function of recording controller 21 is to generate appropriate control signals which cause the first and second optical-image spectrum multiplexers 20A and 20B to selectively transmit particular groups of spectral components constituting the left and right perspective images in order to produce (i) the first spectrally-multiplexed color image on the color-image recording element during the first recording period, and (ii) the second spectrally-multiplexed color image on the color-image detector during the second recording period.
  • optical image spectrum multiplexer 20A, 20B of the present invention is schematically represented as an electro- optical element of physically thin dimensions (e.g. 1 to 10 millimeters) having an optically transparent input surface 23 through which the spectral components of a perspective color or perspective gray-scale image are permitted to enter, and an optically transparent output surface 24 from which selected spectral components of the image are permitted emerge according to the control signals generated by the recording controller 21 during the image recording process.
  • each perspective color image presented to the input surface of the optical-image spectrum multiplexer comprises an ensemble of electromagnetic waves of varying wavelength (i.e. frequency) in the optical region of the electromagnetic spectrum.
  • perspective "gray-scale” images transmit or reflect electromagnetic energy having a bandwidth which extends over the entire optical spectrum, e.g., from about 400 to about 750 nanometers. It is understood, however, that the bandwidth characteristics of particular gray-scaled images will vary depending on the spatial characteristics of the scene represented thereby.
  • Perspective "color” images also transmit or reflect electromagnetic energy having a bandwidth which extends over the entire optical spectrum, e.g., from about 400 to about 750 nanometers. However, it is understood that the bandwidth characteristics of particular color images may extend into the ultraviolet and/or infrared regions of the electromagnetic spectrum. As is well known that certain groups of optical wavelengths contribute to the perception of particular colors in the human vision system.
  • the color green is perceived when the retinal surface of the human vision system is illuminated with the group of optical wavelengths in the region characterized by ⁇ o. ⁇ o ⁇ .
  • the color red is perceived when the retinal surface of the human vision system is illuminated with the group of optical wavelengths in the region characterized by ⁇ ., ⁇ « ⁇ .
  • the color blue is perceived when the retinal surface of the human vision system is illuminated with the group of optical wavelengths in the region characterized by ⁇ B , ⁇ - ⁇ .
  • a first pair of left and right perspective color images of a 3-D scene or object, I. and I » are formed through left and right image forming lenses 16A and 16B, respectively.
  • the recording controller 21 provides a first set of control signals to the left optical image spectrum multiplexer 20A
  • this electro-optical element selectively multiplexes (e.g., passes or transmits ) a first group of spectral components SCG1 through the optical image combiner 17 and onto the color image detector 18 to thereby form a first spectrally filtered image I _. thereon.
  • the recording controller also provides a second set of control signals to the right optical image spectrum multiplexer 20B so that this electro-optical element selectively transmits a second group of spectral components SCG2 through the optical image combiner 17 and also onto the color image detector 18 to thereby form a second spectrally filtered image I m thereon.
  • the first and second groups of spectral components i.e., spectrally filtered images Iu and LOprovide sufficient energy to form a first spectrally-multiplexed color image LMc(l,k) of the 3-D scenery on the color image detector 18.
  • color image detector 18 produces a first digital data set representative of the intensity and color of the pixels comprising the first spectrally-multiplexed color image IsMct(l.k) .
  • the recording controller 21 writes digital pixel data representative of the first spectrally-multiplexed color image into the image buffer 19 operably associated with the color image detector 18. Then as indicated at Block D in Fig.
  • a second pair of left and right perspective color images, I . and I » of the same 3-D scene or object are formed once again through left and right image forming lenses 16A and 16B, respectively.
  • the recording controller 21 provides the second set of control signals to the left optical image spectrum multiplexer 20A so that electro-optical element 20A selectively
  • the recording controller 21 provides the first set of control signals to the right optical image spectrum multiplexer 20B so that electro-optical element 20B selectively transmits the first group of spectral components SCG1 through the optical image combiner 17 and onto the color image detector 18., to thereby form a fourth spectrally filtered image 1 * 2.
  • the first and second groups of spectral components form a second spectrally-multiplexed color image IsM ⁇ (2,k) of the 3-D scene on the color image detector.
  • the color image detector produces a second digital data set representative of the intensity and color of the pixels comprising the second spectrally-multiplexed color image IsM ⁇ (2,k) .
  • the recording controller 21 writes digital pixel data representative of the second spectrally- multiplexed color image into the image buffer 19 , operably associated with the color image detector.
  • the first and second spectrally-multiplexed color images are then co-indexed in buffer memory by the recording controller in order to produce a first spectrally-multiplexed color image pair ⁇ LM ⁇ (l,k),L M ⁇ (2,k) ⁇ .
  • the above-described process is repeated cyclically at a rate equal to or greater than the 30 image frames per second in order to produce a sufficient number of spectrally-multiplexed color image pairs to support stereoscopic viewing of the recorded 3-D scene during the stereoscopic display process of the present invention.
  • the optical image spectrum multiplexer comprises an assembly of optically transparent electro-optical panels, namely: a first plurality of polarizing filter panels 24 ,25 and 26, for passing spectral component bands ⁇ i , ⁇ i and A ⁇ > , respectively, while imparting either a linear or circular polarization state PI thereto; a second plurality of polarizing filter panels 27 , 28 and 29, for passing spectral component bands ⁇ «, ⁇ s and A ⁇ .
  • a voltage-controlled half-wave phase retarding array panel 30 for imparting either a 0 or ⁇ radian phase shift to optical signals (e.g, light patterns) transmitted there through when controller 21 provides voltage levels VI or V2, respectively, thereto; a broad optical band polarization panel 31 for imparting a linear or circular polarization state PI to optical signal (e.g. light pattern) transmitted therethrough; and a picture-frame-like plastic housing 32 for supporting the perimetrical edges of the above- described panels when they are laminated together in the preferred spatial ordering shown, and also for mounting a pair of electrical conductors 33A and 33B leading to the half-wave phase retarding panel.
  • the dimensions of the electro-optical panel assembly will vary from embodiment to embodiment.
  • typical length and width dimensions for the optical image spectrum multiplexer might be 100 millimeters by 100 millimeters, with an overall thickness in the range of from about 1 to about 10 millimeters.
  • the spectral component bands of the first plurality of polarizing filter might be 100 millimeters by 100 millimeters, with an overall thickness in the range of from about 1 to about 10 millimeters.
  • the spectral component bands of the first plurality of polarizing filter might be 100 millimeters by 100 millimeters, with an overall thickness in the range of from about 1 to about 10 millimeters.
  • the spectral component bands of the first plurality of polarizing filter might be 100 millimeters by 100 millimeters, with an overall thickness in the range of from about 1 to about 10 millimeters.
  • V panels 24 through 26 will be selected so as to correspond to a first set of visible colors, while the spectral component bands of the second plurality of polarizing filter panels 27 to 29 will be selected so as to correspond to a second set of visible colors.
  • spectral component band selection and design should be made with consideration to the amount of power present in the spectral bands of the perspective images being recorded in order to achieve minimal "cross- viewing" between the left and right visual fields of viewers during the stereoscopic display process of the present invention.
  • Suitable methods for manufacturing each of the polarizing filter panels 27 to 29 are disclosed in great detail in co-pending U.S. Letters Patent No. 5,221 ,982 to Faris, which is incorporated herein by reference.
  • Suitable methods for manufacturing voltage-controlled half-wave retarding panel 30 are disclosed in great detail in U.S. Letters Patent Nos. 4,719,507 to Bas and 4,670,744 to Buzak, which are also incorporated herein by reference.
  • construction and operation of the polarizing filter panels 27 to 29 depend on particular properties of chiral liquid crystals (CLC), commonly referred to as cholesteric liquid crystals.
  • CLC chiral liquid crystals
  • These CLC polarizing filters operate according to the inherent “selective reflection property" of cholesteric liquid crystals, and such, provide sharp spectral response characteristics which are highly desirable when practicing the present invention.
  • an optical signal with such frequency characteristics is provided as an optical input signal to the input surface of each optical image spectrum multiplexer 20A and 20B.
  • this optical input signal comprises six bands ⁇ i , ⁇ 2 ⁇ 3 , ⁇ , ⁇ i , and ⁇ « , each centered about a central wavelength ⁇ ., ⁇ i, ⁇ i, ⁇ , ⁇ 3 . and ⁇ .., respectively.
  • half- wave phase retarding panel 39 does not convert the polarization state of incoming optical signals.
  • half- wave phase retarding panel 39 converts the polarization state of incoming optical signals.
  • each optical image spectrum multiplexer 20A', 20B' comprises an assembly of optically transparent electro-optical panels, namely: a polarizing filter panel 36 for passing spectral component band associated with the color green, while imparting either a linear or circular polarization state PI thereto; a pair of polarizing filter panels 37 and 38, for passing spectral component bands associated with the colors red and blue, respectively, while imparting either a linear or circular polarization state P2 thereto ; a voltage-controlled half- wave (i.e.
  • phase retarding array panel 39 for imparting either a 0 or ⁇ radian phase shift to the optical image (e.g.. optical signal) transmitted therethrough when recording controller 21 provides voltage levels VI or V2, respectively thereto; a broad band optical polarization panel 40 for imparting a linear or circular polarization state PI to light transmitted therethrough; and picture-frame-like plastic housing 32 for supporting the perimetrical edges of the above panels when they are laminated together in the spatial ordering shown. As described above, frame-like housing facilitates the mounting of electrical conductors 33 A and 33B leading to half- wave phase retarding panel 39. In general, the dimensions of electro-optical panel assembly 35 will vary from embodiment to embodiment.
  • typical length and width dimensions for the optical image spectrum multiplexer might be 100 millimeters by 100 millimeters, with an overall thickness in the range of from about 1 to about 10 millimeters.
  • Suitable methods for manufacturing each of the polarizing filter panels 37 and 38 are disclosed in great detail in co-pending U.S. Letters Patent No. 5,221 ,982 to Faris, which is incorporated herein by reference.
  • Suitable methods for manufacturing voltage-controlled half-wave retarding panel 39 are disclosed in great detail in U.S. Letters Patent Nos. 4,719,507 to Bas and 4,670,744 to Buzak, which are also incorporated herein by reference. As illustrated in Fig.
  • the spectrum for a typical color optical image provided input to the input side of optical image spectrum multiplexer 20A' and 20B' comprises three bands each centered about a central wavelength.
  • the recording controller 21 provides control voltage
  • V l to the half- wave phase retarding array panel of the spectrum multiplexer, only the second group of spectral components SCG2 associated with the color magenta (i.e. red and blue) emerge from the output surface of the spectrum multiplexer, while the first spectral component group SCGl associated with the color green is filtered out, as shown in Fig 51.
  • a solid-state camera system employing the optical image spectrum multiplexers of the present invention is shown in
  • camera system 42 comprises a number of subcomponents, namely: first and second image forming lenses 43A and 43B for forming left and right perspective color images, respectively, of a 3-D scene along first and second optical axis's; first and second optical image spectrum multiplexers 20A' and 20B' disposed along the first and second optical axis's, respectively; an optical image combining element 44; a third image forming lens 45; a CCD color image detecting array 46 operably associated with scanning electronics and an image frame buffer 47; and an image recording controller 48.
  • optical image combining element 44 comprises first and second mirrors 49A and 49B disposed at 45 degrees with respect to the first and second optical axis's 50A and 50B, and third and fourth mirrors 51 A and 5 IB, respectively, disposed parallel to the first and second mirrors respectively, so that the twice reflected optical images are optically coaxially combined and focused in a spatially coherent manner through the third image forming lens, to form a spectrally-multiplexed color image on the surface of the CCD image detecting array.
  • the image recording controller 48 generates control signals to optical-image spectrum multiplexers 20 A' and 20B', and CCD color image detecting array as described above.
  • Fig.6C sets forth the various control voltage signals which are provided to the optical image spectrum multiplexers of the camera system during six consecutive image recording periods Notably, two consecutive recording periods are required to generate and record three pairs of spectrally multiplexed color images using the camera system shown in Figs. 6A and 6B.
  • the camera system of this alternative embodiment of the present invention comprises a number of subcomponents, namely: first and second image forming lenses 56A and 56B for forming left and right perspective color images of a 3-D scene, Uand lR , respectively, along first and second optical axis; first and second CCD color image detecting arrays 57A and 57B, disposed along the first and second optical axis, respectively, for producing frames of digital color video data representative of left and right perspective images formed through lenses 56 A and 56B; first and second color image frame buffers 58A and 58B for buffering single frames of digital color video data produced from the first and second CCD image detecting arrays, respectively; a pair of image frame buffer queues 59A and 59B, for buffering multiple frames of digital color video data sequentially produced from the first and second CCD image detecting arrays 57A and 57B
  • CCD image detecting arrays to the first and second image frame buffers, and from the first and second image frame buffers to the first and second image frame buffer queues, respectively; a digital data processor 61 for simultaneously retrieving frames of digital image data from the first and second image frame buffer queues
  • VRAM dynamic random access memory
  • mass-type data storage device for setting up a plurality of image frame buffers needed during the data process
  • serial data transmission subsystem 64 for storing a large number of frames of digital video data representative of pairs of spectrally multiplexed color images ⁇ lsM ⁇ (l,k),LM ⁇ (2,k) ⁇ ; and a serial data transmission subsystem 64 having means for converting frames of such digital image data into serial streams of digital video output signals, and means for transmitting the same along a serial data communication channel. All of the above described components are stationarily mounted with respect to an optical bench 65, which is completely contained within a compact housing 66 of rugged construction.
  • the housing is provided with connector jacks 66 in order to supply electrical power to the electronic, electro-optical and electrical components of the camera system, while transmitting the serial video data output signals to either a color video image storage device, such as a VCR recorder or video frame grabber, or directly or indirectly to a stereoscopic image display system of the present invention.
  • a color video image storage device such as a VCR recorder or video frame grabber
  • each perspective color image formed on the CCD image detecting array 58A and 58B comprises a matrix of pixels ,each having a color value representative of the spectral content of the image at the pixel's location in the image.
  • CCD image detecting arrays 57A and 57B generate, for each perspective image captured, a frame of digital data representative of the intensity and color of each pixel in the detected perspective color images.
  • the color value of each pixel contains a magnitude for each of the spectral components comprising the system of color representation (e.g, red, green, blue) being used.
  • frames of digital video data representative of each pair of perspective images captured by CCD image detecting arrays 57A and 57B are immediately buffered in first and second image buffers 58A and 58B. These frames of digital video data are subsequently accessed by image recording controller 60 and buffered in first and second image frame buffer queues 59 A and 59B. Thereafter, frames of digital video data are processed by image data processor 61 in accordance with the spectral- multiplexing algorithm illustrated in Figs.
  • the spectral- multiplexing algorithm comprises six data processing stages which cooperatively produce pairs of spectrally-multiplexed color images ⁇ LM ⁇ (l,k),IsM ⁇ (2,k) ⁇ that can be used to stereoscopically display 3-D scenery recorded by the camera system of Fig. 7 A.
  • the first, second, fourth and fifth data processing stages can be performed in parallel as shown .
  • the processor selects the color value (i.e.
  • the processor writes the selected pixel color value to the corresponding pixel location in a first image buffer set up in data storage memory 62.
  • the image processing operations set forth at Blocks E through H are carried out. If desired or required, the image processing operations set forth at Blocks A' through D' can be carried out in parallel with the corresponding operations at Blocks A through D using a second image buffer set up in data storage memory 62. For purposes of completion, these pixel-data processing operations will be described in detail below.
  • the first step in the second stage of the spectral-multiplexing algorithm involves accessing from the second image frame buffer queue 59B, a frame of digital data representative of the right perspective color image
  • the processor selects the color value (i.e. color code) associated with the second predefined spectral component group SCG2 (i.e.
  • Block C the processor writes the selected pixel color value to the corresponding pixel location in a second image buffer set up in data storage memory 62.
  • the processor processes the spectrally filtered images residing in the first and second image buffers so as to produce a first spectrally-multiplexed color image I— .
  • the processor adds together corresponding color values
  • the processor writes the spectrally-multiplexed pixel P SM ⁇ (x ⁇ ,yj) into its spatially corresponding pixel location in a third image buffer set up in data storage memory 62.
  • I S M ⁇ (l,k) the entire first spectrally-multiplexed color image I S M ⁇ (l,k).
  • the first spectrally-multiplexed color image h»a (l,k). is stored in mass-type data storage memory 63. Thereafter, the processor performs operations necessary to produce the second spectrally- multiplexed color image IsM ⁇ (2,k) associated with the k-th stereo image pair thereof. The details of these pixel-data processing operation will be described below.
  • the first step in the fourth stage of the spectral-multiplexing algorithm involves accessing once again from first image buffer queue 59A, the same frame of digital data representative of the left perspective color image K where each pixel therein is designated as
  • Block J for each pixel P-(x,,yj) in the left color perspective image L, the processor selects the color value (i.e. color code) associated with the second predefined spectral component group SCG2 (i.e. ⁇ g ⁇ ). Then at Block K the processor writes the selected pixel color value to the corresponding pixel location in a fourth image buffer set up in data storage memory.
  • the processor proceeds to Block M. While the image processing operations set forth at Blocks M through P are being carried out, preferably the corresponding pixel data processing operations set forth at Blocks I' through L' are carried out in parallel.
  • Block L' for each pixel P»(x ⁇ ,yj) in the right color perspective image l a , the processor selects the color value (i.e. color codes) associated with the first predefined spectral component group SCGl (i.e. ⁇ r ⁇ ,
  • Block K' the processor write the selected pixel color value to the corresponding pixel location in a fifth image buffer set up in a data storage memory 62.
  • the processor processes the spectrally filtered images residing in the fourth and fifth image buffers so as to produce the second spectrally-multiplexed color image IsM ⁇ (2,k) .
  • the processor adds together the corresponding color values [r»,, ⁇ , ⁇ g.. k ⁇ , ⁇ b,., ⁇ in order to yield the (ij)-th spectrally- multiplexed pixel PsM ⁇ (x ⁇ ,yj) in the second spectrally-multiplexed color image L «c ⁇ (2,k). in the k-th stereo image pair thereof.
  • the processor writes the spectrally-multiplexed pixel PsM ⁇ (x,,yj) into its spatially corresponding pixel location in a sixth image buffer set up in data storage memory 62.
  • these pixel processing operations are performed for each set of spatially corresponding pixels residing in the fourth and fifth image buffers until the entire second spectrally-multiplexed color image IsM ⁇ (2,k). is generated.
  • the second spectrally-multiplexed color image IsMc(2,k). is stored in mass-type data storage memory 63 along with the first spectrally- multiplexed color image I_M ⁇ (l,k). for future access and display.
  • the first and second spectrally-multiplexed color images comprise a spectrally-multiplexed color image pair ⁇ LM ⁇ (l,k),L M ⁇ (2,k) ⁇ , containing sufficient visual information for stereoscopic viewing of the 3-D scenery recorded by the camera system of Fig. 7 A.
  • Figs. 7 A to 7E teaches a digital camera and data processing technique, it is understood that analog signal processing circuitry can be readily adapted for use in constructing a camera system with such functionalities.
  • display system 68 comprises a number of components, namely: video random access memory (VRAM) 69 for storing frames of digital video data representative of spectrally- multiplexed color images of 3-D scenery; a flat liquid crystal display(LCD) panel 70 consisting of a matrix of actively driven pixel elements; LCD driver circuitry 71 for driving the pixels of the LCD panel; an image display controller (e.g., programmed microprocessor) 72 for accessing frames of digital video data from VRAM 69 and providing the same to LCD driver circuitry 71 so that spectrally-multiplexed color images are visually displayed on LCD panel 70 at a rate in excess of 30 frames per second; and lightweight spectacles 73 comprising a pair of electrically-active polarizing lenses 74 A and 74B mounted in a frame 75
  • each polarizing lens comprises an optical process.
  • each lens 75 comprises an image spectrum polarizer 76 laminated directly onto a broad band optical polarizer 77.
  • the broad band optical polarizer for the left lens 74A is characterized by either a linear or circular polarization state P2
  • the broad band optical polarizer for the right lens 74B is characterized by either a linear or circular polarization state PI .
  • display panel 70 can be realized using alternative image display technology including, for example, CRT display devices, LCD flat panel display panels, plasma display panels, electroluminescent display panels and the like.
  • the display controller displays a first spectrally-multiplexed color image of a 3-D scene on the LCD panel during a first display period.
  • this spectrally-multiplexed color image contains only the first spectral component group SCGl of the left perspective image and the second spectral component group SCG2 of the right perspective image.
  • display controller 72 provides a first control signal V_ to the left polarizing lens 74A, changing its spectral transmission characteristics so that only the first spectral component group SCGl of the left perspective image can propagate from the display surface, through the transmission medium (e.g. air) 78, and be viewed by the left eye of the viewer.
  • the transmission medium e.g. air
  • the display controller 72 provides a second control signal V» to the right polarizing lens 74B changing its spectral transmission characteristics so that only the second spectral component group SCG2 of the right perspective image can propagate from the display surface, through the transmission medium and be viewed by the right eye of the viewer.
  • the display controller displays a second spectrally-multiplexed color image of the same 3-D scene on the LCD panel during a second display period.
  • this spectrally- multiplexed color image contains only the second spectral component group SCG2 of the left perspective image and the first spectral component group SCGl of the right perspective image.
  • the display controller provides the second control signal to the left polarizing lens 74A changing its spectral transmission characteristics so that it allows only the second spectral component group SCG2 of the left perspective image can propagate from the display surface, through the transmission medium, and be viewed by the left eye of the viewer.
  • the display controller 72 provides the first control signal to the right polarizing lens 74A changing its spectral transmission characteristics so that only the first spectral component group SCGl of the right perspective image can propagate from the display surface, through the transmission medium, and be viewed by the right eye of the viewer.
  • this cyclical display process is repeated at least thirty times per second, the spectral components of the left and right perspective images are effectively provided to the left and right eyes of the viewer, permitting full color stereoscopic viewing of the 3-D scene without image-flicker.
  • each optical image spectrum polarizer of the illustrative embodiment generally comprises an assembly of optically transparent electro-optical panels, namely: a first plurality of passive polarizing filter panels 80, 81 and 82, for passing spectral
  • electro-optical panel assembly will vary from embodiment to embodiment.
  • typical length and width dimensions for the optical image spectrum polarizer will typically be 50 millimeters by 50 millimeters.
  • the thickness of the electro-optical panel assembly between optically transparent input and output surfaces 89 and 90 will typically be in the range of from about 1 to about 10 millimeters, although such dimensions may vary from embodiment to embodiment.
  • the spectral component bands of the first plurality of polarizing filter array panels will be selected so as to correspond to a first set of visible colors, while the spectral component bands of the second plurality of polarizing filter panels are selected so as to correspond to a second set of visible colors.
  • the spectral component bands of the first plurality of polarizing filter array panels will be selected so as to correspond to a first set of visible colors, while the spectral component bands of the second plurality of polarizing filter panels are selected so as to correspond to a second set of visible colors.
  • spectral component band selection and design will be best made with consideration to the amount of power present in the spectral bands of perspective images utilized in producing the spectrally- multiplexed images.
  • Suitable methods for manufacturing each of the polarizing filter panels 80 to 85 are disclosed in great detail in co-pending U.S. Letters Patent No. 5,221 ,982 to Faris.
  • Suitable methods for manufacturing voltage-controlled half-wave retarding panel 86 are disclosed in great detail in U.S. Letters Patent Nos. 4,719,507 to Bas and 4,670,744 to Buzak.
  • the construction and operation of the polarizing filter array panels is based upon the selective reflective property of cholesteric liquid crystals.
  • the spectrum of an exemplary optical image provided to the optically transparent input surface of each optical image spectrum polarizer comprises six bands ⁇ . , ⁇ * ⁇ 3 , ⁇ . , ⁇ 3 , and ⁇ « , each centered about a central wavelength ⁇ ., ⁇ i, ⁇ 3 , ⁇ , ⁇ y and ⁇ «., respectively.
  • P2 broad band polarizer
  • PI broad band polarizer
  • the spectrum for a typical color optical image provided input to the optically transparent input surface of each optical image spectrum polarizer 74A' and 74B' comprises three bands ⁇ « , ⁇ and ⁇ . , each centered about a central wavelength ⁇ », ⁇ oand ⁇ .., respectively.
  • the first group of spectral components SCGl associated with the colors blue and red i.e. magenta
  • the second group of spectral components SCG2 associated with color green emerge with polarization state P2.
  • half-wave phase retarding panel 95 does not convert the polarization state of spectrally polarized optical signals.
  • half-wave phase retarding panel 95 converts the polarization state of incoming optical signals.
  • LCD system 97 comprises a number of components, namely: one or more devices 98 for producing frames of digital video data representative of spectrally-multiplexed images of 3-D scenery; a flat liquid crystal display(LCD) panel 99 consisting of a matrix of pixel elements; LCD driver circuitry 100 for driving the pixels of the LCD panel; an
  • ⁇ 7 image display controller e.g., programmed microprocessor 101 for receiving frames of digital video data from one or more devices 98 and providing the same to LCD driver circuitry 100 so that spectrally-multiplexed color images are visually displayed on LCD panel 99 at a rate in excess of 30 frames per second; an infrared transmitter 102 for receiving control signals from the display controller and transmitting these signals onto a modulated carrier in the infrared region of the electromagnetic spectrum; an infrared receiver 103 for receiving the transmitted carrier signals and demodulating the same to recover the control signals from the display controller; and lightweight spectacles 75, constructed from a pair of electrically-active polarizing lenses 74A and 74B for imparting time dependent polarization states to particular spectral component groups of light emitted from the LCD panel during the image display process so that the 3-D scene can be stereoscopically viewed therethrough in color and with full depth perception.
  • an infrared transmitter 102 for receiving control signals from the display controller and transmitting these signals onto a modulated carrier
  • each polarizing lens 74A, 74B comprises an optical image spectrum polarizer 76 which is directly laminated onto a broad band optical polarizer 77, and is responsive to control signals V. or Vn recovered from infrared receiver 103.
  • the broad band optical polarizer 77 for the left lens 74A is characterized by either a linear or circular polarization state P2
  • the broad band optical polarizer for the right lens 74B is characterized by either a linear or circular polarization state PI .
  • Polarizing lenses 74 A and 74B, infrared receiver 103 along with its antenna element 104 each mounted within plastic spectacle frame 75 shown in greater detail in Fig. IOC.
  • each optical image spectrum polarizer 74A and 74B is identical to that described in connection 0 9 with the optical image spectrum polarizer shown in Fig. 9A.
  • the table shown in Fig.lOB sets forth the spectral components of display outputs, polarization states of spectral components thereof, and various control voltage signals V L and V ⁇ provided to the optical image spectrum polarizers of the display system during six consecutive image display periods.
  • projection display system 106 comprises a number of components, namely: a device 107 in accordance with the present invention for producing frames of digital video data representative of spectrally- multiplexed color images of 3-D scenery; a color LCLV-type image projector 108 consisting of an illumination source 109, a liquid crystal light valve(LCLV) 110, image projection lens 111 and supporting electronics known in the image display art ; an LCLV driver circuit 112 for actively driving the pixel elements of LCLV 110; an image display controller (e.g., programmed microprocessor) 112 for receiving frames of digital video data from one or more devices 107 and providing the same to LCLV driver circuit so that spectrally-multiplexed color images are visually displayed from LCLV 110 onto a reflective display surface 114 at a rate in excess of 30 frames per second; an infrared transmitter 115 for receiving control signals from the display controller
  • electrically-active polarizing lenses 74A and ss 74B mounted within spectacles 73 impart time dependent polarization states to particular spectral component groups of light emitted from the LCLV projection panel 1 10 during the image display process.
  • 3-D scenery represented within the spectrally-multiplexed images being cyclically displayed can be stereoscopically viewed through spectacles 73 with full depth perception.
  • the table shown in Fig.l l B sets forth the spectral components of display outputs, polarization states of spectral components thereof, and various control voltage signals V L and V. provided to the optical image spectrum polarizers of the projection type display system during six consecutive image display periods.
  • display system 120 comprises a number of components, namely: VRAM 121 for storing frames of digital video data representative of spectrally-multiplexed color images of 3-D scenery; a flat LCD panel 122 consisting of a matrix of actively driven pixel elements; an optical image spectrum polarizer 123 laminated directly onto flat LCD panel 121 for imparting time dependent polarization states to particular spectral component groups of light emitted from the LCD panel during the image display process; LCD driver circuitry 125 for driving the pixels of the LCD panel; an image display controller (e.g., programmed microprocessor) 124 for accessing frames of digital video data from VRAM 121 and providing the same to LCD driver circuitry 123 so that spectrally-multiplexed color images are visually displayed on the LCD panel at a rate in excess of 30 frames per second; and
  • image display controller e.g., programmed microprocessor
  • optical image spectrum polarizing panel 123 is identical to the electro-optical device illustrated in Figs. 9A through 9H and described above, except that the length and width dimensions of optical image spectrum polarizing panel 123 will conform substantially to the length and width dimensions of LCD panel 122.
  • each polarizing lens within spectacles 126 is realized as a broad band optical polarizer.
  • the broad band optical polarizer for left lens 128 is characterized by either a linear or circular polarization state P2
  • the broad band optical polarizer for right lens 129 is characterized by either a linear or circular polarization state PI .
  • display controller 124 displays a first spectrally-multiplexed color image of a 3-D scene on LCD panel 122 during each first display period. As illustrated in Fig. 12 A, this spectrally-multiplexed color image contains only the first spectral component group SCGl of the left perspective image and the second spectral component group SCG2 of the right perspective image.
  • the display controller provides a first control signal V 0 .SPI to optical image spectrum polarizer 123, thereby adjusting its spectral polarizing characteristics so that the first spectral component group SCGl of the left perspective image is imparted with a linear or circular polarization state PI upon emerging from its optically transparent output surface, while the second spectral component group SCG2 of the right perspective image is imparted with a linear or circular polarization state P2 upon emerging from its optically transparent output surface.
  • the left polarized lens 128 characterized by polarization state P2 permits only the first spectral component group SCGl of the left perspective image to propagate from the display surface, through transmission medium (e.g., air) 200 and pass to the viewer's left eye
  • the right polarized lens 129 characterized by polarization state PI permits only the second spectral component group SCG2 of the right perspective image to propagate from the display surface, through the transmission medium, and to the viewer's right eye.
  • the display controller displays a second spectrally-multiplexed color image of a 3-D scene on the LCD panel during a second display period.
  • this spectrally-multiplexed color image contains only the second spectral component group SCG2 of the left perspective image and the first spectral component group SCGl of the right perspective image.
  • the display controller provides a second control signal VOBPZ to the optical image spectrum polarizer 123 , thereby adjusting its spectral polarizing characteristics so that the second spectral component group SCG2 of the left perspective image is imparted with a linear or circular polarization state P2 upon emerging from its optically transparent output surface, while the first spectral component group SCGl of the right perspective image is imparted with a linear or circular polarization state PI upon emerging from its optically transparent output surface.
  • the left polarized lens 128 characterized by polarization state P2 permits only the second spectral component group SCG2 of the left perspective image to pass to the viewer's left eye
  • the right polarized lens 129 characterized by polarization state PI permits only the first spectral component group SCGl of the right perspective image to pass to the viewer's right eye.
  • this cyclical display process is repeated at least thirty times per second, the spectral components of the left and right perspective images are effectively provided to the left and right eyes of the viewer, permitting full color and stereoscopic viewing of the 3-D scene.
  • the table shown in Fig.l2C sets forth the spectral components of display outputs, polarization states of spectral components thereof, and the control voltage signals V 0B p provided to the optical image spectrum polarizer of LCD type display system 120 during six consecutive image display periods.
  • a projection type embodiment of the display system of Figs 12A and 12B is shown in Fig.l3A.
  • projection display system 130 comprises a number of components, namely: a device 131 in accordance with the present invention for producing frames of digital video data representative of spectrally- multiplexed color images of 3-D scenery; a color LCLV-type image projector 131 consisting of an illumination source 132, a liquid crystal light valve(LCLV) panel 133; an LCLV driver circuitry 134 for actively driving the pixels of LCLV panel 133; an optical image spectrum polarizer 135 as shown in Figs 9 A through 9H; an image projection lens 136 and supporting electronics known in the image display art ; an image display controller (e.g..programmed microprocessor) 137 for receiving frames of digital video data from device 131 and providing the same to color projector 131 so that spectrally-multiplexed color images are visually displayed on a polarization preserving display surface 138 at a rate in excess of
  • a device 131 in accordance with the present invention for producing frames of digital video data representative of spectrally- multiplexed
  • optical image spectrum polarizer 135 is directly laminated onto LCLV projection panel 135, and is responsive to control signals VOISP generated by display controller 137 in order to impart time dependent polarization states to particular spectral component groups of light emitted from the LCLV projection panel during the image display process.
  • the table shown in Fig.l3B sets forth the spectral components of display outputs, polarization states of spectral components thereof, and the control voltage signals VOISP provided to optical image spectrum polarizer 135 during six consecutive image display periods in the projection type display system of Fig.l 3A
  • Figs 14A and 14B show a portable notebook type computer system 140 capable of displaying spectrally-multiplexed color images using electrically-passive polarizing eyewear 126 described above.
  • portable notebook computer system of the present invention comprises a number of integrated system components, namely: one or more central processing units 141 (e.g. microprocessor); hard-disc data storage device 142 for storing an operating system program, application programs, and optionally various image processing routines of the present invention; random access data storage memory (e.g.
  • VRAM VRAM
  • mass-type data storage memory for long term storage of produced pairs of spectrally-multiplexed color images
  • keyboard or other text input device 145 a pointing and selecting device (.e.g. track-ball) 146; and one or more video
  • 6o output devices 147 such as CD-ROM or a stereo-image producing computer or camera as shown in Figs. 3,4 or 6 A; a flat LCD panel 148 consisting of a matrix of actively driven pixels; LCD panel driver circuitry 149 for driving the pixels of the LCD panel; an optical image spectrum polarizer 150 (similar to polarizer panel 123 shown in Figs.l2A and 12B) directly laminated onto flat LCD panel 148 for imparting time dependent polarization states to particular spectral component groups of optical images emitted from the LCD panel during the image display process; an image display controller (e.g., programmed microprocessor) 151 for accessing frames of digital video data from VRAM 143 and providing the same to LCD driver circuitry 149 so that spectrally- multiplexed color images are visually displayed on the LCD panel at a rate in excess of 30 frames per second; and electrically- passive lightweight polarizing spectacles 126 of the type shown in Figs.
  • image display controller e.g., programmed microprocessor
  • the transient energy imbalance in the produced spectrally-multiplexed image(s) will result in there being a moment or so, when, during the stereoscopic display process, only one of the viewer's eyes is stimulated (i) with sufficient light energy from the primary spectral component groups (e.g. ⁇ r ⁇ and ⁇ b ⁇ , and ⁇ g ⁇ ) of the 3-D image, and (ii) for a predetermined period of time that is functionally related to the retinal response time of the human eye.
  • the primary spectral component groups e.g. ⁇ r ⁇ and ⁇ b ⁇ , and ⁇ g ⁇
  • flicker free stereoscopic images can be produced independent of the spectral power distribution of perspective images by using the method of spectral-multiplexing illustrated in Figs 16A to 17G.
  • this method can be carried out using the computer system of Fig. 3, the camera system of Fig. 7 A, or any other computer-based SMCI producing system of the present invention.
  • each perspective color image produced within and processed by the SMCI computer system comprises a matrix of pixels. Each pixel in the image matrix is designated as
  • P ⁇ x connectory,) ( ⁇ xicidey J ⁇ , ⁇ r,. i ⁇ , ⁇ g,.j ⁇ , ⁇ b,. i ⁇ ), and has a composite color value representative of the spectral content of the image at the pixel's location in the image, indicated by the coordinate pair (x, y).
  • the color value of each pixel contains a magnitude for each of the spectral components, e.g. ⁇
  • the left and right color perspective images are stored in data storage memory (e.g...
  • the "flicker- free" spectral-multiplexing algorithm also comprises plural stages of pixel-data processing which collectively produce pairs of spectrally-multiplexed color images for display and flicker-free stereoscopically viewing of the 3-D imagery represented in the computer-based system. To achieve computational efficiency, several of these stages can be performed in parallel as shown.
  • processor 6 performs the first step in the first stage of the spectral-multiplexing algorithm by accessing from data storage memory 8, a frame of digital data representative of the left perspective color image L where each pixel therein is designated as
  • Block B for each pixel P.(x ⁇ ,yj) in the left color perspective image K, the processor selects the color value (i.e. color code) associated with the first predefined spectral component group SCGl (i.e. ⁇ r ⁇ 7 ⁇ b ⁇ ) and determines whether the selected color codes have sufficient magnitude values (i.e. exceed a predetermined power threshold).
  • this predetermined power threshold can be
  • Block C the processor determines that the selected color codes of pixel Pt(x,yj) have sufficient magnitude values, then at Block D the processor updates the first pixel-filler image buffer shown in Fig. 16A by writing the selected color codes in the spatially corresponding pixel location in the first pixel-filler image buffer set up in data storage memory 8. Thereafter the processor proceeds to Block F and writes the selected color code to the spatially corresponding pixel location in the first image buffer set up in data storage memory.
  • Block C the processor determines that the selected color value of pixel Pa( ⁇ .y ⁇ ) from the right perspective image I R has a sufficient magnitude value, , then at Block D' the processor updates the second pixel-filler image buffer shown in Fig 16A by writing the selected color code in the spatially corresponding pixel location in the second pixel-filler image buffer. Thereafter the processor proceeds to Block F' and writes the selected color code to the spatially corresponding pixel location in the second image buffer set up in the data storage memory.
  • the processor determines whether the selected color value of pixel P ⁇ .(xi,yj) from the left perspective image L and the selected color value of pixel P»( ⁇ ,yj) from the right perspective image I R both lack a sufficient magnitude value. If so, then the output of AND operation (Block H) will be a logical 1. When this condition is determined at Block I, then the processor proceeds to Block J in Fig. 17C. At Block J the processor determines whether a predetermined number of SMCI production periods have lapsed since the output of the AND operation at Block H was a logical "0".
  • this operation checks to determine whether the spatially corresponding pixel values in the left and right perspective images both lack sufficient energy in the primary color values, a pixel condition incapable of producing image flicker. If the predetermined number of SMCI production periods have elapsed, then at Block L the processor erases (e.g. sets to zero value) the color code(s) in the spatially corresponding pixel locations in both the first and second pixel-filler image buffers. Thereafter the processor proceeds to Block K in Fig. 17C and writes the selected color code(s) of the first spectral component group SCG-1 in the spatially corresponding pixel location in the first image buffer, and writes the selected color code(s) of the second spectral component group SCG-2 in the spatially corresponding pixel location in the
  • Block J the processor proceeds directly from Block J to Block K, as shown. From Block K, the processor proceeds to Blocks G and G' in Fig.l7B. However, if at Block I its determined that the output of the
  • the processor processes the spectrally filtered images residing in the first and second image buffers in order to produce a first spectrally-multiplexed color image I S M ⁇ (l,k).
  • the processor adds together the corresponding color values ⁇ r.., ⁇ , ⁇ g... ⁇ , ⁇ fc-.» ⁇ in order to yield the (ij)-th spectrally- multiplexed pixel P S M ⁇ (x ⁇ ,yj) in the first spectrally-multiplexed color image Is M ⁇ (l,k). in the k-th stereo image pair thereof.
  • the processor writes the spectrally-multiplexed pixel PsM ⁇ (x ⁇ ,y,) into its spatially corresponding pixel location in a third image buffer set up in data storage memory 8, as shown in Fig.l6A.
  • the first spectrally-multiplexed color image IsM ⁇ (l,k). is stored in data storage memory 9.
  • Block R the processor thereafter proceeds to Blocks S and S' in order to commence the fourth and fifth stages of pixel-data processing, which produce the second spectrally-multiplexed color image Is»ra(2,k) of the k-th stereo image pair thereof.
  • Block T for each pixel P.(x ⁇ ,yi) in the left color perspective image K, the processor selects the color value (i.e. color code) associated with the second predefined spectral component group SCG2 (i.e., ⁇ g ⁇ ) and determines whether the selected color code has a sufficient magnitude value. If at Block U the processor determines that the selected color value of pixel P-(x ⁇ ,Y)) from the left perspective image L has a sufficient magnitude value, then at Block V the processor updates the first filler-pixel image buffer shown in Fig 16B by writing the selected pixel color value to its spatially corresponding pixel location. Thereafter the processor proceeds to Block X and writes the selected color value to the corresponding pixel location in the fourth image buffer set up in the data storage memory.
  • the color value i.e. color code
  • SCG2 i.e., ⁇ g ⁇
  • While the processor carries out the image processing operations set forth at Blocks S through X, it preferably carries out in parallel corresponding operations at Blocks S' through X' using a fifth image buffer set up in data storage memory 8. For purposes of completion, these pixel-data processing operations will be described below. As illustrated at Block S' in Fig.
  • Block T' for each pixel in the right color perspective image
  • the processor selects the color value (i.e. color codes) associated with the first predefined spectral component group SCGl (i.e. ⁇ r ⁇ ,
  • the processor determines whether the selected color value has a sufficient magnitude value. If at Block U' the processor determines that the selected color value of pixel PR(XI,VJ) from the right perspective image I R has a sufficient magnitude value, then at Block V the processor updates the fourth pixel-filler image buffer shown in Fig 16B by writing the selected color codes to the spatially corresponding pixel location in a fifth image buffer set up in data storage memory 8. Thereafter the processor proceeds to
  • Block X' and writes the selected color codes to the spatially corresponding pixel location in the fifth image buffer, as illustrated in Fig 16B.
  • the processor determines whether the selected color values of pixel P-(xi,yj) from the left perspective image K and the selected color value of pixel P «(xi,y ⁇ ) from the right perspective image I R both lack a sufficient magnitude value. If so, then the output of AND operation (Block Y) will be a logical "1 ", and the processor proceeds to Block Z.
  • the processor determines whether a predetermined number of SMCI production periods have lapsed since the output of the AND operation at Block Y was a logical'O". Notably, this operation checks to determine whether the spatially corresponding pixel values in the left and right perspective images both lack sufficient energy in the primary color values, a pixel condition incapable of producing image flicker.
  • Block CC the processor erases (e.g. sets to zero value) the color codes in the spatially corresponding pixel locations in both the first and second pixel-filler image buffers. Thereafter the processor proceeds to Block BB and writes the selected color codes of the second spectral component group SCG-2 in the spatially corresponding pixel location in the fourth image buffer, and writes the selected color code(s) of the first spectral component group SCG- 1 in the spatially corresponding pixel location in the fifth image buffer. Otherwise, if the predetermined number of SMCI production cycles have not elapsed, then the processor proceeds to Block BB and writes the selected color codes of the second spectral component group SCG-2 in the spatially corresponding pixel location in the fourth image buffer, and writes the selected color code(s) of the first spectral component group SCG- 1 in the spatially corresponding pixel location in the fifth image buffer. Otherwise, if the predetermined number of SMCI production cycles have not elapsed, then the processor proceeds to Block BB and writes the selected color codes of
  • Block BB Block BB 6 ⁇ 7 directly from Block AA to Block BB, as shown. From Block BB, the processor proceeds to Blocks Y and Y'.
  • Block J the output of AND operation (at Block I) is not a logical "1 ", then the processor proceeds from Block U to Block W during the first processing stage, and from Block U' to Block W' during the second processing stage, as shown in Fig 17D.
  • the processor writes into the spatially corresponding pixel location in the first image buffer, the color codes ⁇ g ⁇ of the present (i.e. most recently updated) filler pixel taken from the spatially corresponding pixel location in the first pixel-filler image buffer.
  • the processor writes into the corresponding pixel location in the second image buffer, the color codes ⁇ r ⁇ and ⁇ b ⁇ of the present filler pixel taken from the spatially corresponding pixel location in the second pixel-filler image buffer, as shown in Fig 16B.
  • the processor processes the spectrally filtered images residing in the fourth and fifth image buffers so as to produce the second spectrally-multiplexed color image I SM a(2,k) .
  • the processor adds together the conesponding color values ⁇ r,., ⁇ , ⁇ g.,. ⁇ , ⁇ b..» ⁇ in order to
  • the second spectrally-multiplexed color image IsM ⁇ (2,k). is stored in data storage memory 9 along with the first spectrally-multiplexed color image IsM ⁇ (l,k). for future access and display.
  • the first and second spectrally-multiplexed color images comprise a spectrally-multiplexed color image pair ⁇ lsM ⁇ (l,k),LM ⁇ (2,k) ⁇ , containing original pixel color codes and possibly "filler" pixel color codes that permit stereoscopic viewing of the original 3-D scene without visual perception of image flicker.
  • the above-described pixel-data processing method can be repeated upon left and right perspective color images of either real or synthetic 3-D imagery in order to produce spectrally- multiplexed color image pairs at a sufficiently high rate to support flicker-free 3-D stereoscopic display and animation processes.
  • Any of the above-described display techniques can be used for stereoscopically displaying pairs of spectrally-multiplexed color images produced by the spectral-multiplexing process described above.
  • the spectral power distributions of perspective color images are analyzed in real-time prior to producing and displaying spectrally-multiplexed color images therefrom.
  • particular wavelengths are assigned to the spectral component groups (e.g. SCGl and SCG2) associated with perspective images to be spectrally multiplexed during the SMCI production processes described above.
  • Sg"adaptive spectral multiplexing can be achieved using a modified version of the camera system shown in Fig.6A.
  • the adaptive SMCI camera system includes two mechanism, namely: a means for performing spectral power distribution analysis on perspective images presented to the camera system; and also a means for adapting the spectral transmission characteristics of the left and right optical image spectrum multiplexers utilized therein, to a prespecified criteria.
  • the means for performing spectral power distribution analysis can be realized using a beam splitting optics, an color image detecting array, and an image processor programmed to perform spectral power distribution analysis and produce an appropriate set of control signals on a real-time basis.
  • control signals carry information representative of the wavelength characteristics comprising the spectral component groups SCGl and SCG2 in each spectrally-multiplexed color image.
  • the means for adapting the spectral transmission characteristics of the left and right optical image spectrum multiplexers can be realized using optical image spectrum multiplexers having spectral transmission characteristics that can be selectively changed from recording period to recording period, in response to different control signals produced by the means for performing spectral power distribution analysis.
  • the prespecified criteria satisfied by the adaptive camera system would be to spectrally multiplex the perspective color images so that the spectral power contained in each pair of left and right perspective color images is substantially equally distributed between the pair of spectrally-multiplexed images produced therefrom.
  • an adaptive display system in order to avoid the possibility of flicker perception during the display process. This is particularly important in instances where the left and right perspective images (used to produce the displayed spectrally-multiplexed images) have severely unbalanced spectral power distributions, as previously illustrated in Fig 15.
  • An adaptive display system in accordance with the present invention would employ one or two "adaptive" optical image spectrum polarizers, each having spectral polarizing characteristics particularly adapted to change in response to the control signals
  • the wavelengths associated with the spectral component groups SCGl and SCG2 defined during the SMCI production process will be polarized during the image display process so that only the spectral components associated with the left perspective image propagate through the transmission medium (e.g. air) to the viewer's left eye, while only the spectral components associated with the right perspective image propagate through the transmission medium to the viewer's right eye.
  • the transmission medium e.g. air
  • the systems and components of the present invention will find numerous applications in diverse fields of human endeavor including, for example, business, education, scientific research, entertainment and defense.
  • Stereo Television (STV) entertainment and educational services in which the SMCI producing computer, camera or like devices described above is used to supply analog or digital SMCI signals to the central transmitting system 154 (e.g. station) of a television signal transmission and distribution system 155, schematically illustrated in Fig 18.
  • the central transmitting system includes one or more television carrier signal generators and modulators, which can be used to modulated a television carrier signal by a SMCI video signal, which functions as a modulation signal.
  • the central transmitting station can transmit the modulated television carrier signal over one or more channels 156 in the television signal transmission and distribution system, to one or more remote television signal receiving devices 157 A, 157B.
  • each such channel 156 can be realized as coaxial cable, fiber optical cable and/or the free-space medium, and transmission of such modulated television carrier signals may include the use of microwave or optical transmitters, receivers and/or transceivers, and frequency conversion devices well known in the telecommunication art.
  • the modulated television carrier signal can be redistributed to one or more SMCI display systems of the present invention 3, which includes a SMCI display system of the present invention, such as 68, 97, 106, 120, 130 and 140 described above.
  • the modulated television carrier signal is demodulated and the recovered SMCI signals (including the control signals VOISP) are used to display the spectrally-multiplexed color images as hereinbefore described. As discussed above, such images will be displayed at a rate in excess of 30 video frames per second in order to provide flicker-free stereoscopic viewing of 3-D color images.
  • stereoscopic display system 120 described above is shown operably connected to a remote receiving device 157 A (e.g. a cable television signal converter) present in television signal transmission and distribution system 155.
  • a remote receiving device 157 A e.g. a cable television signal converter
  • electrically-active spectral polarization panel 76 (123) is releasably mounted to the CRT display surface 161 of a conventional color television set 162, using a set of four suction cup type attachment devices 163 A, 163B, 163C and 163D which are fixedly connected to the corners of the plastic frame 87 of the spectral polarization panel 76, detailed in Fig. 9B.
  • the spectral polarization panel is mounted to the CRT display surface by simply pressing the frame against the CRT surface.
  • 77 polarization panel can be made in a variety of sizes in order to accommodate the various size image display surfaces of commercially available television sets.
  • a control signal re-generation device 165 is installed in-line between the TV signal input connector 166 on the television set and the signal output connector 167 on the cable television signal converter, as shown.
  • electronic circuitry which processes the analog SMCI television signal provided to its input connector 171 in order to re-generate control signals VOISP for input to control terminals 88A and 88B of the spectral polarization panel, as described above in connection with stereoscopic display system 120.
  • the control signal re-generation device is powered by a long-life battery contained within the compact housing of the device.
  • the control signal re-generation device can be interconnected the television set and the cable television signal converter by connecting a first section of coaxial cable 168 between connector 166 and the output signal connector 169 on the control signal re-generation device, and then connecting a second coaxial cable section 170 between the input connector 171 of the control signal re-generation device and the output connector of the cable television signal converter.
  • the control signal re-generation device 165 has an control signal output connector 172 which is operably connected to input conductors 88A and 88B of the spectral polarization panel using a section of flexible shielded cable 173, as shown.
  • control signal re-generation device 165 analyzes the received SMCI television signal provided to its input connector terminals, and generates therefrom control signals VI , V2 described above. In turn, these control signals are provided to the spectral polarization panel 76 in order to control the operation of tthereof while spectrally-multiplexed images are visually presented upon the CRT display surface of the television set. During this image display process, the the displayed spectrally- multiplexed images are viewed through passive polarization spectacles 126 so that the 3-D imagery carried by the received SMCI television signal is viewed with full depth perception.
  • the above-described stereo television display system has a number of advantages from a practical stand point.
  • the technique and system is completely compatible with NTSC Standards; it can be used in connection with non-planar display surfaces provided by CRT devices; it can be practiced in a manner substantially free from image flicker; and it can be used with any conventional television set by simply mounting a spectral polarization panel to the CRT display surface thereof and inserting a control signal re ⁇ generation device between the television set and a section of incoming television signal cable.
  • Such accessories are simple and inexpensive to manufacture and distribute to television viewers who desire to stereoscopically view stereoscopic 3-D programs in the comfort of their own home.
  • While active-pixel type flat panel image display devices have been disclosed in the illustrative embodiments, it is understood that such image display devices can include cathode ray tube(CRT) display devices, plasma display panels, passive back-lighted flat display panels, electro-luminescent display panels and the like without departing from the principles of the present invention.
  • CTR cathode ray tube
  • plasma display panels passive back-lighted flat display panels
  • electro-luminescent display panels electro-luminescent display panels and the like
  • the various embodiments of the present invention will be useful in many diverse stereoscopic imaging applications.
  • various modifications to the illustrative embodiments of the present invention will readily occur to persons with ordinary skill in the art. All such modifications and variations are deemed to be within the scope and spirit of the present invention as defined by the Claims to Invention appended hereto.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

Cette invention se rapporte à un procédé et à un appareil servant à produire et à afficher des paires d'images en couleurs ou dans l'échelle des gris de scènes en trois dimensions à multiplexage spectral, dans le but de permettre une visualisation stéréoscopique de ces images, sans scintillement produit spectralement, visualisation pendant laquelle le spectateur porte des lunettes de polarisation de la lumière électriquement passives ou électriquement actives (75). Dans un mode de réalisation illustrant cette invention, des paires d'images en couleurs de scènes en trois dimensions, à multiplexage spectral, sont produites au moyen d'un système de caméra qui enregistre les images en couleurs de perspective droite et gauche de ces scènes et qui traite optiquement les constituantes spectrales de ces images. Dans un autre mode de réalisation illustrant cette invention, des paires d'images en couleurs de scènes en trois dimensions, à multiplexage spectral, sont produites à l'intérieur d'un système géré par ordinateur (101), qui produit des images de perspective droite et gauche de ces scènes au moyen de procédés graphiques informatiques et qui traite les données de pixels de ces images au moyen des procédés de traitement de pixels faisant l'objet de cette invention.
PCT/US1996/009539 1996-05-24 1996-05-24 Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral WO1997046029A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU62621/96A AU6262196A (en) 1996-05-24 1996-05-24 Flicker-free stereoscopic 3-d display system using spectral-multiplexing
PCT/US1996/009539 WO1997046029A1 (fr) 1996-05-24 1996-05-24 Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US1996/009539 WO1997046029A1 (fr) 1996-05-24 1996-05-24 Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral

Publications (1)

Publication Number Publication Date
WO1997046029A1 true WO1997046029A1 (fr) 1997-12-04

Family

ID=22255270

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/009539 WO1997046029A1 (fr) 1996-05-24 1996-05-24 Systeme d'affichage tridimensionnel stereoscopique sans scintillement, utilisant le multiplexage spectral

Country Status (2)

Country Link
AU (1) AU6262196A (fr)
WO (1) WO1997046029A1 (fr)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0954930A4 (fr) * 1997-01-22 2003-05-02 Dynamic Digital Depth Res Pty Procede et appareil de production d'images stereoscopiques
US9251740B2 (en) 2009-10-28 2016-02-02 Dolby Laboratories Licensing Corporation Stereoscopic dual modulator display device using full color anaglyph
US11016579B2 (en) 2006-12-28 2021-05-25 D3D Technologies, Inc. Method and apparatus for 3D viewing of images on a head display unit
US11228753B1 (en) 2006-12-28 2022-01-18 Robert Edwin Douglas Method and apparatus for performing stereoscopic zooming on a head display unit
US11275242B1 (en) 2006-12-28 2022-03-15 Tipping Point Medical Images, Llc Method and apparatus for performing stereoscopic rotation of a volume on a head display unit
US11315307B1 (en) 2006-12-28 2022-04-26 Tipping Point Medical Images, Llc Method and apparatus for performing rotating viewpoints using a head display unit

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4641178A (en) * 1983-08-12 1987-02-03 Brightad Limited Method and apparatus for producing stereoscopic images
US4995718A (en) * 1989-11-15 1991-02-26 Honeywell Inc. Full color three-dimensional projection display

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4641178A (en) * 1983-08-12 1987-02-03 Brightad Limited Method and apparatus for producing stereoscopic images
US4995718A (en) * 1989-11-15 1991-02-26 Honeywell Inc. Full color three-dimensional projection display

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0954930A4 (fr) * 1997-01-22 2003-05-02 Dynamic Digital Depth Res Pty Procede et appareil de production d'images stereoscopiques
US11016579B2 (en) 2006-12-28 2021-05-25 D3D Technologies, Inc. Method and apparatus for 3D viewing of images on a head display unit
US11036311B2 (en) 2006-12-28 2021-06-15 D3D Technologies, Inc. Method and apparatus for 3D viewing of images on a head display unit
US11228753B1 (en) 2006-12-28 2022-01-18 Robert Edwin Douglas Method and apparatus for performing stereoscopic zooming on a head display unit
US11275242B1 (en) 2006-12-28 2022-03-15 Tipping Point Medical Images, Llc Method and apparatus for performing stereoscopic rotation of a volume on a head display unit
US11315307B1 (en) 2006-12-28 2022-04-26 Tipping Point Medical Images, Llc Method and apparatus for performing rotating viewpoints using a head display unit
US11520415B2 (en) 2006-12-28 2022-12-06 D3D Technologies, Inc. Interactive 3D cursor for use in medical imaging
US9251740B2 (en) 2009-10-28 2016-02-02 Dolby Laboratories Licensing Corporation Stereoscopic dual modulator display device using full color anaglyph
US9544579B2 (en) 2009-10-28 2017-01-10 Dolby Laboratories Licensing Corporation Stereoscopic dual modulator display device using full color anaglyph

Also Published As

Publication number Publication date
AU6262196A (en) 1998-01-05

Similar Documents

Publication Publication Date Title
US6016159A (en) Method and apparatus for producing and displaying spectrally-multiplexed images of three-dimensional imagery for use in stereoscopic viewing thereof
Pastoor et al. 3-D displays: A review of current technologies
US6985168B2 (en) Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
EP0540137B1 (fr) Dispositif d'affichage d'images tridimensionnelles utilisant des bandes parallaxes générées électriquement
US6100862A (en) Multi-planar volumetric display system and method of operation
US6466185B2 (en) Multi-planar volumetric display system and method of operation using psychological vision cues
EP1932368B1 (fr) Dispositif d'affichage 2d/3d commutable
US6108005A (en) Method for producing a synthesized stereoscopic image
US6556236B1 (en) Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments
TW548960B (en) Method and apparatus of flicker reduction for LC shutter glasses
Ezra et al. New autostereoscopic display system
WO1996022660A1 (fr) Systeme intelligent et procede associe de creation et presentation d'images stereo multiplexees dans des environnements de realite virtuelle
WO1999054849A9 (fr) Systeme de presentation d'images volumetriques sur plusieurs plans et son mode de fonctionnement a anti-crenelage tridimensionnel
WO1999001988A1 (fr) Systeme d'imagerie tridimensionnelle et d'affichage
WO2017055894A1 (fr) Affichage volumétrique multi-plan tridimensionnel en temps réel et procédé de mise en œuvre
JPH08205201A (ja) 疑似立体視方法
JP3083635B2 (ja) 3次元立体画像/2次元画像共存型表示装置
KR100753517B1 (ko) 입체 영상 디스플레이 기능을 갖는 이동통신 단말기 및이를 이용한 입체 영상 디스플레이 방법
KR101337790B1 (ko) 다층 깊이 융합 3차원 영상 표시 방법 및 장치
KR100274625B1 (ko) 다중액정슬리트를이용한3차원입체화상생성장치
US20090295909A1 (en) Device and Method for 2D-3D Switchable Autostereoscopic Viewing
Faris Novel 3D stereoscopic imaging technology
JPH05107663A (ja) 3次元立体画像表示装置
Wu et al. Backward compatible stereoscopic displays via temporal psychovisual modulation
Pastoor 3D Displays

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BB BG BR BY CA CH CN CZ DE DK EE ES FI GB GE HU IS JP KE KG KP KR KZ LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TR TT UA UG US UZ VN AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: JP

Ref document number: 97542277

Format of ref document f/p: F

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA