WO2021090335A1

WO2021090335A1 - An apparatus for a real time 3d view of an operating site

Info

Publication number: WO2021090335A1
Application number: PCT/IN2020/050937
Authority: WO
Inventors: Raju Sampangi; Rajesh RAMANJULU; Hemalatha BANGALORE CHIKKA HANUMANTHAPPA
Original assignee: Individual
Current assignee: Individual
Priority date: 2019-11-06
Filing date: 2020-11-06
Publication date: 2021-05-14
Anticipated expiration: 2022-05-06

Abstract

The present invention provides an apparatus, system, and method thereof for operating commercially available standard optical instruments such as microscopes (104, 201), or slit lamps. The apparatus includes an arrangement of a plurality of optical elements such that the apparatus captures images of a surgical site to produce the images on a camera sensor of an image capturing device, that renders the captured images in real time multi-dimensional visualization at a 3D viewer. The apparatus can be used with commercially available image capturing device, such as Mirrorless/ DSLR or video camera for outputting real time multi-dimensional visualization at commercially available 3D viewers, such as a TV, monitor, AR/ VR headset, etc. Additionally, output of the image capturing device is directly fed into the 3D viewer as plug and play; therefore, the present apparatus will have only a negligible time lag in image rendering.

Description

AN APPARATUS FOR A REAL TIME 3D VIEW OF AN OPERATING SITE

FIELD OF INVENTION

[001] The present invention generally relates to an apparatus and method for rendering real time three-dimensional view of visual/specific operating sites, such as surgical correction/operation sites. More particularly, the present invention relates to an apparatus and method for operating/managing optical instruments, such as surgical microscopes, clinical bio-microscope, slit lamps and microscopes used in most medical/surgical fields, etc. for rendering multi dimensional view of a surgical site or an object in real time, using imaging apparatuses or systems.

BACKGROUND OF INVENTION

[002] For accurate visualization of a surgical/operating sites in the fields of microsurgery, such as ocular surgery, Neuro/Spinal surgery and ENT (ear, nose and throat) surgery precision is highly required. Surgeons need to be precise in location of the surgery site and are able to do this using the operating microscopes which give the 3-D view through the oculars. However, other than the surgeons, assisting surgeons or surgical team cannot view the surgical field in 3-D in real time unless a specialized 3-D camera systems are used, while it becomes equally important and necessary for the other surgical team members to be provided with real time 3-D imaging of the surgical sites. This helps in greater analysis of the surgery in real time. Also, regular digital recording or seeing through a camera view, one sees an image in 2-dimensions and it lacks the perception of depth. [003] Customised 3-D surgical systems and apparatuses such as Truevision-3D surgical systems and Ngeunity systems are already available in the market for ophthalmic and other microsurgeries. They employ a customised adapter and image capture module which is processed through high end computing processor to produce 3-D imaging. However, there is a slight lag in the real time imaging seen on a TV Screen for which the operating surgeon(s) has to develop/modulate a neuroadaptation while performing the surgeries.

[004] Further, presently available apparatuses and systems are also designed in such a way that they hinder the use of microscope oculars and the surgeon cannot seamlessly alternate between the 3D monitor view and the view through the oculars. This is due to the inability to attach the special beam splitter (that is custom made for 3D camera of the same manufacturer) on all microscope makes.

[005] U.S. Patent Numbered 9552660 discloses an imaging system which displays a multidimensional visualization of a surgical site. In some embodiments, the imaging system receives a selection corresponding to a portion of the displayed multidimensional visualization of the surgical site. At the selected portion of the multidimensional visualization, the imaging system displays a portion of a multidimensional reconstmcted image which corresponds to the selected multidimensional visualization such that the displayed portion of the multidimensional reconstructed image is fused with the displayed multidimensional visualization.

[006] However, the technologies disclosed in the above prior arts employ a customised adapter and image capture module which are processed through high end computing processor to produce 3-D imaging. Therefore, the cost of such imaging systems for viewing surgical sites is expensive. In addition, the presently available technologies for displaying three-dimensional or multi dimensional visualization do experience a slight time lag in real time imaging or video on a 3D viewer, like a 3D-TV.

[007] Hence, there is a need to develop a low cost imaging apparatus for operating such optical instruments, for rendering real time three-dimensional or multi-dimensional visualization of a visual site, such as a surgical site or an object, with very minimal or no time lag in real time visualization.

[008] In order to overcome the above problems, the present invention provides an apparatus and method for rendering real time three-dimensional view of visual/specific operating sites with very minimal or no time lag in real time visualization during surgical corrections or operations or examinations.

SUMMARY OF INVENTION

[009] The present invention discloses an optical imaging apparatus, system and method thereof for operating commercially available standard optical instruments, such as microscopes, slit lamps etc. for rendering real time three-dimensional visualization of a visual site or an object using commercially available standard imaging devices, such as DSLR (digital single -lens reflex camera )/mirrorless still or Video camera. The optical imaging apparatus includes an arrangement of a plurality of optical elements as optical imaging apparatus that captures field of interest in the visual site to produce an image on a camera sensor. The image so produced is compatible with 3D (three dimensional) viewing systems directly as a plug and play, without using a high-end 3D rendering interface

[0010] Therefore, it is an objective of the present invention to provide an optical apparatus and method for operating optical instruments, like microscope, slit lamps etc. for providing real time 3D ocular examination using slit lamp using the adapter visualization of a site, such as surgical site or an object, in three-dimension, using commercially available imaging devices or systems, such as a digital camera.

[0011] Another objective of the present invention is to provide an optical apparatus which can provide real time visualization of the site, such as surgical site or an object, in multi -dimension.

[0012] Yet another objective of the present invention is to provide a method of producing images/videos of the site which are compatible with commercially available 3D viewing systems, such as a 3D-TV, Virtual Reality/ Augmented Reality headsets directly as a plug and play.

[0013] One more objective of the invention is to provide an optical apparatus or providing real time visualization of the site in three-dimensional, being compatible with commercially available 3D viewing systems, such as a 3D-TV (television), and with no or very minimal time lag.

[0014] The optical imaging apparatuses and methods involved in the present invention can be applied in any surgical field such as neurosurgery, orthopaedic and spinal surgery, ophthalmic surgery, ear, nose and throat surgery, general surgery including plastic and reconstructive surgery, or on any target structure or tissue that require micro-precision. It can also be applied to various other manufacturing industries in the quality control systems/devices.

[0015] The foregoing and other objects features, and advantages of the present invention will be apparent from the following descriptions which provides exemplary embodiments of the invention.

BRIEF DESCRIPTION OF DRAWINGS

[0016] FIG. 1 illustrates an exemplary environment of an optical imaging system (102) including a commercially available standard optical instrument such as microscope/ slit lamp (104, 201) with oculars (106, 206) an optical imaging apparatus (102) operating with a set of optical elements, and commercially available imaging device or camera sensor and a 3D viewer, in accordance with an embodiment of the present invention;

[0017] FIG. 2 illustrates an exemplary environment of the optical imaging system, in accordance with an embodiment of the present invention;

[0018] FIG. 3 shows the preferred arrangement of a plurality of optical elements having at least one in-built beam splitter, reflecting prism, anamorphic prism, focusing lens, reflecting mirror and camera sensor, which are being arranged/implemented/constructed at standard optical instrument.

[0019] FIG. 4 illustrates an exemplary flowchart showing a method of optical imaging implementing the optical imaging apparatus (102), in accordance with an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The present invention relates to a low-cost apparatus for operating microscopes, slit lamps or similar devices for real time visualization in 3 -dimensions of surgical field or objects using commercially available DSLR/mirrorless still or video camera.

[0021] The present invention describes the subject matter for patenting with specificity to meet statutory requirements. However, the description itself is not intended to limit the scope of this patent. The principles described herein may be embodied in many different forms.

[0022] The present invention provides an optical surgical instrument for real time three- dimensional or multi-dimensional visualization of a visual site, said apparatus or system comprising: a microscope/ slit lamp (104, 201) with multiple optical elements and a pair of oculars (106, 206) for viewing the visual site. An optical imaging apparatus (102), connected to be used with the microscope/ slit lamp (104, 201) includes an in-built beam splitter (204) and an arrangement of a plurality of optical elements which are arranged in a particular fashion. an image capturing device (205) installed at the optical imaging apparatus (102) for producing image/video of the visual site at its sensor ; and a communication interface for transmitting real time multi dimensional signals to a 3D viewer via direct plug and play, wherein, i. the pair of oculars (106, 206) of the microscope/ slit lamp (104, 201) is used by a surgeon or an assisting surgical team member to view a visual site such as a surgical site, or any other site of interest which requires precision and depth of visualization; ii. while viewing the visual site through the pair of oculars (106, 206) of the microscope/slit lamp (104, 201), the surgeon perceives an image that is produced through multiple optical elements included in the microscope/slit lamp (104, 201); iii. the optical imaging apparatus (102) simultaneously captures the visual site using a series of optical elements that are arranged in a particular fashion such that series of optical elements produces an image on a camera sensor of the image capturing device (205), an output of which is compatible with the 3D viewer; iv. an image produced on the camera sensor of the image capturing device (205) that may be a mirrorless camera/ digital single-lens reflex (DSLR) camera or video camera is transmitted as multi-dimensional signals, via the communication interface as direct plug and play, to the 3D viewer for rendering multi-dimensional images or videos or audio/video data of the visual site at the 3D viewer, in real time.

[0023] One embodiment of the invention provides an optical imaging apparatus for used in operating/functioning optical instruments, such as microscope, slit lamps etc. for providing real time visualization of the visual site, including surgical site or an object, in multi-dimensions, using commercially available imaging devices or systems, such as the image capturing device (205).

[0024] Another embodiment of the invention relates to an optical imaging apparatus has an adapter that can be mounted on any side of the microscope/slit lamp (104, 201) using an in-built custom- made beam splitter (204). [0025] One embodiment of the invention provides an optical imaging apparatus (102) comprising the arrangement of the plurality of optical elements having at least one in-built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which can be also be arranged/implemented/constructed in any standard optical instruments. Further, the optical imaging apparatus can be used with any commercially available camera unit of required specifications such as DSLR/mirrorless camera or video camera to produce the images compatible with current commercially available 3D viewing systems such as TV/Monitors/Virtual reality/ Augmented Reality headsets. The arrangement of the plurality of optical elements forming optical imaging apparatus (102) produces an image on the camera sensor, the output of which is compatible with current 3D viewing devices (206) directly as plug and play.

[0026] Furthermore, the invention provides an apparatus, wherein the image capturing device (205) includes any one of mirrorless camera/ DSLR camera or video camera or smart phone camera, individually or in combination, that transmits multi -dimensional signals of the captured images or videos of the visual site to the 3D viewer, via the communication interface, for rendering multi-dimensional images or videos of the visual site at the 3D viewer, in real time with no or minimal noticeable lag in image rendering. Further the optical imaging apparatus facilitates the surgeon to view seamlessly alternate between the 3D monitor view and the view through the oculars (106, 206).

[0027] Another embodiment of the invention relates to a method of implementing an optical imaging system (102) for operating the optical instrument as defined above, the said method comprising the steps of: i) viewing (302) a visual site through oculars (106, 206) of an optical instrument, such as surgeon oculars (106, 206) of a microscope/slit lamp (104, 201) and the visual site includes at least a surgical site; ii) imaging the visual site through optical elements of the microscope/slit lamp (104, 201), which creates first image of the visual site at the microscope/ slit lamp (104, 201); iii) capturing though the optical imaging apparatus (102) simultaneously the visual site using a series of optical elements that are arranged in a particular way to produce an image on a camera sensor (108) of a digital camera (205); iv) transmitting the captured image of the visual site of the digital camera (205) to a 3D viewer via a plug and play communicating interface, as three-dimensional signals; and v) rendering the three-dimensional visualization of the captured images of the visual site to the 3D viewer in real time.

[0028] Addition embodiment of the invention relates to a method, wherein operating commercially available standard optical instruments, such as microscopes, slit lamps, etc. and rendering real time three-dimensional visualization of a visual site or an object using commercially available standard imaging devices, such as DSLR/mirrorless still or Video camera, wherein: three-dimensional visualization of the visual site is rendered in real time at a commercially available standard 3D viewer such as a TV or virtual reality and or an augmented reality device; and output of an image capturing device that may be a mirrorless camera/ DSLR camera or video camera is directly fed into the 3D viewer as plug and play, without using a high-end 3D rendering interface.

[0029] One more embodiment of the invention is for a method, wherein the optical imaging apparatus is used for operating/functioning optical instruments, such as microscope, slit lamps etc. for providing real time visualization of the visual site, including surgical site or an object, in multi dimensions, using commercially available imaging devices or systems, such as the image capturing device (205). Further, the optical imaging apparatus has an adapter that can be mounted on any side of the microscope/ slit lamp (104, 201) using an in-built custom-made beam splitter (204). Moreover, the method of as describe above, wherein the optical imaging apparatus (102) comprising the arrangement of the plurality of optical elements having at least one in-built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which are being arranged/implemented/constructed at standard optical instrument.

[0030] Illustrative embodiments of the invention now will be described more fully hereinafter with reference to the drawings, in which some, but not all embodiments of the invention are shown. Indeed, the invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will satisfy applicable legal requirements. Like numbers refer to like elements throughout. [0031] The low cost optical imaging apparatus (102) is for operating/functioning optical surgical instruments for real time three-dimensional or multi-dimensional visualization of a visual site, such as a surgical site or an object, with negligible time lag/ practically no time lag using commercially available imaging apparatuses or systems comprising: a microscope/ slit lamp (104, 201) with multiple optical elements, a beam splitter (204) and a pair of oculars (106, 206); an optical imaging apparatus (102) with the arrangement of a plurality of optical elements which are arranged in a particular way; a digital camera (205) installed at the optical imaging apparatus (102) for producing image/video of the visual site at its sensor; any currently available 3D viewer, such as a 3D-TV or a VR/AR (Virtual reality/ Augmented Reality) head gear; communication interface capable of transmitting real time multi-dimensional signals to the 3D viewer via direct plug and play; wherein, a surgeon or surgical team assistant/ Trainee Surgeon/ Resident may view a visual site such as a surgical site, or any other site of interest which requires precision and depth of visualization using oculars (106, 206) of the microscope/ slit lamp (104, 201); while viewing the visual site through the oculars (106, 206) of the microscope/slit lamp (104, 201), a surgeon perceives an image that is produced through a plurality of optical elements included in the optical instrument; the optical imaging apparatus (102) captures the visual site using a series of optical elements that are arranged in a particular way to produce an image on a camera sensor of a digital camera (205); an image produced on camera sensor of the commercially available image capturing device that may be a mirrorless camera/DSLR or video camera is transmitted as compatible multi dimensional signals, via an interface as direct plug and play, to a 3D viewer for rendering multi dimensional images or videos or video data of the visual site at the 3D viewer, in real time. [0032] The optical apparatus is used for operating optical instruments, like microscope, slit lamps etc. for providing real time visualization of a site, such as surgical site or an object, in multi dimensions, using commercially available imaging devices or systems, such as a digital camera (205). The apparatus has adapter that can be mounted on any side of the microscope/slit lamp (104, 201) using a custom-made beam splitter (204) that is incorporated into the adapter itself.

[0033] The optical imaging apparatus (102) having an arrangement of a plurality of optical elements implemented at a commercially available standard optical instrument such as a microscope/ slit lamp (104, 201) and can be used with any commercially available camera unit of required specifications such as DSLR (digital single-lens reflex camera)/mirrorless camera or video camera to produce the images compatible with current commercially available 3D viewing systems (TV/Monitors/Virtual reality headsets).

[0034] The apparatus includes an arrangement of a plurality of optical elements forming optical imaging apparatus (102) produces an image on the camera sensor, the output of which is compatible with current 3D viewing devices (206) directly as plug and play. The method, wherein the image capturing device that may be a mirrorless camera/DSLR inbuilt with an image or video camera transmits compatible multi-dimensional signals of the captured images or videos of the visual site to a 3D viewer, via an interface, for rendering multi -dimensional images or videos of the visual site at the 3D viewer, in real time with no or minimal noticeable lag in image rendering. Further, the apparatus does not hinder the microscope oculars (106, 206) and the surgeon can seamlessly alternate between the 3D monitor view and the view through the oculars (106, 206). [0035] The present invention discloses an optical imaging apparatus (102), system and method thereof for operating commercially available standard optical instruments, such as microscopes, slit lamps, etc. and rendering real time three-dimensional visualization of a visual site or an object using commercially available standard imaging devices, such as DSLR/mirrorless still or Video camera. The three-dimensional visualization of the visual site is rendered in real time at a commercially available standard 3D viewer such as a TV or virtual reality and or an augmented reality device.

[0036] The optical imaging apparatus (102) includes an arrangement of a plurality of optical elements. The optical imaging apparatus (102) captures field of interest in the visual site arrangement of a plurality of optical elements, which are arranged in a particular way, to produce an image on a camera sensor. The image so produced is compatible with 3D viewing systems directly as a plug and play, without using a high-end 3D processing interface for rendering the 3D image.

[0037] FIG. 1 illustrates an exemplary environment of the optical imaging system including the optical imaging apparatus (102) having an arrangement of a plurality of optical elements, in accordance with an embodiment of the present invention. The optical imaging system (102), as shown in FIG. 1, comprises of an optical imaging apparatus (102) of the present invention. The optical imaging apparatus (102) of the present invention includes an arrangement of a plurality of optical elements, such that the arrangement of the optical elements forms the optical imaging apparatus (102). The optical imaging apparatus (102) is implemented at a commercially available standard optical instrument, such as a microscope (104, 201). In an embodiment, the standard optical instrument is a slit lamp. The optical imaging apparatus (102) is designed to be used with commercially available 2D camera of suitable specifications and does not require custom 3D cameras. Use of affordable 2D cameras to create 3D would allow more people to afford and use real time 3D viewing. It may be apparent to a person skilled in the art that the standard optical instrument may be any similar optical instrument that are commercially available, and used for similar purposes, as microscopes or slit lamps, without deviating from the meaning and scope of the present invention. A surgeon may view a visual site using oculars (106, 206) of the commercially available standard optical instrument. A visual site may be a surgical site, or any other site of interest which requires precision and depth of visualization. It may be apparent to a person skilled in the art that the visual site which can be viewed using the optical system (100) may be any site requiring precision and depth of visualization, such as a manufacturing site of quality control systems, or surgical site, or any other site, without deviating from the meaning and scope of the present invention.

[0038] While viewing the visual site through the oculars (106, 206) of the microscope/ slit lamp, a surgeon perceives an image that is produced through a plurality of optical elements included in the microscope/slit lamp. The image that is produced through the microscope/slit lamp and perceived by the surgeon in real time, while operating on the visual site, is also transmitted to the imaging apparatus using the in-built custom made beam splitter (204).

[0039] Further, a commercially available image capturing device (108) that may be mirrorless camera/DSLR or video camera is used with the optical imaging apparatus (102). An image on camera sensor of the commercially available image capturing device (108), is produced via the optical imaging apparatus (102) containing the arrangement of the optical elements. The optical imaging apparatus (102) including the arrangement of the optical elements arranged in such a manner, produces the image on the camera sensor (108), an output of which is compatible with currently available 3D viewer.

[0040] In an embodiment, the commercially available image capturing device may be a DSLR/Mirrorless camera/Video camera. In another embodiment, the commercially available image capturing device may be a mirrorless still image camera. In yet another embodiment, the commercially available image capturing device may be a digital video camera. In another embodiment, the commercially available image capturing device may be a mirrorless camera/DSLR inbuilt with an image or video camera. It may be apparent to a person skilled in the art that the commercially available image capturing devices are any other current standard image capturing devices capable of capturing a video, an image, or an audio/video both, without deviating from the meaning and scope of the present invention.

[0041] After the camera sensor (108) or the image capturing device (108) captures the visual site via the optical imaging apparatus (102) implemented at the standard optical instrument, the image capturing device (108) transmits multi-dimensional signals of the captured images or videos of the visual site to a 3D viewer, via an interface, for rendering multi -dimensional images or videos of the visual site at the 3D viewer, in real time. The multi-dimensional signals may be three- dimensional signals. The 3D viewer is any currently available display unit capable of outputting image, video, or audio/video data, individually or in combination. The 3D viewer includes and is not limited to a 3D-TV, a 3D monitor, a smart phone, a laptop, a desktop, a virtual reality (VR) / augmented reality headset, a tablet, an I-Pad or any other available device. It may be apparent to a person skilled in the art that the 3D viewer may be any other current standard video output device (110) capable of outputting or rendering a video, an image, or an audio/video both, individually or in combination, without deviating from the meaning and scope of the present invention.

[0042] The interface for communicating signals from the image capturing device (108) to the 3D viewer may be a communication interface, which allows for direct plug and play transmission and communication between the image capturing device (108) and the 3D viewer occurring in real time, thereby eliminating/reducing the time lag, , between actual capturing of the first image or the first video and rendering of the first image or the first video at 3D viewer. In an embodiment, the interface is a HDMI/ DVI (high definition multimedia interface/digital visual interface) cable. In an embodiment, the interface is a USB (universal serial bus) cable. In an embodiment, the interface is an AUX cable for audio and video input output. It may be apparent to a person skilled in the art that the interface may be any other current standard interface capable of transmitting signals between the imaging device (108) and the 3D viewer as direct plug and play, without deviating from the meaning and scope of the present invention.

[0043] FIG. 2 illustrates an exemplary environment of the optical imaging system with the optical imaging apparatus (102) equipped with a microscope/ slit lamp (104, 201), and a digital camera (205), and a 3D viewer, like TV or a VR head gear, in accordance with an embodiment of the present invention. The FIG. 2 shows an exemplary system (202) including a microscope/ slit lamp (104, 201) with multiple optical elements, an integrated beam splitter (204) with 3D adapter, and a pair of oculars (106, 206). A surgeon views a visual site through the pair of oculars (106, 206) of the microscope/ slit lamp (104, 201). The system further comprises of an optical imaging apparatus (102) of the present invention (same as the optical imaging apparatus (102) of FIG. 1), which is attached with the microscope/ slit lamp (104, 201). The optical imaging apparatus (102) includes an arrangement of a plurality of optical elements where the optical elements are arranged in a particular way for generating images in 3D format it also includes optical elements of a beam splitter (204). Further, a digital camera (205) is attached to the optical imaging apparatus (102) for producing image/video of the visual site at an image sensor (108) of the digital camera (205) via the optical imaging apparatus (102) with the arrangement of a plurality of optical elements.

[0044] The optical imaging apparatus (102) captures a field of interest in the visual site using the arrangement of a plurality of optical elements, which are arranged in a particular way in the optical imaging apparatus (102), to produce image on the image sensor (108) of the digital camera (205), an output of which is compatible with any current 3D viewing devices (206).

[0045] The digital camera (205) transmits multi-dimensional signals to 3D viewer, such as a TV or a VR/AR head gear, or any other currently available 3D viewer, via a communication interface. The communication interface is capable of transmitting real time multi-dimensional signals to the 3D viewer and allows for direct plug and play interfacing and communicating between the digital camera (205) and the 3D viewer. Hence, real time rendering of the captured images or videos in multi-dimensional visualization at the 3D viewer is achieved, with no or very minimal time lag, using direct plug and play interfacing.

[0046] Therefore, the optical imaging apparatus (102) is designed in a such way that any conventional 2D camera unit of r equired specifications can be used to produce the images compatible with current commercially available 3D viewing systems (TV/Monitors/Virtual reality/ Augmented reality headsets). Also, since the output from the digital camera (205) is directly fed into the viewing system (206) as plug and play, there is hardly any noticeable lag in image/video rendering.

[0047] FIG. 3 illustrates the preferred arrangement of the plurality of optical elements having at least one in-built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which are being arranged/implemented/constructed at standard optical instrument. The said plurality of optical elements are arranged in a particular fashion. Fig. 3 illustrates how the various preferred components such as Object, Cube beam splitter, Reflecting prism, Anamorphic prism, Anamorphic prism, Focusing lens, Reflecting mirror, Reflecting mirror, Camera sensor are arranged as per the present invention. The development of adapter for commercial 2D camera, the adapter creates the images on the camera sensor which are in a format when displayed on the 3D monitors/ viewing devices gives 3D images/video in real time. In the present invention any processor to generate 3D are not used. Hence, the time lag of the real time imaging to the processing power of the camera only, which is very negligible. Further, the most systems use twin cameras/ two camera sensors, then use a processor to synchronize the images and then display and leading to time lag to view the image/video. The present invention uses one commercial 2D camera and the image is generated using the above arrangement with 3D adapter to generate images on the camera which are in 3D compatible format with minimum, negligible or no time lag. [0048] FIG. 4 illustrates a flowchart of an exemplary method (300) of implementing an optical imaging system (102) for operating a standard optical instrument, such as a microscope/ slit lamp (104, 201), in accordance with an embodiment of the present invention. The method in FIG. 4 is read and understood in conjunction with the components and functioning of the components described in the Fig. 1, Fig 2, FIG. 3 and Fig. 4 shows the method that includes a step (302) of a visual site is viewed through oculars (106, 206) of an optical instrument, such as surgeon oculars (106, 206) of microscope/ slit lamp (104, 201). The visual site may be a surgical site. At a step (304), the visual site is imaged through optical elements of microscope/ slit lamp (104, 201), which creates first image of the visual site at the microscope/ slit lamp (104, 201).

[0049] Further at step (306), the optical imaging apparatus (102) simultaneously captures the visual site using a series of optical elements that are arranged in a particular way to produce an image on a camera sensor (108) of a digital camera (205). Therefore, currently available image capturing devices, such as digital camera (205), DSLR/Mirrorless camera etc. can be used with the optical imaging apparatus (102) for capturing images of the visual site, via the optical imaging apparatus (102) including the arrangement of the series of optical elements.

[0050] Thereafter, at step (308), the digital camera (205) transmits the captured images of the visual site to the 3D viewer via a plug and play communicating interface, as three-dimensional signals. At step (310), three-dimensional visualization of the captured images of the visual site is rendered in real time at the 3D viewer.

[0051] Advantageously, the present invention provides an apparatus containing a series or plurality of optical elements structures such as at least one in-built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which are arranged/implemented/constructed at standard optical instrumentarranged in such a manner to produce image on the camera sensor. Further, the apparatus is designed in such that any commercially available camera unit of required specifications can be used to produce the images compatible with current commercially available 3D viewing systems (206) (TV/Monitors/Virtual reality headsets). Also, since the output from the digital camera (205) is directly fed into the viewing system (206) as plug and play, there is hardly any noticeable lag in image rendering. As a result, the apparatus does not hinder the microscope oculars (106, 206) and the surgeon can seamlessly alternate between the 3D monitor view and the view through the oculars (106, 206) (feature not available in some of the current systems). Also, the optical elements of apparatus are designed in a such way that adapter can be mounted on any side of the microscope/ slit lamp (104, 201) using a custom-made beam splitter (204).

[0052] The cost of such 3D surgical assist or recording system, using the optical imaging apparatus (102) of the present invention, is significantly less compared to customised ones since commercially available cameras are used in the present invention and there are no high-end computing systems used to render 3D images. This reduction in cost will lead to greater penetration of this 3-D surgical assist systems across various specialties world over. Additionally, the use of the apparatus will lead to better training of the residents as they can watch surgeries in real time seeing exactly the same surgical view as that of the operating surgeon which is not only magnified but also delivers the depth perception on a 3-D display screen or VR/AR devices and is a very critical part of the microsurgical skill transfer to trainee surgeons. [0053] While certain embodiments have been described, these embodiments have been presented by way of example only and are not intended to limit the scope of the present disclosure. Indeed, the novel methods, devices, and systems described herein may be embodied in a variety of other forms. Furthermore, various omissions, substitutions, and changes in the form of the methods, devices, and systems described herein may be made without departing from the spirit of the present disclosure.

Claims

I/WE Claim:

1. An apparatus for operating optical surgical instruments for real time three-dimensional or multi-dimensional visualization of a visual site, said apparatus or system comprising: a microscope/slit lamp (104, 201) with multiple optical elements and a pair of oculars (106, 206) for viewing the visual site; an optical imaging apparatus (102), connected to be used with the microscope/slit lamp (104, 201) includes an in-built beam splitter (204) and an arrangement of a plurality of optical elements which are arranged in a particular fashion; an image capturing device (205) installed at the optical imaging apparatus (102) for producing image/video of the visual site at its sensor ; and a communication interface for transmitting real time multi-dimensional signals to a 3D viewer via direct plug and play, wherein, i. the pair of oculars (106, 206) of the microscope/slit lamp (104, 201) is used by a surgeon or an assisting surgical team member to view a visual site such as a surgical site, or any other site of interest which requires precision and depth of visualization; ii. while viewing the visual site through the pair of oculars (106, 206) of the microscope/slit lamp (104, 201), the surgeon perceives an image that is produced through multiple optical elements included in the slit lamp (104, 201); iii. the optical imaging apparatus (102) simultaneously captures the visual site using a series of optical elements that are arranged in a particular fashion such that series of optical elements produces an image on a camera sensor of the image capturing device (205), an output of which is compatible with the 3D viewer; iv. an image produced on the camera sensor of the image capturing device (205) that may be a mirrorless camera/ digital single-lens reflex (DSLR) camera or video camera is transmitted as multi-dimensional signals, via the communication interface as direct plug and play, to the 3D viewer for rendering multi-dimensional images or videos or audio/video data of the visual site at the 3D viewer, in real time.

2. The apparatus as claimed in claim 1, wherein the optical imaging apparatus is used for operating/functioning optical instruments, such as microscope, slit lamps etc. for providing real time visualization of the visual site, including surgical site or an object, in multi-dimensions, using commercially available imaging devices or systems, such as the image capturing device (205).

3. The apparatus as claimed in claim 1, wherein the optical imaging apparatus has an adapter that can be mounted on any side of the microscope/slit lamp (104, 201) using an in-built custom-made beam splitter (204).

4. The apparatus as claimed in claim 1, wherein the optical imaging apparatus (102) comprising the arrangement of the plurality of optical elements having at least one in built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which are being arranged/implemented/constructed at standard optical instrument.

5. The apparatus as claimed in claim 1, wherein the optical imaging apparatus can be used with any commercially available camera unit of required specifications such as DSLR/mirrorless camera or video camera to produce the images compatible with current commercially available 3D viewing systems such as TV/Monitors/Virtual reality/ Augmented Reality headsets.

6. The apparatus as claimed in claim 2, wherein the arrangement of the plurality of optical elements forming optical imaging apparatus (102) produces an image on the camera sensor, the output of which is compatible with current 3D viewing devices (206) directly as plug and play.

7. The apparatus as claimed in claim 1, wherein the image capturing device (205) includes any one of mirrorless camera/ DSLR camera or video camera or smart phone camera, individually or in combination, that transmits multi-dimensional signals of the captured images or videos of the visual site to the 3D viewer, via the communication interface, for rendering multi-dimensional images or videos of the visual site at the 3D viewer, in real time with no or minimal noticeable lag in image rendering.

8. The apparatus claimed in claim 1, wherein the optical imaging apparatus facilitates the surgeon to view seamlessly alternate between the 3D monitor view and the view through the oculars (106, 206).

9. A method of implementing an optical imaging system (102) for operating the optical instrument as claimed in claim 1, said method comprising the steps of: i) viewing (302) a visual site through oculars (106, 206) of an optical instrument, such as surgeon oculars (106, 206) of a microscope/slit lamp (104, 201) and the visual site includes at least a surgical site; ii) imaging the visual site through optical elements of the microscope/slit lamp (104, 201), which creates first image of the visual site at the microscope/slit lamp (104, 201); iii) capturing though the optical imaging apparatus (102) simultaneously the visual site using a series of optical elements that are arranged in a particular way to produce an image on a camera sensor (108) of a digital camera (205); iv) transmitting the captured image of the visual site of the digital camera (205) to a 3D viewer via a plug and play communicating interface, as three-dimensional signals; and v) rendering the three-dimensional visualization of the captured images of the visual site to the 3D viewer in real time.

10. A method as claimed in claim 9, wherein operating commercially available standard optical instruments, such as microscope, slit lamps, etc. and rendering real time three- dimensional visualization of a visual site or an object using commercially available standard imaging devices, such as DSLR/mirrorless still or Video camera, wherein: three-dimensional visualization of the visual site is rendered in real time at a commercially available standard 3D viewer such as a TV or virtual reality and or an augmented reality device; and output of an image capturing device that may be a mirrorless camera/ DSLR camera or video camera is directly fed into the 3D viewer as plug and play, without using a high-end 3D rendering interface.

11. The method as claimed in claim 9, wherein the optical imaging apparatus is used for operating/functioning optical instruments, such as microscope, slit lamps etc. for providing real time visualization of the visual site, including surgical site or an object, in multi-dimensions, using commercially available imaging devices or systems, such as the image capturing device (205).

12. The method as claimed in claim 9, wherein the optical imaging apparatus has an adapter that can be mounted on any side of the microscope/slit lamp (104, 201) using an in built custom-made beam splitter (204).

13. The method as claimed in claim 9, wherein the optical imaging apparatus (102) comprising the arrangement of the plurality of optical elements having at least one in built beam splitter (502a, 502b), reflecting prism (503a, 503b), anamorphic prism (504a, 504b), focusing lens (506a, 506b), reflecting mirror (507a, 507b, 508) and camera sensor (509), which are being arranged/implemented/constructed at standard optical instrument.