Patent application number | Description | Published |
20090036902 | INTERACTIVE USER INTERFACES FOR ROBOTIC MINIMALLY INVASIVE SURGICAL SYSTEMS - In one embodiment of the invention, a method for a minimally invasive surgical system is disclosed. The method includes capturing and displaying camera images of a surgical site on at least one display device at a surgeon console; switching out of a following mode and into a masters-as-mice (MaM) mode; overlaying a graphical user interface (GUI) including an interactive graphical object onto the camera images; and rendering a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices. | 02-05-2009 |
20090088634 | TOOL TRACKING SYSTEMS AND METHODS FOR IMAGE GUIDED SURGERY - In one embodiment of the invention, a tool tracking system is disclosed including a computer usable medium having computer readable program code to receive images of video frames from at least one camera and to perform image matching of a robotic instrument to determine video pose information of the robotic instrument within the images. The tool tracking system further includes computer readable program code to provide a state-space model of a sequence of states of corrected kinematics information for accurate pose information of the robotic instrument. The state-space model receives raw kinematics information of mechanical pose information and adaptively fuses the mechanical pose information and the video pose information together to generate the sequence of states of the corrected kinematics information for the robotic instrument. Additionally disclosed are methods for image guided surgery. | 04-02-2009 |
20090088773 | METHODS OF LOCATING AND TRACKING ROBOTIC INSTRUMENTS IN ROBOTIC SURGICAL SYSTEMS - In one embodiment of the invention, a method is disclosed to locate a robotic instrument in the field of view of a camera. The method includes capturing sequential images in a field of view of a camera. The sequential images are correlated between successive views. The method further includes receiving a kinematic datum to provide an approximate location of the robotic instrument and then analyzing the sequential images in response to the approximate location of the robotic instrument. An additional method for robotic systems is disclosed. Further disclosed is a method for indicating tool entrance into the field of view of a camera. | 04-02-2009 |
20090088897 | METHODS AND SYSTEMS FOR ROBOTIC INSTRUMENT TOOL TRACKING - In one embodiment of the invention, a method for a robotic system is disclosed to track one or more robotic instruments. The method includes generating kinematics information for the robotic instrument within a field of view of a camera; capturing image information in the field of view of the camera; and adaptively fusing the kinematics information and the image information together to determine pose information of the robotic instrument. Additionally disclosed is a robotic medical system with a tool tracking sub-system. The tool tracking sub-system receives raw kinematics information and video image information of the robotic instrument to generate corrected kinematics information for the robotic instrument by adaptively fusing the raw kinematics information and the video image information together. | 04-02-2009 |
20090157092 | RIBBED FORCE SENSOR - In one embodiment, a force sensor apparatus is provided including a tube portion having a plurality of radial ribs and a strain gauge positioned over each of the plurality of radial ribs, a proximal end of the tube portion that operably couples to a shaft of a surgical instrument that operably couples to a manipulator arm of a robotic surgical system, and a distal end of the tube portion that proximally couples to a wrist joint coupled to an end effector. | 06-18-2009 |
20090192524 | SYNTHETIC REPRESENTATION OF A SURGICAL ROBOT - A synthetic representation of a robot tool for display on a user interface of a robotic system. The synthetic representation may be used to show the position of a view volume of an image capture device with respect to the robot. The synthetic representation may also be used to find a tool that is outside of the field of view, to display range of motion limits for a tool, to remotely communicate information about the robot, and to detect collisions. | 07-30-2009 |
20090245600 | AUTOMATED PANNING AND DIGITAL ZOOMING FOR ROBOTIC SURGICAL SYSTEMS - In one embodiment of the invention, a digital zoom and panning system for digital video is disclosed including an image acquisition device to capture digital video images; an image buffer to store one or more frames of digital video images as source pixels; a display device having first pixels to display images; a user interface to accept user input including a source rectangle to select source pixels within frames of the digital video images, a destination rectangle to select target pixels within the display device to display images, and a region of interest within the digital video images to display in the destination rectangle; and a digital mapping and filtering device to selectively map and filter source pixels in the region of interest from the image buffer into target pixels of the display device in response to the user input. | 10-01-2009 |
20090248038 | FORCE AND TORQUE SENSING IN A SURGICAL ROBOT SETUP ARM - An apparatus, system, and method for improving force and torque sensing and feedback to the surgeon performing a telerobotic surgery are provided. In one embodiment, a robotic surgical manipulator system, a robotic surgical system, and a method for improved sensing of forces on a robotic surgical instrument and/or manipulator arm are disclosed. | 10-01-2009 |
20090268010 | AUGMENTED STEREOSCOPIC VISUALIZATION FOR A SURGICAL ROBOT USING A CAPTURED FLUORESCENCE IMAGE AND CAPTURED STEREOSCOPIC VISIBLE IMAGES - An illumination channel, a stereoscopic optical channel and another optical channel are held and positioned by a robotic surgical system. A first capture unit captures a stereoscopic visible image from the first light from the stereoscopic optical channel while a second capture unit captures a fluorescence image from the second light from the other optical channel. An intelligent image processing system receives the captured stereoscopic visible image and the captured fluorescence image and generates a stereoscopic pair of fluorescence images. An augmented stereoscopic display system outputs a real-time stereoscopic image comprising a three-dimensional presentation of a blend of the stereoscopic visible image and the stereoscopic pair of fluorescence images. | 10-29-2009 |
20090268015 | AUGMENTED STEREOSCOPIC VISUALIZATION FOR A SURGICAL ROBOT - A robotic surgical system positions and holds an endoscope. A visible imaging system is coupled to the endoscope. The visible imaging system captures a visible image of tissue. An alternate imaging system is also coupled to the endoscope. The alternate imaging system captures a fluorescence image of at least a portion of the tissue. A stereoscopic video display system is coupled to the visible imaging system and to the alternate imaging system. The stereoscopic video display system outputs a real-time stereoscopic image comprising a three-dimensional presentation of a blend of a fluorescence image associated with the captured fluorescence image, and the visible image. | 10-29-2009 |
20090270678 | AUGMENTED STEREOSCOPIC VISUALIZATION FOR A SURGICAL ROBOT USING TIME DUPLEXING - An endoscope with a stereoscopic optical channel is again held and positioned by a robotic surgical system. A capture unit captures (1) at a first time, a first image from light from the channel; and (2) at a second time different from the first time, a second image from the light. Only one of the first image and the second image includes a combination of a fluorescence image and a visible image. The other of the first image and the second image is a visible image. An intelligent image processing system generates an artificial fluorescence image using the captured fluorescence image. An augmented stereoscopic display system outputs an augmented stereoscopic image of at least a portion of the tissue comprising the artificial fluorescence image. | 10-29-2009 |
20100164950 | EFFICIENT 3-D TELESTRATION FOR LOCAL ROBOTIC PROCTORING - An apparatus is configured to show telestration in 3-D to a surgeon in real time. A proctor is shown one side of a stereo image pair, such that the proctor can draw a telestration line on the one side with an input device. Points of interest are identified for matching to the other side of the stereo image pair. In response to the identified points of interest, regions and features are identified and used to match the points of interest to the other side. Regions can be used to match the points of interest. Features of the first image can be matched to the second image and used to match the points of interest to the second image, for example when the confidence scores for the regions are below a threshold value. Constraints can be used to evaluate the matched points of interest, for example by excluding bad points. | 07-01-2010 |
20100250000 | OPTIC FIBER CONNECTION FOR A FORCE SENSING INSTRUMENT - In one embodiment, a surgical instrument includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft operably coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer. In one example, the plurality of strain gauges are operably coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer. A fiber optic connector is operably coupled to the fiber optic splitter or the AWG multiplexer. A wrist joint is operably coupled to a distal end of the force transducer, and an end effector is operably coupled to the wrist joint. In another embodiment, a robotic surgical manipulator includes a base link operably coupled to a distal end of a manipulator positioning system, and a distal link movably coupled to the base link, wherein the distal link includes an instrument interface and a fiber optic connector optically linkable to a surgical instrument. A method of passing data between an instrument and a manipulator via optical connectors is also provided. | 09-30-2010 |
20100317965 | VIRTUAL MEASUREMENT TOOL FOR MINIMALLY INVASIVE SURGERY - Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information from stereoscopic images. Two or more discrete points can be designated in three dimensions so as to provide a cumulative length along a straight or curving structure, an area measurement, a volume measurement, or the like. The discrete points may be identified by a single surgical tool or by distances separating two or more surgical tools, with the user optionally measuring a structure longer than a field of view of the stereoscopic image capture device by walking a pair of tools “hand-over-hand” along the structure. By allowing the system user to interact with the tissues while designating the tissue locations, and by employing imaging data to determine the measurements, the measurement accuracy and ease of measurement may be enhanced. | 12-16-2010 |
20100318099 | VIRTUAL MEASUREMENT TOOL FOR MINIMALLY INVASIVE SURGERY - Robotic and/or measurement devices, systems, and methods for telesurgical and other applications employ input devices operatively coupled to tools so as to allow a system user to manipulate tissues and other structures being measured. The system may make use of three dimensional position information from stereoscopic images. Two or more discrete points can be designated in three dimensions so as to provide a cumulative length along a straight or curving structure, an area measurement, a volume measurement, or the like. The discrete points may be identified by a single surgical tool or by distances separating two or more surgical tools, with the user optionally measuring a structure longer than a field of view of the stereoscopic image capture device by walking a pair of tools “hand-over-hand” along the structure. By allowing the system user to interact with the tissues while designating the tissue locations, and by employing imaging data to determine the measurements, the measurement accuracy and ease of measurement may be enhanced. | 12-16-2010 |
20120004508 | SURGICAL ILLUMINATOR WITH DUAL SPECTRUM FLUORESCENCE - In a minimally invasive surgical system, an illuminator includes a visible color component illumination source and a hardware non-visible fluorescence emission illumination source. Thus, the illuminator outputs target image illumination light in a first spectrum where the first spectrum includes at least a portion of the visible spectrum. The illuminator also outputs target image illumination light in a second spectrum, where the second spectrum includes non-visible light with a wavelength the same as a wavelength in an emission from a fluorophore. | 01-05-2012 |
20120004557 | METHOD AND SYSTEM FOR FLUORESCENT IMAGING WITH BACKGROUND SURGICAL IMAGE COMPOSED OF SELECTIVE ILLUMINATION SPECTRA - A surgical site is simultaneously illuminated by less than all the visible color components that make up visible white light, and a fluorescence excitation illumination component by an illuminator in a minimally invasive surgical system. An image capture system acquires an image for each of the visible color components illuminating the surgical site and a fluorescence image, which is excited by the fluorescence excitation component from the illuminator. The minimally invasive surgical system uses the acquired images to generate a background black and white image of the surgical site. The acquired fluorescence image is superimposed on the background black and white image, and is highlighted in a selected color, e.g., green. The background black and white image with the superimposed highlighted fluorescence image is displayed for a user of the system. The highlighted fluorescence image identifies tissue of clinical interest. | 01-05-2012 |
20120020547 | Methods of Locating and Tracking Robotic Instruments in Robotic Surgical Systems - In one embodiment of the invention, a method is disclosed to locate a robotic instrument in the field of view of a camera. The method includes capturing sequential images in a field of view of a camera. The sequential images are correlated between successive views. The method further includes receiving a kinematic datum to provide an approximate location of the robotic instrument and then analyzing the sequential images in response to the approximate location of the robotic instrument. An additional method for robotic systems is disclosed. Further disclosed is a method for indicating tool entrance into the field of view of a camera. | 01-26-2012 |
20120154564 | APPARATUS FOR AUTOMATED PANNING AND DIGITAL ZOOMING IN ROBOTIC SURGICAL SYSTEMS - In one embodiment of the invention, a digital zoom and panning system for digital video is disclosed including an image acquisition device to capture digital video images; an image buffer to store one or more frames of digital video images as source pixels; a display device having first pixels to display images; a user interface to accept user input including a source rectangle to select source pixels within frames of the digital video images, a destination rectangle to select target pixels within the display device to display images, and a region of interest within the digital video images to display in the destination rectangle; and a digital mapping and filtering device to selectively map and filter source pixels in the region of interest from the image buffer into target pixels of the display device in response to the user input. | 06-21-2012 |
20120190920 | ARTICULATE AND SWAPABLE ENDOSCOPE FOR A SURGICAL ROBOT - The present invention is directed to an articulate minimally invasive surgical endoscope with a flexible wrist having at least one degree of freedom. When used with a surgical robot having a plurality of robot arms, the endoscope can be used with any of the plurality of arms thereby allowing the use a universal arm design. The endoscope in accordance to the present invention is made more intuitive a to a user by attaching a reference frame used for controlling the at least one degree of freedom motion to the flexible wrist for wrist motion associated with the at least one degree of freedom. The endoscope in accordance to the present invention attenuates undesirable motion at its back/proximal end by acquiring the image of the object in association with the at least one degree of freedom based on a reference frame rotating around a point of rotation located proximal to the flexible wrist. | 07-26-2012 |
20130046137 | SURGICAL INSTRUMENT AND METHOD WITH MULTIPLE IMAGE CAPTURE SENSORS - A surgical instrument has a distal end portion with an outer surface with an outer radius. One or more image capture elements are movably mounted in the distal end portion. In a first state, the one or more image capture elements are un-deployed. In the first state, a surface having an aperture of at least one of the one or more image capture elements is enclosed within the outer surface of the surgical instrument so that the surface having the aperture does not extend beyond the outer surface. In a second state, the one or more image capture elements are deployed. In the second state the surface having the aperture of the at least one of the one or more image capture elements extends beyond the outer surface. | 02-21-2013 |
20130245375 | INTERACTIVE USER INTERFACES FOR ROBOTIC MINIMALLY INVASIVE SURGICAL SYSTEMS - In one embodiment of the invention, a method for a minimally invasive surgical system is disclosed. The method includes capturing and displaying camera images of a surgical site on at least one display device at a surgeon console; switching out of a following mode and into a masters-as-mice (MaM) mode; overlaying a graphical user interface (GUI) including an interactive graphical object onto the camera images; and rendering a pointer within the camera images for user interactive control. In the following mode, the input devices of the surgeon console may couple motion into surgical instruments. In the MaM mode, the input devices interact with the GUI and interactive graphical objects. The pointer is manipulated in three dimensions by input devices having at least three degrees of freedom. Interactive graphical objects are related to physical objects in the surgical site or a function thereof and are manipulatable by the input devices. | 09-19-2013 |
20130291654 | RIBBED FORCE SENSOR - In one embodiment, a force sensor apparatus is provided including a tube portion having a plurality of radial ribs and a strain gauge positioned over each of the plurality of radial ribs, a proximal end of the tube portion that operably couples to a shaft of a surgical instrument that operably couples to a manipulator arm of a robotic surgical system, and a distal end of the tube portion that proximally couples to a wrist joint coupled to an end effector. | 11-07-2013 |
20130331650 | Optic Fiber Connection for a Force Sensing Instrument - A surgical instrument that includes a housing linkable with a manipulator arm of a robotic surgical system, a shaft coupled to the housing, a force transducer on a distal end of the shaft, and a plurality of fiber optic strain gauges on the force transducer is disclosed. The plurality of strain gauges are coupled to a fiber optic splitter or an arrayed waveguide grating (AWG) multiplexer, which can be coupled to a fiber optic connector. A wrist joint coupled to an end effector is coupled to a distal end of the force transducer. A robotic surgical manipulator that includes a base link coupled to a distal end of a manipulator positioning system, and a distal link with an instrument interface, and a fiber optic connector optically linkable to a surgical instrument. A method of passing data between an instrument and a manipulator via optical connectors is also provided. | 12-12-2013 |
20140055489 | RENDERING TOOL INFORMATION AS GRAPHIC OVERLAYS ON DISPLAYED IMAGES OF TOOLS - An operator telerobotically controls tools to perform a procedure on an object at a work site while viewing real-time images of the work site on a display. Tool information is provided in the operator's current gaze area on the display by rendering the tool information over the tool so as not to obscure objects being worked on at the time by the tool nor to require eyes of the user to refocus when looking at the tool information and the image of the tool on a stereo viewer. | 02-27-2014 |
20140282196 | ROBOTIC SYSTEM PROVIDING USER SELECTABLE ACTIONS ASSOCIATED WITH GAZE TRACKING - A robotic system provides user selectable actions associated with gaze tracking according to user interface types. User initiated correction and/or recalibration of the gaze tracking may be performed during the processing of individual of the user selectable actions. | 09-18-2014 |
20150025392 | EFFICIENT 3-D TELESTRATION FOR LOCAL AND REMOTE ROBOTIC PROCTORING - An apparatus is configured to show telestration in 3-D to a surgeon in real time. A proctor is shown one side of a stereo image pair, such that the proctor can draw a telestration line on the one side with an input device. Points of interest are identified for matching to the other side of the stereo image pair. In response to the identified points of interest, regions and features are identified and used to match the points of interest to the other side. Regions can be used to match the points of interest. Features of the first image can be matched to the second image and used to match the points of interest to the second image, for example when the confidence scores for the regions are below a threshold value. Constraints can be used to evaluate the matched points of interest, for example by excluding bad points. | 01-22-2015 |