Patent application number | Description | Published |
20080266294 | 3D Object Scanning Using Video Camera and TV Monitor - A system creates three-dimensional computer models of physical objects by displaying illumination patterns on a display device to incidentally illuminate a physical object. A video camera acquires images of the object illuminated by the patterns. The patterns can include motion and multiple colors for acquiring images with large variations in surface shading of the object. Shading values from acquired images of the object are analyzed to determine the orientation of points on the object's surface. The system evaluates the quality of acquired images and selects patterns tailored to specific attributes of objects. The points' orientations are determined by comparing the points' shading values with an illumination model or shading values acquired from a calibration shading object. A model surface is fitted to the point's orientations. Applications may utilize the model for any purpose, including creating and exchanging customized virtual objects, enhanced object tracking, and videoconferencing applications. | 10-30-2008 |
20110151970 | Locating camera relative to a display device - Embodiments of the present disclosure relate to a method, system, and computer-readable medium for locating a sensor of a gaming console relative to a position of a display device in a gaming system includes displaying an image on the display device, estimating the first position and first orientation of the display device relative to the portable device, once the sensor on the portable device has found the image on the display device, instructing the user to move the portable device to a new position, estimating the second position and second orientation of the display device relative to the portable device, once the sensor on the portable device has found the image on the display device, determining the size of the display device using information gathered during the estimating of the first position and orientation and the estimating of the second position and orientation, and determining the orientation of the display device relative to a sensor of a gaming console using the two findings sent to the gaming console. | 06-23-2011 |
20110298829 | Selecting View Orientation in Portable Device via Image Analysis - Methods, systems, and computer programs for setting the orientation of a view shown on a portable device's display are presented. In one embodiment, a method includes an operation for capturing an image of the area in front of the display. Further, the location of one or more features of a person's face is identified when the person is located in the area in front of the display. The method includes another operation for determining one axis of the face based on the location of these features. Additionally, the orientation of the view shown on the display of the portable device is set to substantially correspond to the axis of the face. | 12-08-2011 |
20120013770 | OVERLAY VIDEO CONTENT ON A MOBILE DEVICE - Methods, systems, and devices are described for providing overlay content to be placed over captured video content for display on a mobile device. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera and display may capture video data which includes the video content from the video display. The location of the video content within the captured video data may be tracked. The mobile device may access overlay content, and display the accessed overlay content over the tracked video content. | 01-19-2012 |
20120014558 | POSITION-DEPENDENT GAMING, 3-D CONTROLLER, AND HANDHELD AS A REMOTE - Methods and systems for using a position of a mobile device with an integrated display as an input to a video game or other presentation are presented. Embodiments include rendering an avatar on a mobile device such that it appears to overlay a competing user in the real world. Using the mobile device's position, view direction, and the other user's mobile device position, an avatar (or vehicle, etc.) is depicted at an apparently inertially stabilized location of the other user's mobile device or body. Some embodiments may estimate the other user's head and body positions and angles and reflect them in the avatar's gestures. | 01-19-2012 |
20120017236 | SUPPLEMENTAL VIDEO CONTENT ON A MOBILE DEVICE - Methods, systems, devices, and software are described for providing supplemental content for display on a mobile device. In one embodiment, a system includes a video display that displays video content. A mobile device with an integrated display may track the video display, with a video camera or other methods, and identify the video content in the tracked video display. The mobile device may access supplemental content related to the identified video content, and display the accessed supplemental content on the integrated display. | 01-19-2012 |
20120038635 | 3-D RENDERING FOR A ROTATED VIEWER - Methods and systems for displaying a three dimensional image to a rotated viewer are presented. The roll and yaw of a viewer's eyes, with respect to a display, is tracked and used to adjust the orientation of a pair of stereoscopic images so as to maintain a three dimensional image when a viewer is rotated. Adjustment to the orientation of the pair of stereoscopic images may also factor in the orientation of a plurality of viewers, each viewer with a potentially different orientation with respect to the display. | 02-16-2012 |
20120075062 | METHOD AND SYSTEM FOR ACCESS TO SECURE RESOURCES - A system and method for accessing secured resources using a portable device. When a user with such a portable device is within close proximity to a locked door or other secured resource, a verification process can be automatically initiated on the device. The user verification could utilize all the input and sensor methods on the device. Once the identification process has successfully completed, an access code can be transmitted to the locked door or device via wired or wireless network. This allows for reduced electronics required at these locked doors and allows for more dynamic security measures. | 03-29-2012 |
20120075462 | BLOW TRACKING USER INTERFACE SYSTEM AND METHOD - A blow tracking user interface method and apparatus may detect an orientation of blowing of a user's breath and a magnitude of blowing of the user's breath. A blow vector may be generated from the orientation and magnitude of the blowing of the user's breath. The blow vector may be used as a control input in a computer program. | 03-29-2012 |
20120075463 | USER INTERFACE SYSTEM AND METHOD USING THERMAL IMAGING - A thermal imaging interface for control of a computer program may obtain one or more thermal infrared images of one or more objects with one or more thermographic cameras. The images may be analyzed to identify one or more characteristics of the objects. Such characteristics may be used as a control input in the computer program. | 03-29-2012 |
20120086630 | USING A PORTABLE GAMING DEVICE TO RECORD OR MODIFY A GAME OR APPLICATION IN REAL-TIME RUNNING ON A HOME GAMING SYSTEM - Methods and systems for enabling a user to interface with an interactive application using a handheld device are provided. According to embodiments of the invention, a primary video stream of an interactive application is rendered on a display. Simultaneously, a data feed of the interactive application is transmitted to a handheld device. The data feed is processed on the handheld device to produce an ancillary video stream which is rendered on the handheld device. Interactive input is received at the handheld device while rendering the ancillary video stream. The interactive input is applied to set a virtual tag which defines an event to be rendered on the display when the state of the interactive application reaches a predetermined configuration so as to trigger execution of the virtual tag by the interactive application. | 04-12-2012 |
20120086631 | SYSTEM FOR ENABLING A HANDHELD DEVICE TO CAPTURE VIDEO OF AN INTERACTIVE APPLICATION - Methods and systems for enabling a handheld device to capture video of an interactive session of an interactive application presented on a main display are provided. An interactive session of the interactive application defines interactivity between a user and the interactive application. An initial position and orientation of a handheld device operated by a spectator are determined. A current state of the interactive application based on the interactivity between the user and the interactive application is determined The position and orientation of the handheld device are tracked during the interactive session. A spectator video stream of the interactive session based on the current state of the interactive application and the tracked position and orientation of the handheld device is generated. The spectator video stream is rendered on a handheld display of the handheld device. | 04-12-2012 |
20120102023 | CENTRALIZED DATABASE FOR 3-D AND OTHER INFORMATION IN VIDEOS - Methods and systems for a centralized database for 3-D and other information in videos are presented. A centralized database contains video metadata such as camera, lighting, sound, object, depth, and annotation data that may be queried for and used in the editing of videos, including the addition and removal of objects and sounds. The metadata stored in the centralized database may be open to the public and admit contributor metadata. | 04-26-2012 |
20120122592 | Automated Video Game Rating - In one embodiment described herein, an automated rating system for an electronic game includes a collector configured to collect game data pertaining to the electronic game and to collect implicit user data pertaining to one or more users, a rating processor configured to rate the game based on the collected game data and implicit user data, and a recommender configured to provide a recommendation as a function of the operation of the game rating. | 05-17-2012 |
20120276998 | Methods and Systems for Playing Video Games with a Controller Having a Display that Shares Content with a Main Display - Methods and systems for playing video games with a controller having a display that shares content with a main display are provided. According to embodiments of the invention, a method is provided for interactive gameplay of a video game. The method initiates with executing a video game, the video game providing a virtual environment. A primary view of the virtual environment is rendered on a primary display. A location and orientation of a handheld device in a vicinity of the primary display are tracked. A secondary view of the virtual environment is rendered on the handheld device based on the tracked location and orientation of the handheld device. | 11-01-2012 |
20120295708 | Interface with Gaze Detection and Voice Input - Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands. | 11-22-2012 |
20120300061 | Eye Gaze to Alter Device Behavior - Methods, devices, and computer programs for controlling behavior of an electronic device are presented. A method includes an operation for operating the electronic device in a first mode of operation, and an operation for tracking the gaze of a user interfacing with the electronic device. The electronic device is maintained in a first mode of operation as long as the gaze is directed towards a predetermined target. In another operation, when the gaze is not detected to be directed towards the predetermined target, the electronic device is operated in a second mode of operation, which is different from the first mode of operation. | 11-29-2012 |
20120321130 | SYSTEM AND METHOD FOR CONFIDENCE-BASED MARKER ADJUSTMENT - A tracking system for improving observability of a marker in an image. The tracking system includes a memory unit that stores data; an imaging unit that images the marker and the image; a processor unit that detects the marker in the image; and a communication unit that transmits and receives data. The processor unit determines a first confidence level indicating a visibility of the marker to a user. | 12-20-2012 |
20130038520 | AUTOMATIC SHUTDOWN OF 3D BASED ON GLASSES ORIENTATION - Devices, systems, and methods are presented for shutting down the 3D effect of active shutter 3D glasses by synchronizing the transparency of the lenses with respect to each other when the 3D glasses have been rotated beyond a threshold angle. The threshold angle can be pre-set through a user-selectable switch. Transitioning from an alternating shutter mode to a synchronized shutter mode can include a fade in which the duty cycles of the lens are adjusted. Direct measurement techniques for measuring the differential roll angle between the lenses and left and right eye images on a display are disclosed. | 02-14-2013 |
20130041648 | SOUND LOCALIZATION FOR USER IN MOTION - Methods, apparatus, and computer programs for simulating the source of sound are provided. One method includes operations for determining a location in space of the head of a user utilizing face recognition of images of the user. Further, the method includes an operation for determining a sound for two speakers, and an operation for determining an emanating location in space for the sound, each speaker being associated with one ear of the user. The acoustic signals for each speaker are established based on the location in space of the head, the sound, the emanating location in space, and the auditory characteristics of the user. In addition, the acoustic signals are transmitted to the two speakers. When the acoustic signals are played by the two speakers, the acoustic signals simulate that the sound originated at the emanating location in space. | 02-14-2013 |
20130076894 | POSITION AND ROTATION OF A PORTABLE DEVICE RELATIVE TO A TELEVISION SCREEN - A method for determining the location of a portable device relative to a display is provided. An image stream is captured by the portable device when the portable device is positioned proximate to the display. The image stream is captured from a region of the display when the display is actively rendering a content stream, the content stream including embedded content for position determination. The embedded content is detected within the captured image stream, and the location of the portable device relative to the display is determined based on the detected embedded content. | 03-28-2013 |
20130183021 | SUPPLEMENTAL CONTENT ON A MOBILE DEVICE - Methods, systems, devices, and software are described for providing supplemental content for presentation on a mobile device that identifies a video and a portion within the video. In one embodiment, a system includes a mobile device with an integrated video camera that tracks a display playing a movie. The mobile device automatically identifies the current scene in the movie and then accesses supplemental non-video content related to the identified scene. The accessed supplemental non-video content (e.g., audio, tactile, olfactory data) is then presented to the user at the same time the movie is played. | 07-18-2013 |
20130187920 | ACCELERATED TEXTURE LOOKUPS USING TEXTURE COORDINATE DERIVATIVES - Methods, systems, and devices are disclosed for preparing to prefetch memory in 3D graphical shader programs. Based on the memory addresses of texels from a texture map that were previously read, a memory address of a to-be-read texel is estimated by using a first-order derivative of the memory address with respect to pixel distance. The estimated memory address is then prefetched for use when the pixel corresponding to the texel is rendered. Whether or not to perform the estimation of the texel memory address can be determined by whether the corresponding pixels are on the same, flat facet on a 3D model. Multiple directions on the facet can be used for memory address estimation as well as higher-order derivatives. | 07-25-2013 |
20130194437 | OVERLAY NON-VIDEO CONTENT ON A MOBILE DEVICE - Methods, systems, and devices are described for presenting non-video content through a mobile device that uses a video camera to track a video on another screen. In one embodiment, a system includes a video display, such as a TV, that displays video content. A mobile device with an integrated video camera captures video data from the TV and allows a user to select an area in the video in order to hear/feel/smell what is at that location in the video. | 08-01-2013 |
20140347272 | AUDIO, VIDEO, SIMULATION, AND USER INTERFACE PARADIGMS - Consumer electronic devices have been developed with enormous information processing capabilities, high quality audio and video outputs, large amounts of memory, and may also include wired and/or wireless networking capabilities. Additionally, relatively unsophisticated and inexpensive sensors, such as microphones, video camera, GPS or other position sensors, when coupled with devices having these enhanced capabilities, can be used to detect subtle features about users and their environments. A variety of audio, video, simulation and user interface paradigms have been developed to utilize the enhanced capabilities of these devices. These paradigms can be used separately or together in any combination. One paradigm automatically creating user identities using speaker identification. Another paradigm includes a control button with 3-axis pressure sensitivity for use with game controllers and other input devices. | 11-27-2014 |
20140364197 | TRANSITIONING GAMEPLAY ON A HEAD-MOUNTED DISPLAY - A method for transitioning gameplay is provided, the method including: receiving a signal to interrupt gameplay of a video game, the gameplay being presented on a head-mounted display; in response to receiving the signal, transitioning the gameplay from an active state to a paused state; wherein transitioning the gameplay includes identifying an intensity of a gameplay aspect, and progressively reducing the intensity of the gameplay aspect before entering the paused state. | 12-11-2014 |
20150015486 | HANDHELD DEVICE FOR SPECTATOR VIEWING OF AN INTERACTIVE APPLICATION - A handheld device is provided, comprising: a sensor configured to generate sensor data for determining and tracking a position and orientation of the handheld device during an interactive session of an interactive application presented on a main display, the interactive session being defined for interactivity between a user and the interactive application; a communications module configured to send the sensor data to a computing device, the communications module being further configured to receive from the computing device a spectator video stream of the interactive session that is generated based on a state of the interactive application and the tracked position and orientation of the handheld device, the state of the interactive application being determined based on the interactivity between the user and the interactive application; a display configured to render the spectator video stream. | 01-15-2015 |