Patent application number | Description | Published |
20080235276 | METHODS FOR SCANNING, PRINTING, AND COPYING MULTIMEDIA THUMBNAILS - A method, apparatus and article of manufacture for creating visualizations of documents are described. In one embodiment, the method comprises receiving an electronic visual, audio, or audiovisual content; generating a display for authoring a multimedia representation of the received electronic content; receiving user input, if any, through the generated display; and generating a multimedia representation of the received electronic content utilizing received user input. | 09-25-2008 |
20080235564 | METHODS FOR CONVERTING ELECTRONIC CONTENT DESCRIPTIONS - A method, apparatus and article of manufacture for creating visualizations of electronic audiovisual compositions are described. In one embodiment, a method comprises: receiving an electronic composition description; rendering a visual representation of electronic visual composition description; generating a content description that includes semantic information and location information for elements within the electronic audiovisual composition description; identifying one or more audible, visual, and audiovisual elements from the content description; and generating a multimedia overview of the electronic composition description that includes a selected set of the identified one or more audible, visual, and audiovisual elements. | 09-25-2008 |
20080235585 | METHODS FOR AUTHORING AND INTERACTING WITH MULTIMEDIA REPRESENTATIONS OF DOCUMENTS - A method, apparatus and article of manufacture for assisting a user with authoring a multimedia representation of documents. In one embodiment, the method comprises displaying one or more visual, audible, or audiovisual document elements from an input document in graphical user interface; and selecting one or more elements and for inclusion in a multimedia representation. | 09-25-2008 |
20080309648 | Video Playback on Electronic Paper Displays - A system for displaying video on electronic paper displays to reduce video playback artifacts comprises an electronic paper display, a video transcoder, a display controller and a waveforms module. The video transcoder receives a video stream on for presentation on the electronic paper display. The video transcoder processes the video stream and generates pixel data that is provided to the display controller. The video transcoder adapts and re-encodes the video stream for better display on the electronic paper display. In one embodiment, the video transcoder includes one or more of the following processes: encoding the video using the control signals instead of the desired image, encoding the video using simulation data, scaling and translating the video for contrast enhancement and reducing errors by using simulation feedback, past pixels and future pixels. The present invention also includes a method for displaying video on an electronic paper display. | 12-18-2008 |
20090016615 | Invisible Junction Feature Recognition For Document Security or Annotation - The present invention uses invisible junctions which are a set of local features unique to every page of the electronic document to match the captured image to a part of an electronic document. The present invention includes: an image capture device, a feature extraction and recognition system and database. When an electronic document is printed, the feature extraction and recognition system captures an image of the document page. The features in the captured image are then extracted, indexed and stored in the database. Given a query image, the features in the query image are extracted and compared against those stored in the database to identify the query image. The feature extraction and recognition system of the present invention is integrated into a multifunction peripheral. This allows the feature extraction and recognition system to be used in conjunction with other modules to provide security and annotation applications. | 01-15-2009 |
20090028382 | Techniques for positioning images in electronic documents - Techniques for positioning images in an electronic document. The images may encode information that can be decoded by devices configured to read the images. An area within the electronic document for positioning the image and a set of one or more colors to be used for the image are determined. The determined area and set of colors are such that the image when positioned in the electronic document blends in with the contents of the electronic document while still being clearly visible for reading by reader devices that are configured read and decode the information encoded by the image. | 01-29-2009 |
20090063431 | MONITORING AND ANALYZING CREATION AND USAGE OF VISUAL CONTENT - An MMR system includes an analytics module for monitoring and analyzing the creation and usage of visual content search. The analytics module is part of a MMR gateway and provides a mechanism for administrators to determine the usage patterns and other information about users of the MMR system. This information is fed back to other components of the MMR system to improve its operation. The analytics module comprises a monitoring module, a usage database, an access analysis module and a presentation module. The monitoring module is coupled to other components of the MMR gateway and collects information about retrieval request, image queries, context information and recognition results. The usage database stores the information collected by the monitoring module. The access analysis module performs queries on the usage database and analyzes the results. The output of the access analysis module is provided to the presentation module for presentation or output to other systems and users. | 03-05-2009 |
20090067726 | COMPUTATION OF A RECOGNIZABILITY SCORE (QUALITY PREDICTOR) FOR IMAGE RETRIEVAL - A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR system also includes a quality predictor as a plug-in installed on the mobile device to filter images before they are included as part of a retrieval request or as part of the MMR matching unit. The quality predictor comprises an input for receiving recognition algorithm information, a vector calculator, a score generator and a scoring module. The quality predictor receives as inputs an image query, context information and device parameters, and generates an outputs a recognizability score. The present invention also includes a method for generating robustness features. | 03-12-2009 |
20090070110 | COMBINING RESULTS OF IMAGE RETRIEVAL PROCESSES - A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR matching unit also includes a result combiner coupled to each of the recognition units to receive recognition results. The result combiner produces a list of most likely results and associated confidence scores. This list of results is sent by the result combiner back to the MMR gateway for presentation on the mobile device. The result combiner uses the quality predictor as an input in deciding which results are best. The present invention also includes a number of novel methods including a method for generating the list of best results. | 03-12-2009 |
20090070302 | Mixed Media Reality Recognition Using Multiple Specialized Indexes - An MMR system for searching across multiple indexes comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR matching unit includes a segmenter for segmenting received images by content type, a distributor for distributing the images to corresponding content type index tables, and an integrator for integrating recognition results. The result is returned to the mobile device via the pre-processing server or MMR gateway. The present invention also includes a number of novel methods including a method for processing content-type specific image queries and for processing queries across multiple indexes. | 03-12-2009 |
20090070415 | ARCHITECTURE FOR MIXED MEDIA REALITY RETRIEVAL OF LOCATIONS AND REGISTRATION OF IMAGES - A MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The mobile devices send retrieval requests including image queries and other contextual information. The MMR gateway processes the retrieval request from the mobile devices and then generates an image query that is passed on to the MMR matching unit. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR matching unit includes an image registration unit that receives new content from the MMR publisher and updates the index table of the MMR matching unit. A method for automatically registering images and other data with the MMR matching unit, a method for dynamic load balancing and a method for image-feature-based queue ordering are also included. | 03-12-2009 |
20090074300 | AUTOMATIC ADAPTION OF AN IMAGE RECOGNITION SYSTEM TO IMAGE CAPTURE DEVICES - A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The image registration unit includes an indexing unit for generating images adapted to the environment and capabilities of the image capture device. The indexing unit also automatically adapts the configuration of the plurality of recognition units and index tables based upon image queries applied to the plurality of recognition and index tables. The plurality of recognition units and index tables are configured based on content they reference, recognition algorithm used or other factors. The present invention also includes a number of novel methods including a method for generating blurry images for device training; a method for generating classifiers; a method for selecting a pass classifier; and a method for modifying a hypothesizing and testing classifier on unrecognized images. | 03-19-2009 |
20090076996 | Multi-Classifier Selection and Monitoring for MMR-based Image Recognition - A MMR system that uses multiple classifiers for predicting, monitoring, and adjusting index tables for image recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit includes a plurality of recognition unit and index table pairs corresponding to classifiers to be applied to received image queries, as well as an image registration unit for storing and monitoring performance data for the classifiers. The MMR matching unit receives the image query and identifies, using a classifier set, a result including a document, the page, and the location on the page corresponding to the image query. The present invention also includes methods for monitoring online performance of a multiple classifier image recognition system, for classifier selection and comparison, and for offline classifier prediction. | 03-19-2009 |
20090080800 | Multiple Index Mixed Media Reality Recognition Using Unequal Priority Indexes - An MMR system for processing image queries across index tables with unequal priority comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. The MMR matching unit includes a dispatcher, a plurality of recognition units, and index tables, as well as an image registration unit. In one embodiment, the system includes an MMR matching plug-in installed on the mobile device. The present invention also includes methods for processing image queries across index tables of unequal priority and updating a high priority index based on received or projected image queries. | 03-26-2009 |
20090092287 | Mixed Media Reality Recognition With Image Tracking - An MMR system integrating image tracking and recognition comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. Image tracking information also is provided for determining relative locations of images within a document page. The mobile device includes an image tracker for providing at least a portion of the image tracking information. The present invention also includes methods for image tracking-assisted recognition, recognition of multiple images using a single image query, and improved image tracking using MMR recognition. | 04-09-2009 |
20090092322 | Semantic Classification and Enhancement Processing of Images for Printing Applications - A printing system enables the printing of enhanced documents using a semantic classification scheme. A printing system receives an image to be printed. The system classifies the image according to the semantic classification scheme and, based on this classification, performs enhancement processing on the image. Depending on the desired application, the printing system may recognize and classify any number of image types and may then perform various enhancement processing functions on the image, where the type of enhancement processing performed is based on the classification of the image. | 04-09-2009 |
20090100048 | Mixed Media Reality Retrieval of Differentially-weighted Links - An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher integrated into a network with an advertiser, an ad broker, and an MMR service bureau. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR service bureau uses the result to retrieve advertising or other links associated with the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a differentially weighting links associated with an MMR document. | 04-16-2009 |
20090100050 | CLIENT DEVICE FOR INTERACTING WITH A MIXED MEDIA REALITY RECOGNITION SYSTEM - The mobile device includes a client that has a number of modules, and the MMR Gateway and MMR matching unit are implemented as a server that has a number of modules. The implementation of the MMR system as a client and a server is advantageous because the modules may be distributed among the client and the server in a variety of configurations. The present invention includes a capture module, a preprocessing module, a feature extraction module, a retrieval module, a send message module, an action module, a prediction module, a feedback module, a sending module, an MMR database, a streaming module, an e-mail module, a voice recognition system and an audio database. These modules and systems are operational upon the client or the server. In one embodiment, the client includes only the capture module with the remaining modules operational on the server. In a second embodiment, the server includes the action module with the remaining modules operational on the client. | 04-16-2009 |
20090100334 | Capturing Symbolic Information From Documents Upon Printing - An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit, and an MMR publisher. A computer includes a document authoring application, plug-in, and printer driver. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a method for capturing symbolic information from documents and for capturing printer dll functions. | 04-16-2009 |
20090219264 | VIDEO PLAYBACK ON ELECTRONIC PAPER DISPLAYS - A system for displaying video on electronic paper displays to reduce video playback artifacts comprises an electronic paper display, a video display driver, a video transcoder, a display controller, a memory buffer and a waveforms module. The video display driver receives a re-formatted video stream, which has been processed by the video transcoder, from the memory buffer. The video display driver directs the video transcoder to process the video stream and generate pixel data. The video display driver loads waveforms into the frame buffer and updates display commands repeatedly to activate the display controller until the end of the video playback. The video display driver directs copying video frames sequentially one by one from the memory buffer to the frame buffer in real time during the video playback. The video transcoder receives a video stream for presentation on the electronic paper display and processes the video stream generating pixel data that is provided to the display controller. The present invention also includes a method for displaying video on an electronic paper display. | 09-03-2009 |
20090285444 | Web-Based Content Detection in Images, Extraction and Recognition - A web-based image detection system includes: an image capture device, a web browser, a plug-in, and a recognition server. A captured image is processed by the plug-in to assess whether a pre-determined content type is contained with in the image. Once an initial analysis at the browser plug-in detects a pre-determined content type in an image, the image is transmitted to a recognition server for content recognition of the image by content type. The system thus enables users to link documents or other image types to electronic data using only a capture device and a web browser. | 11-19-2009 |
20100166309 | System And Methods For Creation And Use Of A Mixed Media Environment - A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system includes an MMR user, a MMR computer, a user printer that produces a printed document, a networked media server, an office portal, a service provider server, an electronic display that is electrically connected to a set-top box, a document scanner, a network, a capture device, a cellular infrastructure, wireless fidelity (Wi-Fi) technology, Bluetooth® technology, infrared (IR) technology, wired technology, and a geo location mechanism. The MMR system of the present invention provides mechanisms for forming a mixed media document that includes media of at least two types, such as printed paper as a first medium and a digital photograph, digital movie, digital audio file, or web link as a second medium. Furthermore, the MMR system of the present invention facilitates business methods that take advantage of the combination of a portable electronic device, such as a cellular camera phone, and a paper document. | 07-01-2010 |
20110310110 | SYNTHETIC IMAGE AND VIDEO GENERATION FROM GROUND TRUTH DATA - A system and a method are disclosed for generating video. Object information is received. A path of motion of the object relative to a reference point is generated. A series of images and ground for a reference frame are generated from the ground truth and the generated path. A system and a method are disclosed for generating an image. Object information is received. Image data and ground truth may be generated using position, the image description, the camera characteristics, and image distortion parameters. A positional relationship between the document and a reference point is determined. An image of the document and ground truth are generated from the object information and the positional relationship and in response to user specified environment of the document. | 12-22-2011 |
20120254240 | Method For Determining Constraint-Based Relationships Between Devices For Interacting and Sharing Information - The system includes a constraint-based registry server and a plurality of devices. The constraint-based registry server is coupled to the plurality of devices for publishing or registering spots, managing places and authenticating membership and places. The constraint-based registry server includes a data store for constraint metadata, an authentication module, a spot manager module, a place manager module and a query response module. The devices are adapted to collect field values, create spots, access places, and interact and share information with other spots. In one embodiment, the devices include a constraint collection module, a spot creation module, a query module, a challenge creation module, a presentation module, a challenge response module, a spot action module and a spot communication module. The present invention also includes a number of methods for creating a spot, for generating and approving a challenge, for direct communication or sharing of documents, for performing an action based upon information space membership and for searching for available places. | 10-04-2012 |
20120257237 | Capturing Symbolic Information From Documents Upon Printing - An MMR system for publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit, and an MMR publisher. A computer includes a document authoring application, plug-in, and printer driver. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The list of results and links are sent back to the MMR gateway for presentation on the mobile device. The present invention also includes a number of novel methods including a method for capturing symbolic information from documents and for capturing printer dll functions. | 10-11-2012 |
20130346431 | Monitoring and Analyzing Creation and Usage of Visual Content - An MMR system includes an analytics module for monitoring and analyzing the creation and usage of visual content search. The analytics module is part of an MMR gateway and provides a mechanism for administrators to determine the usage patterns and other information about users of the MMR system. The analytics module comprises a monitoring module, a usage database, an access analysis module and a presentation module. The monitoring module collects information about the retrieval request, image queries, context information and recognition results. The usage database stores the information collected by the monitoring module. | 12-26-2013 |