[go: nahoru, domu]

US20090094113A1 - Systems and Methods For Using Video Metadata to Associate Advertisements Therewith - Google Patents

Systems and Methods For Using Video Metadata to Associate Advertisements Therewith Download PDF

Info

Publication number
US20090094113A1
US20090094113A1 US12/206,622 US20662208A US2009094113A1 US 20090094113 A1 US20090094113 A1 US 20090094113A1 US 20662208 A US20662208 A US 20662208A US 2009094113 A1 US2009094113 A1 US 2009094113A1
Authority
US
United States
Prior art keywords
video
audio
features
signal
video signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/206,622
Inventor
Matthew G. BERRY
Benjamin J. Weinberger
Schuyler E. ECKSTROM
Albert L. SEGARS
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Adeia Media Solutions Inc
Original Assignee
Digitalsmiths Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digitalsmiths Corp filed Critical Digitalsmiths Corp
Priority to US12/206,622 priority Critical patent/US20090094113A1/en
Publication of US20090094113A1 publication Critical patent/US20090094113A1/en
Assigned to TIVO INC. reassignment TIVO INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DIGITALSMITHS CORPORATION
Priority to US14/707,440 priority patent/US20150245111A1/en
Priority to US15/045,223 priority patent/US11800169B2/en
Assigned to TIVO INC. reassignment TIVO INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DIGITALSMITHS CORPORATION
Assigned to TIVO SOLUTIONS INC. reassignment TIVO SOLUTIONS INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: TIVO INC.
Assigned to TIVO INC. reassignment TIVO INC. EMPLOYMENT AGREEMENT Assignors: BERRY, MATTHEW G.
Assigned to TIVO INC. reassignment TIVO INC. PROPRIETARY INFO/INV AGREEMENT Assignors: WEINBERGER, BENJAMIN J.
Assigned to DIGITALSMITHS CORPORATION reassignment DIGITALSMITHS CORPORATION EMPLOYMENT AGREEMENT Assignors: ECKSTROM, SCHUYLER
Priority to US18/367,794 priority patent/US20240007696A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/587—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using geographical or spatial information, e.g. location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/71—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • G06Q30/0264—Targeted advertisements based upon schedule
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0277—Online advertisement
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/02—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information
    • H04H60/07—Arrangements for generating broadcast information; Arrangements for generating broadcast-related information with a direct linking to broadcast information or to broadcast space-time; Arrangements for simultaneous generation of broadcast information and broadcast-related information characterised by processes or methods for the generation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/27—Arrangements for recording or accumulating broadcast information or broadcast-related information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/35—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users
    • H04H60/37—Arrangements for identifying or recognising characteristics with a direct linkage to broadcast information or to broadcast space-time, e.g. for identifying broadcast stations or for identifying users for identifying segments of broadcast information, e.g. scenes or extracting programme ID
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/58—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of audio
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/56—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H04H60/59—Arrangements characterised by components specially adapted for monitoring, identification or recognition covered by groups H04H60/29-H04H60/54 of video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/61—Arrangements for services using the result of monitoring, identification or recognition covered by groups H04H60/29-H04H60/54
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/68—Systems specially adapted for using specific information, e.g. geographical or meteorological information
    • H04H60/73—Systems specially adapted for using specific information, e.g. geographical or meteorological information using meta-information
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/26603—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4331—Caching operations, e.g. of an advertisement for later insertion during playback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/812—Monomedia components thereof involving advertisement data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835—Generation of protective data, e.g. certificates
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8453—Structuring of content, e.g. decomposing content into time segments by locking or enabling a set of features, e.g. optional functionalities in an executable program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/16—Analogue secrecy systems; Analogue subscription systems
    • H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
    • H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
    • H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/79—Processing of colour television signals in connection with recording
    • H04N9/87—Regeneration of colour television signals
    • H04N9/8715—Regeneration of colour television signals involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Definitions

  • the present invention relates generally to targeted advertisements and, more particularly, to methods and systems for delivering targeted advertisements in association with a video program based on metadata associated with the video program.
  • An advertisement promotes the goods, services, organizations, ideas, etc. of an organization or company via a media.
  • Traditional advertisements were made on printed materials and were available on pamphlets, flyers, billboards, posters, newspapers, and magazines.
  • multimedia content such as radio, television, and movies and were typically presented as an interruption of the primary content—occurring either before the primary content or at intervals during the primary content.
  • advertisements are placed within television programs and movies through product placements and are available on the Internet and on electronically stored content (e.g., DVDs), such as in commercials, trailers, and in promotions on DVDs.
  • Internet search engine sites are able to “sell” the terms or keywords used by an Internet searcher to present targeted advertisements that have been associated with specific keywords or search terms.
  • Such advertisements are presented in pop-up windows, banner advertisement windows, or as “sponsored” links to websites that have requested and paid for prominent placements on the search results screen for specific keywords or search terms.
  • An Internet user that searches “keywords” is more likely than a member of the general public to be a potential customer of a good or services associated with such keywords.
  • the present invention in one aspect, relates to a method for using metadata from a video signal to associate advertisements therewith.
  • the method includes (i) segmenting the video signal into a plurality of video clips, (ii) extracting audio and video features from a video signal, (iii) digitizing the plurality of video clips, (iv) identifying extracted audio features within respective digitized video clips using audio processing, wherein each audio feature is associated with the respective digitized video clip, (v) identifying extracted video features within respective digitized video clips using visual processing, wherein each video feature is associated with the respective digitized video clip, (vi) saving the associated audio features and associated video features in a metadata file, (vii) associating the metadata file with the video signal, (viii) storing the metadata file in a database, and (ix) providing the associated metadata file when a video player requests the corresponding video signal.
  • the associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the
  • the video features includes at least one of (i) one or more people, (ii) one or more characters, (iii) one or more animals, (iv) one or more objects, (v) one or more geographic locations, (vi) background, (vii) one or more scene, or a combination of these features.
  • these video features are extracted by a visual processing system of the feature extraction system.
  • the method includes the step of identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system.
  • the method includes the step of identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system.
  • the method includes a combination of both steps.
  • the video signal may contain accompanying audio signal.
  • Audio features of the audio signal includes at lest one of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and a combination of these audio features.
  • the method further includes the steps of: (i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system, (ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system, and (iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system.
  • the method further includes the steps of: (i) collecting audio features of the audio signal by using audio signal recognition system of the feature extraction system, and (ii) saving the collected audio features in the metadata file.
  • the metadata file is an XML file.
  • the metadata file contains one or more of (i) video identification information, (ii) a file name, (iii) a digital signature, (iv) the length of the video signal, (v) a keyword list, (vi) a time-coded transcript, (vii) one or more segments with a corresponding start and stop time, (viii) one or more contents, (ix) one or more characters, (x) one or more animals, (xi) one or more objects, and (xii) a list of vocabulary.
  • the present invention relates to a system for using metadata from a video signal to associate advertisements therewith.
  • the system has (i) a segmentation system for dividing the video signal into a plurality of video clips, (ii) a digitizing system for digitizing the plurality of video clips, (iii) a feature extraction system for extracting audio features and video features from each digitized video clip, associating each audio feature with at least one digitized video clip, associating each video feature with at least one digitized video clip, and saving the audio features and video features into a metadata file associated with the video signal, (iv) a web interface to the feature extraction system for receiving the digitized video clips, and (v) a database accessible by a third party user, wherein video signals and associated metadata files are stored and indexed with a unique filename for each video signal in the database and its corresponding video signal.
  • the associated metadata file is provided when a video player requests the corresponding video signal, and enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
  • the video features comprise at least one of (i) one or more people, (ii) one or more characters, (iii) one or more animals, (iv) one or more objects, (v) one or more geographic locations, (vi) background, (vii) one or more scenes, and (viii) any combination thereof.
  • the video signal includes an accompanying audio signal.
  • the audio features of the audio signal comprise one or more of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and (vi) any combination thereof.
  • the feature extraction system further comprises an audio signal recognition (ASR) system to identify and recognize the audio features of the video signal, and a visual processing system to identify and recognize the visual features of the video signal.
  • the visual processing system further comprises a object classification system to identify and recognize one or more objects from the video signal, and a scene classification system to identify and recognize one or more scenes from the video signal.
  • the audio signal recognition system further comprises a sound classification system to identify and recognize one or more background sounds from the audio signal, and a music classification system to identify and recognize one or more music segments from the audio signal, and a speech recognition system to identify and recognize human speech, dialogues, one or more words, one or more phrases.
  • the metadata file comprises one or more of video identification information, a file name, a digital signature, the length of the video signal, a keyword list, a time-coded transcript, one or more segments with a corresponding start and stop time, one or more contents, one or more characters, one or more pets, one or more objects, and a list of vocabulary.
  • FIG. 1A illustrates a first embodiment of an advertisement placement system of the present invention
  • FIG. 1B illustrates a second embodiment of an advertisement placement system of the present invention
  • FIG. 1C illustrates a third embodiment of an advertisement placement system of the present invention
  • FIG. 1D illustrates a fourth embodiment of an advertisement placement system of the present invention
  • FIG. 1E illustrates a fifth embodiment of an advertisement placement system of the present invention
  • FIG. 1F illustrates a sixth embodiment of an advertisement placement system of the present invention
  • FIG. 2 illustrates one representative display screen for viewing a video program and advertisements associated herewith based on underlying time-coded metadata
  • FIG. 3 illustrates a high level intake system for receiving video files and generating underlying time-coded metadata
  • FIG. 4 illustrates a more detailed flow chart describing the extraction of metadata from a video signal.
  • FIGS. 5A and 5B illustrate one exemplary meta data file generated and used within the present invention.
  • a video program refers to any multimedia content, such as a movie, a television program, an event, a video, an advertisement, a broadcast, or the like that a user would be interested in viewing online or in recorded format.
  • FIG. 1A a first preferred embodiment of an advertisement placement system 100 A based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated.
  • the video program will be viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110 and that the underlying metadata file associated with the video program, once created, is maintained by the video provider 110 .
  • This system 100 A includes one or more video storage databases 115 of the video provider 110 and a video server 113 that provides video programs in VOD or video streaming format over a computer network, such as the Internet for example, to a viewer 150 (or end user).
  • a video file 120 associated with the video program 121 is preferably provided to a metadata generator 130 .
  • the video file 120 has or includes a unique file name or other video identifier (designated herein by the variable V ID ).
  • the metadata generator 130 receives the video file 120 and, using a metadata processor 133 , creates or generates a time-coded metadata file 125 associated with the corresponding video file 120 and underlying video program 121 . As shown in FIG. 1A , this metadata file 125 is stored in a database 135 of the metadata generator 130 but also provided back to the video provider 110 and associated with the corresponding video file 120 and underlying video program 121 in video storage databases 115 .
  • a request 140 for VOD or video streaming of the video program 121 associated with the video file 120 is received from a video display device 155 (such as a computer, Internet or interactive TV, or similar video playback or viewing device) of the viewer 150 , the video provider 110 begins providing access to the video program 121 in conventional fashion (i.e., this assumes all communication and billing parameters are already or previously satisfied; such communication and billing parameters being beyond the scope of the present invention but within the scope and understanding of those skilled in the art).
  • the metadata file 125 associated with the video file 120 is provided to an advertisement distributor 160 , which uses an advertisement server 163 to process the metadata file 125 to selectively identify one or more appropriate advertisements from its database 165 of potential advertisements that is appropriate to provide in conjunction with the video program 121 and, specifically, with each discrete segment of the video program 121 based on its time-coded metadata.
  • the selected advertisement file(s) 175 are then provided to the video display device 155 of the viewer 150 .
  • the metadata file 125 may be provided in whole to the advertisement distributor 160 or it may be parsed and provided in piece meal or “as needed” fashion to the advertisement distributor 160 .
  • the video display 200 of the video display device 155 is configured to receive and display various types of advertisements in conjunction with the actual video display.
  • Such advertisements are preferably displayed in manners that do not interrupt or delay viewing of the requested video, as would a conventional commercial shown on broadcast television.
  • Such advertisements may be shown as conventional banner ads that appear (i) in an optional vertical side window or panel 205 or (ii) in an optional horizontal window or panel 210 that do not interfere with the main video display area 225 .
  • the video display 200 may also include conventional header areas and menu control areas 215 , 220 . Obviously, the placement and purpose of each of the windows and panels of the video display 200 are within the purview of those skilled in the art.
  • advertisements can be displayed as banner ads, it is also possible and expected that alternative advertisements, such as interstitial ads, bug ads, or hyperlinks that can be opened or accessed by the viewer 150 , may be used alternatively or in conjunction with the banner advertisements.
  • additional advertisements may be placed within the main video display area 225 , such as in the lower portion 230 of the main video display area 225 .
  • advertisements are being used generally to define the information that may be displayed around and during the video playback, it is also possible and expected that other information associated with the video playback, such as background information, more detailed information about the video program, the actors in the video program, scenes, events or locations that appear in the video program, related videos or information, and the like, can be displayed, advertised, or linked during the playback and tied to the current time-code of the video as it is being viewed.
  • Such advertisements can be text, still graphics, videos, audio, hyperlinks, or the like.
  • the advertisements merely display information.
  • the advertisements include a hyperlink that, when activated, pause the primary video and allow the user to view or access the advertisement or other additional information.
  • the actual time-code of the video program 121 is provided either from the video provider 110 or, preferably, from the video display device 155 itself.
  • This time-code information associated with the actual viewing of the video program 121 either is provided in real time to the advertisement distributor 160 so that appropriate advertisement files 175 can be provided back to the video display device 155 in real time or, alternatively, is provided in advance to the video display device 155 for caching and later access at the appropriate time, based on the time-code location of the video program 121 as it is being viewed.
  • user or video display device characteristics 185 are obtainable from the video display device 155 and may be provided to the advertisement distributor 160 .
  • Such user or video display device characteristics 185 typically include location, age, gender, interests, Internet websites visited, and other similar demographic data that may be obtained from cookies or similar tracking information.
  • the advertisement distributor 160 utilizes the video display device characteristics 185 to generate advertisement files 175 that are further targeted and customized for the viewer 150 .
  • the advertisement files 175 are provided back to the video display device 155 for display during viewing of the video program 121 .
  • Such targeted advertisements are still shown and synchronized with the time-coded video program 121 ; however, the user data 185 enables the advertisement server 163 to select more accurately between one or more potentially valid advertisements that could be associated with the video program for a particular time-coded segment.
  • FIG. 1B a second preferred embodiment of an advertisement placement system 100 B based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated.
  • the video program is still viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110 ; however, unlike the first embodiment, in this scenario, the underlying metadata file 125 associated with the video program 121 is sent to the video display device 155 along with the video program 121 .
  • VOD Video-on-Demand
  • the video display device 155 (or at least the video player system/software installed on the video display device) then sends the metadata file 125 (or parsed segments thereof at appropriate time intervals) to the advertisement distributor 160 so that appropriate advertisement file(s) 175 are returned back to the player 155 .
  • user data 185 may be provided from the video display device 155 to the advertisement distributor 160 to enable the advertisement server 163 to select more accurately between one or more potentially valid advertisements that could be associated with the video program for a particular time-coded segment.
  • FIG. 1C a third preferred embodiment of an advertisement placement system 100 C based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated.
  • the video program is also viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110 ; however, unlike the first and second embodiments, in this scenario, the underlying metadata file 125 associated with the video program 121 , once created, is not provided back to the video provider 110 .
  • This embodiment is similar in most respects to the first embodiment; however, when a request for video 140 is received from the viewer 150 , the video provider 110 sends a request 145 for metadata file 125 associated with the video program 121 .
  • This request 145 is either sent directly to the metadata generator 130 (as shown) or (as not shown) to the advertisement distributor 160 first, which then requests the same from the metadata generator 130 .
  • the metadata generator 130 then retrieves the appropriate time-coded metadata file 125 from its database 135 and provides it to the advertisement distributor 160 .
  • the remaining aspects, variations, and alternatives of this embodiment are similar to those discussed in association with the first embodiment.
  • FIG. 1D a fourth embodiment is illustrated, which is another variation of the embodiment shown in FIG. 1C .
  • the metadata file 125 is maintained by the metadata generator 130 , but upon receipt of a request 145 , this time from the video display device 155 , the metadata file 125 is provided to the video display device 155 and provided, preferably in parsed or “as needed” basis to the advertisement distributor 160 .
  • the metadata generator 130 may provide the “as needed” portion of the metadata file 125 to the advertisement distributor 160 corresponding to the video segment being viewed by the viewer 150 .
  • FIG. 1E a fifth preferred embodiment of an advertisement placement system 100 E based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated.
  • the video program is actually provided or sold to the viewer 150 on a DVD 117 or similar storage medium, or is provided as a file download (not shown) (as opposed to a mere video streaming in which the file is not actually downloaded) for later playback.
  • This embodiment is similar to the first embodiment to the extent that the underlying metadata file associated with the video program, once created, is maintained by the video provider 110 .
  • This system 100 E includes one or more video storage databases 115 of the video provider 110 and a video manager 116 that communicates with the metadata generator 130 , the advertisement distributor 160 , and the video storage databases 115 , and which manages the production of stored video programs 117 for distribution in DVD format or for download or the like.
  • a video file 120 associated with the stored video program 117 is preferably provided to the metadata generator 130 .
  • the video file 120 has or includes a unique file name or other video identifier (designated herein by the variable V ID ).
  • the metadata generator 130 receives the video file 120 and, using a metadata processor 133 , creates or generates a time-coded metadata file 125 associated with the corresponding video file 120 and underlying video program 121 .
  • This metadata file 125 is stored in a database 135 of the metadata generator 130 but is also provided back to the video provider 110 and associated with the corresponding video file 120 in video storage databases 115 .
  • the metadata file 125 associated with the video file 120 is provided to the advertisement distributor 160 , which uses an advertisement server 163 to process the metadata file 125 to selectively identify one or more appropriate advertisements from its database 165 of potential advertisements that is appropriate to provide in conjunction with the stored video program 117 and, specifically, with each discrete segment of the stored video program 117 based on its time-coded metadata.
  • the selected advertisement file(s) 175 are then provided back to the video provider 110 , which incorporates the advertisement files 175 directly on the stored video program 117 along with the actual video file 120 .
  • the stored video program 117 has all necessary and desired advertisement files 175 built into the stored video program 117 and plays advertisements during viewing of the video in situations in which the video display device 155 does not (intentional, unintentional, non-compatible, or for whatever reason) have real time access to the Internet to obtain real-time advertisements associated with the video.
  • the remaining aspects, variations, and alternatives of this embodiment are similar to those discussed in association with the first embodiment.
  • FIG. 1F a sixth preferred embodiment of an advertisement placement system 100 F based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated.
  • This embodiment is similar to the fifth embodiment; however, it is contemplated that the video display device 155 has access to the Internet and, thus, is able to obtain real-time advertisement files 175 from advertisement distributor 160 .
  • This arrangement is preferred to the fifth embodiment since advertisements associated with the video program are not fixed and unchangeable on the stored video program 117 media. Instead, over time and with each viewing of the stored video program 117 , the viewer 150 , potentially, has a new advertisement experience.
  • the time-coded metadata file 125 actually stored on the stored video program 117 along with the video file 121 so that when the video program is actually being viewed by the viewer 150 on the video display device 155 , the video display device 155 initiates a communication with the advertisement distributor 160 to provide the time-coded metadata file 125 and to receive back appropriate advertisement file(s) 175 .
  • the viewer 150 may be desirable for the viewer 150 to provide or for the advertisement distributor 160 to have user or video display device characteristics 185 (as described in greater detail previously) so that the advertisement files 175 associated with the time-coded metadata of the stored video program 117 are tailored and targeted slightly more at the viewer 150 , but still associated with the appropriate segment of the video program.
  • the embodiments shown in FIGS. 1E and 1F are combined to store a base set of advertisement files 175 on the stored video program 117 .
  • the advertisement files 175 are for situations in which the video display device 155 is “offline” and does not have access to the Internet.
  • the video display device 155 (or the software associated with the stored video program 117 ) is configured to interact in real time with the advertisement distributor 160 to obtain current and up-to-date advertisement files 175 when it is actually able to access the Internet and communicate with the advertisement distributor 160 .
  • the more up-to-date advertisement files 175 are shown during the video playback if they are available. If they are not available, the pre-stored, base advertisement files 175 are used.
  • FIGS. 1A through 1F represent just some of the more likely arrangements and components involved. Additionally, there may be multiple additional parties involved such that the roles and responsibilities for providing and receiving files, for processing files, and for exchanging and storing data can be handled by different parties or components. For example, there may be two separate parties or components used to generate time-coded metadata files and to store and provide such time-coded metadata files to third parties upon request. Likewise, the video provider may want to act as the throughput for the advertisement distributor so that the video display device never interacts directly with a specified advertisement distributor.
  • FIGS. 3 through 5B provide more detailed explanations are described for the creation of time-coded metadata files associated with underlying video programs.
  • the metadata generator 130 receives the video file 120 , which has or includes a unique file name or other video identifier (designated herein by the variable V ID ).
  • the video file 120 and identifier are stored initially in a SOAP database 310 .
  • the video file 120 is received in .mp4 (MPEG 4) format or, if not, is converted to such (or similar) format, as may be changed or updated from time to time.
  • MPEG 4 MPEG 4
  • a hash of this file is run to generate a unique “video signature” and is checked against the existing video signatures stored in the database 135 to determine if a time-coded metadata file already exists for the video file 120 received. If so, the appropriate time-coded metadata file 125 is provided to any requesting party. If the file does not exist, the video file in .mp4 format is then provided to an audio processor 320 and to a video processor 330 . Once the audio and video have been parsed and used to identify underlying metadata of the video program, the time-coded metadata file is stored in database 135 and is available for distribution or use, as described in association with the embodiments of FIGS. 1A through 1F .
  • FIG. 4 illustrates, in more detail, the steps 400 performed by the metadata processor 133 when a video file 120 is received for intake and processing.
  • the video identifier is obtained from the video provider (step 410 ). As stated previously, this identifier may simply be the file name for the video file or it may be the title and year of the video file or something similar. Based on this identifier, it is possible to determine whether this particular video had been previously processed (step 412 ). If the video had already been processed previously, the database storing such time-coded metadata file is updated and cross-referenced with the identifier and existing video signature (step 430 ), then the process jumps to step 480 and determines whether another video needs to be processed or not.
  • the system then downloads or receives the full video file from the video provider for further processing (step 415 ).
  • the video file is converted to .mp4 (MPEG 4) format, if it is not already in such format, and a hash or “video signature” of the .mp4 version of the video is created. Based on this video signature, it is possible to determine whether this particular video had been previously processed, even if the video identifier did not match a previously-known identifier (step 420 ).
  • step 430 the database storing such time-coded metadata files is updated and cross-referenced with the additional identifier and video signature, if necessary (step 430 ), then the process jumps to step 480 and determines whether another video needs to be processed or not. If the video had not been processed previously, it is then submitted to an audio processor (step 440 ) for audio capture and separation and speech recognition (among other things) and a video processor (step 450 ) for classification and analysis (among other things). The resulting metadata is compiled, tied to or associated with the underlying timecode of the video program, and stored in the metadata database (step 470 ). The process then determines whether there is another video to be processed (step 480 ). If so, the process 400 starts over. If not, the process 400 ends.
  • a video program when a video program is received or converted to .mp4 format, an underlying time-code exists or is established for the video program. All audio and video metadata identified or extracted from the video program by the metadata processor 133 is then tied or associated with specific points or regions within the time code. Initially, key identifiers for the video program are determined and identified. This includes all characters who appear in the video program, key or reoccurring scene locations, key props and objects, key terms, etc. The key identifiers are typically audio features and/or video features, and are extracted from the video signal. Then, the video portion of the video program is parsed and divided into “short clips” or discrete segments.
  • Such segments can be specified by a predetermined time frame, but can alternatively be identified based on information within the video signal, such as, for example, a change of camera shots, angles, scene change, scene break or the like. It should also be noted that different video segments can be defined by different predetermined time frames.
  • each segmented video clip is then digitized.
  • the breaks between each segment is identified and tied to the time-code timeline.
  • the metadata processor 133 runs a language and speech recognition process through the entire video and associates all of the dialogue and background audio with the appropriate video segments and time-codes.
  • characters within the video signal are associated with each of the dialogue entries.
  • the metadata processor 133 runs a number of visual processing programs to identify characters, objects, scenes within each segment of the video program. Each identified audio feature is thus associated with at least one segmented video clip. Similarly, each identified video feature is also associated with at least one segmented video clip.
  • the associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
  • presentment is typically implemented by a visual display device, but may also include email, file delivery, and other delivery methods.
  • the video features identified by the visual processor include at least one of (i) people, (ii) characters, (iii) animals, (iv) objects, (v) geographic locations, (vi) background, (vii) scenes, or a combination of any of these features.
  • these video features are extracted by a visual processing system of the feature extraction system.
  • the method includes the step of identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system.
  • the method includes the step of identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system.
  • the method includes a combination of both steps.
  • Audio features of the audio signal includes at least one of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and a combination of these audio features.
  • the method further includes the steps of: (i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system, (ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system, and (iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system.
  • the method further includes the steps of: (i) collecting audio features of the audio signal by using audio signal recognition system of the feature extraction system, and (ii) saving the collected audio features in the metadata file.
  • the metadata file is in XML format.
  • An exemplary portion of a time-coded metadata file, in XML format, is illustrated in FIGS. 5A and 5B .
  • the metadata file contains one or more of (i) video identification information, (ii) a file name, (iii) a digital signature, (iv) the length of the video signal, (v) a keyword list, (vi) a time-coded transcript, (vii) one or more segments with a corresponding start and stop time, (viii) one or more contents, (ix) one or more characters, (x) one or more animals, (xi) one or more objects, and (xii) a list of vocabulary.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Marketing (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Game Theory and Decision Science (AREA)
  • Economics (AREA)
  • Library & Information Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Acoustics & Sound (AREA)
  • Software Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

A system for using metadata from a video signal to associate advertisements therewith, comprising (i) a segmentation system to divide the video signal into video clips, (ii) a digitizing system for digitizing the video clips, (iii) a feature extraction system for extracting audio and video features from each video clip, associating each audio feature with respective video clips, associating each video feature with respective video clips, and saving the audio and video features into an associated metadata file, (iv) a web interface to the feature extraction system for receiving the video clips, and (v) a database, wherein video signals and associated metadata files are stored and indexed, wherein the associated metadata file is provided when a video player requests the corresponding video signal, enabling selection of a relevant advertisement for presentment in conjunction with respective video clips based on the associated audio and video features of the respective video clip.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Patent Application Ser. No. 60/970,593, entitled “Systems and Methods for Using Video Metadata to Associate Advertisements Therewith,” filed Sep. 7, 2007, which is incorporated herein by reference as if set forth herein in its entirety.
    • TECHNICAL FIELD
  • The present invention relates generally to targeted advertisements and, more particularly, to methods and systems for delivering targeted advertisements in association with a video program based on metadata associated with the video program.
    • BACKGROUND
  • An advertisement promotes the goods, services, organizations, ideas, etc. of an organization or company via a media. Traditional advertisements were made on printed materials and were available on pamphlets, flyers, billboards, posters, newspapers, and magazines. As electronic technology developed, commercials were incorporated into multimedia content, such as radio, television, and movies and were typically presented as an interruption of the primary content—occurring either before the primary content or at intervals during the primary content. Today, advertisements are placed within television programs and movies through product placements and are available on the Internet and on electronically stored content (e.g., DVDs), such as in commercials, trailers, and in promotions on DVDs.
  • Traditional advertisements have typically targeted general audiences. Such advertisements can be tailored somewhat to the audience likely to be watching a movie, television program or show or event, or radio station or program based on the general content of the program or show and based on the likely demographic of the audience who would be expected to watch such program or show. The Internet provides advertisers with a more specific targeted audience and, hence, higher potential return on their advertisement expenses. For example, because each computer contains potentially trackable and usable information about user(s) of that computer (e.g., through the use of cookies, location information, language settings, and prior web sites accessed), Internet websites are able to use such information to generate banner or pop-up advertisements that are based on some information available about potential users of each computer. In yet another example, Internet search engine sites are able to “sell” the terms or keywords used by an Internet searcher to present targeted advertisements that have been associated with specific keywords or search terms. Such advertisements are presented in pop-up windows, banner advertisement windows, or as “sponsored” links to websites that have requested and paid for prominent placements on the search results screen for specific keywords or search terms. An Internet user that searches “keywords” is more likely than a member of the general public to be a potential customer of a good or services associated with such keywords.
  • With the continuing advance of technology, bandwidth, and availability of broadband access, online video viewing is becoming increasingly popular and promises to become even more prevalent with the continuing expansion and use of IPTV and video on demand. Unlike static or substantially-static content (text, photographs) that is typically available on a webpage, that gets updated only periodically (more frequently for a news webpage and much less frequently for a standard company webpage), and that sustains a particular viewer for only a brief amount of time, commercial videos over the Internet provide an opportunity to capture a viewing audience for a substantially longer amount of time. However, audiences that are used to watching movies and television on DVDs or off of a DVR are unwilling to view conventional advertisements that interrupt the flow of the video stream.
  • For these and many other reasons, there is a need for a technology platform that is able to provide and display advertisements that are targeted to the specific audience and that are tied to specific programming being viewed. There is a need for methods and systems that enable such advertisements to be viewed selectively and simultaneously with the primary content in such a way that does not interfere with the primary content. There are yet further needs for methods and systems that provide real-time advertisements for the viewer regardless of whether the viewer is accessing the content from off of the Internet or from a DVD or similar electronic media storage if the display device has access to the Internet.
  • Therefore, it is apparent that a heretofore unaddressed need exists in the art to address the aforementioned deficiencies and inadequacies.
    • SUMMARY
  • The present invention, in one aspect, relates to a method for using metadata from a video signal to associate advertisements therewith. In one embodiment, the method includes (i) segmenting the video signal into a plurality of video clips, (ii) extracting audio and video features from a video signal, (iii) digitizing the plurality of video clips, (iv) identifying extracted audio features within respective digitized video clips using audio processing, wherein each audio feature is associated with the respective digitized video clip, (v) identifying extracted video features within respective digitized video clips using visual processing, wherein each video feature is associated with the respective digitized video clip, (vi) saving the associated audio features and associated video features in a metadata file, (vii) associating the metadata file with the video signal, (viii) storing the metadata file in a database, and (ix) providing the associated metadata file when a video player requests the corresponding video signal. The associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
  • The video features includes at least one of (i) one or more people, (ii) one or more characters, (iii) one or more animals, (iv) one or more objects, (v) one or more geographic locations, (vi) background, (vii) one or more scene, or a combination of these features. In one embodiment, these video features are extracted by a visual processing system of the feature extraction system. In another embodiment, the method includes the step of identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system. In yet another embodiment, the method includes the step of identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system. In yet another embodiment, the method includes a combination of both steps.
  • In one embodiment, the video signal may contain accompanying audio signal. Audio features of the audio signal includes at lest one of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and a combination of these audio features. In another embodiment, the method further includes the steps of: (i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system, (ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system, and (iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system. In yet another embodiment, the method further includes the steps of: (i) collecting audio features of the audio signal by using audio signal recognition system of the feature extraction system, and (ii) saving the collected audio features in the metadata file.
  • In one embodiment, the metadata file is an XML file. The metadata file contains one or more of (i) video identification information, (ii) a file name, (iii) a digital signature, (iv) the length of the video signal, (v) a keyword list, (vi) a time-coded transcript, (vii) one or more segments with a corresponding start and stop time, (viii) one or more contents, (ix) one or more characters, (x) one or more animals, (xi) one or more objects, and (xii) a list of vocabulary.
  • In another aspect, the present invention relates to a system for using metadata from a video signal to associate advertisements therewith. In one embodiment, the system has (i) a segmentation system for dividing the video signal into a plurality of video clips, (ii) a digitizing system for digitizing the plurality of video clips, (iii) a feature extraction system for extracting audio features and video features from each digitized video clip, associating each audio feature with at least one digitized video clip, associating each video feature with at least one digitized video clip, and saving the audio features and video features into a metadata file associated with the video signal, (iv) a web interface to the feature extraction system for receiving the digitized video clips, and (v) a database accessible by a third party user, wherein video signals and associated metadata files are stored and indexed with a unique filename for each video signal in the database and its corresponding video signal. The associated metadata file is provided when a video player requests the corresponding video signal, and enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
  • In one embodiment, the video features comprise at least one of (i) one or more people, (ii) one or more characters, (iii) one or more animals, (iv) one or more objects, (v) one or more geographic locations, (vi) background, (vii) one or more scenes, and (viii) any combination thereof. In another embodiment, the video signal includes an accompanying audio signal.
  • In another embodiment, the audio features of the audio signal comprise one or more of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and (vi) any combination thereof. In one feature, the feature extraction system further comprises an audio signal recognition (ASR) system to identify and recognize the audio features of the video signal, and a visual processing system to identify and recognize the visual features of the video signal. In another feature, the visual processing system further comprises a object classification system to identify and recognize one or more objects from the video signal, and a scene classification system to identify and recognize one or more scenes from the video signal. In yet a further feature, the audio signal recognition system further comprises a sound classification system to identify and recognize one or more background sounds from the audio signal, and a music classification system to identify and recognize one or more music segments from the audio signal, and a speech recognition system to identify and recognize human speech, dialogues, one or more words, one or more phrases. In another feature, the metadata file comprises one or more of video identification information, a file name, a digital signature, the length of the video signal, a keyword list, a time-coded transcript, one or more segments with a corresponding start and stop time, one or more contents, one or more characters, one or more pets, one or more objects, and a list of vocabulary.
  • These and other aspects of the present invention will become apparent from the following description of the preferred embodiment taken in conjunction with the following drawings, although variations and modifications therein may be affected without departing from the spirit and scope of the novel concepts of the disclosure.
    • BRIEF DESCRIPTION OF THE DRAWINGS
  • The accompanying drawings illustrate one or more embodiments of the invention and, together with the written description, serve to explain the principles of the invention. Wherever possible, the same reference numbers are used throughout the drawings to refer to the same or like elements of an embodiment, and wherein:
  • FIG. 1A illustrates a first embodiment of an advertisement placement system of the present invention;
  • FIG. 1B illustrates a second embodiment of an advertisement placement system of the present invention;
  • FIG. 1C illustrates a third embodiment of an advertisement placement system of the present invention;
  • FIG. 1D illustrates a fourth embodiment of an advertisement placement system of the present invention;
  • FIG. 1E illustrates a fifth embodiment of an advertisement placement system of the present invention;
  • FIG. 1F illustrates a sixth embodiment of an advertisement placement system of the present invention;
  • FIG. 2 illustrates one representative display screen for viewing a video program and advertisements associated herewith based on underlying time-coded metadata;
  • FIG. 3 illustrates a high level intake system for receiving video files and generating underlying time-coded metadata;
  • FIG. 4 illustrates a more detailed flow chart describing the extraction of metadata from a video signal.
  • FIGS. 5A and 5B illustrate one exemplary meta data file generated and used within the present invention.
    •  DETAILED DESCRIPTION
  • The present invention is more particularly described in the following examples that are intended as illustrative only since numerous modifications and variations therein will be apparent to those skilled in the art. Various embodiments of the invention are now described in detail. Referring to the drawings, like numbers indicate like components throughout the views. As used in the description herein and throughout the claims that follow, the meaning of “a”, “an”, and “the” includes plural reference unless the context clearly dictates otherwise. Also, as used in the description herein and throughout the claims that follow, the meaning of “in” includes “in” and “on” unless the context clearly dictates otherwise.
  • The terms used in this specification generally have their ordinary meanings in the art, within the context of the invention, and in the specific context where each term is used.
  • Certain terms that are used to describe the invention are discussed below, or elsewhere in the specification, to provide additional guidance to the practitioner in describing the apparatus and methods of the invention and how to make and use them. For convenience, certain terms may be highlighted, for example using italics and/or quotation marks. The use of highlighting has no influence on the scope and meaning of a term; the scope and meaning of a term is the same, in the same context, whether or not it is highlighted. It will be appreciated that the same thing can be said in more than one way. Consequently, alternative language and synonyms may be used for any one or more of the terms discussed herein, nor is any special significance to be placed upon whether or not a term is elaborated or discussed herein. Synonyms for certain terms are provided. A recital of one or more synonyms does not exclude the use of other synonyms. The use of examples anywhere in this specification, including examples of any terms discussed herein, is illustrative only, and in no way limits the scope and meaning of the invention or of any exemplified term. Likewise, the invention is not limited to various embodiments given in this specification. Furthermore, subtitles may be used to help a reader of the specification to read through the specification, which the usage of subtitles, however, has no influence on the scope of the invention.
  • As used herein, a video program refers to any multimedia content, such as a movie, a television program, an event, a video, an advertisement, a broadcast, or the like that a user would be interested in viewing online or in recorded format.
  • Turning now to FIG. 1A, a first preferred embodiment of an advertisement placement system 100A based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated. In this first embodiment, it is contemplated that the video program will be viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110 and that the underlying metadata file associated with the video program, once created, is maintained by the video provider 110. This system 100A includes one or more video storage databases 115 of the video provider 110 and a video server 113 that provides video programs in VOD or video streaming format over a computer network, such as the Internet for example, to a viewer 150 (or end user).
  • Before a specific video is provided to the viewer 150, a video file 120 associated with the video program 121 is preferably provided to a metadata generator 130. The video file 120 has or includes a unique file name or other video identifier (designated herein by the variable VID). As will be described in greater detail hereinafter, the metadata generator 130 receives the video file 120 and, using a metadata processor 133, creates or generates a time-coded metadata file 125 associated with the corresponding video file 120 and underlying video program 121. As shown in FIG. 1A, this metadata file 125 is stored in a database 135 of the metadata generator 130 but also provided back to the video provider 110 and associated with the corresponding video file 120 and underlying video program 121 in video storage databases 115.
  • When a request 140 for VOD or video streaming of the video program 121 associated with the video file 120 is received from a video display device 155 (such as a computer, Internet or interactive TV, or similar video playback or viewing device) of the viewer 150, the video provider 110 begins providing access to the video program 121 in conventional fashion (i.e., this assumes all communication and billing parameters are already or previously satisfied; such communication and billing parameters being beyond the scope of the present invention but within the scope and understanding of those skilled in the art). Simultaneously or substantially simultaneously with the start of the video streaming, the metadata file 125 associated with the video file 120 is provided to an advertisement distributor 160, which uses an advertisement server 163 to process the metadata file 125 to selectively identify one or more appropriate advertisements from its database 165 of potential advertisements that is appropriate to provide in conjunction with the video program 121 and, specifically, with each discrete segment of the video program 121 based on its time-coded metadata. The selected advertisement file(s) 175 are then provided to the video display device 155 of the viewer 150. The metadata file 125 may be provided in whole to the advertisement distributor 160 or it may be parsed and provided in piece meal or “as needed” fashion to the advertisement distributor 160.
  • Preferably, as shown in FIG. 2, the video display 200 of the video display device 155 is configured to receive and display various types of advertisements in conjunction with the actual video display. Such advertisements are preferably displayed in manners that do not interrupt or delay viewing of the requested video, as would a conventional commercial shown on broadcast television. For example, such advertisements may be shown as conventional banner ads that appear (i) in an optional vertical side window or panel 205 or (ii) in an optional horizontal window or panel 210 that do not interfere with the main video display area 225. The video display 200 may also include conventional header areas and menu control areas 215, 220. Obviously, the placement and purpose of each of the windows and panels of the video display 200 are within the purview of those skilled in the art. In addition, although the advertisements can be displayed as banner ads, it is also possible and expected that alternative advertisements, such as interstitial ads, bug ads, or hyperlinks that can be opened or accessed by the viewer 150, may be used alternatively or in conjunction with the banner advertisements. Such additional advertisements may be placed within the main video display area 225, such as in the lower portion 230 of the main video display area 225. In addition, it should also be understood that while “advertisements” are being used generally to define the information that may be displayed around and during the video playback, it is also possible and expected that other information associated with the video playback, such as background information, more detailed information about the video program, the actors in the video program, scenes, events or locations that appear in the video program, related videos or information, and the like, can be displayed, advertised, or linked during the playback and tied to the current time-code of the video as it is being viewed. Such advertisements can be text, still graphics, videos, audio, hyperlinks, or the like. In some embodiments, the advertisements merely display information. In other embodiments, the advertisements include a hyperlink that, when activated, pause the primary video and allow the user to view or access the advertisement or other additional information.
  • Although not shown in FIG. 1A, as the video program 121 is being viewed by the viewer 150, the actual time-code of the video program 121 is provided either from the video provider 110 or, preferably, from the video display device 155 itself. This time-code information associated with the actual viewing of the video program 121 either is provided in real time to the advertisement distributor 160 so that appropriate advertisement files 175 can be provided back to the video display device 155 in real time or, alternatively, is provided in advance to the video display device 155 for caching and later access at the appropriate time, based on the time-code location of the video program 121 as it is being viewed.
  • In an optional embodiment of that shown in FIG. 1A, user or video display device characteristics 185 are obtainable from the video display device 155 and may be provided to the advertisement distributor 160. Such user or video display device characteristics 185 typically include location, age, gender, interests, Internet websites visited, and other similar demographic data that may be obtained from cookies or similar tracking information. The advertisement distributor 160 utilizes the video display device characteristics 185 to generate advertisement files 175 that are further targeted and customized for the viewer 150. The advertisement files 175 are provided back to the video display device 155 for display during viewing of the video program 121. Such targeted advertisements are still shown and synchronized with the time-coded video program 121; however, the user data 185 enables the advertisement server 163 to select more accurately between one or more potentially valid advertisements that could be associated with the video program for a particular time-coded segment.
  • Turning now to FIG. 1B, a second preferred embodiment of an advertisement placement system 100B based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated. In this embodiment, it is contemplated that the video program is still viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110; however, unlike the first embodiment, in this scenario, the underlying metadata file 125 associated with the video program 121 is sent to the video display device 155 along with the video program 121. The video display device 155 (or at least the video player system/software installed on the video display device) then sends the metadata file 125 (or parsed segments thereof at appropriate time intervals) to the advertisement distributor 160 so that appropriate advertisement file(s) 175 are returned back to the player 155. Again, optionally, user data 185 may be provided from the video display device 155 to the advertisement distributor 160 to enable the advertisement server 163 to select more accurately between one or more potentially valid advertisements that could be associated with the video program for a particular time-coded segment.
  • Turning now to FIG. 1C, a third preferred embodiment of an advertisement placement system 100C based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated. In this embodiment, it is contemplated that the video program is also viewed in a Video-on-Demand (VOD) or video streaming context from a video provider 110; however, unlike the first and second embodiments, in this scenario, the underlying metadata file 125 associated with the video program 121, once created, is not provided back to the video provider 110. This embodiment is similar in most respects to the first embodiment; however, when a request for video 140 is received from the viewer 150, the video provider 110 sends a request 145 for metadata file 125 associated with the video program 121. This request 145 is either sent directly to the metadata generator 130 (as shown) or (as not shown) to the advertisement distributor 160 first, which then requests the same from the metadata generator 130. The metadata generator 130 then retrieves the appropriate time-coded metadata file 125 from its database 135 and provides it to the advertisement distributor 160. The remaining aspects, variations, and alternatives of this embodiment are similar to those discussed in association with the first embodiment.
  • Turning now to FIG. 1D, a fourth embodiment is illustrated, which is another variation of the embodiment shown in FIG. 1C. Again, the metadata file 125 is maintained by the metadata generator 130, but upon receipt of a request 145, this time from the video display device 155, the metadata file 125 is provided to the video display device 155 and provided, preferably in parsed or “as needed” basis to the advertisement distributor 160. In another slight alternative arrangement, in response to the request 145 (or series of requests containing the video ID and time code location) from the video display device 155, the metadata generator 130 may provide the “as needed” portion of the metadata file 125 to the advertisement distributor 160 corresponding to the video segment being viewed by the viewer 150.
  • Turning now to FIG. 1E, a fifth preferred embodiment of an advertisement placement system 100E based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated. In this embodiment, it is contemplated that the video program is actually provided or sold to the viewer 150 on a DVD 117 or similar storage medium, or is provided as a file download (not shown) (as opposed to a mere video streaming in which the file is not actually downloaded) for later playback. This embodiment is similar to the first embodiment to the extent that the underlying metadata file associated with the video program, once created, is maintained by the video provider 110. This system 100E includes one or more video storage databases 115 of the video provider 110 and a video manager 116 that communicates with the metadata generator 130, the advertisement distributor 160, and the video storage databases 115, and which manages the production of stored video programs 117 for distribution in DVD format or for download or the like.
  • Similar to the first embodiment, before a stored video program 117 is created and made available to an viewer 150, a video file 120 associated with the stored video program 117 is preferably provided to the metadata generator 130. The video file 120 has or includes a unique file name or other video identifier (designated herein by the variable VID). As will be described in greater detail hereinafter, the metadata generator 130 receives the video file 120 and, using a metadata processor 133, creates or generates a time-coded metadata file 125 associated with the corresponding video file 120 and underlying video program 121. This metadata file 125 is stored in a database 135 of the metadata generator 130 but is also provided back to the video provider 110 and associated with the corresponding video file 120 in video storage databases 115.
  • As part of the process for creating a stored video program 117, the metadata file 125 associated with the video file 120 is provided to the advertisement distributor 160, which uses an advertisement server 163 to process the metadata file 125 to selectively identify one or more appropriate advertisements from its database 165 of potential advertisements that is appropriate to provide in conjunction with the stored video program 117 and, specifically, with each discrete segment of the stored video program 117 based on its time-coded metadata. The selected advertisement file(s) 175 are then provided back to the video provider 110, which incorporates the advertisement files 175 directly on the stored video program 117 along with the actual video file 120. In this manner, the stored video program 117 has all necessary and desired advertisement files 175 built into the stored video program 117 and plays advertisements during viewing of the video in situations in which the video display device 155 does not (intentional, unintentional, non-compatible, or for whatever reason) have real time access to the Internet to obtain real-time advertisements associated with the video. The remaining aspects, variations, and alternatives of this embodiment are similar to those discussed in association with the first embodiment.
  • Turning now to FIG. 1F, a sixth preferred embodiment of an advertisement placement system 100F based primarily upon time-coded metadata associated with an underlying video program displayed therewith is illustrated. This embodiment is similar to the fifth embodiment; however, it is contemplated that the video display device 155 has access to the Internet and, thus, is able to obtain real-time advertisement files 175 from advertisement distributor 160. This arrangement is preferred to the fifth embodiment since advertisements associated with the video program are not fixed and unchangeable on the stored video program 117 media. Instead, over time and with each viewing of the stored video program 117, the viewer 150, potentially, has a new advertisement experience.
  • For this reason, it is desirable to have the time-coded metadata file 125 actually stored on the stored video program 117 along with the video file 121 so that when the video program is actually being viewed by the viewer 150 on the video display device 155, the video display device 155 initiates a communication with the advertisement distributor 160 to provide the time-coded metadata file 125 and to receive back appropriate advertisement file(s) 175. Again, in an alternative arrangement, it may be desirable for the viewer 150 to provide or for the advertisement distributor 160 to have user or video display device characteristics 185 (as described in greater detail previously) so that the advertisement files 175 associated with the time-coded metadata of the stored video program 117 are tailored and targeted slightly more at the viewer 150, but still associated with the appropriate segment of the video program.
  • In an additional, alternative embodiment (not shown), the embodiments shown in FIGS. 1E and 1F are combined to store a base set of advertisement files 175 on the stored video program 117. The advertisement files 175 are for situations in which the video display device 155 is “offline” and does not have access to the Internet. The video display device 155 (or the software associated with the stored video program 117) is configured to interact in real time with the advertisement distributor 160 to obtain current and up-to-date advertisement files 175 when it is actually able to access the Internet and communicate with the advertisement distributor 160. In such a scenario, the more up-to-date advertisement files 175 are shown during the video playback if they are available. If they are not available, the pre-stored, base advertisement files 175 are used.
  • It should also be understood that there are many other alternative arrangements and variations of how and where various files are stored and provided. The embodiments shown in FIGS. 1A through 1F represent just some of the more likely arrangements and components involved. Additionally, there may be multiple additional parties involved such that the roles and responsibilities for providing and receiving files, for processing files, and for exchanging and storing data can be handled by different parties or components. For example, there may be two separate parties or components used to generate time-coded metadata files and to store and provide such time-coded metadata files to third parties upon request. Likewise, the video provider may want to act as the throughput for the advertisement distributor so that the video display device never interacts directly with a specified advertisement distributor. This can be controlled more easily in the video streaming context, since the links to the advertisement distributor can be dynamically changed over time to point to the preferred or desired advertisement distributor associated with the video provider. For the stored video program embodiments, it may be desirable to have advertisement links that go back through the video provider—this would enable the video provider to update and change the advertisement distributor used over longer periods of time and prevent such links, hard-coded onto the stored video program from becoming obsolete or broken.
  • FIGS. 3 through 5B provide more detailed explanations are described for the creation of time-coded metadata files associated with underlying video programs. Turning first to FIG. 3, a high level view 300 of the intake process for creating a time-coded metadata file 125 is described. The metadata generator 130 receives the video file 120, which has or includes a unique file name or other video identifier (designated herein by the variable VID). The video file 120 and identifier are stored initially in a SOAP database 310. Preferably, the video file 120 is received in .mp4 (MPEG 4) format or, if not, is converted to such (or similar) format, as may be changed or updated from time to time. A hash of this file is run to generate a unique “video signature” and is checked against the existing video signatures stored in the database 135 to determine if a time-coded metadata file already exists for the video file 120 received. If so, the appropriate time-coded metadata file 125 is provided to any requesting party. If the file does not exist, the video file in .mp4 format is then provided to an audio processor 320 and to a video processor 330. Once the audio and video have been parsed and used to identify underlying metadata of the video program, the time-coded metadata file is stored in database 135 and is available for distribution or use, as described in association with the embodiments of FIGS. 1A through 1F.
  • FIG. 4 illustrates, in more detail, the steps 400 performed by the metadata processor 133 when a video file 120 is received for intake and processing. First, the video identifier is obtained from the video provider (step 410). As stated previously, this identifier may simply be the file name for the video file or it may be the title and year of the video file or something similar. Based on this identifier, it is possible to determine whether this particular video had been previously processed (step 412). If the video had already been processed previously, the database storing such time-coded metadata file is updated and cross-referenced with the identifier and existing video signature (step 430), then the process jumps to step 480 and determines whether another video needs to be processed or not. If the video had not been processed previously, at least based on its identifier, the system then downloads or receives the full video file from the video provider for further processing (step 415). As part of step 415, the video file is converted to .mp4 (MPEG 4) format, if it is not already in such format, and a hash or “video signature” of the .mp4 version of the video is created. Based on this video signature, it is possible to determine whether this particular video had been previously processed, even if the video identifier did not match a previously-known identifier (step 420). If the video had already been processed previously, the database storing such time-coded metadata files is updated and cross-referenced with the additional identifier and video signature, if necessary (step 430), then the process jumps to step 480 and determines whether another video needs to be processed or not. If the video had not been processed previously, it is then submitted to an audio processor (step 440) for audio capture and separation and speech recognition (among other things) and a video processor (step 450) for classification and analysis (among other things). The resulting metadata is compiled, tied to or associated with the underlying timecode of the video program, and stored in the metadata database (step 470). The process then determines whether there is another video to be processed (step 480). If so, the process 400 starts over. If not, the process 400 ends.
  • Generally, when a video program is received or converted to .mp4 format, an underlying time-code exists or is established for the video program. All audio and video metadata identified or extracted from the video program by the metadata processor 133 is then tied or associated with specific points or regions within the time code. Initially, key identifiers for the video program are determined and identified. This includes all characters who appear in the video program, key or reoccurring scene locations, key props and objects, key terms, etc. The key identifiers are typically audio features and/or video features, and are extracted from the video signal. Then, the video portion of the video program is parsed and divided into “short clips” or discrete segments. Such segments can be specified by a predetermined time frame, but can alternatively be identified based on information within the video signal, such as, for example, a change of camera shots, angles, scene change, scene break or the like. It should also be noted that different video segments can be defined by different predetermined time frames.
  • Once the video signal is divided, then each segmented video clip is then digitized. The breaks between each segment is identified and tied to the time-code timeline. Next, the metadata processor 133 runs a language and speech recognition process through the entire video and associates all of the dialogue and background audio with the appropriate video segments and time-codes. Next, characters within the video signal are associated with each of the dialogue entries. Finally, the metadata processor 133 runs a number of visual processing programs to identify characters, objects, scenes within each segment of the video program. Each identified audio feature is thus associated with at least one segmented video clip. Similarly, each identified video feature is also associated with at least one segmented video clip.
  • The associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip. Those of skill in the art will readily appreciate that presentment is typically implemented by a visual display device, but may also include email, file delivery, and other delivery methods.
  • The video features identified by the visual processor include at least one of (i) people, (ii) characters, (iii) animals, (iv) objects, (v) geographic locations, (vi) background, (vii) scenes, or a combination of any of these features. Preferably, these video features are extracted by a visual processing system of the feature extraction system. In one embodiment, the method includes the step of identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system. In another embodiment, the method includes the step of identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system. In yet another embodiment, the method includes a combination of both steps.
  • Audio features of the audio signal includes at least one of (i) a list of one or more words, (ii) speeches by one or more people, (iii) dialogue by one or more people, (iv) music, (v) background sound, and a combination of these audio features. The method further includes the steps of: (i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system, (ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system, and (iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system. The method further includes the steps of: (i) collecting audio features of the audio signal by using audio signal recognition system of the feature extraction system, and (ii) saving the collected audio features in the metadata file.
  • Preferably, the metadata file is in XML format. An exemplary portion of a time-coded metadata file, in XML format, is illustrated in FIGS. 5A and 5B. The metadata file contains one or more of (i) video identification information, (ii) a file name, (iii) a digital signature, (iv) the length of the video signal, (v) a keyword list, (vi) a time-coded transcript, (vii) one or more segments with a corresponding start and stop time, (viii) one or more contents, (ix) one or more characters, (x) one or more animals, (xi) one or more objects, and (xii) a list of vocabulary.
  • The foregoing description of the exemplary embodiments of the invention has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in light of the above teaching.
  • The embodiments were chosen and described in order to explain the principles of the invention and their practical application so as to enable others skilled in the art to utilize the invention and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those skilled in the art to which the present invention pertains without departing from its spirit and scope. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description and the exemplary embodiments described therein.

Claims (21)

1. A method for using metadata from a video signal to associate advertisements therewith, comprising the steps of:
(i) segmenting the video signal into a plurality of video clips;
(ii) extracting audio and video features from the plurality of video clips;
(iii) digitizing the plurality of video clips;
(iv) identifying extracted audio features within respective digitized video clips using audio processing, wherein each extracted audio feature is associated with the respective digitized video clip;
(v) identifying extracted video features within respective digitized video clips using visual processing, wherein each extracted video feature is associated with the respective digitized video clip;
(vi) saving the associated audio features and associated video features in a metadata file;
(vii) associating the metadata file with the video signal;
(viii) storing the metadata file in a database; and
(ix) providing the associated metadata file when a video player requests the corresponding video signal,
wherein, the associated metadata file enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
2. The method of claim 1, wherein the metadata file comprises an XML file.
3. The method of claim 1, wherein the steps of identifying extracted video features and extracted audio features further comprises uploading the digitized video clips to a feature extraction system through a web interface.
4. The method of claim 1, wherein each digitized video clip is specified by a predetermined time frame.
5. The method of claim 1, wherein the video features comprise at least one of:
(i) one or more people;
(ii) one or more characters;
(iii) one or more animals;
(iv) one or more objects;
(v) one or more geographic locations;
(vi) background; and
(vii) one or more scenes.
6. The method of claim 1, further comprising the steps of:
(i) identifying and recognizing one or more objects from the video signal by an object classification system of the feature extraction system; and
(ii) identifying and recognizing one or more scenes from the video signal by a scene classification system of the feature extraction system.
7. The method of claim 1, wherein the video signal comprises an accompanying audio signal.
8. The method of claim 7, wherein audio features of the audio signal comprise one or more of:
(i) a list of one or more words;
(ii) speeches by one or more people;
(iii) dialogue by one or more people;
(iv) music; and
(v) background sound.
9. The method of claim 8, further comprising the steps of:
(i) identifying and recognizing one or more background sounds from the audio signal by using a sound classification system of the feature extraction system;
(ii) identify and recognizing one or more music segments from the audio signal by using a music classification system of the feature extraction system; and
(iii) identifying and recognizing human speech, dialogues, one or more words, one or more phrases by using a speech recognition system of the feature extraction system.
10. The method of claim 9, further comprising the steps of:
(i) collecting audio features of the audio signal by using an audio signal recognition system of the feature extraction system; and
(ii) saving the collected audio features in the metadata file.
11. The method of claim 10, wherein the metadata file comprises one or more of:
(i) video identification information;
(ii) a file name;
(iii) a digital signature;
(iv) the length of the video signal;
(v) a keyword list;
(vi) a time-coded transcript;
(vii) one or more segments with a corresponding start and stop time;
(viii) one or more contents;
(ix) one or more characters;
(x) one or more pets;
(xi) one or more objects; and
(xii) a list of vocabulary.
12. A system for using metadata from a video signal to associate advertisements therewith, comprising:
(i) a segmentation system for dividing the video signal into a plurality of video clips;
(ii) a digitizing system for digitizing the plurality of video clips;
(iii) a feature extraction system for extracting audio features and video features from each digitized video clip, associating each audio feature with at least one digitized video clip, associating each video feature with at least one digitized video clip, and saving the audio features and video features into a metadata file associated with the video signal;
(iv) a web interface to the feature extraction system for receiving the digitized video clips; and
(v) a database accessible by a third party user, wherein video signals and associated metadata files are stored and indexed with a unique filename for each video signal in the database and its corresponding video signal,
wherein the associated metadata file is provided when a video player requests the corresponding video signal, and enables selection of a relevant advertisement for presentment in conjunction with each respective digitized video clip of the corresponding video signal based on the associated audio features and the associated video features of the respective digitized video clip.
13. The system of claim 12, wherein the associated metadata file comprises an XML file.
14. The system of claim 12, wherein each digitized video clip is specified by a predetermined time frame.
15. The system of claim 12, wherein the video features comprise at least one of
(i) one or more people;
(ii) one or more characters;
(iii) one or more animals;
(iv) one or more objects;
(v) one or more geographic locations;
(vi) background; and
(vii) one or more scenes.
16. The system of claim 12, wherein a visual processing system further comprises:
(i) an object classification system to identify and recognize one or more objects from the video signal; and
(ii) a scene classification system to identify and recognize one or more scenes from the video signal.
17. The system of claim 12, wherein the video signal comprises an accompanying audio signal.
18. The system of claim 17, wherein audio features of the audio signal comprise one or more of:
(i) a list of one or more words;
(ii) speeches by one or more people;
(iii) dialogue by one or more people;
(iv) music; and
(v) background sound.
19. The system of claim 18, wherein the feature extraction system further comprises:
(i) an audio signal recognition (ASR) system to identify and recognize the audio features of the video signal; and
(ii) a visual processing system to identify and recognize the video features of the video signal.
20. The system of claim 19, wherein the audio signal recognition system further comprises:
(i) a sound classification system to identify and recognize one or more background sounds from the audio signal; and
(ii) a music classification system to identify and recognize one or more music segments from the audio signal; and
(iii) a speech recognition system to identify and recognize human speech, dialogues, one or more words, one or more phrases.
21. The system of claim 20, wherein the metadata file comprises one or more of:
(i) video identification information;
(ii) a file name;
(iii) a digital signature;
(iv) the length of the video signal;
(v) a keyword list;
(vi) a time-coded transcript;
(vii) one or more segments with a corresponding start and stop time;
(viii) one or more contents;
(ix) one or more characters;
(x) one or more pets;
(xi) one or more objects, and
(xii) a list of vocabulary.
US12/206,622 2007-09-07 2008-09-08 Systems and Methods For Using Video Metadata to Associate Advertisements Therewith Abandoned US20090094113A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US12/206,622 US20090094113A1 (en) 2007-09-07 2008-09-08 Systems and Methods For Using Video Metadata to Associate Advertisements Therewith
US14/707,440 US20150245111A1 (en) 2007-09-07 2015-05-08 Systems and methods for using video metadata to associate advertisements therewith
US15/045,223 US11800169B2 (en) 2007-09-07 2016-02-16 Systems and methods for using video metadata to associate advertisements therewith
US18/367,794 US20240007696A1 (en) 2007-09-07 2023-09-13 Systems and methods for using video metadata to associate advertisements therewith

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US97059307P 2007-09-07 2007-09-07
US12/206,622 US20090094113A1 (en) 2007-09-07 2008-09-08 Systems and Methods For Using Video Metadata to Associate Advertisements Therewith

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US14/707,440 Continuation US20150245111A1 (en) 2007-09-07 2015-05-08 Systems and methods for using video metadata to associate advertisements therewith
US15/045,223 Continuation US11800169B2 (en) 2007-09-07 2016-02-16 Systems and methods for using video metadata to associate advertisements therewith

Publications (1)

Publication Number Publication Date
US20090094113A1 true US20090094113A1 (en) 2009-04-09

Family

ID=40524088

Family Applications (4)

Application Number Title Priority Date Filing Date
US12/206,622 Abandoned US20090094113A1 (en) 2007-09-07 2008-09-08 Systems and Methods For Using Video Metadata to Associate Advertisements Therewith
US14/707,440 Abandoned US20150245111A1 (en) 2007-09-07 2015-05-08 Systems and methods for using video metadata to associate advertisements therewith
US15/045,223 Active 2030-02-24 US11800169B2 (en) 2007-09-07 2016-02-16 Systems and methods for using video metadata to associate advertisements therewith
US18/367,794 Pending US20240007696A1 (en) 2007-09-07 2023-09-13 Systems and methods for using video metadata to associate advertisements therewith

Family Applications After (3)

Application Number Title Priority Date Filing Date
US14/707,440 Abandoned US20150245111A1 (en) 2007-09-07 2015-05-08 Systems and methods for using video metadata to associate advertisements therewith
US15/045,223 Active 2030-02-24 US11800169B2 (en) 2007-09-07 2016-02-16 Systems and methods for using video metadata to associate advertisements therewith
US18/367,794 Pending US20240007696A1 (en) 2007-09-07 2023-09-13 Systems and methods for using video metadata to associate advertisements therewith

Country Status (1)

Country Link
US (4) US20090094113A1 (en)

Cited By (95)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090276402A1 (en) * 2008-05-01 2009-11-05 Mobitv, Inc. Search system using media metadata tracks
US20100129057A1 (en) * 2008-11-26 2010-05-27 Sling Media Pvt Ltd Systems and methods for creating logical media streams for media storage and playback
US20100161441A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Method and apparatus for advertising at the sub-asset level
US20100215211A1 (en) * 2008-05-21 2010-08-26 Ji Zhang System for Facilitating the Archiving of Video Content
US20100215210A1 (en) * 2008-05-21 2010-08-26 Ji Zhang Method for Facilitating the Archiving of Video Content
US20100299702A1 (en) * 2009-05-19 2010-11-25 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
US20110064387A1 (en) * 2009-09-16 2011-03-17 Disney Enterprises, Inc. System and method for automated network search and companion display of results relating to audio-video metadata
US20110137855A1 (en) * 2009-12-08 2011-06-09 Xerox Corporation Music recognition method and system based on socialized music server
US20110202397A1 (en) * 2010-02-12 2011-08-18 Disney Enterprises, Inc. Systems and Methods to Deliver Event-Driven Content
WO2011127359A2 (en) * 2010-04-09 2011-10-13 Affine Systems, Inc. Systems and methods for matching an advertisement to a video
US20110264700A1 (en) * 2010-04-26 2011-10-27 Microsoft Corporation Enriching online videos by content detection, searching, and information aggregation
US20110289536A1 (en) * 2010-05-20 2011-11-24 Comcast Cable Communications, Llc Communication for One Way Devices
CN102347839A (en) * 2010-09-08 2012-02-08 微软公司 Content signaturing
US20120042335A1 (en) * 2010-08-16 2012-02-16 Samsung Electronics Co., Ltd. Method and apparatus for reproducing advertisement
US20120159555A1 (en) * 2010-12-20 2012-06-21 Microsoft Corporation Wireless Distribution System Proxy Caches
US20120159542A1 (en) * 2010-12-20 2012-06-21 Microsoft Corporation Current Device Location Advertisement Distribution
US20120204217A1 (en) * 2010-10-14 2012-08-09 Activevideo Networks, Inc. Streaming Digital Video between Video Devices Using a Cable Television System
US20130031573A1 (en) * 2010-04-27 2013-01-31 Zeidman Robert M Method for advertisers to sponsor broadcasts without commercials
US20130094834A1 (en) * 2011-10-12 2013-04-18 Vixs Systems, Inc. Video processing device for embedding authored metadata and methods for use therewith
US20130097145A1 (en) * 1998-11-30 2013-04-18 Gemstar Development Corporation Search engine for video and graphics
WO2013079768A1 (en) 2011-11-30 2013-06-06 Nokia Corporation Method and apparatus for enriching media with meta-information
US8527520B2 (en) 2000-07-06 2013-09-03 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevant intervals
US8533223B2 (en) 2009-05-12 2013-09-10 Comcast Interactive Media, LLC. Disambiguation and tagging of entities
US20130291002A1 (en) * 2012-04-25 2013-10-31 Cox Communications, Inc. Systems and Methods for Delivery of Media Content
US20130290846A1 (en) * 2012-04-27 2013-10-31 Mobitv, Inc. Search-based navigation of media content
US20130287364A1 (en) * 2010-08-02 2013-10-31 Sony Corporation Data generating device and data generating method, and data processing device and data processing method
US8713016B2 (en) 2008-12-24 2014-04-29 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
EP2765786A1 (en) * 2013-02-06 2014-08-13 Nagravision S.A. Method to enhance a video content in a receiving device
US8955021B1 (en) * 2012-08-31 2015-02-10 Amazon Technologies, Inc. Providing extrinsic data for video content
WO2015050651A1 (en) * 2013-10-01 2015-04-09 Penthera Partners, Inc. Downloading media objects
US9042454B2 (en) 2007-01-12 2015-05-26 Activevideo Networks, Inc. Interactive encoded content system including object models for viewing on a remote device
US9077860B2 (en) 2005-07-26 2015-07-07 Activevideo Networks, Inc. System and method for providing video content associated with a source image to a television in a communication network
US9098758B2 (en) * 2009-10-05 2015-08-04 Adobe Systems Incorporated Framework for combining content intelligence modules
US9113128B1 (en) 2012-08-31 2015-08-18 Amazon Technologies, Inc. Timeline interface for video content
US9125169B2 (en) 2011-12-23 2015-09-01 Rovi Guides, Inc. Methods and systems for performing actions based on location-based rules
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US9204203B2 (en) 2011-04-07 2015-12-01 Activevideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9252916B2 (en) 2012-02-13 2016-02-02 Affirmed Networks, Inc. Mobile video delivery
US9277255B1 (en) * 2013-03-15 2016-03-01 Google Inc. Metering of internet protocol video streams
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9294799B2 (en) 2000-10-11 2016-03-22 Rovi Guides, Inc. Systems and methods for providing storage of data on servers in an on-demand media delivery system
US9326047B2 (en) 2013-06-06 2016-04-26 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US9348915B2 (en) 2009-03-12 2016-05-24 Comcast Interactive Media, Llc Ranking search results
US9357267B2 (en) 2011-09-07 2016-05-31 IMDb.com Synchronizing video content with extrinsic data
US9363560B2 (en) 2003-03-14 2016-06-07 Tvworks, Llc System and method for construction, delivery and display of iTV applications that blend programming information of on-demand and broadcast service offerings
US9374411B1 (en) 2013-03-21 2016-06-21 Amazon Technologies, Inc. Content recommendations using deep data
US20160189712A1 (en) * 2014-10-16 2016-06-30 Veritone, Inc. Engine, system and method of providing audio transcriptions for use in content resources
US9389745B1 (en) 2012-12-10 2016-07-12 Amazon Technologies, Inc. Providing content via multiple display devices
WO2016112042A1 (en) * 2015-01-08 2016-07-14 The Directv Group, Inc. Systems and methods for triggering user interfaces for product and/or service transactions via user receiving devices and mobile devices
EP3062278A1 (en) * 2015-02-26 2016-08-31 Aircom Pacific Inc Product ordering system and product ordering method thereof
US9442933B2 (en) 2008-12-24 2016-09-13 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US9516253B2 (en) 2002-09-19 2016-12-06 Tvworks, Llc Prioritized placement of content elements for iTV applications
US20170046339A1 (en) * 2015-08-14 2017-02-16 Airwatch Llc Multimedia searching
US9633379B1 (en) * 2009-06-01 2017-04-25 Sony Interactive Entertainment America Llc Qualified video delivery advertisement
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
US9800951B1 (en) 2012-06-21 2017-10-24 Amazon Technologies, Inc. Unobtrusively enhancing video content with extrinsic data
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US9826197B2 (en) 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
US9838740B1 (en) 2014-03-18 2017-12-05 Amazon Technologies, Inc. Enhancing video content with personalized extrinsic data
US9892730B2 (en) 2009-07-01 2018-02-13 Comcast Interactive Media, Llc Generating topic-specific language models
US9965900B2 (en) * 2016-09-01 2018-05-08 Avid Technology, Inc. Personalized video-based augmented reality
US9992546B2 (en) 2003-09-16 2018-06-05 Comcast Cable Communications Management, Llc Contextual navigational control for digital television
WO2018128648A1 (en) * 2017-01-05 2018-07-12 Rovi Guides, Inc. Systems and methods for personalized timing for advertisements
US10095367B1 (en) * 2010-10-15 2018-10-09 Tivo Solutions Inc. Time-based metadata management system for digital media
US10110973B2 (en) 2005-05-03 2018-10-23 Comcast Cable Communications Management, Llc Validation of content
US10194189B1 (en) 2013-09-23 2019-01-29 Amazon Technologies, Inc. Playback of content using multiple devices
US10200804B2 (en) 2015-02-25 2019-02-05 Dolby Laboratories Licensing Corporation Video content assisted audio object extraction
US20190082232A1 (en) * 2017-09-10 2019-03-14 Comigo Ltd. Devices, systems and methods for selecting enrichment data of video content items based on commercial content of the video content items
US10271109B1 (en) 2015-09-16 2019-04-23 Amazon Technologies, LLC Verbal queries relative to video content
US10275128B2 (en) 2013-03-15 2019-04-30 Activevideo Networks, Inc. Multiple-mode system and method for providing user selectable video content
US10356478B2 (en) 2015-01-08 2019-07-16 The Directv Group, Inc. Systems and methods for spotted advertising and control of corresponding user interfaces and transactions via user receiving devices and mobile devices
US10409445B2 (en) 2012-01-09 2019-09-10 Activevideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US10424009B1 (en) 2013-02-27 2019-09-24 Amazon Technologies, Inc. Shopping experience using multiple computing devices
US10552074B2 (en) 2016-09-23 2020-02-04 Samsung Electronics Co., Ltd. Summarized data storage management system for streaming data
US10575067B2 (en) 2017-01-04 2020-02-25 Samsung Electronics Co., Ltd. Context based augmented advertisement
US10587930B2 (en) 2001-09-19 2020-03-10 Comcast Cable Communications Management, Llc Interactive user interface for television applications
US10616546B2 (en) 2013-09-03 2020-04-07 Penthera Partners, Inc. Commercials on mobile devices
US10687114B2 (en) 2003-03-14 2020-06-16 Comcast Cable Communications Management, Llc Validating data of an interactive content application
US10721532B2 (en) * 2011-04-06 2020-07-21 Hamed Tadayon Systems and methods for synchronizing media and targeted content
US10726443B2 (en) 2016-07-11 2020-07-28 Samsung Electronics Co., Ltd. Deep product placement
US10733626B2 (en) 2016-09-30 2020-08-04 Disney Enterprises, Inc. System and method for real-time generation of segments for a computerized decision system
WO2020168606A1 (en) * 2019-02-22 2020-08-27 深圳前海微众银行股份有限公司 Advertisement video optimising method, apparatus and device and computer readable storage medium
US10839416B1 (en) 2015-01-08 2020-11-17 The Directv Group, Inc. Systems and methods for controlling advertising, upselling, cross-selling, and purchasing of products and services via user receiving devices and mobile devices
US10880609B2 (en) 2013-03-14 2020-12-29 Comcast Cable Communications, Llc Content event messaging
US10917700B2 (en) 2018-02-02 2021-02-09 Microsoft Technology Licensing, Llc Estimating bandwidth savings for adaptive bit rate streaming
US11019300B1 (en) 2013-06-26 2021-05-25 Amazon Technologies, Inc. Providing soundtrack information during playback of video content
US11381875B2 (en) 2003-03-14 2022-07-05 Comcast Cable Communications Management, Llc Causing display of user-selectable content types
US11412306B2 (en) 2002-03-15 2022-08-09 Comcast Cable Communications Management, Llc System and method for construction, delivery and display of iTV content
US11430015B2 (en) 2015-09-30 2022-08-30 Disney Enterprises, Inc. Methods and systems for personalized gamification of media content
US11531668B2 (en) 2008-12-29 2022-12-20 Comcast Interactive Media, Llc Merging of multiple data sets
US11682045B2 (en) 2017-06-28 2023-06-20 Samsung Electronics Co., Ltd. Augmented reality advertisements on objects
US11783382B2 (en) 2014-10-22 2023-10-10 Comcast Cable Communications, Llc Systems and methods for curating content metadata
US11832024B2 (en) 2008-11-20 2023-11-28 Comcast Cable Communications, Llc Method and apparatus for delivering video and video-related content at sub-asset level
US20240031625A1 (en) * 2015-01-30 2024-01-25 Inscape Data, Inc. Methods for identifying video segments and displaying option to view from an alternative source and/or on an alternative device

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9100702B2 (en) 2006-09-11 2015-08-04 Tivo Inc. Personal content distribution network
US20090094113A1 (en) 2007-09-07 2009-04-09 Digitalsmiths Corporation Systems and Methods For Using Video Metadata to Associate Advertisements Therewith
US8359612B2 (en) 2008-08-13 2013-01-22 Tivo Inc. Content distribution system using transportable memory devices
US9098579B2 (en) * 2011-06-07 2015-08-04 Kodak Alaris Inc. Automatically selecting thematically representative music
US9762967B2 (en) 2011-06-14 2017-09-12 Comcast Cable Communications, Llc System and method for presenting content with time based metadata
US9942396B2 (en) * 2013-11-01 2018-04-10 Adobe Systems Incorporated Document distribution and interaction
US9544149B2 (en) 2013-12-16 2017-01-10 Adobe Systems Incorporated Automatic E-signatures in response to conditions and/or events
US9935777B2 (en) 2015-08-31 2018-04-03 Adobe Systems Incorporated Electronic signature framework with enhanced security
US10347215B2 (en) 2016-05-27 2019-07-09 Adobe Inc. Multi-device electronic signature framework
US11328159B2 (en) 2016-11-28 2022-05-10 Microsoft Technology Licensing, Llc Automatically detecting contents expressing emotions from a video and enriching an image index
US10503919B2 (en) 2017-04-10 2019-12-10 Adobe Inc. Electronic signature framework with keystroke biometric authentication
US10754904B2 (en) 2018-01-15 2020-08-25 Microsoft Technology Licensing, Llc Accuracy determination for media
US11490133B1 (en) * 2019-12-09 2022-11-01 Amazon Technologies, Inc. Insertion of directed content into a video asset

Citations (88)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5267351A (en) * 1989-12-22 1993-11-30 Avid Technology, Inc. Media storage and retrieval system
US5537528A (en) * 1992-05-28 1996-07-16 International Business Machines Corporation System and method for inputting scene information
US5630121A (en) * 1993-02-02 1997-05-13 International Business Machines Corporation Archiving and retrieving multimedia objects using structured indexes
US5650941A (en) * 1994-09-07 1997-07-22 Intel Corporation Computer architecture for creating and manipulating displayable objects
US5655117A (en) * 1994-11-18 1997-08-05 Oracle Corporation Method and apparatus for indexing multimedia information streams
US5797001A (en) * 1994-11-29 1998-08-18 Hitachi America, Ltd. Broadcast interactive multimedia system
US5832495A (en) * 1996-07-08 1998-11-03 Survivors Of The Shoah Visual History Foundation Method and apparatus for cataloguing multimedia data
US5903892A (en) * 1996-05-24 1999-05-11 Magnifi, Inc. Indexing of media content on a network
US5956729A (en) * 1996-09-06 1999-09-21 Motorola, Inc. Multimedia file, supporting multiple instances of media types, and method for forming same
US5973685A (en) * 1997-07-07 1999-10-26 International Business Machines Corporation Scheme for the distribution of multimedia follow-up information
US6032156A (en) * 1997-04-01 2000-02-29 Marcus; Dwight System for automated generation of media
US6134380A (en) * 1997-08-15 2000-10-17 Sony Corporation Editing apparatus with display of prescribed information on registered material
US6141447A (en) * 1996-11-21 2000-10-31 C-Cube Microsystems, Inc. Compressed video transcoder
US6154601A (en) * 1996-04-12 2000-11-28 Hitachi Denshi Kabushiki Kaisha Method for editing image information with aid of computer and editing system
US6172675B1 (en) * 1996-12-05 2001-01-09 Interval Research Corporation Indirect manipulation of data using temporally related data, with particular application to manipulation of audio or audiovisual data
US6181746B1 (en) * 1996-01-26 2001-01-30 Rohm Co., Ltd Image data decoding method and apparatus using memory for storing decoded data
US6192183B1 (en) * 1996-05-30 2001-02-20 Nippon Telegraph And Telephone Corporation Video editing scheme using icons directly obtained from coded video data
US6195458B1 (en) * 1997-07-29 2001-02-27 Eastman Kodak Company Method for content-based temporal segmentation of video
US6249280B1 (en) * 1992-04-10 2001-06-19 Avid Technology, Inc. Media composition system with enhanced user interface features
US6285361B1 (en) * 1996-11-15 2001-09-04 Futuretel, Inc. Method and apparatus for clipping video segments from an audiovisual file
US6292620B1 (en) * 1997-12-17 2001-09-18 Sony Corporation Edited-list creating apparatus, editing apparatus and editing method
US6327420B1 (en) * 1997-10-29 2001-12-04 Sony Corporation Image displaying method and editing apparatus to efficiently edit recorded materials on a medium
US20010049820A1 (en) * 1999-12-21 2001-12-06 Barton James M. Method for enhancing digital video recorder television advertising viewership
US6330004B1 (en) * 1997-11-28 2001-12-11 Matsushita Electric Industrial Co., Ltd. Multimedia program editing and presenting system with flexible layout capability by simplified input operations
US20020089646A1 (en) * 2001-01-10 2002-07-11 Spring House Entertainment Inc. Web movie system
US20020108112A1 (en) * 2001-02-02 2002-08-08 Ensequence, Inc. System and method for thematically analyzing and annotating an audio-visual sequence
US20020110370A1 (en) * 2001-01-24 2002-08-15 Yasuo Nomura Recording and playback apparatus and method, program storage medium, and program
US20020120925A1 (en) * 2000-03-28 2002-08-29 Logan James D. Audio and video program recording, editing and playback systems using metadata
US20020123928A1 (en) * 2001-01-11 2002-09-05 Eldering Charles A. Targeting ads to subscribers based on privacy-protected subscriber profiles
US20020129360A1 (en) * 2000-12-29 2002-09-12 Lg Electronics Inc. Apparatus and method for calculating audience rating using interactive television
US20020138831A1 (en) * 2000-01-14 2002-09-26 Reuven Wachtfogel Advertisements in an end-user controlled playback environment
US20020144264A1 (en) * 2001-03-27 2002-10-03 Broadus Charles R. Passive program completion status indicator for an electronic program guide
US20020147985A1 (en) * 2001-04-05 2002-10-10 Koji Miyajima Video distribution system and video distribution method
US20030066084A1 (en) * 2001-09-28 2003-04-03 Koninklijke Philips Electronics N. V. Apparatus and method for transcoding data received by a recording device
US20030088872A1 (en) * 1997-07-03 2003-05-08 Nds Limited Advanced television system
US20030145323A1 (en) * 1992-12-09 2003-07-31 Hendricks John S. Targeted advertisement using television viewer information
US20030149975A1 (en) * 2002-02-05 2003-08-07 Charles Eldering Targeted advertising in on demand programming
US20030149988A1 (en) * 1998-07-14 2003-08-07 United Video Properties, Inc. Client server based interactive television program guide system with remote server recording
US20040003397A1 (en) * 2002-06-27 2004-01-01 International Business Machines Corporation System and method for customized video commercial distribution
US20040015608A1 (en) * 2000-11-29 2004-01-22 Applied Microsystems Corporation Method and system for dynamically incorporating advertising content into multimedia environments
US20040019524A1 (en) * 2002-07-29 2004-01-29 Marshall Aaron Timothy Showcasing of products featured in entertainment productions
US20040148454A1 (en) * 2002-03-19 2004-07-29 Minoru Seo Information processing apparatus and method
US20040179825A1 (en) * 2003-03-11 2004-09-16 Im Jin Seok Digital video record/playback apparatus and playback method thereof
US20040190867A1 (en) * 2002-12-20 2004-09-30 Stmicroelectronics Sa Process and device for decoding MPEG pictures and for displaying them in rewind mode, video driver circuit and decoder box incorporating such a device
US20040268413A1 (en) * 2003-05-29 2004-12-30 Reid Duane M. System for presentation of multimedia content
US20040268387A1 (en) * 2001-06-11 2004-12-30 Bertrand Wendling Field of programme delivery
US20050010950A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for automatically generating a composite video-on-demand content
US20050076359A1 (en) * 1999-12-21 2005-04-07 Andrew Pierson Modifying commercials for multi-speed playback
US20050074063A1 (en) * 2003-09-15 2005-04-07 Nair Ajith N. Resource-adaptive management of video storage
US20050086703A1 (en) * 1999-07-08 2005-04-21 Microsoft Corporation Skimming continuous multimedia content
US6895407B2 (en) * 2000-08-28 2005-05-17 Emotion, Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20050210110A1 (en) * 2004-03-19 2005-09-22 Lijun Li Portable information terminal and computer software
US20050210101A1 (en) * 1999-03-04 2005-09-22 Universal Electronics Inc. System and method for providing content, management, and interactivity for client devices
US20050216932A1 (en) * 2004-03-24 2005-09-29 Daniel Danker Targeted advertising in conjunction with on-demand media content
US20050246451A1 (en) * 2004-05-03 2005-11-03 Microsoft Corporation Background transcoding
US20050278747A1 (en) * 1998-07-30 2005-12-15 Tivo Inc. Closed caption tagging system
US6981045B1 (en) * 1999-10-01 2005-12-27 Vidiator Enterprises Inc. System for redirecting requests for data to servers having sufficient processing power to transcast streams of data in a desired format
US20050289588A1 (en) * 2004-06-25 2005-12-29 Kinnear D S System and method for targeting video advertisements
US20050289636A1 (en) * 2004-06-25 2005-12-29 Jay Schiller System and method for delivering video programs to a video distribution center
US20060029364A1 (en) * 2004-08-03 2006-02-09 Takuya Kosugi Digital video stream trick play
US20060041902A1 (en) * 2004-08-23 2006-02-23 Microsoft Corporation Determining program boundaries through viewing behavior
US20060088279A1 (en) * 2004-10-26 2006-04-27 Sony Corporation Reproduction apparatus, data processing system, reproduction method, program, and storage medium
US20060095472A1 (en) * 2004-06-07 2006-05-04 Jason Krikorian Fast-start streaming and buffering of streaming content for personal media player
US20060100928A1 (en) * 2004-11-09 2006-05-11 Walczak Robert Jr System and method for providing content to a mobile communication device
US20060161947A1 (en) * 2001-09-05 2006-07-20 Indra Laksono Method and apparatus for customizing messaging within a cable system
US20060184579A1 (en) * 2005-01-05 2006-08-17 Michael Mills Framework for providing ancillary content in a television environment
US20060223593A1 (en) * 2005-04-01 2006-10-05 Ixi Mobile (R&D) Ltd. Content delivery system and method for a mobile communication device
US20070100690A1 (en) * 2005-11-02 2007-05-03 Daniel Hopkins System and method for providing targeted advertisements in user requested multimedia content
US20070118425A1 (en) * 2005-10-25 2007-05-24 Podbridge, Inc. User device agent for asynchronous advertising in time and space shifted media network
US20070157249A1 (en) * 2005-12-29 2007-07-05 United Video Properties, Inc. Systems and methods for episode tracking in an interactive media environment
US20070220024A1 (en) * 2004-09-23 2007-09-20 Daniel Putterman Methods and apparatus for integrating disparate media formats in a networked media system
US20070300261A1 (en) * 2006-06-23 2007-12-27 Barton James M Method and apparatus for advertisement placement in a user dialog on a set-top box
US20080002892A1 (en) * 2006-06-06 2008-01-03 Thomas Jelonek Method and system for image and video analysis, enhancement and display for communication
US20080004954A1 (en) * 2006-06-30 2008-01-03 Microsoft Corporation Methods and architecture for performing client-side directed marketing with caching and local analytics for enhanced privacy and minimal disruption
US20080013622A1 (en) * 2006-07-13 2008-01-17 Yiliang Bao Video coding with fine granularity scalability using cycle-aligned fragments
US20080015932A1 (en) * 2006-07-13 2008-01-17 Anthony Haeuser Methods and apparatus to distribute media content
US20080060002A1 (en) * 2006-08-31 2008-03-06 Sbc Knowledge Ventures L.P. System and method for delivering targeted advertising data in an internet protocol television system
US20080062018A1 (en) * 2006-09-11 2008-03-13 Apple Computer, Inc. Complexity-aware encoding
US20080092182A1 (en) * 2006-08-09 2008-04-17 Conant Carson V Methods and Apparatus for Sending Content to a Media Player
US20080109298A1 (en) * 2006-10-31 2008-05-08 Tivo Inc. Method for enhancing television advertising viewership
US20080120646A1 (en) * 2006-11-20 2008-05-22 Stern Benjamin J Automatically associating relevant advertising with video content
US20080127249A1 (en) * 2006-09-14 2008-05-29 Cruice David A System and method for encouraging advertisement viewing
US20080313669A1 (en) * 2007-06-18 2008-12-18 Swarup Acharya Targeted Advertisement Insertion with Interface Device Assisted Switching
US20090135901A1 (en) * 2007-11-28 2009-05-28 The Hong Kong University Of Science And Technology Complexity adaptive video encoding using multiple reference frames
US20100042499A1 (en) * 2008-08-13 2010-02-18 Barton James M Advertisement content management and distribution system
US20100042749A1 (en) * 2008-08-13 2010-02-18 Barton James M Content distribution system using transportable memory devices
US7734116B2 (en) * 2006-11-17 2010-06-08 Microsoft Corporation Swarm imaging
US20130227621A1 (en) * 2006-10-31 2013-08-29 Tivo Inc. Method and apparatus for downloading ancillary program data to a dvr

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8171509B1 (en) * 2000-04-07 2012-05-01 Virage, Inc. System and method for applying a database to video multimedia
US7177520B2 (en) * 2000-09-15 2007-02-13 Ibm Corporation System and method of timecode repair and synchronization in MPEG streams
US8156116B2 (en) * 2006-07-31 2012-04-10 Ricoh Co., Ltd Dynamic presentation of targeted information in a mixed media reality recognition system
US8692885B2 (en) * 2005-02-18 2014-04-08 Sri International Method and apparatus for capture and distribution of broadband data
US9286388B2 (en) * 2005-08-04 2016-03-15 Time Warner Cable Enterprises Llc Method and apparatus for context-specific content delivery
US20070078713A1 (en) * 2005-09-30 2007-04-05 Yahoo! Inc. System for associating an advertisement marker with a media file
US20070083537A1 (en) * 2005-10-10 2007-04-12 Yahool, Inc. Method of creating a media item portion database
US20070106685A1 (en) * 2005-11-09 2007-05-10 Podzinger Corp. Method and apparatus for updating speech recognition databases and reindexing audio and video content using the same
US9697230B2 (en) * 2005-11-09 2017-07-04 Cxense Asa Methods and apparatus for dynamic presentation of advertising, factual, and informational content using enhanced metadata in search-driven media applications
US9386327B2 (en) * 2006-05-24 2016-07-05 Time Warner Cable Enterprises Llc Secondary content insertion apparatus and methods
US7640272B2 (en) * 2006-12-07 2009-12-29 Microsoft Corporation Using automated content analysis for audio/video content consumption
US20080172293A1 (en) * 2006-12-28 2008-07-17 Yahoo! Inc. Optimization framework for association of advertisements with sequential media
KR101213235B1 (en) * 2007-07-24 2012-12-17 삼성전자주식회사 Method and apparatus for reproducing and publishing content capable of selecting advertisement inserted in content by content user or content publisher
US20090138906A1 (en) * 2007-08-24 2009-05-28 Eide Kurt S Enhanced interactive video system and method
US20090094113A1 (en) 2007-09-07 2009-04-09 Digitalsmiths Corporation Systems and Methods For Using Video Metadata to Associate Advertisements Therewith

Patent Citations (91)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5267351A (en) * 1989-12-22 1993-11-30 Avid Technology, Inc. Media storage and retrieval system
US6249280B1 (en) * 1992-04-10 2001-06-19 Avid Technology, Inc. Media composition system with enhanced user interface features
US5537528A (en) * 1992-05-28 1996-07-16 International Business Machines Corporation System and method for inputting scene information
US20030145323A1 (en) * 1992-12-09 2003-07-31 Hendricks John S. Targeted advertisement using television viewer information
US5630121A (en) * 1993-02-02 1997-05-13 International Business Machines Corporation Archiving and retrieving multimedia objects using structured indexes
US5650941A (en) * 1994-09-07 1997-07-22 Intel Corporation Computer architecture for creating and manipulating displayable objects
US5655117A (en) * 1994-11-18 1997-08-05 Oracle Corporation Method and apparatus for indexing multimedia information streams
US5797001A (en) * 1994-11-29 1998-08-18 Hitachi America, Ltd. Broadcast interactive multimedia system
US6181746B1 (en) * 1996-01-26 2001-01-30 Rohm Co., Ltd Image data decoding method and apparatus using memory for storing decoded data
US6154601A (en) * 1996-04-12 2000-11-28 Hitachi Denshi Kabushiki Kaisha Method for editing image information with aid of computer and editing system
US5903892A (en) * 1996-05-24 1999-05-11 Magnifi, Inc. Indexing of media content on a network
US6192183B1 (en) * 1996-05-30 2001-02-20 Nippon Telegraph And Telephone Corporation Video editing scheme using icons directly obtained from coded video data
US5832495A (en) * 1996-07-08 1998-11-03 Survivors Of The Shoah Visual History Foundation Method and apparatus for cataloguing multimedia data
US5956729A (en) * 1996-09-06 1999-09-21 Motorola, Inc. Multimedia file, supporting multiple instances of media types, and method for forming same
US6285361B1 (en) * 1996-11-15 2001-09-04 Futuretel, Inc. Method and apparatus for clipping video segments from an audiovisual file
US6141447A (en) * 1996-11-21 2000-10-31 C-Cube Microsystems, Inc. Compressed video transcoder
US6172675B1 (en) * 1996-12-05 2001-01-09 Interval Research Corporation Indirect manipulation of data using temporally related data, with particular application to manipulation of audio or audiovisual data
US6032156A (en) * 1997-04-01 2000-02-29 Marcus; Dwight System for automated generation of media
US20030088872A1 (en) * 1997-07-03 2003-05-08 Nds Limited Advanced television system
US5973685A (en) * 1997-07-07 1999-10-26 International Business Machines Corporation Scheme for the distribution of multimedia follow-up information
US6195458B1 (en) * 1997-07-29 2001-02-27 Eastman Kodak Company Method for content-based temporal segmentation of video
US6134380A (en) * 1997-08-15 2000-10-17 Sony Corporation Editing apparatus with display of prescribed information on registered material
US6327420B1 (en) * 1997-10-29 2001-12-04 Sony Corporation Image displaying method and editing apparatus to efficiently edit recorded materials on a medium
US6330004B1 (en) * 1997-11-28 2001-12-11 Matsushita Electric Industrial Co., Ltd. Multimedia program editing and presenting system with flexible layout capability by simplified input operations
US6292620B1 (en) * 1997-12-17 2001-09-18 Sony Corporation Edited-list creating apparatus, editing apparatus and editing method
US20030149988A1 (en) * 1998-07-14 2003-08-07 United Video Properties, Inc. Client server based interactive television program guide system with remote server recording
US20050278747A1 (en) * 1998-07-30 2005-12-15 Tivo Inc. Closed caption tagging system
US20050210101A1 (en) * 1999-03-04 2005-09-22 Universal Electronics Inc. System and method for providing content, management, and interactivity for client devices
US20050086703A1 (en) * 1999-07-08 2005-04-21 Microsoft Corporation Skimming continuous multimedia content
US6981045B1 (en) * 1999-10-01 2005-12-27 Vidiator Enterprises Inc. System for redirecting requests for data to servers having sufficient processing power to transcast streams of data in a desired format
US20050076359A1 (en) * 1999-12-21 2005-04-07 Andrew Pierson Modifying commercials for multi-speed playback
US20010049820A1 (en) * 1999-12-21 2001-12-06 Barton James M. Method for enhancing digital video recorder television advertising viewership
US20050273828A1 (en) * 1999-12-21 2005-12-08 Tivo Inc. Method for enhancing digital video recorder television advertising viewership
US20020138831A1 (en) * 2000-01-14 2002-09-26 Reuven Wachtfogel Advertisements in an end-user controlled playback environment
US20020120925A1 (en) * 2000-03-28 2002-08-29 Logan James D. Audio and video program recording, editing and playback systems using metadata
US6895407B2 (en) * 2000-08-28 2005-05-17 Emotion, Inc. Method and apparatus for digital media management, retrieval, and collaboration
US20040015608A1 (en) * 2000-11-29 2004-01-22 Applied Microsystems Corporation Method and system for dynamically incorporating advertising content into multimedia environments
US20020129360A1 (en) * 2000-12-29 2002-09-12 Lg Electronics Inc. Apparatus and method for calculating audience rating using interactive television
US20020089646A1 (en) * 2001-01-10 2002-07-11 Spring House Entertainment Inc. Web movie system
US20020123928A1 (en) * 2001-01-11 2002-09-05 Eldering Charles A. Targeting ads to subscribers based on privacy-protected subscriber profiles
US20020110370A1 (en) * 2001-01-24 2002-08-15 Yasuo Nomura Recording and playback apparatus and method, program storage medium, and program
US20020108112A1 (en) * 2001-02-02 2002-08-08 Ensequence, Inc. System and method for thematically analyzing and annotating an audio-visual sequence
US20020144264A1 (en) * 2001-03-27 2002-10-03 Broadus Charles R. Passive program completion status indicator for an electronic program guide
US20020147985A1 (en) * 2001-04-05 2002-10-10 Koji Miyajima Video distribution system and video distribution method
US20040268387A1 (en) * 2001-06-11 2004-12-30 Bertrand Wendling Field of programme delivery
US20060161947A1 (en) * 2001-09-05 2006-07-20 Indra Laksono Method and apparatus for customizing messaging within a cable system
US20030066084A1 (en) * 2001-09-28 2003-04-03 Koninklijke Philips Electronics N. V. Apparatus and method for transcoding data received by a recording device
US20030149975A1 (en) * 2002-02-05 2003-08-07 Charles Eldering Targeted advertising in on demand programming
US20040148454A1 (en) * 2002-03-19 2004-07-29 Minoru Seo Information processing apparatus and method
US20040003397A1 (en) * 2002-06-27 2004-01-01 International Business Machines Corporation System and method for customized video commercial distribution
US20040019524A1 (en) * 2002-07-29 2004-01-29 Marshall Aaron Timothy Showcasing of products featured in entertainment productions
US20040190867A1 (en) * 2002-12-20 2004-09-30 Stmicroelectronics Sa Process and device for decoding MPEG pictures and for displaying them in rewind mode, video driver circuit and decoder box incorporating such a device
US20040179825A1 (en) * 2003-03-11 2004-09-16 Im Jin Seok Digital video record/playback apparatus and playback method thereof
US20040268413A1 (en) * 2003-05-29 2004-12-30 Reid Duane M. System for presentation of multimedia content
US20050010950A1 (en) * 2003-07-11 2005-01-13 John Carney System and method for automatically generating a composite video-on-demand content
US20050074063A1 (en) * 2003-09-15 2005-04-07 Nair Ajith N. Resource-adaptive management of video storage
US20050210110A1 (en) * 2004-03-19 2005-09-22 Lijun Li Portable information terminal and computer software
US20050216932A1 (en) * 2004-03-24 2005-09-29 Daniel Danker Targeted advertising in conjunction with on-demand media content
US20050246451A1 (en) * 2004-05-03 2005-11-03 Microsoft Corporation Background transcoding
US20060095472A1 (en) * 2004-06-07 2006-05-04 Jason Krikorian Fast-start streaming and buffering of streaming content for personal media player
US20050289588A1 (en) * 2004-06-25 2005-12-29 Kinnear D S System and method for targeting video advertisements
US20050289636A1 (en) * 2004-06-25 2005-12-29 Jay Schiller System and method for delivering video programs to a video distribution center
US20060029364A1 (en) * 2004-08-03 2006-02-09 Takuya Kosugi Digital video stream trick play
US20060041902A1 (en) * 2004-08-23 2006-02-23 Microsoft Corporation Determining program boundaries through viewing behavior
US20070220024A1 (en) * 2004-09-23 2007-09-20 Daniel Putterman Methods and apparatus for integrating disparate media formats in a networked media system
US20060088279A1 (en) * 2004-10-26 2006-04-27 Sony Corporation Reproduction apparatus, data processing system, reproduction method, program, and storage medium
US20060100928A1 (en) * 2004-11-09 2006-05-11 Walczak Robert Jr System and method for providing content to a mobile communication device
US20060184579A1 (en) * 2005-01-05 2006-08-17 Michael Mills Framework for providing ancillary content in a television environment
US20060223593A1 (en) * 2005-04-01 2006-10-05 Ixi Mobile (R&D) Ltd. Content delivery system and method for a mobile communication device
US20070118425A1 (en) * 2005-10-25 2007-05-24 Podbridge, Inc. User device agent for asynchronous advertising in time and space shifted media network
US20070100690A1 (en) * 2005-11-02 2007-05-03 Daniel Hopkins System and method for providing targeted advertisements in user requested multimedia content
US20070157249A1 (en) * 2005-12-29 2007-07-05 United Video Properties, Inc. Systems and methods for episode tracking in an interactive media environment
US20080002892A1 (en) * 2006-06-06 2008-01-03 Thomas Jelonek Method and system for image and video analysis, enhancement and display for communication
US20070300261A1 (en) * 2006-06-23 2007-12-27 Barton James M Method and apparatus for advertisement placement in a user dialog on a set-top box
US20080004954A1 (en) * 2006-06-30 2008-01-03 Microsoft Corporation Methods and architecture for performing client-side directed marketing with caching and local analytics for enhanced privacy and minimal disruption
US20080013622A1 (en) * 2006-07-13 2008-01-17 Yiliang Bao Video coding with fine granularity scalability using cycle-aligned fragments
US20080015932A1 (en) * 2006-07-13 2008-01-17 Anthony Haeuser Methods and apparatus to distribute media content
US20080092182A1 (en) * 2006-08-09 2008-04-17 Conant Carson V Methods and Apparatus for Sending Content to a Media Player
US20080060002A1 (en) * 2006-08-31 2008-03-06 Sbc Knowledge Ventures L.P. System and method for delivering targeted advertising data in an internet protocol television system
US20080062018A1 (en) * 2006-09-11 2008-03-13 Apple Computer, Inc. Complexity-aware encoding
US7456760B2 (en) * 2006-09-11 2008-11-25 Apple Inc. Complexity-aware encoding
US20080127249A1 (en) * 2006-09-14 2008-05-29 Cruice David A System and method for encouraging advertisement viewing
US20080109298A1 (en) * 2006-10-31 2008-05-08 Tivo Inc. Method for enhancing television advertising viewership
US20130227621A1 (en) * 2006-10-31 2013-08-29 Tivo Inc. Method and apparatus for downloading ancillary program data to a dvr
US7734116B2 (en) * 2006-11-17 2010-06-08 Microsoft Corporation Swarm imaging
US20080120646A1 (en) * 2006-11-20 2008-05-22 Stern Benjamin J Automatically associating relevant advertising with video content
US20080313669A1 (en) * 2007-06-18 2008-12-18 Swarup Acharya Targeted Advertisement Insertion with Interface Device Assisted Switching
US20090135901A1 (en) * 2007-11-28 2009-05-28 The Hong Kong University Of Science And Technology Complexity adaptive video encoding using multiple reference frames
US20100042499A1 (en) * 2008-08-13 2010-02-18 Barton James M Advertisement content management and distribution system
US20100042749A1 (en) * 2008-08-13 2010-02-18 Barton James M Content distribution system using transportable memory devices
US20130132171A1 (en) * 2008-08-13 2013-05-23 Tivo Inc. Content distribution system using transportable memory devices

Cited By (175)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9311405B2 (en) * 1998-11-30 2016-04-12 Rovi Guides, Inc. Search engine for video and graphics
US20130097145A1 (en) * 1998-11-30 2013-04-18 Gemstar Development Corporation Search engine for video and graphics
US8706735B2 (en) * 2000-07-06 2014-04-22 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US9244973B2 (en) 2000-07-06 2016-01-26 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US8527520B2 (en) 2000-07-06 2013-09-03 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevant intervals
US9542393B2 (en) 2000-07-06 2017-01-10 Streamsage, Inc. Method and system for indexing and searching timed media information based upon relevance intervals
US9294799B2 (en) 2000-10-11 2016-03-22 Rovi Guides, Inc. Systems and methods for providing storage of data on servers in an on-demand media delivery system
US9462317B2 (en) 2000-10-11 2016-10-04 Rovi Guides, Inc. Systems and methods for providing storage of data on servers in an on-demand media delivery system
US10587930B2 (en) 2001-09-19 2020-03-10 Comcast Cable Communications Management, Llc Interactive user interface for television applications
US11412306B2 (en) 2002-03-15 2022-08-09 Comcast Cable Communications Management, Llc System and method for construction, delivery and display of iTV content
US9516253B2 (en) 2002-09-19 2016-12-06 Tvworks, Llc Prioritized placement of content elements for iTV applications
US10491942B2 (en) 2002-09-19 2019-11-26 Comcast Cable Communications Management, Llc Prioritized placement of content elements for iTV application
US9967611B2 (en) 2002-09-19 2018-05-08 Comcast Cable Communications Management, Llc Prioritized placement of content elements for iTV applications
US11381875B2 (en) 2003-03-14 2022-07-05 Comcast Cable Communications Management, Llc Causing display of user-selectable content types
US9363560B2 (en) 2003-03-14 2016-06-07 Tvworks, Llc System and method for construction, delivery and display of iTV applications that blend programming information of on-demand and broadcast service offerings
US10237617B2 (en) 2003-03-14 2019-03-19 Comcast Cable Communications Management, Llc System and method for blending linear content, non-linear content or managed content
US11089364B2 (en) 2003-03-14 2021-08-10 Comcast Cable Communications Management, Llc Causing display of user-selectable content types
US10687114B2 (en) 2003-03-14 2020-06-16 Comcast Cable Communications Management, Llc Validating data of an interactive content application
US9729924B2 (en) 2003-03-14 2017-08-08 Comcast Cable Communications Management, Llc System and method for construction, delivery and display of iTV applications that blend programming information of on-demand and broadcast service offerings
US10616644B2 (en) 2003-03-14 2020-04-07 Comcast Cable Communications Management, Llc System and method for blending linear content, non-linear content, or managed content
US10848830B2 (en) 2003-09-16 2020-11-24 Comcast Cable Communications Management, Llc Contextual navigational control for digital television
US11785308B2 (en) 2003-09-16 2023-10-10 Comcast Cable Communications Management, Llc Contextual navigational control for digital television
US9992546B2 (en) 2003-09-16 2018-06-05 Comcast Cable Communications Management, Llc Contextual navigational control for digital television
US10575070B2 (en) 2005-05-03 2020-02-25 Comcast Cable Communications Management, Llc Validation of content
US11765445B2 (en) 2005-05-03 2023-09-19 Comcast Cable Communications Management, Llc Validation of content
US11272265B2 (en) 2005-05-03 2022-03-08 Comcast Cable Communications Management, Llc Validation of content
US10110973B2 (en) 2005-05-03 2018-10-23 Comcast Cable Communications Management, Llc Validation of content
US9077860B2 (en) 2005-07-26 2015-07-07 Activevideo Networks, Inc. System and method for providing video content associated with a source image to a television in a communication network
US9042454B2 (en) 2007-01-12 2015-05-26 Activevideo Networks, Inc. Interactive encoded content system including object models for viewing on a remote device
US9826197B2 (en) 2007-01-12 2017-11-21 Activevideo Networks, Inc. Providing television broadcasts over a managed network and interactive content over an unmanaged network to a client device
US9355681B2 (en) 2007-01-12 2016-05-31 Activevideo Networks, Inc. MPEG objects and systems and methods for using MPEG objects
US20090276402A1 (en) * 2008-05-01 2009-11-05 Mobitv, Inc. Search system using media metadata tracks
US11917323B2 (en) 2008-05-01 2024-02-27 Tivo Corporation System and method for modifying media streams using metadata
US10250841B2 (en) 2008-05-01 2019-04-02 Mobitv, Inc. System and method for modifying media streams using metadata
US20100215210A1 (en) * 2008-05-21 2010-08-26 Ji Zhang Method for Facilitating the Archiving of Video Content
US20100215211A1 (en) * 2008-05-21 2010-08-26 Ji Zhang System for Facilitating the Archiving of Video Content
US11832024B2 (en) 2008-11-20 2023-11-28 Comcast Cable Communications, Llc Method and apparatus for delivering video and video-related content at sub-asset level
US9191610B2 (en) * 2008-11-26 2015-11-17 Sling Media Pvt Ltd. Systems and methods for creating logical media streams for media storage and playback
US20100129057A1 (en) * 2008-11-26 2010-05-27 Sling Media Pvt Ltd Systems and methods for creating logical media streams for media storage and playback
US20100161441A1 (en) * 2008-12-24 2010-06-24 Comcast Interactive Media, Llc Method and apparatus for advertising at the sub-asset level
US11468109B2 (en) 2008-12-24 2022-10-11 Comcast Interactive Media, Llc Searching for segments based on an ontology
US10635709B2 (en) 2008-12-24 2020-04-28 Comcast Interactive Media, Llc Searching for segments based on an ontology
US9477712B2 (en) 2008-12-24 2016-10-25 Comcast Interactive Media, Llc Searching for segments based on an ontology
US9442933B2 (en) 2008-12-24 2016-09-13 Comcast Interactive Media, Llc Identification of segments within audio, video, and multimedia items
US8713016B2 (en) 2008-12-24 2014-04-29 Comcast Interactive Media, Llc Method and apparatus for organizing segments of media assets and determining relevance of segments to a query
US11531668B2 (en) 2008-12-29 2022-12-20 Comcast Interactive Media, Llc Merging of multiple data sets
US9348915B2 (en) 2009-03-12 2016-05-24 Comcast Interactive Media, Llc Ranking search results
US10025832B2 (en) 2009-03-12 2018-07-17 Comcast Interactive Media, Llc Ranking search results
US8533223B2 (en) 2009-05-12 2013-09-10 Comcast Interactive Media, LLC. Disambiguation and tagging of entities
US9626424B2 (en) 2009-05-12 2017-04-18 Comcast Interactive Media, Llc Disambiguation and tagging of entities
US20100299702A1 (en) * 2009-05-19 2010-11-25 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
WO2010135461A3 (en) * 2009-05-19 2011-03-31 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
US8621520B2 (en) 2009-05-19 2013-12-31 Qualcomm Incorporated Delivery of selective content to client applications by mobile broadcast device with content filtering capability
KR101309347B1 (en) * 2009-05-19 2013-09-17 퀄컴 인코포레이티드 Delivery of selective content to client applications by mobile broadcast device with content filtering capability
US9633379B1 (en) * 2009-06-01 2017-04-25 Sony Interactive Entertainment America Llc Qualified video delivery advertisement
US9892730B2 (en) 2009-07-01 2018-02-13 Comcast Interactive Media, Llc Generating topic-specific language models
US11978439B2 (en) 2009-07-01 2024-05-07 Tivo Corporation Generating topic-specific language models
US11562737B2 (en) 2009-07-01 2023-01-24 Tivo Corporation Generating topic-specific language models
US10559301B2 (en) 2009-07-01 2020-02-11 Comcast Interactive Media, Llc Generating topic-specific language models
US20110064387A1 (en) * 2009-09-16 2011-03-17 Disney Enterprises, Inc. System and method for automated network search and companion display of results relating to audio-video metadata
US10587833B2 (en) * 2009-09-16 2020-03-10 Disney Enterprises, Inc. System and method for automated network search and companion display of result relating to audio-video metadata
US9098758B2 (en) * 2009-10-05 2015-08-04 Adobe Systems Incorporated Framework for combining content intelligence modules
US20160055380A1 (en) * 2009-10-05 2016-02-25 Adobe Systems Incorporated Framework for combining content intelligence modules
US10318814B2 (en) * 2009-10-05 2019-06-11 Adobe Inc. Framework for combining content intelligence modules
US20110137855A1 (en) * 2009-12-08 2011-06-09 Xerox Corporation Music recognition method and system based on socialized music server
US9069771B2 (en) * 2009-12-08 2015-06-30 Xerox Corporation Music recognition method and system based on socialized music server
US20110202397A1 (en) * 2010-02-12 2011-08-18 Disney Enterprises, Inc. Systems and Methods to Deliver Event-Driven Content
WO2011127359A3 (en) * 2010-04-09 2011-12-01 Affine Systems, Inc. Systems and methods for matching an advertisement to a video
WO2011127359A2 (en) * 2010-04-09 2011-10-13 Affine Systems, Inc. Systems and methods for matching an advertisement to a video
US9443147B2 (en) * 2010-04-26 2016-09-13 Microsoft Technology Licensing, Llc Enriching online videos by content detection, searching, and information aggregation
US20110264700A1 (en) * 2010-04-26 2011-10-27 Microsoft Corporation Enriching online videos by content detection, searching, and information aggregation
US20130031573A1 (en) * 2010-04-27 2013-01-31 Zeidman Robert M Method for advertisers to sponsor broadcasts without commercials
US10116999B2 (en) * 2010-04-27 2018-10-30 Firtiva Corporation Method for advertisers to sponsor broadcasts without commercials
US20110289536A1 (en) * 2010-05-20 2011-11-24 Comcast Cable Communications, Llc Communication for One Way Devices
US8898719B2 (en) * 2010-05-20 2014-11-25 Comcast Cable Communications, Llc Communication for one way devices
US20130287364A1 (en) * 2010-08-02 2013-10-31 Sony Corporation Data generating device and data generating method, and data processing device and data processing method
US20120042335A1 (en) * 2010-08-16 2012-02-16 Samsung Electronics Co., Ltd. Method and apparatus for reproducing advertisement
US8984577B2 (en) * 2010-09-08 2015-03-17 Microsoft Technology Licensing, Llc Content signaturing
CN102347839A (en) * 2010-09-08 2012-02-08 微软公司 Content signaturing
US20120056752A1 (en) * 2010-09-08 2012-03-08 Microsoft Corporation Content signaturing
US9021541B2 (en) * 2010-10-14 2015-04-28 Activevideo Networks, Inc. Streaming digital video between video devices using a cable television system
US20120204217A1 (en) * 2010-10-14 2012-08-09 Activevideo Networks, Inc. Streaming Digital Video between Video Devices Using a Cable Television System
US10095367B1 (en) * 2010-10-15 2018-10-09 Tivo Solutions Inc. Time-based metadata management system for digital media
US8904431B2 (en) 2010-12-20 2014-12-02 Microsoft Corporation Current device location advertisement distribution
US20120159542A1 (en) * 2010-12-20 2012-06-21 Microsoft Corporation Current Device Location Advertisement Distribution
CN102665096A (en) * 2010-12-20 2012-09-12 微软公司 Wireless distribution system proxy caches
US9258588B2 (en) 2010-12-20 2016-02-09 Microsoft Technology Licensing, Llc Current device location advertisement distribution
US8850491B2 (en) * 2010-12-20 2014-09-30 Microsoft Corporation Wireless distribution system proxy caches
US20120159555A1 (en) * 2010-12-20 2012-06-21 Microsoft Corporation Wireless Distribution System Proxy Caches
US10721532B2 (en) * 2011-04-06 2020-07-21 Hamed Tadayon Systems and methods for synchronizing media and targeted content
US9204203B2 (en) 2011-04-07 2015-12-01 Activevideo Networks, Inc. Reduction of latency in video distribution networks using adaptive bit rates
US9357267B2 (en) 2011-09-07 2016-05-31 IMDb.com Synchronizing video content with extrinsic data
US11546667B2 (en) 2011-09-07 2023-01-03 Imdb.Com, Inc. Synchronizing video content with extrinsic data
US9930415B2 (en) 2011-09-07 2018-03-27 Imdb.Com, Inc. Synchronizing video content with extrinsic data
US9124954B2 (en) * 2011-10-12 2015-09-01 Vixs Systems, Inc Video processing device for generating time-coded metadata based on a search and methods for use therewith
US9542490B2 (en) * 2011-10-12 2017-01-10 Vixs Systems, Inc. Video processing device for generating time-coded metadata and methods for use therewith
US9424350B2 (en) * 2011-10-12 2016-08-23 Vixs Systems, Inc. Video processing device for embedding authored metadata and methods for use therewith
US20130094834A1 (en) * 2011-10-12 2013-04-18 Vixs Systems, Inc. Video processing device for embedding authored metadata and methods for use therewith
US20150033248A1 (en) * 2011-10-12 2015-01-29 Vixs Systems, Inc. Video processing device for embedding time-coded metadata and methods for use therewith
US20150339304A1 (en) * 2011-10-12 2015-11-26 Vixs Systems, Inc. Video processing device for generating time-coded metadata based on a search and methods for use therewith
US8842879B2 (en) * 2011-10-12 2014-09-23 Vixs Systems, Inc Video processing device for embedding time-coded metadata and methods for use therewith
WO2013079768A1 (en) 2011-11-30 2013-06-06 Nokia Corporation Method and apparatus for enriching media with meta-information
EP2786283A4 (en) * 2011-11-30 2015-07-01 Nokia Corp Method and apparatus for enriching media with meta-information
US9125169B2 (en) 2011-12-23 2015-09-01 Rovi Guides, Inc. Methods and systems for performing actions based on location-based rules
US10409445B2 (en) 2012-01-09 2019-09-10 Activevideo Networks, Inc. Rendering of an interactive lean-backward user interface on a television
US9252916B2 (en) 2012-02-13 2016-02-02 Affirmed Networks, Inc. Mobile video delivery
US9800945B2 (en) 2012-04-03 2017-10-24 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US10506298B2 (en) 2012-04-03 2019-12-10 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US10757481B2 (en) 2012-04-03 2020-08-25 Activevideo Networks, Inc. Class-based intelligent multiplexing over unmanaged networks
US9123084B2 (en) 2012-04-12 2015-09-01 Activevideo Networks, Inc. Graphical application integration with MPEG objects
US20130291002A1 (en) * 2012-04-25 2013-10-31 Cox Communications, Inc. Systems and Methods for Delivery of Media Content
US9785639B2 (en) * 2012-04-27 2017-10-10 Mobitv, Inc. Search-based navigation of media content
US20130290846A1 (en) * 2012-04-27 2013-10-31 Mobitv, Inc. Search-based navigation of media content
US11789992B2 (en) 2012-04-27 2023-10-17 Tivo Corporation Search-based navigation of media content
US10628477B2 (en) 2012-04-27 2020-04-21 Mobitv, Inc. Search-based navigation of media content
US9800951B1 (en) 2012-06-21 2017-10-24 Amazon Technologies, Inc. Unobtrusively enhancing video content with extrinsic data
US11636881B2 (en) 2012-08-31 2023-04-25 Amazon Technologies, Inc. User interface for video content
US10009664B2 (en) 2012-08-31 2018-06-26 Amazon Technologies, Inc. Providing extrinsic data for video content
US9747951B2 (en) 2012-08-31 2017-08-29 Amazon Technologies, Inc. Timeline interface for video content
US8955021B1 (en) * 2012-08-31 2015-02-10 Amazon Technologies, Inc. Providing extrinsic data for video content
US9113128B1 (en) 2012-08-31 2015-08-18 Amazon Technologies, Inc. Timeline interface for video content
US11112942B2 (en) 2012-12-10 2021-09-07 Amazon Technologies, Inc. Providing content via multiple display devices
US9389745B1 (en) 2012-12-10 2016-07-12 Amazon Technologies, Inc. Providing content via multiple display devices
US10579215B2 (en) 2012-12-10 2020-03-03 Amazon Technologies, Inc. Providing content via multiple display devices
EP2765786A1 (en) * 2013-02-06 2014-08-13 Nagravision S.A. Method to enhance a video content in a receiving device
US10424009B1 (en) 2013-02-27 2019-09-24 Amazon Technologies, Inc. Shopping experience using multiple computing devices
US11601720B2 (en) 2013-03-14 2023-03-07 Comcast Cable Communications, Llc Content event messaging
US10880609B2 (en) 2013-03-14 2020-12-29 Comcast Cable Communications, Llc Content event messaging
US10275128B2 (en) 2013-03-15 2019-04-30 Activevideo Networks, Inc. Multiple-mode system and method for providing user selectable video content
US11073969B2 (en) 2013-03-15 2021-07-27 Activevideo Networks, Inc. Multiple-mode system and method for providing user selectable video content
US9277255B1 (en) * 2013-03-15 2016-03-01 Google Inc. Metering of internet protocol video streams
US9602852B1 (en) * 2013-03-15 2017-03-21 Google Inc. Metering of internet protocol video streams
US9374411B1 (en) 2013-03-21 2016-06-21 Amazon Technologies, Inc. Content recommendations using deep data
US9219922B2 (en) 2013-06-06 2015-12-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US9326047B2 (en) 2013-06-06 2016-04-26 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US10200744B2 (en) 2013-06-06 2019-02-05 Activevideo Networks, Inc. Overlay rendering of user interface onto source video
US9294785B2 (en) 2013-06-06 2016-03-22 Activevideo Networks, Inc. System and method for exploiting scene graph information in construction of an encoded video sequence
US11019300B1 (en) 2013-06-26 2021-05-25 Amazon Technologies, Inc. Providing soundtrack information during playback of video content
US11418768B2 (en) 2013-09-03 2022-08-16 Penthera Partners, Inc. Commercials on mobile devices
US11070780B2 (en) 2013-09-03 2021-07-20 Penthera Partners, Inc. Commercials on mobile devices
US10616546B2 (en) 2013-09-03 2020-04-07 Penthera Partners, Inc. Commercials on mobile devices
US11991489B2 (en) 2013-09-03 2024-05-21 Penthera Partners, Inc. Commercials on mobile devices
US10194189B1 (en) 2013-09-23 2019-01-29 Amazon Technologies, Inc. Playback of content using multiple devices
WO2015050651A1 (en) * 2013-10-01 2015-04-09 Penthera Partners, Inc. Downloading media objects
US9244916B2 (en) 2013-10-01 2016-01-26 Penthera Partners, Inc. Downloading media objects
US9838740B1 (en) 2014-03-18 2017-12-05 Amazon Technologies, Inc. Enhancing video content with personalized extrinsic data
US9788029B2 (en) 2014-04-25 2017-10-10 Activevideo Networks, Inc. Intelligent multiplexing using class-based, multi-dimensioned decision logic for managed networks
US20160189712A1 (en) * 2014-10-16 2016-06-30 Veritone, Inc. Engine, system and method of providing audio transcriptions for use in content resources
US11783382B2 (en) 2014-10-22 2023-10-10 Comcast Cable Communications, Llc Systems and methods for curating content metadata
US10051340B2 (en) 2015-01-08 2018-08-14 The Directv Group, Inc. Systems and methods for triggering user interfaces for product and/or service transactions via user receiving devices and mobile devices
US10839416B1 (en) 2015-01-08 2020-11-17 The Directv Group, Inc. Systems and methods for controlling advertising, upselling, cross-selling, and purchasing of products and services via user receiving devices and mobile devices
WO2016112042A1 (en) * 2015-01-08 2016-07-14 The Directv Group, Inc. Systems and methods for triggering user interfaces for product and/or service transactions via user receiving devices and mobile devices
US10820059B1 (en) 2015-01-08 2020-10-27 The Directv Group, Inc. Systems and methods for spotted advertising and control of corresponding user interfaces and transactions via user receiving devices and mobile devices
US10356478B2 (en) 2015-01-08 2019-07-16 The Directv Group, Inc. Systems and methods for spotted advertising and control of corresponding user interfaces and transactions via user receiving devices and mobile devices
US20240031625A1 (en) * 2015-01-30 2024-01-25 Inscape Data, Inc. Methods for identifying video segments and displaying option to view from an alternative source and/or on an alternative device
US10200804B2 (en) 2015-02-25 2019-02-05 Dolby Laboratories Licensing Corporation Video content assisted audio object extraction
EP3062278A1 (en) * 2015-02-26 2016-08-31 Aircom Pacific Inc Product ordering system and product ordering method thereof
US20170046339A1 (en) * 2015-08-14 2017-02-16 Airwatch Llc Multimedia searching
US11665406B2 (en) 2015-09-16 2023-05-30 Amazon Technologies, Inc. Verbal queries relative to video content
US10271109B1 (en) 2015-09-16 2019-04-23 Amazon Technologies, LLC Verbal queries relative to video content
US11430015B2 (en) 2015-09-30 2022-08-30 Disney Enterprises, Inc. Methods and systems for personalized gamification of media content
US11699173B2 (en) 2015-09-30 2023-07-11 Disney Enterprises, Inc. Methods and systems for personalized gamification of media content
US10726443B2 (en) 2016-07-11 2020-07-28 Samsung Electronics Co., Ltd. Deep product placement
US9965900B2 (en) * 2016-09-01 2018-05-08 Avid Technology, Inc. Personalized video-based augmented reality
US10078920B2 (en) 2016-09-01 2018-09-18 Avid Technology, Inc. Personalized video-based augmented reality
US10552074B2 (en) 2016-09-23 2020-02-04 Samsung Electronics Co., Ltd. Summarized data storage management system for streaming data
US10733626B2 (en) 2016-09-30 2020-08-04 Disney Enterprises, Inc. System and method for real-time generation of segments for a computerized decision system
US10575067B2 (en) 2017-01-04 2020-02-25 Samsung Electronics Co., Ltd. Context based augmented advertisement
WO2018128648A1 (en) * 2017-01-05 2018-07-12 Rovi Guides, Inc. Systems and methods for personalized timing for advertisements
US11720923B2 (en) 2017-01-05 2023-08-08 Rovi Guides, Inc. Systems and methods for personalized timing for advertisements
US10929886B2 (en) 2017-01-05 2021-02-23 Rovi Guides, Inc. Systems and methods for personalized timing for advertisements
US11682045B2 (en) 2017-06-28 2023-06-20 Samsung Electronics Co., Ltd. Augmented reality advertisements on objects
US20190082232A1 (en) * 2017-09-10 2019-03-14 Comigo Ltd. Devices, systems and methods for selecting enrichment data of video content items based on commercial content of the video content items
US10917700B2 (en) 2018-02-02 2021-02-09 Microsoft Technology Licensing, Llc Estimating bandwidth savings for adaptive bit rate streaming
WO2020168606A1 (en) * 2019-02-22 2020-08-27 深圳前海微众银行股份有限公司 Advertisement video optimising method, apparatus and device and computer readable storage medium

Also Published As

Publication number Publication date
US20150245111A1 (en) 2015-08-27
US11800169B2 (en) 2023-10-24
US20160165288A1 (en) 2016-06-09
US20240007696A1 (en) 2024-01-04

Similar Documents

Publication Publication Date Title
US20240007696A1 (en) Systems and methods for using video metadata to associate advertisements therewith
US11403676B2 (en) Interleaving video content in a multi-media document using keywords extracted from accompanying audio
US20190364329A1 (en) Non-intrusive media linked and embedded information delivery
US8219911B2 (en) System and method for displaying contextual advertisements with media
US20080046917A1 (en) Associating Advertisements with On-Demand Media Content
US20090172727A1 (en) Selecting advertisements to present
US20080040768A1 (en) Approach for associating advertising supplemental information with video programming
US20090276807A1 (en) Facilitating indication of metadata availbility within user accessible content
Begeja et al. eClips: A new personalized multimedia delivery service

Legal Events

Date Code Title Description
AS Assignment

Owner name: TIVO INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIGITALSMITHS CORPORATION;REEL/FRAME:032820/0918

Effective date: 20140430

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: TIVO INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:DIGITALSMITHS CORPORATION;REEL/FRAME:044265/0020

Effective date: 20140430

Owner name: TIVO SOLUTIONS INC., CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:TIVO INC.;REEL/FRAME:044265/0089

Effective date: 20160908

Owner name: TIVO INC., CALIFORNIA

Free format text: EMPLOYMENT AGREEMENT;ASSIGNOR:BERRY, MATTHEW G.;REEL/FRAME:044567/0347

Effective date: 20140214

Owner name: DIGITALSMITHS CORPORATION, CALIFORNIA

Free format text: EMPLOYMENT AGREEMENT;ASSIGNOR:ECKSTROM, SCHUYLER;REEL/FRAME:044567/0423

Effective date: 20060530

Owner name: TIVO INC., CALIFORNIA

Free format text: PROPRIETARY INFO/INV AGREEMENT;ASSIGNOR:WEINBERGER, BENJAMIN J.;REEL/FRAME:044567/0400

Effective date: 20140124