US20070283276A1 - Mosaic-like user interface for video selection and display - Google Patents
Mosaic-like user interface for video selection and display Download PDFInfo
- Publication number
- US20070283276A1 US20070283276A1 US11/707,643 US70764307A US2007283276A1 US 20070283276 A1 US20070283276 A1 US 20070283276A1 US 70764307 A US70764307 A US 70764307A US 2007283276 A1 US2007283276 A1 US 2007283276A1
- Authority
- US
- United States
- Prior art keywords
- entries
- user
- entry
- information
- response
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/74—Browsing; Visualisation therefor
- G06F16/743—Browsing; Visualisation therefor a collection of video files or sequences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/0044—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
- H04N1/00442—Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/0044—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
- H04N1/00442—Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
- H04N1/00453—Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails arranged in a two dimensional array
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/0044—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
- H04N1/00458—Sequential viewing of a plurality of images, e.g. browsing or scrolling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/0035—User-machine interface; Control console
- H04N1/00405—Output means
- H04N1/00408—Display of information to the user, e.g. menus
- H04N1/0044—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet
- H04N1/00461—Display of information to the user, e.g. menus for image preview or review, e.g. to help the user position a sheet marking or otherwise tagging one or more displayed image, e.g. for selective reproduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4314—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4826—End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
- H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only
Definitions
- the invention relates to user interfaces for video selection and display.
- Some known systems allow users to sort lists of entries, but one result of such sorting is that the user is presented with a linear list of entries or titles, disposed in a fashion that is often difficult on the eye and relatively unhelpful for selection of an individual entry or title. This is a relatively greater drawback when many entries or titles have data fields that might be categorized into multiple groups. For example, many videos might be characterized as both “comedy” and “western,” or as both “action-adventure” and “mystery,” and the like. Some known systems allow users to search or sort entries by such categories, but the user's ability to locate entries with similar categories can be relatively limited, depending on the degree of sorting allowed and the number of sort keys allowed per entry.
- the invention provides a method and system capable of presenting a UI (user interface) involving selection and display of videos from a library thereof, although of course the concepts of the invention are not limited to videos.
- the UI includes a “Mosaic” mode of operation, in which a primarily visual display is made of information about possible videos, with the effect that a user might select one such video in response to such visual display.
- Entries from the library are presented in a graphical format, with entries each displayed including at least one graphical form sufficient for the user to recognize that entry, and preferably representative of at least one data field associated with that entry.
- entries For example, not intended to be limiting in any way, for displaying information for a library of videos, each entry might be displayed using its lobby poster (also known in the movie industry as a “one sheet”), possibly along with additional text such as a caption.
- the graphical form sufficient for the user to recognize that entry might be dynamically generated, in response to data fields associated with that entry, in response to other information, or in response to some combination or conjunction thereof.
- the Mosaic is organized as a multidimensional display of entries, each of which has visual information relating to that entry.
- the Mosaic is organized as a two-dimensional array of movie posters, each representative of one entry in the library. This two-dimensional array preferably includes auxiliary information disposed near a focused-upon entry, as described below.
- the focused-upon entry is relatively centralized and emphasized, and might have auxiliary information about that specific entry displayed for further user understanding.
- additional information about a video might be displayed in a screen region near the lobby poster for that video, such as to the right or left of that lobby poster, and might include auxiliary information about the video such as its title, maturity rating, quality rating, genre, actors, and year of publication. Additional such information, such as for example director, language, a summary description of the movie, a more detailed description or set of reviews of the movie, and the like, might be presented in response to a user request.
- auxiliary information about the movie might be presented, possibly in conjunction with enlarging or otherwise emphasizing the screen region associated with that auxiliary information, in response to the user pointing to, clicking on, mousing over, or otherwise selecting, the focused-upon entry or its auxiliary information.
- the Mosaic is presented with the focused-upon entry highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for those entries that are not focused-upon, and with relatively lesser highlighting or other emphasis for those entries positioned relatively distant from the focused-upon entry.
- the UI presents visual representations of relatively similar entries relatively near to each other, with the effect that those entries or titles having relatively greater similarity to the focused-upon entry or title are presented near the focused-upon entry or title, and might have their similarity otherwise emphasized as well. This has the effect that, if the user is interested in the focused-upon entry or title, the user can also easily and readily locate at least some entries or titles of with possible similar interest.
- pairs of individual entries are compared, and a measure of content distance (responsive to information about those entries, such as for example information about their content) is determined.
- Individual entries are displayed in a format in which display distance within the OSD is correlated with content distance. This has the effect that similar videos are displayed in relative proximity within the OSD.
- content distance is responsive to metadata about those videos.
- metadata might include keywords in the title of the video, a genre assigned to the video (such as for example “comedy” or “western,” a set of actors or characters involved with the video, a series into which the video is classified (that is, “Star Wars” or “Jackie Chan Movies”), a director or producer or studio associated with the video, a year in which the video was made or remade, a rating assigned to the video (such as for example, TV-Y, G, PG, or R, or some other selected set of ratings), a set of awards associated with the video (such as for example “best cartoon” or “best foreign film”), and the like.
- keywords in the title of the video such as for example “comedy” or “western,” a set of actors or characters involved with the video, a series into which the video is classified (that is, “Star Wars” or “Jackie Chan Movies”), a director or producer or studio associated with the video, a year in which the
- aspects of the cover art might also be compared, such as for example whether that cover art is abstract or shows a scene, whether that cover art shows a selected actor, whether that cover art is primarily pictorial or text, and the collection of brightness, hue, and saturation associated with that cover art (with the effect, for example, of differentiating between the cover of a box of “Tide” and a work from Picasso's Blue Period).
- relative weighting assigned to each data field of metadata is responsive to user choice, where that user choice might be expressed (a) relatively directly, such as for example by selecting a relative weighting value, (b) relatively indirectly, such as for example by the system deducing the user's preferred relative weighting value in response to those videos actually selected for viewing or as the next video for focus, or (c) in response to demographic information about the user, possibly in combination or conjunction with collaborative filtering information.
- selection of actual placement is random or pseudo-random, preferably in response to both metadata information and random or pseudo-random information, and dynamically determined, preferably in response to both a content distance from a focused-upon entry and random or pseudorandom information.
- the one or more triggering events might include (a) an explicit request by the user for dynamic rearrangement, (b) selection of a new focused-upon entry by the user, (c) incoming new data to be incorporated by the UI for presentation, and the like, as well as combinations or conjunctions thereof.
- the rearrangement when performing dynamic rearrangement, is presented to the user as a continuous process, with individual movie posters being presented as moving, for a fraction of a second, from a first to a second position.
- the rearrangement may be presented to the user as a process having at least some continuous elements, such as for example either (a) a single transform into a new rearrangement, (b) a sequence of transforms, each being relatively smooth, but with time boundaries in between sequential elements, such as for example sliding individual rows and columns in a sequence, (c) a stochastic set of transforms, such as exchanging pairs of videos, or replacing video to be removed with a video to be inserted.
- continuous elements such as for example either (a) a single transform into a new rearrangement, (b) a sequence of transforms, each being relatively smooth, but with time boundaries in between sequential elements, such as for example sliding individual rows and columns in a sequence, (c) a stochastic set of transforms, such as exchanging pairs of videos, or replacing video to
- the selected movie posters are arranged with the effect of tiling the screen area of the OSD, with the effect that a relatively maximum number of movie posters are displayed within that limited screen area.
- the selected movie posters are arranged in an overlapped manner (thus possibly having the effect of displaying more movie posters, but not necessarily all of their content simultaneously), or with spacing in between, with the effect of presenting the user with a preferred pleasing arrangement.
- the Mosaic is presented as a two-dimensional array of picture elements (such as a movie poster for each video), with the property that a user might scroll either horizontally or vertically within the two-dimensional array without missing any entries. That is, all entries presented in the Mosaic appear at least somewhere in each row and each column of the two-dimensional array. This has the effect of presenting a visual illusion that the two-dimensional array of images is infinite in extent, while actually it is the case that scrolling in any one direction (right, left, up, down) sufficiently will eventually return to the same presentation of cover art.
- FIG. 1 shows a block diagram of a system including a mosaic-like user interface for video selection and display.
- FIG. 2 shows a block diagram of an on-screen display including operation of a mosaic-like guided user interface for video selection and display.
- FIG. 3 shows a process flow diagram of a method including operation of a mosaic-like guided user interface for video selection and display.
- FIG. 1 shows a block diagram of a system including a mosaic-like user interface for video selection and display.
- a system 100 includes a processor 101 , program and data memory or mass storage 102 , at least one input element 103 , and at least one output element 104 .
- the system 100 is coupled to at least one communication element 110 capable of sending and receiving information from a logically remote device 111 , such as for example a computer network coupled to an internet, intranet, LAN, WAN, VPN, or an enterprise network.
- a logically remote device 111 might include one or more computing devices capable of receiving requests from a user 112 of the system 100 and responding to those requests by providing information related to use of the system 100 .
- the information might include (a) media streams, such as for example movies; or might include (b) metadata (such as for example titles, ratings, and the like, as some examples are further described herein) about those media streams.
- the communication element 110 could be used in combination or conjunction with the incorporated disclosure, including techniques shown in the provisional patent applications titled “SYSTEM ARCHITECTURE OF A SYSTEM FOR SECURE DISTRIBUTION OF MEDIA” and “TOPOLOGY OF CACHING NODES IN A SYSTEM FOR SECURE DELIVERY OF MEDIA CONTENT.”
- the memory or mass storage 102 is capable of including instructions capable of being executed or interpreted by the processor 101 to perform steps as described herein.
- the memory or mass storage 102 is also capable of maintaining data on behalf of the processor 101 as described herein.
- the system 100 using the at least one input element 103 , is disposed for receiving information from the user 112 , such as for example an individual who desires to select a movie for viewing, and using the at least one output element 104 , is disposed for presenting information to the user 112 .
- the user 112 is so limited.
- the user 112 might include an individual, a company or family or other group, or another entity. In one embodiment, where the user 112 includes a company or family or other group, the user 112 might include more than one person who interacts with the system 100 from time to time.
- the one or more input elements 103 and the one or more output elements 104 are coupled to the processor 101 and the memory or mass storage 102 using a local network, such as for example a LAN, VPN, or enterprise network.
- the system 100 uses the processor 101 and program and data memory or mass storage 102 , is disposed for processing information from the user 112 , such as (a) receiving commands or requests 113 from the user 112 , (b) parsing or recognizing those commands or requests 113 , (c) determining one or more responses 114 to make to those commands or requests 113 , and (d) directing the at least one output element 104 to present those responses 114 to the user 112 .
- the system 100 using the at least one output element 104 , is disposed for presenting information to the user 112 .
- FIG. 2 shows a block diagram of an on-screen display including operation of a mosaic-like guided user interface for video selection and display.
- the input element 103 (such as for example the remote control) and the display screen 105 operate in combination or conjunction, under control of the processor 101 and the program and data memory or mass storage 102 , to present a UI (user interface) as described herein.
- UI user interface
- the UI includes at least some elements to be presented on the display screen 105 , including possibly a set of screen regions 201 (possibly disjoint or possibly overlapping), a set of scroll affordances 202 a or scroll bars 202 b (possibly horizontal or possibly vertical), one or more highlighting features or pointing elements 203 , one or more iconic or symbolic elements 204 , one or more pictures (possibly still pictures, animation, or motion video), one or more units of text (possibly presented in one or more fonts), and the like.
- the UI also includes at least some elements to be received from the user 112 (possibly presented on the display screen 105 or on the touch-panel control 103 b ), such as a set of buttons 211 , possibly pre-selected and fixed in function, or possibly selected in response to user preferences or other input and alterable in function from time to time.
- buttons 211 might be shown (a) directly on the remote control 103 a , and selected by the user 112 by pressing one of the physical buttons 211 ; (b) directly on the touch-panel control 103 b , and selected by the user 112 by pressing one of the areas designated on that touch-panel control 103 b as one of the buttons 211 ; or (c) directly on the display screen 105 in a selected screen region 201 , and selected by the user 112 by selecting the button 211 using the pointing device or keyboard.
- references to the UI “interpreting” input, “presenting” output, or “reacting to” input describe operations by the processor 101 and the program and data memory or mass storage 102 , as described above, to (a) receive commands or requests 113 from the user 112 , (b) parse or recognize those commands or requests 113 , (c) determine one or more responses 114 to make to those commands or requests 113 , and (d) direct the at least one output element 104 to present those responses 114 to the user 112 .
- the processor 101 and the program and data memory or mass storage 102 might be responsive to (a) receive inputs from the user 112 , and respond to those inputs by moving a position of the pointing element 203 , (b) respond to a relative position of that pointing element 203 with regard to one of the screen regions 201 , and respond by highlighting or de-highlighting selected screen regions 201 , (c) respond to a relative position of that pointing element 203 with regard to one of the scroll affordances 202 a or scroll bars 202 b , and respond by scrolling or paging one or more of the screen regions 201 , (d) respond to a relative position of that pointing element 203 with regard to one of the iconic or symbolic elements 204 , and respond by invoking or de-invoking an selected function associated with that one iconic or symbolic element 204 , (e) as well as reasonable generalizations thereof, and the like.
- the display screen 105 is partitioned into a rectilinear tiled set of screen regions 201 , such as for example disjoint regions as one might find in a chessboard, although in the context of the invention, there is no particular requirement that each such screen region 201 need be the same height or width.
- the rectilinear tiled set of screen regions 201 comprise a set of rows 211 and a set of columns 212 , each such row 211 and column 212 intersecting in a single substantially disjoint such screen regions 201 .
- the “Mosaic” mode of operation may include other dispositions of individual screen regions 201 , such as for example (a) a hexagonal pattern of screen regions 201 disposed within the display screen 105 , (b) a spiral pattern of screen regions 201 disposed within the display screen 105 , (c) a perspective view having the effect of representing a multidimensional pattern of screen regions 201 , such as for example a three-dimensional lattice, disposed within the display screen 105 , (d) a distribution of screen regions 201 representing a set of clusters of entries 231 , (e) a pseudorandom or random distribution of screen regions 201 disposed within the display screen 105 , reasonable generalizations thereof, and the like.
- the “Mosaic” mode of operation may include individual screen regions 201 having different sizes for distinct entries 231 .
- the UI might present selected screen regions 201 as relatively larger or relatively smaller, with the effect of representing distance in a three-dimensional viewing illusion presented to the user 112 .
- the UI might present selected screen regions 201 as relatively larger or relatively smaller, with the effect of representing relative importance within a cluster of entries 231 presented to the user 112 .
- the “Mosaic” mode of operation is performed in association with a database 221 .
- the database 221 is available to the processor 101 at the program and data memory 102 , but in the context of the invention, there is no particular requirement where the database 221 is specifically located.
- the database 221 might be located (a) at a remote device available processor 100 using the communication device 111 , (b) at an auxiliary processor 101 b coupled to the processor 101 or the program and data memory 102 , or (c) on a computer-readable medium 222 coupled to a reader 223 thereof, to the processor 101 or the program and data memory 102 , or to any other element of the system 100 .
- the database 221 preferably includes information involving a library or set of videos, such as for example movies that might be selected for presentation, and presented, to the user 112 .
- a library or set of videos such as for example movies that might be selected for presentation, and presented, to the user 112 .
- the database 221 is limited to videos, or even to information that might be presented to the user 112 .
- the invention could be used to represent advertisements, animation, audio titles, books or other textual works, computer programs in source or object code form, encyclopedia entries, magazines or articles therefrom, microfiche images, people (real or fictional), still pictures, or more generally, database entries of any kind.
- the database 221 is the sole source of information to be presented to the user 112 .
- the invention could be used in combination or conjunction with other techniques for presenting or representing information, such as in any of the following possibilities: a plurality of such databases 221 , a hierarchical representation of data, a hyperlinked representation of data (such as for example a web page), a dynamically generated representation of data (such as for example by an applet), or some combination or mixture thereof.
- the database 221 includes one entry 231 for each such video, and a set of data fields 232 , with the property that for each such entry 231 , at least some of those data fields 232 have information relating to that entry 231 , and with the property that the information in each data field 232 for a first entry 231 bears the same relation to that first entry 231 as the information in that data field 232 for a second entry 231 .
- a data field 232 is selected to represent the title of an entry 231 , for each entry 231 for which that data field 232 has any information, that information represents the title of that entry 231 .
- the database 221 includes a plurality of such entries 231 , and a plurality of such data fields 232 , with the effect that an individual entry 231 might (or might not) have the same information as another such entry for a related data field 232 .
- more than one entry 231 each representing a distinct video, might each have a data field 232 representing the genre of that video (such as for example a “comedy” or a “western”), and more than one such entry 231 might have the same information for that data field 232 , such as for example if both such videos were comedies.
- the database 221 might include multiple data values 222 for one or more such data fields 232 for an entry 231 , such as for example a single video might be associated with multiple actors or multiple genres.
- a selected screen region 201 a within the display screen 105 is reserved for a focused-upon entry 231 , such as for example a video recently selected by the user 112 as the focused-upon entry 231 .
- the UI presents, at the focus 201 a , at least one graphical form 201 b , such as a lobby poster, from which the user 112 can readily identify the focused-upon entry 231 .
- the UI may present, at the focus 201 a , more than one such graphical form 201 b , such as for example both a lobby poster and selected stills from the movie associated with the focused-upon entry 231 , or such as for example an animated or clickable slideshow associated with the focused-upon entry 231 .
- the UI might also present, adjacent or otherwise near to the focus 201 a , additional information, such as for example a caption 201 c .
- the caption 201 c might include (a) a title, (b) a color bar representing a category or genre associated with the movie, (c) a thermometer indicator representing a value associated with the movie, such as for example a maturity rating or quality rating, reasonable generalizations thereof, and the like.
- the focus 201 a has associated with it an auxiliary information area 205 , in which the UI presents auxiliary information about the focused-upon entry 231 .
- the auxiliary information area 205 includes textual or other detailed information about the focused-upon entry 231 , such as for example its (a) title, (b) maturity rating, (c) quality rating, (d) genre, (e) actors, (f) year of publication, (g) director, (h) language, (i) a summary description of the movie, (j) a more detailed description or set of reviews of the movie, and the like, to the extent that such information can be conveniently presented within the auxiliary information area 205 .
- the auxiliary information area 205 has associated with it a control zone 206 , in which the UI might receive commands and requests 113 from the user 112 , such as for example to (a) select information to display about the focused-upon entry 231 , (b) scroll or page the information being displayed within the auxiliary information area 205 , (c) receive text or other selected information with which to search the database 221 , reasonable generalizations thereof, and the like.
- the control zone 206 might include one more icons 208 , each associated with a possible command or requests 113 from the user 112 , and each associated with a function (or a selected set of functions) that the UI might perform in response to such a command or request 113 from the user 112 .
- the processor 101 computes an arrangement of entries 231 .
- the arrangement of entries 231 has the property that a measure of distance between entries 231 (herein sometimes called “content distance”) and a measure of distance between screen regions 201 associated with those entries 231 are maximally correlated over the entire arrangement of entries 231 .
- the processor 101 pre-computes a content distance value for each pair of entries 231 , in response to information associated with those entries 231 by the database 221 .
- the processor 101 might compute the content distance value for at least some pairs of entries 231 dynamically, in response to information associated with those entries 231 by the database 221 , and possibly in response to other information obtained dynamically, such as from the communication link 111 or from the user 112 .
- the processor 101 examines the data fields 232 associated with each such entry 231 in the database 221 , and computes an individual distance value associated with each such data field 232 . The processor 101 combines these individual distance values associated with each such data field 232 to determine a content distance value associated with each pair of entries 231 .
- Individual distance values might be continuous or discrete values, such as for example (for a continuous value) a measure of similarity of titles, a measure of difference value between year of publication, or a measure of difference in number of awards won by each movie, or (for a discrete value) whether the director or producer or studio associated with the video is the same, whether the genre or maturity rating is the same for both movies, whether both movies are classified in the same series (such as for example “Star Wars” or “Jackie Chan Movies”), or how many actors are common to both movies.
- a continuous value a measure of similarity of titles, a measure of difference value between year of publication, or a measure of difference in number of awards won by each movie, or (for a discrete value) whether the director or producer or studio associated with the video is the same, whether the genre or maturity rating is the same for both movies, whether both movies are classified in the same series (such as for example “Star Wars” or “Jackie Chan Movies”), or how many actors are common to both movies.
- the processor 101 may examine information associated with the movies themselves. For a first example the processor 101 might compare the movie posters for both entries 231 , such as for example whether that cover art is abstract or shows a scene, whether that cover are shows a selected actor, whether that cover art is primarily pictorial or text, and the collection of brightness, hue, and saturation associated with that cover art (with the effect, for example, of differentiating between the cover of a box of “Tide” and a work from Picasso's Blue Period). For a second example, the processor 101 might compare selected frames or scenes or aspects of the movies themselves, such as for example whether the movies are generally bright or dark, show scenes that are indoors or outdoors, show fast motion or talking, or show animated or cartoon characters.
- relative weighting assigned to each data field of metadata is responsive to user choice, where that user choice might be expressed (a) relatively directly, such as for example by selecting a relative weighting value, (b) relatively indirectly, such as for example by the system deducing the user's preferred relative weighting value in response to those videos actually selected for viewing or as the next video for focus, or (c) in response to demographic information about the user, possibly in combination or conjunction with collaborative filtering information.
- the processor 101 computes a screen distance value for each pair of possible screen regions 201 that might be associated with entries 231 .
- the set of screen regions 201 might exceed the actual size of the display screen 105 , so that the set of possible screen regions 201 might significantly exceed the number of screen regions 201 that fit on the display screen 105 .
- the processor 101 pre-computes the screen distance for each pair of possible screen regions 201 , in response to their relative positions as they might be presented on the display screen 105 .
- the processor 101 might compute the screen distance value for at least some pairs of screen regions 201 dynamically, in response to information associated with the disposition of those screen regions 201 in response to entries 231 from the database 221 , and possibly in response to other information obtained dynamically, such as from the communication link 111 or from the user 112 .
- screen regions 201 are tiled, there is no particular requirement in the context of the invention for dynamic computation of the screen distance value.
- the processor 101 computes a correlation value indicating how good a match that association presents. This has the effect that a relatively higher correlation indicates that the entries 231 to be presented in each screen region 201 are relatively closer when those entries 231 are relatively similar, and that a relatively lower correlation indicates that the entries 231 to be presented in each screen region 201 are not as close as they could be when those entries 231 are relatively similar.
- the processor 101 assigns at least one screen region 201 for each entry 231 in the database 221 .
- the user 112 may have available a command or request 113 to filter the database 221 , with the effect that this statement is true for the retained entries 231 of the filtered database 221 .
- This zeroth-order pseudorandom or random assignment o A has associated with it a correlation between content distance and screen distance, as determined with regard to the set of all screen regions 201 and with regard to the set of all entries 231 .
- the symbol o A indicates the zeroth-order assignment.
- the zeroth-order assignment o A has associated with it a correlation indicating how well it places entries 231 that are similar to each other in screen regions 201 that are close to each other.
- the processor 101 iteratively modifies the k th assignment k A of screen regions 201 for entries 231 in response to a pseudorandom or random input, to produce a (k+1) st such assignment (k+1) A, using a technique similar to simulated annealing.
- the processor 101 might, in response to a pseudorandom or random input, exchange the association of two screen regions 201 with their two entries 231 , with the effect of altering the k th assignment k A of screen regions 201 for entries 231 , and might make such alterations a number of times, with the effect of producing the (k+1) st such assignment (k+1) A.
- the processor 101 may use other techniques to attempt to substantially optimize the assignment of screen regions 201 for entries 231 .
- the processor 101 may use a gradient descent technique, a neural network technique, a genetic algorithm or genetic programming technique, a random search technique, or other techniques known in the fields of artificial intelligence and machine learning. These techniques may also be used in combination or conjunction with simulated annealing.
- the processor 101 determines a measure of quality of the k th assignment k A of screen regions 201 for entries 231 , responsive to the measure of correlation between content distance and screen distance, as determined with regard to the set of all screen regions 201 and with regard to the set of all entries 231 (and in response to any effects on screen distance responsive to operations described below in the section “Scrolling and Paging”).
- the processor 101 selects an amount of modification of that k th assignment k A acceptable to make in producing a (k+1) st such assignment (k+1) A.
- the processor 101 modifies the k th assignment k A to generate a prospective (k+1) st such assignment (k+1) A, for example, such as described above with regard to exchanging associations of two screen regions 201 with their two entries 231 . If the prospective (k+1) st such assignment (k+1) A is better than the earlier k th assignment k A, the processor 101 repeats the process with the new (k+1) st such assignment (k+1) A, thus possibly generating a newer (k+2) nd such assignment (k+2) A, and so on.
- the processor 101 decreases the amount of modification to the k th assignment k A acceptable to make in producing a next such (k+1) st such assignment (k+1) A.
- the processor 101 halts the technique and considers the final assignment A acceptable.
- the UI in response to a command or request 113 from the user 112 changing the focus 201 a , the UI dynamically re-computes a new acceptable pseudorandom positioning assignment A. This has the effect that when the user 112 issues a command or request 113 causing the focus 201 a to be changed, the Mosaic dynamically rearranges the display in response to one or more possible triggering events, with the effect that videos may be moved into or out of the user's field of vision within the OSD.
- the one or more triggering events might include (a) an explicit request by the user for dynamic rearrangement, (b) selection of a new focused-upon entry by the user, (c) incoming new data to be incorporated by the UI for presentation, and the like, as well as combinations or conjunctions thereof.
- the user 112 indicates that the focus 201 a should be changed by an additional action, such as a button press, mouse click, or touch-pad tap.
- an additional action such as a button press, mouse click, or touch-pad tap.
- the Mosaic provides a more automated-like response to user action, while in the latter case, the Mosaic provides a more command-like response to user action.
- the rearrangement when performing dynamic rearrangement, is presented to the user 112 as a continuous process, with individual movie posters being presented as moving, for a fraction of a second, from a first screen region 201 to a second screen region 201 .
- the rearrangement may be presented to the user 112 as a process having at least some continuous elements, such as for example either (a) a single transform into a new assignment A, (b) a sequence of transforms, each being relatively smooth, but with time boundaries in between sequential elements, such as for example sliding individual rows and columns in a sequence, (c) a stochastic set of transforms, such as exchanging pairs of screen regions 201 , or replacing a first entry 231 to be removed with a second entry 231 to be inserted.
- a stochastic set of transforms such as exchanging pairs of screen regions 201 , or replacing a first entry 231 to be removed with a second entry 231 to be inserted.
- the Mosaic is presented with the focus 201 a highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for those entries 231 that are not focused-upon, and with relatively lesser highlighting or other emphasis for those entries 231 positioned relatively distant from the focus 201 a .
- the entry 231 at the focus 201 a might be given approximately the same brightness as other entries 231 in the same row, or immediately adjacent in the same column, but also given a distinctly-colored border.
- Entries 231 other than those at the focus 201 a , or near the focus 201 a might be given approximately half that brightness.
- highlighting or other emphasis is additionally applied in response to content distance, with the effect that information presented to the user 112 is added to the information ordinarily presented by the fact of screen distance.
- Entries 231 near the focus 201 a are given a degree of brightness (or other highlighting) in response to a measure of their content distance from the focus 201 a , with the effect that if, for example, there are only two entries 231 relatively close in content distance to the focus 201 a , only those two entries 231 will be highlighted to so indicate.
- the degree of highlighting assigned to entries 231 proceeds in a relatively few step reductions (such as for example, a first level for the focus 201 a itself, a second level for entries 231 having very close content distance to the focus 201 a , a third level for entries 231 having somewhat close content distance to the focus 201 a , and a fourth level for all other entries 231 ).
- the first level includes both highlighting and a distinctly-colored border
- the second level includes a degree of highlighting approximately equal to the focus 201 a
- the third level includes a degree of highlighting approximately half of the focus 201 a
- the fourth level includes relatively no highlighting.
- the degree of highlighting might be proportional to a Gaussian curve, with those entries 231 being a content distance X from the focus 201 a being assigned a degree of highlighting proportional to about exp ( ⁇ 1 ⁇ 2x 2 ), where exp ( ) is an exponential function.
- the UI presents the display screen 105 as a two-dimensional array of screen regions 201 (such as a movie poster for each 231 representing a video), with the property that the user 112 might scroll either horizontally or vertically within that two-dimensional array without missing any entries 231 . That is, all entries 231 presented in the Mosaic appear at least somewhere in each row and each column of the two-dimensional array. This has the effect of presenting a visual illusion that the two-dimensional array is infinite in extent, while actually it is the case that scrolling in any one direction (right, left, up, down) sufficiently will eventually return to the same presentation of cover art.
- the UI assures that each entry 231 appears at least once in each row and at least once in each column.
- the UI achieves this effect by first selecting an arrangement including an assignment A, as described above in the section titled “Pseudorandom Positioning,” with the additional requirement that the two-dimensional presentation of the assignment A is responsive to an offset procedure for rows other than the focus 201 a as described below.
- the assignment A is computed so as to place all entries 231 in the library in a single row including the focus 201 a , and to offset each other row as described below, but with the screen distance responsive to both the offset within the single row including the focus 201 a and the offset for each other row as described below.
- the UI notes the number N of entries 231 in the row including the focus 201 a .
- the UI staggers each succeeding row by the offset R, with the effect that each such row and each such column includes every entry 231 in the entire library at least once.
- This has the effect that the assignment A, when staggered at each row by the offset R, causes each entry 231 to be available for presentation in each row (by virtue of the assignment A including all such entries 231 ), and causes each entry 231 to be available for presentation in each column (by virtue of the offset R).
- the UI positions the focus 201 a , and its associated entry 231 , at the center of the display screen 105 , and positions all other entries 231 at their associated screen regions 201 relatively offset from the focus 201 a .
- the auxiliary information area 205 and the control zone 206 are placed to the immediate left of the focus 201 a .
- the auxiliary information area 205 or the control zone 206 be placed in any particular location.
- FIG. 3 shows a process flow diagram of a method including operation of a mosaic-like guided user interface for video selection and display.
- a method 300 is performed by the system 100 . Although the method 300 is described serially, the flow points and steps of the method 300 can be performed by separate elements in conjunction or in parallel, whether asynchronously or synchronously, in a pipelined manner, or otherwise. There is no particular requirement that the method 300 must be performed in the same order in which this description lists flow points or steps, except where explicitly so indicated.
- the system 100 is ready to display a portion of the database 221 on the display screen 105 .
- the system 100 selects a k th assignment k A of screen regions 201 for entries 231 , responsive to the measure of correlation between content distance and screen distance, and the offset R relatively prime to N, as described above.
- the system 100 selects at least one graphical form 201 b for each entry 231 .
- the system 100 determines the at least one graphical form 201 b in response to a set of data fields 232 associated with that entry 231 , possibly in combination or conjunction with other information.
- the system 100 might determine the at least one graphical form 201 b as follows:
- the graphical form 201 b includes a single iconic or representational graphic form by which a user might identify the entry or title in response to visual presentation thereof.
- the graphical form 201 b may include a plurality of such iconic or representational graphic forms, and the system 100 may (a) manipulate that plurality of graphic forms into a single combined graphical form 201 b for display, (b) select, in response to that plurality of graphic forms, a single combined graphical form 201 b for display, or (c) some combination or conjunction or reasonable generalization thereof, and the like.
- the system 100 presents the at least one graphical form 201 b associated with each entry 231 , and disposes those graphical forms 201 b in the k th assignment k A of screen regions 201 , with the effect that the system 100 presents those graphical forms 201 b associated with each entry 231 in a plurality of screen regions 201 .
- the set of screen regions 201 are disposed on the display screen 105 as a rectilinear tiled set of screen regions 201 , such as for example disjoint regions as one might find in a chessboard.
- the set of screen regions 201 take such a form.
- the “Mosaic” mode of operation may include other dispositions of individual screen regions 201 , such as for example (a) a hexagonal pattern of screen regions 201 disposed within the display screen 105 , (b) a spiral pattern of screen regions 201 disposed within the display screen 105 , (c) a perspective view having the effect of representing a multidimensional pattern of screen regions 201 , such as for example a three-dimensional lattice, disposed within the display screen 105 , (d) a distribution of screen regions 201 representing a set of clusters of entries 231 , (e) a pseudorandom or random distribution of screen regions 201 disposed within the display screen 105 , reasonable generalizations thereof, and the like.
- the system 100 presents auxiliary information in the auxiliary information area 205 about the focused-upon entry 231 located at the focus 201 a of the k th assignment k A of screen regions 201 .
- the system 100 obtains the auxiliary information from the data fields 232 associated with focused-upon entry 231 in the database 221 .
- the system 100 determines what emphasis (such as for example highlighting) to be applied to the focus 201 a , the auxiliary information area 205 , and other screen regions 201 , in response to the content distance and screen distance, computed as described above.
- emphasis such as for example highlighting
- the system 100 renders the graphical forms 201 b and the auxiliary information area 205 in their allocated screen regions 201 , and renders any other presentation elements to be shown on the display screen 105 , such as for example (a) scroll affordances 202 a or scroll bars 202 b , (b) pointing elements 203 , (c) iconic or symbolic elements 204 , (d) pictures, (e) text, (f) dividing lines between the screen regions 201 , (g) touch-panel buttons 211 or other heads-up display elements, (h) status indicators about the system 100 drawn from outside the database 221 , and the like. As part of this step, the system 100 renders any transitions from earlier presentation states, such as fade-in/fade-out, and the like.
- the system 100 has displayed a portion of the database 221 on the display screen 105 , and is ready to receive commands or requests 113 from the user 112 .
- the system 100 has displayed a portion of the database 221 on the display screen 105 , and is ready to receive commands or requests 113 from the user 112 .
- the system 100 receives a sequence of commands or requests 113 from the user 112 .
- the user 112 enters these commands or requests 113 from the at least one input element 103 in the form of button presses, such as for example from the television infrared remote control 103 a or touch-panel control 103 b , where the button presses might indicate (a) directions such as right, left, up, down, (b) selection or de-selection, or (c) alphanumeric entry of letters or numbers.
- the user 112 may enter these commands or requests 113 from the at least one input element 103 in the form of keyboarding, mouse clicks and double-clicks, possibly in combination or conjunction with mouse movement, such as for example as might be used in entering commands or requests 113 for an ordinary PC programming environment.
- the user 112 may enter these commands or requests 113 from the at least one input element 103 in the form of voice commands or other biometric input techniques.
- the system 100 parses or recognizes those commands or requests 113 received from the user 112 .
- Those commands or requests 113 might direct assistant to perform actions such as described above with regard to FIG. 1 and FIG. 2 .
- the system 100 determines one or more responses 114 to make to those commands or requests 113 received from the user 112 . As part of this step, the system 100 directs the at least one output element 104 (including the display screen 105 ) to make those responses 114 , in such manner that the user 112 might readily understand those responses 114 .
- the system 100 has received and responded to a command or request 113 from the user 112 , and is ready to continue with the flow point 320 to do so again.
- the system 100 performs the steps described in association with the flow point 310 .
- the system 100 has received and responded to a command or request 113 from the user 112 , and is ready to continue with the flow point 320 to do so again.
- the system 100 dynamically re-computes a new acceptable pseudorandom positioning assignment A. This has the effect that when the user 112 issues a command or request 113 causing the focus 201 a to be changed, the Mosaic dynamically rearranges the display in response to one or more possible triggering events, with the effect that videos may be moved into or out of the user's field of vision within the display screen 105 .
- the system 100 causes each row in a two-dimensional array of screen regions 201 to include all possible entries 231 and to be offset from each other such row by an offset R relatively prime to the number N of entries 231 in the library, with the effect of similarly causing each column in that two-dimensional array of screen regions 201 to include all possible entries 231 and to be offset from each other such column by a relatively prime number.
- This has the effect that scrolling or paging along either a row or column will eventually bring the user 112 to a graphical form 201 b for each possible entry 231 in the database 221 .
- the system 100 presents the focus 201 a highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for those entries 231 that are not focused-upon, and with relatively lesser highlighting or other emphasis for those entries 231 having relatively larger content distance from the focus 201 a.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A UI involving selection and display from a library of videos, including a “Mosaic” mode of operation, in which a primarily visual display is made of information about possible videos, with the effect that a user might select one such video in response to such visual display. The Mosaic includes an two-dimensional array of entries, each of which has visual information for that entry. The Mosaic collects relatively similar entries near to each other in the visual field seen by a user. The focus is centralized and emphasized, and has auxiliary information displayed for further understanding. The array is dynamically rearranged in response to change in focus and metadata about the entries. Relative weighting of that metadata is responsive to user choice. The array includes rows and columns each of which includes all possible entries, but offset by relatively prime values.
Description
- 1. Field of the Invention
- The invention relates to user interfaces for video selection and display.
- 2. Related Art
- In systems for presenting information, such as for example audiovisual media, there are now so many possible choices that individuals find it difficult to remember them all. Accordingly, such systems generally involve a UI (user interface) by which users might search for possible choices, with the effect that those users are able to select one or more choices for presentation. However, while they achieve the general goal of allowing users to search and select, known systems are subject to several drawbacks.
- First, there are often such a large number of entries or titles that presenting even a small fraction of them for review by users, such as on an OSD (on screen display), or a video screen or similar interface, is unwieldy. Moreover, the large number of entries or titles makes it difficult for the user to make meaningful comparisons among multiple titles, either using a single data field for categorization, or using a plurality of data fields for categorization. In the latter case, the number of possible data fields and the fuzziness of the concept of similarity among entries or titles makes the task extremely problematic for users.
- Some known systems allow users to sort lists of entries, but one result of such sorting is that the user is presented with a linear list of entries or titles, disposed in a fashion that is often difficult on the eye and relatively unhelpful for selection of an individual entry or title. This is a relatively greater drawback when many entries or titles have data fields that might be categorized into multiple groups. For example, many videos might be characterized as both “comedy” and “western,” or as both “action-adventure” and “mystery,” and the like. Some known systems allow users to search or sort entries by such categories, but the user's ability to locate entries with similar categories can be relatively limited, depending on the degree of sorting allowed and the number of sort keys allowed per entry.
- This has the effect that only the most sophisticated users, those who are already very familiar with the corpus of possible entries or titles, can make meaningful use of combining database search techniques and linear presentation of information. There are several aspects of the invention in which this problem is ameliorated: (1) a relatively large corpus of information is sorted in such manner as to centralize and emphasize a set of similar entries or titles, possibly when considered along a plurality of data fields, (2) the user is presented with a focused-upon entry or title, with the option for causing the system to dynamically reorder those entries or titles in the corpus of information in response to the focused-upon entry or title, (3) those entries or titles having relatively greater similarity to the focused-upon entry or title are centralized and emphasized, with the effect that the user can easily and readily locate at least some entries or titles of interest, and (4) the user is presented with the ability to scroll through the presented mosaic of entries or titles, with the effect that the user is not restricted to a subset of the corpus of entries or titles when viewing the mosaic.
- Accordingly, it would be advantageous to provide an improved user interface for video selection and display.
- The invention provides a method and system capable of presenting a UI (user interface) involving selection and display of videos from a library thereof, although of course the concepts of the invention are not limited to videos. The UI includes a “Mosaic” mode of operation, in which a primarily visual display is made of information about possible videos, with the effect that a user might select one such video in response to such visual display.
- 1. Graphical Representation of Entries
- Entries from the library (preferably, a relatively large corpus of information) are presented in a graphical format, with entries each displayed including at least one graphical form sufficient for the user to recognize that entry, and preferably representative of at least one data field associated with that entry. For example, not intended to be limiting in any way, for displaying information for a library of videos, each entry might be displayed using its lobby poster (also known in the movie industry as a “one sheet”), possibly along with additional text such as a caption. However, in alternative embodiments, the graphical form sufficient for the user to recognize that entry might be dynamically generated, in response to data fields associated with that entry, in response to other information, or in response to some combination or conjunction thereof.
- In one embodiment, the Mosaic is organized as a multidimensional display of entries, each of which has visual information relating to that entry. For example, not intended to be limiting in any way, the Mosaic is organized as a two-dimensional array of movie posters, each representative of one entry in the library. This two-dimensional array preferably includes auxiliary information disposed near a focused-upon entry, as described below.
- The focused-upon entry is relatively centralized and emphasized, and might have auxiliary information about that specific entry displayed for further user understanding. For example, not intended to be limiting in any way, additional information about a video might be displayed in a screen region near the lobby poster for that video, such as to the right or left of that lobby poster, and might include auxiliary information about the video such as its title, maturity rating, quality rating, genre, actors, and year of publication. Additional such information, such as for example director, language, a summary description of the movie, a more detailed description or set of reviews of the movie, and the like, might be presented in response to a user request. For example, not intended to be limiting in any way, auxiliary information about the movie might be presented, possibly in conjunction with enlarging or otherwise emphasizing the screen region associated with that auxiliary information, in response to the user pointing to, clicking on, mousing over, or otherwise selecting, the focused-upon entry or its auxiliary information.
- In one embodiment, the Mosaic is presented with the focused-upon entry highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for those entries that are not focused-upon, and with relatively lesser highlighting or other emphasis for those entries positioned relatively distant from the focused-upon entry.
- 2. Entry Positioning and Distances
- In one aspect of the invention, the UI presents visual representations of relatively similar entries relatively near to each other, with the effect that those entries or titles having relatively greater similarity to the focused-upon entry or title are presented near the focused-upon entry or title, and might have their similarity otherwise emphasized as well. This has the effect that, if the user is interested in the focused-upon entry or title, the user can also easily and readily locate at least some entries or titles of with possible similar interest.
- In one embodiment, pairs of individual entries are compared, and a measure of content distance (responsive to information about those entries, such as for example information about their content) is determined. Individual entries are displayed in a format in which display distance within the OSD is correlated with content distance. This has the effect that similar videos are displayed in relative proximity within the OSD.
- In one embodiment, content distance (that is, the degree to which the system regards distinct videos as similar or dissimilar) is responsive to metadata about those videos. For example, not intended to be limiting in any way, such metadata might include keywords in the title of the video, a genre assigned to the video (such as for example “comedy” or “western,” a set of actors or characters involved with the video, a series into which the video is classified (that is, “Star Wars” or “Jackie Chan Movies”), a director or producer or studio associated with the video, a year in which the video was made or remade, a rating assigned to the video (such as for example, TV-Y, G, PG, or R, or some other selected set of ratings), a set of awards associated with the video (such as for example “best cartoon” or “best foreign film”), and the like.
- In one embodiment, aspects of the cover art (herein sometimes referred to as “movie posters”) might also be compared, such as for example whether that cover art is abstract or shows a scene, whether that cover art shows a selected actor, whether that cover art is primarily pictorial or text, and the collection of brightness, hue, and saturation associated with that cover art (with the effect, for example, of differentiating between the cover of a box of “Tide” and a work from Picasso's Blue Period).
- In one embodiment, relative weighting assigned to each data field of metadata is responsive to user choice, where that user choice might be expressed (a) relatively directly, such as for example by selecting a relative weighting value, (b) relatively indirectly, such as for example by the system deducing the user's preferred relative weighting value in response to those videos actually selected for viewing or as the next video for focus, or (c) in response to demographic information about the user, possibly in combination or conjunction with collaborative filtering information.
- 3. Dynamic Repositioning
- In one embodiment, selection of actual placement is random or pseudo-random, preferably in response to both metadata information and random or pseudo-random information, and dynamically determined, preferably in response to both a content distance from a focused-upon entry and random or pseudorandom information. This has the effect that when the user changes focus, the Mosaic dynamically rearranges the display in response to one or more possible triggering events, with the effect that videos may be moved into or out of the user's field of vision within the OSD. In one embodiment, the one or more triggering events might include (a) an explicit request by the user for dynamic rearrangement, (b) selection of a new focused-upon entry by the user, (c) incoming new data to be incorporated by the UI for presentation, and the like, as well as combinations or conjunctions thereof.
- In one embodiment, when performing dynamic rearrangement, the rearrangement is presented to the user as a continuous process, with individual movie posters being presented as moving, for a fraction of a second, from a first to a second position. In alternative embodiments, the rearrangement may be presented to the user as a process having at least some continuous elements, such as for example either (a) a single transform into a new rearrangement, (b) a sequence of transforms, each being relatively smooth, but with time boundaries in between sequential elements, such as for example sliding individual rows and columns in a sequence, (c) a stochastic set of transforms, such as exchanging pairs of videos, or replacing video to be removed with a video to be inserted. For one example, not intended to be limiting in any way, it is possible that that same entries will be presented after dynamic rearrangement, but in completely different locations.
- 4. Scrolling and Paging
- In one embodiment, the selected movie posters are arranged with the effect of tiling the screen area of the OSD, with the effect that a relatively maximum number of movie posters are displayed within that limited screen area. However, in alternative embodiments, it might occur that the selected movie posters are arranged in an overlapped manner (thus possibly having the effect of displaying more movie posters, but not necessarily all of their content simultaneously), or with spacing in between, with the effect of presenting the user with a preferred pleasing arrangement.
- In one embodiment, the Mosaic is presented as a two-dimensional array of picture elements (such as a movie poster for each video), with the property that a user might scroll either horizontally or vertically within the two-dimensional array without missing any entries. That is, all entries presented in the Mosaic appear at least somewhere in each row and each column of the two-dimensional array. This has the effect of presenting a visual illusion that the two-dimensional array of images is infinite in extent, while actually it is the case that scrolling in any one direction (right, left, up, down) sufficiently will eventually return to the same presentation of cover art. Those skilled in the art will recognize, after perusal of this application, that this has the effect of presenting the user with a relatively small rectangular window view onto the surface of a torus, but that in the context of the invention there is no requirement that the surface be a torus, and instead might be a sphere or some other shape.
-
FIG. 1 shows a block diagram of a system including a mosaic-like user interface for video selection and display. -
FIG. 2 shows a block diagram of an on-screen display including operation of a mosaic-like guided user interface for video selection and display. -
FIG. 3 shows a process flow diagram of a method including operation of a mosaic-like guided user interface for video selection and display. - This application claims priority of the following documents, each of which is hereby incorporated by reference as if fully set forth herein.
-
- U.S. provisional patent application 60/394,922, filed Jul. 9, 2002, in the name of Michael Malcolm, Stephen Watson, and Daniel Collens, attorney docket number 217.1002.01, titled “System Architecture of a System for Secure Distribution of Media.”
- U.S. provisional patent application 60/394,588, filed Jul. 9, 2002, in the name of Michael Malcolm, Stephen Watson, and Daniel Collens, attorney docket number 217.1003.01, titled “Topology of Caching Nodes in a System for Secure Delivery of Media Content.”
- U.S. provisional patent application 60/439,330, filed Jan. 31, 2003, in the name of the same inventors as this application, attorney docket number 217.1014.01, titled “User Interface for Video Selection and Display.”
- U.S. patent application Ser. No. 10/418,949, filed this same day, in the name of the same inventors as this application, attorney docket number 217.1017.01, titled “Guide-Like User Interface for Video Selection and Display.”
- U.S. patent application Ser. No. 10/418,739, filed Apr. 18, 2003, in the name of Shawn Neely, Lawrence Kesteloot, Margaret Novotny, Marion Buchenau, Sheila Foley, and Michael O'Neil, attorney docket number 217.1018.01, titled “Mosaic-Like User Interface for Video Selection and Display.”
- These documents are hereby incorporated by reference as if fully set forth herein, and are sometimes referred to herein as the “incorporated disclosure.”
- Inventions described herein can be used in combination or conjunction with technology described in the incorporated disclosure.
- In the description herein, a preferred embodiment of the invention is described, including preferred process steps and data structures. Those skilled in the art would realize, after perusal of this application, that embodiments of the invention might be implemented using a variety of other techniques not specifically described, without undue experimentation or further invention, and that such other techniques would be within the scope and spirit of the invention.
- Lexicography
- The general meaning of each of these following terms is intended to be illustrative and in no way limiting.
-
- The phrase “media stream” describes information intended for presentation in a sequence, such as motion pictures including a sequence of frames or fields, or such as audio including a sequence of sounds. As used herein, the phrase “media stream” has a broader meaning than the standard meaning for “streaming media,” (of sound and pictures that are transmitted continuously using packets and that start to play before all of the content arrives). Rather, as described herein, there is no particular requirement that “media streams” must be delivered continuously. Also as described herein, media streams can refer to other information for presentation, such as for example animation or sound, as well as to still media, such as for example pictures or illustrations, and also to databases and other collections of information.
- The phrase “digital content” describes data in a digital format, intended to represent media streams or other information for presentation to an end viewer. “Digital content” is distinguished from packaging information, such as for example message header information. For the two phrases “digital content” and “media stream,” the former describes a selected encoding of the latter, while the latter describes a result of presenting any encoding thereof.
- The scope and spirit of the invention is not limited to any of these definitions, or to specific examples mentioned therein, but is intended to include the most general concepts embodied by these and other terms.
- System Elements
-
FIG. 1 shows a block diagram of a system including a mosaic-like user interface for video selection and display. - A
system 100 includes aprocessor 101, program and data memory ormass storage 102, at least oneinput element 103, and at least one output element 104. - Those of ordinary skill in the art will recognize, after perusal of this application, that each of these elements in a
system 100 might be implemented in one of a variety of possible ways. -
- For example, not intended to be limiting in any way, the
processor 101 and the program and data memory ormass storage 102 might include one or more of the following devices, possibly operating in combination of conjunction: (a) preferably, a stand-alone computing device, such as a set-top box or other auxiliary presentation and display decoder, capable of generalized computation and presentation of information; (b) a PC (personal computer), laptop, workstation, or other device suitable for generalized computation and presentation of information; (c) a handheld computer, “Palm Pilot” device, or other portable device suitable for generalized computation and presentation of information; or (d) any other type of computing device suitable for generalized computation and presentation of information. - For example, not intended to be limiting in any way, the at least one
input element 103 might include one or more of the following devices, possibly operating in combination of conjunction: (a) preferably, a remote control, such as a television infraredremote control 103 a or a touch-panel control 103 b or other type of remote control, (b) a workstation input element 103 c, such as for example a keyboard along with a mouse or other pointing device, (c) or other data entry elements, such as for example a speech input or speech recognition device. - For example, not intended to be limiting in any way, the at least one output element 104 might include one or more of the following devices, possibly operating in combination of conjunction: (a) preferably, a flat panel display or computer monitor or television monitor or
other display device 104 a, along with speakers or other sound presentation devices, (b) another type of television device, such as a projection television device; (c) a projector 104 b along with a projection screen or other projection surface; or (d) any other type of device or method suitable for presentation of information. In such cases, the active portion of the video display for the television or other display device is herein sometimes referred to as thedisplay screen 105, and the speakers or other sound presentation devices are herein sometimes referred to as the speaker 106.
- For example, not intended to be limiting in any way, the
- Those skilled in the art will recognize, after perusal of this application, that embodiments involving set-top boxes or other auxiliary presentation and display decoders, operating in combination or conjunction with
remote controls 103 a or touch-panel controls 103 b, might be combined in part with embodiments involving PCs, laptops, or workstations, operating in combination or conjunction with workstation input elements 103 c such as keyboards and mice. Moreover, those skilled in the art will recognize, after perusal of this application, that such combinations are within the scope and spirit of the invention, and would be workable without undue experimentation or further invention. - In one embodiment, the
system 100 is coupled to at least one communication element 110 capable of sending and receiving information from a logicallyremote device 111, such as for example a computer network coupled to an internet, intranet, LAN, WAN, VPN, or an enterprise network. In one embodiment, the logicallyremote device 111 might include one or more computing devices capable of receiving requests from auser 112 of thesystem 100 and responding to those requests by providing information related to use of thesystem 100. For example, not intended to be limiting in any way, the information might include (a) media streams, such as for example movies; or might include (b) metadata (such as for example titles, ratings, and the like, as some examples are further described herein) about those media streams. - Those skilled in the art would recognize, after perusal of this application, that the communication element 110 could be used in combination or conjunction with the incorporated disclosure, including techniques shown in the provisional patent applications titled “SYSTEM ARCHITECTURE OF A SYSTEM FOR SECURE DISTRIBUTION OF MEDIA” and “TOPOLOGY OF CACHING NODES IN A SYSTEM FOR SECURE DELIVERY OF MEDIA CONTENT.”
- The memory or
mass storage 102 is capable of including instructions capable of being executed or interpreted by theprocessor 101 to perform steps as described herein. The memory ormass storage 102 is also capable of maintaining data on behalf of theprocessor 101 as described herein. - The
system 100, using the at least oneinput element 103, is disposed for receiving information from theuser 112, such as for example an individual who desires to select a movie for viewing, and using the at least one output element 104, is disposed for presenting information to theuser 112. However, in the context of the invention, there is no particular requirement that theuser 112 is so limited. Theuser 112 might include an individual, a company or family or other group, or another entity. In one embodiment, where theuser 112 includes a company or family or other group, theuser 112 might include more than one person who interacts with thesystem 100 from time to time. - Moreover, in the context of the invention, there is no particular requirement that the same information is received from each
input element 103 or that the same information is presented at each output element 104. In one embodiment, the one ormore input elements 103 and the one or more output elements 104 are coupled to theprocessor 101 and the memory ormass storage 102 using a local network, such as for example a LAN, VPN, or enterprise network. - The
system 100, using theprocessor 101 and program and data memory ormass storage 102, is disposed for processing information from theuser 112, such as (a) receiving commands orrequests 113 from theuser 112, (b) parsing or recognizing those commands orrequests 113, (c) determining one ormore responses 114 to make to those commands orrequests 113, and (d) directing the at least one output element 104 to present thoseresponses 114 to theuser 112. - The
system 100, using the at least one output element 104, is disposed for presenting information to theuser 112. - On-Screen Display
-
FIG. 2 shows a block diagram of an on-screen display including operation of a mosaic-like guided user interface for video selection and display. - Screen Display
- Those skilled in the art will recognize that the input element 103 (such as for example the remote control) and the
display screen 105 operate in combination or conjunction, under control of theprocessor 101 and the program and data memory ormass storage 102, to present a UI (user interface) as described herein. - The UI includes at least some elements to be presented on the
display screen 105, including possibly a set of screen regions 201 (possibly disjoint or possibly overlapping), a set ofscroll affordances 202 a orscroll bars 202 b (possibly horizontal or possibly vertical), one or more highlighting features or pointingelements 203, one or more iconic or symbolic elements 204, one or more pictures (possibly still pictures, animation, or motion video), one or more units of text (possibly presented in one or more fonts), and the like. - The UI also includes at least some elements to be received from the user 112 (possibly presented on the
display screen 105 or on the touch-panel control 103 b), such as a set of buttons 211, possibly pre-selected and fixed in function, or possibly selected in response to user preferences or other input and alterable in function from time to time. For example, not intended to be limiting in any way, an arrangement of buttons 211 might be shown (a) directly on theremote control 103 a, and selected by theuser 112 by pressing one of the physical buttons 211; (b) directly on the touch-panel control 103 b, and selected by theuser 112 by pressing one of the areas designated on that touch-panel control 103 b as one of the buttons 211; or (c) directly on thedisplay screen 105 in a selectedscreen region 201, and selected by theuser 112 by selecting the button 211 using the pointing device or keyboard. - As described herein, references to the UI “interpreting” input, “presenting” output, or “reacting to” input, describe operations by the
processor 101 and the program and data memory ormass storage 102, as described above, to (a) receive commands orrequests 113 from theuser 112, (b) parse or recognize those commands orrequests 113, (c) determine one ormore responses 114 to make to those commands orrequests 113, and (d) direct the at least one output element 104 to present thoseresponses 114 to theuser 112. - For example, in one embodiment, the
processor 101 and the program and data memory ormass storage 102, might be responsive to (a) receive inputs from theuser 112, and respond to those inputs by moving a position of thepointing element 203, (b) respond to a relative position of thatpointing element 203 with regard to one of thescreen regions 201, and respond by highlighting or de-highlighting selectedscreen regions 201, (c) respond to a relative position of thatpointing element 203 with regard to one of the scroll affordances 202 a orscroll bars 202 b, and respond by scrolling or paging one or more of thescreen regions 201, (d) respond to a relative position of thatpointing element 203 with regard to one of the iconic or symbolic elements 204, and respond by invoking or de-invoking an selected function associated with that one iconic or symbolic element 204, (e) as well as reasonable generalizations thereof, and the like. - Database Presentation
- The one embodiment, the
display screen 105 is partitioned into a rectilinear tiled set ofscreen regions 201, such as for example disjoint regions as one might find in a chessboard, although in the context of the invention, there is no particular requirement that eachsuch screen region 201 need be the same height or width. As described herein the rectilinear tiled set ofscreen regions 201 comprise a set of rows 211 and a set of columns 212, each such row 211 and column 212 intersecting in a single substantially disjointsuch screen regions 201. - In alternative embodiments, the “Mosaic” mode of operation may include other dispositions of
individual screen regions 201, such as for example (a) a hexagonal pattern ofscreen regions 201 disposed within thedisplay screen 105, (b) a spiral pattern ofscreen regions 201 disposed within thedisplay screen 105, (c) a perspective view having the effect of representing a multidimensional pattern ofscreen regions 201, such as for example a three-dimensional lattice, disposed within thedisplay screen 105, (d) a distribution ofscreen regions 201 representing a set of clusters ofentries 231, (e) a pseudorandom or random distribution ofscreen regions 201 disposed within thedisplay screen 105, reasonable generalizations thereof, and the like. - In alternative embodiments, the “Mosaic” mode of operation may include
individual screen regions 201 having different sizes fordistinct entries 231. For a first example, not intended to be limiting in any way, in a perspective view having the effect of representing a three-dimensional pattern ofscreen regions 201, the UI might present selectedscreen regions 201 as relatively larger or relatively smaller, with the effect of representing distance in a three-dimensional viewing illusion presented to theuser 112. For second example, not intended to be limiting in any way, the UI might present selectedscreen regions 201 as relatively larger or relatively smaller, with the effect of representing relative importance within a cluster ofentries 231 presented to theuser 112. - In one embodiment, the “Mosaic” mode of operation is performed in association with a
database 221. In one embodiment, thedatabase 221 is available to theprocessor 101 at the program anddata memory 102, but in the context of the invention, there is no particular requirement where thedatabase 221 is specifically located. For example, thedatabase 221 might be located (a) at a remote deviceavailable processor 100 using thecommunication device 111, (b) at anauxiliary processor 101 b coupled to theprocessor 101 or the program anddata memory 102, or (c) on a computer-readable medium 222 coupled to areader 223 thereof, to theprocessor 101 or the program anddata memory 102, or to any other element of thesystem 100. - The
database 221 preferably includes information involving a library or set of videos, such as for example movies that might be selected for presentation, and presented, to theuser 112. However, in the context of the invention, there is no particular requirement that thedatabase 221 is limited to videos, or even to information that might be presented to theuser 112. For one example, not intended to be limiting in any way, the invention could be used to represent advertisements, animation, audio titles, books or other textual works, computer programs in source or object code form, encyclopedia entries, magazines or articles therefrom, microfiche images, people (real or fictional), still pictures, or more generally, database entries of any kind. Moreover, in the context of the invention, there is no particular requirement that thedatabase 221 is the sole source of information to be presented to theuser 112. For one example, not intended to be limiting in any way, the invention could be used in combination or conjunction with other techniques for presenting or representing information, such as in any of the following possibilities: a plurality ofsuch databases 221, a hierarchical representation of data, a hyperlinked representation of data (such as for example a web page), a dynamically generated representation of data (such as for example by an applet), or some combination or mixture thereof. - In one embodiment, the
database 221 includes oneentry 231 for each such video, and a set ofdata fields 232, with the property that for eachsuch entry 231, at least some of thosedata fields 232 have information relating to thatentry 231, and with the property that the information in eachdata field 232 for afirst entry 231 bears the same relation to thatfirst entry 231 as the information in thatdata field 232 for asecond entry 231. For one example, not intended to be limiting in any way, if adata field 232 is selected to represent the title of anentry 231, for eachentry 231 for which thatdata field 232 has any information, that information represents the title of thatentry 231. - In one embodiment, the
database 221 includes a plurality ofsuch entries 231, and a plurality ofsuch data fields 232, with the effect that anindividual entry 231 might (or might not) have the same information as another such entry for arelated data field 232. For one example, not intended to be limiting in any way, more than oneentry 231, each representing a distinct video, might each have adata field 232 representing the genre of that video (such as for example a “comedy” or a “western”), and more than onesuch entry 231 might have the same information for thatdata field 232, such as for example if both such videos were comedies. - The
database 221 might includemultiple data values 222 for one or moresuch data fields 232 for anentry 231, such as for example a single video might be associated with multiple actors or multiple genres. - In one embodiment, a selected
screen region 201 a (herein sometimes called the “focus” 201 a) within thedisplay screen 105 is reserved for a focused-uponentry 231, such as for example a video recently selected by theuser 112 as the focused-uponentry 231. The UI presents, at thefocus 201 a, at least one graphical form 201 b, such as a lobby poster, from which theuser 112 can readily identify the focused-uponentry 231. (In alternative embodiment, the UI may present, at thefocus 201 a, more than one such graphical form 201 b, such as for example both a lobby poster and selected stills from the movie associated with the focused-uponentry 231, or such as for example an animated or clickable slideshow associated with the focused-uponentry 231.) The UI might also present, adjacent or otherwise near to thefocus 201 a, additional information, such as for example acaption 201 c. In one embodiment, thecaption 201 c might include (a) a title, (b) a color bar representing a category or genre associated with the movie, (c) a thermometer indicator representing a value associated with the movie, such as for example a maturity rating or quality rating, reasonable generalizations thereof, and the like. - The
focus 201 a has associated with it anauxiliary information area 205, in which the UI presents auxiliary information about the focused-uponentry 231. In one embodiment, theauxiliary information area 205 includes textual or other detailed information about the focused-uponentry 231, such as for example its (a) title, (b) maturity rating, (c) quality rating, (d) genre, (e) actors, (f) year of publication, (g) director, (h) language, (i) a summary description of the movie, (j) a more detailed description or set of reviews of the movie, and the like, to the extent that such information can be conveniently presented within theauxiliary information area 205. - The
auxiliary information area 205 has associated with it acontrol zone 206, in which the UI might receive commands andrequests 113 from theuser 112, such as for example to (a) select information to display about the focused-uponentry 231, (b) scroll or page the information being displayed within theauxiliary information area 205, (c) receive text or other selected information with which to search thedatabase 221, reasonable generalizations thereof, and the like. Thecontrol zone 206 might include onemore icons 208, each associated with a possible command orrequests 113 from theuser 112, and each associated with a function (or a selected set of functions) that the UI might perform in response to such a command or request 113 from theuser 112. - Content Distance
- In response to information from the
database 221, includingindividual data fields 232 associated with eachentry 231 in thedatabase 221, theprocessor 101 computes an arrangement ofentries 231. The arrangement ofentries 231 has the property that a measure of distance between entries 231 (herein sometimes called “content distance”) and a measure of distance betweenscreen regions 201 associated with thoseentries 231 are maximally correlated over the entire arrangement ofentries 231. - In one embodiment, the
processor 101 pre-computes a content distance value for each pair ofentries 231, in response to information associated with thoseentries 231 by thedatabase 221. However, in alternative embodiments, theprocessor 101 might compute the content distance value for at least some pairs ofentries 231 dynamically, in response to information associated with thoseentries 231 by thedatabase 221, and possibly in response to other information obtained dynamically, such as from thecommunication link 111 or from theuser 112. - More specifically, in one embodiment, the
processor 101 examines the data fields 232 associated with eachsuch entry 231 in thedatabase 221, and computes an individual distance value associated with eachsuch data field 232. Theprocessor 101 combines these individual distance values associated with eachsuch data field 232 to determine a content distance value associated with each pair ofentries 231. Individual distance values might be continuous or discrete values, such as for example (for a continuous value) a measure of similarity of titles, a measure of difference value between year of publication, or a measure of difference in number of awards won by each movie, or (for a discrete value) whether the director or producer or studio associated with the video is the same, whether the genre or maturity rating is the same for both movies, whether both movies are classified in the same series (such as for example “Star Wars” or “Jackie Chan Movies”), or how many actors are common to both movies. - In alternative embodiments, the
processor 101 may examine information associated with the movies themselves. For a first example theprocessor 101 might compare the movie posters for bothentries 231, such as for example whether that cover art is abstract or shows a scene, whether that cover are shows a selected actor, whether that cover art is primarily pictorial or text, and the collection of brightness, hue, and saturation associated with that cover art (with the effect, for example, of differentiating between the cover of a box of “Tide” and a work from Picasso's Blue Period). For a second example, theprocessor 101 might compare selected frames or scenes or aspects of the movies themselves, such as for example whether the movies are generally bright or dark, show scenes that are indoors or outdoors, show fast motion or talking, or show animated or cartoon characters. - In one embodiment, relative weighting assigned to each data field of metadata is responsive to user choice, where that user choice might be expressed (a) relatively directly, such as for example by selecting a relative weighting value, (b) relatively indirectly, such as for example by the system deducing the user's preferred relative weighting value in response to those videos actually selected for viewing or as the next video for focus, or (c) in response to demographic information about the user, possibly in combination or conjunction with collaborative filtering information.
- Screen Distance
- In response to their selected positions for disposition on the
display screen 105, theprocessor 101 computes a screen distance value for each pair ofpossible screen regions 201 that might be associated withentries 231. As described below, the set ofscreen regions 201 might exceed the actual size of thedisplay screen 105, so that the set ofpossible screen regions 201 might significantly exceed the number ofscreen regions 201 that fit on thedisplay screen 105. - In one embodiment, the
processor 101 pre-computes the screen distance for each pair ofpossible screen regions 201, in response to their relative positions as they might be presented on thedisplay screen 105. However, in alternative embodiments, theprocessor 101 might compute the screen distance value for at least some pairs ofscreen regions 201 dynamically, in response to information associated with the disposition of thosescreen regions 201 in response toentries 231 from thedatabase 221, and possibly in response to other information obtained dynamically, such as from thecommunication link 111 or from theuser 112. However, in an embodiment in which screenregions 201 are tiled, there is no particular requirement in the context of the invention for dynamic computation of the screen distance value. - In response to the set of associations between each
screen region 201 and theentry 231 to be presented in that screen region 201 (that is, as described below, in response to the association A), theprocessor 101 computes a correlation value indicating how good a match that association presents. This has the effect that a relatively higher correlation indicates that theentries 231 to be presented in eachscreen region 201 are relatively closer when thoseentries 231 are relatively similar, and that a relatively lower correlation indicates that theentries 231 to be presented in eachscreen region 201 are not as close as they could be when thoseentries 231 are relatively similar. - Pseudorandom Positioning
- In a pseudorandom or random manner, the
processor 101 assigns at least onescreen region 201 for eachentry 231 in thedatabase 221. (In alternative embodiments, theuser 112 may have available a command orrequest 113 to filter thedatabase 221, with the effect that this statement is true for the retainedentries 231 of the filtereddatabase 221.) This zeroth-order pseudorandom or random assignment oA has associated with it a correlation between content distance and screen distance, as determined with regard to the set of allscreen regions 201 and with regard to the set of allentries 231. In this notation, the symbol oA indicates the zeroth-order assignment. Thus, the zeroth-order assignment oA has associated with it a correlation indicating how well it placesentries 231 that are similar to each other inscreen regions 201 that are close to each other. - In one embodiment, the
processor 101 iteratively modifies the kth assignment kA ofscreen regions 201 forentries 231 in response to a pseudorandom or random input, to produce a (k+1)st such assignment (k+1)A, using a technique similar to simulated annealing. For example, not intended to be limiting in any way, theprocessor 101 might, in response to a pseudorandom or random input, exchange the association of twoscreen regions 201 with their twoentries 231, with the effect of altering the kth assignment kA ofscreen regions 201 forentries 231, and might make such alterations a number of times, with the effect of producing the (k+1)st such assignment (k+1)A. In alternative embodiments, theprocessor 101 may use other techniques to attempt to substantially optimize the assignment ofscreen regions 201 forentries 231. For example, not intended to be limiting in any way, theprocessor 101 may use a gradient descent technique, a neural network technique, a genetic algorithm or genetic programming technique, a random search technique, or other techniques known in the fields of artificial intelligence and machine learning. These techniques may also be used in combination or conjunction with simulated annealing. - To perform this technique, the
processor 101 determines a measure of quality of the kth assignment kA ofscreen regions 201 forentries 231, responsive to the measure of correlation between content distance and screen distance, as determined with regard to the set of allscreen regions 201 and with regard to the set of all entries 231 (and in response to any effects on screen distance responsive to operations described below in the section “Scrolling and Paging”). In response to this measure of quality, theprocessor 101 selects an amount of modification of that kth assignment kA acceptable to make in producing a (k+1)st such assignment (k+1)A. In response to the selected amount of modification, theprocessor 101, in a pseudorandom or random manner, modifies the kth assignment kA to generate a prospective (k+1)st such assignment (k+1)A, for example, such as described above with regard to exchanging associations of twoscreen regions 201 with their twoentries 231. If the prospective (k+1)st such assignment (k+1)A is better than the earlier kth assignment kA, theprocessor 101 repeats the process with the new (k+1)st such assignment (k+1)A, thus possibly generating a newer (k+2)nd such assignment (k+2)A, and so on. If the prospective (k+1)st assignment (k+1)A is not better than the earlier kth assignment kA, theprocessor 101 decreases the amount of modification to the kth assignment kA acceptable to make in producing a next such (k+1)st such assignment (k+1)A. When the amount of modification is less than a selected threshold, theprocessor 101 halts the technique and considers the final assignment A acceptable. - Dynamic Repositioning
- In one embodiment, in response to a command or request 113 from the
user 112 changing thefocus 201 a, the UI dynamically re-computes a new acceptable pseudorandom positioning assignment A. This has the effect that when theuser 112 issues a command orrequest 113 causing thefocus 201 a to be changed, the Mosaic dynamically rearranges the display in response to one or more possible triggering events, with the effect that videos may be moved into or out of the user's field of vision within the OSD. In one embodiment, the one or more triggering events might include (a) an explicit request by the user for dynamic rearrangement, (b) selection of a new focused-upon entry by the user, (c) incoming new data to be incorporated by the UI for presentation, and the like, as well as combinations or conjunctions thereof. - In one embodiment, the
user 112 indicates that thefocus 201 a should be changed by an additional action, such as a button press, mouse click, or touch-pad tap. However, in the context of the invention, there is no particular requirement that one of these specific additional actions is required. Those skilled in the art would recognize, after perusal of this application, that one or more of the following alternatives might be used to signal that thedisplay screen 105 should be dynamically repositioned, either in combination or conjunction: -
- For example, not intended to be limited in any way, the Mosaic might trigger dynamic repositioning in response to a timer. The timer might be triggered by one or more of the following: (a) the
user 112 does not change the selection of thefocus 201 a, that is, thefocus 201 a remains the same for a time duration consistent with the user desiring dynamic repositioning to occur; (b) theuser 112 does not move thepointer 203 away from thefocus 201 a, that is, thefocus 201 a is selected and the selection is “held” on thefocus 201 a for a time duration consistent with the user desiring dynamic repositioning to occur. - For example, not intended to be limited in any way, the Mosaic might trigger dynamic repositioning for any
new focus 201 a in response to challenge to theuser 112 and a response therefrom. For example, not intended to be limiting in any way, the challenge might include one or more of the following: (a) a question asked by the UI of theuser 112, determining a yes/no answer whether to trigger dynamic repositioning; (b) highlighting of thefocus 201 a and waiting for a response (or a non-response, as with the timer possibility indicated above).
- For example, not intended to be limited in any way, the Mosaic might trigger dynamic repositioning in response to a timer. The timer might be triggered by one or more of the following: (a) the
- Those skilled in the art would recognize, after perusal of this application, that in the former case, the Mosaic provides a more automated-like response to user action, while in the latter case, the Mosaic provides a more command-like response to user action.
- In one embodiment, when performing dynamic rearrangement, the rearrangement is presented to the
user 112 as a continuous process, with individual movie posters being presented as moving, for a fraction of a second, from afirst screen region 201 to asecond screen region 201. In alternative embodiments, the rearrangement may be presented to theuser 112 as a process having at least some continuous elements, such as for example either (a) a single transform into a new assignment A, (b) a sequence of transforms, each being relatively smooth, but with time boundaries in between sequential elements, such as for example sliding individual rows and columns in a sequence, (c) a stochastic set of transforms, such as exchanging pairs ofscreen regions 201, or replacing afirst entry 231 to be removed with asecond entry 231 to be inserted. For one example, not intended to be limiting in any way, it is possible that thatsame entries 231 will be presented after dynamic rearrangement into a new assignment A, but in different locations. - Entry Highlighting and Emphasis
- In one embodiment, the Mosaic is presented with the
focus 201 a highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for thoseentries 231 that are not focused-upon, and with relatively lesser highlighting or other emphasis for thoseentries 231 positioned relatively distant from thefocus 201 a. For example, not intended to be limiting in any way, theentry 231 at thefocus 201 a might be given approximately the same brightness asother entries 231 in the same row, or immediately adjacent in the same column, but also given a distinctly-colored border.Entries 231 other than those at thefocus 201 a, or near thefocus 201 a, might be given approximately half that brightness. - In one embodiment, highlighting or other emphasis is additionally applied in response to content distance, with the effect that information presented to the
user 112 is added to the information ordinarily presented by the fact of screen distance.Entries 231 near thefocus 201 a are given a degree of brightness (or other highlighting) in response to a measure of their content distance from thefocus 201 a, with the effect that if, for example, there are only twoentries 231 relatively close in content distance to thefocus 201 a, only those twoentries 231 will be highlighted to so indicate. - It has been found by the inventors that the following parameters present a UI pleasing to
most users 112, and that the degree to which the UI is pleasing tousers 112 is a surprising advantage, which would not have been obvious to those skilled in the art without perusal of this application. The degree of highlighting assigned toentries 231 proceeds in a relatively few step reductions (such as for example, a first level for thefocus 201 a itself, a second level forentries 231 having very close content distance to thefocus 201 a, a third level forentries 231 having somewhat close content distance to thefocus 201 a, and a fourth level for all other entries 231). In one embodiment, the first level includes both highlighting and a distinctly-colored border, the second level includes a degree of highlighting approximately equal to thefocus 201 a, the third level includes a degree of highlighting approximately half of thefocus 201 a, and the fourth level includes relatively no highlighting. In alternative embodiments, the degree of highlighting might be proportional to a Gaussian curve, with thoseentries 231 being a content distance X from thefocus 201 a being assigned a degree of highlighting proportional to about exp (−½x2), where exp ( ) is an exponential function. - Scrolling and Paging
- In one embodiment, the UI presents the
display screen 105 as a two-dimensional array of screen regions 201 (such as a movie poster for each 231 representing a video), with the property that theuser 112 might scroll either horizontally or vertically within that two-dimensional array without missing anyentries 231. That is, allentries 231 presented in the Mosaic appear at least somewhere in each row and each column of the two-dimensional array. This has the effect of presenting a visual illusion that the two-dimensional array is infinite in extent, while actually it is the case that scrolling in any one direction (right, left, up, down) sufficiently will eventually return to the same presentation of cover art. Those skilled in the art will recognize, after perusal of this application, that this has the effect of presenting the user with a relatively small rectangular window view onto the topological surface of a torus, but that in the context of the invention there is no requirement that the surface be a topological torus, and instead might be a topological sphere or some other shape. - In one embodiment, the UI assures that each
entry 231 appears at least once in each row and at least once in each column. The UI achieves this effect by first selecting an arrangement including an assignment A, as described above in the section titled “Pseudorandom Positioning,” with the additional requirement that the two-dimensional presentation of the assignment A is responsive to an offset procedure for rows other than thefocus 201 a as described below. Thus, the assignment A is computed so as to place allentries 231 in the library in a single row including thefocus 201 a, and to offset each other row as described below, but with the screen distance responsive to both the offset within the single row including thefocus 201 a and the offset for each other row as described below. - Thus, after selecting each kth assignment kA, the UI determines the offset R as described below, and determines a measure of quality of the kth assignment kA of
screen regions 201 forentries 231, responsive to the measure of correlation between content distance and screen distance, after taking into account the offset R and the number N ofentries 231 in the library. Those skilled in the art would understand, after perusal of this application, that the offset R might equally well be applied to columns instead of rows, or to another type of screen arrangement ofentries 231, and that such alternatives are within the scope and spirit of the invention, and would be workable without undue experimentation or further invention. - After obtaining such an assignment A, the UI notes the number N of
entries 231 in the row including thefocus 201 a. The UI then finds the first value R such that R>2 sqrt (N) and gcd (R, N)=1, where sqrt ( ) represents the square-root function and gcd ( ) represents the greatest-common-denominator function. That is, the UI searches integers upward from 2 sqrt (N) until it finds one that is relatively prime to N. At least one such value R will be located <4 sqrt (N), and there is a high likelihood that at least one such value R will be located <2 sqrt (N) In (2 sqrt (N)). In alternative embodiments, the UI may search integers both upward and downward from 2 sqrt (N), with the effect that the value R may be closer to 2 sqrt (N). - It has been found by the inventors that the
parameter 2 sqrt (N) presents a UI pleasing tomost users 112, and that the degree to which the UI is pleasing tousers 112 is a surprising advantage, which would not have been obvious to those skilled in the art without perusal of this application. - After obtaining the offset R, the UI staggers each succeeding row by the offset R, with the effect that each such row and each such column includes every
entry 231 in the entire library at least once. This has the effect that the assignment A, when staggered at each row by the offset R, causes eachentry 231 to be available for presentation in each row (by virtue of the assignment A including all such entries 231), and causes eachentry 231 to be available for presentation in each column (by virtue of the offset R). - Combining the assignment A and the offset R, the UI positions the
focus 201 a, and its associatedentry 231, at the center of thedisplay screen 105, and positions allother entries 231 at their associatedscreen regions 201 relatively offset from thefocus 201 a. In one embodiment, theauxiliary information area 205 and thecontrol zone 206 are placed to the immediate left of thefocus 201 a. However, in the context of the invention, there is no particular requirement that theauxiliary information area 205 or thecontrol zone 206 be placed in any particular location. - Method of Operation
-
FIG. 3 shows a process flow diagram of a method including operation of a mosaic-like guided user interface for video selection and display. - A
method 300 is performed by thesystem 100. Although themethod 300 is described serially, the flow points and steps of themethod 300 can be performed by separate elements in conjunction or in parallel, whether asynchronously or synchronously, in a pipelined manner, or otherwise. There is no particular requirement that themethod 300 must be performed in the same order in which this description lists flow points or steps, except where explicitly so indicated. - Screen Display
- At a
flow point 310, thesystem 100 is ready to display a portion of thedatabase 221 on thedisplay screen 105. - At a
step 311, thesystem 100 selects a kth assignment kA ofscreen regions 201 forentries 231, responsive to the measure of correlation between content distance and screen distance, and the offset R relatively prime to N, as described above. - At a
step 312, thesystem 100 selects at least one graphical form 201 b for eachentry 231. As part of this step, thesystem 100 determines the at least one graphical form 201 b in response to a set ofdata fields 232 associated with thatentry 231, possibly in combination or conjunction with other information. For example, not intended to be limiting in any way, thesystem 100 might determine the at least one graphical form 201 b as follows: -
- The graphical form 201 b might be responsive to a
single data field 232, such as for example a data field including a graphic element such as a movie poster associated with thatentry 231. - The graphical form 201 b might be responsive to one of multiple
such data fields 232, such as for example a data field including a graphic element such as a selection of one of a set of stills from a movie associated with thatentry 231. - The graphical form 201 b might be responsive to a combination or conjunction of multiple
such data fields 232, such as for example a data field including a first graphic element for display in response to a first selected set of conditions (such as for example, if the user is a youngster and not allowed access to that movie in response to its maturity rating), and a second graphic element for display in response to a second selected set of conditions (such as for example if the first selected set of conditions do not apply). - The graphical form 201 b might be responsive to a combination or conjunction of multiple
such data fields 232 with demographic information about the user, such as for example a data field including a first graphic element for display to users of a first demographic type or in a first geographic region, or some combination or conjunction thereof, and a second graphic element for display to other users. - The graphical form 201 b might have alternative variants by which the user might deduce further information. For example, not intended to be limiting in any way, where the iconic or representational data field involves a shape of a state or a nation, that shape might be extended by outlining or filling it with a selected hue (such as blue, red, or green) to indicate some aspect of that entry, such as for example an election report.
- The graphical form 201 b might be dynamically generated in response to information in the database, or other information such as for example real-time stock data, telemetry, or video. For example, not intended to be limiting in any way, where the iconic or representational data field involves an individual, that shape might be dynamically generated in response to a video feed, such as for example a webcam (a camera coupled to a communication network).
- The graphical form 201 b might be responsive to a
- In one embodiment, the graphical form 201 b includes a single iconic or representational graphic form by which a user might identify the entry or title in response to visual presentation thereof. In alternative embodiments, the graphical form 201 b may include a plurality of such iconic or representational graphic forms, and the
system 100 may (a) manipulate that plurality of graphic forms into a single combined graphical form 201 b for display, (b) select, in response to that plurality of graphic forms, a single combined graphical form 201 b for display, or (c) some combination or conjunction or reasonable generalization thereof, and the like. - At a
step 313, thesystem 100 presents the at least one graphical form 201 b associated with eachentry 231, and disposes those graphical forms 201 b in the kth assignment kA ofscreen regions 201, with the effect that thesystem 100 presents those graphical forms 201 b associated with eachentry 231 in a plurality ofscreen regions 201. - As described above, the set of
screen regions 201 are disposed on thedisplay screen 105 as a rectilinear tiled set ofscreen regions 201, such as for example disjoint regions as one might find in a chessboard. However, as described above, in the context of the invention, there is no particular requirement that the set ofscreen regions 201 take such a form. In alternative embodiments, the “Mosaic” mode of operation may include other dispositions ofindividual screen regions 201, such as for example (a) a hexagonal pattern ofscreen regions 201 disposed within thedisplay screen 105, (b) a spiral pattern ofscreen regions 201 disposed within thedisplay screen 105, (c) a perspective view having the effect of representing a multidimensional pattern ofscreen regions 201, such as for example a three-dimensional lattice, disposed within thedisplay screen 105, (d) a distribution ofscreen regions 201 representing a set of clusters ofentries 231, (e) a pseudorandom or random distribution ofscreen regions 201 disposed within thedisplay screen 105, reasonable generalizations thereof, and the like. - At a
step 314, thesystem 100 presents auxiliary information in theauxiliary information area 205 about the focused-uponentry 231 located at thefocus 201 a of the kth assignment kA ofscreen regions 201. As part of this step, thesystem 100 obtains the auxiliary information from the data fields 232 associated with focused-uponentry 231 in thedatabase 221. - At a
step 315, thesystem 100 determines what emphasis (such as for example highlighting) to be applied to thefocus 201 a, theauxiliary information area 205, andother screen regions 201, in response to the content distance and screen distance, computed as described above. - At a
step 316, thesystem 100 renders the graphical forms 201 b and theauxiliary information area 205 in their allocatedscreen regions 201, and renders any other presentation elements to be shown on thedisplay screen 105, such as for example (a)scroll affordances 202 a orscroll bars 202 b, (b) pointingelements 203, (c) iconic or symbolic elements 204, (d) pictures, (e) text, (f) dividing lines between thescreen regions 201, (g) touch-panel buttons 211 or other heads-up display elements, (h) status indicators about thesystem 100 drawn from outside thedatabase 221, and the like. As part of this step, thesystem 100 renders any transitions from earlier presentation states, such as fade-in/fade-out, and the like. - At a
flow point 320, thesystem 100 has displayed a portion of thedatabase 221 on thedisplay screen 105, and is ready to receive commands orrequests 113 from theuser 112. - User Requests and Responses
- As described above, at the
flow point 320, thesystem 100 has displayed a portion of thedatabase 221 on thedisplay screen 105, and is ready to receive commands orrequests 113 from theuser 112. - At a
step 321, thesystem 100 receives a sequence of commands orrequests 113 from theuser 112. In one embodiment, theuser 112 enters these commands orrequests 113 from the at least oneinput element 103 in the form of button presses, such as for example from the television infraredremote control 103 a or touch-panel control 103 b, where the button presses might indicate (a) directions such as right, left, up, down, (b) selection or de-selection, or (c) alphanumeric entry of letters or numbers. In alternative embodiments, theuser 112 may enter these commands orrequests 113 from the at least oneinput element 103 in the form of keyboarding, mouse clicks and double-clicks, possibly in combination or conjunction with mouse movement, such as for example as might be used in entering commands orrequests 113 for an ordinary PC programming environment. In further alternative embodiments, theuser 112 may enter these commands orrequests 113 from the at least oneinput element 103 in the form of voice commands or other biometric input techniques. - At a
step 322, thesystem 100 parses or recognizes those commands orrequests 113 received from theuser 112. Those commands orrequests 113 might direct assistant to perform actions such as described above with regard toFIG. 1 andFIG. 2 . - At a
step 323, thesystem 100 determines one ormore responses 114 to make to those commands orrequests 113 received from theuser 112. As part of this step, thesystem 100 directs the at least one output element 104 (including the display screen 105) to make thoseresponses 114, in such manner that theuser 112 might readily understand thoseresponses 114. - As part of this step, it might occur as described above that the
system 100 performs one or more of the following actions, possibly in combination or conjunction: -
- The system 100 (a) moves the position of the
pointing element 103, (b) highlights or de-highlights selectedscreen regions 201, (c) scrolls or pages one or more of thescreen regions 201, or (d) invokes or de-invokes a selected function associated with one or more iconic or symbolic elements 204. - The system 100 (a) presents one or more
selected entries 231, on thedisplay screen 105, with the effect that the user may review those selectedentries 231; or (b) changes the focused-uponentry 231, along with according changes to representation of the focused-uponentry 231.
- The system 100 (a) moves the position of the
- At a
flow point 330, thesystem 100 has received and responded to a command or request 113 from theuser 112, and is ready to continue with theflow point 320 to do so again. As part of themethod 300 proceeding from theflow point 320 to theflow point 330, thesystem 100 performs the steps described in association with theflow point 310. - Dynamic Repositioning
- As described above, at a
flow point 330, thesystem 100 has received and responded to a command or request 113 from theuser 112, and is ready to continue with theflow point 320 to do so again. - In the
step 311, as described above in response to a command or request 113 from theuser 112 changing thefocus 201 a, thesystem 100 dynamically re-computes a new acceptable pseudorandom positioning assignment A. This has the effect that when theuser 112 issues a command orrequest 113 causing thefocus 201 a to be changed, the Mosaic dynamically rearranges the display in response to one or more possible triggering events, with the effect that videos may be moved into or out of the user's field of vision within thedisplay screen 105. - Also in the
step 311, as described above with regard to dynamically re-computing a new acceptable pseudorandom positioning assignment A, thesystem 100 causes each row in a two-dimensional array ofscreen regions 201 to include allpossible entries 231 and to be offset from each other such row by an offset R relatively prime to the number N ofentries 231 in the library, with the effect of similarly causing each column in that two-dimensional array ofscreen regions 201 to include allpossible entries 231 and to be offset from each other such column by a relatively prime number. This has the effect that scrolling or paging along either a row or column will eventually bring theuser 112 to a graphical form 201 b for eachpossible entry 231 in thedatabase 221. - In the
step 315, as described above, thesystem 100 presents thefocus 201 a highlighted or otherwise emphasized, with relatively lesser highlighting or other emphasis for thoseentries 231 that are not focused-upon, and with relatively lesser highlighting or other emphasis for thoseentries 231 having relatively larger content distance from thefocus 201 a. - Although preferred embodiments are disclosed herein, many variations are possible which remain within the concept, scope, and spirit of the invention. These variations would become clear to those skilled in the art after perusal of this application.
-
- The invention applies to any information to be presented or represented, not necessarily just to video titles. For example, not intended to be limiting in any way, the invention could be used to represent advertisements, animation, audio titles, books or other textual works, encyclopedia entries, magazines and articles therefrom, people (real or fictional), still pictures, or more generally, database entries of any kind.
- The invention might be combined with other techniques for presenting or representing information. For example, not intended to be limiting in any way, the invention could be combined with a hierarchical representation of data, a hyper-linked representation of data, a dynamically generated representation of data (such as for example by an applet), or some combination or mixture thereof.
- The invention applies to any information to be presented or represented, not necessarily just to video titles, in which there is at least one data field suitably iconic or representational that a user might identify the entry or title in response to visual presentation of that iconic or representational data field. For example, not intended to be limiting in any way, the iconic or representational data field might involve a picture of a person, a flag, a shape of a state or a nation, a stylized facial expression (happy, sad, and the like), an icon representing a data type or a computer program.
- With regard to having at least one data field suitably iconic or representational that a user might identify the entry or title in response to visual presentation thereof, it is within the scope and spirit of the invention that the iconic or representational data field might have alternative variants by which the user might deduce further information. For example, not intended to be limiting in any way, where the iconic or representational data field involves a shape of a state or a nation, that shape might be extended by outlining or filling it with a selected hue (such as blue, red, or green) to indicate some aspect of that entry, such as for example an election report.
- With regard to having at least one data field suitably iconic or representational that a user might identify the entry or title in response to visual presentation thereof, it is also within the scope and spirit of the invention that the iconic or representational data field might be dynamically generated in response to information in the database, or other information such as for example real-time stock data, telemetry, or video. For example, not intended to be limiting in any way, where the iconic or representational data field involves an individual, that shape might be dynamically generated in response to a video feed, such as for example a webcam (a camera coupled to a communication network).
- The invention might be combined with techniques described in the incorporated disclosure. For a first example, not intended to be limiting in any way, the UI might present a linear ordering of each entry, with one data field in a selected row (or column), and cause that linear arrangement to be dynamically rearranged in response to the user focusing on a selected data field. This would have the effect that if the user selected a picture data field, the linear arrangement would be responsive to similarity of pictures, if the user selected a text data field, the linear arrangement would be responsive to similarity of text, and if the user selected a numeric value data field, the linear arrangement would be responsive to similarity of numeric value. The use of a similarity measure would be in contrast to the alphanumeric ordering used by the “Guide” shown in the incorporated disclosure. Alternatively, the selected data field may be more heavily weighted rather than being the only data field responded to.
- The invention might be combined with techniques described in the incorporated disclosure. For a second example, not intended to be limiting in any way, the UI might present an arrangement on the display screen, with the user being given the opportunity to select weights to assign to each data field when determining the measure of content distance. In one embodiment, the user might mark selected data fields, and obtain a pseudorandom two-dimensional display responsive to those data fields. Alternatively, the user might select a relative weight to assign to each data field, with that relative weight either being variable from 0% to 100% relative weight, or being restricted to being variable to a less inclusive range, such as for example 20% to 80% relative weight. In the first alternative, this would have the effect that if the user marked a picture data field and a numeric value data field, the two-dimensional arrangement would be responsive to similarity of both the pictures and the numeric values, but not other data fields. In the second alternative, this would have the effect that if the user marked a picture data field and a numeric value data field with high relative weights, the two-dimensional arrangement would be responsive to similarity of both the pictures and the numeric values, but also to other data fields.
- Those skilled in the art will recognize, after perusal of this application, that these alternative embodiments are illustrative and in no way limiting.
Claims (6)
1. A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation responsive to at least one data field associated with said entry, wherein said data field has a pictorial representation;
wherein said representation is generated in response to a measure of data-entry distance between each pair of said entries and in response to a measure of representation distance between each pair of said entries.
2-12. (canceled)
13. A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation at an intersection of least one said row and one said column;
wherein said representation is rearranged in response to associating said focus with a different one of said entries.
14-18. (canceled)
19. A method including steps of
generating a representation of a set of entries, said representation including a set of entries, each entry having a set of data fields, and a focus associated with at least one of said entries, a set of said entries being incorporated into said representation, each said entry being incorporated into said representation at an intersection of least one said row and one said column;
wherein when scrolling through said representation either horizontally or vertically, said representation includes each said entry in each said row and in each said column.
20-41. (canceled)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/707,643 US20070283276A1 (en) | 2002-07-09 | 2007-02-16 | Mosaic-like user interface for video selection and display |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US39458802P | 2002-07-09 | 2002-07-09 | |
US39492202P | 2002-07-09 | 2002-07-09 | |
US43933003P | 2003-01-09 | 2003-01-09 | |
US10/418,739 US7231607B2 (en) | 2002-07-09 | 2003-04-18 | Mosaic-like user interface for video selection and display |
US10/418,949 US7246322B2 (en) | 2002-07-09 | 2003-04-18 | Grid-like guided user interface for video selection and display |
US11/707,643 US20070283276A1 (en) | 2002-07-09 | 2007-02-16 | Mosaic-like user interface for video selection and display |
Related Parent Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/418,739 Continuation US7231607B2 (en) | 2002-05-14 | 2003-04-18 | Mosaic-like user interface for video selection and display |
US10/418,949 Continuation US7246322B2 (en) | 2002-05-14 | 2003-04-18 | Grid-like guided user interface for video selection and display |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070283276A1 true US20070283276A1 (en) | 2007-12-06 |
Family
ID=32074639
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/418,739 Expired - Fee Related US7231607B2 (en) | 2002-05-14 | 2003-04-18 | Mosaic-like user interface for video selection and display |
US11/707,643 Abandoned US20070283276A1 (en) | 2002-07-09 | 2007-02-16 | Mosaic-like user interface for video selection and display |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/418,739 Expired - Fee Related US7231607B2 (en) | 2002-05-14 | 2003-04-18 | Mosaic-like user interface for video selection and display |
Country Status (1)
Country | Link |
---|---|
US (2) | US7231607B2 (en) |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040139047A1 (en) * | 2003-01-09 | 2004-07-15 | Kaleidescape | Bookmarks and watchpoints for selection and presentation of media streams |
US20050010955A1 (en) * | 2003-05-15 | 2005-01-13 | Elia Eric J. | Method and system for playing video |
US20070283290A1 (en) * | 2006-05-19 | 2007-12-06 | Yahoo! Inc. | System and method for visualizing the temporal evolution of object metadata |
US20080062179A1 (en) * | 2007-11-20 | 2008-03-13 | Rolando Branly | Data display system to facilitate pattern recognition and classification |
US20110231797A1 (en) * | 2010-03-19 | 2011-09-22 | Nokia Corporation | Method and apparatus for displaying relative motion of objects on graphical user interface |
US20120030613A1 (en) * | 2009-01-09 | 2012-02-02 | Hillcrest Laboratories, Inc. | Zooming and Panning Widget for Internet Browsers |
US20120110454A1 (en) * | 2010-10-27 | 2012-05-03 | Haeng-Suk Chae | Method and apparatus for providing user interface for media contents in user equipment |
US20120226983A1 (en) * | 2011-03-01 | 2012-09-06 | Lucasfilm Entertainment Company Ltd. | Copying an Object in an Animation Creation Application |
US20150356877A1 (en) * | 2014-06-06 | 2015-12-10 | Catherine Ann Downey | Visual organization architecture system |
US10104438B1 (en) * | 2013-03-15 | 2018-10-16 | Cox Communications, Inc | Automatic population of a programming guide mosaic screen |
Families Citing this family (100)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5986650A (en) | 1996-07-03 | 1999-11-16 | News America Publications, Inc. | Electronic television program guide schedule system and method with scan feature |
US8589975B2 (en) | 1998-08-21 | 2013-11-19 | United Video Properties, Inc. | Electronic program guide with advance notification |
US20070220580A1 (en) * | 2002-03-14 | 2007-09-20 | Daniel Putterman | User interface for a media convergence platform |
US7231607B2 (en) * | 2002-07-09 | 2007-06-12 | Kaleidescope, Inc. | Mosaic-like user interface for video selection and display |
US20070245247A1 (en) * | 2002-05-14 | 2007-10-18 | Kaleidescape, Inc. | Grid-like guided user interface for video selection and display |
EP1523822A4 (en) * | 2002-07-09 | 2011-08-31 | Kaleidescape Inc | Secure presentation of encrypted digital content |
US7003131B2 (en) * | 2002-07-09 | 2006-02-21 | Kaleidescape, Inc. | Watermarking and fingerprinting digital content using alternative blocks to embed information |
US7111171B2 (en) * | 2002-07-09 | 2006-09-19 | Kaleidescope, Inc. | Parallel distribution and fingerprinting of digital content |
WO2004070998A2 (en) | 2003-01-31 | 2004-08-19 | Kaleidescape, Inc. | Recovering from de-synchronization attacks against watermarking and fingerprinting |
US20050125405A1 (en) * | 2003-04-18 | 2005-06-09 | Kaleidescape, Inc. | Distinct display of differentiated rights in property |
US20050086069A1 (en) * | 2003-07-15 | 2005-04-21 | Kaleidescape, Inc. | Separable presentation control rules with distinct control effects |
US8572104B2 (en) * | 2003-04-18 | 2013-10-29 | Kaleidescape, Inc. | Sales of collections excluding those already purchased |
US7443404B2 (en) * | 2003-10-17 | 2008-10-28 | Casio Computer Co., Ltd. | Image display apparatus, image display controlling method, and image display program |
JP4225418B2 (en) * | 2004-02-05 | 2009-02-18 | ソニー株式会社 | Compound equipment |
US7882436B2 (en) * | 2004-03-10 | 2011-02-01 | Trevor Burke Technology Limited | Distribution of video data |
JP2006004256A (en) * | 2004-06-18 | 2006-01-05 | Fuji Xerox Co Ltd | Browsing device, and browsing method |
US8677274B2 (en) * | 2004-11-10 | 2014-03-18 | Apple Inc. | Highlighting items for search results |
TW200704183A (en) * | 2005-01-27 | 2007-01-16 | Matrix Tv | Dynamic mosaic extended electronic programming guide for television program selection and display |
US8434117B2 (en) * | 2005-02-14 | 2013-04-30 | Microsoft Corporation | Tunerless media presentation unit and methods of use |
US20060190260A1 (en) * | 2005-02-24 | 2006-08-24 | Nokia Corporation | Selecting an order of elements for a speech synthesis |
EP1705916A1 (en) * | 2005-03-25 | 2006-09-27 | Alcatel | Interactive displaying system |
WO2006105480A1 (en) * | 2005-03-30 | 2006-10-05 | United Video Properties, Inc. | Systems and methods for video-rich navigation |
US8387089B1 (en) | 2005-05-06 | 2013-02-26 | Rovi Guides, Inc. | Systems and methods for providing a scan |
US8640166B1 (en) | 2005-05-06 | 2014-01-28 | Rovi Guides, Inc. | Systems and methods for content surfing |
US20070016925A1 (en) * | 2005-06-20 | 2007-01-18 | Arthur Vaysman | Interactive TV application display method and apparatus |
US20070006262A1 (en) * | 2005-06-30 | 2007-01-04 | Microsoft Corporation | Automatic content presentation |
EP1744523A1 (en) * | 2005-07-14 | 2007-01-17 | Sony Ericsson Mobile Communications AB | Device with highlighted menu |
US8875196B2 (en) * | 2005-08-13 | 2014-10-28 | Webtuner Corp. | System for network and local content access |
US8719857B1 (en) | 2005-08-24 | 2014-05-06 | Rovi Guides, Inc. | Systems and methods for providing parental control features in video mosaic environments |
KR100719023B1 (en) * | 2005-10-08 | 2007-05-17 | 삼성전자주식회사 | Display Apparatus And Contents Information Displaying Method |
KR100682331B1 (en) * | 2005-12-23 | 2007-02-15 | 삼성전자주식회사 | Method for searching phone-book in portable communication terminal |
US20100153885A1 (en) * | 2005-12-29 | 2010-06-17 | Rovi Technologies Corporation | Systems and methods for interacting with advanced displays provided by an interactive media guidance application |
US7966573B2 (en) * | 2006-02-17 | 2011-06-21 | Microsoft Corporation | Method and system for improving interaction with a user interface |
US20070208776A1 (en) * | 2006-03-06 | 2007-09-06 | Microsoft Corporation | Assignment of metadata |
US7669128B2 (en) * | 2006-03-20 | 2010-02-23 | Intension, Inc. | Methods of enhancing media content narrative |
US20070250865A1 (en) * | 2006-03-23 | 2007-10-25 | Krakirian Haig H | System and method for selectively recording program content from a mosaic display |
US8316394B2 (en) | 2006-03-24 | 2012-11-20 | United Video Properties, Inc. | Interactive media guidance application with intelligent navigation and display features |
US8102863B1 (en) | 2006-06-27 | 2012-01-24 | Qurio Holdings, Inc. | High-speed WAN to wireless LAN gateway |
EP2050270A2 (en) | 2006-07-31 | 2009-04-22 | United Video Properties, Inc. | Systems and methods for providing media guidance planners |
US8615778B1 (en) | 2006-09-28 | 2013-12-24 | Qurio Holdings, Inc. | Personalized broadcast system |
US20080104058A1 (en) * | 2006-11-01 | 2008-05-01 | United Video Properties, Inc. | Presenting media guidance search results based on relevancy |
US20080104127A1 (en) * | 2006-11-01 | 2008-05-01 | United Video Properties, Inc. | Presenting media guidance search results based on relevancy |
US7996399B2 (en) * | 2006-11-01 | 2011-08-09 | United Video Properties, Inc. | Presenting media guidance search results based on relevancy |
US7738676B1 (en) * | 2006-11-02 | 2010-06-15 | Qurio Holdings, Inc. | Client-side watermarking using hybrid I-frames |
US7983440B1 (en) | 2006-11-02 | 2011-07-19 | Qurio Holdings, Inc. | Selection of I-frames for client-side watermarking |
US7802306B1 (en) | 2006-11-30 | 2010-09-21 | Qurio Holdings, Inc. | Multiple watermarks for digital rights management (DRM) and content tracking |
US8000474B1 (en) * | 2006-12-15 | 2011-08-16 | Quiro Holdings, Inc. | Client-side protection of broadcast or multicast content for non-real-time playback |
US20080163059A1 (en) | 2006-12-28 | 2008-07-03 | Guideworks, Llc | Systems and methods for creating custom video mosaic pages with local content |
US8607144B2 (en) * | 2007-01-08 | 2013-12-10 | Apple Inc. | Monitor configuration for media device |
US8612857B2 (en) * | 2007-01-08 | 2013-12-17 | Apple Inc. | Monitor configuration for media device |
EP1956838A3 (en) * | 2007-02-07 | 2009-04-29 | The DirecTV Group, Inc. | Live video management system |
US8910209B2 (en) * | 2007-02-07 | 2014-12-09 | The Directv Group, Inc. | Live video management system |
US9177603B2 (en) | 2007-03-19 | 2015-11-03 | Intension, Inc. | Method of assembling an enhanced media content narrative |
US8135947B1 (en) | 2007-03-21 | 2012-03-13 | Qurio Holdings, Inc. | Interconnect device to enable compliance with rights management restrictions |
US9191605B1 (en) | 2007-03-26 | 2015-11-17 | Qurio Holdings, Inc. | Remote monitoring of media content that is associated with rights management restrictions |
US8863187B2 (en) | 2007-04-02 | 2014-10-14 | Tp Lab, Inc. | System and method for presenting multiple pictures on a television |
US7895442B1 (en) * | 2007-06-18 | 2011-02-22 | Qurio Holdings, Inc. | Interconnect device to enable compliance with rights management restrictions |
US8051387B2 (en) * | 2007-06-28 | 2011-11-01 | Nokia Corporation | Method, computer program product and apparatus providing an improved spatial user interface for content providers |
US8407737B1 (en) | 2007-07-11 | 2013-03-26 | Rovi Guides, Inc. | Systems and methods for providing a scan transport bar |
US8601392B2 (en) * | 2007-08-22 | 2013-12-03 | 9224-5489 Quebec Inc. | Timeline for presenting information |
US8190994B2 (en) | 2007-10-25 | 2012-05-29 | Nokia Corporation | System and method for listening to audio content |
US8230360B2 (en) * | 2008-01-04 | 2012-07-24 | Apple Inc. | User interface for selection from media collection |
US8640227B2 (en) * | 2008-06-23 | 2014-01-28 | EchoStar Technologies, L.L.C. | Apparatus and methods for dynamic pictorial image authentication |
US20100071004A1 (en) * | 2008-09-18 | 2010-03-18 | Eldon Technology Limited | Methods and apparatus for providing multiple channel recall on a television receiver |
US9357262B2 (en) | 2008-09-30 | 2016-05-31 | Echostar Technologies L.L.C. | Systems and methods for graphical control of picture-in-picture windows |
US8572651B2 (en) | 2008-09-22 | 2013-10-29 | EchoStar Technologies, L.L.C. | Methods and apparatus for presenting supplemental information in an electronic programming guide |
US8937687B2 (en) | 2008-09-30 | 2015-01-20 | Echostar Technologies L.L.C. | Systems and methods for graphical control of symbol-based features in a television receiver |
US8763045B2 (en) | 2008-09-30 | 2014-06-24 | Echostar Technologies L.L.C. | Systems and methods for providing customer service features via a graphical user interface in a television receiver |
US8473979B2 (en) | 2008-09-30 | 2013-06-25 | Echostar Technologies L.L.C. | Systems and methods for graphical adjustment of an electronic program guide |
US8582957B2 (en) * | 2008-09-22 | 2013-11-12 | EchoStar Technologies, L.L.C. | Methods and apparatus for visually displaying recording timer information |
US8793735B2 (en) * | 2008-09-30 | 2014-07-29 | EchoStar Technologies, L.L.C. | Methods and apparatus for providing multiple channel recall on a television receiver |
US20100083319A1 (en) * | 2008-09-30 | 2010-04-01 | Echostar Technologies Llc | Methods and apparatus for locating content in an electronic programming guide |
US8098337B2 (en) * | 2008-09-30 | 2012-01-17 | Echostar Technologies L.L.C. | Systems and methods for automatic configuration of a remote control device |
US8411210B2 (en) * | 2008-09-30 | 2013-04-02 | Echostar Technologies L.L.C. | Systems and methods for configuration of a remote control device |
US8397262B2 (en) * | 2008-09-30 | 2013-03-12 | Echostar Technologies L.L.C. | Systems and methods for graphical control of user interface features in a television receiver |
US20100088602A1 (en) * | 2008-10-03 | 2010-04-08 | Microsoft Corporation | Multi-Application Control |
US9100614B2 (en) | 2008-10-31 | 2015-08-04 | Echostar Technologies L.L.C. | Graphical interface navigation based on image element proximity |
US20100115036A1 (en) * | 2008-10-31 | 2010-05-06 | Nokia Coporation | Method, apparatus and computer program product for generating a composite media file |
US9325823B2 (en) * | 2008-12-19 | 2016-04-26 | Verizon Patent And Licensing Inc. | Visual address book and dialer |
US20100217410A1 (en) * | 2009-02-22 | 2010-08-26 | Yang Pan | User interface for home media system |
JP2011130279A (en) * | 2009-12-18 | 2011-06-30 | Sony Corp | Content providing server, content reproducing apparatus, content providing method, content reproducing method, program and content providing system |
US8863025B2 (en) * | 2010-08-26 | 2014-10-14 | Dell Products L.P. | System for enabling a user to view visual content on an information handling system |
CN103262110B (en) * | 2010-12-20 | 2017-02-15 | 英特尔公司 | Method, device and equipment for management and presentation of content |
US10108955B1 (en) * | 2011-03-14 | 2018-10-23 | Amazon Technologies, Inc. | Metering costs of aggregated storage |
CA2836462A1 (en) | 2011-05-17 | 2012-11-22 | Eduard Zaslavsky | System and method for scalable, high accuracy, sensor and id based audience measurement system |
KR20140035424A (en) | 2011-05-24 | 2014-03-21 | 웹튜너 코포레이션 | System and method to increase efficiency and speed of analytics report generation in audience measurement systems |
EP2716038A4 (en) | 2011-05-26 | 2014-10-22 | Webtuner Corp | Highly scalable audience measurement system with client event pre-processing |
US8977721B2 (en) * | 2012-03-27 | 2015-03-10 | Roku, Inc. | Method and apparatus for dynamic prioritization of content listings |
CA2791935A1 (en) | 2012-03-30 | 2013-09-30 | Disternet Technology, Inc. | Transcoding system and method |
US11259087B2 (en) | 2012-10-03 | 2022-02-22 | Mimik Technology Inc. | System and method for managing streaming services |
US9342519B2 (en) * | 2013-12-11 | 2016-05-17 | Viacom International Inc. | Systems and methods for a media application including an interactive grid display |
US9247283B1 (en) | 2014-10-27 | 2016-01-26 | Cisco Technology, Inc. | Mosaic presentation screen production |
US10645465B2 (en) | 2015-12-21 | 2020-05-05 | Centurylink Intellectual Property Llc | Video file universal identifier for metadata resolution |
US10650039B2 (en) * | 2016-02-25 | 2020-05-12 | Lionheart Legacy Uco | Customizable world map |
US11477302B2 (en) | 2016-07-06 | 2022-10-18 | Palo Alto Research Center Incorporated | Computer-implemented system and method for distributed activity detection |
US9936389B2 (en) | 2016-08-26 | 2018-04-03 | Rovi Guides, Inc. | Methods and systems for preventing a user input device from controlling user equipment |
US10664805B2 (en) * | 2017-01-09 | 2020-05-26 | International Business Machines Corporation | System, method and computer program product for resume rearrangement |
US10831787B2 (en) * | 2017-06-30 | 2020-11-10 | Sap Se | Security of a computer system |
US10945034B2 (en) * | 2019-07-11 | 2021-03-09 | International Business Machines Corporation | Video fractal cross correlated action bubble transition |
CN110717103B (en) * | 2019-10-09 | 2021-08-31 | 东北大学 | Improved collaborative filtering method based on stack noise reduction encoder |
Citations (29)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6166735A (en) * | 1997-12-03 | 2000-12-26 | International Business Machines Corporation | Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects |
US6211876B1 (en) * | 1998-06-22 | 2001-04-03 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for displaying icons representing information items stored in a database |
US6229524B1 (en) * | 1998-07-17 | 2001-05-08 | International Business Machines Corporation | User interface for interaction with video |
US6243725B1 (en) * | 1997-05-21 | 2001-06-05 | Premier International, Ltd. | List building system |
US6278446B1 (en) * | 1998-02-23 | 2001-08-21 | Siemens Corporate Research, Inc. | System for interactive organization and browsing of video |
US20010020236A1 (en) * | 1998-03-11 | 2001-09-06 | Cannon Mark E. | Method and apparatus for analyzing data and advertising optimization |
US20010056398A1 (en) * | 2000-04-14 | 2001-12-27 | E-Vantage International, Inc. | Method and system for delivering foreign exchange risk management advisory solutions to a designated market |
US6356971B1 (en) * | 1999-03-04 | 2002-03-12 | Sony Corporation | System for managing multimedia discs, tracks and files on a standalone computer |
US20020054174A1 (en) * | 1998-12-18 | 2002-05-09 | Abbott Kenneth H. | Thematic response to a computer user's context, such as by a wearable personal computer |
US20020113824A1 (en) * | 2000-10-12 | 2002-08-22 | Myers Thomas D. | Graphic user interface that is usable as a commercial digital jukebox interface |
US6463426B1 (en) * | 1997-10-27 | 2002-10-08 | Massachusetts Institute Of Technology | Information search and retrieval system |
US6463431B1 (en) * | 1995-11-15 | 2002-10-08 | Bizrate.Com | Database evaluation system supporting intuitive decision in complex multi-attributive domains using fuzzy hierarchical expert models |
US20020180803A1 (en) * | 2001-03-29 | 2002-12-05 | Smartdisk Corporation | Systems, methods and computer program products for managing multimedia content |
US20030018972A1 (en) * | 2001-07-17 | 2003-01-23 | Jitesh Arora | Method, system and software for display of multiple media channels |
US20030040850A1 (en) * | 2001-08-07 | 2003-02-27 | Amir Najmi | Intelligent adaptive optimization of display navigation and data sharing |
US20030050818A1 (en) * | 2001-09-07 | 2003-03-13 | Tomoko Maie | Production managing system |
US20030126136A1 (en) * | 2001-06-22 | 2003-07-03 | Nosa Omoigui | System and method for knowledge retrieval, management, delivery and presentation |
US6618035B1 (en) * | 1999-10-15 | 2003-09-09 | Yves Jean-Paul Guy Reza | Interface unit between a user and an electronic device |
US20040039661A1 (en) * | 2002-08-26 | 2004-02-26 | Jacquelyn Fuzell-Casey | List-based selection system and methods for using same |
US20040044658A1 (en) * | 2000-11-20 | 2004-03-04 | Crabtree Ian B | Information provider |
US20040073921A1 (en) * | 2002-07-09 | 2004-04-15 | Neely Shawn R. | Grid-like guided user interface for video selection and display |
US20040139064A1 (en) * | 2001-03-16 | 2004-07-15 | Louis Chevallier | Method for navigation by computation of groups, receiver for carrying out said method and graphical interface for presenting said method |
US6968511B1 (en) * | 2002-03-07 | 2005-11-22 | Microsoft Corporation | Graphical user interface, data structure and associated method for cluster-based document management |
US20060004680A1 (en) * | 1998-12-18 | 2006-01-05 | Robarts James O | Contextual responses based on automated learning techniques |
US6985897B1 (en) * | 2000-07-18 | 2006-01-10 | Sony Corporation | Method and system for animated and personalized on-line product presentation |
US20060031260A1 (en) * | 2000-03-28 | 2006-02-09 | Nissan Motor Co., Ltd. | Data display system, data map forming system, and data map forming method |
US20060095300A1 (en) * | 2001-04-24 | 2006-05-04 | Schrier Robert W | Providing patient-specific drug information |
US7231607B2 (en) * | 2002-07-09 | 2007-06-12 | Kaleidescope, Inc. | Mosaic-like user interface for video selection and display |
US7240028B1 (en) * | 2002-03-15 | 2007-07-03 | Microsoft Corporation | Automated financial register reconciliation in a combined user interface |
Family Cites Families (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4965825A (en) * | 1981-11-03 | 1990-10-23 | The Personalized Mass Media Corporation | Signal processing apparatus and methods |
US4992940A (en) * | 1989-03-13 | 1991-02-12 | H-Renee, Incorporated | System and method for automated selection of equipment for purchase through input of user desired specifications |
US5270831A (en) * | 1990-09-14 | 1993-12-14 | Eastman Kodak Company | Storage and playback of digitized images in digital database together with presentation control file to define image orientation/aspect ratio |
DE69233335T2 (en) * | 1991-12-02 | 2005-02-10 | Koninklijke Philips Electronics N.V. | Closed information system with copy protection |
US6182069B1 (en) * | 1992-11-09 | 2001-01-30 | International Business Machines Corporation | Video query system and method |
US5337357A (en) * | 1993-06-17 | 1994-08-09 | Software Security, Inc. | Method of software distribution protection |
US6614914B1 (en) * | 1995-05-08 | 2003-09-02 | Digimarc Corporation | Watermark embedder and reader |
US6625581B1 (en) * | 1994-04-22 | 2003-09-23 | Ipf, Inc. | Method of and system for enabling the access of consumer product related information and the purchase of consumer products at points of consumer presence on the world wide web (www) at which consumer product information request (cpir) enabling servlet tags are embedded within html-encoded documents |
US6411725B1 (en) * | 1995-07-27 | 2002-06-25 | Digimarc Corporation | Watermark enabled video objects |
JPH09231274A (en) * | 1996-02-26 | 1997-09-05 | Fujitsu Ltd | Retrieval server system |
US5896454A (en) * | 1996-03-08 | 1999-04-20 | Time Warner Entertainment Co., L.P. | System and method for controlling copying and playing of digital programs |
US5765176A (en) * | 1996-09-06 | 1998-06-09 | Xerox Corporation | Performing document image management tasks using an iconic image having embedded encoded information |
JP2000509588A (en) * | 1997-01-27 | 2000-07-25 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Method and system for transferring content information and related supplementary information |
US6009525A (en) * | 1997-08-29 | 1999-12-28 | Preview Systems, Inc. | Multi-tier electronic software distribution |
PT1020077E (en) * | 1997-10-08 | 2002-12-31 | Digimarc Corp | PROCESS AND APPARATUS FOR A UNIQUE COPY WATER BRAND FOR A VIDEO GRAVACATION |
AU5781599A (en) * | 1998-08-23 | 2000-03-14 | Open Entertainment, Inc. | Transaction system for transporting media files from content provider sources tohome entertainment devices |
US6188728B1 (en) * | 1998-09-29 | 2001-02-13 | Sarnoff Corporation | Block motion video coding and decoding |
US6349143B1 (en) * | 1998-11-25 | 2002-02-19 | Acuson Corporation | Method and system for simultaneously displaying diagnostic medical ultrasound image clips |
US6260024B1 (en) * | 1998-12-02 | 2001-07-10 | Gary Shkedy | Method and apparatus for facilitating buyer-driven purchase orders on a commercial network system |
US6563935B1 (en) * | 1998-12-02 | 2003-05-13 | Hitachi, Ltd. | Method of extracting digital watermark information and method of judging bit value of digital watermark information |
US6366910B1 (en) * | 1998-12-07 | 2002-04-02 | Amazon.Com, Inc. | Method and system for generation of hierarchical search results |
WO2000062533A1 (en) * | 1999-03-30 | 2000-10-19 | Tivo, Inc. | Television viewer interface system |
US6629097B1 (en) * | 1999-04-28 | 2003-09-30 | Douglas K. Keith | Displaying implicit associations among items in loosely-structured data sets |
US6192139B1 (en) * | 1999-05-11 | 2001-02-20 | Sony Corporation Of Japan | High redundancy system and method for watermarking digital image and video data |
US6801999B1 (en) * | 1999-05-20 | 2004-10-05 | Microsoft Corporation | Passive and active software objects containing bore resistant watermarking |
US6701305B1 (en) | 1999-06-09 | 2004-03-02 | The Boeing Company | Methods, apparatus and computer program products for information retrieval and document classification utilizing a multidimensional subspace |
GB2351405B (en) * | 1999-06-21 | 2003-09-24 | Motorola Ltd | Watermarked digital images |
US6772340B1 (en) * | 2000-01-14 | 2004-08-03 | Microsoft Corporation | Digital rights management system operating on computing device and having black box tied to computing device |
US7426750B2 (en) * | 2000-02-18 | 2008-09-16 | Verimatrix, Inc. | Network-based content distribution system |
WO2001076128A2 (en) * | 2000-04-04 | 2001-10-11 | Ecd Systems, Inc. | Method and system for digital data delivery and reproduction |
EP1768414A3 (en) * | 2000-05-26 | 2007-12-26 | Canon Kabushiki Kaisha | Contents forming method and contents reproducing apparatus and method |
US6714683B1 (en) * | 2000-08-24 | 2004-03-30 | Digimarc Corporation | Wavelet based feature modulation watermarks and related applications |
US20020029187A1 (en) * | 2000-09-07 | 2002-03-07 | Meehan John J. | Electronic marketplace |
US7181625B2 (en) * | 2000-10-17 | 2007-02-20 | Vidius Inc. | Secure distribution of digital content |
US6694041B1 (en) * | 2000-10-11 | 2004-02-17 | Digimarc Corporation | Halftone watermarking and related applications |
US6889383B1 (en) * | 2000-10-23 | 2005-05-03 | Clearplay, Inc. | Delivery of navigation data for playback of audio and video content |
US6904410B1 (en) * | 2000-11-02 | 2005-06-07 | Haveneed.Com, Inc. | Online method and system for management of collectibles |
US20020116707A1 (en) * | 2000-12-11 | 2002-08-22 | Morris Richard M. | Streaming media client system and method |
US20020087876A1 (en) * | 2000-12-28 | 2002-07-04 | Larose Gordon Edward | Adaptive software installation process supporting multiple layers of security-related attributes |
US7251833B2 (en) * | 2000-12-29 | 2007-07-31 | International Business Machines Corporation | Digital media delivery with local cache and streaming tokens |
US6678009B2 (en) * | 2001-02-27 | 2004-01-13 | Matsushita Electric Industrial Co., Ltd. | Adjustable video display window |
JP2002278996A (en) * | 2001-03-22 | 2002-09-27 | Sony Corp | Recorder, recording method and recording medium |
US6728213B1 (en) * | 2001-03-23 | 2004-04-27 | Advanced Micro Devices, Inc. | Selective admission control in a network device |
US7016496B2 (en) * | 2001-03-26 | 2006-03-21 | Sun Microsystems, Inc. | System and method for storing and accessing digital media content using smart card technology |
US20030163815A1 (en) * | 2001-04-06 | 2003-08-28 | Lee Begeja | Method and system for personalized multimedia delivery service |
JP3983993B2 (en) * | 2001-04-13 | 2007-09-26 | 株式会社日立製作所 | Method for creating application data with face photo, apparatus for implementing the same, and processing program therefor |
US7047413B2 (en) * | 2001-04-23 | 2006-05-16 | Microsoft Corporation | Collusion-resistant watermarking and fingerprinting |
US6996273B2 (en) * | 2001-04-24 | 2006-02-07 | Microsoft Corporation | Robust recognizer of perceptually similar content |
US6975743B2 (en) * | 2001-04-24 | 2005-12-13 | Microsoft Corporation | Robust and stealthy video watermarking into regions of successive frames |
US6973574B2 (en) * | 2001-04-24 | 2005-12-06 | Microsoft Corp. | Recognizer of audio-content in digital signals |
US20020174021A1 (en) * | 2001-05-15 | 2002-11-21 | International Business Machines Corporation | Optimized shopping list process |
US20020178077A1 (en) * | 2001-05-25 | 2002-11-28 | Katz Steven Bruce | Method for automatically invoking a software module in response to an internal or external event affecting the procurement of an item |
KR20030006533A (en) * | 2001-07-13 | 2003-01-23 | 삼성전자 주식회사 | Method and apparatus for controlling a reproduction restriction level on the video reproduction system |
GB2379115A (en) * | 2001-08-21 | 2003-02-26 | Sony Uk Ltd | Introducing test signals into a data signal |
US7032177B2 (en) * | 2001-12-27 | 2006-04-18 | Digeo, Inc. | Method and system for distributing personalized editions of media programs using bookmarks |
US6904151B2 (en) * | 2002-01-17 | 2005-06-07 | Deguillaume Frederic | Method for the estimation and recovering of general affine transform |
US6957232B2 (en) * | 2002-04-05 | 2005-10-18 | Infocus Corporation | Projector control markup language |
US7036024B2 (en) * | 2002-07-09 | 2006-04-25 | Kaleidescape, Inc. | Detecting collusion among multiple recipients of fingerprinted information |
US7003131B2 (en) * | 2002-07-09 | 2006-02-21 | Kaleidescape, Inc. | Watermarking and fingerprinting digital content using alternative blocks to embed information |
US7111171B2 (en) * | 2002-07-09 | 2006-09-19 | Kaleidescope, Inc. | Parallel distribution and fingerprinting of digital content |
-
2003
- 2003-04-18 US US10/418,739 patent/US7231607B2/en not_active Expired - Fee Related
-
2007
- 2007-02-16 US US11/707,643 patent/US20070283276A1/en not_active Abandoned
Patent Citations (31)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6463431B1 (en) * | 1995-11-15 | 2002-10-08 | Bizrate.Com | Database evaluation system supporting intuitive decision in complex multi-attributive domains using fuzzy hierarchical expert models |
US6243725B1 (en) * | 1997-05-21 | 2001-06-05 | Premier International, Ltd. | List building system |
US6463426B1 (en) * | 1997-10-27 | 2002-10-08 | Massachusetts Institute Of Technology | Information search and retrieval system |
US6166735A (en) * | 1997-12-03 | 2000-12-26 | International Business Machines Corporation | Video story board user interface for selective downloading and displaying of desired portions of remote-stored video data objects |
US6278446B1 (en) * | 1998-02-23 | 2001-08-21 | Siemens Corporate Research, Inc. | System for interactive organization and browsing of video |
US20010020236A1 (en) * | 1998-03-11 | 2001-09-06 | Cannon Mark E. | Method and apparatus for analyzing data and advertising optimization |
US6211876B1 (en) * | 1998-06-22 | 2001-04-03 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for displaying icons representing information items stored in a database |
US6229524B1 (en) * | 1998-07-17 | 2001-05-08 | International Business Machines Corporation | User interface for interaction with video |
US7076737B2 (en) * | 1998-12-18 | 2006-07-11 | Tangis Corporation | Thematic response to a computer user's context, such as by a wearable personal computer |
US20020054174A1 (en) * | 1998-12-18 | 2002-05-09 | Abbott Kenneth H. | Thematic response to a computer user's context, such as by a wearable personal computer |
US20060004680A1 (en) * | 1998-12-18 | 2006-01-05 | Robarts James O | Contextual responses based on automated learning techniques |
US6356971B1 (en) * | 1999-03-04 | 2002-03-12 | Sony Corporation | System for managing multimedia discs, tracks and files on a standalone computer |
US6618035B1 (en) * | 1999-10-15 | 2003-09-09 | Yves Jean-Paul Guy Reza | Interface unit between a user and an electronic device |
US20060031260A1 (en) * | 2000-03-28 | 2006-02-09 | Nissan Motor Co., Ltd. | Data display system, data map forming system, and data map forming method |
US20010056398A1 (en) * | 2000-04-14 | 2001-12-27 | E-Vantage International, Inc. | Method and system for delivering foreign exchange risk management advisory solutions to a designated market |
US6985897B1 (en) * | 2000-07-18 | 2006-01-10 | Sony Corporation | Method and system for animated and personalized on-line product presentation |
US20020113824A1 (en) * | 2000-10-12 | 2002-08-22 | Myers Thomas D. | Graphic user interface that is usable as a commercial digital jukebox interface |
US20040049537A1 (en) * | 2000-11-20 | 2004-03-11 | Titmuss Richard J | Method of managing resources |
US20040044658A1 (en) * | 2000-11-20 | 2004-03-04 | Crabtree Ian B | Information provider |
US20040139064A1 (en) * | 2001-03-16 | 2004-07-15 | Louis Chevallier | Method for navigation by computation of groups, receiver for carrying out said method and graphical interface for presenting said method |
US20020180803A1 (en) * | 2001-03-29 | 2002-12-05 | Smartdisk Corporation | Systems, methods and computer program products for managing multimedia content |
US20060095300A1 (en) * | 2001-04-24 | 2006-05-04 | Schrier Robert W | Providing patient-specific drug information |
US20030126136A1 (en) * | 2001-06-22 | 2003-07-03 | Nosa Omoigui | System and method for knowledge retrieval, management, delivery and presentation |
US20030018972A1 (en) * | 2001-07-17 | 2003-01-23 | Jitesh Arora | Method, system and software for display of multiple media channels |
US20030040850A1 (en) * | 2001-08-07 | 2003-02-27 | Amir Najmi | Intelligent adaptive optimization of display navigation and data sharing |
US20030050818A1 (en) * | 2001-09-07 | 2003-03-13 | Tomoko Maie | Production managing system |
US6968511B1 (en) * | 2002-03-07 | 2005-11-22 | Microsoft Corporation | Graphical user interface, data structure and associated method for cluster-based document management |
US7240028B1 (en) * | 2002-03-15 | 2007-07-03 | Microsoft Corporation | Automated financial register reconciliation in a combined user interface |
US20040073921A1 (en) * | 2002-07-09 | 2004-04-15 | Neely Shawn R. | Grid-like guided user interface for video selection and display |
US7231607B2 (en) * | 2002-07-09 | 2007-06-12 | Kaleidescope, Inc. | Mosaic-like user interface for video selection and display |
US20040039661A1 (en) * | 2002-08-26 | 2004-02-26 | Jacquelyn Fuzell-Casey | List-based selection system and methods for using same |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8225194B2 (en) | 2003-01-09 | 2012-07-17 | Kaleidescape, Inc. | Bookmarks and watchpoints for selection and presentation of media streams |
US20040139047A1 (en) * | 2003-01-09 | 2004-07-15 | Kaleidescape | Bookmarks and watchpoints for selection and presentation of media streams |
US8627193B2 (en) | 2003-01-09 | 2014-01-07 | Kaleidescape, Inc. | Bookmarks and watchpoints for selection and presentation of media streams |
US9176643B2 (en) * | 2003-05-15 | 2015-11-03 | Comcast Cable Holdings, Llc | Method and system for playing video |
US20050010955A1 (en) * | 2003-05-15 | 2005-01-13 | Elia Eric J. | Method and system for playing video |
US7581184B2 (en) * | 2006-05-19 | 2009-08-25 | Yahoo! Inc. | System and method for visualizing the temporal evolution of object metadata |
US20070283290A1 (en) * | 2006-05-19 | 2007-12-06 | Yahoo! Inc. | System and method for visualizing the temporal evolution of object metadata |
US20080062179A1 (en) * | 2007-11-20 | 2008-03-13 | Rolando Branly | Data display system to facilitate pattern recognition and classification |
US9459783B2 (en) * | 2009-01-09 | 2016-10-04 | Hillcrest Laboratories, Inc. | Zooming and panning widget for internet browsers |
US20120030613A1 (en) * | 2009-01-09 | 2012-02-02 | Hillcrest Laboratories, Inc. | Zooming and Panning Widget for Internet Browsers |
US20110231797A1 (en) * | 2010-03-19 | 2011-09-22 | Nokia Corporation | Method and apparatus for displaying relative motion of objects on graphical user interface |
US9977472B2 (en) * | 2010-03-19 | 2018-05-22 | Nokia Technologies Oy | Method and apparatus for displaying relative motion of objects on graphical user interface |
US20120110454A1 (en) * | 2010-10-27 | 2012-05-03 | Haeng-Suk Chae | Method and apparatus for providing user interface for media contents in user equipment |
US8464153B2 (en) * | 2011-03-01 | 2013-06-11 | Lucasfilm Entertainment Company Ltd. | Copying an object in an animation creation application |
US9335902B2 (en) | 2011-03-01 | 2016-05-10 | Lucasfilm Entertainment Company, Ltd. | Copying an object in an animation creation application |
US20120226983A1 (en) * | 2011-03-01 | 2012-09-06 | Lucasfilm Entertainment Company Ltd. | Copying an Object in an Animation Creation Application |
US10104438B1 (en) * | 2013-03-15 | 2018-10-16 | Cox Communications, Inc | Automatic population of a programming guide mosaic screen |
US20150356877A1 (en) * | 2014-06-06 | 2015-12-10 | Catherine Ann Downey | Visual organization architecture system |
Also Published As
Publication number | Publication date |
---|---|
US7231607B2 (en) | 2007-06-12 |
US20040070593A1 (en) | 2004-04-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7231607B2 (en) | Mosaic-like user interface for video selection and display | |
EP1590186B1 (en) | Mosaic-like user interface for video selection and display | |
US20120198336A1 (en) | Grid-Like Guided User Interface for Video Selection and Display | |
US9843841B2 (en) | High density interactive media guide | |
US9129407B2 (en) | Information processing apparatus, control method for use therein, and computer program | |
CN100492351C (en) | Device for constructing search inquiry and method and system for searching database | |
US8432358B2 (en) | Methods and systems for enhancing television applications using 3D pointing | |
US8041155B2 (en) | Image display apparatus and computer program product | |
JP4142119B2 (en) | Method and apparatus for detecting and selecting desired data from a large schedule of data items using a controller such as a television and a television remote control | |
JP5632571B2 (en) | User interface to automatically generate keyword search criteria and provide ergonomic expressions | |
KR101190462B1 (en) | Scaling and layout methods and systems for handling one-to-many objects | |
US7734680B1 (en) | Method and apparatus for realizing personalized information from multiple information sources | |
US20050097135A1 (en) | Touch panel user interface | |
US8869211B2 (en) | Zoomable content recommendation system | |
US20100057722A1 (en) | Image processing apparatus, method, and computer program product | |
US20060112352A1 (en) | Video program menu system and menu system control device thereof | |
CN1692352A (en) | User interface providing automatic organization and filtering of search criteria | |
JP2003529155A (en) | Search user interface to provide a mechanism for manipulation of explicit and implicit criteria | |
JP2003526144A (en) | Method and apparatus for defining search queries and user profiles and viewing search results | |
KR20070093084A (en) | Distributed software construction for user interfaces | |
US20160188658A1 (en) | Visual search and recommendation user interface and apparatus | |
US20070245247A1 (en) | Grid-like guided user interface for video selection and display | |
CN106599170A (en) | Media file browsing method and information processing equipment | |
Lee et al. | User interface design for keyframe-based browsing of digital video | |
CN116975480A (en) | Content preview method, device, computer equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |