KR20130072119A - Panoptic visualization document layout - Google Patents

Abstract

PURPOSE: A panoptic visualization document layout is provided to allow a user to observe a number of pages at the same time and rapidly, and to search visually while using low bandwidth of searching all pages. CONSTITUTION: A search engine (302) receives a request for medium contents, and discriminates document configuration element including the medium contents. The document configuration element includes the medium contents, and is panoptic visualization document collection having document configuration elements having meta data. A layout engine (308) is combined to the search engine, and selects a layout model for visualization expression of panoptic arrangement of the document configuration elements. The layout model is selected according to the meta data related with the document configuration element. [Reference numerals] (302) Search engine; (304) Page storage device; (306) Meta data storage device; (308) Layout engine; (AA) Page; (BB) Meta data; (CC) Layout model; (DD) Layout; (EE) Request

Description

Panoptic visualization document layout {PANOPTIC VISUALIZATION DOCUMENT LAYOUT}

FIELD The present disclosure relates generally to panoptic visualization of documents, and more particularly to panoptic visualization of documents or their document components in a manner that reflects logical relationships between documents / components.

Since information is not appropriate on a single page and / or is provided more efficiently using multiple pages, printed information about a topic is often printed on multiple pages. Multiple pages can be the same source or multiple sources. For example, a technical graphic form of an aircraft may be printed so that other portions of the same drawing may be printed on different pages. Graphics of one assembly on an aircraft may be included in one library or source while graphics of another assembly may be included in a second library or source.

The printed information can also be printed so that one document contains one level of detail about the object while the second document contains a second level of detail about the same object. For example, the shape of the aircraft can be printed so that the exterior of the aircraft is shown as a graphic. Other shapes of the same aircraft can be printed so that the exterior of the aircraft is not visible, but the exterior of the aircraft is provided. Thus, a reader may use other graphics to acquire other information related to the same object.

As another example, the wiring diagrams of wiring systems are often printed over multiple pages because the graphical and textual information provided in the wiring diagram is too large to fit on a single page . Thus, the reader may change the document several times in order to acquire information related to the entire wiring system.

Documents such as engineering diagrams, technical drawings, wiring diagrams, and other appropriate document forms may be used to maintain the aircraft. The document is created to be viewed in printed form. However, such documents are typically stored in electronic form and are shown on a display device of a data processing system. As a result, the reader is viewed through other documents that may be on other forms of media. This form of review can be more time-consuming than is required to find information related to the aircraft.

Documents associated with a complex system of a system, such as an aircraft, may thus include a large amount of information relating to the complex system and its components, subsystems and components, and the connections and relationships between each element of the complex system. The complexity of the system and often the large amount of information required to describe the system can increase the time required to study the document as well as the difficulty in understanding the complex system and its elements. Not only do users require time to review documents that contain a large amount of information, but also the time and patience to study the information to understand how complex systems and their elements relate to each other may also be required.

It is an object of the present invention to provide a method and apparatus for considering at least some of the problems discussed above as well as other possible problems.

Exemplary embodiments of the present invention generally relate to a panoptic visualization document layout system, and a corresponding method and a computer readable storage medium. According to an exemplary embodiment, the media content of a document collection reflects a logical relationship between content, which in turn may reflect the relationship between the subjects or objects described by the content. It can be arranged optically in a manner. Arrays can enable users to view content in a single view, and in an array that facilitates a better understanding of the relationship between their subjects or objects and content that might otherwise be difficult to understand. have. In the context of a complex system such as an aircraft that includes a large number of components, subsystems and components, the arrangement not only saves the time required to review a document containing a large amount of information, but also allows the complex system and its elements to interact with each other. This can save time in understanding how to relate to and facilitate the difficulty of studying information. When reflected in a panoptic array, various relationships can be made customizable and, moreover, can facilitate understanding of various users. Thus, example embodiments may facilitate the difficulty and time requirements for retrieving even the largest amount of information included in some document collections.

According to one aspect of an example embodiment, a system includes a search engine configured to receive a request for media content and identify a document component that contains the requested media content. In this regard, the identified document component is a panoptic visualization document collection with a plurality of document components, each of which includes respective media content and has associated metadata that provides information about each document component.

The system of this aspect also includes a layout engine coupled to a search engine and configured to select a layout model from a plurality of layout models for a panopically arranged visual representation of the plurality of document components. The layout model of this aspect is selected in accordance with the associated metadata for the identified document component. In one example, the identified document component is an electronic document of a panoptic visualization document collection, and the associated metadata for the identified document component provides information regarding the type of each document; In this example, the layout engine may be configured to select a layout model according to the type of each document. In one example, the associated metadata for the identified document component provides information about the media content of each document component; In this example, the layout engine may be configured to select a layout model according to the media content of the identified document component.

The associated metadata for the identified document component includes information identifying one or more links between the identified document component and one or more other document components. Thus, the layout engine is also configured to retrieve a number of document components, including the identified document component and other document component (s) identified according to associated metadata for the identified document component.

The layout engine is also configured to generate a layout of a panoptically arranged visual representation of the retrieved document component according to the selected layout model and associated metadata for the retrieved document component and the retrieved document component. The layout engine is then configured to communicate the layout.

In one example, the associated metadata for each of the retrieved document components provides information specifying the size, position, and / or depth of the visual representation of each document component in the layout, the one or more other Can be specified with respect to the retrieved document component. In this example, for each retrieved document component, the layout engine may be configured to generate the layout according to the size, location, and / or depth specified by the information provided in the associated metadata.

In one other example, for each one or more retrieved document components, the document component may be in a state that includes a visible representation at each resolution of the document component, and the associated metadata is associated with each document component in the layout. Information specifying at least the size of the visible representation may be provided. In this example, for each one or more retrieved document components, the layout engine may be configured to retrieve the document components for visible representation at a resolution that matches the size specified by the information provided in the associated metadata. And in another example, for each one or more retrieved document components, as sizes are specified with respect to one or more other retrieved document components, the associated metadata specifies at least the size of the visible representation of each document component in the layout. Information can be provided.

In one example, the layout engine may be further configured to receive a request for another panoptic arrangement of the visual representation of the retrieved document component. In this example, the layout engine may be configured to select another layout model from the plurality of layout models in response to the request. And the layout engine is configured to phantom rearrange the visual representation of the retrieved document component according to the selected other layout model and associated metadata for the retrieved document component and the retrieved document component. It can be configured to generate different layouts of document components.

In another aspect of an example embodiment, a method and a computer-readable storage medium are provided for placing a document for panoptic visualization. A computer readable storage medium having portions of computer readable program code responsive to execution by a processor include at least:

Receive a request for media content and identify a document component that contains the requested media content, wherein the identified document components each contain associated media content and provide information about each document component as well as providing information about each document component. A panoptic visualization document with multiple document components with data;

Selecting a layout model from the plurality of layout models for a panopically arranged visual representation of the plurality of document components, wherein the layout model is selected according to the associated metadata for the identified document component;

Retrieve a number of document components, including the identified document component and one or more other document components identified according to associated metadata for the identified document component, each metadata being identified with a document component and each one Further comprising information identifying one or more links between one or more other document components;

Generate a layout of a panoptically arranged visual representation of the retrieved document component according to the selected layout model and associated metadata for the retrieved document component and the retrieved document component;

To communicate the layout;

Can cause the device.

The computer readable storage medium may also include associated metadata for the identified document component that provides information about the type of each document, and the apparatus may be caused to select a layout model according to the type of each document. . The associated metadata for the identified document component provides information about the media content of each document component, and the apparatus selects a layout model according to the media content of the identified document component. The associated metadata for each retrieved document component can also provide information specifying one or more sizes, positions or depths of the visual representation of each document component in the layout, and for each retrieved document component, the device is associated with The layout may be generated according to one or more sizes, positions or depths specified by the information provided in the metadata. The retrieved document component, which may include size, position, or depth, is specified with respect to one or more other retrieved document components.

For each of the retrieved document components, the document component may be in a state that includes a visible representation at each resolution of the document component, and the associated metadata specifies at least the size of the visible representation of each document component in the layout. Provides information, and for each one or more retrieved document components, the device may retrieve document components for visual representation at a resolution that matches the size specified by the information provided in the associated metadata.

For each one or more retrieved document components, the associated metadata can provide information specifying at least the size of the visible representation of each document component in the layout, the size being specified with respect to one or more other retrieved document components.

The computer readable storage device may also receive the request for another panoptic arrangement of the visual representation of the retrieved document component; In response, it is possible to select another layout model from the plurality of layout models; Generate different layouts of the retrieved document components, including phantom rearrangement of the visual representations of the retrieved document components according to the selected layout model and associated metadata for the retrieved document components and retrieved document components. Can be.

The features, functions, and advantages disclosed herein may be achieved independently in various exemplary embodiments, or may be combined in other exemplary embodiments that may be learned by reference to the following description and drawings in more detail.

1 is a diagram of a panoptic visualization system according to an example embodiment.
2 is a diagram of a panoptic visualization document collection system according to one example embodiment.
3 is a diagram of a panoptic visualization document layout system according to one exemplary embodiment.
4 is a diagram of a panoptic visualization document navigation system, according to one exemplary embodiment.
5-16 are diagrams schematically illustrating an example of a suitable layout model in accordance with an exemplary embodiment.
17-21 illustrate examples of layout of a page, which can be displayed in a GUI having a predetermined viewable area and can be navigated by a user, according to an exemplary embodiment of the present invention. .

Some embodiments of the invention are described below with reference to the drawings, in which some but not all of the invention are shown. Indeed, various embodiments of the invention may be embodied in many other forms and should not be construed as limited to the embodiments set forth herein; Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the aspects of the invention to those skilled in the art. For example, references such as first, second, etc. should not be construed as encompassing a particular order, unless expressly stated otherwise. Also, something may be described as something else (unless stated otherwise) below, and vice versa; Likewise, something described as being left to the other can be substituted for the right, and vice versa. Like reference numerals are used throughout to refer to like elements.

Exemplary embodiments of the present invention generally relate to panoptic visualization of documents, and more particularly to panoptic visualization of documents or their document components in a way that reflects the logical relationships between documents / components. Exemplary embodiments are described first with reference to aerospace applications. However, it should be understood that the example embodiments may be used in connection with various other applications, both aerospace and aerospace.

Referring to FIG. 1, a panoptic visualization system 100 is shown in accordance with an exemplary embodiment of the present invention. The system may include a number of different subsystems (each of the individual systems) for performing one or more functions or operations with respect to one or more electronic documents. As shown, for example, the system may include a document collection system 102, a document layout system 104, and / or a document navigation system 106. Although shown as part of the panoptic visualization system, one or more document collection systems, layout systems, and / or navigation systems may instead be separate from, but in communication with, the panoptic visualization system. It should also be understood that one or more subsystems may function or operate as a separate system without being associated with other subsystems. Furthermore, it should be understood that the veneer-optic visualization system may include one or more additional or different subsystems other than those shown in Fig.

As described herein, an electronic document (or simply a document) can be any electronic medium content that can be visualized in electronic and / or printed (or printable) form. The media content of the document may include one or more text, graphics, or other visible content such as still images, video, and the like. A document may be in many different forms of a document in which the form of the document can be defined by one or more characteristics of the document, such as its format, media content, and the like. Examples of suitable forms of documents include computer-aided design (CAD) documents (e.g., CAD, CATDrawing, CATPart, CATProduct, CATProcess, cgr, DWG, DXF, DWF, etc.), text- (Such as ANS, ASC, DOC, DOCX, HTML, PDF, RTF, TXT, WPD, etc.), presentation documents (e.g., PDP, PPT, etc.), graphic documents (e.g., BMP, GIF, JPEG, JP2, PNG, PSD , PSP, RAW, TIFF, etc.), video documents (e.g., AVI, MPEG, QuickTime, WMV, etc.). Other examples of suitable forms of documents include legal documents (e.g., court decisions, briefs, patents, etc.), books, articles, web pages, screenshots, service bulletins, engineering diagrams, warranties, technical drawings, wiring diagrams, and the like. Another example of a suitable form of document includes data sets such as engineering design data, wiring data, troubleshooting data, business data, and the like.

A document may consist of one or more constituent document components that can group the media content, such as between basic breaking points. The document component may depend on the type of document and may include, for example, electronic pages, slides, diagrams, drawings, still images, videos, etc. can do. A document component may sometimes be referred to as a " page "although a document component does not necessarily have to be an electronic page as it includes other types of components. If the document includes only one component, the document and its components may be one and the same.

As described herein, a reference may be made to a document composed of constituent pages. However, it should be understood that the example embodiments are equally applicable to the group (collection) of documents that make up a component document, with or without a component page. Thus, the functions performed in connection with the document can be performed equally with respect to a group of documents, and the functions performed in connection with the page can be performed equally with respect to the component document.

Each page may be formed of data whose visual representation (or rather its media content) can be generated in electronic and / or printed (or printable) form. The visual representation of a page may sometimes be referred to simply as a page or "image ", although not necessarily including a still image as the page may include other forms of media content.

A page may include media content that comprises one or more subjects and reflects or otherwise forms the subject (s). Sometimes, therefore, a page can be referred to describe the subject (s) and / or the object (s) of the subject (s). By way of example, a page may have an aircraft as its subject and may include an external or internal observation or a section of an external / internal observation of the aircraft as object (s), or a page may have external / And may include sections of external observations as objects. As another example, a page may have an aircraft instrument panel as its subject and may include gauges of the instrument panel as a subject.

In general, documents and / or their pages in accordance with example embodiments may have one or more logical relationships with each other. As will be described in greater detail below, at this time, the document collection system 102 of the plate optic visualization system 100 may include a collection of document optics (such as a plate optic visualization document collection) as pages collected as a document collection for plate optic visualization, Lt; RTI ID = 0.0 > and / or < / RTI > collect pages. The document layout system 104 can be generally configured to generate a layout of plate-optically-arranged, logically-related pages of a plate-optically visualized document collection, such as a collection from a document collection system. The document navigation system 106 may be used to navigate a visible representation of the layout of the page-optically-arranged, logically-related pages of the plate-optically visualized document collection, such as the layout generated by the document layout system And may be generally configured to select and provide navigation option (s). The visual representation of the layout can sometimes be referred to simply as a layout.

Thus, an exemplary embodiment of the present invention, in the context of a complex system such as an aircraft in one example, may collect pages of a document according to logical relationships between pages that may reflect structural relationships between the elements. Pages can be arranged plate-optically in a way that reflects logical relationships and, in various instances, structural relationships. The arrangement allows the user to view the page in a way that facilitates a better understanding of the relationship, which may otherwise be difficult to understand with a single observation. For example, in the context of a complex system, the arrangement not only saves time required to review a document containing a large amount of information, but also saves time understanding the complex system and how its elements are related to one another And can facilitate the difficulty of studying information in addition to information.

Reference is made to FIGS. 2, 3, and 4 that describe more specific examples of suitable document collection systems, document layout systems, and document navigation systems, respectively, in accordance with an exemplary embodiment of the present invention.

2 illustrates a document collection system 200 according to one example embodiment. As shown, the document collection system may include a document parser 202 configured to receive and decompose one or more electronic documents into a plurality of component pages (document components), each containing a respective media content have. Documents in one example may be exploded according to the type of document (eg, CAD document, presentation document, graphic document, video document, legal document, book, article, web page, engineering figure, technical drawing, wiring figure, etc.). have. Thus, the document parser can also be configured to identify the type of document based on the format of the document, business rules, or by user input.

The document collection system 200 may also include a colligator 204 coupled to the document parser 202 and configured to associate pages. In this regard, collaging of the page may include, for each of the plurality of one or more pages, a collator configured to identify one or more links between the page and a plurality of one or more other pages. One example link (s) may be identified according to the document, the form of the document, and / or the media content of the page and other page (s). And, in one example, link (s) may be defined according to one or more business rules, logic, or the like. These link (s) may establish one or more logical relationships between the page and the other page (s).

In one example, a link can be identified between pages that share a common document (a component of the same document). In one example, a link may be identified between pages adjacent to each other in a predetermined sequence, such as a time sequence, a spatial sequence or an acquisition sequence of documents or an order sequence in a common document. . In some examples, the link may be identified according to the page's subject (s) or object (s). For example, a link may be identified between pages that share a common subject or common object. In one example, a link can be identified between pages where one object is the subject (object-subject) of another, or one subject is an object (subject-object) of another.

In one example, links can be identified between related pages by parent-child relationships. In one example, a link may be identified between pages of an instance where one of the pages includes a reference or link to that media content. In this regard, a court decision may include a reference to another court decision (e.g., in the body of a court decision, or in a footnote, endnote, etc.), or the page may include a hyperlink to another page (hyperlink). And in yet another example, the link may be identified between pages by user input specifying the link between the pages.

In addition to identifying the link (s) from one page to another, the collator 204 may also, for each of the one or more pages, extract, generate, Lt; / RTI > For a page, its associated metadata may provide a number of different pieces of information about the page. For example, the metadata may provide information identifying the link between the page and the other page (s) in the metadata associated with the page. This information may include the names or other identifiers of other page (s) linked to the page and may also include logical relationship (s) established by the link (s) between them Such as a common document, a subject and / or object, an adjacency, an object-subject-object, a parent-child, a reference / link, a user-specific, etc.).

In addition to the link (s), the associated metadata for the page may include another piece of one or more pieces of information about the page. For example, metadata may be associated with a document whose page is a component, such as a document's name or other identifier, and / or author, size, and / or time of creation or last revision of the document. Can be provided. Also, for example, the metadata may provide information about one or more content restrictions that are authorized or authorized for the page, such as access restriction, editing or change restriction, and / or encryption of the page.

The metadata may also provide information about the media content of the page. This information may include, for example, identifying the subject (s) and / or object (s) of the page, the portion of the page containing one or more object (s), and / . In various examples, links between pages that share a common subject, object, or object-subject or subject-object relationship can be deduced from metadata identifying the subject (s) and / or object (s) of each document have. In these examples, the specification of the subject (s) of the page and / or the object (s) may be sufficient as information identifying the appropriate link (s) between the pages.

In one example, the collage of pages may further comprise a collator 204 configured to identify one or more layout models for at least some pages. In this example, the associated metadata extracted, generated, or otherwise provided by the collator for the page may further include information identifying an array of each page in each of the one or more layout models. For each layout model, this may include specifying, for example, the size, position and / or depth (z-order) (or in particular its visual representation) of the page. The layout model (s) can be identified and can be specified in any of a number of different ways, such as size, location, and / or depth, such as following one or more business rules, logic,

Examples of suitable layout models (sometimes referred to as style of expression) include brickwall, partial brickwall, hierarchy, shape, center out, top / triangle -down / triangulated, center-out triangulated, size dominance, overlap through detail, master-detail through depth, Load shape, facet, mixed-media / static-and-dynamic, and the like. Other examples may include combinations of one or more of the layout models. Each of a number of exemplary layout models is described in further detail below.

In one example, the size of a page in a layout model can be specified as an absolute size or a relative size, any of which can be given in a number of different ways. In various examples, the size of the page may be related to the size in pixels, thus giving the page's pixel count or pixel resolution. In one example, the absolute size of the page may be given in height and width dimensions (e.g., NxM pixels). In another example, the size of a page may be specified as a relative size based on the size of one or more other pages to which the page is logically related. For example, the relative size may be given in a number of different ways, such as a percentage, a fraction, or a multiple of another page (s); Or the relative size can be simply given by a smaller, larger or equivalent representation in size for the other page (s). For pages related by parent-child relationships, for example, the size of a child page may be specified in half the size of its parent. In some cases where the sizes are relative, the size of each other page (s) may be given as their associated metadata, and may be given as an absolute size and a relative size based on the size of another page.

As with the size, in one example, the location of the page in the layout model (sometimes referred to as the position) may be specified as an absolute or relative position, but in either case, It can be given in other ways. Likewise, the depth of a page in a layout model can be specified as an absolute depth or a relative depth, any of which can be given in a number of different ways. For example, the absolute position of the page may be given as the x, y coordinates of the coordinate system rewriting the layout model, and / or the absolute depth may be given as the z coordinate of the coordinate system. In another example, the relative position of a page may be given in terms of x, y coordinates relative to the point in the layout model or other page (s). In another example, the relative position can be simply given by the top, bottom, left, or right side of the point or other page (s) in the layout model. Likewise, in one example, the relative depth can be simply given by an indication before or after another page (s) in the layout model. For any given position and / or depth relative to each other, the position and / or depth of each other page (s) may be given as their associated metadata and may be given as absolute or relative position and / or depth.

The collator 204 may be configured to communicate the page and metadata as a plate-optic visualization document and to communicate a collection of predetermined multiple other destinations. In one example, the collator may be configured to communicate page and metadata to each reservoir 206, 208 for later retrieval. The reservoir can reside with the document collection system 200, or communicate with the document collection system in isolation. Pages and metadata may be formatted and stored in any of a number of different ways, and thus their storage may be any of a number of different forms. Examples of suitable forms of the reservoir include file storage, database storage, cloud storage, and the like.

In various examples, a page may be compressed before the page is stored in each reservoir 206, or otherwise processed for easier storage and retrieval. As shown, for example, the system may include a tyler 210, coupled to a collator, configured to communicate with a page. The tyler can be configured to generate a visible representation of the page at each resolution for the zoom levels of the page, for each of the one or more pages. As described herein, a page (or rather a visual representation thereof) at each zoom level is generally referred to as a "sub-image ", sometimes referred to as a separate version or copy of the page, May be considered. As suggested above, however, the sub-image of a page does not necessarily need to include a still image as the page may include other forms of media content.

In addition to or instead of generating a sub-image of the page, the tyler 210 may be configured to progressively enlarge the sub-image over the zoom level, And may be configured to partition into tiles, covering the spatial area. This may facilitate searching, panning and / or zooming of the page, as will be described further below. At this time, the tyler may be further configured to communicate a tile of sub-images of the page, such as for a page store. Before communicating the tiles, however, Tyler can be further configured to compress the tiles if desired.

In another specific example, tyler 210 generates multiple resolutions of a page at each zoom level hierarchically arranged from a top zoom level to a base zoom level through one or more intermediate zoom levels . Each zoom level includes sub-images of the entire page at different resolutions; The sub-image of the page through the zoom level may have the same native aspect ratio (the ratio of the width of the image to its height). In one example, the highest zoom level (level 0) may comprise a sub-image of the entire page at its lowest resolution, and the one or more intermediate zoom levels are progressively higher resolution (levels directly below level 0). 1, level 2 directly below level 1, etc.), and the default zoom level (level L) may contain sub-images of the entire page at its highest (or maximum) resolution. Can be.

Each sub-image of the page may be generated in any of a number of different ways. In one example, one of the sub-images may be received by the tyler 210, such as a full-resolution sub-image. Tyler may then be configured to generate another sub-image at a lower resolution, just by down-sampling the full-resolution sub-image.

As shown, tyler 210 may be configured to divide the sub-image through the zoom level into tiles, progressively larger in number, each covering the spatial region of the sub-image at each zoom level. A tile may have a fixed size (resolution) over and within the zoom level, and therefore a sub-image composed of a larger number of tiles generally has a higher resolution than a sub-image composed of fewer tiles Lt; / RTI > Thus, each zoom level can be considered a higher zoom level for a further predetermined zoom level (the sub-image at the zoom level is at a higher resolution than the sub-image at the further predetermined zoom level) . Likewise, each zoom level may take into account a lower zoom level with respect to a lower predetermined zoom level (the sub-image at the zoom level is at a lower resolution than the sub-image at the lower predetermined zoom level) ).

In one example, the sub-image at each zoom level can be half the resolution of the zoom level just below it, and can be twice the resolution of the zoom level just above it (resolution can be increased by a factor of two Increased or decreased). In this example, the zoom level 1 is given by t _l = t ₀ x 4 ^l , where l = 0, 1, 2, ... L, and t ₀ represent the number of tiles at the maximum zoom level (level 0). In another specific example involving four zoom levels 0, 1, 2 and 3 (L = 3), the maximum zoom-level sub-image consists of one tile (t ₀ = 1) Level (level 1) sub-image can be composed of four tiles, the second intermediate zoom-level (level 2) sub-image can be composed of sixteen tiles, and the basic zoom- The sub-image may be composed of 64 tiles.

In one example, the pages covered by multiple tiles at one zoom level may be covered by an increase or a decrease in the number of tiles at a higher or lower zoom level, respectively, Or an increase or decrease. Similarly, regions of a page covered by one tile at one zoom level can be covered by multiple (e.g., 4) tiles at adjacent higher zoom levels, thus increasing the resolution of each region of the page . And the area of a page covered by multiple tiles at one zoom level can be covered by one tile at a contiguous lower zoom level, thus causing a reduction in the resolution of each area of the page.

In one example, a page (or region thereof) at a particular resolution may be displayed by the tile (s) covering the page at a zoom level equivalent to a particular resolution. Zoom-in of a page can be performed by replacing the displayed tile (s) with an increased number of tiles covering the page at a higher zoom level. The zoom-out of the page may then be effected by replacing the displayed tile (s) with a reduced number of tiles (s) covering the page at a lower zoom level. And, because the page can be divided into tiles, in an example where not all but the entire page is visible with a graphical user interface (GUI) on which the page is displayed, only those tiles covering the observable portion of the page are retrieved and Can be displayed.

Reference is made to FIG. 3, which illustrates a document layout system 300 according to one example embodiment. As described above, the document layout system 300 may be an example of the document layout system 104 of the plate-optic visualization system 100 of FIG. The document layout system can be generally configured to generate a layout of plate-optically-arranged, logically related pages of plate-optically visualized document collections. The collection may be, for example, a collection from the document collection system 102, or, in one example, from the document collection system 200 of FIG.

As shown in FIG. 3, the document layout system 300 includes a search interface, such as a request interface, configured to receive a request for media content and to identify one or more pages containing the requested media content, A search engine 302 may be included. The identified pages may be panel-optic visualized document collections, each having a plurality of pages with associated metadata, each containing media content and providing information about each page. The page and metadata may be stored in each of the reservoirs 304, 306, which may correspond to each of the reservoirs 206, 208 shown in FIG. 2 in one example.

The search engine 302 may be configured to identify the page (s) in a number of different ways merely based on the relevant metadata of the page of the collection. For example, the request may include keyword matching or having relevance to the subject or object of the page (s) of the collection. In response to the request, the search engine may then be configured to retrieve a metadata store 306 for the associated metadata of one or more page (s), including media content matching or relevance to the request.

The document layout system 300 is also configured to select a layout model (a style of presentation) from a plurality of layout models for a plurality of plate-optically-arranged pages coupled to the search engine 302 and including identified pages A layout generator, and the like. The layout model may be maintained in each repository, such as a file repository, a database repository, a cloud repository, etc., and may be formatted and stored in any of a number of different ways depending on each repository.

A layout model may include any number of different types of layouts for laying out pages optically. Examples of suitable layout models include, but are not limited to, barriers, partial barriers, layers, shapes, central overhangs, top-down / triangular, center-overhang triangles, size dominance, Master-detail, load shapes, facets, mixed-media / static-dynamic, Other examples may include combinations of one or more of the layout models.

The layout engine 308 may be configured to select a layout model in a number of different ways. In one example, the layout engine may be configured to select a layout model according to the associated metadata for the identified page. The search engine 302 may thus be configured to communicate relevant metadata for the identified page to the layout engine, and in turn, to select a layout model according to each related metadata.

As described above, the associated metadata for a page may provide information about the type of document that the page is a component of, and / or information about the media content of the page. In one example, at this time, the layout engine 308 may determine that the identified page is a component (e.g., a CAD document, a presentation document, a graphic document, a video document, a legal document, a book, an article, , The technical drawing (s), the wiring diagram (s), etc.), depending on the type of the document. In another example, the layout engine may be configured to select a layout model according to the media content of the identified page, such as one or more of its subject (s) and / or object (s).

Also as noted above, the associated metadata for the page may include information identifying the link (s) between the page of the collection and the other page (s). The layout engine 308 may thus also be configured to retrieve the identified page (s) and the identified other page (s) according to the associated metadata for the identified page. These pages may be retrieved from each reservoir 304.

The layout engine 308 may be configured to generate a layout of the retrieved pages, which are plate-optically-arranged according to the selected layout model and the retrieved page and associated metadata. In addition to page retrieval, an example layout engine at this time may also be configured to retrieve related metadata, such as from each store 306, The layout engine may then be configured to communicate a layout, such as a GUI for displaying the layout, or a printer for generating the printing of the layout.

As suggested, the layout may define a plate-like arrangement of the retrieved pages according to the selected layout model. For an array of layouts, the pages may each have a specific size, position and / or depth (z-order). The size, position, and / or depth of each page of the layout may be absolute or relative to other page (s) of the layout, and may be determinable or otherwise determinable in a number of different ways. In one example, the size, position and / or depth may be specified or otherwise determinable from the definition of a selected one of the layout models. Additionally or alternatively, the associated metadata for each page of the layout, for example, can provide information specifying the size, position and / or depth (z-order) in the layout, as described above. In these examples, the layout engine 308 may be configured to generate a layout in accordance with the size, location, and / or depth specified by the selected layout model and / or the associated metadata of the page of the layout.

The aspect ratios of the pages may be their inherent aspect ratios. In various examples, however, the layout model may define, for each of the one or more pages, whether or not to specify a different aspect ratio than the unique aspect ratio of each page. In these examples, the layout engine 308 may be further configured to generate a layout according to another, non-unique aspect ratio (s) of page (s).

In one alternative example, one or more pages of the layout may be in a state including a visible representation (e.g., a sub-image) at each resolution. For each of these pages, the layout engine 308 may be configured to retrieve a page for a visual representation at a resolution that matches or closest matches the size specified by the selected layout model and / or associated metadata. This may include, for example, retrieving the sub-image of the page at each resolution or at the closest resolution.

The layout generated by the layout engine 308 can be generated dynamically according to the selected layout model so that different layouts of pages can be realized by changing the selected layout model. Other layouts may also be implemented in a number of different ways, such as based on associated metadata of a page of layouts or one or more time-based factors. In one example, the layout engine may then be further configured to receive a request for a different version of the retrieved page. In this example, the layout engine may be configured to select a different layout model from a plurality of layout models in response to the request. The layout engine can then be configured to generate different layouts of the retrieved pages. This may include a layout engine configured to optically rearrange the retrieved pages according to other selected layout models and associated metadata for the retrieved pages and retrieved pages.

As noted above, the layout model may include any number of different types of layouts for laying out pages optically. In the layout model, the logical relationship (s) established by the link (s) between the pages can be represented by an array of pages, either in position or depth (z-order) or both. In one example, the logical relationship may be represented by the proximity of the page to each other at their location, and / or their relative depth. Additionally, the one or more layout models may define or imply a navigation path between a document associated with each other and / or a load shape for loading a page of a layout generated according to each layout model. . Reference is made to FIGS. 5-16, which diagrammatically illustrate examples of suitable layout models. As shown, these examples include master-detail through a barrier, a partial barrier, a layer, a shape, a central overhang, a top-down / triangular, a center-overtop triangulation, a size dominance, Facet, mixed-media / static-dynamic, and the like.

5 illustrates a barrier layout model 500 according to one example embodiment in which the page 502 may be arranged in one or more columns and one or more rows. As shown, the barrier layout model may be characterized by a consistent end-to-end orientation consistent with the consistent page size and / or aspect ratio along one or more rows and / or rows have. This form of the layout model can be used for general search results. In one example, the layout model may provide a horizontal orientation with respect to a chapter location, with a vertical orientation associated with a progressive increase in page length.

Although not separately shown, the partial barrier layout model may consider a superset of barrier layout model 500. The partial barrier layout model may likewise be characterized by clusters of pages that may be consistent at least in size and / or aspect ratio within each cluster. In this layout model, the clusters can be related by the associated metadata of each page, such as their media content, author, time of creation, last version, and so on.

6 illustrates a hierarchical layout model 600 according to one example embodiment in which pages may be arranged hierarchically in position and / or size. Hierarchical relationships between pages (pages that are hierarchically related) can be represented by their associated metadata in a number of different ways. For example, a hierarchical relationship may be represented by a parent-child relationship between pages. In another example, the hierarchical relationship may be such that the object of one page higher in the hierarchy can be the subject (s) of the lower page (s) in the hierarchy, and at least some of each other page (s) May be represented by an object-subject or subject-object relationship that may be at the same level in the hierarchy. In this example, the subject of one page may be the master view and the subject (s) of the other page (s) may be a detailed view (s) of the object )). In another example, the hierarchical relationship may be such that one higher page in the hierarchy has the link (s) (e.g., citations, hyperlinks, etc.) or reference (s) to the lower document , And may be represented by a relationship in which at least some of each other document (s) may be at the same level in the hierarchy.

In one example of the hierarchical layout model 600, higher pages in the hierarchy may be located above the lower in the hierarchy (top-down), and / or than lower in the hierarchy. Can be larger in size. Pages in such a layout model may not be consistent in size or aspect ratio. The higher the page in the hierarchy may dominate the lower in the hierarchy and the lower the page in the hierarchy can be constrained in the x-direction by the higher page width in the hierarchy.

In particular, for example, the highest page 602 in the hierarchy can be located at the top, and can be sized according to the full resolution of the page with its unique aspect ratio. The next highest page (s) 604 in the hierarchy may be located just below the highest page at a smaller size than the highest page, and collectively next for the width of the highest page according to the aspect ratio. Constrain the highest page (s) of. This pattern may be repeated for the third highest page (s) 606 in the hierarchy below each one of the next highest page, the fourth highest page (s) 608 in the hierarchy, and so forth. . This layout model can provide a single page with the associated page cited in each page beneath it in one example.

FIG. 7 illustrates a shape layout model 700 according to one example embodiment in which the model mimics a page-related physical structure, such as US terrain or aircraft. In one example, the page 702 may be arranged within the boundaries of the visible representation 704 (two or three dimensional representation) of the physical structure, where the location (s) of the page (s) is relative to the structure. May match the relationship of their media content. For example, a page about an aircraft's wing tip area (e.g., by subject or object) may be located in each area of the aircraft's visual representation. In another example, pages about court decisions from other states in the United States could be located in areas of the United States' visible representation consistent with the state in which the decision was made.

In the shape layout model 700, in various examples, one or more subsets of the page may be arranged in the cluster 706 in each region of the visual representation of the physical structure. In these examples, the clusters can be arranged respectively in accordance with the other of the layout models, in both the size of the page of the cluster and the item of the position.

8 illustrates a center-out layout model 800 according to one exemplary embodiment. This layout model is by highlighting a centrally-located primary page 802, such as a page identified by a search engine (eg, search engine 302) searching for media content. Can be characterized. Pages 804 associated with the main page (eg, hierarchically related) may be located around the main page in a 360 degree arrangement. Pages in this layout model are not consistent in size or aspect ratio. In one example, the layout model is a layout model in which the main page is related to a page that is pre (upper), post (lower) and contemporaneous (beside) . ≪ / RTI > An example of this type of layout is a collection of web pages or documents that are cross-hyperlinked with pages that are part of a document tree that causes a central, main page.

9 illustrates a top-down / triangulated layout model 900 according to one exemplary embodiment. This layout model may be similar to the combination of barrier layout model 500 and hierarchical layout model 600 and may be characterized by a top-down arrangement of hierarchically related pages 902. As with the barrier layout model, the pages in this layout model may be consistent with at least the size and / or aspect ratio within the page at the same level of the hierarchy, which may indicate the importance of the pages relative to each other. As with the hierarchical layout model, in one example, the higher page in the hierarchy may be on the lower page (in the y-direction) in the hierarchy; In comparison with the hierarchical layout model, the width of the lower page may not be constrained by the higher page in the x-direction. In one example, the top-down / triangular layout model may provide a single page as a node in the graph tree of the associated page.

10 illustrates a center-out triangulated layout model 1000 according to one exemplary embodiment. This layout model, like the centrally projected layout model 800, can be characterized by prominent centrally projected main page 1002. In the centrally projected triangulation layout model, pages 1004 associated with (eg, hierarchically related) the main page may be located above and / or below the main page. Also, as with the central extrusion layout model, the pages of the central extruded triangulation layout model may not be consistent in size or aspect ratio. The centering triangulated layout model may indicate that the main page is related to the previous (pre) (upper) and later (lower) pages. An example of this type of layout could be a collection of web pages or documents that are hyperlinked with the top page, which is the part of the document tree that causes center, main page, and bottom page pulled from the main page.

11 illustrates a size-dominance layout model 1100, according to an example embodiment. This layout model may be similar to the central protrusion layout model 800. In this regard, the size-dominant layout model distinguishes the centrally located main page 1102 and the page 1104 associated with (eg, hierarchically related) the main page located around the main page in a 360 degree arrangement. Can be characterized by However, this layout model may include one or more main pages, which may be the same size or different sizes, with the two such pages 1102a and 1102b shown. The size of the page in this layout model can convey the relevance or weight of the page relative to each other. An example of this type of layout may be a collection of wiring diagrams having at least associated reference (s) or link (s) on all four axes of primary diagrams. The referenced / linked wiring diagram / schemes may themselves include relationships to additional drawings.

12 illustrates an overlap-through-detail layout model 1200 through details, according to an example embodiment. This layout model can be characterized by the preservation of hierarchical relationships between pages at the arranged depth (z-order). In one example, the higher page 1202 in the hierarchy may be placed on another lower page 1204 in the hierarchy, which in turn may also be placed in another lower page 1206 in the hierarchy. In this layout, pages sharing one or more common objects or other media content may be overlapped 1208 such that the nested object (s) / other media content may be spatially aligned at least partially across the page.

Navigating a layout (or in particular its visual representation) may include zooming into or out of the presentation. Enlarging the layout according to the superimposed layout model 1200 through the details may include increasing the size and resolution of the page, in various examples of one example. However, in this layout model, zooming into the layout may also include rendering the overlaying page invisible so that the overlaid pages beneath it may be included, (Or rather the part lying on it) can come into view. Conversely, zooming out of a layout may also include showing the overlying page that is invisible, so that each page comes into view, and one or more overlaid pages (or rather the overlying ones) Out. In one example, rendering the page invisible can include increasing transparency (or reducing its opacity) of the page during zoom-in, Making the page visible may include increasing the opacity of the page (or reducing its transparency) during zoom-out.

In one example, as shown in FIG. 12, the superimposed layout model 1200 with details including pages 1202, 1204, and 1206 may become less visible as the user enlarges the layout. At some point during the zoom-in, each page can no longer be made observable so that the layout appears to include only pages 1204 and 1206. Zoom-in may continue further, making the page 1204 difficult to see until it is no longer observable, which is the point that the layout indicates to include only the page 1206. In these examples, the invisible pages may remain in the layout, or the layout engine 308 may be configured to remove them from the layout.

Continuing with the example of FIG. 12 where only page 1206 is observable and pages 1202 and 1204 are not visible, page 1204 allows page 1206 to be overlaid upon user zooming out of the layout. . At some point during the zoom-out, each page can be made observable so that the layout is shown to include both pages 1204 and 1206. Reduction may continue further to show page 1202 until it is manageable, which is the point that the layout indicates to include pages 1202, 1204, 1206. In these examples, the overlaid pages (or portions over them) may remain in the layout, or the layout engine 308 may be configured to remove them from the layout.

13 illustrates a master-detail through depth layout model 1300, according to one example embodiment. This layout model is similar to the nested layout model 1200 through details in that the hierarchical relationship between pages can be maintained at their depth (z-order). However, in this layout model, the overlaid pages (e.g., lower in the hierarchy) may be sized and aligned to be consistent with the overallty of the overlay pages (e.g., higher in the hierarchy) .

As with the nested layout model 1200 through the details, the navigation in the master details layout model 1300 through the depth, layout, which may include making the page about the underlying page invisible or visible. It may include expanding or contracting. In the example shown in FIG. 13. Navigating a layout that includes pages 1302, 1304, and 1306 may include making the page overlaid as the user enlarge the layout. Conversely, navigating the layout may include causing the user to view the overlying page as the layout is reduced. In this regard, the master detail layout model through the depth of the multi-page can be as well as implementing a zoom for a page containing multiple sub-images.

14 illustrates a load-shape layout model 1400, according to one exemplary embodiment. This layout model includes several of the other layout models (e.g., central protrusions, centers) that highlight the centrally located main page 1402 and pages 1404 associated with the main page (e.g., hierarchically related). Protruding triangulation). Pages in this layout model may not be consistent in size or aspect ratio. The load geometry layout model may be characterized by the time it takes to load the layout (or in particular its visual representation). In this layout model, non-primary pages may be loaded first after the main page.

An example of the load-shaped layout model 1400 may be a page of media content related to the time at which a page of old media content can be loaded before the main page of the most recent media content. In this context, the timing of the media content may be related to the time-aspects of the subject (s) or object (s) of the media content. For example, a page (eg, page 1404) for a prioring history of court decisions may be loaded before the court decision (eg, page 1402) itself. In another example, the timing of the media content may include a first draft and one or more changes or revisions (eg, page 1404) for the document before the last or current version of the document (eg, page 1402). May be related to the time of creation of the content, such as when loading.

15 illustrates a facet layout model 1500 according to one example embodiment. The facet layout model may be characterized by the arrangement of pages 1502 in a three dimensional (3D) environment, such as in the context of a facet of truncated icosahedron (1504) truncated vertices. For example, each page may be generated from a set of x, y, z coordinates having a known consistent unit vector for orientation. Each page can then be placed in the layout in relation to the viewer's perspective. This layout model may be provided visually in three dimensions, or may be converted into a corresponding two dimensional (2D) arrangement, such as a icosahedron 1506 with the vertices cut in plane.

16 illustrates a mixed-media / static-and-dynamic layout model 1600, according to an example embodiment. The layout model may be a subset of one or more other layout models that may include pages in the form of a mixed media of pages of the layout. For example, the layout model may include one or more static ("S") pages, such as in the case of textual content or still images, and one or more dynamic ("D" . ≪ / RTI > FIG. 16 illustrates a mixed media / static and dynamic layout model that arranges mixed media content, for example, in an arrangement similar to size advantage layout model 1100. As shown, this arrangement may include highlighting centrally located main pages 1602a, 1602b and pages 1604 associated with (eg, hierarchically related) main pages located around the main page. Can be.

4, the document navigation system 400 is shown according to one embodiment. As mentioned above, the document navigation system 400 may be an example of the document navigation system 106 of the plate-optic visualization system 100 of FIG. The document navigation system may be configured to select and provide navigation options (s) for navigating the layout of a page, optically arranged, logically related pages, generally of a veneer visualized document collection. In one example, this may include collection from the document collection system 102 (e.g., document collection system 200). Additionally or alternatively, for example, it may include a layout generated by the document layout system 104 (e.g., document layout system 300).

As shown in FIG. 4, the document navigation system 400 may be configured to receive a layout of pages (document components) of a veneer visualized document collection. The collection may have a plurality of pages, each containing a respective media content, and associated metadata providing information about each page. The layout may include a plate-like array of visible representations of the pages of the layout according to the associated metadata of each page.

The navigation engine 402 may also be configured to select one or more navigation options from a plurality of navigation options for navigating the layout, wherein the navigation options may be selected according to the associated metadata for the pages of the layout. Navigation options may be maintained in each store, such as a file store, a database store, a cloud store, and the like, and may be formatted and stored in any of a number of different ways depending on each store. Likewise, the metadata for the pages of the layout may be stored in each store 404, which in one example may correspond to either or both of the stores 208,306. The navigation engine may also be configured to communicate the selected navigation option, such as for a GUI where the selected navigation option may be provided along the layout.

In one example, the navigation engine 402 may be configured to select a navigation option based on the page (s) of the document (s) whose page of layout is a component, which may be represented in the associated metadata for the page have. In one example, the navigation engine may be configured to select navigation options according to the media content of the page of the layout, such as their subject (s) and / or object (s) It can be done. Examples of suitable navigation options for layout include command tools (e.g., pan, rotate, zoom, obscure / show, home, etc.) ), Annotation tools (e.g., timeline / milestone, callout, etc.), linking tools (such as hyperlinks, hotlinks, hotspots, (e.g., hotspots and the like), navigation path tools (e.g., tracking, recording, etc.), metadata tools (e.g., search, (eg insertion, etc.), page tools (eg, search, filter, cue, activation, size, location, dominance, Logical-relationship (s)), layout-model change, co-navigation, hyper-hypo navigation, printing, etc. Include do.

Relevant metadata for a page of a layout can directly or indirectly affect selected navigation options. In one example, the associated metadata may be retrieved to directly affect the navigation options selected by the navigation engine 402. Additionally or alternatively, for example, the associated metadata for a page can affect their layout, such as by affecting a selected layout model as the layout may be generated. In particular, for example, the layout of the page may be generated in accordance with the layout model selected according to the form of the document (s) of the page, and / or the media content of the page. The layout can then affect the navigation options selected by the navigation engine. Either of the associated metadata may directly or indirectly affect the selected navigation option, and the navigation engine may be referred to as selecting the navigation option according to the associated metadata for the page of the layout.

The document navigation system 400 can also include a request interface 404 coupled to the navigation engine 402 and configured to receive a request in accordance with one or more selected navigation options. The request interface may be configured to communicate the request to the navigation engine. The navigation engine may in turn be further configured to respond to the request and, depending on the request, result in an adjustment of the visual representation of the layout and to communicate the adjustment, such as for the GUI described above. In one example, the navigation engine can be configured to effect adjustment of the visual representation without adjustment of the layout itself. In another example, the navigation engine may be configured to effect adjustment of a visual representation that includes adjustment of the layout.

As suggested above, the selected navigation options can be influenced by the layout and / or the associated metadata for the page of the layout, or the page, or in one or more specific examples. In various examples, at this point, the layout of the other page may result in the selection of one or more other navigation options. For example, the navigation engine 402 may consider the layout of the first page and the layout layout of the second page at different times, with each layout containing a plate-optic arrangement of each page. In this example, the navigation engine may select a first navigation option for the first layout and a second navigation option for the second layout. The first and second pages may include one or more common pages, but in one example, may include one or more other pages. In this example, the first and second layouts may differ in that at least the first and second pages include one or more other pages. In turn, despite the similarity of the first and second pages-the first and second navigation options selected by the navigation engine may comprise one or more other navigation options, the first and second navigation options being one or more common navigation options. It may include an option.

The navigation engine 402 may be configured to select a number of different navigation options for the layout of the page. Many layouts, including many different types of pages of a document, generated in accordance with many different layout models, may include pan, rotate, zoom, obscure / show, (home), and the like. In various examples, some, but not all, of the layout may be observable in the GUI where the layout is displayed. This may be the case, for example, where the size of the layout is larger than the viewable area of the GUI (sometimes referred to as a " view ") or the case where the layout is a page in a 3D environment have. In these examples, the navigation option may include panning and / or rotating to move the layout. This may include one or more pages of the incoming layout, and may additionally or alternatively include one or more pages that go out of sight. Layouts in an observation or a page of a layout coming in through an observation can be retrieved and displayed, while a page out of sight or out of sight can be removed from the display. Moreover, in the example where only a portion of the page comes into view or view, and the page is divided into tiles, only such tiles covering the observable portion of the page can be retrieved and displayed.

The instruction tool may also include zooming into or out of the layout, and thus the page may include increasing or decreasing the size of the layout. Increasing or decreasing the size of such a layout may in turn include increasing or decreasing size (s), and, in various examples of one example, including the resolution (s) of the page.

In one example, a page of the layout may include a sub-image at each resolution for the zoom level of the page. In this example, the layout may include for a sub-image of a page that matches or closest matches the size of a page specified by each page, a selected layout model, and / or associated metadata. At this time, a zoom-in of the layout can be performed by replacing the sub-image of the page with an increased zoom level, and thus with each sub-image at increased resolution. Conversely, a zoom-out of the layout can be performed by replacing the sub-image of the page with a reduced zoom level, and thus with each sub-image at reduced resolution.

In various examples, zooming (in or out) of a page or a layout may be possible in a finer increase than that provided by the page of the layout or the zoom level of one or more pages. The zoom of the page (either alone or as part of the layout) may be for an increase associated with the sub-image of the page being displayed, and the other sub-images of the page may match the increased / Matched. In these examples, for example, zooming may be performed by replacing the sub-image of the page with the corresponding sub-image of the page at a higher / lower resolution. However, in another example, the zoom may be for an increase associated with the sub-image of the page being displayed, and the same sub-image still matches the increased / reduced size of the page closest to the page. In these examples, for example, zooming can be performed by increasing the size of the sub-image of the page without replacing the sub-image with another at a higher / lower resolution.

In another example, a page may include each sub-image, as well as a sub-image that traverses the zoom level, with a larger number of tiles, each of which covers the spatial region of the sub-image at each zoom level It can be divided into groups. In this example, the zoom-in of the layout can be performed by replacing the displayed tile (s) of the page with an increased number of tiles covering the page at the higher zoom level (s). Conversely, the zoom-out of the layout can be performed by replacing the displayed tile with the number of reduced tiles (s) covering the page at the lower zoom level (s). As with panning the layout, enlargement or reduction of the layout can include one or more pages of the incoming layout, and additionally or alternatively, one or more pages out of sight. These pages can be handled in the same way as at higher or lower level (s), panning the layout.

For one or more layouts, in addition to an increase or decrease in page size / resolution of the layout, the zoom option may associate one or more other navigation options to further affect one or more pages. For example, the superimposed layout model 1200 through details and the master details layout model 1300 through depth may be used to zoom-in and zoom-in, such as the method described above with reference to FIGS. 12 and 13. You can associate obscure / show options that can be either invisible or visible about the page being placed during out. However, it should be understood that the invisible / visible option can be used to make one or more pages of the layout invisible or visible, regardless of the zooming option, and regardless of the page overlaid on top of each other.

Multiple navigation options, including the above-described command tool, can result in adjustment of the visual representation of the layout. The home option may thus allow the user to return from the adjusted visible representation to the visible representation.

The navigation options may include annotation tools such as timeline / milestone, callout, and the like. These tools may allow the user to annotate the layout, may be selected for a number of different layouts for different layout models, and include pages of many different types of documents. In various examples, the timeline / milestone option may be applicable to pages that are logically related to each other, especially in a time sequence. In one example, the timeline / milestone can result in a lyric added to the layout that can relate pages of the layout as milestones in the timeline.

The navigation options may include linking tools such as hyperlinks, hotlinks, hotspots, and the like. According to the hyperlinking option, one or more pages (each source) may be linked to the reference (s) or link (s) to the media content of another page (s) or other page (s) . ≪ / RTI > The target page (s) or media content may be in the same panoptic visualization document collection, but not in the same layout or in the same layout, but in the same panoptic visualization document collection. Goals may include page (s) or media content that is not the same plate optic visualization document collection.

The hyperlink option may allow the source page to include an inline in its media content, which is linked content from one or more other pages. This is sometimes referred to as a hot link in particular. The hyperlink option may also allow the user to navigate from the source page to one or more target pages linked to for each source page. In this regard, the hyperlink may be represented in any of a number of different ways, such as text, graphics, and the like. For example, the media content of one page may be formatted as a hyperlink to the media content of another page or another page. In particular, for example, an object depicted on one page may be formatted as a hyperlink to another page that also depicts the object, or more directly to another page. This form of hyperlink is sometimes referred to as a hotspot.

In addition to or instead of the above, for example, navigation options may include navigation path tools such as tracking, recording, and the like. Navigation paths according to an example embodiment may be defined in any number of different ways. In one example, the navigation path may include panning, rotating, layout or zooming and / or repositioning a layout or one or more of its pages, (Hyperlinks) from one page to another page or media content, or otherwise effecting (or rather a visualization of) the adjustment of the layout. The navigation path tool may allow tracking and / or recording of the navigation path followed by the user and accordingly generating the navigation history.

One example navigation option may include a metadata tool, such as a search, filter, insert, etc., that may operate in conjunction with associated metadata for a page of the layout. The search and filter options may allow a user to search for an associated layout for a particular metadata, or to filter the associated metadata to include or exclude specific metadata. Insertion options may include inserting specific metadata for a visible representation of the layout, such as the form of a callout, where the associated metadata includes specific metadata referenced to the page (s) containing the particular metadata Can be accepted.

Navigation options include page tools such as search, filter, cue, activation, size, location, dominance, logical relationship (s) ). Like the metadata tool, the search and filter options may allow the user to search the page of the layout for the particular page (s) or specific media content. In this regard, the search and filter options can relate relevant metadata for the pages of the layout.

The cue option may allow the application of one or more visual effects to one or more pages to draw the user's attention to their page (s) in the layout. The visible effect may be any of a number of different effects. An example of a suitable visual effect is an opaque or translucent boundary of noticeable color (e.g., yellow) around the page (s), an opaque or translucent visible object or shape that is overlaid with the page (s) A semitransparent visible object or shape that is the same or larger in size as well as overlying it. Examples of other suitable visual effects include an increase in the size of the page (s), animation applied to the page (s), and the like.

The visible effect (s) may be triggered in any number of different ways, depending on the page (s) to which the effect (s) are applied. For example, the visual effect (s) may be triggered to indicate the selection of one or more page (s). In this example, the visual effect (s) can be applied to the selected page (s). In this example, additionally or alternatively, the visual effect (s) may be associated with the selected page (s) with a particular logical relationship (e.g., common document sharing, subject. Object, adjacency, object-subject-object, / Link, a specified user, etc.). In another example, the visual effect (s) may be applied to the page (s) to indicate the navigation path followed by the user.

The activation option may be particularly applicable to dynamic pages and may include playing or otherwise controlling video content that may be included in such page (s) (e.g., rewinding, Fast forward, volume, mute, etc.) of the user.

The size, position, and dominance options may allow the user to resize or otherwise rearrange one or more page (s) of the layout, which may in turn create a different layout. These options can be applied to a number of different layouts for different layout models and can include pages of many different types of documents. In one example, however, the dominant option is a layout according to a layout model including dominant pages, such as hierarchy, center protrusion, center-extrusion triangulation, size dominance, load geometry, mixed media / static- In particular.

The logical relationship (s) option may allow the user to add, delete, or otherwise change one or more logical relationships between pages, which in turn may result in a change in the layout of the page. These changes may or may not be conveyed from the navigation of the layout of the page to the associated metadata of those pages and any other similarly related pages. Thus, in one example, the changes may be provisional in that they are only applied to the layout of the page currently being visually provided. In another example, a change may be more permanent in that it results in a corresponding change to the associated metadata for the page, which may result in a change in the currently provided layout as well as other generated layouts including the affected page have.

Furthermore, other examples of navigation options may include layout-model changes, co-navigation, hyper-hypo navigation, printing, and the like. The layout-model change option allows the user to change the layout model as the visible layout is generated. This option can result in rearrangement of the layout's pages according to different layout models, resulting in different layouts. The co-navigation option may allow users of other instances of the same system to cooperatively navigate the layout of the page, which may be generated by one of the systems, but which may currently be provided visually by both systems. The hyper-hypo navigation option may be a page of a unique layout state or layout, a navigation between different pages (hyper navigation) that may not be part of the same plate optic visualization collection, and / or a single layout that may change as a result of the navigation (Hypo-navigation) can be allowed. And, the printing option may allow the user to face a visually-provided layout for the printer to generate its printout.

To further illustrate an exemplary embodiment of the present invention, the reference depicts an exemplary layout of waste paper that can be displayed in a GUI having a predetermined viewable area, in accordance with an exemplary embodiment of the present invention, to a user. 17-21, which can be navigated by. 17-19 show examples of layouts in accordance with the hierarchical layout model 600 displayed in a GUI having a predetermined observable area 1700. As shown, a layout according to a hierarchical layout model may include a number of pages 1702, each of which may be a sub-image of a page at each resolution in one example. Various ones of the pages are different resolutions in the layout, depending on the page 1704 with a higher resolution than the page 1706, which in turn has a higher resolution than the page 1708, and a higher resolution than the page 1708. It may have a.

The page may be positioned and / or sized in the layout according to the logical relationship (s) between the pages. In the example shown, page 1702 is an engineering drawing of the aircraft and may have an object-topic relationship. In particular, for example, the object (s) of the page on the level of the hierarchy may be the subject (s) of the page below it in the hierarchy, and in one example, the subject (s) It becomes contents.

In particular, for example, page 1704 may depict an external view of the entire aircraft. Page 1706 may depict a nose section, a landing gear assembly, a window, an engine assembly, and a tail assembly. Page 1708 may depict additional details about the content of each one of pages 1706, and page 1710 may depict additional details about the content of each one of pages 1708. have. However, for the observable area 1700, pages 1708 and 1710 may be provided at a resolution that results in their media content that is only partially understood or not understood at all by the user. Of course, in other example embodiments, page 1708 and / or page 1710 may be provided at a resolution sufficient to substantially understand all of their media content.

The GUI may provide one or more selected navigation options to navigate the layout of page 1702. In this illustrative example, the pan and zoom navigation options are for moving and / or increasing the size of the page in the observable area 1700 to focus on the portion 1714 of the layout. It may be provided in the form of control 1712. That is, the user may activate the above controls to move and / or zoom the layout to fill a larger portion of the viewable area of the GUI with portions of the layout. 18 shows one example of the results of navigating the layout in this manner.

As shown in FIG. 18, as the user activates control 1712 to focus on a portion 1714 of the layout, the size of pages 1704-1710 can increase, which in one example is the case. , Substituting sub-images of pages 1704-1708 with corresponding sub-images at a higher resolution. The resolution of the sub-image may allow the user to understand substantially all of the provided media content. In this regard, however, the page 1710 may not be provided at a sufficient resolution to be understood by the user because the size of each page may not be increased to the level of associating the next sub-image. That is, even after increasing the size of the image, the size may still be closest to the same sub-image so as not to cause its replacement with the next sub-image at higher resolution. In this illustrative example, the user may again activate control 1712 to move and / or resize the observation to focus on smaller portion 1802 of the layout.

One example of the results of navigating the layout to focus on portion 1802 is shown in FIG. 19. In one example, the observable area 1900 of the GUI can be resized to more fully accommodate the focused portion of the layout. As the user activates control 1712 to focus on portion 1802 of the layout, the size of pages 1704-1710 can increase, which in one example is a sub-page of page 1710. -Replacing the image with a corresponding sub-image at a higher resolution. The media content of page 1710 may be sufficient to be understood by the user. In one example where only a portion of page 1704 is within the observable area of the GUI, and each page is divided into tiles, only the tiles covering the observable portion of each page may be retrieved and displayed.

20 shows an example of a layout according to barrier layout model 500 displayed in a GUI having a predetermined observable area 2000. The layout may include pages 2002-2010. In the illustrated embodiment, the pages of the layout are wiring diagrams of the wiring system that can be related by a spatial sequence. In this regard, page 2002 may depict the wiring (s) connected to the wiring (s) depicted on page 2004. Page 2004 may in turn depict the wiring (s) connected to the wiring (s) depicted on page 2006, and the wiring (s) of page 2008 with respect to the wiring (s) of page 2006. For example, with respect to the wiring (s) of the page 2008, the wiring (s) connected to the wiring (s) of the page 2010 may be depicted.

The page of the layout may be formed entirely within the observable area 200 of the GUI or otherwise define the region of interest or region 2012. In one example, a page within a region of interest may be provided at an increased resolution relative to a predetermined page outside the region of interest. As shown, the region of interest may include pages 2002-2008, but because only a portion of the page 2010 is within the observable area of the GUI, the page (although it may still be considered within the observable area). 2010 may be considered outside the region of interest. In this example, page 2010 may be provided at a lower resolution than the resolution (s) of pages 2002-2008.

21 shows an example of a layout according to the superimposed layout model 1200 with details displayed in a GUI having a predetermined observable area 2100. As shown, the layout may include pages 2102 and 2104, and the page 2102 may include a reference to the page 2104. As shown, this hierarchical relationship allows pages 2104 (higher in the hierarchy) to be partly placed above page 2102, and in one example, page 2104 is the location of its reference in each page. Can be placed on top of page 2102. As also shown, page 2104 may be provided smaller in size than page 2102 and thus may be provided at a lower resolution than page 2102.

According to an exemplary embodiment of the present invention, the subsystem, including the panoptic visualization system 100, the document collection system 102, the document layout system 104, and the document navigation system 106 may be by various means. Can be implemented. Similarly, the document collection system 200, the document layout system 300, and the document navigation system 400, each including respective elements, may be implemented by various means in accordance with the illustrative embodiment. The means for implementing the system, the subsystems and their respective elements may comprise hardware, either alone or in the form of executable computer readable program code instructions from one or more computer program code instructions, program instructions or computer-readable storage media .

In one example, one or more devices may be provided that are shown and configured to function as, or otherwise implement, the systems, subsystems, and elements described herein, as well as those illustrated. In an example involving more than one device, each device may be connected or otherwise communicated with each other in a number of different ways, such as directly or indirectly via a wired or wireless network or the like.

In general, the device of an exemplary embodiment of the invention can be made, included, or implemented with one or more fixed or portable electronic devices. Examples of suitable electronic devices include smart phones, tablet computers, laptop computers, desktop computers, workstation computers, server computers, and the like. An apparatus may include each of one or more of a plurality of components, such as a processor (e.g., a processor unit) coupled to a memory (e.g., a storage device).

A processor may generally include any hardware capable of processing information, such as data, computer-readable program code, instructions, etc. (generally a "computer program ", e.g. software, firmware, etc.), and / to be. In particular, for example, a processor may be configured to execute a computer program that is stored on a processor and stored or otherwise stored in a memory (of the same or other apparatus). A processor may be a number of processors, a multi-processor, or some other type of processor depending on the particular implementation. Moreover, a processor may be implemented using a number of heterogeneous processor systems in which the main processor is provided as one or more secondary processors on a single chip. As another example, a processor may be a symmetric multi-processor system that includes multiple processors of the same type. In another example, the processor may be implemented with one or more application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or the like. Thus, although the processor may execute a computer program to perform one or more functions, the various example processors may perform one or more functions without the aid of a computer program.

The memory is typically any hardware capable of storing information such as, for example, data, computer programs, and / or other appropriate information on a provisional and / or permanent basis. The memory can include volatile and / or non-volatile memory and can be fixed or removable. Examples of suitable memory include random access memory (RAM), read-only memory (ROM), hard drive, flash memory, thumb drive, removable computer diskette, optical disk, Magnetic tape or some combination of the above. The optical disk may include compact disk-read only memory (CD-ROM), compact disk-read / write (CD-R / W), DVD, and the like. In various examples, the memory may be a non-transient device capable of storing information, such as a computer-readable medium such as electronic transitory signals capable of carrying information from one location to another, Readable < / RTI > storage medium. The computer-readable medium as described above is generally referred to as a computer-readable storage medium or a computer-readable medium.

In addition to the memory, the processor may also be coupled to one or more interfaces for displaying, transmitting and / or receiving information. The interface may comprise a communication interface (e.g., a communication unit) and / or one or more user interfaces. The communication interface may be configured to transmit and / or receive information to other device (s), network (s), and / or the like. The communication interface may be configured to transmit and / or receive information by physical (wired) and / or wireless communication links. Examples of suitable communication interfaces include a network interface controller (NIC), a wireless NIC (WNIC), and the like.

The user interface may include a display and / or one or more user input interfaces (e.g., input / output units). The display may be configured to provide or otherwise display information for a user, and suitable examples thereof include a liquid crystal display (LCD), a light-emitting diode display (LED), and a plasma display panel (PDP). The user input interface may be wired or wireless and may be configured to receive information from a user to a device, such as for processing, storing and / or displaying. Examples of suitable user input interfaces include a microphone, an image or video capture device, a keyboard or keypad, a joystick, a touch-sensitive surface (separate from or integrated with the touch screen), a biometric sensor ) And the like. The user interface may further include one or more interfaces for communicating with peripheral devices such as printers, scanners, and the like.

As noted above, program code instructions may be stored in memory and executed by a processor to implement the functions of the systems, subsystems and their respective elements described herein. As will be appreciated, any suitable program code instructions may be loaded onto a computer or other programmable device from a computer-readable storage medium to produce a particular machine, . These program code instructions may be stored in a computer-readable storage medium that is capable of directing a computer, processor, or other programmable apparatus to a function in a particular way so as to cause a particular item of manufacture or a particular item of manufacture. The instructions stored in the computer-readable storage medium may produce items of manufacture, wherein items of manufacture are means for implementing the functions described herein. Program code instructions are retrieved from a computer-readable storage medium to form a computer, processor, or other programmable apparatus for performing the operations to be performed on or by a computer, processor, or other programmable apparatus, Capable device.

The retrieval, loading and execution of program code commands can be executed sequentially, so that one instruction is retrieved, loaded and executed at a time. In some demonstrative embodiments, retrieval, loading, and / or execution may be executed in parallel such that multiple instructions may be retrieved, loaded, and / or executed together. Execution of the program code instructions may produce a computer-implemented process, such that instructions executed by a computer, processor, or other programmable device provide operations for implementing the functions described herein.

Execution of instructions by a processor, or storage of instructions in a computer-readable storage medium, supports a combination of operations to perform a particular function. It is also understood that one or more functions, and combinations of functions, may be executed by a special purpose hardware-based computer system that performs a particular function, or combination of special purpose hardware and program code instructions.

As noted above, exemplary embodiments of the present invention allow for the collection, layout, and / or navigation of multiple pages (or documents). An example embodiment may allow a user to observe and visually retrieve a larger number of pages simultaneously and quickly while using a lower bandwidth to retrieve all pages. In an example where a user may have a general idea of the appearance of the page (s) of interest, or have an idea of the logical relationship between each page (s) and other pages, the layout of the page positions the page (s) of interest And may be generated and / or navigated to allow the user to use it. Users can view and navigate pages as if they were unfolding in the physical world without requiring physical space associated with large collections of pages.

Many modifications and other embodiments of the inventions described herein will come to mind to one skilled in the art to which these inventions pertain having the benefit of the teachings presented in the foregoing descriptions and the associated figures. Accordingly, it is to be understood that the invention is not to be limited to the specific embodiments disclosed and that modifications and other embodiments are considered to be included within the scope of the appended claims. Moreover, although the foregoing description and the associated drawings set forth exemplary embodiments in the context of certain illustrative combinations of elements and / or functions, other combinations of elements and / or functions may depart from the scope of the appended claims. It should be understood that it may be provided by alternative embodiments without. In this regard, for example, combinations of elements and / or functions other than those described above are also contemplated as described in some of the appended claims. Although specific terms are employed herein, they are used in a generic and descriptive sense only and not for purposes of limitation.

Claims (16)

Receive a request for media content and identify a document component that contains the requested media content, wherein the identified document component provides information about each document component as well as each containing each media content. A search engine, which is a panoptic visualization document collection with a plurality of document components having associated metadata;
Coupled to a search engine and configured to select a layout model from a plurality of layout models for a panopically arranged visual representation of the plurality of document components, wherein the layout model is selected according to the associated metadata for the identified document component A layout engine;
The layout engine is configured to retrieve a plurality of document components, including the identified document component and one or more other document components identified according to associated metadata for the identified document component, each metadata being identified. Further comprising information identifying one or more links between the component and each one or more other document components,
The layout engine is configured to generate a layout of a panoptically arranged visual representation of the retrieved document component according to the selected layout model and associated metadata for the retrieved document component and the retrieved document component,
A panoptic visualization document layout system, wherein the layout engine is configured to communicate layouts.
The method of claim 1,
The identified document component is an electronic document of a panoptic visualization document collection, the associated metadata for the identified document component provides information about the shape of each document, and the layout engine creates a layout model according to the shape of each document. And a panoptic visualization document layout system configured to select.
The method of claim 1,
The associated metadata for the identified document component provides information about the metadata of each document component, and the layout engine is configured to select a layout model according to the media content of the identified document component. Optical visualization document layout system.
The method of claim 1,
Relevant metadata for each of the retrieved document components provides information specifying one or more sizes, positions or depths of the visual representation of each document component in the layout,
For each of the retrieved document components, the layout engine is configured to generate a layout according to one or more sizes, positions or depths specified by the information provided in the associated metadata.
5. The method of claim 4,
For each of the one or more retrieved document components, one or more sizes, positions or depths are specified in relation to the one or more other retrieved document components.
5. The method of claim 4,
For each of the one or more retrieved document components, the document component is in a state that includes a visible representation at each resolution of the document component, and the associated metadata specifies at least the size of the visible representation of each document component in the layout. Information,
For each of the one or more retrieved document components, the layout engine is configured to retrieve the document components for visual representation at a resolution that matches the size specified by the information provided in the associated metadata. Layout system.
The method according to claim 6,
For each of the one or more retrieved document components, the associated metadata provides information specifying at least the size of the visible representation of each document component in the layout, wherein the size is specified with respect to the one or more other retrieved document components. Panoptic visualization document layout system.
The method of claim 1,
The layout engine is further configured to receive a request for another panoptic arrangement of the visual representation of the retrieved document component; In response,
Select another layout model from the plurality of layout models;
A different layout of the retrieved document component, comprising: configured to optopically rearrange the visual representation of the retrieved document component according to the selected other layout model and associated metadata for the retrieved document component and the retrieved document component. And a panoptic visualization document layout system.
Receiving a request for media content and identifying a document component that includes the requested media content, wherein the identified document component is associated with providing information about each document component as well as each containing each media content. A panoptic visualization document with multiple document components with metadata;
Selecting a layout model from the plurality of layout models for a panoptically arranged visual representation of the plurality of document components, the layout model being selected according to the associated metadata for the identified document component;
By retrieving a plurality of document components, including the identified document component and one or more other document components identified according to associated metadata for the identified document component, wherein each metadata is identified and each document component Further comprising information identifying one or more links between one or more other document components;
Generating a layout of the retrieved document component, comprising phantomly arranging a visual representation of the retrieved document component according to the selected layout model and associated metadata for the retrieved document component and the retrieved document component; And
And communicating the layout.
10. The method of claim 9,
The identified document component is an electronic document of a panoptic visualization document collection, the associated metadata for the identified document component provides information about the shape of each document, and the layout model is selected according to the type of each document. How to feature.
10. The method of claim 9,
The associated metadata for the identified document component provides information about the metadata of each document component, and the layout model is selected according to the media content of the identified document component.
10. The method of claim 9,
Relevant metadata for each of the retrieved document components provides information specifying one or more sizes, positions or depths of the visual representation of each document component in the layout,
For each of the retrieved document elements, the layout is generated according to one or more sizes, positions or depths specified by the information provided in the associated metadata.
The method of claim 12,
For each of the one or more retrieved document components, one or more sizes, positions, or depths are specified in relation to the one or more other retrieved document components.
The method of claim 12,
For each of the one or more retrieved document components, the document component is in a state that includes a visible representation at each resolution of the document component, and the associated metadata specifies at least the size of the visible representation of each document component in the layout. Provide information,
For each of the one or more retrieved document components, the document components are retrieved for visual representation at a resolution that matches the size specified by the information provided in the associated metadata.
15. The method of claim 14,
For each of the one or more retrieved document components, the associated metadata provides information specifying at least the size of the visible representation of each document component in the layout, wherein the size is specified with respect to the one or more other retrieved document components. How to.
10. The method of claim 9,
Further comprising receiving a request for another panoptic arrangement of the visual representation of the retrieved document component; In response,
Select another layout model from the plurality of layout models;
Generate a different layout of the retrieved document component, including panoptical rearrangement of the visual representation of the retrieved document component according to the selected other layout model and associated metadata for the retrieved document component and the retrieved document component Characterized in that the method.

Images