WO2003041405A1

WO2003041405A1 - Data reception apparatus

Info

Publication number: WO2003041405A1
Application number: PCT/JP2002/011568
Authority: WO
Inventors: Yoshiaki Ogisawa; Toshio Nomura
Original assignee: Sharp Kabushiki Kaisha
Priority date: 2001-11-07
Filing date: 2002-11-06
Publication date: 2003-05-15
Also published as: JPWO2003041405A1

Abstract

A data reception apparatus includes a reception unit (1) for receiving digital data of a video program, an analysis unit (2) for dividing the received program video digital data into coded data of each object, a decoding unit (3) for decoding the coded data of each object, a combining unit (5) for combining the decoded objects into a reproduction video, and a display unit (9) for displaying the combined reproduction video. The apparatus further includes an input device (6) for moving a combination position of an arbitrary object on a screen and a limit judgment unit (8) for judging according to attention area information for identifying an attention area on the screen whether the object instructed to move by the input device (6) is superimposed on the attention area. When the object is superimposed on the attention area, movement or combination of the object is limited according to limit attribute information describing the attribute of the attention area.

Description

Data receiver

Technical field

The present invention relates to a data receiving apparatus that receives and reproduces a program video composed of a plurality of objects.

Ming Background Art In the recently launched digital television broadcasting, program video is provided using compression technology. As one of program videos using this compression technology, one using the concept of an object of MPEG-4 coding can be considered. In MP E G-4 encoding, components that compose a video such as parts video such as background video and characters of a program or audio, and composite information of those objects are encoded individually.

Therefore, for example, the user may consider a technique of switching the display non-display of an object (part image) made into an object or drawing the position of the object display. For example, according to Japanese Patent Application Laid-Open No. 2 0 0 0 1-1 5 5 1 1 8), digital television broadcasts including objects are received, and movement, enlargement / reduction, and display on / off of objects selected by the user are optional. A broadcast receiver that can be set to

However, when the user changes the display position of the video object distributed by the receiving device, or switches between display and non-display, the program video reproduced by the receiving device on the user side is what the distribution side intended. Is different. If the video to be distributed includes a program sponsor's advertisement video, the distribution side intends to have the user look at this advertisement video, but the video object included in the program video is advertised by the user. If it is moved above the image, it The ad video will be hidden in the video app and will not be displayed on the user's receiver.

On the other hand, if the movement of the video object is completely prohibited, the above problems can be avoided, but the screen layout can not be changed freely, and the user's convenience is lost. The delivery side receives the status of the video being played back on the receiving device side by feedback from the receiving device, determines the information that has been feed packed, and the video that the delivery side wants to see is hidden. Although it is sufficient to distribute data so as to change the position of an object, it is difficult and impractical to distribute a specific date to a specific user.

The present invention has been made in view of the above problems, and provides a data receiving apparatus that allows the user to freely change the screen layout without losing the intention of the distribution side. Disclosure of the invention

The present invention has the following configuration in order to achieve the above object.

According to a first aspect of the present invention, there is provided a receiving section for receiving digital data of a program video in which coded data of a plurality of objects are multiplexed, and a digital data of the received program video as a code of each object. A demultiplexing unit for demultiplexing data, a decoding unit for decoding encoded data of the separated object, a combining unit for combining the decoded object to form a playback video, and a screen of the playback video In the data receiving apparatus having a display unit displayed on the display unit, an input unit for instructing the movement of a combined position in the screen of an arbitrary object, and an area of interest in the screen included in digital data of the program video. A determination unit that determines whether an object for which movement is instructed by the input unit overlaps the attention region, based on the attention region information for specifying When the object and the attention area overlap, the restriction attribute information describing the attribute of the attention area, which is included in the digital data of the program video, is used. And a restriction unit for restricting movement and Z or composition of the object.

A second invention of the present application is characterized in that the region of interest is the object included in the program video, and the region of interest information is shape information of the object.

According to a third aspect of the present invention, in the restriction attribute information, the priority of each object is described, and the restriction unit compares the priority when the region of interest overlaps the object. It is characterized in that the movement of the object is restricted by

A fourth invention of the present application is characterized in that the object identification information and the movement restriction information are described in the restriction attribute information for each attention area. According to a fifth aspect of the present invention, in the case where a specific region of interest has the same attribute for all objects, the object identification information corresponding to the specific region of interest is described in the restricted attribute information. It is characterized by not being done.

The sixth invention of the present application is characterized in that identification information of a focused area whose movement is restricted for each of the objects is described in the restricted attribute information.

According to a seventh invention of the present application, the restriction section restricts a portion where the attention area overlaps the object so as to combine the object using a transparency signal, so as not to hide the attention area. It is characterized in that the object can be displayed on the screen.

The eighth invention of the present application is the video camera according to the eighth aspect of the present invention, in which the restriction unit restricts the reduced image of the object to be synthesized near the attention area when the attention area overlaps the object. It is characterized in that the object can be displayed without hiding it.

According to a ninth aspect of the present invention, in the case where the restriction unit is configured such that, when the attention area overlaps the object, an icon or symbol image indicating the object is displayed in the vicinity of the attention area. It is characterized in that the object can be displayed without hiding the region of interest by restricting composition.

In a tenth invention of the present application, the digital data of the program video includes an area information valid flag indicating whether the focused area information is valid, and the restriction unit is configured to use the area information valid flag. If it is indicated that the attention area information is valid, the movement of the object is restricted using the attention area information received last, and the attention area information is invalid. In the case where is indicated, the movement of the object is not restricted regardless of the presence of the attention area information. Brief description of the drawings

FIG. 1 is a block diagram showing a broadcast receiving apparatus in an embodiment of the present invention. FIG. 2 is an explanatory view showing an example of a screen configuration according to an embodiment of the present invention. FIG. 3 is an explanatory view showing an example of a method of specifying a rectangular area in the embodiment of the present invention.

FIG. 4 is an explanatory diagram showing an example of a method of designating an area by binary according to an embodiment of the present invention.

FIG. 5 is an explanatory view showing an example of a screen configuration according to an embodiment of the present invention and an example of designating an attention area by multiple values.

FIG. 6 is an explanatory view showing a configuration example of region attribute information according to an embodiment of the present invention.

FIG. 7 is a flowchart showing movement processing of a video object in an embodiment of the present invention.

FIG. 8 is a flowchart showing the moving process of the video object using the area valid flag in the embodiment of the present invention.

FIG. 9 shows that the attention area in one embodiment of the present invention is included in all the video objects. It is explanatory drawing which shows the structural example of the area | region attribute information made effective.

FIG. 10 is an explanatory diagram showing an example of video composition when moving the video object to the attention area in the embodiment of the present invention.

FIG. 11 is an explanatory view showing an example of reduced display when moving the video object to the attention area in the embodiment of the present invention.

FIG. 12 is an explanatory view showing an example in which the video object is moved to the vicinity of the target area when the video object is moved to the target area in the embodiment of the present invention.

FIG. 13 is an explanatory drawing showing an example of reduced display when moving a video object to another video object according to an embodiment of the present invention.

FIG. 14 is an explanatory view showing an example of moving to a side of a moving image object when moving a moving image object to another moving image object according to an embodiment of the present invention.

FIG. 15 shows an example in which when moving a video object to another video object according to an embodiment of the present invention, a part of the video object moved outside the moving image object is displayed. FIG.

FIG. 16 is an explanatory view showing various display modes of two video objects when moving the video object to another video object in the embodiment of the present invention. BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing a schematic configuration of a data receiving apparatus in the present embodiment.

. As shown in FIG. 1, the data receiving apparatus according to the present embodiment includes a receiving unit 1, an analyzing unit 2, a decoding unit 3, a video management unit 4, a combining unit 5, an input device 6, an input operation analysis unit 7, a restriction determination. Department

8 and display unit 9 are provided. The receiving unit 1 receives digital data of a program video transmitted as broadcast video by the distribution side. The program video digital data includes at least one or more encoded video objects. Here, a video object refers to a part image of a rectangle or any shape. This video object is encoded by, for example, MPEG-4. MPEG-4 has a function of encoding an object that is a component of an image in a different manner.

The distribution side can combine these video objects to create a program video. For example, a natural image obtained by photographing a landscape etc. and an image obtained by extracting only the person from the image obtained by photographing the person are synthesized and distributed. Although this composition can be performed on the delivery side as in the prior art, by multiplexing each encoded data and their composition information (scene description information) as in the present embodiment and distributing it, It can be combined and displayed on the user's receiver side.

This video object is composed of a pixel value signal (color information), a shape signal, a transmittance signal, and the like. The shape signal is defined as a binary signal with identification data indicating the force each pixel is external or internal to the object. In the non-embodiment, this shape signal is used to determine whether the video object is in a specific area of interest specified by the distribution side. In addition, the transparency signal is represented by 8 bits, in which 0 is transparent and 25 is opaque for each pixel, and is data indicating a ratio when combined with the background. In the present embodiment, in the program video data to be distributed, attention area information and restriction attribute information are multiplexed in addition to the video object and the composition information (scene description information). The attention area is an area where the distribution side restricts the movement of the video object, and is set, for example, when avoiding that the display area of the picture that the user wants to view is hidden by the movement of the video object. And attention area information is data representing the attention area.

The restriction attribute information describes the attribute of the attention area, and the details will be described later. A part of the entire display system such as a background image may be set in the above noted area , You may set a video object. In the present embodiment, it is assumed that the background image is an image displayed on the entire display system of the receiving apparatus, and the user can not instruct the movement of the background image. First, the case where a certain area in the background image is specified as the attention area will be described.

The analysis unit 2 appropriately separates program video data in which attention area information and restriction attribute information are multiplexed. That is, they are separated into data such as encoded data of each video object and their combined information (scene description information). The separated video object data is decoded by the decoding unit 3 respectively. In addition, composite information, attention area information, restriction attribute information and the like are sent to the video management unit 4.

The video management unit 4 analyzes composite information (scene description information) describing the composite position of each video object. In addition, analyze and manage attention area information and restriction attribute information. The user uses the input device 6 to issue an instruction to move the video object. The input device 6 can select at least a video object and can specify the position to move the selected video object, regardless of the shape and method of the mouse, keyboard, remote control, etc.

The input operation analysis unit 7 analyzes the operation performed by the user using the input device 6. The analyzed operation is output to the restriction determination unit 8. The restriction determination unit 8 determines whether the moving destination of the video object selected by the user using the input device 6 overlaps the attention area prohibited by the distribution side, and the overlap is determined. In addition, it is determined whether or not the video object can be moved by using the limited attribute information belonging to the attention area, and the process of determining the moving destination of the video object is performed.

In determining whether the movement destination is the attention area in the restriction determination unit 8, data of the attention area information and restriction attribute information sent from the video management unit 4 and the shape signal used when the object is decoded by the decoding unit 3 And. If it is determined that the video object and the attention area overlap with each other, the restriction determination unit 8 determines whether the video object can be moved or not from the restriction attribute information describing the attribute of the attention area of the movement destination. If moveable, determine how it is moved.

If the video object can be moved according to the determination result, the composite information is updated and sent from the restriction determination unit 8 to the combining unit 5. If it is determined that movement is not possible, the composite information is not updated. Further, the composite information changed by the restriction determination unit 8 is also sent to the video management unit 4 and the current composite information is managed.

The combining unit 5 combines the video objects decoded by the decoding unit 3 in accordance with the combination information output by the restriction determination unit 8. A transparency signal is used to synthesize each video object. The combined video is converted to an output format adapted to the user's image receiving device on the display unit 9 and then displayed.

Next, a method of expressing attention area information in the present embodiment will be described. FIG. 2 is a video including a background video 21, a video object O B J 1 representing a clock, and a video object B B J 2 representing a person. The video object O B J 1 and the video object O B J 2 can be moved by the user's instruction, and the display position can be changed.

In such a program video, an area 22 in the background video 2 1 is an area in which a CM video such as a product video of a program sponsor is displayed in the video. For this reason, the distribution side does not want the video object O B J 1 or O B J 2 to be moved to the area 22 to hide the corresponding area of the background image. Therefore, the distribution side sets the area 22 as the area of interest, and also sets the area of interest as the movement prohibited area, whereby the video object BJ 1 or the video object OBJ 2 moves to the area 22. Prohibit This attention area information is transmitted every frame of the background video.

Although in FIG. 2 the attention area is the movement prohibited area, it is not limited to the prohibited area, and may be designated as the movable area. Whether the designated area of interest is movement prohibited or movable can be specified by the restriction attribute information described later. As a method for the delivery side to designate the attention area, designation with a rectangle and designation with an arbitrary shape by a free curve can be considered. If it is a rectangle, as shown in Figure 3, the reference of display system coordinates There is a method of using only the distance from the point (V and H in Fig. 3) and the length and width of the specified rectangle (in Fig. 3!! Eight and width) as information.

Also, even if the target area shape is an arbitrary shape, it can be treated as a rectangular area by considering it as a rectangle that includes the area. However, if an arbitrary shape, for example, a rectangle including an area such as a person, is set as an attention area, unnecessary parts increase as the attention area, and the freedom of movement of the video object decreases. As a method of designating a region of interest without causing the problem, a method using data representing each pixel of the region of interest designated for the background image by an arbitrary value like a binary mask is used. This can be binary data if the specified area of the background video is a note-in area for all video objects in the program video, as shown in FIG.

That is, all pixels in the background image may be distinguished as to whether or not they are the area of interest. For example, assuming that each pixel included in the region 22 which is the region of interest in FIG. 2 is represented by 1 and pixels in the other regions are represented by 0, data as shown in FIG. 4 (a) is generated. Fig. 4 (b) is an enlarged view of the part surrounded by the broken line in Fig. 4 (a), and one square represents one pixel.

Next, as shown in FIG. 5, when a plurality of video objects are included in the program video and the attribute of the region of interest of the background video is different for each video object, it can not be expressed in binary. For example, in FIG. 5, area A, area B, and area C in the figure are set as the area of interest, and video object OBJ 1 is prohibited from moving to areas A and C, and moving to area B is possible. The video object B BJ 2 can move to the area A, and can not express a state in which the movement to the areas B and C is prohibited.

In order to express this, it is expressed not by two values, but by, for example, multiple values (three or more values). This value is called an area ID in the present embodiment. The area ID may be assigned any value as long as each area can be distinguished. Domain assigned to each area The area ID is assigned to all pixels included in the area as in FIG. Information on such areas of interest is delivered concomitantly to each frame of background video. '

These attention areas are given attributes by the restriction attribute information. The restricted attribute information has a focused area identifier, a moving object identifier, and a restricted state identifier. The focused area identifier indicates a focused area in which the distribution side sets the movement limit. The movement object identifier describes a video object which is restricted when it is moved to the attention area among the video objects which can be moved by the user. The restricted state identifier describes whether movement is possible when the video object is moved to a certain area of interest. An example of this restriction attribute information is shown in Fig. 6 (a).

The attention area identifier describes an ID for identifying each attention area. Figure 6 (a) is an example using the ID of the area of interest assigned in Figure 5 (a). The moving object identifier describes the ID of the video surveillance subject to restriction when being moved to the corresponding attention area. This restriction, for example, movement prohibited or movable is described by the restriction state identifier.

As described above, in FIG. 5, with respect to the regions A, B, and C that are the regions of interest, the video object B BJ 1 does not move the regions A and C, the region B can move, and the video object OBJ 2 Figure 6 shows the region attribute information when region A can be moved and regions B and C are not moved. The movable area for each video object is not specified because it is an area other than the restricted area.

In addition, it can be understood that the restriction attribute information shown in Fig. 6 (a) describes the movement prohibition / possible of the B central image for the attention area set in the background image. If such a description is given, a video object is added while the program video is being distributed, and if it becomes necessary to set a region of interest to the video object as well, the distribution side re-limits the restriction attribute information. Need to configure and deliver. In order to reduce this labor, the restriction attribute information may be described by focusing on the video object as shown in FIG. 6 (b). By describing as shown in Fig. 6 (b), even if the video object is added while the program video is being distributed, the distribution side adds only the limited attribute information of the increased video object. It is easy for the receiving side to respond simply by distributing it.

The shape signal attached to the video object is used to determine whether the video object has moved to the area of interest. The area where the video object is synthesized is calculated from the data obtained by decoding the shape signal and the position after movement specified by the user, and the pixels of the video object are compared with the area-of-interest information.

The area ID of the area of interest corresponding to the pixel of the video object is acquired, and it is determined whether the combination of the object ID of the picture object and the area ID of the area of interest is described in the restriction attribute information. If the combination of the object ID and the area ID is described in the restricted attribute information, it is determined that the video object and the area of interest overlap.

After the overlap is determined, the attributes of the video object and the attention area of the background video are acquired from the restriction status identifier of the restriction attribute information. This comparison is made sequentially for each pixel of the video object. If the overlap is determined even for one pixel, and the acquired attribute indicates no movement, the determination is ended on the assumption that the video object can not be moved at that time.

In this way, when the movement of the video object is determined as a result of the determination, the synthetic information is set so as to combine the video object at the position designated by the user. Conversely, if it can not be moved, a message will be displayed on the screen or a warning sound will alert you and no new composition information will be set. Therefore, the video object is not moved, and the video object is composited at the position before the movement. FIG. 7 shows a flowchart of processing using this attention area information and restriction attribute information. First, the user instructs movement of the video object using the input device. Determine if it was (step 1). When the movement instruction is not given to the video object, there is no change to the video, so the current composite information is acquired from the video management unit 4 (step 1 1), and a composite video is created.

When a moving instruction is given to the video object, the input from the user is interpreted, and the moving image object and the moving destination of the object are acquired (step 2). Then, the shape signal of the moving object to be moved decoded from the decoding unit 3 is acquired, and the shape signal after movement is created (step 3).

Further, the shape signal of the moving destination of the video object and the attention area information are compared to determine the overlap (step 4), and if the overlap is not determined, the composition information is updated and set (step 7). When the overlap is determined, 'restricted attribute information on the video object to be moved is acquired using' the attention area information and the restricted attribute information '(step S5, the restricted state of the restricted attribute information acquired in step 5) The identifier is determined (step 6). If it is determined that the image object can be moved, the composition information is set so that the image object is composited to the movement position designated in step 7, and the image management unit of the composition information is determined. Give feedback to 4. Conversely, if it is determined that movement is not possible, the user is warned (Step 1 2) In this case, new composite information is not set. Based on the synthesized information, a synthesized image of each video object is created (step 8), and sent to the display unit 9 (step 9). Convert according to one receiver and display (Step 10).

By doing this, the other video object is not moved to the area desired by the distribution side, and the video which the distribution side wants the user one to see is always displayed by the user one receiver. In addition, since moving video objects to areas other than the specified area is possible according to the user's intention, the screen layout matched to the user's rumor It is possible to out.

In the above description, the information on the area of interest is attached to each frame of the background video. However, when the background image moves less, the target area on the delivery side changes less. In such a case, since there is no change in the attention area information, it is redundant to deliver the attention area information for each frame.

In order to reduce this redundancy, if there is no change in the attention area, it will not be delivered frame by frame, and if the attention area information is not attached to the background video frame to be displayed, it was last transmitted. Focus area information (latest focus area information) should be valid. However, if the attention area information transmitted last is always valid, it is not clear whether there is really no attention area or it may be used repeatedly. In order to avoid this, for example, an area information valid flag is used. This flag is a flag indicating whether or not the attention area information is valid. This flag is valid Z takes two values of Z invalid. When taking a valid value, judgment is performed using the attention area information delivered last. When an invalid value is set, it is assumed that the area of interest information does not exist, and the video object can be moved freely.

The flowchart in this case is as shown in FIG. Only the differences from FIG. 7 will be described below. If it is determined in step 1 that the movement instruction has been made, after steps 2 and 3, the area information valid flag of the video to be synthesized is referred to (step 2 1). If the area information valid flag is valid, the attention area information is acquired. In order to acquire attention area information, first, it is judged whether or not attention area information exists in a frame of a video to be synthesized (step 2 2). If attention area information also exists, the accompanying attention area information is acquired as before (step 2 3). If it is determined in step 22 that no attention area information is present in the frame, the attention area information transmitted last is acquired (step 24). If the area information valid flag is invalid, the composite information is set so that the video object is displayed at the user's designated position without performing comparison (step 7). As a result, it is possible to reduce the degree of redundancy of distribution data, and also to reduce the amount of distribution data. In addition, it is possible to use such as temporarily releasing the moving object restriction of the video object at the convenience of the distribution side.

In the above explanation, movement restriction was performed by creating restriction attribute information on the pair of the attention area and the video object. However, when a program video is composed of a large number of video objects, it is necessary to describe the attributes with respect to the area of interest for all the video objects, so the amount of delay of the limited attribute information increases. In order to avoid this, it is possible to extend and respond to the restriction attribute information shown in FIG.

When all video objects have the same attribute to the same area of interest, the ID of the video object is not described in the moving object identifier of the limited attribute information. FIG. 9 is an example of restriction attribute information indicating that the area C is set as the attention area in the program video shown in FIG. 5 and that the area C is an area in which all video objects can not be moved.

In this way, when there is no description of a specific video object in the moving object identifier, it is prohibited to move all the video objects in the region of interest, reducing the amount of data of restricted attribute information and the time for data creation. It is possible to

In the present embodiment, an example is described in which the ID of the video object is not described, but a focused domain having a specific area ID may always have an attribute of no movement. Also, the moving object identifier may be set and described as a specific ID indicating all video objects.

So far, if the attribute of the attention area to which the video object moves is prohibited, the video object can not be moved. However, when the program image has the attention area shown in FIG. 10 (a) and the limited attribute information shown in FIG. 10 (b), the area A which is the attention area occupies most of the display system. , The video object OBJ 1 has almost no freedom of movement.

Therefore, when moving a video object, movement of part of the video object is prohibited. When overlapping with the attention area with the stop attribute, the part overlapping with the attention area of the video object is composited without being displayed. In this composition method, composition signal transmission information is created and used from the composition signal associated with the video object.

For example, when the video object OBJ 1 is moved as shown in Fig. 10 (c), until the limit judgment unit 8 detects the overlap between the background video and the video object even if it is 1 pixel , Here, overlap judgment of pixels in all video objects is performed. When it is determined that each pixel is in the region of interest, transparency signal information for composition is created.

The transparency signal corresponds to each pixel on a one-to-one basis, and a value between 0 and 25 is set. A value of 0 means transparent, 2 5 5 means opaque. The transparency signal of the pixel determined to overlap with the area of interest from the transparency signal of the video object to be moved is set to 0 (transparent), and the transparency signal of the pixel determined not to overlap is By setting the value of the transparency signal of the video object, transparency signal information for composition is created.

By combining video objects using this transparency signal information, as shown in FIG. 10 (d), in the case of combining, the attention area where the video objects overlap becomes a video in which the pixels of the background video are displayed. This makes it possible to increase the freedom of movement of the video object.

However, in the above case, when the entire video object is included in the region of interest at the destination of the video object, the values of all pixels of the transparency signal information for composition created from the video object are set to transparent. Video object is not displayed as shown in Figure 1 1 (a). In this case, when the user tries to move the video object again, it is difficult to specify the position of the video object.

In order to avoid this, if the value of the transparency signal information for composition becomes all 0, as shown in Figure 1 1 (b), the reduced display of the object is displayed in the area of interest. Composed by · displayed. The user can move again by instructing the reduced video object to move.

In the above example, the display when the video object is hidden is the reduced display, but the video to be displayed is not limited to the reduced display, but may be an icon indicating the video object, or the corresponding video object. You may display it by a symbol etc.

In the present embodiment, although the case where all the pixels of the video object are included in the attention area is described, the present invention is not limited to all the pixels. For example, a ratio to the total number of pixels of the video object is used as a threshold. When the number of pixels exceeding the threshold is overlapped, reduced display may be performed. At that time, the video object is not displayed, including the non-overlapping part (displayed part) of the video object.

Furthermore, so far, if the move destination is the attention area as shown in Fig. 12 (a), it can not be moved if the attribute is movement prohibited. If the movement of the object fails, the user has to restart the movement again. In order to avoid this trouble, as shown in Fig.12 (b), if the attention area of the movement destination has the movement prohibition attribute, the vicinity of the area is set as the movement destination of the video object instructed to move. It may be displayed as 'synthetic'.

Also, if the video that the user wants the user to see is delivered as an object, it is possible to secure the display of the video object by designating that video object in the attention area. For example, when the distribution side desires to distribute an advertisement video to be included in a program video as a video object, it is not preferable that the object of the advertisement video is hidden by another video object. Examples of video objects that are not desirable to be concealed in this way include, in addition to advertising video, for example, video objects of newscasters in news programs, tickers of breaking news in a program, and the like.

At this time, a video object is specified as a region of interest, and the ID of the video object is described in the region of interest in the restricted attribute information. That is, to the attention area identifier Is the same as in the case of the background image, the distribution side

ID is described.

Similarly, other identifiers of restriction attribute information describe the ID of the video object subject to restriction in the moving object identifier, and describe the attribute applied at that time in the restriction state identifier. As the attention area information used to determine the overlap between the video objects, the shape signal of the video object described by the attention area identifier is used. In Fig. 13 (a), to prevent the video object OB J 1 and the video object OB J 2 from overlapping each other, set the video objects OB J 1 and OB J 2 as a region of interest, and limit them. Set the attribute information as shown in Fig. 13 (c).

By describing in this way, for example, when moving the video object OB J 1 onto the video object OB J 2, the shape signal and the video of the video object OB J 1 are processed in the same manner as the previous steps. Overlap is determined from the shape signal of the object OB J 2 and movement is determined to be prohibited from the restriction attribute information in FIG. 13 (c). For this reason, the video object is not moved.

However, consider the case where a video as shown in Fig. 13 (a) is distributed together with the restriction attribute information shown in Figs. 13 (b) and (c). As shown in Figs. 13 (b) and 13 (c), the area A, the video object OB J 1 and the video object B B J 2 are respectively set as areas of interest. When moving the video object OB J 1, neither the area A nor the video object OB J 2 is moved, so there is almost no area in which the video object OB J 1 can actually move.

In such a case, priority is set between the video objects in order to increase the freedom of movement of the video objects by the user. This priority is set by the distribution side, multiplexed with program video and distributed. FIG. 13 (d) is an example when the video object OB J 2 has higher priority than the video object OB J 1.

In the case of Fig. 13 (d), it is assumed that the priority is set with a value of 0-255. priority When the lower video object OBJ1 is moved to overlap with the higher priority object OBJ2, the composition method differs depending on the receiving system and the display method is received because there is no restriction attribute information. Depends on the side system.

Figure 13 (e) is an example where the moved video object is hidden. In Fig. 13 (e), the object OB J 1 moved by the user is hidden, and in addition, the video object OB J 1 is not displayed, so it is difficult to move again. is there. Also, conversely, the video object OBJ1 may be displayed on the video object OBJ2, and the display of the video object OBJ1 that the delivery side wants to see may be hidden. , To avoid this, by moving the video object by the user, etc.

If a low-priority video object is not displayed hidden by a high-priority video object, as shown in Fig. 13 (f), the reduction of the low-priority video object may occur. Display next to the video object that hides the display (high priority). ·

As a result, a video object that the distribution side does not want to hide is displayed without being hidden by the user's move operation, and it becomes easy to move the moved video object again even if the user does. In this case, the image is displayed in a reduced size, but if the user's convenience is not impaired, an icon may be displayed that is an image of the video object instructed to be moved, or the video object You may display a symbol indicating.

Also, it is assumed that the video objects completely overlap each other, but the distribution side or the user sets the number of pixels allowing the weight, and the value is used as the threshold to reduce the threshold when it is determined that the number of pixels overlaps. You may display it.

Furthermore, up to now, as shown in FIG. 14 (a), the video objects OB J 1 and OB J 2 are set as the regions of interest, and the user one overlaps the video object OB J 1 with the video object OB J 2 As shown in Figure 14 (b) when moving to The video object could not be moved if the attribute of the target area of the movement destination was movement prohibited. If the moving of the video object fails, the user must restart moving again.

In order to avoid this trouble, as shown in FIG. 14 (b), when the moving destination video object which is the target area is not moved, as shown in FIG. 14 (c), it is displayed near the moving destination video object. The movement destination of the video object instructed to be moved may be set.

So far, when the video object is hidden due to the movement by the user, the method of reducing the display of the video object has been presented so as not to impair the convenience of the user. Next, an example will be shown where convenience is not lost as in the case of reduced display by displaying a part of the video object outside the hidden video object when the video object is hidden. In FIG. 13, when the video object OB J 1 with low priority is in the state as shown in FIG. 13 (e) due to the user's move operation etc., the OB J 1 is moved as shown in FIG. Move so that part of it is displayed outside the hidden object OB J 2. The user can move the OB J 1 by designating the part displayed outside in this way with an input device such as a mouse. By doing this, the user can move the hidden video object again without losing convenience.

Although FIG. 15 shows an example in which OB J 1 is displayed at a specific position of OB J 2, there is no particular limitation on the position and area to be displayed, and some part of OB J 1 is outside of OB J 2 It should just be displayed.

When a low priority video object is hidden, instead of displaying the reduced display or a part of it, move a high priority video object that hides the video object to lower the priority video. Objects may be displayed. For example, in the state of Fig. 13 (e), OB J 1 is hidden and the user can not operate it. Here, as shown in Fig. 13 (f), ○ BJ 1 reduced to the side of OB J 2 Instead of making it show, ○ BJ 2 is moved to display ○ BJ 1. An example is shown in Fig. 16 (a) in which the video object OBJ 2 is moved to the position where the video object B BJ 1 is displayed. As a result, the user can move the video object OBJ 1 again.

In this example, the video object BBJ 2 is moved until the video object OBJ 1 is completely displayed. However, since the video object OBJ 2 also has a movement restriction, the video If the object OBJ 1 can not be moved enough to display all, the image object OBJ 1 may be displayed in a reduced size as shown in FIG. 16 (b), and the image object OBJ 2 may be moved to display both. Alternatively, as shown in FIG. 16 (c), the video object O B J 2 may be moved to a position where part of the video object O B J 1 can be displayed.

As described above, according to the present invention, the area for restricting the movement of the video object in the program video is set as the area of interest, and the information in the area of interest is distributed according to the program video. By permitting the movement of the video object by the user within a limited range, it is possible to always reflect the distribution side's intention in the program video reproduced by the user's receiving device.

Further, according to the present invention, by using the area valid flag, it is not necessary to distribute the information of the area of interest for each frame, so it is possible to reduce the amount of data when distributing the program video.

Furthermore, according to the present invention, since the movement restriction of the video object can be set for each attention area, the intention on the distribution side can be closely reflected in the video. Furthermore, according to the present invention, since it is possible to set an attention area whose movement is restricted for each video object, when adding a video object in the middle of a program, an attention area where movement of the video object to be added is restricted. It is easy to respond by simply adding the information on.

Also, according to the present invention, the attention area is the same for all video objects. In the case of motion restrictions, since it is not necessary to set different restrictions for all video objects, it is possible to reduce the time and effort of setting the movement limitations of video objects.

Furthermore, according to the present invention, when the user moves the video object to the region of interest, the user is able to freely display only the portion overlapping the region of interest of the video object. The video object can be moved. Also, according to the present invention, when the video object is hidden when the user moves the video object to the attention area, the reduced display of the video object is performed. By displaying an icon or a symbol indicating a video object in the vicinity of the region of interest, the user can easily move the video object again without losing sight of the video object. Industrial applicability

In the data receiving apparatus according to the present invention, when receiving and reproducing a program video composed of a plurality of objects, the user can freely display the screen on an advertisement or the like desired by the distribution side while ensuring the display. It is suitable for the data receiving device which enables the change of the layout of the video object in

Claims

The scope of the claims

1. A receiving unit for receiving digital data of a program video in which encoded data of a plurality of objects are multiplexed;

A multiplex separation unit that separates the digital data of the received program video into encoded data of each object;

A decoding unit that decodes encoded data of the separated object;

A data receiving apparatus comprising: a combining unit configured to combine the decoded objects to form a reproduced video; and a display unit configured to display the reproduced video on a screen. The object for which movement is instructed by the input unit is based on the input unit for instructing the target region, and the target region information included in the digital data of the program video to specify the target region on the screen. A determination unit that determines whether or not

When the object and the note area overlap, the movement and Z or the combination of the object are limited based on the restriction attribute information describing the attribute of the attention area included in the digital data of the program video. A data receiving apparatus comprising: a limiting unit.

2. The data receiving apparatus according to claim 1, wherein the attention area is the object included in the program video, and the attention area information is shape information of the object.

3. The restriction attribute information describes the priority of each object, and the restriction unit restricts the movement of the object by comparing the priority when the attention area overlaps the object. 4. The data receiving apparatus according to claim 2, wherein said data is received.

4. The object attribute information and the movement restriction information are described in the restriction attribute information for each of the areas of interest. A data receiving apparatus according to any one of the preceding claims.

5. If the specified area of interest has the same attribute for all objects, the restriction attribute information is characterized in that the object identification information corresponding to the specified area of interest is not described. Data reception according to claim 4

6. In the restricted attribute information, identification information of a focused area whose movement is restricted for each object is described, according to any one of claims 1 to 3, characterized in that Data receiver.

7. The restriction unit restricts a portion where the attention area overlaps the object to combine the object using a transparency signal, so that the object can be displayed without hiding the attention area. Claims, characterized in that

The data receiving apparatus according to any one of the items 1 to 6.

8. The restriction unit displays the object without hiding the attention area by restricting the reduced image of the object in the vicinity of the attention area when the attention area overlaps the object. The data receiving apparatus according to any one of claims 1 to 6, wherein the request is made possible.

9. The restriction unit restricts the attention area by combining an icon or a symbol image indicating the object in the vicinity of the attention area when the attention area overlaps the object, thereby hiding the attention area. The data receiving apparatus according to any one of claims 1 to 6, characterized in that the display of the object is enabled.

1 0. The digital data of the program video includes an area information valid flag indicating whether the focused area information is valid,

When the area information valid flag indicates that the area of interest information is valid, the restriction unit restricts movement of the object using the area of interest area information received last. Do,

When it is indicated that the attention area information is invalid, the attention area information is The data receiving apparatus according to any one of claims 1 to 9, wherein restriction of movement of the object is not performed regardless of the presence of information.