FR2842320A1 - MULTIMEDIA DATA PROCESSING DEVICE - Google Patents

Abstract

The invention relates to a multimedia data processing device comprising - means for receiving incoming streams of multimedia data of a different nature, - means for managing streams, - means for directing the incoming streams according to their nature to the flow management means, - a plurality of flow processing means depending on the origin or destination of the flows, connected to the flow management means, The management means, the reception means, the means of '' directing the incoming flows and the flow processing means cooperate in order to ensure at least one path for each incoming flow of a different nature in order to allow parallel processing of the flows of different natures and their routing to at least one recipient means of the flow .

Description

The invention relates to a method and a device for processing

multimedia data.

  Multimedia data flow processing devices are required to process flows of a different nature requiring times of

  very short treatment and also remarkable performance.

  By processing multimedia data is meant, in a non-exhaustive manner, coding, decoding in different formats according to the types of application for which the data streams are intended as well as manipulation of multimedia data consisting in personalizing the

  data as desired by a user.

  By multimedia data is meant, in a non-exhaustive manner, audio / video type data, still images, sound, graphic data. In addition, the devices receiving these flows are often devices having characteristics and requirements that are often incompatible, these devices being able to be, in a non-exhaustive manner,

  visualization, storage devices or data networks.

  The processing operations to be carried out on the incoming streams are therefore often different, for example in terms of coding or decoding, and sometimes even incompatible when a stream is intended both for a storage means and for a display device for example. In this case, the data flows must very often be manipulated several times, which requires significant resources in the known devices. Indeed, the known multimedia data processing devices implement architectures based on buses interconnecting the various components allowing to carry out the various treatments at

perform on video.

  If the same flow is intended for different recipients of a different nature, these flows are often transported on the bus in order to undergo the different treatments. The data therefore pass over the bus several times in order to undergo the different treatments carried out by the different modules and when the data is intended for several modules, they very often monopolize the bus several times for the same type of processing, which leads to time important processing and requires many resources. The invention therefore proposes a device whose architecture is suitable for processing multimedia data streams and making it possible to improve the

  performance of current devices.

  To this end, the invention proposes a multimedia data processing device comprising - means for receiving incoming streams of multimedia data of different nature, - flow management means, - means for routing the incoming flows as a function of their nature towards the flow management means, - a plurality of flow processing means according to the origin or the destination of the flows, connected to the flow management means, According to the invention, the management means , the reception means, the means for directing the incoming flows and the flow processing means cooperate in order to ensure at least one path for each incoming flow of different nature in order to allow parallel processing of the flows of different natures and their routing to at least one means recipient of the flow. Thus, the different flows processed are not in competition and can be processed independently of each other so as not to slow down the processing time and avoid the conflicts that can occur in known architectures of the bus type or only one. bus connects them

  different components involved in the processing of flows.

  The proposed architecture can for example be considered as a "pipeline" type architecture as opposed to a bus type architecture

  unique commonly used for this kind of treatment.

  Each flow entering the processing device is routed directly from the input to the output via the different modules

  but by not making several round trips between the different modules.

  According to a preferred embodiment, the means for receiving the stream can be chosen from - a permanent storage means, - a removable storage means, - a data network, - a display means,

  and any combination of these.

  The invention is particularly advantageous, but not limited to this embodiment, when the different streams are intended for storage means, networks or display devices whose requirements are different in terms of stream format, bit rate and of data processing. According to a preferred embodiment, when the recipient module is a display means, the processing means comprise - means for decoding the stream, - means for presenting streams of audio / video type,

  - means of coding a video stream.

  According to this embodiment, the data streams can undergo processing making it possible to perform functions of decoding the stream, converting the audio / video, coding the video according to different standards and thus adapting to the different devices. recipients while not monopolizing the device for these particular treatments. All these treatments are carried out using different paths allowing to

  perform them competitively.

  According to a preferred embodiment, the means for decoding the stream comprise at least two decoding means adapted to decode at

minus two streams simultaneously.

  This may possibly allow for video overlay. According to a preferred embodiment, the means of presenting audio / video type streams are intended to manipulate the data streams by adding to it means chosen from - text overlay - graphic synthesis, - image-in-image insertion, - video effects, - real-time editing on the video stream,

  and any combination of these.

  In accordance with this last embodiment, the device is particularly advantageous for manipulating different types of flow by adding to it possibilities of graphic manipulation and different effects.

  specials to customize the programs received.

  According to a preferred embodiment, the incoming streams of multimedia data are chosen from - streams of digital nature, - streams of analogical nature, - streams coming from the means of presenting streams of audio / video type, - streams coming means for decoding the stream,

  and any combination of these.

  According to a preferred embodiment, the device comprises - means for converting the streams of analog nature into a stream of digital nature, means for coding the digitized analog streams, the streams coming from the stream decoding means and the streams leaving the

  means of presenting audio / video streams.

  According to a preferred embodiment, the device comprises means for protecting the content making it possible to protect the content of the streams leaving the means of presenting streams of audio / video type and of streams coming from the means of decoding the stream and intended to be stored. or

  broadcast to an outside network.

  Content protection is an important issue for content creators and in particular when audio video data processing devices are inserted in communication networks because it is then difficult to control the use of content by the various devices connected to the network . It may therefore be particularly advantageous, in certain embodiments, to provide protection of the content so as to limit

  the use of data and the rights of certain users.

  The invention also relates to a method of processing multimedia data comprising the steps of: - receiving incoming streams of multimedia data of different nature, - routing the streams according to their nature to flow management means, - stream processing depending on the origin or destination of the flow, connected to the flow management means, characterized in that it includes a step allowing the management means, the means to direct the flows and the processing means to cooperate to ensure at least one direct and distinct path for each incoming flow of different nature to ensure simultaneous processing of flows of different nature and their

  routing to at least one module receiving the content.

  The invention will be better understood and illustrated by means of examples of advantageous embodiments and implementation, in no way limiting, with reference to the appended figures in which: - Figure 1 shows an overall representation of an embodiment of the invention, - Figure 2 shows a detailed representation of a mode of

realization of the invention.

  In FIG. 1, the processing device 100 includes digital inputs Dl, D2, ..., Dn and analog inputs Ax

  carrying multimedia or analog data.

  The analog streams are converted into digital streams by an analog / digital converter 10 and sent to a multiplexer 1

  also multiplexing the looped inputs coming from the device 100.

  The output of encoder 2 is connected to device 100 and more

  particularly in module 3 of flow routing.

  The module 3 receives as input all the incoming flows mentioned and directs the flows according to their nature and their destination. The inputs of module 3 are dedicated to the incoming flows, the outputs are dedicated to the inputs of a flow manager 4. The module 3 is an adaptation layer which makes it possible to route an incoming signal to a process (which has an input dedicated) of the flow manager 4. The referral depends on the application. For example, the direct recording of a stream on a storage means of the hard disk type, not shown, connected to an input / output 8 of the device 100, is done by establishing a path between an input D1, D2, .. ., Dn or an output of encoder 2 and the input of the process which manages the audio / video recording of the

Hard disk.

  The referral module 3 is connected to the data flow manager 4. The module 4 performs, among other things, demultiplexing operations, access control on the audio / video stream, descrambling, time stamping, storage, reading, unpacking of two or more incoming streams. It also performs readings of data stored in storage means connected to input / output 8. This module is capable of processing at least two flows simultaneously. All operations are carried out in real time by

fast processors.

  The flow manager generates different types of flows

depending on the destination of the flows.

  The device 100 includes processing means consisting of

  decoders 5, video presentation module 6 and video encoder 7.

  The flows can be intended for storage devices,

  visualization devices, or to other terminals across networks.

  The streams intended for display devices are transmitted to decoders 5 operating according to well-known standards depending on the type of

recipient device.

  The input streams of the decoder conform to the MPEG-2 (English acronym for "Motion Picture Expert Group"), MPEG-4, DV (English acronym for "Digital video") or JPEG (English acronym for "Joint Picture") standard. Expert Group "), TIFF (acronym for" Tagged Image File Format ") for coding still images, PNG (acronym for" Portable Network Graphics ") or MP3 (acronym for" MPEG audio layer "), MP3Pro , WMA (English acronym for "Windows Media Audio") for sound. The decoders 5 are for example decoders conforming to the

  CCIR 656 standard, also known as 4: 2: 2.

  These decoders are, for example, coders based on the

  transformed into discrete cosine (DCT).

  The decoders 5 include fast processors controlled by real-time software which allow real-time decoding of video streams without

  assistance from external processors.

  MPEG-2, MP3, WMA audio streams are processed by

  audio decoders not shown in this figure.

  The output of the video decoder is connected to a module 6 of

presentation of the video.

  This module includes means allowing it to perform special effects modes, text inlay ("OSD" in English), image in image ("PIP" in English), graphic synthesis, of the edition

real time on the video stream.

  This module also allows you to make advanced presentations by adding special modes such as two or three-dimensional images. In such modules as module 6, the video is considered to be a texture and is mapped onto two-dimensional shapes such as rectangles or any other shape. When three-dimensional effects are achieved, three-dimensional shapes such as

  cubes for example are used to tackle the video.

  Pixel-level calculations are performed to apply the illumination,

shading and other effects.

  The video presentation module 6 provides the means to locally produce animated images, completely synthesized or created from original images or scenes. Such animated images can for example be EPGs (acronym for "electronic program guide"), games. The presentation module allows you to present images either by

  scene composition from object, either by synthesis, or both.

  The video presentation module also allows a user to edit video in real time and thereby produce his

  personal films or its image libraries.

  The video presentation module 6 is connected at the output to a video encoding module 7 which produces a signal conforming to the format required by the display device. This output signal can be a known signal of digital or analog type, for example of SDTV type (English acronym for "Standard Definition Television") or of HDTV type (acronym

  "High Definition Television").

  In a first embodiment, when the output format conforms to the SDTV standard, the analog encoder is produced by an encoder of digital type to which a digital analog converter is added. The digital encoder directly converts a 4: 2: 2 signal into an NTSC (English acronym for "National Television System Committee") signal, conforming to the CCIR601 standard, or a PAL signal (English acronym for "Phase Alternating Line"), SECAM (acronym for "Color Electronic System With Memory"), Y / C or RGB (acronym for "Red,

Green Blue ")..

  Alternatively, when the output format conforms to the HDTV standard, the signals are formatted to the 4: 2: 2 signal and transmitted using for example the DVI standard (English acronym for "Digital Visual

  Interface "meaning" digital visual interface ").

  The output of the decoders 5 is also connected to the multiplexer 1.

  This advantageously makes it possible to record audio / video data in any format before or after transcoding. This advantageously allows data encoded initially in DV format (at 3OMbit / s) to be recorded in MPEG-2 format at a speed of 4Mbit / s, the loss of quality

being very weak.

  The output of the video presentation module 6 is also connected to the multiplexer 1. This advantageously makes it possible to record video after having edited, modified, processed it. For example, this can allow a user receiving video from a digital camcorder via an IEEE-1394 standard network to edit that video by adding special effects, comments, and recording it. then on a storage medium at a lower speed so as not to use too much space

memory on a storage medium.

  Content protection mechanisms, not shown, are used to preserve the rights associated with the data received. Indeed, the protection of content is an important objective in the processing of audio / video data and content creators do not wish to use it without

data limit.

  FIG. 2 represents a more detailed view of a device 200

  according to an embodiment of the invention.

  The device 200 according to an embodiment according to the invention comprises two analog inputs AI, A2, two digital inputs D1, D2, two inputs 35, 36 connected to an interface 34 conforming to the IEEE-1394 standard. The two analog inputs are connected to a multiplexer 38, the output of which is connected to an encoding module 11 allowing

  to encode analog streams in CCIR656 format.

  The stream encoded in CCIR656 format leaving the encoding module 11 is multiplexed by a multiplexer 1 with looped streams coming from the device 200. At the output of the multiplexer 1, the streams are transmitted to an encoder 2 encoding the data in MPEG format- 2. A memory 37 of SDRAM type (English acronym for "Synchronous Dynamic Random Access Memory")

is connected to encoder 2.

  The digital inputs DI, D2, the outputs of the IEEE-1394 interface and the outputs of the encoder 2 are all connected to the data routing module 3 which routes the flows according to their nature and their destination

as previously described.

  The module 3 is connected to the flow management module 4 described above. This module 4 is connected to permanent 12 and removable storage means 13. These storage means advantageously make it possible to record video data encoded in different formats. The flow manager 4 is also connected to a microprocessor 14 itself connected to an Ethernet link 15, to a reader

  chip card 16 and an SDRAM type memory 17.

  The microprocessor 14 houses the system, the applications and controls the various peripherals linked to the system, such as a PROM memory (acronym for "Programmable Read Only Memory") 18, a real time clock 19, a graphics generator 26, the slow devices such as Ethernet interface 15, smart card reader 16, asynchronous mode

  interface 34 IEEE-1394, configure all system modules.

  The flow manager 4 is a set of processors dedicated to the processing of flows, controlled and controlled by the microprocessor but having the resources necessary to perform the requested tasks

by different applications.

  The stream manager 4 is connected to video decoders 20 and 21 and to audio decoders 22 and 23. The video decoders 20 and 21 are

  respectively connected to memories 24 and 25 of SDRAM type.

  Video decoders 20 and 21 are connected to module 6 of

presentation of the video.

  The audio decoders 22 and 23 are connected to an audio module 29.

  This audio module 29 allows direct connection to a device for

audio playback 32.

  The video presentation module 6 is connected to a

  graphics accelerator 26 itself connected to a memory 27 of SDRAM type.

  The module 6 is also connected to a CVBS coding device (acronym for "Composite Video Baseband Signal") 28 itself

  connected to a display device 31.

  A connection bus B connects the graphics accelerator 26, the microprocessor 14, the smart card reader 16 as well as the memory 18 of

  PROM type, real time clock 19 and interface 34 IEEE-1394.

Claims (9)

claims   1. Multimedia data processing device (100,200) comprising means (1, 2, 10) for receiving incoming streams (Dl, D2, Dn, Ax, AI, A2, 36, 35) of multimedia data of different nature, - means (4) for flow management, - means (3) for directing incoming flows according to their nature to the means (4) for flow management, - a plurality of means (5, 6, 7 ) flow processing as a function of the origin or destination of the flows, connected to the flow management means (4), characterized in that the management means (4), the means (1, 2, 10) reception, the means (3) for directing the incoming flows and the flow processing means (5, 6, 7) cooperate in order to ensure at least one path for each incoming flow of different nature in order to allow parallel processing flows of different natures and their routing to at least one recipient means (8, 9) of the flow.   2. Device according to claim 1 characterized in that the means receiving the flow can be chosen from - a means (12) of permanent storage, - a means (13) of removable storage, - a data network, - a means ( 31) of visualization,   and any combination of these.   3. Device according to one of claims 1 or 2 characterized in that,   when the recipient module is a display means, the plurality of processing means comprise - means (5, 20, 21, 22, 23) for decoding the stream, - means (6) for presenting streams of audio type / video,   - means (7) for coding a video stream.   4. Device according to claim 3 characterized in that the means (5) for decoding the stream comprise at least two decoding means adapted to decode at least two streams simultaneously. 5. Device according to claim 3 or 4 characterized in that the means (6) for presenting audio / video type flows are intended to manipulate the data flows by adding means chosen therefrom - from text overlay - graphic synthesis, - image-in-image insertion, - video effects, - real-time editing on the video stream,   and any combination of these.   6. Device according to one of claims 1 to 6 characterized in that the   incoming streams (DI, D2, Dn, Ax, AI, A2, 36, 35) of multimedia data are chosen from - streams (DI, D2, Dn) of digital nature, - streams (AI, A2, Ax) of analog nature, - streams coming from the means of presenting audio / video type streams, - streams coming from the stream decoding means,   and any combination of these.   7. Device according to claim 6 characterized in that it comprises means (10) for converting the streams of analog nature (AI, A2, Ax) into streams of digital nature, - means (2) for coding the analog streams (AI, A2, Ax) digitized, the streams coming from the stream decoding means and the   outgoing flow means for presenting audio / video type flows.   8. Device according to claim 7 characterized in that it comprises means for protecting the content making it possible to protect the content of the flows leaving the means of presenting audio / video type flows and flows coming from the means for decoding the flow and intended to be stored or distributed to an external network. 9. Method for processing multimedia data comprising the steps of - receiving incoming flows of multimedia data of a different nature, - switching flows according to their nature to flow management means, - processing flows according to origin or destination of the flow, connected to the flow management means, characterized in that it comprises a step making it possible to ensure at least one direct and distinct path for each incoming flow of different nature between the different means in order to ensure the simultaneous processing of flows of a different nature and their   routing to a content recipient module.