CN108234511B - Method, system, equipment, storage medium and gateway for multimedia data transmission - Google Patents
Method, system, equipment, storage medium and gateway for multimedia data transmission Download PDFInfo
- Publication number
- CN108234511B CN108234511B CN201810049931.9A CN201810049931A CN108234511B CN 108234511 B CN108234511 B CN 108234511B CN 201810049931 A CN201810049931 A CN 201810049931A CN 108234511 B CN108234511 B CN 108234511B
- Authority
- CN
- China
- Prior art keywords
- port
- address
- data
- network
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/50—Address allocation
- H04L61/5007—Internet protocol [IP] addresses
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L61/00—Network arrangements, protocols or services for addressing or naming
- H04L61/09—Mapping addresses
- H04L61/25—Mapping addresses of the same type
- H04L61/2503—Translation of Internet protocol [IP] addresses
- H04L61/256—NAT traversal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1101—Session protocols
- H04L65/1104—Session initiation protocol [SIP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
- H04L69/164—Adaptation or special uses of UDP protocol
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M7/00—Arrangements for interconnection between switching centres
- H04M7/006—Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a method, a system, equipment, a storage medium and a gateway for multimedia data transmission, which comprises the following steps: receiving signaling data, changing the signaling data according to a target address of the signaling data, converting a transmission protocol of the signaling data into a public network user protocol or a UDP protocol, changing an SDP field of the signaling data, adding a candidate IP address and a port to realize the conversion of a network address into a preset public network IP address and a first port or an internal network IP address and a second port, sending the changed signaling data to the target address, establishing a multimedia transmission connection, receiving media stream data, and sending the changed media stream data to the target address. The invention unifies the transmission protocol of the data transmitted to the internal network into the UDP protocol by converting the transmission protocol of the signaling data, and the background server only needs to process the data of the UDP protocol, thereby realizing the support of all users for the VoIP service without modification.
Description
Technical Field
The present invention relates to multimedia data transmission in a network environment, and more particularly, to a method, system, device, storage medium, and gateway for multimedia data transmission.
Background
VoIP (Voice over IP, IP-based language service) refers to multimedia data transmission over IP-based data networks in the Internet, intranet, and lan, where the multimedia data includes Voice, video data, and signaling data. VoIP provides diversified, simplified and low-price practical service for consumers, provides low-price service, accords with the development direction of three-in-one network, and promotes the development and transformation of the telecommunication industry. The VoIP establishes a Session using SIP (Session Initiation Protocol). SIP is a multimedia communication protocol established by the IETF (Internet Engineering Task Force) and is a text-based application-layer control protocol for creating, modifying and releasing sessions of one or more participants. However, the transmission modes of the SIP session data are various, and different data sources use transmission protocols with different formats, for example, the web end may transmit the SIP session data in the WS or WSs protocol to access the VoIP service, and the mobile end application, the software terminal, and the entity phone may access the VoIP service in the UDP, TCP, or TLS protocol.
Therefore, to support all users, the VoIP service must implement all the above transmission methods. However, the implementation of all the transmission modes has high requirements on the background system and the background server, and the background system and the background server need to be modified to support all the transmission protocol data, which consumes time and cost.
In addition, because of the shortage of public IP addresses and Network security problems, NAT (Network Address Translation) is generally used, but it is a further challenge to realize multimedia data transmission in all transmission schemes under NAT.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a method, a system, equipment, a storage medium and a gateway for transmitting multimedia data, which can realize the transmission of multimedia data in all transmission modes under the condition of not modifying a background server.
A first aspect of the present invention provides a method for transmitting multimedia data, the multimedia data including signaling data and media stream data, the multimedia data being transmitted between a public network and an internal network, the method for transmitting multimedia data including the steps of: s11, receiving signaling data; s12, changing the signaling data according to the destination address of the signaling data, when the destination address of the signaling data is a public network, converting the transmission protocol of the signaling data into a public network user protocol, converting the network address and the port of the signaling data into a preset public network IP address and a first port, when the destination address is an internal network, converting the transmission protocol of the signaling data into a UDP protocol, and converting the network address and the port of the signaling data into a preset internal network IP address and a second port; s13, sending the changed signaling data to a target address and receiving the signaling data returned by the target address; repeating the steps S11 to S13 until the multimedia transmission connection is established; s14, receiving the media stream data, converting the IP address and port of the media stream data into a preset public network IP address and a first port or a preset internal network IP address and a second port, and sending the changed media stream data to the target address.
Preferably, step S12 includes: s121, authenticating a target address and a source address of the signaling data; s122, acquiring multimedia proxy resources, and allocating a port number of a first port and a port number of a second port from a plurality of alternative port numbers; s123, changing an SDP field of the signaling data according to the target address of the signaling data, and adding the candidate IP address and the port as a public network IP address and a first port or an internal network IP address and a second port; s124, the transmission protocol of the signaling data is converted according to the target address of the signaling data.
Preferably, the preset public network IP address in step S12 is an IP address of a first network card of the multimedia transmission gateway, the first network card is in butt joint with the public network, the preset internal network IP address is an IP address of a second network card of the multimedia transmission gateway, and the second network card is in butt joint with the internal network.
Preferably, in step S123, the number of alternative port numbers of the first port is equal to the number of alternative port numbers of the second port, and in each multimedia transmission connection, a pair of the port number of the first port and the port number of the second port is allocated.
The second aspect of the present invention also provides a system for multimedia data transmission, where the multimedia data includes signaling data and media stream data, and the multimedia data is transmitted between a public network and an internal network, including: the signaling service module is used for receiving and sending signaling data to establish multimedia transmission connection, changing the signaling data according to a target address of the signaling data, converting a transmission protocol of the signaling data into a public network user protocol when the target address of the signaling data is a public network, converting a network address and a port of the signaling data into a preset public network IP address and a first port, and converting the transmission protocol of the signaling data into a UDP protocol when the target address is an internal network, and converting the network address and the port of the signaling data into the preset internal network IP address and a second port; the media stream service module is used for receiving media stream data after the multimedia transmission connection is established, converting the IP address and the port of the media stream data into a preset public network IP address and a first port or a preset internal network IP address and a second port, and sending the changed media stream data to a target address.
Preferably, the system for multimedia data transmission includes a first IP address and a second IP address, the preset public network IP address is the first IP address, the first IP address is used for communicating with the public network, the preset internal network IP address is the second IP address, and the second IP address is used for communicating with the internal network.
Preferably, the signaling service module acquires the multimedia proxy resource from the media streaming service module, allocates a port number of the first port and a port number of the second port from a plurality of alternative port numbers, the number of the alternative port numbers of the first port is equal to the number of the alternative port numbers of the second port, and allocates a pair of the port number of the first port and the port number of the second port in each multimedia transmission connection.
Preferably, the signaling service module changes the SDP field of the signaling data according to the destination address of the signaling data, and adds the candidate IP address and port as the public network IP address and the first port or the internal network IP address and the second port.
The third aspect of the present invention also provides a multimedia data transmission apparatus comprising: a processor; a memory having stored therein executable instructions of the processor; wherein the processor is configured to perform the steps of the method of multimedia data transmission of the first aspect described above via execution of executable instructions.
The fourth aspect of the present invention also provides a computer-readable storage medium for storing a program which, when executed, implements the steps of the method for multimedia data transmission of the first aspect described above.
The fifth aspect of the present invention also provides a multimedia data transmission gateway, which includes the multimedia data transmission system of the second aspect.
The method, the system, the equipment, the storage medium and the gateway for transmitting the multimedia data change the signaling data according to the target address of the signaling data and convert the transmission protocol of the signaling data so as to unify the transmission protocol of the data transmitted to the internal network into a UDP protocol, and the data transmitted to the public network meets the user protocol of the public network. The background system and the background server only need to process data of a UDP protocol, thereby realizing the support of all users for the VoIP service without modification.
Through changing the SDP field of the signaling data, the candidate IP address and the port are added to realize network address conversion, and the IP address and the port of the media stream data are converted, thereby realizing NAT traversal, effectively improving public IP address allocation and improving network security.
Drawings
Other features, objects and advantages of the present invention will become more apparent upon reading of the following detailed description of non-limiting embodiments thereof, with reference to the accompanying drawings.
Fig. 1 is a flow chart of a method of multimedia data transmission according to an embodiment of the invention;
fig. 2 is a detailed flowchart of step S12 in fig. 1;
FIG. 3 is a block diagram of a system for multimedia data transmission according to an embodiment of the present invention;
FIG. 4 is a timing diagram of an internal network outgoing call of the present invention;
FIG. 5 is a timing diagram of the public network outgoing call of the present invention;
fig. 6 is a schematic structural diagram of an apparatus for multimedia data transmission according to an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention; and
fig. 8 is a schematic structural diagram of a multimedia data transmission gateway according to an embodiment of the present invention.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their repetitive description will be omitted.
The existing VoIP service has high requirements on a background system and a background server, all public network user protocols need to be supported, and due to the fact that the number of the background servers is large, the background is difficult to reconstruct one by one, and time and cost are consumed. Meanwhile, it is a further challenge to realize multimedia data transmission in all transmission modes under NAT.
The VoIP of the invention adopts SIP to establish conversation, in the network voice service of two parties or multiple parties, the multimedia data transmitted by each party comprises signaling data and media stream data, the signaling data is used for coordinating the process of multimedia transmission communication, and the media stream data comprises specific media contents such as voice data and video data. The invention is directed to multimedia data transmission, and is mainly applied to the transmission between a public network and an internal network.
Fig. 1 is a flowchart of a method for transmitting multimedia data according to an embodiment of the present invention. The multimedia data transmission method comprises a multimedia transmission gateway, wherein the multimedia transmission gateway is arranged between a public network and an internal network and is used as a gateway for processing a multimedia data packet between the public network and the internal network.
As shown in fig. 1, the method for transmitting multimedia data of the present invention comprises the following steps:
and S11, receiving the signaling data. The signaling data includes, in accordance with its contents, signaling data of a call request, signaling data of a call response. The establishment of multimedia transmission connection of each party is realized through multiple times of signaling data interaction.
And S12, changing the signaling data according to the target address of the received signaling data.
Fig. 2 is a detailed flowchart of step S12 in fig. 1, and step S12 is described in detail below with reference to fig. 2. First, in step S121, the destination address and the source address of the signaling data are authenticated. When the signaling data of the call request sent by the multimedia data session initiator is received, the target address and the source address of the signaling data are authenticated, and the address is confirmed to be free from abnormity, so that the communication safety is guaranteed.
Preferably, in this embodiment, before receiving the signaling data of the call request, a registration authentication step is further included, that is, the client of the public network or the backend server of the internal network registers and stores the communication information in the multimedia transmission gateway. The communication information includes an IP address and a port of a client or a server of the public network. For communication security, the multimedia transport gateway authenticates clients of the public network. In this embodiment, in order to improve the processing efficiency of the multimedia transmission gateway, reduce the operation occupation, improve the system throughput, query whether the client of the public network has ever registered within a preset time period, if so, no registration authentication is performed, and directly default that the client of the public network is a secure client, and perform the subsequent steps.
Next, in step S122, the multimedia proxy resource is obtained. The multimedia proxy resource comprises port numbers of the first port and the second port. The multimedia transport gateway allocates a port number of the first port and a port number of the second port from a plurality of alternative port numbers. Wherein the first port is for interfacing with a public network and the second port is for interfacing with an internal network.
Preferably, in order to ensure the processing amount at the time of high concurrency, the number of the alternative port numbers of the first port is equal to the number of the alternative port numbers of the second port, that is, the paired first port and second port of port number 1 to 1 can be allocated for each multimedia transmission connection. For convenience of management, the port numbers of the first port and the second port are the same in the same multimedia transmission connection.
In this embodiment, at least 1000 alternative port numbers for the first port and the second port are set, so as to further guarantee the processing speed and the processing amount of the multimedia data.
Next, in step S123, the network address and the port of the signaling data are converted according to the destination address of the signaling data.
The multimedia transmission gateway comprises a first network card and a second network card, wherein the first network card is in butt joint with a public network, and the second network card is in butt joint with an internal network. The preset public network IP address is the IP address of a first network card of the multimedia transmission gateway, and the preset internal network IP address is the IP address of a second network card of the multimedia transmission gateway.
Preferably, in the present invention, the network address and the port of the signaling data are converted by changing the SDP field of the signaling data. Specifically, a candidate IP address and a port are added in an SDP field of the signaling data, so that a receiver receiving the changed signaling data can locate multimedia agent resources by reading the candidate IP address and the port, and the NAT traversal of the information data is conveniently, efficiently and reliably ensured.
For the SDP field for changing the signaling data, when the signaling data destination address is a public network, adding a candidate IP address and a port to realize the conversion of the network address into a preset public network IP address and a first port, and when the signaling data destination address is an internal network, adding the candidate IP address and the port to realize the conversion of the network address into the preset internal network IP address and a second port.
In step S124, the transmission protocol of the signaling data is converted. When the signaling data destination address is a public network, the transmission protocol of the signaling data is converted into a public network user protocol. When the destination address of the signaling data is an internal network, the transmission protocol of the signaling data is converted into a UDP protocol.
The public network user protocol comprises a WS protocol, a WSS protocol, a UDP protocol, a TCP protocol or a TLS protocol. The WS protocol is a protocol specification proposed by html5, specified by IETF as standard RFC 6455 in 2011 and supplemented by RFC7936, and it promises a communication specification, and through a handshake mechanism, a TCP-like connection can be established between the browser and the server. The WSS protocol is an encrypted version of the WS protocol, and the WS protocol is combined with SSL to realize safe WS protocol communication, namely the WSS protocol. The TCP Protocol (Transmission Control Protocol) is a connection-oriented, reliable transport layer communication Protocol based on a byte stream, and is defined by RFC793 of the IETF. The TLS protocol (transport layer Security) is used to provide confidentiality and data integrity between two communicating applications. The UDP (User Datagram Protocol) is a connectionless transport layer Protocol in an OSI (Open System Interconnection) reference model, and provides a transaction-oriented simple unreliable information transfer service, and IETF RFC 768 is a formal specification of UDP.
The transmission protocol of the signaling data is changed, so that the transmission protocol of the data transmitted to the internal network is unified into a UDP protocol, and the data transmitted to the public network meets the user protocol of the public network. Therefore, the background system and the background server only need to process the data of the UDP protocol, and all users are supported for the VoIP service without modification.
Preferably, steps S122 and S123 are performed before step S124, so as to ensure that signaling data can still be transmitted when step S124 fails to be implemented or there is an error, thereby improving the success rate of communication.
And S13, sending the changed signaling data to the target address, and receiving the signaling data returned by the target address.
The received returned signaling data is the step S11, and the steps S11 to S13 are repeated until the communicating parties establish the multimedia transmission connection. If the established multimedia transmission connection is successful, step S14 is executed.
S14, receiving the converted transmission media stream data.
In particular, media stream data is received after a multimedia transport connection is established. And converting the IP address and the port of the media stream data into a preset public network IP address and a first port or a preset internal network IP address and a second port according to the target address of the media stream data, and sending the changed media stream data to the target address.
Through changing the SDP field of the signaling data, candidate IP addresses and ports are added to realize network address conversion, so that communication parties in a public network and an internal network can obtain a transmission target address for media stream data processing when a multimedia transmission connection is established. And converting the IP address and the port of the media stream data, thereby realizing NAT traversal, effectively improving public IP address allocation and improving network security.
Fig. 3 is a schematic diagram of a multimedia data transmission system according to an embodiment of the present invention, and the following description is provided with reference to fig. 3.
The system 10 for multimedia data transmission includes a signaling service module 11 and a media streaming service module 12. The signaling service module 11 is configured to receive and send signaling data to establish a multimedia transmission connection. The media stream service module 12 is configured to transmit media stream data after the multimedia transmission connection is established.
In fig. 3, clients 21,22,23 in the public network 20 transmit multimedia data in a variety of public network user protocols. The web end user 21 transmits multimedia data by means of the WS protocol or the WSs protocol. The mobile application user 22 or the software terminal accesses the VoIP service through TCP or TLS protocol. The physical phone user 23 may transmit multimedia data via UDP protocol.
Within the internal network 30 there are a number of background servers 31,32 for handling speech processing, such as a call centre 31 and a speech server 32.
As shown in fig. 3, clients 21,22,23 in the public network 20 and background servers 31,32 in the internal network 30 need to perform multimedia data transmission.
In this embodiment, first, the signaling service module 11 in the system 10 for multimedia data transmission receives signaling data.
The signalling service module 11 then modifies the signalling data according to its destination address. Specifically, the system 10 for multimedia data transmission includes a first IP address and a second IP address, the preset public network IP address is the first IP address, the first IP address is used for communicating with the public network 20, the preset internal network IP address is the second IP address, and the second IP address is used for communicating with the internal network 30.
After receiving signaling data initiated by a call, the signaling service module 11 applies for port numbers of the first port and the second port from the media stream service module 12, and the media stream service module 12 allocates the port numbers of the first port and the second port among a plurality of port numbers, and the port numbers of the first port and the second port are the same in the same multimedia transmission connection.
When the destination address of the signaling data is the public network 20, converting the transmission protocol of the signaling data into a public network user protocol, changing the SDP field of the signaling data, adding a candidate IP address and a port to realize the conversion of the network address into a preset public network IP address and a first port, when the destination address is the internal network, converting the transmission protocol of the signaling data into a UDP protocol, changing the SDP field of the signaling data, and adding a candidate IP address and a port to realize the conversion of the network address into the preset internal network IP address and a second port.
The public network user protocol comprises a WS protocol, a WSS protocol, a UDP protocol, a TCP protocol or a TLS protocol.
The signaling service module 11 sends the changed signaling data to the target address and receives the signaling data returned by the target address. The signaling service module 11 repeats the above steps until the multimedia transmission connection is established.
The media stream service module receives media stream data after the multimedia transmission connection is established, converts the IP address and the port of the media stream data into a preset public network IP address and a first port or a preset internal network IP address and a second port, and sends the changed media stream data to a target address so as to transmit the media stream data.
Fig. 4 is a timing diagram of the internal network call of the present invention, and fig. 5 is a timing diagram of the public network call of the present invention. The following describes the data processing procedure of the system for multimedia data transmission with reference to fig. 4 and 5.
As shown in fig. 4, the internal network 30 sends out signaling data of the call request. The signaling data is received by a signaling service module 11 in the system 10 for multimedia data transmission. The signaling service module 11 applies for the proxy resource from the media stream service module 12, and the media stream service module 12 returns the proxy resource to the signaling service module 11. The proxy resource comprises port numbers of the first port and the second port.
The signaling service module 11 changes the signaling data according to the target address of the signaling data, and if the target address is the public network 20, the transmission protocol of the signaling data is converted into the public network user protocol, the SDP field of the signaling data is changed, and the candidate IP address and the port are the IP address and the first port of the first network card are added in the SDP field. The signaling service module 11 forwards signaling data of the changed call request to a destination address of the public network 20.
The signaling service module 11 receives the signaling data of the call response returned by the public network 20, changes the signaling data according to the target address of the signaling data, and if the target address is the internal network 10, converts the transmission protocol of the signaling data into a UDP protocol, changes the SDP field of the signaling data, and adds the candidate IP address and the port as the IP address of the second network card and the second port in the SDP field. The signaling service module 11 forwards the signaling data of the changed call response to the destination address of the internal network 10.
The client in the public network 20 and the background server in the internal network 10 both obtain the IP address and port for the subsequent media stream data transmission, and the multimedia transmission connection is established. Clients in the public network 20 and background servers in the internal network 10 process the media stream data through the media stream service module 12, thereby implementing multimedia communication.
Similarly, as shown in fig. 5, public network 20 sends signaling data for the call request. The signaling data is received by a signaling service module 11 in the system 10 for multimedia data transmission. The signaling service module 11 applies for the proxy resource from the media stream service module 12, and the media stream service module 12 returns the proxy resource to the signaling service module 11. In this embodiment, the proxy resource is the port numbers of the first port and the second port.
The signaling service module 11 changes the signaling data according to the target address of the signaling data, and if the target address is the internal network 10, the transmission protocol of the signaling data is converted into the UDP protocol, the SDP field of the signaling data is changed, and the candidate IP address and the port are the IP address and the second port of the second network card are added to the SDP field. The signaling service module 11 forwards signaling data of the changed call request to a destination address of the internal network 10.
The signaling service module 11 receives signaling data of a call response returned by the public network 20, changes the signaling data according to a target address of the signaling data, and if the target address is the public network 20, converts a transmission protocol of the signaling data into a public network user protocol, changes an SDP field of the signaling data, and adds a candidate IP address and a port to the SDP field, where the port is an IP address of the first network card and the first port. The signaling service module 11 forwards the signaling data of the changed call response to the destination address of the public network 20.
The client in the public network 20 and the background server in the internal network 10 both obtain the IP address and port for the subsequent media stream data transmission, and the multimedia transmission connection is established. Clients in the public network 20 and background servers in the internal network 10 process the media stream data through the media stream service module 12, thereby implementing multimedia communication.
It can be known from the above description of the multimedia data transmission system that the present invention changes the signaling data according to the target address of the signaling data, and converts the transmission protocol of the signaling data, so that the transmission protocol of the data transmitted to the internal network is unified into the UDP protocol, and the data transmitted to the public network meets the public network user protocol. The background system and the background server only need to process data of a UDP protocol, thereby realizing the support of all users for the VoIP service without modification.
Through changing the SDP field of the signaling data, the candidate IP address and the port are added to realize network address conversion, and the IP address and the port of the media stream data are converted, thereby realizing NAT traversal, effectively improving public IP address allocation and improving network security.
The embodiment of the invention also provides multimedia data transmission equipment which comprises a processor. A memory having stored therein executable instructions of the processor. Wherein the processor is configured to perform the steps of the above-described method of multimedia data transmission via execution of executable instructions.
As described above, the embodiment modifies the signaling data according to the destination address of the signaling data, and converts the transmission protocol of the signaling data so that the transmission protocol of the data transmitted to the internal network is unified into the UDP protocol, and the data transmitted to the public network satisfies the public network user protocol. And by changing the SDP field of the signaling data, adding a candidate IP address and a candidate port to realize network address conversion, converting the IP address and the candidate port of the media stream data, and realizing NAT traversal.
As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or program product. Thus, various aspects of the invention may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" platform.
Fig. 6 is a schematic structural diagram of a multimedia data transmission apparatus according to an embodiment of the present invention. The multimedia data transmission apparatus 600 according to this embodiment of the present invention is described below with reference to fig. 6. The multimedia data transmission apparatus 600 shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present invention.
As shown in fig. 6, the multimedia data transmission apparatus 600 is embodied in the form of a general-purpose computing apparatus. The components of the multimedia data transmission apparatus 600 may include, but are not limited to: at least one processing unit 610, at least one memory unit 620, a bus 630 connecting the different platform components (including the memory unit 620 and the processing unit 610), a display unit 640, etc.
Wherein the storage unit stores program code executable by the processing unit 610 to cause the processing unit 610 to perform steps according to various exemplary embodiments of the present invention described in the above-mentioned electronic prescription flow processing method section of the present specification. For example, processing unit 610 may perform the steps as shown in fig. 1.
The storage unit 620 may include readable media in the form of volatile memory units, such as a random access memory unit (RAM)6201 and/or a cache memory unit 6202, and may further include a read-only memory unit (ROM) 6203.
The memory unit 620 may also include a program/utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The multimedia data transmission apparatus 600 may also communicate with one or more external devices 700 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the multimedia data transmission apparatus 600, and/or with any device (e.g., router, modem, etc.) that enables the multimedia data transmission apparatus 600 to communicate with one or more other computing devices. Such communication may occur via an input/output (I/O) interface 650. Also, the multimedia data transmission apparatus 600 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) through the network adapter 660. The network adapter 660 can communicate with other modules of the multimedia data transmission apparatus 600 through the bus 630. It should be understood that although not shown in the figures, other hardware and/or software modules may be used in conjunction with the multimedia data transmission apparatus 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, to name a few.
An embodiment of the present invention further provides a computer-readable storage medium for storing a program, and when the program is executed, the steps of the method for transmitting multimedia data in the foregoing embodiments are implemented. In some possible embodiments, the aspects of the present invention may also be implemented in the form of a program product comprising program code for causing a terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above-mentioned electronic prescription flow processing method section of this specification, when the program product is run on the terminal device.
As described above, the program of the computer-readable storage medium of this embodiment, when executed, changes the signaling data according to the target address of the signaling data, and converts the transmission protocol of the signaling data so that the transmission protocol of the data transmitted to the internal network is unified into the UDP protocol and the data transmitted to the public network satisfies the public network user protocol. And by changing the SDP field of the signaling data, adding a candidate IP address and a candidate port to realize network address conversion, converting the IP address and the candidate port of the media stream data, and realizing NAT traversal.
Fig. 7 is a schematic structural diagram of a computer-readable storage medium according to an embodiment of the present invention. Referring to fig. 7, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
A computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Fig. 8 is a schematic structural diagram of a multimedia data transmission gateway according to an embodiment of the present invention. The multimedia data transmission gateway 10 comprises the system of multimedia data transmission gateways described above. Specifically, the multimedia data transmission gateway 10 includes a signaling service module 11 and a media streaming service module 12. The signaling service module 11 and the media streaming service module 12 may be software or hardware devices with related functions. For example, the signaling service module 11 is software including softsbc service, and is used for performing signaling data translation, registration and signaling data NAT traversal between the public network and the internal network. The media stream service module 12 is, for example, software including rtpengine service, and is configured to perform NAT traversal and transcoding of media stream data. The specific functions of the multimedia data transmission gateway 10 are described in detail in the above-mentioned system of multimedia data transmission gateways, and will not be described in detail here.
The method, the system, the equipment, the storage medium and the gateway for transmitting the multimedia data change the signaling data according to the target address of the signaling data and convert the transmission protocol of the signaling data so as to unify the transmission protocol of the data transmitted to an internal network into a UDP protocol, and the data transmitted to a public network meets the protocol of a public network user. The background system and the background server only need to process data of a UDP protocol, thereby realizing the support of all users for the VoIP service without modification.
Through changing the SDP field of the signaling data, the candidate IP address and the port are added to realize network address conversion, and the IP address and the port of the media stream data are converted, thereby realizing NAT traversal, effectively improving public IP address allocation and improving network security.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (6)
1. A method for transmitting multimedia data, wherein the multimedia data includes signaling data and media stream data, and the multimedia data is transmitted between a public network and an internal network, wherein a multimedia transmission gateway is disposed between the public network and the internal network, and the multimedia transmission gateway is configured with a first network card interfacing with the public network and a second network card interfacing with the internal network, and the method for transmitting multimedia data includes the steps of:
s11, receiving signaling data;
s12, acquiring a multimedia proxy resource including a plurality of candidate port numbers, allocating port numbers to a first port interfacing with the public network and a second port interfacing with the internal network, respectively, and changing the signaling data according to a destination address of the signaling data, including: when the target address is the public network, converting the network address and the port of the signaling data into the IP address of the first network card and the first port, and converting the transmission protocol of the signaling data into a public network user protocol; when the target address is the internal network, converting the network address and the port of the signaling data into the IP address and the second port of the second network card, and converting the transmission protocol of the signaling data into a UDP protocol;
s13, sending the changed signaling data to the target address, and receiving the signaling data returned by the target address;
repeating the steps S11 to S13 until the multimedia transmission connection is established;
the number of the alternative port numbers of the first port is equal to the number of the alternative port numbers of the second port, and in the same multimedia transmission connection, the first port and the second port are allocated with the same port numbers in pairs;
s14, receiving media stream data, converting the IP address and port of the media stream data into the IP address and the first port of the first network card or the IP address and the second port of the second network card, and sending the changed media stream data to the target address.
2. The method for multimedia data transmission according to claim 1, wherein in the step S12:
before the multimedia agent resource is obtained, the method further comprises the following steps: authenticating a destination address and a source address of the signaling data;
the method for converting the network address and the port of the signaling data comprises the following steps: and adding the IP address of the first network card and the first port or adding the IP address of the second network card and the second port in the SDP field of the signaling data.
3. A system for multimedia data transmission, wherein the multimedia data includes signaling data and media stream data, and the multimedia data is transmitted between a public network and an internal network, the system for multimedia data transmission is configured in a multimedia transmission gateway disposed between the public network and the internal network, the multimedia transmission gateway is further configured with a first network card interfacing with the public network and a second network card interfacing with the internal network, and the system for multimedia data transmission comprises:
a signaling service module, configured to cyclically receive and send signaling data to establish a multimedia transmission connection, where a cycle includes: the signaling service module receives signaling data; the signaling service module acquires a multimedia proxy resource comprising a plurality of alternative port numbers, allocates port numbers for a first port in butt joint with the public network and a second port in butt joint with the internal network respectively, and changes the signaling data according to a target address of the signaling data, including: when the target address is the public network, converting the network address and the port of the signaling data into the IP address of the first network card and the first port, and converting the transmission protocol of the signaling data into a public network user protocol; when the target address is the internal network, converting the network address and the port of the signaling data into the IP address and the second port of the second network card, and converting the transmission protocol of the signaling data into a UDP protocol; the signaling service module sends the changed signaling data to the target address and receives the signaling data returned by the target address; the number of the alternative port numbers of the first port is equal to the number of the alternative port numbers of the second port, and in the same multimedia transmission connection, the signaling service module allocates the paired and same port numbers to the first port and the second port;
and the media stream service module is used for receiving media stream data after the multimedia transmission connection is established, converting the IP address and the port of the media stream data into the IP address and the first port of the first network card or the IP address and the second port of the second network card, and sending the changed media stream data to the target address.
4. The system for multimedia data transmission according to claim 3,
the mode of the signaling service module for converting the network address and the port of the signaling data is as follows: and adding the IP address of the first network card and the first port or adding the IP address of the second network card and the second port in the SDP field of the signaling data.
5. An apparatus for multimedia data transmission, comprising:
a processor;
a memory having stored therein executable instructions of the processor;
wherein the processor is configured to perform the steps of the method of multimedia data transmission of claim 1 or 2 via execution of the executable instructions.
6. A computer-readable storage medium for storing a program, wherein the program, when executed by a processor, implements the steps of the method of multimedia data transmission of claim 1 or 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049931.9A CN108234511B (en) | 2018-01-18 | 2018-01-18 | Method, system, equipment, storage medium and gateway for multimedia data transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810049931.9A CN108234511B (en) | 2018-01-18 | 2018-01-18 | Method, system, equipment, storage medium and gateway for multimedia data transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108234511A CN108234511A (en) | 2018-06-29 |
| CN108234511B true CN108234511B (en) | 2021-07-13 |
Family
ID=62668005
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810049931.9A Active CN108234511B (en) | 2018-01-18 | 2018-01-18 | Method, system, equipment, storage medium and gateway for multimedia data transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108234511B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109547474A (en) * | 2018-12-21 | 2019-03-29 | 深圳市创梦天地科技有限公司 | A kind of data transmission method and device |
| CN110290140B (en) * | 2019-06-28 | 2021-09-24 | 腾讯科技（深圳）有限公司 | Multimedia data processing method and device, storage medium and electronic equipment |
| CN113489717A (en) * | 2021-07-02 | 2021-10-08 | 北京飞讯数码科技有限公司 | Internal and external network intercommunication method, device, equipment and storage medium based on SIP protocol |
| CN114938414A (en) * | 2022-05-13 | 2022-08-23 | 上海华客信息科技有限公司 | Telephone traffic proxy method, system, equipment and storage medium for isolating soft switch end |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101208935A (en) * | 2005-05-04 | 2008-06-25 | 西门子企业通讯有限责任两合公司 | Method and device for converting an internet protocol address inside a communications network |
| CN103107983A (en) * | 2011-11-09 | 2013-05-15 | 广达电脑股份有限公司 | Data management method of network system and related system thereof |
| CN103227788A (en) * | 2013-04-17 | 2013-07-31 | 广州市和声信息技术有限公司 | Method and system realizing communication between web-based application and SIP equipment |
| CN104717234A (en) * | 2013-12-11 | 2015-06-17 | 中兴通讯股份有限公司 | Enterprise network communication device and communication method |
| CN105049541A (en) * | 2014-04-17 | 2015-11-11 | 财团法人资讯工业策进会 | Network address translation traversal system and method for real-time communications |
| CN107566671A (en) * | 2017-10-12 | 2018-01-09 | 携程旅游信息技术（上海）有限公司 | Network voice communication method and its system, storage medium, electronic equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030018814A1 (en) * | 2001-06-29 | 2003-01-23 | Yung-Chung Kao | Method of letting a single LAN port voice over IP device have network address translation function |
-
2018
- 2018-01-18 CN CN201810049931.9A patent/CN108234511B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101208935A (en) * | 2005-05-04 | 2008-06-25 | 西门子企业通讯有限责任两合公司 | Method and device for converting an internet protocol address inside a communications network |
| CN103107983A (en) * | 2011-11-09 | 2013-05-15 | 广达电脑股份有限公司 | Data management method of network system and related system thereof |
| CN103227788A (en) * | 2013-04-17 | 2013-07-31 | 广州市和声信息技术有限公司 | Method and system realizing communication between web-based application and SIP equipment |
| CN104717234A (en) * | 2013-12-11 | 2015-06-17 | 中兴通讯股份有限公司 | Enterprise network communication device and communication method |
| CN105049541A (en) * | 2014-04-17 | 2015-11-11 | 财团法人资讯工业策进会 | Network address translation traversal system and method for real-time communications |
| CN107566671A (en) * | 2017-10-12 | 2018-01-09 | 携程旅游信息技术（上海）有限公司 | Network voice communication method and its system, storage medium, electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108234511A (en) | 2018-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109274634B (en) | Multimedia communication method and device, and storage medium | |
| CN108234511B (en) | Method, system, equipment, storage medium and gateway for multimedia data transmission | |
| US7797433B2 (en) | System, method, and computer program product for resolving addressing in a network including a network address translator | |
| RU2580097C2 (en) | Method and system for reliable protocol tunnelling over http | |
| EP1892887B1 (en) | Communication method between communication devices and communication apparatus | |
| US10250646B2 (en) | Method and device for establishing channel | |
| CN111294399B (en) | Data transmission method and device | |
| CN106850399B (en) | Communication method based on WebRTC technology instant message | |
| EP2870735B1 (en) | Method for adding client capability data to a sip message | |
| US8601139B2 (en) | Multiple core session initiation protocol (SIP) | |
| JP2005236824A (en) | IPv6/IPv4 TRANSLATOR | |
| US20060239251A1 (en) | Multi-user media client for communication devices | |
| EP4175221A1 (en) | Method for accessing network, media gateway, electronic device, and storage medium | |
| US20120166656A1 (en) | Establishing Secure Communications Between Client Computing Devices Located Behind Network Security Devices | |
| CN113489717A (en) | Internal and external network intercommunication method, device, equipment and storage medium based on SIP protocol | |
| Emmanuel et al. | A peer-to-peer architecture for real-time communication using Webrtc | |
| CN116582590A (en) | Data transmission method and device | |
| US7408926B1 (en) | Method and apparatus for accessing voice over internet protocol connection | |
| CN114978485B (en) | Voice data transmission method, system, electronic equipment and storage medium | |
| Bongard et al. | Reverse Shell via Voice (SIP, Skype) | |
| JP4648436B2 (en) | Packet distribution device, communication system, packet processing method, and program | |
| Tiamiyu | On the design and implementation of peer–to peer communication using webrtc | |
| JP6183881B2 (en) | Codec conversion gateway, codec conversion method, and codec conversion program | |
| CN117221292A (en) | Audio playing method and device, electronic equipment and storage medium | |
| Fajandar | Implementing an Authorization model in a SIP User Agent to secure SIP sessions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |