具体实施方式 Detailed ways

下面结合附图进一步说明本发明的详细内容及其具体实施方式。 The detailed content of the present invention and its specific implementation will be further described below in conjunction with the accompanying drawings.

参见图1至图6，本发明的基于云计算的多屏互动方法，将机顶盒、计算机、智能手机、PAD等使用者终端既作为操作终端、控制终端，又作为显示终端，通过对使用者在各终端登录账号的绑定，在云应用平台实现对使用者多种终端间的绑定，通过HTTP、RTSP等� �准通信与� 输协议完成终端到终端间的通信与消息解析，并依据消息信令完成一个终端对另一终端的控制，即操作终端将相关控制命令发送至云应用平台，云应用平台完成对相关协议的解析并生成适合被控制终端解析的控制信令，并将控制信令发送至被控制终端，完成操作终端对控制终端的控制，完成影片在多个使用者终端上的播放，及在播放过程中由一个终端� 缝切换到另一终端的� 间断播放及控制； Referring to Figures 1 to 6, the cloud computing-based multi-screen interaction method of the present invention uses user terminals such as set-top boxes, computers, smart phones, and PADs as operating terminals, control terminals, and display terminals. The binding of login accounts of each terminal realizes the binding of various terminals of users on the cloud application platform, and completes communication and message analysis between terminals through standard communication and transmission protocols such as HTTP and RTSP, and according to message signaling Complete the control of one terminal to another terminal, that is, the operating terminal sends relevant control commands to the cloud application platform, and the cloud application platform completes the analysis of the relevant protocols and generates control signaling suitable for the controlled terminal to analyze, and sends the control signaling to To the controlled terminal, complete the control of the operating terminal to the control terminal, complete the playback of the video on multiple user terminals, and seamlessly switch from one terminal to another during the playback process without interruption;

为实现向不同终端提供相同内容的流媒体内容服务，在云应用平台通过机顶盒视频点播平台、计算机视频点播平台和移动终端视频点播平台来实现对不同网络接入类型的不同终端的流媒体内容服务； In order to provide streaming media content services with the same content to different terminals, the cloud application platform implements streaming media content services for different terminals with different network access types through the set-top box video-on-demand platform, computer video-on-demand platform and mobile terminal video-on-demand platform ;

为实现在多种终端间内容的� 缝切换，在云应用平台通过相应的业务处理平台来实现不同能力支撑平台上同一内容的元数据关联、使用者在不同终端登录账号的关联、影视内容在不同终端间的切换过程中断点信息的关联； In order to realize the seamless switching of content between various terminals, the cloud application platform uses the corresponding business processing platform to realize the metadata association of the same content on different capability support platforms, the association of users’ login accounts on different terminals, and the video content in the Association of interruption point information in the handover process between different terminals;

为实现多种终端间彼此操作的控制，在终端安装相关平台客户端软件，不同终端间通信均通过云应用平台进行，实现终端对终端的控制；业务处理平台在此过程完成对不同终端发起的信令请求的解析、处理、并通知被控制终端完成相关操作； In order to realize the control of mutual operation between various terminals, relevant platform client software is installed on the terminal, and the communication between different terminals is carried out through the cloud application platform to realize terminal-to-terminal control; the business processing platform completes the process initiated by different terminals Analyze and process signaling requests, and notify the controlled terminal to complete related operations;

为实现多种终端上登录账号的统一，在云应用平台通过建立关联数据库表，将多种终端上的登录账号进行绑定，从而实现统一的登录认证。 In order to realize the unification of login accounts on various terminals, the cloud application platform establishes an associated database table to bind the login accounts on various terminals, so as to realize unified login authentication.

如上所述实现方法，不同使用者通过云应用平台可相互添� 为好友，不同使用者在不同终端上可彼此发送消息，使用者可将当前操作发布至微博等基于使用者关系的信息分享平台。 According to the implementation method described above, different users can add each other as friends through the cloud application platform, different users can send messages to each other on different terminals, and users can post current operations to Weibo and other information sharing platforms based on user relationships .

参见图1，本发明的基于云计算的多屏互动系统，包括媒体资产管理平台204、业务处理平台1、能力支撑平台2及业务应用终端3四个系统模块，所述业务处理平台1分别与媒体资产管理平台204、能力支撑平台2及业务应用终端3通信连接，所述能力支撑平台2分别与媒体资产管理平台204、业务处理平台1及业务应用终端3通信连接；媒体资产管理平台204对所有进入系统的媒体内容进行处理，完成对媒体内容的二次编转� �及封装过程，并生成针对不同媒体� �式的相关索引文件(XML� �式ADI文档)； Referring to Fig. 1 , the multi-screen interactive system based on cloud computing of the present invention includes four system modules of a media asset management platform 204, a business processing platform 1, a capability support platform 2 and a business application terminal 3, and the business processing platform 1 is connected with the business application terminal 3 respectively. The media asset management platform 204, the capability support platform 2 and the service application terminal 3 are connected in communication, and the capability support platform 2 is respectively connected to the media asset management platform 204, the service processing platform 1 and the service application terminal 3; the media asset management platform 204 is connected to Process all the media content entering the system, complete the secondary encoding, transcoding and packaging process of the media content, and generate relevant index files (ADI documents in XML format) for different media formats;

所述业务处理平台1由元数据关联模块101、用户账号关联模块102及断点信息关联模块103构成，所述数据关联模块101完成在不同应用终端上展示内容的索引文件的关联关系创建，并生成新的索引文件供能力支撑平台所使用；所述用户账号关联模块102完成使用者在不同应用终端进行登录所用账号的关联关系的创建，从而实现系统自动识别不同终端上登陆的同一使用者；所述断点信息关联模块103完成使用者在不同终端上观看影片退出时，对媒体文件的名称、文件� �式、网络地址、退出时间点等相关信息的记录，并整合使用者所产生的每个媒体文件的最新退出时间点信息，从而保证使用者在其他终端进行登录并浏览相关媒体文件时，可从最近的退出节点继续欣赏媒体内容；�  The business processing platform 1 is composed of a metadata association module 101, a user account association module 102, and a breakpoint information association module 103. The data association module 101 completes the establishment of the association relationship of index files displaying content on different application terminals, and Generate a new index file for use by the capability support platform; the user account association module 102 completes the creation of the association relationship of the account used by the user to log in on different application terminals, so that the system can automatically identify the same user logged in on different terminals; The breakpoint information association module 103 completes the recording of relevant information such as the name of the media file, file format, network address, exit time point, etc. when the user exits watching a movie on different terminals, and integrates each The latest exit time point information of the media file, so as to ensure that the user can continue to enjoy the media content from the nearest exit node when logging in on other terminals and browsing related media files;

所述能力支撑平台2由机顶盒视频点播平台201、计算机视频点播平台202及移动终端视频点播平台203构成，所述机顶盒视频点播平台201完成面向机顶盒的点播视频流播发与控制；所述计算机视频点播平台202完成面向计算机、PAD等移动终端的点播视频流播发与控制；所述移动终端视频点播平台203面向多种型号智能手机的视频流播发与控制； Described capability support platform 2 is made up of set-top box video-on-demand platform 201, computer video-on-demand platform 202 and mobile terminal video-on-demand platform 203, and described set-top box video-on-demand platform 201 completes broadcast and control facing set-top box video-on-demand; The platform 202 completes broadcasting and control of on-demand video streams for mobile terminals such as computers and PADs; the mobile terminal video-on-demand platform 203 broadcasts and controls video streams for various types of smart phones;

所述业务应用终端3包括机顶盒301、计算机302及智能手机303，所述机顶盒301分别与数据关联模块101、用户账号关联模块102、断点信息关联模块103及机顶盒视频点播平台201连接，完成机顶盒上的流媒体视频内容的播放与控制，搜集使用者从机顶盒301退出时所产生的影片断点信息并上报至断点信息关联模块103；所述计算机302分别与数据关联模块101、用户账号关联模块102、断点信息关联模块103及机顶盒视频点播平台201连接，完成计算机或PAD终端上的流媒体视频内容的播放与控制，搜集使用者从计算机302退出时所产生的影片断点信息并上报至断点信息关联模块103；所述智能手机303分别与数据关联模块101、用户账号关联模块102、断点信息关联模块103及机顶盒视频点播平台201连接，完成移动终端上的流媒体视频内容的播放与控制，搜集使用者从智能手机303退出时所产生的影片断点信息并上报至断点信息关联模块103。 The service application terminal 3 includes a set-top box 301, a computer 302 and a smart phone 303, and the set-top box 301 is connected with the data association module 101, the user account association module 102, the breakpoint information association module 103 and the set-top box video-on-demand platform 201 respectively to complete the set-top box The playback and control of the streaming video content on the computer collects the video breakpoint information generated when the user exits the set-top box 301 and reports it to the breakpoint information association module 103; the computer 302 is respectively associated with the data association module 101 and the user account Module 102, breakpoint information association module 103 and set-top box video-on-demand platform 201 are connected to complete the playback and control of streaming video content on the computer or PAD terminal, and collect the video breakpoint information generated when the user exits from computer 302 and report it To the breakpoint information association module 103; the smart phone 303 is connected with the data association module 101, the user account association module 102, the breakpoint information association module 103 and the set-top box video-on-demand platform 201 respectively, and completes the streaming video content on the mobile terminal For playback and control, the video breakpoint information generated when the user exits from the smart phone 303 is collected and reported to the breakpoint information association module 103 .

图2所示为多屏互动的内容发布处理的实施例，主要包含S20接口，S21接口，S22接口，S23-S25接口共4类处理过程。 FIG. 2 shows an embodiment of multi-screen interactive content release processing, which mainly includes four types of processing processes: S20 interface, S21 interface, S22 interface, and S23-S25 interface.

其中，所有的实时/非实时流媒体内容源经过S20接口（实时内容� 输以UDP协议为基础，非实时内容� 输以FTP协议为基础）导入媒体资产管理平台204。 Among them, all real-time/non-real-time streaming media content sources are imported into the media asset management platform 204 through the S20 interface (real-time content transmission is based on the UDP protocol, and non-real-time content transmission is based on the FTP protocol).

媒体资产管理平台204经过内部S21接口处理流程，完成对通过S20接口导入的流媒体内容的处理，完成流媒体内容的编转� �处理、封装� �式处理，生成针对不同流媒体视频点播平台的流媒体内容文件及相关流媒体内容检索文件（符合ADI� �准的XML� �式的文本信息）。 The media asset management platform 204 completes the processing of the streaming media content imported through the S20 interface through the internal S21 interface processing flow, completes the encoding and transcoding processing and packaging format processing of the streaming media content, and generates streaming media for different streaming media video-on-demand platforms. Content files and related streaming media content retrieval files (text information in XML format conforming to ADI standards).

媒体资产管理平台204完成对流媒体内容处理后，经S22接口（SOAP信令接口）向元数据关联模块101发送处理完成后的多种封装� �式、不同� �流的流媒体内容元数据信息，供元数据关联模块101进行后续处理。 After the media asset management platform 204 completes the processing of the streaming media content, it sends the metadata information of the streaming media content in various encapsulation formats and different code streams to the metadata association module 101 through the S22 interface (SOAP signaling interface) for supplying metadata. The data association module 101 performs subsequent processing.

媒体资产管理平台204经S23接口、S24接口、S25接口（实时内容� 输以UDP协议为基础，非实时内容� 输以FTP协议为基础）分别向机顶盒视频点播平台201、计算机视频点播平台202、移动终端视频点播平台203注入实时和非实时流媒体内容，供机顶盒视频点播平台201、计算机视频点播平台202、移动终端视频点播平台203对外提供流媒体内容点播服务。 The media asset management platform 204 transmits to the set-top box video-on-demand platform 201, the computer video-on-demand platform 202, and the mobile terminal via the S23 interface, the S24 interface, and the S25 interface (the real-time content transmission is based on the UDP protocol, and the non-real-time content transmission is based on the FTP protocol). The video-on-demand platform 203 injects real-time and non-real-time streaming media content for the set-top box video-on-demand platform 201, the computer video-on-demand platform 202, and the mobile terminal video-on-demand platform 203 to provide streaming media content on-demand services.

图3所示为多屏互动使用者信息的关联实施例，使用者在机顶盒301、计算机302、智能手机303上将注册信息通过S31接口、S32接口、S33接口（HTTP信令接口）发送至用户账号关联模块102。用户账号关联模块102记录使用者注册使用者名、密� �等相关信息。至此，使用者可在机顶盒301、计算机302、智能手机303上对相关流媒体视频进行点播、播放。当需要多屏互动时，使用者可在机顶盒301、计算机302、智能手机303任意终端发起多屏互动业务开通请求，用户账号关联模块102模块对使用者在各种终端上的登录账号进行绑定。绑定后，使用者在机顶盒301、计算机302、智能手机303任意终端上都可使用同一登录账号进行登录。 Figure 3 shows an associated embodiment of multi-screen interactive user information. The user sends the registration information to the user through the S31 interface, S32 interface, and S33 interface (HTTP signaling interface) on the set-top box 301, computer 302, and smart phone 303. Account association module 102. The user account association module 102 records related information such as the registered user name and password of the user. So far, the user can order and play related streaming media videos on the set-top box 301 , computer 302 , and smart phone 303 . When multi-screen interaction is required, the user can initiate a multi-screen interactive service activation request on any terminal of the set-top box 301, computer 302, or smart phone 303, and the user account association module 102 binds the user's login account on various terminals . After binding, the user can use the same login account to log in on any terminal of the set-top box 301 , computer 302 , or smart phone 303 .

图4所示为多屏互动的节目断点信息统一收集、处理与发布实施例，机顶盒301与云端平台的机顶盒视频点播平台201间通过S41接口以HTTP1.1作为控制信令� 输协议，以TS� over� UDP作为媒体流� 输方式。当机顶盒301有暂停、退出等操作时，机顶盒301通过接口S44将相关使用者暂停、退出信息以XML� �式� 送给断点信息关联模块103。断点信息关联模块103记录使用者机顶盒301使用者ID，使用者观看的流媒体内容ID、使用者退出时，流媒体内容播放时间戳等相关信息。 Figure 4 shows an embodiment of the unified collection, processing and release of multi-screen interactive program breakpoint information. The set-top box 301 and the set-top box video-on-demand platform 201 of the cloud platform use HTTP1.1 as the control signaling transmission protocol through the S41 interface, and use TS over UDP as a media stream transmission method. When the set-top box 301 performs operations such as suspending or exiting, the set-top box 301 transmits relevant user suspension and exit information to the breakpoint information association module 103 in XML format through the interface S44. The breakpoint information association module 103 records related information such as the user ID of the user's set-top box 301 , the streaming media content ID watched by the user, and the streaming media content playing time stamp when the user quits.

终端设备计算机302与云端平台的计算机视频点播平台202间通过S42接口以HTTP1.1作为控制信令� 输协议，及媒体流� 输协议。当计算机302有暂停、退出等操作时，计算机302通过接口S45将相关使用者暂停、退出信息以XML� �式� 送给断点信息关联模块103。断点信息关联模块103记录计算机302使用者ID，使用者观看的流媒体内容ID、使用者退出时，流媒体内容播放时间戳等相关信息。 The terminal device computer 302 and the computer video-on-demand platform 202 of the cloud platform use HTTP1.1 as the control signaling transmission protocol and the media streaming transmission protocol through the S42 interface. When the computer 302 performs operations such as suspending or exiting, the computer 302 transmits relevant user suspension and exit information to the breakpoint information association module 103 in XML format through the interface S45. The breakpoint information correlation module 103 records related information such as the user ID of the computer 302 , the streaming media content ID watched by the user, and the time stamp of streaming media content playing when the user exits.

终端设备智能手机303与云端平台的移动终端视频点播平台203间通过S43接口以HTTP1.1作为控制信令� 输协议，及媒体流� 输协议。当智能手机303有暂停、退出等操作时，智能手机303通过接口S46将相关使用者暂停、退出信息以XML� �式� 送给断点信息关联模块103。断点信息关联模块103记录使用者智能手机303使用者ID，使用者观看的流媒体内容ID、使用者退出时，流媒体内容播放时间戳等相关信息。 The terminal equipment smart phone 303 and the mobile terminal video-on-demand platform 203 of the cloud platform use HTTP1.1 as the control signaling transmission protocol and the media streaming transmission protocol through the S43 interface. When the smart phone 303 performs operations such as suspending or exiting, the smart phone 303 transmits the relevant user suspension and exit information to the breakpoint information association module 103 in XML format through the interface S46. The breakpoint information association module 103 records the user ID of the user's smart phone 303, the ID of the streaming media content watched by the user, and the streaming media content playing time stamp when the user quits.

图5所示为节目多屏� 间断播放处理实施例，业务应用终端的机顶盒301、计算机302、智能手机303触发多屏切换操作时(S01、S02、S03操作)，经外部网络将相关切换信令通过S31接口发布到云服务业务处理平台，S31接口所携带的信息包含使用者登录账号信息、使用者当前观看影片信息、使用者触发多屏切换时影片的时间戳信息、使用者当前所用终端信息，使用者继续观看所用终端信息。 Figure 5 shows an embodiment of multi-screen uninterrupted playback processing of a program. When a set-top box 301, a computer 302, and a smart phone 303 of a service application terminal trigger a multi-screen switching operation (operations S01, S02, and S03), the relevant switching information is transmitted via the external network. The command is published to the cloud service business processing platform through the S31 interface. The information carried by the S31 interface includes the user's login account information, the user's current viewing video information, the time stamp information of the video when the user triggers multi-screen switching, and the user's current terminal. information, the user continues to view the terminal information used.

业务处理平台依据S31接口所携带的信息，经S12接口（S12-1、S12-2、S12-3）通知相关视频点播平台中断使用者当前终端所观看视频流，并将使用者继续观看所用终端信息、节目信息、影片时间戳信息发送至相关能力支撑平台，由适合使用者继续观看所用终端的能力支撑平台通过S23接口向使用者继续欣赏影片所使用终端推送由时间戳开始的影片节目资源。 Based on the information carried by the S31 interface, the service processing platform notifies the relevant video-on-demand platform via the S12 interface (S12-1, S12-2, S12-3) to interrupt the video stream watched by the user's current terminal and continue to watch the video stream on the terminal used by the user. Information, program information, and movie timestamp information are sent to the relevant capability support platform, and the capability support platform suitable for the terminal used by the user to continue watching the movie pushes the movie program resource starting from the timestamp to the terminal used by the user to continue watching the movie through the S23 interface.

图6所示为多终端彼此控制实施例，为实现图6所示由计算机、手机对机顶盒的控制（S23-1）。首先，计算机、手机通过S23-11接口，将相关操作信令经网络发送至信息解析网关，解析网关一方面，通过S001、S002接口与业务处理平台所存储的用户信息进行对比，获取用户计算机、手机所绑定的机顶盒CA卡信息；另一方面，完成对S23-1接口所� 送的控制信令的解析。随后，网关将解析后的信令封装成机顶盒可识别的消息内容发送给用户机顶盒，从而完成使用计算机、手机对机顶盒进行控制的操作过程。 FIG. 6 shows an embodiment of multi-terminal mutual control, in order to realize the control of the set-top box by the computer and the mobile phone shown in FIG. 6 (S23-1). First, the computer and the mobile phone send relevant operation signaling to the information analysis gateway through the network through the S23-11 interface. Set-top box CA card information bound to the mobile phone; on the other hand, complete the analysis of the control signaling transmitted by the S23-1 interface. Subsequently, the gateway encapsulates the analyzed signaling into a message content recognizable by the set-top box and sends it to the user's set-top box, thereby completing the operation process of using the computer and the mobile phone to control the set-top box.

以上实施例仅用以说明本发明的技术方案，而非对其进行限制。尽管参照前述实施例对本发明进行了一定的说明，但对本领域的普通技术人员来说，依然可以对前述实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换。而这些修改或替换并不使相应的技术方案的本质脱离本发明所要求保护的技术方案的精神和范围。 The above embodiments are only used to illustrate the technical solution of the present invention, not to limit it. Although the present invention has been described with reference to the aforementioned embodiments, those skilled in the art can modify the technical solutions described in the aforementioned embodiments, or equivalently replace some of the technical features. However, these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions claimed in the present invention.