System for interactive matrix manipulation control of streamed data
Contents
1. numerous references will be made regarding servers services inter faces portals platforms or other systems formed from com puting devices It should be appreciated that the use of such terms is deemed to represent one or more computing devices having at least one processor configured to execute software instructions stored on a computer readable tangible non transitory medium For example a server can include one or more computers operating as a web server database server or other type of computer server in a manner to fulfill described roles responsibilities or functions 0086 The matrix manipulation control system uses the Boolean control code streamed from the provider s remote device to activate a set of matrix manipulation controls inside the virtual machine which change s or transforms the images and data being displayed by calculating matrix transforma tion on each of the pixels to be display or audibly presented in order to manipulate the data 0087 One of the preferred embodiments of this invention configures a matrix manipulation function to act as a digital filter which is a variable matrix of digital doors for streamed data which is always active or can be off or in use so that the data to be controlled utilized displayed or rendered or played back in the manner in which the data was intended to be played back and is always being processed through the matrix manipulation system process Ifthe manipula2. Imageorvideo matrixgrid 8 Image or video matrixed layers Image orvideodata US 2013 0238901 Al SYSTEM FOR INTERACTIVE MATRIX MANIPULATION CONTROL OF STREAMED DATA AND MEDIA CROSS REFERENCE TO RELATED APPLICATIONS 0001 This application claims the benefit of U S Provi sional Application No 61 609 164 filed Mar 9 2012 the contents of which are expressly incorporated herein by refer ence STATEMENT RE FEDERALLY SPONSORED RESEARCH DEVELOPMENT 0002 Not Applicable BACKGROUND 0003 The field of the invention is data and media stream ing 0004 This system in one embodiment is manifested as one or more streaming media servers running our proprietary image video audio matrix manipulation controlled encod ing and streaming software a network and subscribers re mote users that download a proprietary remote viewer to their computer television tablet or smart phone device 0005 This system provides controllable streamed data and interactive entertainment media such as video in an encoded or encrypted form over the Internet to an applet or a virtual machine operating in a buffer in the remote users computer or wireless device either in conjunction with the operating system of the remote computer or device or inde pendent of the operating system and under the control of the external streaming server which provides a separate Boolean control code or other type of control code to match with the authorized remo
3. authorized remote user to form the completed pass key or completed digital puzzle The matrix manipulation control system would scramble the image or some other function if both parts of the digital pass key were not authorized to function together The pass key functions can be an actively modulated and digitally con trolled remotely on both ends of the control code inputs from the service provider through the streamed control code com ing in with the selected streamed data and from the code that is streamed to the user to input from the user s end while continuously actively changing to continually fit together as the encryption or function controlling control code is streamed to the users remote device 0098 The matrix manipulation control is engaged actively at all time while the remote viewer or other device is func tioning inside the remote users computer or web device like an electric screen door that has to be turned off for all the data to pass through or the authorized portion of the data to pass through the electric matrix of doors of the matrix manipula tion control system The input of the authorized remote users control code to the system will turn off the electric matrix of doors or just turn off the portions Control codes from the provider is streamed to the remote user or contained in the remote user s device to allow access to 3D video content or access to higher resolution The same system can turn on and off colors in
4. images or enlarge images or enhance images Sep 12 2013 zoom in on selected portions of image data cut and paste image data and perform various rendering functions by per forming a pixel by pixel transformation using the correspond ing matrix manipulation algorithm for the desired effect 0099 Streamed 3D data is switched sequenced modified and or transformed as layers of frames side by side frames or acheckerboard matrix of pixels for each frame by mathemati cally switching on and off as desired each data set and every part of each data set individually using matrix manipulation inside a matrix manipulation control system operating in a virtual machine or other device to achieve any type of 3D display needed at any resolution desired by the remote user or required for the remote user s device in order to be properly displayed or monitored 0100 The matrix manipulation control system can be switched to allow for different audio tracks to be played which could allow for multiple languages to be streamed simultaneously and the user can select which language the matrix manipulation control system will let through the matrix manipulation doors 0101 In normal streamed data virtual machine viewers or devices matrix manipulation is applied interactively by the remote user Our inventive method goes much further by applying matrix manipulation full time to the streamed encoded data decoding process that occurs inside the virtual
5. machine to act as a digital gate for data to get to the viewer or device data output system This digital gate function can also transform the data into other outputted data 0102 The Matrix manipulation function is always acti vated just to keep the image stable or viewable or to allow manual manipulation of the data by an authorized remote user If the matrix manipulation turns of the image goes to a default mode that renders the system useless or only capable of delivering a predetermined set of functions such as only low resolution video or no 3D function as an example of the many embodiments possible for this invention 0103 Media providers or other business like appliance manufacturers could control user access and functionality of any device including remote viewer systems and other devices not related to images or data such as remote switching functions and remote data monitoring by capturing bits of data from the matrix manipulation system to gather data remotely in an upstream function from the remote device triggered by the matrix manipulation system through the Boolean control code sent from the provider This can be done on any Internet ready devices or networked devices and smart appliances using my novel method 0104 It should be apparent to those skilled in the art that many more modifications besides those already described are possible without departing from the inventive concepts herein The inventive subject matter ther
6. media service provider One embodiment of this inventive method would be to stream the control code to the remote user s cell phone or other radio device or wireless internet transmitter to allow the user to communicate with other devices that have the service providers control code to match and allow the user to use matrix manipulation controlled function on any other system that is networked into the ser vice providers using my novel method and system 0091 Matrix manipulation control filtering in one embodiment can be applied to recognize image patterns in a digital image pattern or sequence of data by running a control code activated process in the matrix manipulation control that monitors the data stream and uses artificial intelligence to US 2013 0238901 Al perform analytics on the date and activate other processes to send the data produce by using the matrix manipulation con trol system to monitor the data stream 0092 In one embodiment of the inventive subject matter the system described could also be used to actively tell the matrix control system to filter out data based on my method for instructing the matrix manipulation control to function as an active filter 0093 In one embodiment of the inventive subject matter the system would monitor the stream for certain determined patterns of colors and shapes and other means of artificial intelligence image recognition using this method 0094 Inone embodiment of this invent
7. of image data in order to display the corre sponding matrix manipulated images data video frames and selected portions of the images and video frames and data sets in varying locations on the resulting display to their corre sponding controlled position image and video data sets and or matrix manipulated selections of image and video data with motion intervals at varying times and durations for the pur pose of streaming 3D image displays and interactive 3D images or video displays 45 The method in claim 44 wherein one or more corre sponding data sets or overlaying image data or water mark layers or left and right frames of corresponding image data and video data are controlled and or transformed by a process of matrix manipulation in a virtual machine to produce a 3D display 46 The method of claim 44 wherein one or more corre sponding data sets or overlaying image data or water mark layers or left and right frames or channels of stereo images are US 2013 0238901 Al controlled and or transformed by a process of switching on or off the corresponding and or layered or overlapping image data layers 47 The method of claim 44 wherein the layers or left and right frames are used for anaglyph 3D display 48 The method in claim 44 wherein the layers or image data is oppositely polarized 49 The method of claim 44 wherein the layers are not opaque and layers of image data below a layer of image data are visible through the layer above
8. remotely such as an encryption chip inside the computer or wireless device 16 The method in claim 15 wherein the matrix manipula tion system triggers or switches an external device such as an encryption chip or a video chip 17 The method in claim 15 where the external video chip is a device that delivers 4000 or more lines of resolution 18 The method of claim 1 wherein the matrix manipula tion control system is used to control adaptation functions for different hardware devices 19 The method in claim 16 wherein the matrix manipula tion control system is being controlled by the streamed con trol code from the remote device of the application service provider or control code input by the remote user 20 The method in claim 1 wherein the matrix manipulation control system is used to adapt playback to different operating systems 21 To use the matrix manipulation control system to remotely adapt streamed playback of data to different wire less devices 22 The method of claim 5 wherein the matrix manipula tion control system adjusts the level of resolution of the streamed video data or image data by adding or subtracting lines or pixels from the image horizontally and vertically to control the resulting display image video or data to conform to a user s device screen or to add or subtract the resolution level of an image or video 23 The method wherein the matrix manipulation control system monitors and encoded audio or vo
9. the lower layers Sep 12 2013
10. the users input when allowed or when the service provider remotely switches on more reso lution on demand or converting a 2D image or video to a particular type of 3D display such as anaglyph or bi polarized in different transmission formats such as Frame sequential Frame packing Side by side and Checkerboard 3D image or video data transmission techniques 0011 These current methods of streamed 3D transmission formats are data bandwidth intensive and requires consider able processing power our novel method will control the frame switching functions inside a matrix manipulation con trol system operating in a virtual machine or device to sepa rate the process from the operating system if desired to main tain secure content control and allow for greater control and manipulation capabilities of the streamed image audio or video data 0012 A few of the different services that can be offered using our novel method are 3D viewing on demand different levels of high resolution on demand and secure encryption services which can allow different levels of active encryption to be added as well as the ability to constantly change the encryption algorithms using the method of streamed control codes to a matrix manipulation control system This and all other extrinsic materials discussed herein are incorporated by reference in their entirety Where a definition or use of a term in an incorporated reference is inconsistent or contrary to the defi
11. US 20130238901A1 as United States a2 Patent Application Publication 0 Pub No US 2013 0238901 A1 Wise 43 Pub Date Sep 12 2013 54 SYSTEM FOR INTERACTIVE MATRIX 52 U S Cl MANIPULATION CONTROL OF STREAMED CRE EE E HOA4L 63 08 2013 01 DATA AND MEDIA USPC neren raia dis 713 168 71 Applicant Kelley Wise Villia Park CA US 67 ABSTRACT An interactive streaming media and application service pro 72 Inventor Kelley Wise Villia Park CA US vider system can securely stream high resolution multiple formats of video and data Different data sets can be included 21 Appl No 13 776 511 in a single stream A rights management system controls matrix manipulation and other aspects of user control of the 22 Filed Feb 25 2013 data including one or more of rendering in various different 2D 3D or other media formats reconstruction and modeling Related U S Application Data zooming frame grab print frame parental controls picture in picture preventing unauthorized copying adapting to dif 60 Provisional application No 61 609 164 filed on Mar ferent data transmission formats adapting to different reso 9 2012 lutions and screen sizes and actively control functionality contained in embedded data encryption decryption Control Publication Classification can be exerted by an external entity through a user side virtual machine Control codes can optionally be embedded in the 51 Int Cl media embedded in th
12. ata sets DETAILED DESCRIPTION 0082 The inventive subject matter provides apparatus systems and methods in which an interactive streaming media and application service provider system can securely stream high resolution multiple formats of video and data 0083 In preferred embodiments different data sets can be included in a single stream A rights management system can advantageously control matrix manipulation and other aspects of user control of the data including one or more of rendering in various different 2D 3D or other media formats reconstruction and modeling zooming frame grab print frame parental controls picture in picture preventing unau thorized copying adapting to different data transmission for mats adapting to different resolutions and screen sizes and actively control functionality contained in embedded data encryption decryption In especially preferred embodiments control can be exerted by an external entity through a user side virtual machine Control codes can optionally be embed ded in the media embedded in the user s device and or sent separately to the device 0084 Various objects features aspects and advantages of the inventive subject matter will become more apparent from the following detailed description of preferred embodiments along with the accompanying drawing figures in which like numerals represent like components Sep 12 2013 0085 Throughout the following discussion
13. ce provider 0076 FIG 2 represents the inner workings of the matrix manipulation control system and using the control codes from the user and the provider to actively control access and func tionality of an active digital watermark embedded in the streamed data 0077 FIG 3 represents the same inner workings of the matrix manipulation control system and using the control codes from the user and the provider to actively control access and functionality of streamed data without an embedded active digital watermark using only the functionality of the matrix manipulation control system on regular streamed con tent with no digital water mark embedded in the data 0078 FIG 4 represents the control of streamed data in the matrix manipulation system 0079 FIG 5 represents the control of streamed data in the matrix manipulation system with embedded layers or a water mark in the streamed data 0080 FIG 6 represents how different sources of control codes can be used to control different functions on the streamed data and an embedded watermark or data layers and data sets embedded in the streamed image or video data with the matrix manipulation control system 0081 FIG 7 represents an example of matrixed image data sets showing a sideways view of data set layers and an example of one embodiment of a display matrix facing the display looking at an example of four lines of resolution or one line with matrixed sub sets of matrixed image d
14. e user s device and or sent separately HOAL 29 06 2006 01 to the device Boolean control code or other control code Streamed encoded image or video data with or without embedded channels Application Service or Media Provider Distribute user control code 4 Access or view data video and other streamed content User controlled matrix manipulation functions Enter control code 3 streamed encoded data 2 control code Buffer sandbox or browser matrix manipulation control system user entered control code Remote computer or wireless device Patent Application Publication Sep 12 2013 Sheet 1 of 7 US 2013 0238901 A1 Boolean control code or other control code Streamed encoded image or video data with or without embedded channels 3 streamed Application Service or Media Provider encoded data 2 control code Buffer sandbox Distribute or browser user control code 4 matrix manipulation Access or view control system data video and other streamed content User controlled matrix manipulation Device control code functions Enter control code user entered control code Remote computer or wireless device FIG 1 Patent Application Publication Sep 12 2013 Sheet 2 of 7 US 2013 0238901 A1 2 36 3 Streamed Streamed Data Streamed Control code in Contol code in and data out Monitoring or interactive data out ze Matrix manipulation controlle
15. efore is not to be restricted except in the spirit of the appended claims More over in interpreting both the specification and the claims all terms should be interpreted in the broadest possible manner consistent with the context In particular the terms com prises and comprising should be interpreted as referring to elements components or steps in a non exclusive manner indicating that the referenced elements components or steps may be present or utilized or combined with other elements components or steps that are not expressly referenced Where the specification claims refers to at least one of something selected from the group consisting of A B C and N the text should be interpreted as requiring only one element from the group not A plus N or B plus N etc US 2013 0238901 Al 0105 The above description is given by way of example and not limitation Given the above disclosure one skilled in the art could devise variations that are within the scope and spirit of the invention disclosed herein Further the various features of the embodiments disclosed herein can be used alone or in varying combinations with each other and are not intended to be limited to the specific combination described herein Thus the scope of the claims is not to be limited by the illustrated embodiments What is claimed is 1 A method for providing interactive data 3D and 2D video providing different levels of video resol
16. f claim 1 where the remotely control matrix manipulation process provides a user access to available con trols of the virtual machine portion of the receiving computer or wireless device 3 The method of claim 1 where the users control code is input to the matrix manipulation control system by a Wi Fi connection 4 The method of claim 1 wherein the user s control code and or the service providers control code is a file or set of code instructions other than Boolean code that can be installed on the matrix manipulation control system by downloading or using a data key or smart card or similar portable electronic device or integrated circuit chip 5 The method of claim 1 wherein image and video display resolution can be increased or decreased either remotely by the controlling device or by an authorized user by cutting out or restoring line of resolution from a high resolution video or image data a matrix manipulation process inside the matrix manipulation control system functioning inside the virtual machine portion of the remote receiving computer or wireless device Sep 12 2013 6 The method of claim 1 wherein the matrix manipulation control system remotely controls conversion of left and right eye images of video to display anaglyph 3D display 7 The matrix manipulation control system remotely con trols access to streamed left and right eye images and video content for 3D display on demand 8 The method of claim 1 wherein the
17. g in real time with matrix manipu lation controls and or manipulates the various encoded com ponents of each portion of the data set s 0070 34 The data sets are encoded to be decoded or switched by matrix manipulation of each encoded component of the data or data sets 0071 35 The Internet or a network 0072 36 Data such as user data or interactive control codes from the user to the ASP can engage interactive func tionality and other features of the system such as allowing the remote user access to other data streams and e commerce applications from the ASP 0073 37 The system provides a graphical user interface for the user to manipulate interact the data 0074 38 The system uses a server or other computer device to modify adjust manipulate and combine data sets such as one or more channels of video or other data to encode the data and stream the data or save the encoded as a file for US 2013 0238901 Al streaming This device or server will produce and stream corresponding control codes for the encoded data and per form other services for the ASP as described herein 0075 FIG 1 represents an embodiment of the inventive subject matter showing the steps of providing an encoded stream of data and a separate control code to control functions and access of the data and using an authorized users control code input into the system to actively communicate with the control code streamed from the application or media servi
18. ice content channel of streamed data to activate a language translation system that US 2013 0238901 Al communicates with a language data base to form words for the remote user on the fly in real time with the data stream to apply word audio translations to data or text translations shown over the display image or data or video 24 The method of claim 1 wherein the control code streamed by the application service provider and the control code inputted by an authorized user is a Boolean code 25 The method of claim 1 wherein either control code or both control codes is a download file or hardware device control key 26 A method for encrypting or controlling access and functionality in remote devices that are Internet or networked systems by remotely using a control code encryption control system to control the matrix manipulation functions of a virtual machine to remove or modify a digital watermark embedded onto the streamed data 27 Whereas a streamed data set with a digital water mark to block embedded functions and features is actively removed by the matrix manipulation functions of a virtual machine 28 Whereas a streamed data set with a digital water mark to block embedded functions and features is actively removed by the matrix manipulation functions of a computer proces sor 29 Whereas a streamed data set with a digital water mark to block embedded functions and features is actively removed by the matrix manipulation function
19. ion data can also be changed by actively removing portions of an image to be displayed in real time by using artificial intelligence to obscure faces or address and phone numbers on signs as needed by the provider of the streamed data 0095 One embodiment of this invention is an invisible Digital Watermark encoded onto the data itself such as a video or image or data which is actively removed or con trolled by the matrix manipulation control system described herein 3D data can be displayed using this method with a series of image layers with a small space between them encoded into a single stream to be decoded in the remote device and then sequenced or switched on an off using matrix manipulation 0096 The Matrix manipulation system can act as a filter independent of the code itself and it can be used to activate the embedded digital watermark function embedded in the streamed data or streamed with the data as a separate code This same inventive method can also in one embodiment to control the functionality of 3D video and image streaming on demand or activating higher resolution on any device for any one stream rather than for all images displayed for the device 0097 One embodiment of this invention is using a pass key that is streamed to the matrix manipulation control device and will not open until the corresponding section of the digital pass key is combined with the digital passkey of the authori zation control code entered by the
20. is combined or encoded as multi layer data to react as desired to the corre sponding control codes required using matrix manipulation to act as matching puzzle pieces or activating the desired data or sub sets of data 0062 25 The encoded data is streamed or encoded as a file for streaming 0063 26 The encoded data can be streamed together or streamed separately 0064 27 The data or data sets is streamed or input to the remote users matrix manipulation control system or matrix manipulation filter in the remote users device 0065 28 A second streamed data set is input to the matrix manipulation control system or filter 0066 29 A user control code is input by the user or by the users device or automatically by the ASP if needed into the matrix manipulation control system or filter 0067 30 The system s uses the control codes to manipu late and or permit access and manipulation of the encoded data or data sets and enables features such as 3D and interac tive controls of the media or data 0068 31 The combined data sets are decoded to produce 3D video images data and or interactive media displays data or combinations of different data and media functional ity 0069 32 Encoded stereoscopic or multi channel 3D video images or data in a matrix manipulation adjusted matrixed and layered data set format with or without a digital watermark in a combined encoded form that allows for active and or interactive decodin
21. mage or layers of image and or video data or opening and closing a matrix of doors to create openings or closing in the overlaying image and or video data to allow the image or video data below to be combined or subtracted from the corresponding image or video data sets making the none one or more of the streamed image and or video data sets visible or not visible in the resulting display 43 The method in claim 41 wherein the process of matrix manipulation uses the frame packing method where a matrix manipulation process will separate layers with a small space between them streamed simultaneously to a virtual machine 44 A method wherein a matrix manipulation transforma tion is used to oscillate or switch on and off or change the color of one or more streamed stereoscopic layers of image or video data with a small space between them embedded in images or channels of images or video data which is streamed to a remote device resulting in a remote display of a 3D streamed image or video from manipulating the one or more channels of image or video frame data sets as two or more whole left and right frames and or as a matrix manipulation of selected individual pixels of image and video data to move position enlarge or reduce control color in each separate frames of image and video data sets and turn on and off corresponding image and video frame data sets or left and right frames in the image or video data sets itself and or a selected matrix
22. matrix manipulation control system remotely controls the type of 3D display that can be viewed remotely such as selecting anaglyph or Bi Polar 3D viewing 9 The method of claim 1 wherein the remote controlled matrix manipulation system is used for activating controls to allow the remote user to select the type of 3D display 10 The method of claim 1 wherein the matrix manipula tion control system is used to perform rendering and to remotely modify streamed data to convert the data into another format inside the virtual machine portion of the remote computer or wireless device 11 The method of claim 1 wherein the control code streamed from the remote device to remotely disable or allow playback of the streamed content by controlling matrix manipulation of the data inside the virtual machine 12 The method in claim 1 wherein the matrix manipulation control system is used to further prevent unauthorized copy ing of the data images video or file 13 The method in claim 12 wherein the matrix manipula tion control system is remotely controlled by the streamed control code from the remote device to further prevent unau thorized copying of the data images video or file as well as open said data to copying if authorized 14 The method of claim 1 wherein the use of this method provides parental controls over access to content 15 A method of claim 1 wherein the matrix manipulation control system is used to control an external device
23. nd in which 0036 The drawings shown are flow charts representing two of the preferred embodiments of the inventive subject matter and show the steps to use a matrix manipulation con trol system inside a remote receiving computer or wireless device or other device which acts like matching puzzle sets and or a filter or matrix of doors or windows opening and closing to actively control access and functionality of streamed data images interactive video and other streamed applications The matrix manipulation control system is con trolled and locked remotely by a streamed Boolean control code from the application service provider and engaged by a corresponding control code inputted from the authorized remote user and can be further used to activate controls con tained in an active digital water mark embedded in the code 0037 The drawings shown are two flowcharts which are FIG 1 FIG 2 and FIG 3 FIG 4 FIG 5 FIG 6 and FIG 7 representing the present invention and showing the steps con trolling and manipulating the data stream with an active matrix manipulation control system 0038 0039 2 Application service provider server streams or encodes a file or data for streaming with encrypted and or encoded data as a single data set or more than one data set combined together and encoded with a matrix manipulation filter or encryption puzzle pattern or other similar data modi fications encoded onto the data and with or witho
24. nd other features and control embedded digital watermark type control functions that have been embedded in the data itself such as image data video and other types of streamed data 0044 7 A user control code is received by the user 0045 8 Authorized user receives the distributed user con trol code 0046 9 User inputs the user control code into the matrix control system 0047 10 The user control code unlocks or activates matrix manipulation encryption or controls of the system or the digital watermark functions embedded in the data 0048 11 Functionality or controls are engaged by user input of a control code 0049 12 Access control system inside the matrix manipu lation control system opens or controls encoded user control functionality 0050 13 The matrix manipulation control system engages functions according to the level of access authorized and provides access to streamed content and the authorized matrix manipulation controlled features available from the streamed or downloaded data code 0051 14 The Matrix Manipulation filter decodes the data according to the control code by adjusting the encoded matrix manipulation settings of each component of the encoded streamed data sets 0052 15 Active digital watermark or matrix manipulation control encoded data or data sets 0053 16 Virtual machine or other device displays or pro vides the streamed data 0054 17 The streamed operating Boolean code or o
25. nition of that term provided herein the definition of that term provided herein applies and the definition of that term in the reference does not apply 0013 Unless the context dictates the contrary all ranges set forth herein should be interpreted as being inclusive of their endpoints and open ended ranges should be interpreted to include only commercially practical values Similarly all lists of values should be considered as inclusive of interme diate values unless the context indicates the contrary 0014 Thus there is still a need for systems and methods that can be used to securely stream media to an end user BRIEF SUMMARY 0015 An application service provider server streams encrypted and or encoded data with a Boolean operating code or other type of code over the Internet The application service provider server also streams a separate Boolean control code US 2013 0238901 Al or other type of control code corresponding to the streamed data with Boolean operating code or other type of operating code to control a matrix manipulation control system func tioning inside a remote device or a virtual machine operating inside the buffer of a remote user s device computer or wire less Internet device in order to provide access authorization and unlock features on demand when the remote user enters another Boolean control code provided by the application service provider A separate control code is provided to device manufacturer
26. on streamed data is an applet 36 The method of claim 32 wherein the digital watermark or digital shutters control by opening closing or switching the type audio content or programming provided 37 The method of claim 32 wherein the digital watermark functions as a digital shutters or matrix of doors controlled by opening or closing and switching a matrix of data blocking pixels that open or close to all data to be displayed or provided by streamed data Sep 12 2013 38 The method of claim 32 wherein the digital watermark functions as a digital shutters or matrix of doors the type of image resolution of video and other images or data will be provided 39 The method of claim 32 wherein the digital watermark or digital shutters control by opening closing or switching control over the type of data is collected when monitored by the matrix manipulation control system 40 A method wherein matrix manipulation is used to add or remove move and position and or modify a layer of data and or video or other image data and control data and data in the form ofa file that is viewed over or in front of another layer of images video and data 41 A method wherein a process of matrix manipulation is used to control the addition or subtraction of video lines or pixels from streamed video 42 The method in claim 41 wherein a process of matrix manipulation is used to control resolution of image data by adding or removing data from an overlaying i
27. ontrol conversion of left and right eye images and video content to display anaglyph 3D display 0028 k To remotely control the type of 3D display that can be viewed remotely such as selecting anaglyph or Bi Polar 3D viewing 0029 1 To remotely engage controls on the remote user s device which allow the remote user to select the type of 3D display 0030 m Toremotely modify streamed data to convert into another format inside the virtual machine using matrix manipulation 0031 n To remotely disable or allow playback of the streamed content by controlling matrix manipulation of the data inside the virtual machine 0032 0 To actively control functionality contained in an active digital water mark embedded in the data to control interactive media 0033 p The method conserve processor power in the remote device when decoding streamed stacked image data sets and compressed side by side set of data for streamed 3D displays 0034 These objects described above and many others are achieved in the preferred embodiment of the inventive subject matter and allow for further advantages to become apparent from a consideration of the ensuing description and drawings BRIEF DESCRIPTION OF THE DRAWINGS 0035 These and other features and advantages of the vari ous embodiments disclosed herein will be better understood with respect to the following description and drawings in which like numbers refer to like parts throughout a
28. prior art method 0009 Inmy novel method the application or media service provider use a separate set of streamed control codes to give the provide active control and active encryption over the Sep 12 2013 streamed data by having a server stream a separate Boolean control code or other type of code to a matrix manipulation control system operating inside the remote computer either in a virtual machine operating inside a buffer or sandbox or browser or embedded in a chip or other device to control or manipulate the image or data inside the device or virtual machine with matrix manipulation and or transformation to provide different levels of service when an authorized user has entered a corresponding control code into the matrix manipulation control system functioning inside the chip device or a virtual machine running inside the remote user s computer or wireless Internet device 0010 When large numbers of remote users on different remote receiving devices with different data requirements need different levels of video resolution the system can pro vide each user the correct resolution through the matrix manipulation control system to add or subtract horizontal video lines of a video file or large image file such as a medical diagnostic image when a full resolution image is not needed as with a low resolution image used as a thumbnail such as when opening a file or a low resolution image being restored to a full resolution image by
29. r Active Digital processor Watermark Control code in to 10 control watermark Matrix manipulation control filter Matrix l manipulation Viewer or data device function application control app controls Authorized Data out user control code in FIG 2 Patent Application Publication Sep 12 2013 Sheet 3 of 7 US 2013 0238901 A1 ZT 2 ra 36 wax 3 Streamed Control code and data out Streamed Contol code in Monitoring data out 36 Matrix manipulation controller processor 1 Matrix 4 manipulation control filter 19 Matrix l manipulation Viewer or data device function application control app controls Device applet or virtual machine Authorized Data out user control code in FIG 3 Patent Application Publication Sep 12 2013 Sheet 4 of 7 US 2013 0238901 A1 generate control codes according to modifications Control User inputs Assign and code to control code distribute user user control codes Virtual machine or device VA A Monitoring reporting matrix manipulation matrix control gt Manipulation 41 system control Engage Matrix Manipulation Subtract data and or decode off of data Add data and or Modified data encode data onto video out data FIG 4 Patent Application Publication Sep 12 2013 Sheet 5 of 7 US 2013 0238901 A1 Encoding and streaming device Program 3D matrix manipulation control da
30. r transformed as layers of frames side by side frames and or a checkerboard matrix of pixels for each video frame by mathematically switching on and off as desired each data set and every part of each data set individually to achieve any type of 3D display needed at any resolution desired by the remote user or required for the remote user s device in order to be properly displayed or monitored 0017 Besides the objectives and advantages of the pre ferred embodiment of the inventive subject matter described above there are objectives and advantages also some of which are 0018 a To use this method to further prevent unautho rized copying of the data images video or file 0019 b To use this method to provide parental controls over access to content 0020 c To use this method to render image data 0021 d Render an image in 3D 0022 e Allow a device to remotely adapt to different 3D transmission formats 0023 f To allow a remote device to automatically adjust to different image resolutions streamed from a provider 0024 g To remotely control by matrix manipulation access to available controls on the remote Viewer 0025 h To remotely set functionality levels in the remote user s device by remote control of the matrix manipulation control system 0026 i To remotely control access to streamed left and right eye images and video content for 3D display on demand Sep 12 2013 0027 j To remotely c
31. s and distributers to install in remote user devices to control codes from the streamed media or data provider to cause the remote device to adapt the matrix manipulation control system or other system internal to the remote user s device to accept different formats of streamed image audio and video data and other streamed data 0016 The encrypted and or encoded data and Boolean operating code is streamed through a matrix manipulation control system running inside an applet or virtual machine operating inside a buffer such as a sandbox or browser in a remote user s computer or other device The streamed Bool ean control code controls the matrix manipulation functions of the Matrix manipulation control system functioning inside the virtual machine to control access to the streamed data and lock and control viewer functionality image resolution 3D viewing and other features Authorized users receive the distributed control code and enter the control code into the matrix manipulation control system functioning inside the virtual machine viewer The control code unlocks the matrix manipulation encryption system The remote controlled matrix manipulation encryption system opens according to the level of access authorized and provides access to the authorized matrix manipulation controlled features available from the streamed data code The virtual machine viewer displays the streamed data Streamed 3D data is switched sequenced modified and o
32. s of a microchip 30 A method wherein encrypted and controlled embedded functions or features of streamed data a digital file or data set that is a like an active digital jig saw puzzle is contained in a control code streamed to a digital locking system operating in a virtual machine or other device and using a matrix manipu lation control system to unlock user control remotely on its own or by combining the digital puzzle contained in the control code sent by the provider s control code with the corresponding remote users puzzle contained in the control code in the matrix manipulation control system operating inside the virtual machine portion of the remote users com puter or similar device which is provided to the authorized remote user by the service provider 31 A method wherein the matrix manipulation control system provides real time language translation to streamed content 32 The method wherein a matrix manipulation control system is used to remove or modify a digital watermark that is embedded on streamed data 33 The method of claim 32 wherein the matrix control system that removes or modifies an embedded digital water mark is a virtual machine 34 The method of claim 32 wherein the matrix control system that removes or modifies a digital watermark embed ded on streamed data is an integrated circuit chip 35 The method in claim 32 wherein the matrix control system that removes or modifies a digital watermark embed ded
33. ta Left Eye Channel Right Eye Channel Left Right Left Right On Off On Off Modify switch sequence image or video data channels Control code to user Stream Channel Channels are combined or streamed seperately Matrix modulation 39 control system Internet Network Channel 2 or other Decoded 3D or Control code interactive enables streamed image display and data controls Remote user views data 2nd channel streamed to user device Control code to remote user Patent Application Publication Sep 12 2013 Sheet 6 of 7 Virtual machine or device matrix manipulation control system 15 Embedded watermark Matrix overlay or matrix Manipulation of data set Graphic User control from layers of image interface for graphic user audio video matrix interface data matrix Manipulation channels Control Control code inputted from Remote user f remote user inputs Control code from device User inputs Streamed image control code S audio and video data Internet with or without network embedded control data Control code to user US 2013 0238901 A1 Encoded Streoscopic 3D Image video data in matrixed and or layer format with or without embedded control data Control codes streamed from provider Other control codes from provider to virtual machine or device Patent Application Publication Sep 12 2013 Sheet 7 of 7 US 2013 0238901 A1
34. te user s control code provided by the service provider The provider of the streamed media or data is able to turn on and off a set of premium services by remote control such as 3D images and different levels of resolution on the screen to name a few by streaming a separate control code to remotely control the matrix manipulation control system inside the virtual machine The control code sent from the streaming media provider server shakes hands with the remote viewer to confirm it is an authorized viewer and not a video copying software system 0006 The viewer maintains an active control connection to the streaming server through the control code from the server connecting to the remote viewer 0007 The control code could also be internal to the device and or pre installed to communicate with the embedded data in the streamed code to engage matrix manipulation as required for the control specifications contain in the streamed data 0008 While it is useful for streaming media providers to provide the remote user manual control over the streamed images videos or files using matrix manipulation inside a virtual machine the present methodologies to not address a host of problems that occur on the Internet regarding content piracy and other issues and features and functionality not being provided in prior art methods My novel and inventive method provides a much higher lever of control over the streamed data and media content than any
35. ther control code allows the user to have manual control over standard functions of the embedded device or viewer or other type of device that receive and transmits streamed data 0055 18 When authorized a remote user may control some matrix manipulation functions of the virtual machine viewer 0056 19 A device can utilize its own control code for authorization or other purpose 0057 20 For 3D media encoding the system inputs one two or more channels of a video or image or other data or data sets Sep 12 2013 0058 21 A programmable matrix manipulation control filter encoder encodes different matrix manipulation control settings onto various desired components of the data or data sets which can be assigned to operate with the proper control code to turn on and off or to switch adjust filter enlarge offset dim change color or other form of manipulation which can be performed using matrix manipulation to adjust the pixels or other data to be displayed or provided for user interaction 0059 22 The system allows left and right channels of video and or stereoscopic images and data or other type of 3D media or data to be controlled and switched at a high rate of speed using matrix manipulation switching and or manipula tion 0060 23 The System can be used for encryption by and access authorization by assigning different types of control codes as per the needs of the ASP 0061 24 Stereo 3D or multi channel data
36. tion pro cess were to stop the data would be corrupted or non useable or limited in the amount of data or portions of the data that are allowed to pass through the matrix manipulation filter 0088 The matrix manipulation filter searches for Boolean Patterns or pattern from other codes used that are coming in the control code both from the application service provider and the authorized remote user to activate or deactivate the Matrix manipulation filtering or control functions of the data streamed to the device or virtual machine operating in a remote computer or other networked computer device The code is a form of puzzle that requires corresponding sections of the puzzle to be filled in by the corresponding pieces contained in the authorized remote users control code 0089 Theuser control code is streamed to the control link in the matrix manipulation control device which is active and can be changed simultaneously between the corresponding control code from the provider and the code from the autho rized user by sending the user control code to a cell phone or other device which would send the users control code to the device with a Wi Fi or any other wireless standard connection between the devices 0090 The user code provided to the user can be activated and changed remotely so that the key or authorization code is never the same also new functionality can be added to the user s service provided under the control of the application or
37. ut an embed ded digital water mark embedded in the data over a network or the Internet with a corresponding Boolean operating code or other code streamed separately 1 Application Service or Media Provider Servers US 2013 0238901 Al 0040 3 Application service provider server streams or encodes for streaming a separate Boolean control code for the streamed data with Boolean operating code which can be assigned to each user 0041 4 A separate control code can be provided to the user for the user to input to a device to enable functionality or additional functionality or products and services on a device or service 0042 5 Anapplet or virtual machine or other device oper ating inside a buffer such as a sandbox or browser in a remote user s computer or a matrix manipulation control system embedded in another device receives the encrypted or encoded data or data sets with the matrix manipulation encryption and interactive function control code encoded onto the data or data sets 0043 6 A matrix manipulation control system interacts with the the streamed Boolean control code or other streamed control code which controls the matrix manipulation control system functions running inside a virtual machine or other device to control matrix manipulation of the streamed data to add or remove functionality or control access to the streamed data and lock and control the remote device functionality image resolution Stereo 3D viewing a
38. ution on demand 2D or 3D video and image media to a recipient while preventing unauthorized viewing or copying of the data video or image media comprising accessing a remote receiving computer wireless device smart phone tablet phone computer or computer embedded appliance that runs a remote virtual machine or applet under control of an external device and inde pendent of an operating system of the receiving com puter streaming the data to remote virtual machine portion of the receiving computer and streaming a separate Boolean control code to the virtual machine portion of the receiving computer and using the Boolean control code or the controlling device to remotely control the streamed data by remotely controlling the matrix manipulation functions in the virtual machine portion of the remote receiving com puter to manipulate the streamed data and to control the display or access of data images and video and having a control code entered by the remote user into the matrix manipulation control system operating inside the virtual machine operating in the receiving computer or wireless device and enabling a handshake or authentication process between the user s inputted control code to combine like a key in a digital lock or communicate with the streamed Bool ean control code inside the matrix manipulation control system and jointly unlock or engage the matrix manipulation control system 2 The method o
Download Pdf Manuals
Related Search