Feature and parameter extraction for audio and video processing

• Main Authors: ANDREWS BRETT J, WAN WADE, WYMAN RICHARD HAYDEN, HERRICK JASON W, GEORGI BERND
• Format: Patent
• Language: Chinese; English
• Published: 02.05.2023
• Subjects: ELECTRIC COMMUNICATION TECHNIQUE; ELECTRICITY; PICTORIAL COMMUNICATION, e.g. TELEVISION

Methods, systems, and apparatus for improving security of media streams are disclosed. The system may receive a decoded media stream from a media decoding pipeline that receives and decodes an encoded media stream. The system may identify a set of features to generate based on the decoded media stream and generate the set of features using the decoded media stream. Such features may include luminance histograms, pixel intensity data, motion vectors, edge detection, audio gain, tone information, pitch information, and other types of features. The system may provide the set of features to a processor executing a machine learning model, wherein the device prevents the processor executing the machine learning model from accessing the decoded media stream. 本发明公开用于改进媒体流的安全性的方法、系统及装置。所述系统可从接收并解码经编码媒体流的媒体解码管线接收经解码媒体流。所述系统可基于所述经解码媒体流识别要产生的一组特征及使用所述经解码媒体流产生所述一组特征。此类特征可包含亮度直方图、像素强度数据、运动向量、边缘检测、音频增益、音调信息、音高信息以及其它类型的特征。所述系统可将所述一组特征提供给执行机器学习模型的处理器，其中所述装置防止执行所述机器学习模型的所述处理器存取所述经解码媒体流。