高级检索
同鸣, 丁力伟, 刘莹莹. 多维语义线索和HCRF模型的足球视频精彩事件检测[J]. 计算机辅助设计与图形学学报, 2013, 25(11): 1715-1724.
引用本文: 同鸣, 丁力伟, 刘莹莹. 多维语义线索和HCRF模型的足球视频精彩事件检测[J]. 计算机辅助设计与图形学学报, 2013, 25(11): 1715-1724.
Tong Ming, Ding Liwei, Liu Yingying. Soccer Event Detection Based on Multidimensional Semantic Clues and HCRF[J]. Journal of Computer-Aided Design & Computer Graphics, 2013, 25(11): 1715-1724.
Citation: Tong Ming, Ding Liwei, Liu Yingying. Soccer Event Detection Based on Multidimensional Semantic Clues and HCRF[J]. Journal of Computer-Aided Design & Computer Graphics, 2013, 25(11): 1715-1724.

多维语义线索和HCRF模型的足球视频精彩事件检测

Soccer Event Detection Based on Multidimensional Semantic Clues and HCRF

  • 摘要: 足球视频精彩事件检测一直是视频语义分析领域研究的热点和难点.文中利用隐条件随机场(hidden conditional random field,HCRF)模型在表达和识别语义事件方面的强大功能,提出一种多维语义线索和HCRF的角球、点球和红黄牌精彩事件检测框架.首先通过对精彩事件视频结构语义进行分析,定义了10种多维语义线索,以准确描述精彩事件富含的语义信息;然后对视频片段进行物理镜头分割,对镜头关键帧提取多维语义线索得到特征矢量,再将测试视频片段中所有镜头的特征矢量共同构成观察序列;最后在小规模训练样本的情况下将观察序列作为HCRF模型的输入,建立了精彩事件检测的HCRF模型.文中基于音视频底层特征、多维语义线索及精彩语义事件之间的映射关系,从视频结构语义的多个维度挖掘了精彩事件的内在规律,准确地实现了精彩事件的检测.实验结果表明了该框架的有效性.

     

    Abstract: Wonderful event detection for soccer video has been the hot and difficult problem in the field of sport video semantic analysis.Based on the powerful expression ability of hidden conditional random fields (HCRF) model in the expression and identification of semantic event, this paper presents a novel framework for corner, penalty, and the red and yellow cards wonderful events detection based on the multidimensional semantic clues and HCRF model.Firstly, through analysis of the structural semantics of the wonderful event video, ten kinds of multidimensional semantic clues are defined to accurately describe the included semantic information of the wonderful events.Secondly, the video clips are split into several physical lens, then the multimodal semantic clues are extracted from the key frame of each lens to get the feature vector of the current lens, and the observed sequence is composed of the feature vectors of all shots in the test video clips.Finally, the above observed sequence is used as HCRF model input in the case of small-scale training samples, and a wonderful event detection HCRF model is effectively established.The inherent laws of the wonderful events are excavated from the multiple dimensions of the video structural semantics based on the mapping relationship of audio and video low-level features, the multidimensional semantic clues and the wonderful events, and the wonderful events;and the wonderful events detection is precisely achieved.Experiments show the effectiveness of this framework.

     

/

返回文章
返回