高级检索
郑瑞凌, 张俊松. 脑电时空多特征融合的数字图形界面认知负荷评价方法[J]. 计算机辅助设计与图形学学报, 2020, 32(7): 1062-1069. DOI: 10.3724/SP.J.1089.2020.18358.z54
引用本文: 郑瑞凌, 张俊松. 脑电时空多特征融合的数字图形界面认知负荷评价方法[J]. 计算机辅助设计与图形学学报, 2020, 32(7): 1062-1069. DOI: 10.3724/SP.J.1089.2020.18358.z54
Zheng Ruiling, Zhang Junsong. Assessing Cognitive Load Combining Features of Time,Frequency and Spatial Domain under Digital Graphical Interface[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(7): 1062-1069. DOI: 10.3724/SP.J.1089.2020.18358.z54
Citation: Zheng Ruiling, Zhang Junsong. Assessing Cognitive Load Combining Features of Time,Frequency and Spatial Domain under Digital Graphical Interface[J]. Journal of Computer-Aided Design & Computer Graphics, 2020, 32(7): 1062-1069. DOI: 10.3724/SP.J.1089.2020.18358.z54

脑电时空多特征融合的数字图形界面认知负荷评价方法

Assessing Cognitive Load Combining Features of Time,Frequency and Spatial Domain under Digital Graphical Interface

  • 摘要: 准确地评价数字图形界面下操作员的认知负荷(cognitive load,CL),有助于实现认知反馈机制并最终提高人机工效.为了进一步提高评价方法的鲁棒性与泛化能力,结合EEG实验将Att-BLSTM应用于CL评价问题中.该方法首先利用Multi-CNN提取EEG的频域与空间特征,然后利用Att-BLSTM提取EEG的时域特征,最后通过多特征融合构建CL评价方法.通过招募12名被试,采集了2种CL条件下的EEG数据进行了实验.实验结果表明,文中方法在该数据集上的平均准确率为82%,比传统机器学习的方法具有更强的EEG信号表征能力;与其他深度学习方法相比,也能更准确地提取EEG的时域特征,且具有更强的鲁棒性.

     

    Abstract: Evaluating operator’s cognitive load(CL)under digital graphical interface accurately can help to realize cognitive feedback mechanism and ultimately improve ergonomics.In order to further improve the robustness and generalization capability of the evaluation method,Att-BLSTM is applied to CL evaluation problems combining with EEG experiments.First,we train Multi-CNN to extract time and spatial domain features.Next,we train an Att-BLSTM to learn robust representations from raw EEG time series.Finally,a multi-feature fusion strategy is used to construct CL evaluation method.12 subjects were recruited,and EEG data were collected under two CL conditions.The average accuracy of our method on our dataset is 82%,which has a stronger EEG signal characterization capability than the traditional machine learning method,it can also extract the time domain characteristics of EEG more accurately and with stronger robustness than other deep learning methods.

     

/

返回文章
返回