SST-CRAM: spatial-spectral-temporal based convolutional recurrent neural network with lightweight attention mechanism for EEG emotion recognition

Ahmed F, Bari ASMH, Gavrilova ML (2020) Emotion recognition from body movement. IEEE Access 8:11761–11781. https://doi.org/10.1109/ACCESS.2019.2963113

Article  Google Scholar 

Alhagry S, Aly A, AR (2017) Emotion recognition based on EEG using LSTM Recurrent Neural Network. ijacsa 8:. https://doi.org/10.14569/IJACSA.2017.081046

Aydin S (2020) Deep learning classification of neuro-emotional phase domain complexity levels induced by affective video film clips. IEEE J Biomed Health Inform 24:1695–1702. https://doi.org/10.1109/JBHI.2019.2959843

Article  PubMed  Google Scholar 

Bagheri M, Power SD (2020) EEG-based detection of mental workload level and stress: the effect of variation in each state on classification of the other. J Neural Eng 17:056015. https://doi.org/10.1088/1741-2552/abbc27

Article  PubMed  Google Scholar 

Busso C, Deng Z, Yildirim S, et al (2004) Analysis of emotion recognition using facial expressions, speech and multimodal information. In: Proceedings of the 6th international conference on Multimodal interfaces. ACM, State College PA USA, pp 205–211

Chen J, Jiang D, Zhang Y, Zhang P (2020) Emotion recognition from spatiotemporal EEG representations with hybrid convolutional recurrent neural networks via wearable multi-channel headset. Comput Commun 154:58–65. https://doi.org/10.1016/j.comcom.2020.02.051

Article  Google Scholar 

Collin L, Bindra J, Raju M et al (2013) Facial emotion recognition in child psychiatry: A systematic review. Res Dev Disabil 34:1505–1520. https://doi.org/10.1016/j.ridd.2013.01.008

Article  PubMed  Google Scholar 

Cowie R, Douglas-Cowie E, Tsapatsoulis N et al (2001) Emotion recognition in human-computer interaction. IEEE Signal Process Mag 18:32–80. https://doi.org/10.1109/79.911197

Article  Google Scholar 

Dadebayev D, Goh WW, Tan EX (2022) EEG-based emotion recognition: Review of commercial EEG devices and machine learning techniques. J King Saud Univ—Comp Info Sci 34:4385–4401. https://doi.org/10.1016/j.jksuci.2021.03.009

Article  Google Scholar 

Deng X, Zhu J, Yang S (2021) SFE-Net: EEG-based emotion recognition with symmetrical spatial feature extraction

Ehrlich S, Guan C, Cheng G (2017) A closed-loop brain-computer music interface for continuous affective interaction. In: 2017 International Conference on Orange Technologies (ICOT). IEEE, Singapore, pp 176–179

Fieldhouse JLP, Singleton EH, Van Engelen ME et al (2023) Decreased emotion recognition and reduced focus on facial hallmarks in behavioral variant frontotemporal dementia compared to primary psychiatric disorders and controls. Euro J of Neurology 30:2222–2229. https://doi.org/10.1111/ene.15837

Article  Google Scholar 

Fragopanagos N, Taylor JG (2005) Emotion recognition in human–computer interaction. Neural Netw 18:389–405. https://doi.org/10.1016/j.neunet.2005.03.006

Article  CAS  PubMed  Google Scholar 

George JM (2000) Emotions and leadership: the role of emotional intelligence. Human Relations 53:1027–1055. https://doi.org/10.1177/0018726700538001

Article  Google Scholar 

Giorgi A, Ronca V, Vozzi A et al (2021) Wearable technologies for mental workload, stress, and emotional state assessment during Working-Like tasks: a comparison with laboratory technologies. Sensors 21:2332. https://doi.org/10.3390/s21072332

Article  PubMed  PubMed Central  Google Scholar 

Goh SK, Abbass HA, Tan KC et al (2018) Spatio-Spectral representation learning for electroencephalographic Gait-Pattern classification. IEEE Trans Neural Syst Rehabil Eng 26:1858–1867. https://doi.org/10.1109/TNSRE.2018.2864119

Article  PubMed  Google Scholar 

Graves A, Mohamed A, Hinton G (2013) Speech recognition with deep recurrent neural networks. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE, Vancouver, BC, Canada, pp 6645–6649

He K, Zhang X, Ren S, Sun J (2016) Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, Las Vegas, NV, USA, pp 770–778

Hu J, Shen L, Albanie S et al (2020) Squeeze-and-Excitation networks. IEEE Trans Pattern Anal Mach Intell 42:2011–2023. https://doi.org/10.1109/TPAMI.2019.2913372

Article  PubMed  Google Scholar 

Hwang S, Hong K, Son G, Byun H (2020) Learning CNN features from DE features for EEG-based emotion recognition. Pattern Anal Applic 23:1323–1335. https://doi.org/10.1007/s10044-019-00860-w

Article  Google Scholar 

Karasu S, Altan A (2022) Agricultural crop classification with R-CNN and machine learning methods

Kerdjidj O, Amara K, Harizi F, Boumridja H (2023) Implementing hand gesture recognition using EMG on the Zynq Circuit. IEEE Sensors J 23:10054–10061. https://doi.org/10.1109/JSEN.2023.3259150

Article  Google Scholar 

Keys R (1981) Cubic convolution interpolation for digital image processing. IEEE Trans Acoust, Speech, Signal Process 29:1153–1160. https://doi.org/10.1109/TASSP.1981.1163711

Article  Google Scholar 

Kılıç B, Aydın S (2022) Classification of contrasting discrete emotional states indicated by EEG based graph theoretical network measures. Neuroinform 20:863–877. https://doi.org/10.1007/s12021-022-09579-2

Article  Google Scholar 

Koelstra S, Muhl C, Soleymani M et al (2012) DEAP: A database for emotion analysis; using physiological signals. IEEE Trans Affective Comput 3:18–31

Article  Google Scholar 

Li D, Wang Z, Wang C et al (2019) The fusion of electroencephalography and facial expression for continuous emotion recognition. IEEE Access 7:155724–155736. https://doi.org/10.1109/ACCESS.2019.2949707

Article  Google Scholar 

Li J, Zhang Z, He H (2018) Hierarchical convolutional neural networks for EEG-Based emotion recognition. Cogn Comput 10:368–380. https://doi.org/10.1007/s12559-017-9533-x

Article  Google Scholar 

Li X, Zhang Y, Tiwari P et al (2023) EEG based emotion recognition: a tutorial and review. ACM Comput Surv 55:1–57. https://doi.org/10.1145/3524499

Article  Google Scholar 

Lotfi E, Akbarzadeh-T M-R (2014) Practical emotional neural networks. Neural Netw 59:61–72. https://doi.org/10.1016/j.neunet.2014.06.012

Article  PubMed  Google Scholar 

Nita S, Bitam S, Heidet M, Mellouk A (2022) A new data augmentation convolutional neural network for human emotion recognition based on ECG signals. Biomed Signal Process Control 75:103580. https://doi.org/10.1016/j.bspc.2022.103580

Article  Google Scholar 

Özçelik YB, Altan A (2023a) A comparative analysis of artificial intelligence optimization algorithms for the selection of entropy-based features in the early detection of epileptic seizures. In: 2023 14th International Conference on Electrical and Electronics Engineering (ELECO). IEEE, Bursa, Turkiye, pp 1–5

Özçelik YB, Altan A (2023b) Overcoming nonlinear dynamics in diabetic retinopathy classification: a robust AI-Based model with chaotic swarm intelligence optimization and recurrent long Short-Term memory. Fractal Fract 7:598. https://doi.org/10.3390/fractalfract7080598

Article  Google Scholar 

Rudakov E, Laurent L, Cousin V, et al (2021) Multi-Task CNN model for emotion recognition from EEG Brain maps. In: 2021 4th International Conference on Bio-Engineering for Smart Technologies (BioSMART). IEEE, Paris / Créteil, France, pp 1–4

Sarma P, Barma S (2021) Emotion recognition by distinguishing appropriate EEG segments based on random matrix theory. Biomed Signal Process Control 70:102991. https://doi.org/10.1016/j.bspc.2021.102991

Article  Google Scholar 

Shang Y, Yang M, Cui J et al (2022) Driver emotion and fatigue state detection based on time series fusion. Electronics 12:26. https://doi.org/10.3390/electronics12010026

Article  Google Scholar 

Shen F, Dai G, Lin G et al (2020) EEG-based emotion recognition using 4D convolutional recurrent neural network. Cogn Neurodyn 14:815–828. https://doi.org/10.1007/s11571-020-09634-1

Article  PubMed  PubMed Central  Google Scholar 

Sikander G, Anwar S (2019) Driver Fatigue detection systems: a review. IEEE Trans Intell Transport Syst 20:2339–2352. https://doi.org/10.1109/TITS.2018.2868499

Article  Google Scholar 

Tang Y, Wang Y, Zhang X, Wang Z (2023) STILN: A novel spatial-temporal information learning network for EEG-based emotion recognition. Biomed Signal Process Control 85:104999. https://doi.org/10.1016/j.bspc.2023.104999

Article  Google Scholar 

Tepelena I, Frantzidis C, Salvari V, et al (2017) Are elderly less responsive to emotional stimuli? An EEG-based Study across pleasant, unpleasant and neutral greek words. In: 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS). IEEE, Thessaloniki, pp 469–474

Topic A, Russo M (2021) Emotion recognition based on EEG feature maps through deep learning network. Eng Sci Technol Int J 24:1442–1454. https://doi.org/10.1016/j.jestch.2021.03.012

Article  Google Scholar 

Wang Q, Wu B, Zhu P, et al (2020a) ECA-Net: efficient channel attention for deep convolutional neural networks

Wang Q, Wu B, Zhu P, et al (2020b) ECA-Net: efficient channel attention for deep convolutional neural networks. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp 11531–11539

Wang Y, Huang Z, McCane B, Neo P (2018) EmotioNet: A 3-D convolutional neural network for EEG-based emotion recognition. 2018 International Joint Conference on Neural Networks (IJCNN). IEEE, Rio de Janeiro, pp 1–7

Google Scholar 

Woo S, Park J, Lee J-Y, Kweon IS (2018) CBAM: Convolutional Block Attention Module. In: Ferrari V, Hebert M, Sminchisescu C, Weiss Y (eds) Computer Vision – ECCV 2018. Springer International Publishing, Cham, pp 3–19

Chapter  Google Scholar 

Xiao G, Shi M, Ye M et al (2022) 4D attention-based neural network for EEG emotion recognition. Cogn Neurodyn 16:805–818. https://doi.org/10.1007/s11571-021-09751-5

Article  PubMed  PubMed Central  Google Scholar 

Yang Y, Wu Q, Fu Y, Chen X (2018) Continuous convolutional neural network with 3D Input for EEG-based emotion recognition. In: Cheng L, Leung ACS, Ozawa S (eds) Neural Information Processing. Springer International Publishing, Cham, pp 433–443

Chapter  Google Scholar 

Zhang Y, Chen J, Tan JH et al (2020) An investigation of deep learning models for EEG-Based emotion recognition. Front Neurosci 14:622759. https://doi.org/10.3389/fnins.2020.622759

Article  PubMed  PubMed Central  Google Scholar 

Zheng W-L, Zhu J-Y, Lu B-L (2019) Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans Affective Comput 10:417–429. https://doi.org/10.1109/TAFFC.2017.2712143

Article  Google Scholar 

Zheng X, Chen W (2021) An Attention-based Bi-LSTM method for visual object classification via EEG. Biomed Signal Process Control 63:102174. https://doi.org/10.1016/j.bspc.2020.102174

Article  Google Scholar 

留言 (0)

沒有登入
gif