Research ArticleNo Access

Exploring the Brain Responses to Driving Fatigue Through Simultaneous EEG and fNIRS Measurements

Corresponding authors.

CIBCI, Centre for Artificial Intelligence, FEIT, University of Technology Sydney, Sydney, Broadway, 15, Ultimo NSW 2007, Australia

E-mail Address: [email protected]

Search for more papers by this author

Jung-Tai King

Brain Research Center, National Chiao Tung University, Hsinchu 300, Taiwan

E-mail Address: [email protected]

Search for more papers by this author

Chun-Hsiang Chuang

Department of Computer Science and Engineering, National Taiwan Ocean University, Keelung 202, Taiwan

E-mail Address: [email protected]

Search for more papers by this author

Weiping Ding

School of Information Science and Technology, Nantong University, Nantong 226019, China

E-mail Address: [email protected]

Search for more papers by this author

Wei-Yu Chuang

Brain Research Center, National Chiao Tung University, Hsinchu 300, Taiwan

E-mail Address: [email protected]

Search for more papers by this author

Lun-De Liao

Institute of Biomedical Engineering and Nanomedicine, National Health Research Institutes, Zhunan, 350, Taiwan

E-mail Address: [email protected]

Search for more papers by this author

and

Yu-Kai Wang

Corresponding authors.

CIBCI, Centre for Artificial Intelligence, FEIT, University of Technology Sydney, Sydney, Broadway, 15, Ultimo NSW 2007, Australia

E-mail Address: [email protected]

Search for more papers by this author

https://doi.org/10.1142/S0129065719500187Cited by:15

Abstract

Fatigue is one problem with driving as it can lead to difficulties with sustaining attention, behavioral lapses, and a tendency to ignore vital information or operations. In this research, we explore multimodal physiological phenomena in response to driving fatigue through simultaneous functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) recordings with the aim of investigating the relationships between hemodynamic and electrical features and driving performance. Sixteen subjects participated in an event-related lane-deviation driving task while measuring their brain dynamics through fNIRS and EEGs. Three performance groups, classified as Optimal, Suboptimal, and Poor, were defined for comparison. From our analysis, we find that tonic variations occur before a deviation, and phasic variations occur afterward. The tonic results show an increased concentration of oxygenated hemoglobin (HbO₂) and power changes in the EEG theta, alpha, and beta bands. Both dynamics are significantly correlated with deteriorated driving performance. The phasic EEG results demonstrate event-related desynchronization associated with the onset of steering vehicle in all power bands. The concentration of phasic HbO₂ decreased as performance worsened. Further, the negative correlations between tonic EEG delta and alpha power and HbO₂ oscillations suggest that activations in HbO₂ are related to mental fatigue. In summary, combined hemodynamic and electrodynamic activities can provide complete knowledge of the brain’s responses as evidence of state changes during fatigue driving.

Keywords:

References

1. K. Mandrick, Z. Chua, M. Causse, M. Causse, S. Perrey and F. Dehais, Why a comprehensive understanding of mental workload through the measurement of neurovascular coupling is a key issue for neuroergonomics? Front Hum. Neurosci. 10 (2016) 250. Crossref, Medline, ISI, Google Scholar
2. D. van der Linden and P. Eling, Mental fatigue disturbs local processing more than global processing, Psychol. Res. 70(5) (2006), 395–402. Crossref, Medline, ISI, Google Scholar
3. Y. Kato, H. Endo and T. Kizuka, Mental fatigue and impaired response processes: Event-related brain potentials in a Go/NoGo task Int. J. Psychophysiol. 72(2) (2009) 204–211. Crossref, Medline, ISI, Google Scholar
4. M. A. Boksem, T. F. Meijman and M. M. Lorist, Effects of mental fatigue on attention: An ERP study Brain Res. Cogn. 25(1) (2005) 107–116. Crossref, Medline, Google Scholar
5. C. S. Wei, Y. P. Lin, Y. T. Wang, C. T. Lin and T. P. Jung, A subject-transfer framework for obviating inter and intra-subject variability in EEG-based drowsiness detection NeuroImage 174 (2018) 407–419. Crossref, Medline, ISI, Google Scholar
6. N. Naseer1 and K. S. Hong, fNIRS-based brain-computer interfaces: A review, Front Hum. Neurosci. 9 (2015) 3. Medline, ISI, Google Scholar
7. M.-J. Khan and K.-S. Hong, Passive BCI based on drowsiness detection: An fNIRS study, Biomed. Opt. Exp., 6(10) (2015) 4063–4078. Crossref, Medline, ISI, Google Scholar
8. T. Liu, M. Pelowski, C. Pang, Y. Zhou and J. Cai, Near-infrared spectroscopy as a tool for driving research Ergonomics 59(3) (2016) 368–379. Crossref, Medline, ISI, Google Scholar
9. S. Makeig and T.-P. Jung, Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness Cognitive Brain Res. 4 (1996) 15–25. Crossref, Medline, Google Scholar
10. K. Lal and A. Craig, Driver fatigue: Electroencephalography and psychological assessment Psychophysiology 39(3) (2002) 313–321. Crossref, Medline, ISI, Google Scholar
11. C.-H. Chuang, L.-W. Ko, T.-P. Jung and C.-T. Lin, Kinesthesia in a sustained-attention driving task NeuroImage 91 (2014) 187–202. Crossref, Medline, ISI, Google Scholar
12. C. T. Lin, K. C. Huang, C. F. Chao, J. A. Chen, T. W. Chiu, L. W. Ko and T. P. Jung, Tonic and phasic EEG and behavioral changes induced by arousing feedback NeuroImage 52 (2010) 633–642. Crossref, Medline, ISI, Google Scholar
13. K. C. Huang, T. Y. Huang, C. H. Chuang, J. T. King, Y. K. Wang, C. T. Lin and T. P. Jung, An EEG-based fatigue detection and mitigation system Int. J. Neural Syst. 26(4) (2016) 1650018–1650018. Link, ISI, Google Scholar
14. A. Watanabe, N. Kato and T. Kato, Effects of creatine on mental fatigue and cerebral hemoglobin oxygenation Neurosci. Res. 42(4) (2002) 279–285. Crossref, Medline, ISI, Google Scholar
15. G. Lange, J. Steffener, D. B. Cook, B. M. Bly, C. Christodoulou, W. C. Liu, J. DeLuca and B. H. Natelson, Objective evidence of cognitive complaints in chronic fatigue syndrome: A BOLD fMRI study of verbal working memory NeuroImage 26(2) (2005) 513–524. Crossref, Medline, ISI, Google Scholar
16. D. B. Cook, P. J. O’Connor, G. Lange and J. Steffener, Functional neuroimaging correlates of mental fatigue induced by cognition among chronic fatigue syndrome patients and controls NeuroImage 36(1) (2007) 108–122. Crossref, Medline, ISI, Google Scholar
17. S. P. Drummond et al., The neural basis of the psychomotor vigilance task, Sleep 28(9) (2005) 1059–1061. Medline, ISI, Google Scholar
18. J. Lim, W. C. Wu, J. Wang, J. A. Detre, D. F. Dinges and H. Rao, Imaging brain fatigue from sustained mental workload: An ASL perfusion study of the time-on-task effect NeuroImage 49(4) (2010) 3426–3435. Crossref, Medline, ISI, Google Scholar
19. Z. Li, M. Zhang, X. Zhang, S. Dai, X. Yu and Y. Wang, Assessment of cerebral oxygenation during prolonged simulated driving using near infrared spectroscopy: Its implications for fatigue development, Eur. J. Appl. Physiol. 1073 (2009), 281–287. Crossref, Google Scholar
20. M. Suda, M. Fukuda, T. Sato, S. Iwata, M. Song, M. Kameyama and M. Mikuni, Subjective feeling of psychological fatigue is related to decreased reactivity in ventrolateral prefrontal cortex Brain Res. 1252 (2009) 152–160. Crossref, Medline, ISI, Google Scholar
21. S. Miyata, A. Noda, N. Ozaki, Y. Hara, M. Minoshima, K. Lwamoto, M. Takahashi, T. Iidaka and Y. Koike, Insufficient sleep impairs driving performance and cognitive function Neurosci. Lett. 469(2) (2010) 229–233. Crossref, Medline, ISI, Google Scholar
22. C. T. Lin, M. Nascimben, J. T. King and Y. K. Wang, Task-related EEG and HRV entropy factors under different real-world fatigue scenarios Neurocomputing 311 (2018) 24–31. Crossref, ISI, Google Scholar
23. C. H. Chuang, Z. Cao, J. T. King, B. S. Wu, Y. K. Wang and C. T. Lin, Brain electrodynamic and hemodynamic signatures against fatigue during driving Front Neurosci. 12 (2018) 181. Crossref, Medline, ISI, Google Scholar
24. T. Nguyen1, S. Ahn, H. Jang, S. C. Jun and J. G. Kim, Utilization of a combined EEG/NIRS system to predict driver drowsiness Sci. Rep. 7 (2017) 43933. Crossref, Medline, ISI, Google Scholar
25. L. Kocsis, P. Herman and A. Eke, The modified Beer-Lambert law revisited Phys. Med. Biol. 51(5) (2006) 91–98. Crossref, Medline, ISI, Google Scholar
26. Y. K. Wang, S. A. Chen and C. T. Lin, An EEG-based brain–computer interface for dual task driving detection Neurocomputing 129 (2014) 85–93. Crossref, ISI, Google Scholar
27. A. Delorme and S. Makeig, EEGLAB: An open source toolbox for analysis of single trial EEG dynamics including independent component analysis J. Neurosci. Methods 134(1) (2004) 9–21. Crossref, Medline, ISI, Google Scholar
28. S. K. Piper, A. Krueger, S. P. Koch, J. Mehnert, C. Habermehl, J. Steinbrink, H. Obrig and C. H. Schmitz, A wearable multichannel fNIRS system for brain imaging in freely moving subjects NeuroImage 85 (2014) 64–71. Crossref, Medline, ISI, Google Scholar
29. C. F. Lu, Y. C. Liu, Y. R. Yang, Y. T. Wu and R. Y. Wang, Maintaining gait performance by cortical activation during dual-task interference: A functional near-infrared spectroscopy study, PLOS one 10(6) (2015). Crossref, ISI, Google Scholar
30. C.-T. Lin, C.-H. Chuang, S. Kerick, T. Mullen, T. P. Jung, L. W. Ko, S. A. Chen, J. T. King and K. McDowell, Mind-wandering tends to occur under low perceptual demands during driving Sci. Rep. 6 (2016) 21353. Crossref, Medline, ISI, Google Scholar
31. C. Bogler, J. Mehnert, J. Steinbrink and J. D. Haynes, Decoding vigilance with NIRS, PloS one 9(7) (2014) e101729. Crossref, Medline, ISI, Google Scholar
32. A. C. Merzagora, M. Izzetoglu, R. Polikar, V. Weisser, B. Onaral and M. T. Schutheis, Functional near-infrared spectroscopy and electroenceph-alography: A multimodal imaging approach, Int. Conf. Foundations of Augmented Cognition. Neuroer Gonomics and Operational Neuroscience, San Diego, CA, USA, (2009), LNAI 5638, pp. 417–426. Crossref, Google Scholar
33. Y. K. Wang, T. P. Jung and C. T. Lin, Theta and alpha oscillations in attentional interaction during distracted driving Front. Behav. Neurosci. 12 (2018) 3. Crossref, Medline, ISI, Google Scholar
34. Y. K. Wang, T. P. Jung and C. T. Lin, EEG-based attention tracking during distracted driving, IEEE Trans. Neural Syst. Rehabil. Eng., 23(6) (2015) 1085–1094. Crossref, Medline, ISI, Google Scholar
35. G. Pfurtscheller, A. Stancak Jr and C. Neuper, Event-related synchronization (ERS) in the alpha band-an electrophysiological correlate of cortical idling: A review Int. J. Psychophysiol. 24(1–2) (1996) 39–46. Crossref, Medline, ISI, Google Scholar
36. Y. Hoshi and M. Tamura, Dynamic multichannel near-infrared optical imaging of human brain activity. J. Appl. Physiol. 75 (1993) 1842–1846. Crossref, Medline, ISI, Google Scholar
37. C. Xu, B. Signe and L.-R. Allan, Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics NeuroImage 49 (2010) 3039–3046. Crossref, Medline, ISI, Google Scholar
38. H. Bortfeld, E. Wruck and D. A. Boas, Assessing infants’ cortical response to speech using near-infrared spectroscopy Neuroimage 34 (2007) 407–415. Crossref, Medline, ISI, Google Scholar
39. R. J. Huster, S. Debener, T. Eichele and C. S. Herrmann, Methods for simultaneous EEG-fMRI: An introductory review J. Neurosci. 32(18) (2012) 6053–6060. Crossref, Medline, ISI, Google Scholar
40. S. T. Ahn and S. C. Jung, Multi-modal integration of EEG-fNIRS for brain-computer interfaces – current limitations and future directions Front. Human Neurosci. 11 (2017) 503. Crossref, Medline, ISI, Google Scholar
41. S. I. Goncalves, J. C. Munck, P. J. W. Pouwels, R. Schoonhoven, J. P. A. Kuijer, N. M. Maurits, J. M. Hoogduin, E. J. W. Someren, R. M. Heethaar and F. H. L. da Silva, Correlating the alpha rhythm to BOLD using simultaneous EEG/fMRI: Inter-subject variability, NeuroImage 30(1) (2006) 203–213. Crossref, Medline, ISI, Google Scholar
42. R. I. Goldman, J. M. Stern, J. Engel Jr and M. S. Cohen, Simultaneous EEG and fMRI of the alpha rhythm Neuroreport 13(18) (2002) 2487–2492. Crossref, Medline, ISI, Google Scholar
43. H. Laufs, A. Kleinschmidt, A. Beyerle, E. Eger, A. Salek-Haddadi, C. Preibisch and K. Krakow, EEG- correlated fMRI of human alpha activity NeuroImage 19(6) (2003) 1463–1476. Crossref, Medline, Google Scholar
44. S. G. Horovitz, M. Fukunaga, J. A. de Zwart, P. van Gelderen, S. C. Fulton, T. J. Balkin and J. H. Duyn, Low frequency BOLD fluctuations during resting wakefulness and light sleep: A simultaneous EEG–fMRI study Hum. Brain Mapp. 29(6) (2008) 671–682. Crossref, Medline, ISI, Google Scholar
45. P. Ritter and A. Villringer, Simultaneous EEG– fMRI Neurosci. Biobehav. Rev. 30(6) (2006) 823–838. Crossref, Medline, ISI, Google Scholar
46. L. Xu, B. Wang, G. Xu, W. Wang, Z. Liu and Z. Li, Functional connectivity analysis using fNIRS in healthy subjects during prolonged simulated driving Neurosci. Lett. 640(15) (2017) 21–28. Crossref, Medline, Google Scholar

Published: 1 August 2019

Remember to check out the Most Cited Articles!
Check out our titles in neural networks today!

Vol. 30, No. 01

Metrics

Downloaded 340 times

History

Accepted 28 May 2019

Keywords

PDF download

System Upgrade on Mon, Jun 21st, 2021 at 1am (EDT)

Exploring the Brain Responses to Driving Fatigue Through Simultaneous EEG and fNIRS Measurements

Abstract

References

Recommended