f. cincotti, f. babiloni, l. bianchi, m.g.marciani, s ... · f. cincotti, f. babiloni, l. bianchi,...
TRANSCRIPT
![Page 1: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/1.jpg)
F. Cincotti, F. Babiloni, L. Bianchi,
M.G. Marciani, S. Salinari,
L. Astolfi, F. Aloise, F. de Vico Fallani
and D. Mattia
Workshop on BMI
for Space Applications
Università di Roma
"Tor Vergata"
Noordwijk (The Netherlands), 30 November 2009
![Page 2: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/2.jpg)
“Brain–computer interfaces (BCI’s) give their users communication and control channels that
do not depend on the brain’s normal output channels of peripheral nerves and muscles.”
“A BCI changes the electrophysiological signals from mere reflections of CNS activity into the
intended product of the activity: messages and commands that act on the world”
Wolpaw et al. 2002, clinph
2ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 3: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/3.jpg)
Goal of Brain-Computer Interface
research is to provide:
A new control option(to people with severe motor disabilities)
Functions that normal muscular control
can’t address(to able-bodied people)
ESA BMI Workshop - Nov 30, 20093
Cincotti - BCI & Domotics
![Page 4: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/4.jpg)
4
Psychological
Effort
(Intention)
Modification of
Brain SignalsSignal Features
Classification
Of Intent
appropriate feature extraction
appropriate feedback strategy
use
r tr
ain
ing
co
mp
ute
r train
ing
Environment
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 5: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/5.jpg)
The model of BCI (2)
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics5
![Page 6: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/6.jpg)
Detection of activity in the CNS Electrocorticography (ECoG), Intracortical potentials
(microelectrodes), Depth Electrodes (SEEG), …
Electroencephalography (EEG),
Magnetoencephalography (MEG), Functional
Magnetic Resonance Imaging (fMRI), Near Infrared
Spectroscopy (NIRS), …
ESA BMI Workshop - Nov 30, 20096
Cincotti - BCI & Domotics
![Page 7: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/7.jpg)
ESA BMI Workshop - Nov 30, 20097
Detection of sensorimotor
rhythms modulationDetection of P300
Detection of
steady-state (V)EPs
Detection of Slow
Cortical Potentials
Cincotti - BCI & Domotics
![Page 8: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/8.jpg)
C3Cz
C4
8
Mu-Rhythm for BCI
δ
θ
α
βγ
ESA BMI Workshop - Nov 30, 2009 Cincotti - BCI & Domotics
![Page 9: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/9.jpg)
Cursor control
Left vs.Right hand
Upper vs. Lower limb
43 CC SSy
432
1CCCz SSSy
C3Cz
C4
ESA BMI Workshop - Nov 30, 20099
Cincotti - BCI & Domotics
![Page 10: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/10.jpg)
The P300 is an event-related potential, dominating at parietal electrode sites.
P300 follows unexpected sensory stimuli or stimuli that provide task related information
P300 speller
10
From Selllers & Donchin 2006, clinph
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 11: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/11.jpg)
Domotic applicationsUser
(Brain) Interface
(Smart) Controller
Actuators
ESA BMI Workshop - Nov 30, 2009 11Cincotti - BCI & Domotics
![Page 12: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/12.jpg)
Beyond a BCI-centric approach
ESA BMI Workshop - Nov 30, 200912
Cincotti - BCI & DomoticsCincotti et al 2008, BRB
![Page 13: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/13.jpg)
13
“ASPICE” Project
(Italian Telethon
Foundation)
SMR control of a home
environment
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 14: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/14.jpg)
P300 control of a home
environment
14
“SM4All” Project
(FP7-ICT STREP)
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 15: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/15.jpg)
P300 control of a home
environment
15
“SM4All” Project
(FP7-ICT STREP)
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 16: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/16.jpg)
Possible improvementsSignal processing: Neuroelectrical imaging
HCI: Non-visual feedback/stimulation
…
Asynchronous control
Reduce symbolism
ESA BMI Workshop - Nov 30, 2009 16Cincotti - BCI & Domotics
![Page 17: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/17.jpg)
Neuroelectrical Source Imaging
(1)
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics17
Cincotti et al 2007, JNM
![Page 18: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/18.jpg)
Neuroelectrical Source Imaging
(2)
18
Subject 2
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 19: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/19.jpg)
19
SMR Vibrotactile feedback (1)
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
Cincotti et al 2007, CIN
![Page 20: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/20.jpg)
SMR Vibrotactile feedback (2)
SMR patterns are
comparable
Control performance
are slightly reduced
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics20
Visual Feedback Tactile Feedback
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
ALFA BOAN MADA RUDA WUWE
99 - Tactor
99 - Visual
![Page 21: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/21.jpg)
21
“MAIA” Project
(FP5 – STREP)
SMR Vibrotactile Feedback
ESA BMI Workshop - Nov 30, 2009Cincotti - BCI & Domotics
![Page 22: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/22.jpg)
Multimodal stimulation for a
P300-BCI
(100%) (93%) (70%) (68%)
ESA BMI Workshop - Nov 30, 200922
Cincotti - BCI & DomoticsAloise et al 2007, IJBEM
BCI Performance
Statistics
![Page 23: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/23.jpg)
New challenges
Targeted non muscular communication devices Non-invasive neuroprosthetics Non-deterministic applications (entertainment) Monitoring/fostering cortical plasticity
Hybridization with muscular channels Asynchronous recognition of mental states (SMR,
MRP, P300) Merging with the wider HCI fields Improved sensors: dry electrodes Standardization Wearable/Embedded platforms Evaluation metrics Ethics
TOBI : Tools for
Brain-Computer
InteractionESA BMI Workshop - Nov 30, 2009
23Cincotti - BCI & Domotics
![Page 24: F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S ... · F. Cincotti, F. Babiloni, L. Bianchi, M.G.Marciani, S. Salinari, L. Astolfi, F. Aloise, F. de Vico Fallani and D. Mattia](https://reader030.vdocumenti.com/reader030/viewer/2022040601/5e91a0c08193a062b63c8829/html5/thumbnails/24.jpg)
Funding
• EC FP7 ICT-2007-224631
Integrated Project (TOBI)
• EC FP7-2007-224332
Project (SM4All)
• Italian Ministry of Health
Collaborators
• José del R. Millàn
• Massimo Mecella
• Gerwin Schalk
NEILab
• Donatella Mattia
• Fabio Babiloni
• Luigi Bianchi
• Laura Astolfi
• Fabrizio de Vico Fallani
• Fabio Aloise,
• Lucia R. Quitadamo
• Angela Riccio
• Monica Risetti
• Maria Grazia Marciani
• Serenella Salinari
24ESA BMI Workshop - Nov 30, 2009
24Cincotti - BCI & Domotics