‫بيان هوية وتعريف ر‬
PROJECT IDENTITY FACTSHEET‫المشوع‬
‫المجموعة‬/‫اسم الطالب‬Students/group’s name: Mohammed Salih (Team Leader), Hussien Hani,
Zaynab Faysal, Safa Ryadh and Jumana Mohammed
‫ر‬
‫المشوع‬
‫عنوان‬/‫اسم‬Project title: A Smart Control System of Home Appliances Using Brain
Computer Interface (BCI)
‫موقع ر‬Project location: Mosul-Iraq
‫المشوع‬
‫قطاع ر‬Project sector ( ‫اختار‬select):
‫المشوع‬
Category 1: Campus & Civic Engagement ‫الجامع والمشاركة المدنية‬
‫الحرم‬
‫ي‬
‫استئناف اطار ر‬Project framework resume:
‫المشوع‬
Main objectives ‫االهداف الرئيسية‬
Main Related activities ‫الفعاليات الرئيسية المرتبطة بها‬
•
•
•
•
Select a proper neuroheadset and test it.
Using EmotivPro software to get raw data.
Study these signals and classify them according
to the brain’s limb.
•
Make signal conditioning and a controller will
take action depending on these processed
signals.
Select a proper disabled person.
Read his Electroencephalography (EEG) signals.
•
Acquire, study, classify and process the
signals of the human brain then convert
these signals into actions.
Implement the project over several •
disabled persons to meet desired •
results.
•
By using the controller, matching between the
useful signals and actions want to take will be
made.
‫عدد المستفيدين المخطط له‬Total planned beneficiaries:
23000 (Expected)
‫ تاري خ البدء‬Start date:
1st August 2019
‫تاري خ االنتهاء‬End date:
31 December 2019
‫الموازنة الكلية‬Total Budget ($):
8000$
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
1
Need assessment – ‫تقدير مدى الحاجة‬/‫استبيان‬
1.
1.1. Assessment methodology ‫منهجية االستبيان‬
Injuries are increasingly recognized as a major component of the global burden of disease but
little is known about civilian injuries, deaths and disabilities during conflict. In terms of Mosul
and Iraq in general, it is difficult to obtain a precise number about disabled and handicap
people. There are some statistics according to different organizations that could be relied on.
According to the Yaqein agency news, the number of disabled people reached up to 23000
persons. 70% of the recorded disabled cases was during the ISIS war [1]. while, in 2017, the
ministry of planning said that the number of disabled people in Iraq became 1.878 million
people (57% male and 43% female) [2].
1.2. Problems and needs analysis ‫المشاكل القائمة و تحليل االحتياجات‬
According to the number of disabled people, some problems arose about dealing with these
handicaps such as taking care, accompany and so on. In other word, there are multiple barriers
that can make it extremely difficult or even impossible for people with disabilities to function.
Here are the seven most common barriers. Often, more than one barrier occurs at a time.
•
Transportation
•
Communication and social relationship
•
Loss of independence
•
Accessibility issue
•
Education
•
Social
• Attitudinal
Therefore, often every single disabled person needs a person to help him/her. And, in a
technological era, everything around us turns to be automated, therefore some technology
utilizes the human brain to take control over some actions. Some research has been
conducted and showed that brain signals can be used to help disabled people to make some
of their activities.
‫ألمستفيدون من ر‬
2.
Beneficiaries of the project ‫المشوع‬
Firstly, the main objective that can be predicted from this project is to offer a compatible and
compact BCI system for Mosulian people in particular and Iraqi in general who suffering from
neurological disorder or Tetraplegia. This implementation requires a comprehensive study on
how to deal with signal conditioning measured from brain and converting these signals to an
easy form in the programming procedure before giving action to external devices.
Secondly, initializing a kernel research group in the field of prosthetics mind control to
rehabilitate a Mosul’s children that faces daily challenges after liberation who lost their limbs
to give them more hope. This objective necessitates a cooperation with representative of the
Ministry of Health in Nineveh.
The following number taken from governing hospitals and health centers , so it’s not fully
critical , it’s expected numbers based on their databases.
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
2
3.
Beneficiary
types
‫اصناف‬
‫المستفيدين‬
Total
number
‫العدد الكل‬
Disabled
people
21850
Infant &
Children (5young
17)
children (0- ‫االحداث من‬
59 month)
‫ سنة‬17-5
‫االطفال من‬
‫ شهر‬59-0
6210
Adults
(18-49)
‫ن‬
‫البالغي‬
-18 ‫من‬
‫ سنة‬49
Elderly
(over
50)
‫المعمرين‬
50 ‫فوق‬
‫سنة‬
%
Female
‫نسبة‬
‫االناث‬
%
Male
‫نسبة‬
‫الذكور‬
12650
2990
43%
57%
‫( عرض ر‬2 pages maximum‫)صفحتي كحد أقىص‬
‫ن‬
Project presentation ‫المشوع‬
‫أوصف ر‬
3.1.
Describe the project you want to implement ‫المشوع الذي ترغب نف تنفيذه‬
3.1.1 REVIEW AND PROJECT IDENTITY:
Brain-Computer Interfaces (BCIs) simply defined as systems that can read
electroencephalography (EEG) signals from human being’s brain and translate them to
messages or commands to perform some interactive application [3]. Recoding the electrical
activity of the brain via EEG is considered as a non-invasive approach, which is used in the
diagnosis of neurological disorder plus developing BCI. The waves obtained from the brain can
be subdivided according their frequencies into four waves: beta, alpha, theta and delta [4].
Because of this frequency variation, induce researchers to devote the efforts and resources to
benefiting from this technology through several applications such as controlling robot arm or
prosthetics for disabled people. The following block diagram summarizes the main
Preprocessing
Classification
Aquistion
technique
Selecting
Application
Interface
Raw
Signals
Brain EEG Signal
Thoughts or
Facial
expressions
components of BCI [4].
Control or Actuation
Signal
BCI
Driving an actuator
or managing
Application
Feedback (vision,
Movement)
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
3
One of the most interesting parts of BCI development is that these devices can be controlled
by human thoughts. It may be very useful for people who lose the ability to use their muscles
because of total or partial paralysis of their entire motor system due to stroke, traumatic brain
injury, or cerebral palsy. These patients are fully conscious and alert, but are unable to use
their muscles. Hence they can use the power of their brains along with the required interface
and output devices to perform an action, e.g., wheel chair control or prosthetic arm control.
In order to control a device using thoughts, some training is needed. For example, the subject
may visualize closing his or her hand. The signals of this thought (hand-closing) will be
collected; features will be extracted and then programmed into the BCI system. Later, when
the subject thinks of closing his or her hand, the robotic hand will close automatically [5].
3.1.2 Software:
The expected software to be used throughout the project:
✓
✓
✓
✓
MATLAB (Licensed)
LabVIEW (Licensed)
Arduino IDE )open source)
EPOC+ and EMOTIV Flex Gel/Saline Kit (with head set)
3.1.3 Main Hardware components:
Since the initial idea is to control home appliances (opening and closing doors, turning lights
on and off …etc.). The second phase of this scheme is to control prosthetics of disabled people
that has injured after Mosul liberation operations or wheel chair. Consequently, the expected
hardware devices almost needed have been annexed within the budget plan.
3.1.4 Data acquisition:
The EEG signal is acquired from the brain using a wireless
Emotiv EPOC headset [6,7] that receives EEG signals via
electrodes placed on the human scalp. The Emotiv EPOC
headset has 32 electrodes plus 2 reference electrodes that are
located at positions AF3, AF4, F3, F4, F7, F8, FC5, FC6, P7, P8,
T7, T8, O1, and O2 based on the international 10–20 system
[8,9] of electrode placement. Here AF stands for anterior
frontal, F stands for frontal, FC stands for fronto-central, P
stands for parietal, and O stands for occipital. Two reference
electrodes (CMS/DRL) are placed on P3/P4 as shown in Figure
1. The EEG data are acquired at a sampling rate of 128 Hz.
Figure 1 Emotiv EPOC sensor positions.
EmotivPRO is a software tool that could be used to obtain raw data. it allows to view data
streams and frequency analyses in real time whenever your headset is connected, both during
a recording and when you are not recording. EmotivPRO also allows to open and playback
saved recordings, which includes all data streams and frequency analyses.
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
4
‫ر‬
3.2.
Project justifications ‫المشوع‬
‫مبرات‬
‫ر‬
- The main reason behind this concept is the situation of health sector that our city suffers from
especially after the liberation operations in 2017.
- Biomedical Engineering is almost non-existent in the city with the urgent need to cope with
the large number of people with disabilities. Thus, promoting such a project indicates that this
field will continue in the future with more complex issues to be solved.
The designed plan that have been planted for this work passes through main three stages:
3.2.1. first Stage: (Planning)
✓ Reading research articles related project title to assess where the researchers have been
achieved and what we can add.
✓ Classify the EEG signals obtained from the brain via EPOC channels and specify which kind will
be employed with its frequency to drive the actuators such as facial expressions.
✓ Test EMOTIV EPOC Channel Mobile EEG kit and locate the references electrodes on a student
head (CMS and DRL signals).
✓ Start working on the Emotive Control Panel as a graphical user Interface
✓ Presenting a proposal for the sponsor
3.2.2. Second Stage: (Signals Conditioning):
✓ Studying how to acquire the signals with specifying the sampling rates and the electronic filters
will be used
✓ Artificial intelligence will play a crucial role on classifying these signals with one of its
techniques such as neural network.
✓ Signal amplifications required to ease the processing in the program structure because EEG
signals have low amplitudes.
✓ Reading about Fast Fourier transform (FFT)
✓ Identifying the most convenient software platform to manage the system either MATLAB or
LabVIEW
3.3.3. Third stage: (Actuation signals):
✓ Implementing the sampled signals to drive Motors (Servos or Steppers)
✓ Selecting the appropriate controller for this project either Arduino or Raspberry Pi
✓ final control elements to be driven (Home appliances and wheel chair or prosthetics)
✓ Final project presentation
In summary, the EEG signals for the people who have disability in four limbs (upper and lower)
or upper side only measured by Wireless EMOTIV EPOC Channel Mobile EEG kit. Then, these
signals will be sampled and processing through microcontroller with personal computer as an
assistant. Next, the actuation signal will go to drive either relays coil of the home appliances
or DC motors that can move a wheel chair or prosthetics. Finally, suggest a compatible design
kit to turning on and off any home device straightforwardly.
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
5
4.
‫اطار ر‬
Project framework ‫المشوع‬
Description
‫ألوصف‬
Objective 1
O1. Acquire, study,
1 ‫ ألهدف‬classify and process
What I want to do? the signals of the
‫ ماذا اريد أعمل؟‬human brain then
convert these signals
into actions.
Objective 2
O2. Implement the
2 ‫ الهدف‬project over several
What I want to do? disabled persons to
‫ ماذا اريد أعمل؟‬meet
desired
results.
Activities ‫ألفعاليات‬
‫ر‬
Results indicators ‫مؤشات النتائج‬
How I want to do?
How I will measure my results?
Risks and constraints ‫المخاطر و القيود‬
What are the problems I can face?
O1.A1.
Select
a
proper
neuroheadset and test it.
O1.A2 Using EmotivPro software to
get raw data.
O1.A3 Study these signals and
classify them according to the
brain’s limb.
O1. A4 Make signal conditioning
and a controller will take action
depending on these processed
signals.
Ind1. Take fully correct results
from BCIs programs as like
(moving eyes , smile , facial
recognition, etc)
1. The main thing we will facing is the
delaying of delivering time of the EEG
device , because we have to buy it online.
2. It’s difficult to find pure EEG signal and
analysis it .
O2.A1 Select a proper disabled
person.
O2.A2 Read his brain signals
O2.A3 By using the controller,
matching between the useful
signals and actions want to take
will be made.
Ind1. After processing the
signals , the user should have a
correct results and actions
during the tests.
Ind2. The disabled person
shouldn’t need a person beside
him to help him in his daily
actions (turn light , tv ,etc)
1. The training for using BCIs is not that
easy for persons who haven’t previous
knowledge in this side.
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
6
‫خطة تنفيذ ر‬
5.
Project implementation plan ‫المشوع‬
The whole implementation plan chart has annexed with the submitted proposal.
2019
22
December
21 20 19
18
17
November
16 15 14
13
October
12 11 10
9
8
September
7
6
5
4
August
3
2
1
Task - ‫ألمهمة‬
Stage one ( Planning )
Place Quations according Budget
Brainstorming from previous works in the
field of Mind Control
Writing Literature Review for the project
Aims and Objectives of the whole projects
Estimating time of items arrival
Test EMOTIV EPOC flex Channel Mobile EEG kit
Assessment and Analysing the results so far
Preparing for stage two by Installing
relevant software and practicing
Stage two ( EEG processing )
Studying how to acquire the signals with specifying
the sampling rates
Classifying EEG signals with one of AI techniques such
as neural network.
Reading about Fast Fourier transform (FFT)
Identifying the most convenient software platform
Intermediate Assessment
Stage three ( driving and Actuation devices )
Implementing the sampled signals to
drive Motors (Servos or Steppers)
Designing the controller for this project
Wiring Final control elements
Final report
Agreement from the donor
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
7
6.
‫موازنة ر‬
Project budget ‫ألمشوع‬
Balance $
‫الرصيد‬
$0.00
Spent total
Cost $ ‫اجمال‬
‫ي‬
‫الكلفة‬
‫المرصوفة‬
$0.00
Budget $
‫الموازنة‬
Duration
unit ‫وحدة المدة‬
# ‫المدة‬
Unit cost$
‫كلفة الوحدة‬
# unit
‫عدد‬
‫الوحدات‬
Unit
‫الوحدة‬
CATEGORY - ‫باب الرصف‬
Human Resources (Labor costs &
‫المصادر ر‬
services) -‫البشية (كلف العمال و‬
‫)الخدمات‬
Sub-total ‫المجموع الجزئ‬
Equipment - ‫المعدات‬
$0.00
$5,000.00
$0.00
$5,000.00
1
$1,100.00
$0.00
$1,100.00
1
$594.00
$0.00
$594.00
$150.00
$0.00
$150.00
1
$1,000.00
$7,844.00
$0.00
$0.00
$1,000.00
$7,844.00
1
$0.00
$0.00
$0.00
$0.00
$0.00
$0.00
$0.00
$0.00
$0.00
$0.00
$7,844.00
$0.00
$0.00
$0.00
$0.00
$0.00
$7,844.00
$0.00
$7,844
$0
$7,844
months
4%
6
Device2,500
2
‫جهاز‬
EPOC Flex Gel Sensor Kit
Controllers Full kit (Arduino mega +
Device- Node MCU + CanaKit Raspberry Pi 4
‫جهاز‬
Basic Kit + Relay board + wire jumper +
550
2
Bread board )
Software 99
1
‫ برنامج‬EmotivPRO LICENSE
4 Channels Wifi Smart Switch 4 Gang
Deviceon/off Wireless Control Smart Home
‫جهاز‬
75
2
10A/2200W
Device- High preformance Laptop to process
1000
1
‫جهاز‬
signals
Sub-total ‫المجموع الجزئ‬
‫ز‬
Supply - ‫التجهيات‬
Sub-total ‫المجموع الجزئ‬
Premises - ‫االيجارات‬
Sub-total ‫المجموع الجزئ‬
Travels /Transport - ‫النقل‬
Sub-total ‫المجموع الجزئ‬
Other cost - ‫تكاليف اخرى‬
Sub-total ‫المجموع الجزئ‬
GENERAL TOTAL - ‫الكل‬
‫المجموع ي‬
Administrative Costs 2% - ‫اجمال الكلفة‬
‫ من‬%2 ‫ رنيية‬-‫مصاريف ادارية‬
‫ي‬
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
Budget
code ‫الرمز‬
‫الحساب‬
‫ي‬
EF-1
EF-2
EF-2.1
EF-2.2
EF-2.3
EF-2.4
EF-2.5
EF-3
EF-4
EF-5
EF-6
ADM
GٌRANT TOTAL - ‫أالجمال العام‬
‫ي‬
8
References:
[1] https://yaqein.net/archives/191871
[2] http://aynaliraqnews.com/index.php?aa=news&id22=80149
[3] Lotte, Fabien, Chang S. Nam, and Anton Nijholt. "Introduction: Evolution of BrainComputer Interfaces." (2018).
[4] H. NISAR, H. KHOW and K. YEAP, "Brain-computer interface: controlling a robotic arm using
facial expressions", TURKISH JOURNAL OF ELECTRICAL ENGINEERING & COMPUTER SCIENCES,
vol. 26, no. 2, pp. 707-720, 2018. Available: 10.3906/elk-1606-296.
[5] Nisar H, Balasubramaniam HC, Malik AS. Brain computer interface for operating a robot.
In: Proceedings of the International Symposium on Computational Models for Life Sciences;
27{29 November 2013; Sydney, Australia: pp. 37-46.
[6] Lievesley R, Martin W, David E. The Emotiv EPOC neuro head set: an inexpensive method
of controlling assistive technologies using facial expressions and thoughts? J Assist Technol
2011; 5: 67-82.
[7] Badcock NA, Mousikou P, Mahajan Y, de Lissa P, Thie J, McArthur G. Validation of the
Emotiv EPOC EEG gaming system for measuring research quality auditory ERPs. Peer J 2013;
1: e38.
[8] Teplan M. Fundamentals of EEG measurement. Meas Sci Rev 2002; 2: 1-11.
[9] Jurcak V, Tsuzuki D, Dan I. 10/20, 10/10, and 10/5 systems revisited: their validity as
relative head-surface-based positioning systems. Neuroimage 2007; 34: 1600-1611.
A Smart Control System of Home Appliances Using (BCI)
Mosul contest-project framework
9