EE800 Stochastic Systems

Welcome and Introduction

Dr. Hassan Aqeel Khan

School of Electrical Engineering & Computer Science (SEECS)
National University of Sciences & Technology (NUST)

Copyright Syed Ali Khayam 2009

Course Information
Lecture Timings:
Tuesday: 5:00pm-5:50pm, SEECS CR# 02
Thursday: 6:00pm-7:50pm, SEECS CR# 02

My Office:
Room # A-311

Office Hours
Tuesday, 4:00-4:30pm, or by appointment.
hassan.aqeel@seecs.edu.pk

The course will be managed through LMS and facebook

NUST LMS: www.lms.nust.edu.pk
Facebook group: TBA
2

Timetable - MS EE-8 (DSSP & Power and Control)

Textbooks

Probability & Random Processes

for Electrical Engineers, 2nd or 3rd
ed.

Albert Leon-Garcia

Introduction to Probability Models,

9th ed.

Sheldon M. Ross

Elements of Information Theory

Thomas M. Cover and Joy

A. Thomas

Course Outline
Syllabus
Introduction to Probability Theory
Random Variables
Limits and Inequalities
Central Limit Theorem
Application Area: Information Theory
Stochastic Processes
Prediction and Estimation
Markov Chain (time permitting)

Grading

(subject to change)

Final Exam:
Midterm Exam:
Quizzes:
Homework Assignments:

50%
30%
10%
10%

Policies
Quizzes will be unannounced
Late homework submissions will be accepted for up to 24 hours
with a 50% penalty of the total.
I will take strong disciplinary action in cases of plagiarism or
cheating in exams, homework or quizzes. There are no second
chances if plagiarism is proven.
Attendance:
Will be taken at any time during class.
The current rules of the school will be followed (min. 75%
attendance requirement).

NOVEL APPLICATIONS

APPLICATION AREAS
Archeology
Control Systems
Biology

Archeology

10

Indus Valley Script

Image courtesy: [1]

11

Control Systems

12

13

Kalman Filtering (Guidance & Control)

Images courtesy: [2]

14

Biology

15

Dr. Evils bucket-list

1. Engineer Super-Humans.!!

2. Predict when and how they will fail

Images courtesy: Google

16

Introduction
Engineered biological nano-machines must be able to
communicate with biological systems.
The biological communication channel is significantly
different from the conventional communication channel.
Potential applications: Early disease detection, biological
tissue regeneration, interfacing artificial devices.

17

Introduction
Example of a natural nano-bio-communication system:
Cellular communication network (The biological one)
Threat
Detected

Detected by
Macrophages

Intruders
(Virus)

Body cell
Images courtesy: Google

Gottcha.!

Macrophage

Antibodies

Macrophages
activate
Helper-T cells

Helper
T-cells

B-Cells
Plasma Cells

Cytotoxic
18
T-cells

Applications[1]

Biomedical
Smart-Drug design &
delivery
Health monitoring
Lab-on-Chip
Regenerative Medicine
Environmental
Environmental
monitoring
Waste and Pollution
control
Industrial
Precise structure design
Structural health
monitoring
19

Background

Most of the material in the background section is based on the national institutes of healths (NIH) Genetics
home reference available online at: http://ghr.nlm.nih.gov/handbook
Other Useful references include:
Another very useful reference is available at: http://www.diffen.com/difference/DNA_vs_RNA

20

Background
DNA (DeoxyriboNucleic Acid)
Hereditary material in the vast
majority of living organisms.
Contains information in the form of a
code.
Code constructed from four chemical
bases: adenine (A), guanine (G),
cytosine (C), and thymine (T).

Adenine (A)

Cytosine (C)

Thymine (T)

Guanine (G)

Chromosomes

Nucleus
DNA

Images courtesy: [1]

Cell

21

Background
The Central Dogma of Molecular Biology
DNA

Gene

Book of Life

Chapter-1

Transcription

Transcription
mRNA

Translation
Protein

Translation

22

Architecture of a MolecularCommunication System[8]

Encode
Transmit
Receive
Decode
So whats the big deal ?

Message
received
Transmitting
Nano-Machine

All of this must be

accomplished via the
interaction of biological (or
synthetic) molecules or
chemical interactions.

Legend
Information Molecule

Receiving
Nano-Machine

Transport Molecule
Interface Molecule
23

Architecture of a MolecularCommunication System[8]

Information Molecule:

Could be DNA, RNA, protein etc

Transport Molecule:

Could be a protein, or bacteria

Interface Molecule:

Could be a protein, or DNA strand

24

References
1.
2.

Rao, Rajesh PN, et al. "Entropy, the Indus script, and language: A reply to
R. Sproat." Computational Linguistics 36.4 (2010): 795-805.
How a Kalman filter works, in pictures URL:
http://www.bzarg.com/p/how-a-kalman-filter-works-in-pictures/

25