MATH4240 - Stochastic Processes - 2019/20

Course Name: 
Course Year: 


  • Jan 3: Welcome to this course! No tutorial in the 1st week. Here is the tentative course schedule: [Download file]
  • Tentative course schedule (Updated on 27 April) [Download file]
  • Adjusted Assessment Scheme (updated on April 27th) [Download file]
  • Apr 15: Tips for Take-home Midterm Test: [Download file]
  • Apr 27: Tips for Take-home Final Exam: [Download file]
  • May 4: Statement on Academic Honesty [Download file]

General Information


  • Prof. Renjun DUAN
    • Office: LSB 206
    • Tel: 3943 7977
    • Email:
    • Office Hours: 9:00am-12:00noon each Wednesday

Teaching Assistant

  • Mr. Tak Ming CHEUK
    • Office: LSB 228
    • Tel: 3943 7955
    • Email:
    • Office Hours: 10:00am-12:00noon each Thursday

Time and Venue

  • Lecture: Mo 1:30PM - 2:15PM, Lady Shaw Bldg C2; We 4:30PM - 6:15PM, Lady Shaw Bldg C1
  • Tutorial: Mo 12:30PM - 1:15PM, Lady Shaw Bldg C2

Course Description

Bernoulli processes and sum of independent random variables, Poisson processes, times of arrivals, Markov chains, transient and recurrent states, stationary distribution of Markov chains, Markov pure jump processes, and birth and death processes. Students taking this course are expected to have knowledge in probability.


  • Introduction to Stochastic Processes by Hoel, Port and Stone (Chapter 1, Chapter 2, and Chapter 3 ONLY)


  • Essentials of Stochastic Processes by Durrett (many applied examples)
  • Introduction to Stochastic Processes by Lawler (condense)
  • Basic Stochastic Processes by Brzezniak and Zastawniak (more theoretical)
  • Denumerable Markov chains by Wolfgang Woess (more topics on Markov chains)
  • Stochastic Processes by Sheldon Ross (more advanced)

Pre-class Notes

Lecture Notes

Tutorial Notes


Quizzes and Exams


Useful Links

Honesty in Academic Work

The Chinese University of Hong Kong places very high importance on honesty in academic work submitted by students, and adopts a policy of zero tolerance on cheating and plagiarism. Any related offence will lead to disciplinary action including termination of studies at the University. Although cases of cheating or plagiarism are rare at the University, everyone should make himself / herself familiar with the content of the following website:

and thereby help avoid any practice that would not be acceptable.

Assessment Policy

Last updated: May 08, 2020 16:02:41