Lecture Details :
Stochastic Processes by Dr. S. Dharmaraja, Department of Mathematics, IIT Delhi. For more details on NPTEL visit http://nptel.iitm.ac.in
Course Description :
Probability Theory Refresher: Axiomatic construction of probability spaces, random variables and vectors, probability distributions, functions of random variables; mathematical expectations, transforms and generating functions, modes of convergence of sequences of random variables, laws of large numbers, central limit theorem.
Introduction to Stochastic Processes (SPs): Definition and examples of SPs, classification of random processes according to state space and parameter space, types of SPs, elementary problems.
Discrete-time Markov Chains (MCs): Definition and examples of MCs, transition probability matrix, Chapman-Kolmogorov equations; calculation of n-step transition probabilities, limiting probabilities, classification of states, ergodicity, stationary distribution, transient MC; random walk and gamblerís ruin problem, applications.
Continuous-time Markov Chains (MCs): Kolmogorov- Feller differential equations, infinitesimal generator, Poisson process, birth-death process, Applications to queueing theory, inventory analysis, communication networks, finance and biology.
Brownian Motion: Wiener process as a limit of random walk; first -passage time and other problems, applications to finance.
Branching Processes: Definition and examples branching processes, probability generating function, mean and variance, Galton-Watson branching process, probability of extinction.
Renewal Processes: Renewal function and its properties, elementary and key renewal theorems, cost/rewards associated with renewals, Markov renewal and regenerative processes, applications.
Stationary Processes: Weakly stationary and strongly stationary processes, moving average and auto regressive processes.
Martingales: Conditional expectations, definition and examples of martingales, inequality, convergence and smoothing properties, applications in finance.
Get Your Degree!
Find schools and get information on the program that’s right for you.
Powered by Campus Explorer
Other Resources :
Other Mathematics Courses
- Algebra I Worked Examples by Khan Academy
- Statistical Inference by IIT Kharagpur
- Numerical Methods and Computation by IIT Delhi
- Singapore Math by Khan Academy
- Numerical Analysis and Computer Programming by IIT Madras
- Analytic Geometry and Calculus II,Fall 2011 by UC Berkeley
- Partial differential equations by Other
- Analytic Geometry and Calculus,Fall 2011 by UC Berkeley
- Linear Algebra by MIT
- Arithmetic by Khan Academy
» check out the complete list of Mathematics Video lectures