Stochastic Processes

IIT Delhi Course , Prof. S. Dharmaraja

338 students enrolled

Overview

Probability Theory Refresher: Axiomatic construction of probability spaces, random variables and vectors, probability distributions, functions of random variables; mathematical expectations, transforms and generating functions, modes of convergence of sequences of random variables, laws of large numbers, central limit theorem;Introduction to Stochastic Processes (SPs): Definition and examples of SPs, classification of random processes according to state space and parameter space, types of SPs, elementary problems;Stationary Processes: Weakly stationary and strongly stationary processes, moving average and auto regressive processes;Discrete-time Markov Chains (DTMCs): Definition and examples of MCs, transition probability matrix, Chapman-Kolmogorov equations; calculation of n-step transition probabilities, limiting probabilities, classification of states, ergodicity, stationary distribution, transient MC; random walk and gamblers ruin problem, applications;Continuous-time Markov Chains (CTMCs): Kolmogorov- Feller differential equations, infinitesimal generator, Poisson process, birth-death process, stochastic Petri net, applications to queueing theory and communication networks;Martingales: Conditional expectations, definition and examples of martingales.

Brownian Motion: Wiener process as a limit of random walk; process derived from Brownian motion, stochastic differential equation, stochastic integral equation, Ito formula, Some important SDEs and their solutions, applications to finance;Renewal Processes: Renewal function and its properties, renewal theorems, cost/rewards associated with renewals, Markov renewal and regenerative processes, non Markovian queues, applications of Markov regenerative processes;Branching Processes: Definition and examples branching processes, probability generating function, mean and variance, Galton-Watson branching process, probability of extinction

Lecture 32: Renewal Function and Renewal Equation

Up Next
You can skip ad in
SKIP AD >
Advertisement
      • 2x
      • 1.5x
      • 1x
      • 0.5x
      • 0.25x
        EMBED LINK
        COPY
        DIRECT LINK
        PRIVATE CONTENT
        OK
        Enter password to view
        Please enter valid password!
        0:00
        3.0 (1 Ratings)

        Lecture Details

        Stochastic Processes by Dr. S. Dharmaraja, Department of Mathematics, IIT Delhi. For more details on NPTEL visit httpnptel.iitm.ac.in

        LECTURES



        Review


        3.0

        1 Rates
        3
        100%
        1

        Comments Added Successfully!
        Please Enter Comments
        Please Enter CAPTCHA
        Invalid CAPTCHA
        Please Login and Submit Your Comment

        LECTURES