About the content
The world is full of uncertainty: accidents, storms, unruly financial markets, noisy communications. The world is also full of data. Probabilistic modeling and the related field of statistical inference are the keys to analyzing data and making scientifically sound predictions.
Probabilistic models use the language of mathematics. But instead of relying on the traditional "theorem-proof" format, we develop the material in an intuitive -- but still rigorous and mathematically-precise -- manner. Furthermore, while the applications are multiple and evident, we emphasize the basic concepts and methodologies that are universally applicable.
The course covers all of the basic probability concepts, including:
- multiple discrete or continuous random variables, expectations, and conditional distributions
- laws of large numbers
- the main tools of Bayesian inference methods
- an introduction to random processes (Poisson processes and Markov chains)
The contents of this courseare heavily based upon the corresponding MIT class -- Introduction to Probability -- a course that has been offered and continuously refined over more than 50 years. It is a challenging class but will enable you to apply the tools of probability theory to real-world applications or to your research.
This course is part of theMITx MicroMasters Program in Statistics and Data Science. Master the skills needed to be an informed and effective practitioner of data science. You will complete this course and three others from MITx, at a similar pace and level of rigor as an on-campus course at MIT, and then take a virtually-proctored exam to earn your MicroMasters, an academic credential that will demonstrate your proficiency in data science or accelerate your path towards an MIT PhD or a Master's at other universities. To learn more about this program, please visit https://micromasters.mit.edu/ds/.
- The basic structure and elements of probabilistic models
- Random variables, their distributions, means, and variances
- Probabilistic calculations
- Inference methods
- Laws of large numbers and their applications
- Random processes
College-level calculus (single-variable & multivariable). Comfort with mathematical reasoning; and familiarity with sequences, limits, infinite series, the chain rule, and ordinary or multiple integrals.
Unit 1: Probability models and axioms
- Probability models and axioms
- Mathematical background: Sets; sequences, limits, and series; (un)countable sets.
Unit 2: Conditioning and independence
- Conditioning and Bayes' rule
Unit 3: Counting
Unit 4: Discrete random variables
- Probability mass functions and expectations
- Variance; Conditioning on an event; Multiple random variables
- Conditioning on a random variable; Independence of random variables
Unit 5: Continuous random variables
- Probability density functions
- Conditioning on an event; Multiple random variables
- Conditioning on a random variable; Independence; Bayes' rule
Unit 6: Further topics on random variables
- Derived distributions
- Sums of independent random variables; Covariance and correlation
- Conditional expectation and variance revisited; Sum of a random number of independent random variables
Unit 7: Bayesian inference
- Introduction to Bayesian inference
- Linear models with normal noise
- Least mean squares (LMS) estimation
- Linear least mean squares (LLMS) estimation
Unit 8: Limit theorems and classical statistics
- Inequalities, convergence, and the Weak Law of Large Numbers
- The Central Limit Theorem (CLT)
- An introduction to classical statistics
Unit 9: Bernoulli and Poisson processes
- The Bernoulli process
- The Poisson process
- More on the Poisson process
Unit 10 (Optional): Markov chains
- Finite-state Markov chains
- Steady-state behavior of Markov chains
- Absorption probabilities and expected time to absorption
Professor, Department of Electrical Engineering and Computer Science
Professor, Electrical Engineering and Computer Science
Professor, Electrical Engineering and Computer Science
Lecturer and Research Scientist
Massachusetts Institute of Technology
MIT is a world-class educational institution where teaching and research — with relevance to the practical world as a guiding principle — continue to be its primary purpose.
MIT is independent, coeducational, and privately endowed. Its five schools and one college encompass numerous academic departments, divisions and degree-granting programs, as well as interdisciplinary centers, laboratories and programs whose work cuts across traditional departmental boundaries.
Harvard University, the Massachusetts Institute of Technology, and the University of California, Berkeley, are just some of the schools that you have at your fingertips with EdX. Through massive open online courses (MOOCs) from the world's best universities, you can develop your knowledge in literature, math, history, food and nutrition, and more. These online classes are taught by highly-regarded experts in the field. If you take a class on computer science through Harvard, you may be taught by David J. Malan, a senior lecturer on computer science at Harvard University for the School of Engineering and Applied Sciences. But there's not just one professor - you have access to the entire teaching staff, allowing you to receive feedback on assignments straight from the experts. Pursue a Verified Certificate to document your achievements and use your coursework for job and school applications, promotions, and more. EdX also works with top universities to conduct research, allowing them to learn more about learning. Using their findings, edX is able to provide students with the best and most effective courses, constantly enhancing the student experience.