Robotics: Vision Intelligence and Machine Learning
list 12个序列
assignment 等级:高级
chat_bubble_outline 语言:英语
card_giftcard 1,344分


credit_card 免费进入
verified_user 收费证书
timer 96小时总数


How do robots “see”, respond to and learn from their interactions with the world around them? This is the fascinating field of visual intelligence and machine learning. Visual intelligence allows a robot to “sense” and “recognize” the surrounding environment. It also enables a robot to “learn” from the memory of past experiences by extracting patterns in visual signals.

You will understand how Machine Learning extracts statistically meaningful patterns in data that support classification, regression and clustering. Then by studying Computer Vision and Machine Learning together you will be able to build recognition algorithms that can learn from data and adapt to new environments.

By the end of this course, part of the Robotics MicroMasters program, you will be able to program vision capabilities for a robot such as robot localization as well as object recognition using machine learning.

Projects in this course will utilize MATLAB and OpenCV and will include real examples of video stabilization, recognition of 3D objects, coding a classifier for objects, building a perceptron, and designing a convolutional neural network (CNN) using one of the standard CNN frameworks.

  • The fundamentals of image filtering and tracking, and how to apply those principles to face detection, mosaicking and stabilization
  • How to use geometric transformations to determine 3D poses from 2D images for augmented reality tasks and visual odometry for robot localization
  • How to recognize objects and the basics of visual learning and neural networks for the purpose of classification

more_horiz 查看更多
more_horiz 收起


  • College-level introductory linear algebra (vector spaces, linear systems, matrix decomposition)
  • College-level introductory calculus (partial derivatives, function gradients)
  • Basic knowledge of computer programming (variables, functions, control flow) is preferred, but students may also choose to learn it on their own. The class projects will be carried out MATLAB/Python, with C++ as an option.



Week 1: Camera Geometry and Color Sensing

Week 2: Fourier Transforms, Image Convolution, Edge Detection
Week 3: Image Convolution and Edge Detection Part 2, Image Pyramids
Week 4: Feature Detection: Filters, SIFT, HOG
Week 5: Geometrical Transformation, Affine, Protective and Ransac
Week 6: Optical Flow Estimation
Week 7: Image Morphing
Week 8: Image Blending
Week 9: Image Carving
Week 10: Probability and Statistics, Regression and Classification
Week 11: SVM and Object Recognition
Week 12: Convolutional Neural Network



Jianbo Shi
Professor, Computer and Information Science, School of Engineering and Applied Science
University of Pennsylvania

Kostas Daniilidis
Professor, Computer and Information Science, School of Engineering and Applied Science
University of Pennsylvania

Dan Lee
Professor, Computer and Information Science and Electrical and Systems Engineering, School of Engineering and Applied Science
University of Pennsylvania



University of Pennsylvania
The University of Pennsylvania (commonly referred to as Penn) is a private university, located in Philadelphia, Pennsylvania, United States. A member of the Ivy League, Penn is the fourth-oldest institution of higher education in the United States, and considers itself to be the first university in the United States with both undergraduate and graduate studies.



EdX est une plateforme d'apprentissage en ligne (dite FLOT ou MOOC). Elle héberge et met gratuitement à disposition des cours en ligne de niveau universitaire à travers le monde entier. Elle mène également des recherches sur l'apprentissage en ligne et la façon dont les utilisateurs utilisent celle-ci. Elle est à but non lucratif et la plateforme utilise un logiciel open source.

EdX a été fondée par le Massachusetts Institute of Technology et par l'université Harvard en mai 2012. En 2014, environ 50 écoles, associations et organisations internationales offrent ou projettent d'offrir des cours sur EdX. En juillet 2014, elle avait plus de 2,5 millions d'utilisateurs suivant plus de 200 cours en ligne.

Les deux universités américaines qui financent la plateforme ont investi 60 millions USD dans son développement. La plateforme France Université Numérique utilise la technologie openedX, supportée par Google.

您是 MOOC 的设计者?