Sensor Fusion Engineer

BY
Udacity

Become proficient in key Sensor Fusion concepts such as fusing Lidar point clouds, signatures from radars, and track vehicles using Kalman filters.

Lavel

Expert

Mode

Online

Duration

63 Hours

Quick Facts

particular details
Collaborators Mercedes Benz
Medium of instructions English
Mode of learning Self study, Virtual Classroom
Mode of Delivery Video and Text Based

Course overview

The supply of professionals with advanced sensor fusion skills has remained behind the demand expressed by the industry. Hence, an investment in this Nanodegree program will set you up in the league of candidates that are in short supply, and therefore very likely to find economically and professionally rewarding packages in the global value chain.

This program revolves around 4 uniquely curated, industrial robotics projects that test the most relevant problem statements of this industry. Thus, once you brainstorm through these wholesome, exciting, and complex scenarios, you would come out on the other side having answered a lot of the questions prospective recruiting companies look for, in their candidates.

Typically, studying for 10 hours a week, a student is able to graduate from this program in 4 months. For those who have limited background in one of the prerequisites, candidates should consider the Intro to Self-driving Cars Nanodegree program. This will help them in laying foundation so that you can enroll for this program thereafter.

The highlights

  • 4 months program
  • 10 hours per week
  • Personalized feedback
  • Nanodegree program
  • Job offers negotiation
  • Dedicated technical support
  • Job search assistance
  • Real-life projects

Program offerings

  • Personal career coach
  • Technical mentor support
  • Real-world projects
  • Student community
  • Flexible learning curriculum
  • Interview preparation assistance
  • Linkedin profile review
  • Expert project feedback.

Course and certificate fees

The fees for the course Sensor Fusion Engineer is -

Fees componentsAmount
All Access monthly
Rs. 20,500 /month
All Access bundle
Rs. 17,425 /month
Sensor Fusion
Rs. 78,131 /one-time payment


certificate availability

Yes

certificate providing authority

Udacity

Who it is for

The Sensor Fusion Engineer Nanodegree program is apt for professionals aspiring to learn about radar, lidar, and camera data, to subsequently fuse it together for real-world application. Professionals with the following capabilities are likely to gain the most from this course:

  • Practical coding experience of an Object Oriented Programming language such as Python
  • High-school probability applications
  • Linux command lines
  • Expertise in Linear Algebra
  • Comfortable with Calculus

Eligibility criteria

Work experience

The program needs no work experience, and is thus open for all.

Education

For the best learning experience, it is advisable to have working knowledge of C++ or an equivalent programming language based on the principles of an Object Oriented setup. Additionally, it would be very desirable to have the basics of probabilities, calculus, and linear algebra to be in place.

Certification qualifying details

The program requires the students to clear the projects associated with all the 4 modules to be duly cleared in order to graduate. Whenever a submission is made, it will be evaluated by the designated faculty and relevant feedback be provided. The submissions not clearing in the first attempt will need to be re-attempted till they match the minimum standards.

What you will learn

Knowledge of engineering

Upon graduating from the Sensor Fusion Engineer Nanodegree program, the participants will learn these concepts:

  • Design intelligent systems to detect vehicles on the road with the use of segmentation, filtering, and clustering of raw lidar data.
  • Application of Euclidean clustering to differentiate between vehicles and obstacles.
  • Get equipped with radar signatures which will help in calculating velocity and orientation by taking into account radial velocity distortions.
  • Become proficient in the in the nuances associated with thresholds to ascertain and subsequently eliminate false positive.
  • Recognize lidar point cloud data to extract information from camera images to accurately arrive at the object’s motion and direction of travel.
  • Utilize 3-D image projection techniques in collaboration with lidar data to setup a motion model.
  • Gain a deep understanding of data fusion from multiple sources with the assistance of Kalman filters.
  • Expedite the implementation of the feedback loop which will enable a dynamically updated version of Kalman filters. Moreover, unscented Kalman filters can then be built.

The syllabus

Course 2: Lidar Obstacle Detection

Introduction of Lidar & Point Clouds
  • Learn about lidar and point clouds. Use a simulation highway environment to explore lidar sensing and generate point clouds.
Point Cloud Segmentation
  • In this lesson, you will be using Ransac with a plane model to segment point cloud data and separate it into points that are part of the road and points that are not.
Clustering Obstacles
  • Perform Euclidean clustering, and learn how to build KD-Trees to use them to do efficient nearest neighbor search for clustering.
Working with Real Point Cloud Data
  • Take what you have learned in the previous lessons and apply it to real pcd being played back in a video.

Course 4: Radar

Introduction to Radar

 

Radar Principles
  • Review Radar functionality, FMCW waveform, Radar Hardware, Schematic and the Radar Equation
Range-Doppler Estimation
  • Estimate the range and velocity of the target using the FMCW radar
Clutter, CFAR, AoA, and Clustering
  • Discuss - Clutter formation and then its removal using CFAR technique. After that

Course 3: Camera

Introduction
  • Introduction to the instructor, and the guest Timo Rehfeld, Mercedes-Benz R&D North America, and the course overview.
Autonomous Vehicles and Computer Vision
  • Learn about the various levels of autonomy, some typical sensor sets, basics of camera technology, and an introduction into the OpenCV computer vision library.
Engineering a Collision Detection System
  • Learn the collision detection basics, and estimating the TTC with Lidar and Camera.
Tracking Image Features
  • Learn about the intensity gradient and filtering techniques; extract corners, infer features of an image, and track an object across multiple images.
Combining Camera and Lidar
  • Learn to improve the tracking process results by combining the Camera and Lidar output
Final Thoughts from Timo
  • Merge data from multiple sources
  • Construct Kalman filters
  • Improve tracking accuracy
  • Reduce sensor noise

Course 5: Kalman Filters

Introduction and Sensors
  • Meet the team at Mercedes who will help you track objects in real-time with Sensor Fusion.
Kalman Filters
  • Learn from the best! Sebastian Thrun will walk you through the usage and concepts of a Kalman Filter using Python.
Lidar and Radar Fusion with Kalman Filters in C++
  • In this lesson, you'll build a Kalman Filter in C++ that's capable of handling data from multiple sources. Why C++? Its performance enables the application of object tracking with a Kalman Filter in real-time.
Unscented Kalman Filters
  • While Extended Kalman Filters work great for linear motion, real objects rarely move linearly. With Unscented Kalman Filters, you'll be able to accurately track non-linear motion!
Geometry and Trigonometry Refresher
  • This optional content is designed to refresh your knowledge of trigonometry and geometry.  

Course 1: Welcome

Introduction to Sensor Fusion
Getting Help
  • You are starting a challenging but rewarding journey! Take 5 minutes to read how to get help with projects and content.

Course 6: Appendix Optional

Kalman Filter in MATLAB

Admission details

The enrolment steps for the Sensor Fusion Engineer Nanodegree program are:

Enrolment

This Nanodegree program comes with a free trial that can be availed by all users. You can access this from the course page by signing in with your Google or Facebook account. For others, please proceed with signing up with a new account.

Payment

The standard accessibility of 4 months comes in-built with the tuition fee of $1356 USD. Moreover, it will be charged to your preferred banking route only after the first 7 days of the free trial. Moving on, if the candidate hasn’t cleared all the requisite papers within the 4-month period, the cost for each subsequent is $399 USD. This will be applicable till the student clears all the projects to the standards deemed fit.

LMS

The LMS access is the last step in the chain of events. This is made available within a few minutes of the receipt of payment by us.

Scholarship Details

As of now, there is no provision for a scholarship. However, depending on if you pay upfront or as you go, the total price will incur a discount of 15%.

Evaluation process

The Nanodegree is offered when all assignments at the end of each module are cleared by the students. This leads to the access to the next module.

How it helps

The founding stones of the program are designed based on thorough primary market research. The elements being offered and their depth has been taken from the most employable skills that have demand in today’s job market.

Real world projects are ingrained very well into the Robotics Software Engineer Nanodegree Program. All the 4 modules have been curated by industry experts to give participants confidence for having immersed in it.

Instructors

Mr David Silver

Mr David Silver
Lead
Udacity

Other Bachelors, MBA

Mr Stephen Welch
Instructor
Udacity

Ph.D

Mr Andreas Haja

Mr Andreas Haja
Professor
Freelancer

Ph.D

Mr Abdullah Zaidi
Instructor
UMD

M.S

Mr Aaron Brown

Mr Aaron Brown
Instructor
Freelancer

FAQs

Who are the course faculty?

Following is the course faculty:

  • Dr. Stephan Welch (Instructor, PhD in Mathematics)
  • Dr. Andreas Haja (Instructor, ex Volkswagen and Bosch)
  • Mr. Abdullah Zaidi (Instructor, M.S. – University of Maryland)
  • Mr. David Silver (Curriculum Lead, ex Ford, MBA Stanford)

Is there an acceptance criteria for this program?

No, the objectives of the program have been laid out. Please evaluate if those match with your professional goals and proceed to enroll.

When does the course commence?

The approach to the Learning Management System is made available on receipt of the payment towards the course fee. Thus, the course commencement depends on the candidate.

How long has this course been designed to run?

Over the 4-month access, it is envisaged that the students should be able to graduate from this Nanodegree program. Should there be a need to extend, the same can be done by paying a monthly fee.

Are there any support functions provided for the Robotics Software Engineer program?

Absolutely, a department of technical experts will be assigned to your batch for any and all product support that may be sought from you. Their contact mechanism will be explained after on-boarding is completed.

Is there placement assistance provided as part of this program?

Measures are in place to widen the professional network for our students through strategic networking events from global leaders. Moreover, in-depth interview preparation in-person as well telephonically will be made available.

What kinds of jobs are seen after the completion of this program?

Following are some common job profiles: Sensor Fusion Engineer, Automated Vehicle Engineer, Self-driving car engineer, System integration engineer, Perception engineer, Imaging engineer, and Object tracking engineer.

Is there a provision for a demo/preview session for this course?

Yes, the course preview can be accessed from the homepage of the Nanodegree program.

What software do I need?

As the coding will be done on our virtual machines through the browsers, you wouldn’t need to install anything on your own computer. However, if you would like to complete projects on your machine, please install C++ version 11 and Point Cloud Library 1.7. Guidance will be given on how and where to get these from.

Courses of your Interest

Electroceramics

Electroceramics

IIT Kanpur via NPTEL

Online
Expert
Free

Multi Object Tracking for Automotive Systems

Chalmers University of Technology, Go... via Edx

10 Weeks Online
Expert
Free

Sensor Fusion and Non linear Filtering for Automot...

Chalmers University of Technology, Go... via Edx

9 Weeks Online
Expert
Free
Introduction to Quantum Transport

Introduction to Quantum Transport

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free
Fundamentals of Building Information Modeling

Fundamentals of Building Information Modeling

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free
Stability and Design of Structural Frames

Stability and Design of Structural Frames

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free
Analysis and Design of Water Distribution Systems

Analysis and Design of Water Distribution Systems

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free
Stability and Design of Structural Members

Stability and Design of Structural Members

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free
Nanophotonic Modeling

Nanophotonic Modeling

Purdue University, West Lafayette via Edx

5 Weeks Online
Expert
Free

More Courses by Udacity

Introduction to Data Science

Udacity

1 Week Online
Expert
₹ 82,000

Machine Learning Devops Engineer

Udacity

63 Hours Online
Expert

Ethical Hacker

Udacity

37 Months Online
Expert

Data Architect

Udacity

73 Hours Online
Expert
Artificial Intelligence

Artificial Intelligence

Udacity

40 Hours Online
Expert
Deep Reinforcement Learning

Deep Reinforcement Learning

Udacity

4 Months Online
Expert
Data Streaming

Data Streaming

Udacity

2 Months Online
Expert
Natural Language Processing

Natural Language Processing

Udacity

3 Months Online
Expert
₹ 20,500
Computer Vision Expert

Computer Vision Expert

Udacity

3 Months Online
Expert
Flying Car and Autonomous Flight Engineer

Flying Car and Autonomous Flight Engineer

Udacity

86 Hours Online
Expert

Trending Courses

Popular Courses

Popular Platforms

Learn more about the Courses