ML.NET Improves Object Detection

Microsoft improved the object detection capabilities of its ML.NET machine learning framework for .NET developers, adding the ability to train custom models with Model Builder in Visual Studio.

ML.NET is an open source, cross-platform machine learning framework, working on Windows, Linux and macOS. It works with other Microsoft ML components and offerings including:

  • Model Builder: a visual interface used to build, train and deploy custom ML models in Visual Studio without the need for deep ML expertise.
    Model Builder in Animated Action in Visual Studio
    [Click on image for larger, animated GIF view.] Model Builder in Animated Action in Visual Studio (source: Microsoft).
  • ML.NET CLI: a cross-platform command-line interface.
  • AutoML: a generic term ("the process of automating the time consuming, iterative tasks of ML model development") with a specific implementation coming from Microsoft Research, which designs "probabilistic ML models to guide (automated) experimental decisions and meta-learning to reduce the sample complexity and transfer knowledge across related datasets or problems." It comes with Azure Machine Learning, a cloud service to build and deploy ML models faster.

In the monthly September update to ML.NET -- bringing it to v1.5.2 -- Microsoft introduced:

  • The ability to train custom object detection models via Model Builder, leveraging Azure and AutoML
  • The ability to locally train image classification models with the ML.NET CLI

"While previously ML.NET offered the ability to consume pre-trained TensorFlow and ONNX models for object detection via the ML.NET API, you can now use Model Builder in Visual Studio to train custom object detection models with the power of Azure and AutoML," said Bri Achtman, program manager, .NET, in a Sept. 25 blog post.

Object detection is a useful adjunct improvement to image classification as it can, for example, identify a person and a dog in the same image, rather than just classify an image of a dog as a dog, as illustrated here:

Image Classification/Object Detection
[Click on image for larger view.] Image Classification/Object Detection (source: Microsoft).

Use cases for object detection include:

  • Self-driving cars
  • Robotics
  • Face detection
  • Workplace safety
  • Object counting
  • Activity recognition

The new ability to locally train custom image classification models via the ML.NET CLI, meanwhile, adds to the tool's previous abilities including classification, regression and recommendation.

Achtman goes into detail about using the new functionality in her post and much more information about the v1.5.2 update can be found in the release notes.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus


  • New Visual Studio Razor Editor 'Close to Being Ready' for Blazor and Other Projects

    The experimental Razor editor for Visual Studio introduced last summer has been updated and is "close to being ready for normal daily development."

  • Microsoft Updates 'Must Have' Xamarin Community Toolkit

    The Xamarin Community Toolkit provides all kinds of effects, views and helpers to complement mobile app development with Microsoft's recently released, open source, cross-platform Xamarin.Forms 5.

  • JetBrains Unveils Plans for WinForms, WPF and More in Rider .NET IDE

    JetBrains announced plans for Windows Forms, Windows Presentation Foundation (WPF), ASP.NET and more tooling in the next release of its popular Rider IDE for .NET development.

  • Multi-Class Classification Using PyTorch: Model Accuracy

    Dr. James McCaffrey of Microsoft Research continues his four-part series on multi-class classification, designed to predict a value that can be one of three or more possible discrete values, by explaining model accuracy.

Upcoming Events