ML.NET Improves Object Detection

Microsoft improved the object detection capabilities of its ML.NET machine learning framework for .NET developers, adding the ability to train custom models with Model Builder in Visual Studio.

ML.NET is an open source, cross-platform machine learning framework, working on Windows, Linux and macOS. It works with other Microsoft ML components and offerings including:

  • Model Builder: a visual interface used to build, train and deploy custom ML models in Visual Studio without the need for deep ML expertise.
    Model Builder in Animated Action in Visual Studio
    [Click on image for larger, animated GIF view.] Model Builder in Animated Action in Visual Studio (source: Microsoft).
  • ML.NET CLI: a cross-platform command-line interface.
  • AutoML: a generic term ("the process of automating the time consuming, iterative tasks of ML model development") with a specific implementation coming from Microsoft Research, which designs "probabilistic ML models to guide (automated) experimental decisions and meta-learning to reduce the sample complexity and transfer knowledge across related datasets or problems." It comes with Azure Machine Learning, a cloud service to build and deploy ML models faster.

In the monthly September update to ML.NET -- bringing it to v1.5.2 -- Microsoft introduced:

  • The ability to train custom object detection models via Model Builder, leveraging Azure and AutoML
  • The ability to locally train image classification models with the ML.NET CLI

"While previously ML.NET offered the ability to consume pre-trained TensorFlow and ONNX models for object detection via the ML.NET API, you can now use Model Builder in Visual Studio to train custom object detection models with the power of Azure and AutoML," said Bri Achtman, program manager, .NET, in a Sept. 25 blog post.

Object detection is a useful adjunct improvement to image classification as it can, for example, identify a person and a dog in the same image, rather than just classify an image of a dog as a dog, as illustrated here:

Image Classification/Object Detection
[Click on image for larger view.] Image Classification/Object Detection (source: Microsoft).

Use cases for object detection include:

  • Self-driving cars
  • Robotics
  • Face detection
  • Workplace safety
  • Object counting
  • Activity recognition

The new ability to locally train custom image classification models via the ML.NET CLI, meanwhile, adds to the tool's previous abilities including classification, regression and recommendation.

Achtman goes into detail about using the new functionality in her post and much more information about the v1.5.2 update can be found in the release notes.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus


  • C# Slides in Usage Ranking of Programming Languages

    "The fact that C# lost three places in the ranking of language communities during the last three years is mostly explained by its slower growth compared to C/C++ and PHP."

  • Telerik UI for Blazor Updated

    Progress announced an update to its Telerik UI for Blazor components, targeting Microsoft's open source Blazor framework that lets C# coders create web apps without having to rely upon JavaScript.

  • Infragistics Unveils UI Components for Blazor

    Infragistics, specializing in third-party UI/UX controls and tools, unveiled a new offering targeting Blazor, Microsoft's red-hot open source framework that allows for C#-based web development instead of traditional mainstay JavaScript.

  • AWS Open Sources Tool for Porting .NET Framework Apps to .NET Core

    Leading cloud computing platform Amazon Web Services open sourced the it announced in July for helping users port old .NET Framework applications to the new .NET Core framework.

  • Uno Platform Ports Windows Calculator to Linux

    Uno Platform has ported the famed Windows Calculator, open sourced last year, to Linux as part of a continuing "proof point" effort to demonstrate the reach of what it describes as the sole UI offering available to target Windows, WebAssembly, iOS, macOS, Android and Linux with single-codebase applications coded in C# and XAML.

Upcoming Events