AI Gets Smarter with Microsoft's Cognitive Toolkit 2.0

Microsoft's second release of its open source deep learning framework earlier this month adds support for Java bindings, Spark, and Keras.

Artificial intelligence just got smarter with the 2.0 release earlier this month of the Microsoft Cognitive Toolkit. This version adds support for Java Bindings, Spark, and Keras.

AI sounds like we might be talking about the future of computing -- but there's important work being done with it now. As an example, Microsoft researchers worked with a team of digital crime investigators with the Federal Trade Commission to thwart malware scammers, and key was the use the Cognitive Toolkit.

A typical scam being run currently is a pop-up ad that warns computer users of a virus on their computers, which in turn tells them to call or contact a company to help get rid of the virus. It's not just one company working these scams, but hundreds, and locating them is tricky, since those companies would often continue relocating their digital footprints. To track them down, the researchers and investigators used a mix of tools: the computer vision API from the Toolkit to scan and gather information at faster than human speed to eventually pinpoint the origin of the scams; Power BI to gather and slice the data into something meaningful; Azure to host and run the apps.

(The full story of the discovery, capture, and prosecution covers quite a few other Microsoft technologies; you can read the whole story on The Official Microsoft Blog here.)

With the Cognitive Toolkit at 2.0, there are a few more new features:

  • Support for Java Bindings, Spark: Besides evaluating models in Python, BrainScript, or C#, Cognitive Toolkit models can now be evaluated with a new Java API, which means it can now be integrated into Java-based deep learning models and can be used on the Spark platform.
  • Model Compression: The Toolkit now includes "extensions that allow quantized implementations of several FP operations, which are several times faster compared to full precision counterparts," which makes evaluating models on lower-powered computing devices such as smartphones much more accurate.
  • Keras Support in Preview: The added Keras support is also new, and being tested in a public preview. The open source Keras neural network library is popular with developers for its user-friendliness when used for deep learning applications, and now that the Cognitive Toolkit supports it, code that's written with Keras can easily be used by the Toolkit without having to change it.

Details on these features is in this blog post from the Cognitive Team.

About the Author

Michael Domingo is a long-time software publishing veteran, having started up and managed several developer publications for the Clipper compiler, Microsoft Access, and Visual Basic. He's also managed IT pubs for 1105 Media, including Microsoft Certified Professional Magazine and Virtualization Review before landing his current gig as Visual Studio Magazine Editor in Chief. Besides his publishing life, he's a professional photographer, whose work can be found by Googling domingophoto.

comments powered by Disqus


  • AI for GitHub Collaboration? Maybe Not So Much

    No doubt GitHub Copilot has been a boon for developers, but AI might not be the best tool for collaboration, according to developers weighing in on a recent social media post from the GitHub team.

  • Visual Studio 2022 Getting VS Code 'Command Palette' Equivalent

    As any Visual Studio Code user knows, the editor's command palette is a powerful tool for getting things done quickly, without having to navigate through menus and dialogs. Now, we learn how an equivalent is coming for Microsoft's flagship Visual Studio IDE, invoked by the same familiar Ctrl+Shift+P keyboard shortcut.

  • .NET 9 Preview 3: 'I've Been Waiting 9 Years for This API!'

    Microsoft's third preview of .NET 9 sees a lot of minor tweaks and fixes with no earth-shaking new functionality, but little things can be important to individual developers.

  • Data Anomaly Detection Using a Neural Autoencoder with C#

    Dr. James McCaffrey of Microsoft Research tackles the process of examining a set of source data to find data items that are different in some way from the majority of the source items.

  • What's New for Python, Java in Visual Studio Code

    Microsoft announced March 2024 updates to its Python and Java extensions for Visual Studio Code, the open source-based, cross-platform code editor that has repeatedly been named the No. 1 tool in major development surveys.

Subscribe on YouTube