News

Azure Data Lakes Tools for Visual Studio Code Now in Preview

The ability to embrace U-SQL jobs via authoring, scripting, extensibility via the VSCode environment and using C# is the key to this tooling preview.

Visual Studio Code is jumping into the Big Data pool, with a new offering that allows for working directly with the Azure Data Lake Store. The springboard is Azure Data Lake Tools for Visual Studio Code, which is now in preview; it was one of a number of other Azure offering announced at Microsoft's Connect(); event this week.

Azure Data Lake Store is Microsoft's Azure-based service for analyzing gobs of unstructured data. U-SQL debuted over a year ago as a means to be able to connect queries made to ADLS to a programming language that developers find more familiar -- specifically, C#.

"By extending VSCode, leveraging the Azure Data Lake Java SDK for U-SQL job submission, and integrating with the Azure portal for job monitoring, the tools provide a cross-platform IDE," writes Jenny Jiang, a program manager on Microsoft's Big Data team, in a blog post. "Users can run it smoothly in Window, Linux and Mac."

ADL Tools for VSCode supports U-SQL language authoring, scripting, and extensibility with C#. U-SQL extensibility is enabled using custom code either by using registered custom code assemblies (which is done via the Register Assembly command) or code-behind capabilities.

ADL Tools for VSCode can be use to "process any type of data, integrate with your custom code, as well as efficiently scale to any size of data," Jiang notes.

The new tooling also integrates with Azure Data Lake Analytics, which means U-SQL job submissions can be done through ADLA, with job output to ADLS or Azure Blob Storage.

The preview is available now via the VSCode Extension repository or in the VSCode Marketplace. To run it, it requires VSCode and JRE 1.8.x, Mono 4.2.x (for Linux and Mac), and .Net Core (for Linux and Mac).

About the Author

Michael Domingo is a long-time software publishing veteran, having started up and managed several developer publications for the Clipper compiler, Microsoft Access, and Visual Basic. He's also managed IT pubs for 1105 Media, including Microsoft Certified Professional Magazine and Virtualization Review before landing his current gig as Visual Studio Magazine Editor in Chief. Besides his publishing life, he's a professional photographer, whose work can be found by Googling domingophoto.

comments powered by Disqus

Featured

  • Cloud-Focused .NET Aspire 9.1 Released

    Along with .NET 10 Preview 1, Microsoft released.NET Aspire 9.1, the latest update to its opinionated, cloud-ready stack for building resilient, observable, and configurable cloud-native applications with .NET.

  • Microsoft Ships First .NET 10 Preview

    Microsoft shipped .NET 10 Preview 1, introducing a raft of improvements and fixes across performance, libraries, and the developer experience.

  • C# Dev Kit Previews .NET Aspire Orchestration

    Microsoft's dev team has been busy updating the C# Dev Kit, a Visual Studio Code extension that enhances the C# development experience by providing tools for managing, debugging, and editing C# projects.

  • Hands On: New VS Code Insiders Build Creates Web Page from Image in Seconds

    New Vision support with GitHub Copilot in the latest Visual Studio Code Insiders build takes a user-supplied mockup image and creates a web page from it in seconds, handling all the HTML and CSS.

  • Naive Bayes Regression Using C#

    Dr. James McCaffrey from Microsoft Research presents a complete end-to-end demonstration of the naive Bayes regression technique, where the goal is to predict a single numeric value. Compared to other machine learning regression techniques, naive Bayes regression is usually less accurate, but is simple, easy to implement and customize, works on both large and small datasets, is highly interpretable, and doesn't require tuning any hyperparameters.

Subscribe on YouTube

Upcoming Training Events