Tool for VS Code Enables Serverless, SQL-Based Big Data Analytics on Azure Cloud

Microsoft updated its extension for tying its lightweight Visual Studio Code editor into the Azure cloud for serverless, SQL-based Big Data analytics.

Azure Data Lake Tools for Visual Studio Code enhances the open source, cross-platform code editor to help data scientists and data developers more easily perform U-SQL-based Big Data analytics against the Microsoft Azure Data Lake, which stores data of any size, shape and speed.

U-SQL is a variant of the Structured Query Language -- combining declarative SQL with imperative C# -- designed to help developers efficiently analyze data in various relational stores, including Azure SQL Database, in a serverless cloud environment.

"We are excited to share the recent release for VSCode Azure Data Lake Tools, a cross-platform code editor to allow you easily to author and submit U-SQL file to Azure Data Lake Analytics (ADLA)," said Jenny Jiang, principal program manager, Big Data Team, in a blog post last week. "We have greatly improved the getting started experience, enhanced usability of the tools, and improved the integration with Azure Data Lake Storage (ADLS). The ADLS integration allows you to easily preview files, list storage paths, and download or upload files with exceptional performance."

Along with new features -- such as status monitoring of files downloaded from ADLS and single or multiple file uploads -- Microsoft said it solidified performance and reliability via architectural improvements and made the installation of a C# extension optional in order to improve the getting started experience.

It further slimmed the tool down by removing the .NetCore and Java dependencies from the Windows extension, which Jiang said was in keeping with the lightweight philosophy behind VS Code.

 Monitoring Download Status
[Click on image for larger view.] Monitoring Download Status (source: Microsoft).

The VS Code Marketplace entry says the extension provides:

  • U-SQL language sample package
  • U-SQL language editing support, including Syntax Highlighting, IntelliSense, Auto Format, Go To Definition, Find All References, Error Markers, Code Snippet and more
  • U-SQL scripting, code behind programming and assembly handling
  • Azure Data Lake Analytics U-SQL job submission, execution and job status monitoring
  • U-SQL local run and local debug in Windows
  • Azure Data Lake compute account object navigation for objects such as databases, schemas and other metadata
  • Azure Data Lake Storage integration with resources navigation, file preview, file upload and file download
  • Azure Data Lake Analytics metadata navigation to show historical jobs

The extension has been installed more than 21,800 times at the time of this writing, with no reviews or ratings yet. The source code is available on GitHub, where the project shows three stars, four contributors and two releases.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus


  • Vendors Update Controls for .NET Core 3.1, Blazor

    This week saw two third-party vendors of dev tools -- UX and UI toolkits and controls -- release new offerings that include support for two of Microsoft's main open source frameworks, the cross-platform .NET Core 3.1 and Blazor, which allows for creating browser-based web applications with C# instead of JavaScript.

  • C++ Is Focus of New Visual Studio 2019 v16.7 Preview 2

    C++ development is a focus point of the new Visual Studio 2019 v16.7 Preview 2, featuring a slew of tweaks and improvements touching upon remote SSH connections, IntelliSense support and more.

  • Clustering Non-Numeric Data Using C#

    Clustering non-numeric -- or categorial -- data is surprisingly difficult, but it's explained here by resident data scientist Dr. James McCaffrey of Microsoft Research, who provides all the code you need for a complete system using an algorithm based on a metric called category utility (CU), a measure how much information you gain by clustering.

  • So What's Up with Microsoft's (and Everyone Else's) Love of Rust?

    Microsoft already stewards several popular programming languages -- C#, TypeScript, F# -- so what's up with its love of Rust, along with the rest of the world?

  • C# Steps Up Programming Language Popularity Ladder

    Microsoft's C# programming language climbed a year-over-year notch on the TIOBE Index, which measures popularity among developers.

.NET Insight

Sign up for our newsletter.

Terms and Privacy Policy consent

I agree to this site's Privacy Policy.

Upcoming Events