News

Tool for VS Code Enables Serverless, SQL-Based Big Data Analytics on Azure Cloud

Microsoft updated its extension for tying its lightweight Visual Studio Code editor into the Azure cloud for serverless, SQL-based Big Data analytics.

Azure Data Lake Tools for Visual Studio Code enhances the open source, cross-platform code editor to help data scientists and data developers more easily perform U-SQL-based Big Data analytics against the Microsoft Azure Data Lake, which stores data of any size, shape and speed.

U-SQL is a variant of the Structured Query Language -- combining declarative SQL with imperative C# -- designed to help developers efficiently analyze data in various relational stores, including Azure SQL Database, in a serverless cloud environment.

"We are excited to share the recent release for VSCode Azure Data Lake Tools, a cross-platform code editor to allow you easily to author and submit U-SQL file to Azure Data Lake Analytics (ADLA)," said Jenny Jiang, principal program manager, Big Data Team, in a blog post last week. "We have greatly improved the getting started experience, enhanced usability of the tools, and improved the integration with Azure Data Lake Storage (ADLS). The ADLS integration allows you to easily preview files, list storage paths, and download or upload files with exceptional performance."

Along with new features -- such as status monitoring of files downloaded from ADLS and single or multiple file uploads -- Microsoft said it solidified performance and reliability via architectural improvements and made the installation of a C# extension optional in order to improve the getting started experience.

It further slimmed the tool down by removing the .NetCore and Java dependencies from the Windows extension, which Jiang said was in keeping with the lightweight philosophy behind VS Code.

 Monitoring Download Status
[Click on image for larger view.] Monitoring Download Status (source: Microsoft).

The VS Code Marketplace entry says the extension provides:

  • U-SQL language sample package
  • U-SQL language editing support, including Syntax Highlighting, IntelliSense, Auto Format, Go To Definition, Find All References, Error Markers, Code Snippet and more
  • U-SQL scripting, code behind programming and assembly handling
  • Azure Data Lake Analytics U-SQL job submission, execution and job status monitoring
  • U-SQL local run and local debug in Windows
  • Azure Data Lake compute account object navigation for objects such as databases, schemas and other metadata
  • Azure Data Lake Storage integration with resources navigation, file preview, file upload and file download
  • Azure Data Lake Analytics metadata navigation to show historical jobs

The extension has been installed more than 21,800 times at the time of this writing, with no reviews or ratings yet. The source code is available on GitHub, where the project shows three stars, four contributors and two releases.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus

Featured

  • AI for GitHub Collaboration? Maybe Not So Much

    No doubt GitHub Copilot has been a boon for developers, but AI might not be the best tool for collaboration, according to developers weighing in on a recent social media post from the GitHub team.

  • Visual Studio 2022 Getting VS Code 'Command Palette' Equivalent

    As any Visual Studio Code user knows, the editor's command palette is a powerful tool for getting things done quickly, without having to navigate through menus and dialogs. Now, we learn how an equivalent is coming for Microsoft's flagship Visual Studio IDE, invoked by the same familiar Ctrl+Shift+P keyboard shortcut.

  • .NET 9 Preview 3: 'I've Been Waiting 9 Years for This API!'

    Microsoft's third preview of .NET 9 sees a lot of minor tweaks and fixes with no earth-shaking new functionality, but little things can be important to individual developers.

  • Data Anomaly Detection Using a Neural Autoencoder with C#

    Dr. James McCaffrey of Microsoft Research tackles the process of examining a set of source data to find data items that are different in some way from the majority of the source items.

  • What's New for Python, Java in Visual Studio Code

    Microsoft announced March 2024 updates to its Python and Java extensions for Visual Studio Code, the open source-based, cross-platform code editor that has repeatedly been named the No. 1 tool in major development surveys.

Subscribe on YouTube