News

VS Code Tool Integrates with Azure Data Lake for Big Data Analytics

Microsoft updated its Visual Studio Code extension for working with the Azure Data Lake for Big Data analytics in the cloud, furthering integration of the extension's data exploration tool among other new features and improvements.

That data explorer tool comes in the Azure Data Lake Tools extension for the open source, cross-platform VS Code editor that's available for free from the Visual Studio Code Marketplace.

Data exploration is but one bit of functionality provided by the extension, which is designed to ease the development of Big Data projects with Microsoft's U-SQL language. U-SQL is a special Microsoft variant of Structured Query Language that provides scalable distributed query capabilities. It combines declarative SQL with imperative C# to let developers process data at any scale in Azure Data Lake Analytics (ADLA), a central component of the Microsoft Big Data ecosystem.

Azure Data Lake Store
[Click on image for larger view.] Azure Data Lake Store (source: Microsoft).

To make that easier, the Data Lake Explorer tool in the VS Code Azure Data Lake Tools extension now integrates with ADLA and Azure Data Lake Storage (ADLS), an enterprise-wide scalable repository for Big Data analytic workloads. It provides for operational and exploratory analytics on data of any size, type and ingestion speed in one single place, according to Microsoft.

The extension's description says it "provides you a cross-platform, light-weight, keyboard-focused authoring experience for U-SQL while maintaining a rich set of development functions."

Jenny Jiang, principal program manager, Big Data Team, said the VS Code extension's increased capabilities let developers use it for tasks such as: helping a data scientist explore data and understand what's being saved and the hierarchy of a data folder; and helping a developer look for easier navigation inside the ADLS.

"The VS Code Data Lake Explorer enhances your Azure login experiences, empowers you to manage your ADLA metadata in a tree like hierarchical way and enables easier file exploration for ADLS resources under your Azure subscriptions," Jiang said in a blog post last week. "You can also preview, delete, download, and upload files through contextual menu. With the integration of VS Code explorer, you can choose your preferred way to manage your U-SQL databases and your ADLS storage accounts in addition to the existing ADLA and ADLS commands."

According to the extension's marketplace entry, new features added to the tool include:

  • Integrate with VS Code Azure Account for improved Azure sign-in experiences.
  • Enable multi-tenant scenarios.
  • Update Data Lake Explorer to be Azure Subscription oriented.
  • Add "Script to Create", "Delete" menu for U-SQL database objects creation and deletion.
  • Add "Delete", "Upload Folder" menu for ADLS Storage files and folders.
  • Add "ADL: Set Git Ignore" command to exclude certain system-generated files and folders from GitHub repository.

At the time of this writing, the VS Code extension has been installed more than 34,800 times, with no reviews or ratings.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus

Featured

  • Visual Studio 2019 v16.7 Ships with Better Git Integration

    Better GitHub integration and other improvements highlight the new Visual Studio 2019 Version 16.7 and first preview of v16.8.

  • Visual Studio Codespaces Private Preview Woos C++ Developers

    Microsoft announced a private preview of Visual Studio Codespaces, which eases the setup and use of cloud-powered development environments that can be used from anywhere for remote development and other scenarios, targeting C++ console app and library developers.

  • Data Prep for Machine Learning: Normalization

    Dr. James McCaffrey of Microsoft Research uses a full code sample and screenshots to show how to programmatically normalize numeric data for use in a machine learning system such as a deep neural network classifier or clustering algorithm.

  • Microsoft Intros Azure Well-Architected Framework Best Practices

    Taking a page from the Amazon Web Services (AWS) book on cloud computing platforms, Microsoft has introduced its own Azure Well-Architected Framework, providing a set of architecture best practices to help users build and deliver great solutions and improve the quality of cloud workloads.

  • Creating a Progressive Web App with Blazor WebAssembly

    Not surprisingly, it's dead easy to create an app in Blazor that runs outside of the browser window and (potentially) in an offline mode. Before you get carried away, though, there are some key design decisions to make.

.NET Insight

Sign up for our newsletter.

Terms and Privacy Policy consent

I agree to this site's Privacy Policy.

Upcoming Events