Azure Data Factory Takes Visual, Low-Code Route

In response to developer feedback, Microsoft is taking a page from the growing visual, low-code development approach to simplify Big Data analytics in the cloud with Azure Data Factory.

The new visual, drag-and-drop functionality comes in Azure Data Factory (ADF) v2, a new public preview of Microsoft's cloud-based data integration service that debuted as v1 in October 2015. ADF is used to create data-driven workflows -- such as extract, transform, load (ETL) and extract, load, transform (ELT) -- in the cloud in order to orchestrate and automate data movement and data transformation.

Processing and transforming the data is done in conjunction with compute services such as Azure HDInsight Hadoop, Spark, Azure Data Lake Analytics and Azure Machine Learning.

One of ADF's main uses is the creation and scheduling of those data-driven workflows (Microsoft calls them "pipelines": logical groupings of activities that together perform a task) that can ingest data from disparate data stores.

That process is now point-and-click simple in the v2 preview.

"One of the consistent pieces of customer feedback we received, is to enable a rich interactive visual authoring and monitoring experience allowing users to create, configure, test, deploy and monitor data integration pipelines without any friction," said Microsoft's Gaurav Malhotra, senior program manager, in a blog post last week.

"We listened to your feedback and are happy to announce the release of visual tools for ADF v2. The main goal of the ADF visual tools is to allow you to be productive with ADF by getting pipelines up & running quickly without requiring [you] to write a single line of code."

The new visual functionality lets developers create control flow pipelines, drag-and-drop activities onto a canvas and "connect them on-success, on-failure, on-completion." Visual monitoring of pipeline, activity and trigger runs is also available in a simple list view interface.

ADF v2 also includes guided tours that help developers understand how to use the new visual authoring and monitoring features while also providing a mechanism to give the ADF team more valuable feedback.

See Malhotra's post for more details on the above functionality and much more. Additional guidance is provided in the Jan. 16 article "Create a data factory using the Azure Data Factory UI," which covers the v2 preview.

About the Author

David Ramel is an editor and writer for Converge360.

comments powered by Disqus


  • .NET for Apache Spark Debuts in Version 1.0

    The open source project .NET for Apache Spark has debuted in version 1.0, finally vaulting the C# and F# programming languages into Big Data first-class citizenship.

  • In-App Reviews Come to Xamarin.Forms Android

    Android is playing a little catch-up to iOS regarding in-app review functionality, just now coming tp Microsoft's Xamarin.Forms implementation.

  • C# Slides in Usage Ranking of Programming Languages

    "The fact that C# lost three places in the ranking of language communities during the last three years is mostly explained by its slower growth compared to C/C++ and PHP."

  • Telerik UI for Blazor Updated

    Progress announced an update to its Telerik UI for Blazor components, targeting Microsoft's open source Blazor framework that lets C# coders create web apps without having to rely upon JavaScript.

  • Infragistics Unveils UI Components for Blazor

    Infragistics, specializing in third-party UI/UX controls and tools, unveiled a new offering targeting Blazor, Microsoft's red-hot open source framework that allows for C#-based web development instead of traditional mainstay JavaScript.

Upcoming Events