Onward and Upward

Blog archive

Microsoft, Hortonworks Combine to Bring Hadoop to Windows Server

Hortonworks has partnered with Microsoft to provide the first Hadoop implementation geared specifically toward Windows Server.

Called the Hortonworks Data Platform (HDP), it "enables organizations to capture, process and share data in any format and at scale," according to a Hortonworks press release.

HDP allows customers to use Hadoop on-premises or in the cloud, via Windows Azure. It's a 100 percent open-source project -- all code is made available to the Apache Software Foundation.

For Microsoft-focused developers, it should make creating Big Data apps easier. "Applications built on HDP for Windows should just work on Microsoft's HDInsight server and the Azure HDInsight service," wrote Herain Oberoi on the SQL Server Blog.  

HDP is also completely interoperable between Windows and Linux, making it the industry's first Hadoop distribution available on both platforms, according to Hortonworks.

Hadoop is becoming more important to Microsoft. HDInsight was featured at last year's Build conference, Microsoft's main developer show. And although Big Data has seen its growth mostly in the realm of Linux and Java, Redmond has been steadily increasing its presence in the market. And when one considers that Windows Server has 73 percent of the market (according to Hortonworks, quoting IDC numbers), it makes sense to open up Windows to a larger segment of the development community.

Visual Studio Magazine columnist Andrew Brust nicely summed up the benefits of HDInsight in his December 2012 article:

"With HDInsight, developers can write MapReduce code in C# instead of Java, or use a LINQ provider to manipulate MapReduce indirectly through Hive. A NuGet package provides the C# MapReduce support, and a single-node developer version of HDInsight allows local debugging of such code in Visual Studio. A command-line utility provides deployment of the assembly to the local Hadoop instance. Deployment directly from Visual Studio to remote clusters, including the Windows Azure HDInsight implementation, seems a safe bet for future releases."

The announcement continues to solidify two recent trends for Microsoft: Big Data integration and open-source collaboration. For instance, the recent revelation that Visual Studio and Team Foundation Service (TFS) will support Git source control demonstrated that Microsoft isn't just teasing when it says its committed to the open-source community.

Hortonworks Data Platform 1.2 is available here.

Posted by Keith Ward on 02/28/2013


comments powered by Disqus

Featured

  • Mastering Blazor Authentication and Authorization

    At the Visual Studio Live! @ Microsoft HQ developer conference set for August, Rockford Lhotka will explain the ins and outs of authentication across Blazor Server, WebAssembly, and .NET MAUI Hybrid apps, and show how to use identity and claims to customize application behavior through fine-grained authorization.

  • Linear Support Vector Regression from Scratch Using C# with Evolutionary Training

    Dr. James McCaffrey from Microsoft Research presents a complete end-to-end demonstration of the linear support vector regression (linear SVR) technique, where the goal is to predict a single numeric value. A linear SVR model uses an unusual error/loss function and cannot be trained using standard simple techniques, and so evolutionary optimization training is used.

  • Low-Code Report Says AI Will Enhance, Not Replace DIY Dev Tools

    Along with replacing software developers and possibly killing humanity, advanced AI is seen by many as a death knell for the do-it-yourself, low-code/no-code tooling industry, but a new report belies that notion.

  • Vibe Coding with Latest Visual Studio Preview

    Microsoft's latest Visual Studio preview facilitates "vibe coding," where developers mainly use GitHub Copilot AI to do all the programming in accordance with spoken or typed instructions.

  • Steve Sanderson Previews AI App Dev: Small Models, Agents and a Blazor Voice Assistant

    Blazor creator Steve Sanderson presented a keynote at the recent NDC London 2025 conference where he previewed the future of .NET application development with smaller AI models and autonomous agents, along with showcasing a new Blazor voice assistant project demonstrating cutting-edge functionality.

Subscribe on YouTube