Xamarin Announces New UI Testing Product

Today Xamarin Inc., at its first Evolve Conference in Austin, Texas, announced a new product called Xamarin Test Cloud. Xamarin Test Cloud is an automated, cross-platform UI testing service that gives mobile developers access to hundreds of mobile devices, which are hosted in the cloud by Xamarin. Also announced at the conference was Xamarin's acquisition of LessPainful, the company that created the Calabash mobile UI testing automation framework upon which Xamarin Test Cloud is based.

"Testing is a significant, but time-consuming and difficult, part of the mobile development process. Developers need a simpler and easier way to test across the hundreds of devices and multiple platforms out there," said Nat Friedman, CEO and cofounder of Xamarin, in a press release accompanying the announcement.

Xamarin Test Cloud provides that simpler testing experience by giving developers access to a lab of real, non-jailbroken iOS and Android mobile devices, which are hosted by Xamarin and made available in the cloud. Developers upload their mobile app to the Xamarin Test Cloud service directly from Visual Studio, Xamarin Studio or one of the supported continuous integration (CI) systems (supported systems include Team Foundation Server [TFS], TeamCity and Jenkins). Once the app is uploaded, the developer is presented with a dropdown list of devices and can select those on which he wishes to run tests. Then the Xamarin Test Cloud App Explorer "systematically exercises every screen and control in your app without you having to write a single test," according to Xamarin's product information slides.

Following the automated testing, Xamarin Test Cloud delivers a results-view page to the developer showing which tests passed or failed on each device. Developers can click on those devices with errors to view a more-detailed error log.

In a pre-release briefing, Friedman noted that Xamarin Test Cloud not only simplifies the testing process, but also makes it more robust. He explained that Xamarin Test Cloud uses object-based UI testing, which provides a stronger method for defining proper UI behavior than methods used by other UI testing tools (such as testing based on image recognition or gesture recording). Object-based testing also allows for "cross-platform test cases that adapt automatically as the UI changes," according to the Xamarin Test Cloud press release, which allows "tests [to] continue working even if changes are made to the app UI."

Xamarin Test Cloud will be available in Q3 2013, with support for Windows Phone devices to be added at a later date. The service will have tiered pricing based on usage hours. Xamarin is currently accepting beta testers on a first-come, first-serve basis; developers can learn more and sign up for the beta program at

About the Author

Katrina Carrasco is the associate group managing editor for the 1105 Enterprise Computing Group. She can be reached at [email protected]

comments powered by Disqus


  • ML.NET Improves Object Detection

    Microsoft improved the object detection capabilities of its ML.NET machine learning framework for .NET developers, adding the ability to train custom models with Model Builder in Visual Studio.

  • More Improvements for VS Code's New Python Language Server

    Microsoft announced more improvements for the new Python language server for Visual Studio Code, Pylance, specializing in rich type information.

  • Death of the Dev Machine?

    Here's a takeaway from this week's Ignite 2020 event: An advanced Azure cloud portends the death of the traditional, high-powered dev machine packed with computing, memory and storage components.

  • COVID-19 Is Ignite 2020's Elephant in the Room: 'Frankly, It Sucks'

    As in all things of our new reality, there was no escaping the drastic changes in routine caused by the COVID-19 pandemic during Microsoft's big Ignite 2020 developer/IT pro conference, this week shifted to an online-only event after drawing tens of thousands of in-person attendees in years past.

  • Visual Studio 2019 v16.8 Preview Update Adds Codespaces

    To coincide with the Microsoft Ignite 2020 IT pro/developer event, the Visual Studio dev team shipped a new update, Visual Studio 2019 v16.8 Preview 3.1, with the main attraction being support for cloud-hosted Codespaces, now in a limited beta.

Upcoming Events