News

Use of Live Customer Data in Application Testing Still Widespread

A survey released by Compuware Corporation and the Ponemon Institute shows "an overwhelming majority of organizations surveyed risk compromising critical information by using actual customer data for the development and testing of applications."

The report, The Insecurity of Test Data: The Unseen Crisis, says that 62 percent of companies surveyed use actual customer data instead of disguised data when testing applications. Of those companies, 89 percent use customer files and 74 percent use customer lists. The report notes that live data often includes "employee records, vendor records, customer account numbers, credit card numbers, Social Security numbers, and other credit, debit, or payment information."

Developers may believe that test data is immune from privacy threats because they are testing in a non-production environment, but the survey points out that such environments are usually less secure than their production counterparts. It also notes that testing data may be exposed to such unauthorized sources as in-house testing staff, consultants, partners, and offshore personnel. Over half (52 percent) of respondents say they outsource their application testing, and 49 percent of those respondents shared live data with the outsourced company.

"For many organizations, large customer data files represent an easy, cheap source of data to use when testing applications, but this process introduces a huge element of risk to the challenge of maintaining the integrity of sensitive information, particularly when third parties and offshore resources are involved," said Dr. Larry Ponemon, chairman and founder of the Ponemon Institute. "This study points to a need for greater awareness and accountability over how sensitive data is used within organizations. Common practices as they relate to all uses of live data must be evaluated to assess risk, and safeguards implemented to ensure data security."

The survey reports that half of the companies using actual customer data in testing don't protect that information. Some 897 IT professionals participated in the survey; they averaged ten years experience.

Among the other findings:

  • Half (50 percent) of respondents have no way to know if the test data had been compromised

  • Over four in ten respondents (41 percent) do not protect live data they use when developing software

  • Over a third (38 percent) were unsure if the live test or development data used in their organization had had been lost or stolen

  • More than one-fourth of respondents (26 percent) didn't know who was responsible for protecting test data (26 percent thought it was the development team, 21 percent thought the testing organization was responsible)

"Few people realize how much is at risk during the development and testing of applications," said John Williams, senior vice president, product solutions, Compuware. "All commercial organizations -- not just health care and financial institutions -- have an obligation to protect the privacy of consumer data. To eliminate the test data security risk, an increasing number of our clients are using our Test Data Privacy solution that provides them with an automated, repeatable process for creating safe and effective test data."

About the Author

James E. Powell is the former editorial director of Enterprise Strategies (esj.com).

comments powered by Disqus

Featured

  • Mastering Blazor Authentication and Authorization

    At the Visual Studio Live! @ Microsoft HQ developer conference set for August, Rockford Lhotka will explain the ins and outs of authentication across Blazor Server, WebAssembly, and .NET MAUI Hybrid apps, and show how to use identity and claims to customize application behavior through fine-grained authorization.

  • Linear Support Vector Regression from Scratch Using C# with Evolutionary Training

    Dr. James McCaffrey from Microsoft Research presents a complete end-to-end demonstration of the linear support vector regression (linear SVR) technique, where the goal is to predict a single numeric value. A linear SVR model uses an unusual error/loss function and cannot be trained using standard simple techniques, and so evolutionary optimization training is used.

  • Low-Code Report Says AI Will Enhance, Not Replace DIY Dev Tools

    Along with replacing software developers and possibly killing humanity, advanced AI is seen by many as a death knell for the do-it-yourself, low-code/no-code tooling industry, but a new report belies that notion.

  • Vibe Coding with Latest Visual Studio Preview

    Microsoft's latest Visual Studio preview facilitates "vibe coding," where developers mainly use GitHub Copilot AI to do all the programming in accordance with spoken or typed instructions.

  • Steve Sanderson Previews AI App Dev: Small Models, Agents and a Blazor Voice Assistant

    Blazor creator Steve Sanderson presented a keynote at the recent NDC London 2025 conference where he previewed the future of .NET application development with smaller AI models and autonomous agents, along with showcasing a new Blazor voice assistant project demonstrating cutting-edge functionality.

Subscribe on YouTube