Welcome!

Apache Authors: Elizabeth White, Pat Romanski, Liz McMillan, Christopher Harrold, Janakiram MSV

Related Topics: Microsoft Cloud, Java IoT, Microservices Expo, Silverlight, Agile Computing, Apache

Microsoft Cloud: Article

Making a Case for a Test Case

You need to balance the limitations in terms of resources and time, with the need to ship the highest quality product possible

For software testers to create a detailed test case during the QA process can be tricky: sometimes it's not an option; sometimes it's wasted effort. Here are ways to help make that decision.

Part of the skill set required to be a good tester involves the ability to assess a software project and decide when it's worth putting in the effort to create really detailed test cases. Sometimes the software will lend itself to unstructured testing, sometimes the development methodology will dictate a specific approach, and sometimes every possible facet will need to be covered. If you plotted projects on a graph you would get a bell curve because most of them fall somewhere in between the casual and the comprehensive.

How Do You Decide?
There are various factors that are going to weigh on any decision. Some of them leave no room for ambiguity, for example:

  • There are legal compliance requirements or contractual obligations that require documentary evidence.
  • Any bugs in the software would be potentially disastrous, such as with air traffic control or medical software.

These are special cases and they make the decision to write detailed test cases easy, but most projects are not so straightforward.

Consider Your Testers and Audience
How much experience does your test team have? Novice testers may well need the guidance provided by a set of clear and concise test cases. If they are more experienced, then you can trust them to do a thorough job without so much direction.

The intended audience for the software is also an important factor. If this is business software aimed at specific professionals, and you can envisage clear use cases, then a well-organized test plan with detailed test cases will help the QA department. If, on the other hand, the software is aimed at the mass market and it's tougher to predict exactly how people will interact with it, some less formal, agile exploratory testing could turn up important bugs that a more formal approach would miss.

It's also worth bearing in mind that rigorous, detailed test cases, with no room for intellectual input or creative thought, can be dispiriting and even demotivating for testers. Talented testers welcome the opportunity to flex their brains and they can use their experience and their intuition to uncover flaws in the software. If the approach is overly strict and you fail to leverage your tester's skills, bugs will end up slipping through into the final product.

Match the Development Methodology
Modern software development encompasses a number of different approaches and no two teams or projects are the same. If you start out with a vague set of requirements and the developers take an agile approach, then you may not even have the necessary prerequisites to write detailed test cases.

It's also not uncommon for projects to change direction frequently during development and these changes could render your test cases obsolete within a few weeks of them being created. It may be necessary to talk directly to designers or the customers generating the requirements in order to keep abreast of where the software is going and how best to test it, but it's not always possible to get answers to all of your questions.

At the other end of the spectrum a traditional waterfall approach to development, where everything is agreed and signed off before the project begins, will enable you to create test cases with confidence.

It's About Efficiency
Ultimately it's about finding the most efficient approach. You need to balance the limitations in terms of resources and time, with the need to ship the highest quality product possible. Longevity has to factor in - if the project is only scheduled for three months, you won't get much value from a detailed set of test cases, but an ongoing enterprise platform that will be in use for years definitely merits an upfront investment in test cases.

Think about what will offer the best return on investment. Writing test cases is a time-consuming task and it requires the attentions of your most experienced testers. Before you pull the trigger on a detailed test plan, take the time to consider whether it's the most efficient use of their time.

Sometimes it will increase your effectiveness and have a big positive impact on the software, sometimes it won't. The trick is to find the right balance.

More Stories By Vu Lam

Vu Lam is founder and CEO of QASymphony, developers of defect capture tools that track user interactions with applications. He was previously with First Consulting Group and was an early pioneer in Vietnam’s offshore IT services industry since 1995. He holds an MS degree in electrical engineering from Purdue University. You may reach him at [email protected]

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


IoT & Smart Cities Stories
DXWorldEXPO LLC announced today that ICC-USA, a computer systems integrator and server manufacturing company focused on developing products and product appliances, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City. ICC is a computer systems integrator and server manufacturing company focused on developing products and product appliances to meet a wide range of ...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
René Bostic is the Technical VP of the IBM Cloud Unit in North America. Enjoying her career with IBM during the modern millennial technological era, she is an expert in cloud computing, DevOps and emerging cloud technologies such as Blockchain. Her strengths and core competencies include a proven record of accomplishments in consensus building at all levels to assess, plan, and implement enterprise and cloud computing solutions. René is a member of the Society of Women Engineers (SWE) and a m...
Nicolas Fierro is CEO of MIMIR Blockchain Solutions. He is a programmer, technologist, and operations dev who has worked with Ethereum and blockchain since 2014. His knowledge in blockchain dates to when he performed dev ops services to the Ethereum Foundation as one the privileged few developers to work with the original core team in Switzerland.
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time t...
Headquartered in Plainsboro, NJ, Synametrics Technologies has provided IT professionals and computer systems developers since 1997. Based on the success of their initial product offerings (WinSQL and DeltaCopy), the company continues to create and hone innovative products that help its customers get more from their computer applications, databases and infrastructure. To date, over one million users around the world have chosen Synametrics solutions to help power their accelerated business or per...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
When talking IoT we often focus on the devices, the sensors, the hardware itself. The new smart appliances, the new smart or self-driving cars (which are amalgamations of many ‘things'). When we are looking at the world of IoT, we should take a step back, look at the big picture. What value are these devices providing. IoT is not about the devices, its about the data consumed and generated. The devices are tools, mechanisms, conduits. This paper discusses the considerations when dealing with the...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
IoT is rapidly becoming mainstream as more and more investments are made into the platforms and technology. As this movement continues to expand and gain momentum it creates a massive wall of noise that can be difficult to sift through. Unfortunately, this inevitably makes IoT less approachable for people to get started with and can hamper efforts to integrate this key technology into your own portfolio. There are so many connected products already in place today with many hundreds more on the h...