2024 was a busy year for Calleo content, with 40+ software testing insights and 12 editions of Testing Times! Throughout the year, we covered a wide range of topics, from the World Quality Report to Lessons you can learn from Streetfighter II.
Don’t worry, I won’t judge you if you haven’t read everything we’ve produced! I know you’re busy, so today, I’m giving an overview of our five top articles from 2024.
The articles explore…
- How NASA techniques can be applied to enterprise-level testing
- Whether manual testing is becoming obsolete
- Current automation trends
- Why the total cost of ownership matters
- The need for integrity in vendor communications.
Whether you’re a seasoned testing professional or new to the field, this 2024 highlights package provides valuable perspectives and actionable takeaways to enhance your testing strategies.
Learning from the Best: NASA’s Software Testing Approach
NASA is world famous for incredibly complex systems and a high mission success rate.
They launch rockets into space and explore other planets, with software underpinning pretty much everything they do. But how do they achieve such high levels of quality and avoid catastrophic defects?
In How NASA Does Software Testing: 4 Lessons We Can Learn, we explored the rigorous testing practices they use and how they can offer valuable insights for enterprise-level testers:
Theeir practices underscore the importance of thorough, systematic testing in high-stakes environments, principles that can elevate any organisation’s testing practices.
Read the full article to learn how to apply NASA’s testing techniques to your enterprise-level software testing efforts.
The Shift from Manual to Automated Testing
Test automation has existed for decades, and while I’m the first to admit it was a bit ropey in the early days, it is now mature, sophisticated, and essential for modern software testing. So why are some organisations still reluctant to implement it?
Our article It’s 2024: Why Are You Still Doing Manual Software Testing? addressed this critical question facing many organisations.
We discussed why, as technology evolves and software development becomes increasingly complex, relying solely on manual testing is no longer viable.
Automation just solves so many problems:
- You can test faster and more efficiently
- Your results will be more accurate and consistent
- You can cover more features and platforms
- You will save money despite initial setup investments
Whilst manual testing still has its place, particularly in exploratory and usability testing, automation should be the primary method for most testing scenarios.
Read the full article to learn the right way to implement test automation.
Emerging Trends in Test Automation
Now that I’ve convinced you to take the plunge into automation, I’ll point you to another one of out top articles: Software Test Automation: 5 Important Trends for 2024
Knowing which automation ideas to adopt can be tricky, especially if you haven’t done it before. In this, we’ve helped simplify your journey by identifying five useful trends shaping test automation:
- AI-Driven Testing: Artificial Intelligence is now a core aspect of test automation, enhancing efficiency and effectiveness.
- Shift-Left Testing: Integrating testing earlier in the development process with IDE-based automation tools.
- Codeless Test Automation: Making test automation accessible to professionals with varying technical expertise.
- Continuous Testing: Adopting ongoing testing throughout the SDLC to detect regression errors and reduce project timelines.
- Cloud-Based Testing Tools: Leveraging scalable, flexible, and cost-efficient SaaS solutions for dynamic testing environments.
These trends are easy to adopt and allow you to implement intelligent, accessible, and efficient testing methodologies.
Read the full article to learn how to implement these trends.
The True Cost of Testing Tools
I speak to so many companies who’ve been stung by unnecessary and unexpected test tool costs. Because of this, I wrote How to Avoid This Expensive Mistake When Choosing Test Tools.
This article highlights a common pitfall in software procurement—that many organisations focus solely on upfront costs, overlooking the total cost of ownership (TCO) and creating serious long-term budgetary and technical problems:
- Free or low-cost tools often carry hidden implementation, maintenance, and resource allocation expenses.
- Professional-grade tools, whilst seemingly more expensive initially, often provide better long-term value and lower TCO.
- Consider factors like hosting costs, integration efforts, and resource requirements when evaluating testing tools.
This insight emphasises the importance of a holistic approach to tool selection, considering both immediate and long-term financial implications.
Read the full article to learn how to avoid making costly mistakes when choosing tools!
Industry Integrity: A Critical Look at Vendor Claims
“What’s happening to you Pinocchio is you told a lie. And when you lie, it’s-a plain like the nose on your face”.
In Tricentis Are Lying. Again, and BlazeMeter is Lying About LoadRunner, I looked at several false claims made by a couple of test tool vendors.
These articles highlighted lies made by both parties, specifically misleading comparisons and omissions in their marketing materials and their portrayal of OpenText products.
Their hit pieces remind us of the importance of due diligence and critical evaluation of vendor claims in the software testing industry.
I don’t want to sully this article with their fibs, but if you want to know what they said check out Tricentis’ and BlazeMeter’s latest lies.
What You Can Expect in the Year Ahead!
At Calleo, we love to keep you informed about the latest developments, whether they involve learning from industry leaders like NASA, embracing automation and AI, or anything else related to testing.
In 2025, we have planned some great articles to inform, intrigue and challenge your thinking on software testing. If you have not yet signed up, you can follow us here:
