Whenever there’s a debate about open source vs. professional tools, many jump to the defence of ‘free’ open-source tools. But how free is ‘free’ really, or to put it another way, how much money are you prepared to waste on ‘free’ tools?
The Illusion of Saving Money
One of the most common reasons businesses gravitate towards open-source tools is the perceived financial savings. I have heard all sorts of arguments, including::
- We have to use free tools, there is no money to spend on tools,.
- Why spend money on tools when we can get them for free?
- My team enjoy the technical challenge of getting the tools to work.
- Open source is not great, but it is good enough
While you might save initially, the time and effort invested in getting the tool to work and maintaining it can quickly surpass the cost of a professional tool. But it’s essential to look beyond the immediate ‘no-cost’ appeal.
Free Today, But Costly Tomorrow
Don’t be fooled by tools that are free at the point of acquisition – these tools are by no means free
The misconception that testers should utilise free tools might be well-intended, but it’s misguided. These tools might not have a price tag attached during acquisition, but their subsequent operational costs can be vast. Essentially, you invest more time (which equals money) to achieve similar results compared to professional tools.
I recently spoke with someone whose business uses open source solutions when developing customer solutions. I asked:
- Why do you use open source rather than products? He said it was because open source offered a cheaper upfront solution and was therefore easier to get approval, and they don’t require an ongoing support contract.
- How does this compare to licensed products? He said that in most situations, paid products would be cheaper than free by the 2nd or 3rd year.
Free tools might not cost initially; however, you do pay from that point onwards.
The DIY Analogy
Imagine you’re doing a massive DIY project. Would you rather use a manual or electric screwdriver?
If a store offers free screwdrivers, many might happily take one and spend countless hours manually fixing hundreds of screws.
But wouldn’t investing in a professional electric screwdriver with long-life batteries be more efficient?
Ten years later, the professional tool will still perform efficiently and think of the hours saved – let alone the greater ease of use.
The point here isn’t about screws but valuing time over short-term savings. If we understand the value of efficient tools in DIY projects, why are test professionals often handed the metaphorical screwdriver and told to make do?
The Real Cost: Time Over Money
The crux of the argument is straightforward: time is more valuable than a few pounds saved. When considering testing tools, one should view the investment through the lens of long-term efficiency and accuracy.
Ask yourself, whenever free tools have been selected, has someone calculated the cost of getting the tool working and supporting it? Has anyone compared this to the costs of a paid tool that works immediately, requires minimal setup and includes ongoing support?
Instead of grappling with inadequate open-source tools, businesses should use more efficient, cost-effective solutions.
A Real World Example
For example, I recently spoke with a decent-sized company (500 staff) that had decided to use an obscure open-source performance test tool for a one-off performance test rather than a professional tool.
The open source solution in question had little information available online and was unsupported. It required hardware to run the test, a security team review, installation, proving, etc.
Would LoadRunner Cloud Have Been Cheaper?
Alternatively, they could have gone with LoadRunner Cloud, which includes all of that out-of-the-box, has abundant online help and documentation, and is fully supported.
With VUH (Virtual User Hour) pricing, their project would cost less than £500 using LoadRunner Cloud, offering scalability, precision, and analysis at an all-inclusive price.
I am convinced that the open source solution ended up costing significantly more than £500. LoadRunner Cloud would also be cheaper if they decided to scale up their testing.
This is not just about Performance Testing.
Licensed test tools make financial sense across the board.
- Good test management tools save your team many hours each week.
- Good automation tools will save your team significant time in initial scripting and script maintenance.
These savings will typically outweigh the cost of the tools and should also provide value-add.
I have said it before and will say it again, People are the real cost in software testing.
How Much Money Are You Prepared to Waste on ‘Free’ Open Source Testing Tools?
When choosing test tools, looking beyond the initial allure of ‘free’ and considering the long-term implications is essential. There’s no such thing as a free lunch; these tools carry significant hidden costs, often making them more expensive than licensed tools.
Professional tools have an upfront cost, but their efficiency, support, additional features & benefits, as well as accuracy make them more valuable than open source alternatives. Investing wisely will save considerable time and improve the results you get.
If you are told there is no budget to spend, be prepared to defend your position. Ask if there is a budget to invest and what it will take for your stakeholders to say yes.
There might not be money to spend, but there is always an appetite to save.
Understanding the Total Cost of Ownership (TCO) and the tools’ Return on Investment (ROI) will make all the difference to budget holders or finance. It is their language. Show the TCO and ROI and I am confident that you will be able to get the tools that enable you to do the job better, faster and with more job satisfaction.
Contact me if you would like help with this.
