On many occassions I have dreamed, wished, hoped, our platform was completely automated. I long for the day when I can just push a button and the testing is done. Wow... wouldn't that be great! Of course it would... but you need to know a few things before you begin your Automation journey.
Here is some information that can help you answer the questions... should you, can you and will you automate?
• If you are testing the same set of tests for each code release then automating those tests are your best bet.
• If you need to test against code that frequently changes in a timely manner to catch regression bugs then Automate.
• If you are frequently testing significant amounts of test cases on multiple browsers and/or OS platforms, try automating. Automated tests can be run at the same time on different machines, whereas the manual tests would have to be run sequentially.
• Are you testing non-UI aspects of the platform? If so, automation is the way to go.
• If you have the time, money and resources to dedicate to automating your platform, then do so. But remember, not only do you need to create your automated scripts, but you also have to maintain those scripts. Weekly releases of your code could equal a lot of maintenance!
• If you understand that you can’t automate everything, there are test cases that will have to be manually tested. If you have included that additional time into your testing cycle and you can still hit your deadlines, then go for it!
• The type of testing tool you use to automate makes a big difference in what you can and can’t automate. Free tools tend to have more limitations which means less automated scripts and more manual testing. The bigger more robust tools can be pricey, however you will have more flexibility and less limitations which means more automated scripts and less manual testing.
• If you have a few technical savvy Quality Assurance team members that can set up the server that will be the home to your automation framework, and they can troubleshoot and fix issues that arise within that framework, then you are on the right track.
• If you decide to automate do not go into it with the notion that it is the “be all to end all” and all your testing woes will be answered. Automation is a beautiful thing if you are prepared to put the heavy work in from the beginning and continue to do so while you maintain that bounty.
• If you think your Quality Assurance team has what it takes, management is on board and understands that automation will not happen over night, and you are ready to begin that journey, then please proceed below!
Here is a quick test that will help you determine what test cases can and can't be automated:
Is this test scenario automatable?
1. Yes and it won't take but a minute!
2. Yes, but I will be working on this for a week!
3. No, it is not possible to automate
How important is this test scenario?
1. This has to be tested ALL THE TIME!
2. This should to be tested regularly.
3. I only need to test this scenario once in a while.
If you answered #1 to both questions – definitely automate that test
If you answered #1 or #2 to both questions – you should automate that test
If you answered #2 to both questions – you need to consider if it is really worth the investment to automate
If you answered #3 to the first question - I don't think I have to explain to you that your manually testing that one.
If you answered #3 to the second question - it's probably not worth it to automate.
I recently read, AutomatedQA, Pragmatic Software and SmartBear had merged. Now... as I do consider myself a "semi-computer nerd", I'm not really interested in reading about mergers and acquisitions. But this story caught my eye....
When I finished reading the article, one word popped in my mind... "
genius". What a solid and creative plan to pull together 3 tools that every software development shop would need. An Automated test and performance tool, a requirements and defect tracking tool and a code review tool... like I said "
genius". And get this... they are affordable to even the smallest development shops, making integrated automation accessible to the masses!
I checked out their ALM Complete product and I was extremely impressed by what it offers, Project Management, Performance Management, Requirements Tracking , Defect Tracking, Collaboration and Reporting.
Believe me, I know times are tough and companies tend to lean more towards free shareware options, which is the route we take here at ThePort. But if you do have a small budget and want a more robust tool that would cover all your needs, take a look at what they have to offer. They pride themselves on being an affordable solution and spend the time differentiating themselves from the "big" automation providers. Another "
genius" move!
You can check out the full article at:
www.sdtimes.com
To learn more about the software offered by Pragmatic Software, SmartBear and AutomatedQA
click here!