What testing tools to use?

[wrack]

Hi,

I am doing a research for the purpose of automating the task of unit testing, regression testing and stress testing.

The application is written as a client - server app both components written in .NET. Server is running as a service but can also run as a console app. Connects to a SQL Server 2008 database using ADO.NET. Client connects to the server using IPC or TCP remoting channel. We are not making a shift to WCF just yet.

So the question is does anyone has any experience with any testing tools? My research has led me to shortlist (purely based on their descriptions). I would welcome any other suggestions or experience with any of the tools listed below.

VS 2010 Ultimate
Testing the Application
http://msdn.microsoft.com/en-us/library/ms182409.aspx

What's New for Testing
http://msdn.microsoft.com/en-us/library/bb385901.aspx

Configuring Test Controllers and Test Agents for Load Testing
http://msdn.microsoft.com/en-us/library/ms243155.aspx

Managing Your Virtual User Licenses for Load Testing with a Test Controller
http://msdn.microsoft.com/en-us/library/ee850544.aspx

Using UI Automation for Automated Testing
http://msdn.microsoft.com/en-us/library/aa348551.aspx


Borland

Silk4Net
http://www.borland.com/us/products/silk/silk4net.html

SilkPerformer
http://www.borland.com/us/products/silk/silkperformer/index.html


AutoIt (EDIT: THIS SEEMS TO BE JUST A SCRIPTING TOOL SO OUT OF SCOPE FOR ME)

http://www.autoitscript.com/autoit3/index.shtml


IBM

Rational Functional Tester ($$$ Damn!)
http://www-01.ibm.com/software/awdtools/tester/functional/index.html


HP

Unified Functional Testing Software
https://h10078.www1.hp.com/cda/hpms/display/main/hpms_content.jsp?zn=bto&cp=1-11-127-24%5E1352_4000_100__


AutomatedQA

TestComplete
http://www.automatedqa.com/products/testcomplete/

If you have any experiences with any of these then I would also love the PRO vs. CON arguments too.

TA :)

[Nightwalker83]

Which .net language just vb.net or other .net languages as well? You have posted multiple questions for the same question One thread will suffice.

[Techno]

Generally I use VS 2010 Ultimate for testing and also NUnit for unit tests.
I use sometimes Rhino Mocks for mocking or NMock or Isolator.

NCover for code coverage

generally speaking, industry standard is to use VS2010 for testing and also NUnit.

[Nightwalker83]

Generally I use VS 2010 Ultimate for testing and also NUnit for unit tests.


I use those products for testing as well.

[kevininstructor]

In regards to automated testing tools, they can be helpful but you need to keep on top of the scripts as in if the UI changes than so does the testing scripts for one example. Avoid writing scripts by any recording method as this relies on controls being at specific coordinates so it is best to write scripts that target controls no matter where they are on the screen. Plan on spending a good deal of time learning how to use the tools within whatever automating testing tool you select followed by how to properly writing scripts. We invested a good deal of money and time with a tool called Visual Test 6 (if I remember correctly), used it for several years but eventually stop using the tool because our testers did not see enough benefits from using any testing suite. The original testers were developers who were fine with using automation testing tools but testers that came afterwards had no background in developing apps which help lead to phasing out the use of automated testing even with using VT helping with things like stress testing that is harder to pull off without such a suite of tools for automating many users stressing out a specific application.

[brad jones]

Wrack - people with fewer posts would be immediately banned for posting the same message in four threads. That is simply spamming. Please don't do that again without permission from the admins. Duplicate threads are being removed.

Thanks,

Brad!

[wrack]

My apologies Brad and to those who pointed out that I posted multiple posts. My reason was to post them in VB & C# section were many peoples who visit there don't normally visit low volume sections like testing (this is in my experience).

Again my EXPERIENCE is no excuse to spam so SORRY about that.

Now back to the topic, to give more information.

The application is written in C#. Many of the UI controls are DevExpress components along with standard .NET controls shipped with VS. We are using VS 2008 at the moment but I don't mind pushing the whole team to VS 2010 if the VS 2010 can do the job. We are not doing it because we haven't upgraded third party components just yet and the client is not willing to spend money unless necessary.

So if I understand corretly then VS 2010 ultimate would give me unit testing, regresstion testing and stress testing but not automated UI testing.

What if I were to sacrifice the UI testing bit in favour of backend methods which are called by the UI anyways. Would any of the tools I listed be sufficient?

What if I can't sacrifice the UI testing?

What about a tool that can target multi platform development (don't think these exist) like .NET, iOS, Android, Windows Phone?