Feedback requested: Test Review Tool

Hi folks.

We are always considering new ideas that will make unit testing, better unit testing, easier and safer for developers. One such tool we are working on as a proof of concept is a test review tool that will analyze your tests and give guidance and automated fixing ability on issues found in tests.

please do not share the following with anyone else.

the good news is that we have something you can play with that actually works with 7 “common” issues to find in unit tests. Currently, it is based on a tool called “CodeRight” and it is a set of custom rules for that tool.

to get started playing with this thing you need vs 2008.

download this document for full details on how to download and install the tool and custom rules for it.

Introduction: CodeIt Right for Tests

i need to know if you’d want to buy such a tool, or what you’d want to see added or changed that would make you buy it.

Please email royo@typemock.com with any questions, thoughts or ideas. We’ll looking to you to make this thing a reality if you believe it has merit.

CodeItRight for test review is like having an expert unit testing instructor sit next to you while you code. At any time you can ask CodeTitRight for a test review, and it can detect (for now) 7 common unit testing problems.

What problems can it find?

• 1) Missing asserts in a test (if the test is not names to expect an exception)
• 2) Calling a test from another test
• 3) Integration tests in a non integration project (using file system, registry access, random, threads, date and others)
• 4) Logic inside tests (if, loops, switches)
• 5) Multiple asserts against different objects in a single test
• 6) Usage of multiple mock objects to verify (instead of one mock and others as stubs)
• 7) Using random numbers in tests

Installation:

• · Install COdeItRight by downloading from http://api.typemock.com/files/CodeItRight/CodeIt.Right_v1.8.zip
• · Download http://api.typemock.com/files/CodeItRight/SubMain.CodeItRight.Rules.TEST.20091116.rar
• · unzip the zip files
• · put SubMain.CodeItRight.Rules.Test.dll at : C:\Program Files (x86)\SubMain\CodeIt.Right\Rules\ (remove "(x86)" for 32 bit systems)
• · put Test Profile.profile.xml at C:\Program Files (x86)\SubMain\CodeIt.Right\Rules\ (remove "(x86)" for 32 bit systems)
• · load visual studio
• · you should see a "codeitright" menu item as well as a combo box selecting which "profile" to use.
• · select the "Test" profile

Using it

Note: currently, as this is a proof of concept: it ONLY works with NUNIT

Right click on a test file or click on the “start analysis” button:

You will then see the results:

Some rules have a “correct” action or more associated with them. You can see those actions by either right clicking on the rules and choosing “correct” or opening the combo in the rule line:

CURRENTLY: FIXES DO NOT WORK. They are for demo purpose only to show possible ideas for correction.

Version 5.4.5 release next week

And you can get it first here – 32bit and 64bit.

First here’s the new feature of Intellitest: The behavior wizard.

When you use fakes, you can use the wizard to generate a WhenCalled statement for you.  Please try it, and let us know what you think about it.

Other bug fixes in 5.4.5:

Major improvements to fake object creation and recursive fake performance

Improved verification messages when verifying exact arguments, and two objects do not match

Natural Mocks auto-field mocking was not being properly reset

Intellitest suggestion extensibility now provides an event when a suggestion is about to be executed

PartCover 2.3.0 code coverage is now supported by Isolator

Small Company Promotion

Hi everyone,

We’re starting the promotion next Monday, Dec-7. It’s time to spread the word.

If you know people in companies under 25 people who are planning on buying Isolator soon – tell them to stop and wait for next week. If you know people who are interested in unit testing in general, point them to our blog and site. It is going to be worth it.

We’ll be twitting and blogging about it this week (the quiz is leading to that as well), as well as throughout the next weeks. It really is a chance to get into unit testing in a very, very low price (we’ll expose the exact deal here by the end of the week).

Help us get to these people, and make sure they get the best deal around.

Thanks in advance,

Gil

Newsletter from Typemock

Hi Guys,

We’re coming out with a newsletter for our customers.

What you see here is the first we’re going to send. Please let us know what we can do, as we want to improve.

What would you like to see next?

Thanks again!

An End of the year Promotion

Hi Guys,

We’re doing a promotion towards the end of the year. I can tell you it’s for small companies (up to 25 employees), and it’s going to be amazingly valuable for them.

We’re doing some hype build-up towards the beginning of the promotion (it’s starts on Dec-7). We’re putting up a special count down page, and we’re going to throw around clues about this.

You’re going to know about this first (obviously), but I’d like you to help us do some clue throwing. It’s about twitting and blogging if you can. And just to show everyone that you know what’s happening at Typemock before everyone else, you can throw the clues around before we do.

Don’t talk about it yet. I’ll be in touch.

If we pull this off (and we will), this is going to be very, very cool.

Typemock Tracker

As you probably know, we’ve announced Typemock Tracker. We see this as the best (and only) tool in your arsenal when you’re going out to persuade people to do unit tests.

This is our first tool that targets more than developers – it talks to managers in the universal language of $.

Please help us spread the word. Retweet, post about it (I did), tell us what you think, and offer people evaluating unit testing the option to actually see progress. And if you’re willing to share your finding, we’ll be grateful.

Go Tracking!

Typemock with Intellitest - Released!

Hi guys,

Thanks for all your help in the last couple of weeks! We've just released the new Isolator 5.4.2 with Intellitest, and posted a video of it - check out our public blog. We've managed to put in more functionality than we thought for this release, so this version supports, in addition to the early versions you got the opportunity to play with, suggestions on concrete classes and more.

Doron