Software Testing with Visual Studio 2010

Foreword xvii Preface xxi Acknowledgments xxix About the Author xxxi 1 State of Testing 1 Software Testing Challenges 1 The Need for Testers 3 A Different Approach 5 Fixing Communication 5 Increasing Project Visibility 6 What Are the Tools Designed to Do? 7 Metrics 10 Citations 12 2 Software Quality and Testing Overview 13 Software Quality 13 Requirements 14 Business Value 14 Expectations 15 Nonfunctional Requirements 15 Where Do You Build Quality? 17 Process and Quality 19 Software Testing 19 The Testing Mindset 20 Software Testing Strategies 21 Types of Software Testing 22 Test Management 27 After the Product Is Shipped or Deployed 27 3 Planning Your Testing 29 Microsoft Test Manager 30 Test Plans 36 Properties 38 Contents 43 Adding Suites and Test Cases to Your Plan 46 Testing Configurations 48 Managing Test Configurations 49 Assigning Test Configurations 51 Assigning Testers 53 Test Case Planning Workflow 55 Analysis and Initial Design 56 Construction 61 User Acceptance Testing 62 Common Scenarios 64 Scheduling and Tracking Test Case Creation and Execution 64 Feature Driven Development 65 Moving from One Iteration to Another 67 Handling Different Test Configurations 68 4 Executing Manual Tests 71 Using the Test Case Work Item Type 72 Shared Steps 75 Data Driven Test Cases (Test Parameters) 77 Running Your First Tests 79 Test Runner 80 Examining Test Results 92 Test Run Results 93 Detailed Test Results 95 Exploratory Testing with MTM 101 5 Resolving Bugs 107 A Bug's Life 107 Customer Reported Bug 110 Test Team Reported Bug 110 Triaging the Bug 110 Reactivations 111 Bug Differences and Modifications 111 The Generated Bug 116 How a Developer Uses IntelliTrace 120 Fixing the Bug 122 Associated Changesets 124 Associated Work Items 124 Impacted Tests 125 Setting the Build Quality 125 Assigning a New Build 127 Verifying That the Bug Is Fixed 129 Dealing with Impacted Tests 131 6 Automating Test Cases 135 To Automate or Not to Automate 136 The Automated Testing

Jeff Levinson has 16 years of experience in software development in many different roles-developer, tester, architect, project manager, and scrum master at several large companies. Jeff is currently a Senior Application Lifecycle Management (ALM) Consultant for Northwest Cadence, which is a company that specializes in Team Foundation Server, Visual Studio, methodologies, and process improvement. In his day-to-day work, Jeff helps teams, organizations, and companies adopt more efficient processes, improve quality, and reduce costs associated with software development. Jeff is a frequent speaker at industry events and writes a twice-monthly column for Visual Studio Magazine Online. This is his fourth book on software development. His other books are Building Client/Server Applications with VB.NET (Apress 2003), Pro Visual Studio Team System 2005 (Apress 2006), and Pro Visual Studio Team System with Team Edition for Database Professionals (Apress 2007). Jeff has a master's degree in software engineering from Carnegie Mellon University and is an MCP, MCAD, MCSD, MCDBA, and MCT. Jeff currently lives in Washington State with his wife and two children.

"Jeff Levinson has written a remarkable book. Remarkable because it distills a massive amount of information into a clear, readable book that will teach you how to best use the Visual Studio 2010 Testing Tools. Remarkable because it shows not just how to use the strengths of the tools, but also how to work around any of their weaknesses. Remarkable because Jeff walks you through the implementation strategies that can bring real business value, not just to the testing team, but also to test the entire organization. If you are implementing the test tools, this book belongs on your desk. My dog-eared and marked-up copy sits on mine." --Steven Borg, Owner, Northwest Cadence "Testing--and testers--don't get enough respect. By providing a great mix of the what, why, and how of testing with Visual Studio 2010, this book will help change that. More important, it will help make the software we use better." --David Chappell, Principal, Chappell & Associates "Jeff has once again written a great book, filled with nice nuggets of testing wisdom. A great addition to your testing and ALM library for anyone using Visual Studio 2010 and Team Foundation Server 2010." --Mickey Gousset, Microsoft ALM MVP and Senior Technical Developer, Infront Consulting Group "Jeff's book is by far the most in-depth investigation of the Test features in Visual Studio ALM I have seen. His insight and experience help the readers understand the impact of poor testing and how they can improve the quality of their software. I particularly liked the obvious real-world understanding of the realities of software testing when applied in practice and the effort by the author to show the readers the ways around those realities." --Martin Hinshelwood, Visual Studio ALM MVP and Visual Studio ALM Ranger "Software Testing defines much more than the usage of a testing tool; it shows the practical way in which we test at Microsoft Corporation. Additionally, this book provides the definitive process to using