Okay it's been a while but here's an update with where we're at with Whidbey on the dev side. A few weeks ago we passed ZBB for Beta 2. What's ZBB you say? Well I'm glad you asked. Basically, you need to drive the product to a "known" state at intervals throughout the cycle or you'll never get it shipped. So before each major milestone, the whole division drives towards Zero Bug Bounce, on a per-team basis. ZBB for a team is when that team has zero active bugs for a moment in time. Now, for this to happen there are some caveats. Brand new bugs, usually less than 48 hours old, don't count. Certain types of bugs that we call "tracking bugs" don't count, since those are usually in the system to track something that isn't a specific bug. And there's usually some other special case exceptions but that's the idea. And there is a set of bugs that get pushed over to the next milestone for one reason or another. For example, we pushed a set of bugs over that didn't really need to be fixed for Beta 2. We made sure we fixed all of the Priority 1 bugs and most of the Priority 2 bugs. We feel okay saving some of the fit and finish stuff until after Beta 2. I was most concerned about getting fixes in for any large, very complicated, or very risky fixes so that we can get the maximum bake time in.
We started our Beta 2 push in earnest in early July, with some work items we call DCR's (Design Change Requests), and when we wrapped those up we moved directly into the ZBB push. Between June 25th and November 12th, the dev team fixed over 3,500 bugs. Realize, I've got about 14 devs on the team fixing bugs so that's pretty amazing. The team as a whole resolved (not all bugs that are filed get fixed -- some are duplicates of other issues, some don't reproduce by the time we get to them, some are actually by-design behavior) over 7700 bugs, and 5300 new ones came in during that amount of time, so we had a net gain of about 2200 bugs over that period of time. Just in the 3 weeks starting October 11th, the team resolved 2022 bugs, which is really amazing. During the same period of time QA was doing their full test pass (FTP) which generates the vast majority of these issues -- we don't normally see that kind of incoming!
It was a ton of work but we feel really good about this Beta 2 and we think you'll like it too. We were really hard core about getting the right bugs fixed for this beta, hopefully we made the right choices. Ladybug has definitely helped us make some of those decisions.
So that's where we sit. Fortunately we're right up on the holidays so the team gets a well-deserved break. After the holiday's we'll lock the tree down for work on super-critical issues and stress bugs, then head towards shipping this thing. We'll start fixing the bugs that we pushed out of Beta 2, spend some more time on performance across Windows Forms, and maybe even start scratching our heads and thinking about what's next. Whidbey kicked off (for real, there's a long story here...) in September of 2002 so it's been a pretty long road!