It is sooooo slow at the office right now. Almost all the developers in my team are on a well deserved vacation, but that leaves us testers a bit bored. So when we finally got a fix to verify we went bananas with it. We did the usual routine; creating a playbook on a whiteboard and sorting out how things worked before and how it should work now. We went through the risk areas and settled on a couple of charters to run sessions on.









Then the fun started. Two big TV screens have been installed in one of the meeting rooms so we high jacked that room. We thought it would be a good idea to test run the TV also. So we got two Macs hooked up to a screen each and then we had some sessions the three of us. It was quite neat, everybody had their own computer but we had a good overview of what was happening in the logs and the environment since we could see the same things and discuss them. So my plan is to make the room into our new test lab. :)

Our new test lab:

More sunshine!

Ah, I can't believe we are having such lovely weather Stockholm! It just keeps being warm day after day and I'm loving it! It is even okay to be at work! Well, kind of. We compensate by eating a lot of ice cream. And since I don't have any vacation until September I just have to be positive about it. And still, I rather work and have the sun shining outside than rain... Any day of the week...

But, there is not so much to say about testing at the moment. I'm working on a presentation for SAST 2010 (Swedish Association for Software Testing) in October. Hopefully we will get started in looking at our processes and improve them during the summer, but as more and more people are going on vacations even that will be hard. So I guess I'll have to live with a slow pace the coming couple of weeks. That is quite alright with me :)

Enjoy the sun!

Summer time!

Finally, we are getting a bit of sun in the great capitol! It's about time I say. My objective during sunny days is to convince my colleagues that every meeting should be held outside down by the water and with ice cream. So far I managed to hijack one meeting this week. I'll hopefully get to more next week. Otherwise things are going into a nice slow summer rhythm. With so many going on vacation it's not so much to do at the office which is a nice change after a quite stressful spring with the opening of the France market. We went live with real money yesterday so now we have three sites. Or as my boss pointed out today, we go into a new market every summer. Two years ago it was Italy, last summer we went live with the new poker engine P5 and this summer France. I suppose next year will be Spain. And Denmark...

I think most of Europe will open up their markets in five years since they can not resist all the money they will make in taxes. And that is good, I am not a believer in monopolies. And the US market will follow as well. Even if it is a hassle with different governments having different requirements, based on the best promoting lobbyist it is better that we have regulated markets. Hopefully the swedes will get it some day as well, and knowing how much we looove our taxes I can't believe it will take them long to realize how much money they are loosing on keeping their monopoly.

So, go outside, dream about a world without monopolies and enjoy the sun and have an ice-cream!

India baby!

This sprint has finally come to an end. That's good, I'm ready for some swedish midsummer and nubbe. Most things have worked out quite well in the sprint, but my concern that we were too many sharing the testlog came true. It has been a bit messy, and nobody remembers what happened 2 weeks ago. AP (action point) for next sprint is that everybody has their own test log that can be merged into one test report at the end of the sprint.

Otherwise there is a new buzz in the office; bwin is discussing outsourcing to India! That is so cool! I attended a lunch meeting today where we discussed some of the changes that might take place and how we plan to handle them. I think this outsourcing will be great. It will be very interesting to work with these new circumstances, even if I won't be allowed to move to India. It will be challenging, but I'm game!

Have a great midsummer everybody!

It's getting messy

As I mentioned last week, in this sprint we have been working with teams within the team. It has been ok but it has also proven to create a new kind of problem. Because we are working on different features we test on different releases (not because we use the great system of branching, but because we ignore the releases that weren't meant for our specific feature.). The problem is that with every release we should update the changes in the testlog/playbook. After a while it is hard to know which risks are connected to which release. And right now I have no idea any more.

It would create a bit of overhead having different testlogs (I'm naming the document that we use to visualize risks/changes and ends up being the test report. Until it is a test report, it is a testlog.) And, if we have two different testlogs, do we merge them into one testreport at the end on the sprint? Or wait until we have done our sprint end testing and then merge everything together? Suggestion anybody?

Enough about that, today it is bwin Games summer party, so I'm off for some food and drinks and good times, see you next week!

Getting everybody on board

This sprint we are trying a new thing in order to strengthen the relationship between developers and QA in the team. We are doing teams in the team, i.e. we have teamed up in two smaller teams working with their own features. So far it is going quite well, it is much more easy to focus on a specific feature and not having to pick up every release and test it. It lessens the context switching which is something that we have suffered quite severely from.

Now we are sitting together, behind us is the whiteboard with the playbook from which we can discuss changes that might have affected other areas and if the risks have changed. Also we try to update our written playbook with every release. It's quite neat actually, we increase the area that needs more testing with 1, and in the end we can see if we are testing where the risks are. It is powerful, it is visual and there is no escape. The playbook tells us if we are testing the right things based on the risks. But see here comes the problem, which is the same as before; it doesn't feel like we have enough time to test all the changes. The developers are pretty fast in writing and changing the code, and we would have to work overtime to match all the changes. But, the upside is that we don't have to. Our responsibility is to be able to present what we have tested, and it is up to the company if they want to release it. They are presented the risk, in a far more obvious way then before.

I am so glad I don't have to make those decisions, if it was up to me nothing would be released ;)

But that is enough test talk for this week, I'm off to Riga to have a lovely weekend, I hope you do too!

The Joy of Visual Feedback

And we are done. Well, not done done as we say here at bwin Games, but more or less done with the testing of our new component TRS. Today I started working on collecting all the sessions I have written and checking them into Subversion. From there my colleague Per's fantastic php-thingy does it's magic and I can see how many minutes we spent on setup time and on testing time. All the data can then be moved to Excel where we have a nice cross-point diagram where you can see how much we have tested in different areas. Had we done a proper risk analysis during the sprint planning we could also have shown how much we have tested vs. how big the risk is. Unfortunately we didn't do this, but we have had discussions with dev about where to focus our attention, so we might be able to work with that somehow. I guess we learn as we go along. One important lesson I learned is that we need to keep the Playbook alive during the sprint and update it with changes so that we can migrate the risks correctly.

But it is so awarding to see all your testing being transformed into useful data! You can actually see that you have been doing something for the last three weeks! When we were running scripted test cases in regressions I had no confidence that I had tested enough. You somehow forgot what you did the first week, and it is only what you do during the last week in regression that shows for anything. Now we have a track record for the whole sprint.

So with this happy feeling I am going out in the sun for some ice cream. See you next week!