All posts by Stephen Janaway

This is my website :)

Episode 7 of Testing In The Pub Is Now Available

Episode 7 of the software testing podcast that I record with Dan Ashby is now available. In this episode we talk about the idea of ‘schools of testing’ and compare and contrast approaches such as those from the ISTQB and context-driven communities.

You can download it from the site, via RSS or it’ll shortly be in iTunes as usual.

The End Of The Road For Test Managers?

I’ve been reading a lot about test management recently. There’s some excellent posts out there, in particular I’d recommend you look at this one from Katrina Clokie, explaining the changes that are required for test management to remain relevant in the world of Agile software development and continuous delivery.

She also links some other articles which I would definitely recommend you read, if you are interested in the subject.

My Interest

So why am I interested? Well for starter I’m a Test Manager. Over the last couple of years I have seen my role change, from one of leading a separate, large test department, to one of managing testers across a number of project teams. It’s about to change again.

I’ve seen the challenges being a Test Manager in an Agile environment brings, in particular the difficulty in remaining relevant in the eyes of product and development managers, and the challenges of understanding enough about multiple areas in order to be able to support your team members. Being a Test Manager in a Agile environment can be isolating at times, particularly when the department is big, and the number of agile teams is large. It requires an ability to balance a lot of information, priorities, and tasks, across a number of areas. Stakeholder management and influence become key. Context switching comes as standard. Often it’s not much fun.

Through discussions with others, and looking at my own situation, I’m increasingly coming to the conclusion that the new ‘Agile Test Manager’ positions that Test Managers are moving/ falling into just don’t fit with the ways that teams want to work anymore. The team is more important than the manager, and, for example, choosing to keep discipline based management because it means testers are managed by testing ‘experts’ isn’t enough to justify it. Managers are not able to effectively support their people if they do not have the time and energy to keep fully in the loop with the team. As Test Managers get split across multiple teams, (primarily because having one Test Manager per Agile team is massive waste),  then it becomes nearly impossible.

Continuous Delivery

Moving to Continuous Delivery complicates matters further. Giving a team complete autonomy to design, build and release it’s own code is an extremely motivating way of working. Do Test Managers fit in with this ? I’m not sure they do. Where independence and autonomy are key, management from someone from outside of the team just doesn’t fit, particularly when that management is only part-time.

Change Is Coming

So how do we change? Do Test Managers merely become people managers, desperately trying to understand what their people, spread across multiple teams, are up to? Are they there to help manage testing but not people?? What about the coaching and mentoring, the sharing of knowledge and expertise, and the personal development of testers?

As I see it I think we’re going to see a lot more of this sort of setup:

  • Engineering Managers, who line manage an entire team. They understand the people best because they work with them day-to-day. No need for handovers, no need for performance feedback requests to other managers at review time, and no need to waste time and effort with coordination. Engineering Managers manage the whole delivery process and people involved. They may have come from a background of expertise is a particular discipline, but now they need to be able to represent all. But crucially they are focused on the management of a team who own a particular product or component and so share a single focus with their team.
  • Test Project Managers, who manage larger testing projects/ programme’s and dedicated testing phases such as UAT and customer acceptance. No people to manage, just deliverables. This role is very dependant on the nature of the software/ hardware solution being delivered. It’s most likely not needed in a lot of companies.
  • Test Coaches, who help organisations deliver the optimum testing possible. This means through coaching, mentoring, advising and working with engineering managers and whole teams in order to help them optimise their testing effort. Similar to James Bach’s idea of Test Jumpers, but with more focus on providing advice, guidance and strategy. In smaller companies they are much more likely to be exactly like the idea of Test Jumpers. Call them Test Jumpers, Test Managers, Heads of Testing or whatever, but the key point is that they are test experts who have the mandate to support testers in multiple teams but do not manage them. They can assist with recruitment and personal development if required, but are not a particular person’s official manager, and may get involved more with recruitment and personal development process, rather than people.

What Next?

The dedicated Test Manager, who manages testers and testing is not a role I can see continuing for too much longer. It is a hangover from the past, when large, dedicated test teams needed management, and it simply does not fit with how a lot of teams work anymore.

But, and this is a big but, I work in web, web services and mobile. I’ve seen the push for Agile and the push for Continuous Delivery because it fits the nature of the projects and technology used in these areas. Team’s are lean and projects are short. Almost certainly this makes me biased.

I would be interested to know what you think. Do you think the traditional Test Management role is reaching the end of the road?  Or is it alive and well, and relevant in the area that you work? Why not leave a comment below and get the conversation started.

Speaking At Mobile App Europe – Discounts

I’m going to be speaking at the first Mobile App Europe conference, which is on 28th September – 1st October in Potsdam, Germany. My presentation will be about mobile software testing and I’m part of what looks like a great conference, with keynotes from Jonathan Kohl, Dr. Chaehan So, Jesse Freeman, Stefan Bielau and Christian Kaar.  There’s also lots of other excellent looking talks and learning opportunities on offer.

I’m really looking forward to it.

The early bird pricing ends in two weeks time and I also have a speaker discount which will get you another 10% off the ticket price. Let me know if you’d like it and I’ll share it with you.

Interviewed For the uTest Testing Blog

I was interviewed recently for the uTest blog. I’ll be speaking about ‘Testing As An Activity’ at the forthcoming Next Generation Testing Conference, and so they asked me some questions about the topic, as well as some more general one’s about my thoughts on testing and how I started in the industry.

Worth a read I reckon, (I am biased of course). You can find the uTest blog post on their site.

More details on the Next Generation Testing Conference are on their site.

Testing In The Pub Episode 6 – Continuous Delivery Part 2

Episode 6 of the software testing podcast I record with Dan Ashby is now available. This time we continue our interview with Amy Phillips about Continuous Delivery and how testing fits in with Continuous Delivery.

You can download it directly from the Testing In The Pub site, search for us on iTunes or subscribe using our RSS feed from your favourite RSS reader.

All feedback is most welcome, we want to produce a podcast that people want to listen to 🙂

Live From Nordic Testing Days – Day 2

I’m back at day 2 of Nordic Testing Days. I’ll be around until lunchtime so expect mind maps and photos from this mornings sessions here.

I am now in Raji Bhamidipati’s note taking workshop. It was a good session.

First up, Anto Veldre, talking about Software Errors As The Founding Pillars Of Modern Society. Wow, he had a lot of slides! I caught bits and pieces in this mind map but it’s by no means the whole story.

image

image

Great party last night and a more muted start 🙂

Live from Nordic Testing Days – Day 1

I’m here in Tallinn for Nordic Testing Days. I will be blogging and posting mind maps here throughout the day.

Last up, Pete Walen and Matt Heusser, talking about complete testing. This one is much more Q&A based so no mind map I am afraid. You need to be here. We have sweets 🙂

image

Gitte Ottosen is talking about Pragmatic Testing. You can find my mind map here.

image

I talked about Testing Your Emotions. You can find my slides here.

image

Interesting session on Drawing To Learn from Ruud Cox. My mind map is here.

Next up Beautiful Builds with Roy Osherove. My mind map of his session is here.

image

image

First up, Testing In The Automation Age from Jevgeni Kabanov. Here is my mind map.

image

image

Check back for more later.

Testing In The Pub Episode 5 – Continuous Delivery

Episode 5 of the software testing podcast I record with Dan Ashby is now available. This time we interviewed Amy Phillips about Continuous Delivery and how testing fits in with Continuous Delivery.

It was certainly fun to record an interview, and I think we got a lot of good discussion going. It’s well worth listening to (ok I am bias but….) It’s a two part interview and we’ll be publishing the second part next week.

You can download it directly from the Testing In The Pub site, subscribe from iTunes or using our RSS feed from your favourite RSS reader.

All feedback is most welcome, we want to produce a podcast that people want to listen to 🙂

Forthcoming Speaking Engagements

I’ll be speaking at a number of conferences in June. It would be great to catch-up with you if you’re there.

Testing Your Emotions

Thursday 5th June – Nordic Testing Days – Tallinn, Estonia

In this talk I intend to explore the situations that projects teams typically encounter and how these impact the emotions that everyone in the team faces. I will explore typical dimensional models of emotion such as those proposed by Robert Plutchik and Hugo Lövheim and use these, and others, to help explain how we can better understand the emotions that we face, and the emotions that we raise in others.

More details here.

Best practices in managing QA testing for the multi-device nightmare

Wednesday 18th June – Enterprise Apps World – London

  • How many devices do you need to test from?
  • How effective is the emulator as a substitute or support to testing on actual devices?
  • How do you balance the functional, compatibility and performance testing requirements across devices?
  • Determining the severity of bugs– How to go about analysing the number of devices affected, the device configurations and ultimately the user base affected.
  • Consideration of issue resolution strategies post launch.

More details here. 

Testing As An Activity

Next Generation Testing Conference – Thursday 26th June – London

Recently I’ve started to come to the belief that we can solve a lot of our problems if we just start to think differently about testing. Instead of thinking about software testing only as a distinct discipline, we should to start to think about it as an activity. After all, testing is just that, an activity. It’s something we do. Something we’d love others to do more. James Bach likes to define software testing as a performance, and what is a performance without some activity to perform?

In this presentation I will explain why we should start to think of testing as an activity, what the benefits are that this could bring, and discuss how teams can work in a more efficient and cross-functional way as a result.

More details here.