Test Management Forum - July 2014

The 43rd Test Management Forum will take place on Wednesday 30 July 2014 at the conference centre at Balls's Brothers, Minster Pavement.

Eventbrite - Test Management Forum - 30 July 2014

Programme/Timetable

13:30pm Tea/Coffee
14:00pm Introductions
14:15pm Mike Bartley, Test and Verification Solutions
Testing the Internet of Things
Joanna Newman, Ericsson

Approaching Technically Complex Test Projects: Techniques and Lessons from the Coalface

Tony Bruce, Associate from Equal Experts
Remaining Relevant
15:30pm Tea/Coffee
16:00pm

Paul Gerrard, Gerrard Consulting
Future Organisation of the TMF

Thorsten Heinze, EC Interactive
What can we Learn from Testing in the Games Industry?
Declan O’Riordan, Testing IT
Security Testing – Where are we now?
17:15pm Drinks Reception

Abstracts

Mike Bartley, Test and Verification Solutions, Testing the Internet of Things
The Internet of Things (IoT) refers to uniquely identifiable objects and their virtual representations in an Internet-like structure. It is a fairly loose definition but potentially represents the next generation of computing devices as analysts estimate an installed base of approximately 212 billion interconnected things by 2020.

So how do we test such an amorphous object? In this session we will discuss the types of software involved, the attributes we want for such software (such as Correctness, Performance, Safety, Reliability, Availability, Resilience, Security) and how we can test for such attributes.

Joanna Newman, Ericsson, Approaching Technically Complex Test Projects: Techniques and Lessons from the Coalface

Interested in improving your Test Management capabilities? In this session, I'll review approaches to dealing with technically complex test projects:

  • how to determine a 'pass' when everything is still in beta
  • sampling techniques for big data projects
  • determining robust and realistic test cases for scalable functions
  • managing performance targets and deliverables when the answer really is about the length of the string

This will be an interactive session so please bring your stories too!

Tony Bruce, Associate from Equal Experts, Remaining Relevant

The times they are a changing. Constantly.

What can we.....should we be doing to ensure we remain relevant?

Is it a case of screaming to be heard to prove our value?

Forgetting about job titles and utilising our skills where needed?

Remembering and using all the buzz words you can?

Up-skilling? What would you focus on?

This will be an interactive session within which you can share your thoughts.

Paul Gerrard, Gerrard Consulting, Future Organisation of the TMF
This is a special session for those who want to be involved in the organisation of the Forum in future. About fifteen people offered to help with the Forum, and on Wednesday 10th, eight of us had an informal chat about what could be done to improve the organisation (which is barely existent at the moment), to broaden the net to find good topics and session facilitators and so on. But I also want to suggest the Forum could be used as a vehicle to promote other testing-related initiatives that align with our principles (such as they are) and advance our profession.

I suspect we won't be creating a working party or formal committee. For the time being, we'll call the group of volunteers, "Friends of the TMF".

Thorsten Heinze, EC Interactive, What can we Learn from Testing in the Games Industry?
The games industry is a constantly changing and evolving beast and you need to keep up with the newest developments at any given moment, with all the multitude of types of games, genres, hardware and business models this industry is one of the most complex and tightly knitted community.

The games changed from simple Jump'n'Runs to complex virtual worlds where players are free to explore and interact which also change the development requirement radically.

Several project management types are merged and mended to fit the needs of the project and teams which work on these titles that you don't have a clear agile or waterfall you face anything in between with a huge focus on flexibility, at the beginning games were all developed in a waterfall environment and had clear separate phases while today's projects are often started with a vertical slice to please investors and publishers then the content and more gameplay is added on top of those.

Additionally Free 2 Play started to grow and this involves a different whole strategy in itself as the development creates only a base game and the interaction of the players and the resulting data decides which direction the development heads as content is developed in accordance to players preferences due to the business model relying on players buying extra content not the whole product like in the traditional model. What did all this mean for QA?

At the beginning all games were linear and very easy to test single or maximum local multiplayer, todays games offer a whole different set of challenges. QA is faced with:

  • Open world gaming where the player decides in which order he takes on parts of the game which creates a multitude of possible buggy areas which do not exist in linear games
  • Procedural games where the game is every time different which makes this product not 100% testable only to a certain degree which requires different testing strategies
  • Localization got more complex as it is not only language but full internationalization is required to adhere to cultural sensitivities and law regulations

Roughly the direction with a elaboration on what this fluid environment can provide to other industries as learning base.

Declan O’Riordan, Testing IT, Security Testing – Where are we now?
Before anyone can seek help, they need to recognise they have a problem. The evidence that many organisations and individuals have a problem with computer security is everywhere, but do any of us have a security problem too? If we have, can we help each other cure our security testing problems? The TMF are a self-selecting group at the most passionate and professional end of the testing industry spectrum, but is it possible some of us have an aversion to personally dealing with security testing? Are we projecting too many of our security testing responsibilities onto others, and if so to whom?

Let’s undertake a security health-check and talk openly about our capabilities and goals. Since the subject is rapidly changing, a journey to complete security probably has no end point, but it does have a direction of travel. Before we can move in that direction we should ask ourselves: “Security Testing - Where are we now?”