Вы находитесь на странице: 1из 20
2016
2016
State of Testing Report
State of Testing Report

Sponsored by

2016 State of Testing Report Sponsored by
2016 State of Testing Report Sponsored by

Share

Share Table of Contents State of Testing project Respondent Demographics Tester’s Professional Profile How Testers are

Table of Contents

State of Testing project

Respondent Demographics

Tester’s Professional Profile

How Testers are working

Skills

Testing Process

Testing Challenges

Your Predictions to the Future

Final Note

Collaborators

3

4

5

7

9

12

14

16

18

19

Sponsored by

Note Collaborators 3 4 5 7 9 12 14 16 18 19 Sponsored by © 2016

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

-3-

State of Testing project

The current times are exciting for testers, aren't they?

Many changes are taking place around us. Technology is advancing at a head-spinning pace. The accelerating pace of development is making our work more challenging than ever. And overall we are seeing a more serious approach towards quality and testing in our work-ecosystem.

Today, we feel that testing is seen as a critical activity by many of the same people who used to see testers as “unskilled individuals” doing least important tasks in the end and slowing down their deliveries.

This change in perception is also having a positive impact on everything right from allocating budget, to the kind of meetings we testers are being invited to. Moreover it seems to be improving how people listen to what we have to say about the product and processes in our projects.

Oh, are we spilling the beans here already? Okay, we’ll stop here now and would let you go over the findings yourselves! Although we do want to let you know that State of Testing survey 2016 has been biggest ever, with the participation from over 1,000 professionals from 61 countries!

Once again we would like to thank our Review Panel

About the State of Testing Survey

The State of Testing is the largest testing survey worldwide. With more than 1000 participants from more than 60 countries, the survey aims to provide the most accurate information of the testing profession and the global testing community. Held yearly, the survey also captures current and future trends.

With more than 20 leading testing bloggers and thought leaders helping us make this survey a reality (see collaborators list at the end), this survey is all

Sponsored by

list at the end), this survey is all Sponsored by Share members Jerry Weinberg, Keith Klain

Share

list at the end), this survey is all Sponsored by Share members Jerry Weinberg, Keith Klain

members Jerry Weinberg, Keith Klain and Daniel Knott, who helped us with insightful feedback on the questions for the survey.

We also want to thank all the collaborators who helped us by blogging and posting about the project, making sure the news of the survey reached literally the remote corners of the World! You can know more about these awesome people in the list at the end of this report :-)

And finally we also want to thank everyone who answered the survey and helped make 2016’s State of Testing Report possible!

We invite you to go over the information below, and we also recommend to go over it twice - like every good tester who examines the information critically :-) A quick tip would be just to skim over the report quickly to get a general feeling of what is happening over in our testing ecosystem; and then you may take the deep dive into analysis and the comments for each of the aspects reviewed.

Like previous years, we are sure you will find State of Testing Report - 2016 to be having many interesting facts and even some pleasant surprises. We hope this information will help you improve further on professional front together with your testing teams.

Enjoy! Lalit and Joel

about giving you, as a tester, the ability to better understand your professional status compared to other testers and companies worldwide, and to be better prepared based on the current and future trends. We are always happy to hear feedback from testers so feel free to contact us.

* As in previous years, we expect to have a translation of this survey to Japanese as well. If you’d like to translate it to your own language, let us know.

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -4- Respondent Demographics Geographical location Europe (& Russia) 48 % USA/Canada 21 % India

-4-

Respondent Demographics

Share -4- Respondent Demographics Geographical location Europe (& Russia) 48 % USA/Canada 21 % India

Geographical location

Europe (& Russia)48 %

48%

USA/Canada21 %

21%

India  11 %

 

11%

 

Asia (w/o India)7 %

7%

Other  4 %

 

4%

Latin America3 %

3%

Australia / NZ3 %

3%

Middle East2 %

2%

Africa1 %

1%

48% 21% 7% 2% 11% 1% 3% 3%
48%
21%
7%
2%
11%
1%
3%
3%
1 2 3 4+ location locations locations locations 23% 14% 30% 33%
1
2
3
4+
location
locations
locations
locations
23%
14%
30%
33%

Size of the Testing Team

We are starting to see a trend where testing teams are getting smaller year after year in comparison with the results from the previous surveys. It will be interesting to check if this trend continues in our next surveys.

By looking into the data, we see the same trend as in previous years where testing teams in North America, Western Europe and Australia are becoming smaller, while in contrast teams in India, Asia, Eastern Europe and the Middle East keep getting bigger.

Number of geographical Locations where your company works

When we asked how many locations does your company work have, we saw that teams are even more globally distributed today than in our previous surveys.

We also saw, by drilling down into the answers, that more than half of the respondents who work in small testing teams (of 5 testers or less) also work on development teams distributed in two, three or more locations!

The bottom line is that testing and development have become distributed tasks, and as testers we need to develop the necessary skills to thrive in this new reality.

1-5 Testers

1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %
1-5 Testers 34 %

34% %

34 %
34 %
34 %

6-15 Testers

6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %
6-15 Testers 25 %

25% %

16-50 Testers

16-50 Testers 21 %
16-50 Testers 21 %
16-50 Testers 21 %
16-50 Testers 21 %
16-50 Testers 21 %
16-50 Testers 21 %
16-50 Testers 21 %

21%

51+ Testers

51+ Testers 20 %
51+ Testers 20 %
51+ Testers 20 %
51+ Testers 20 %
51+ Testers 20 %
51+ Testers 20 %
51+ Testers 20 %

20%

Sponsored by

16-50 Testers 21 % 51+ Testers 20 % Sponsored by © 2016 - PractiTest & Tea

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -5- Tester’s Professional Profile Testing as a profession & not a stepping stone 5 %

-5-

Tester’s Professional Profile

Share -5- Tester’s Professional Profile Testing as a profession & not a stepping stone 5 %

Testing as a profession & not a stepping stone

Profile Testing as a profession & not a stepping stone 5 % <1 year 10 %

5%

Testing as a profession & not a stepping stone 5 % <1 year 10 % 1-2

<1 year

as a profession & not a stepping stone 5 % <1 year 10 % 1-2 years

10%

a profession & not a stepping stone 5 % <1 year 10 % 1-2 years 25%

1-2 years

25%
25%
not a stepping stone 5 % <1 year 10 % 1-2 years 25% 2 to 5

2 to 5 years

28%
28%
stone 5 % <1 year 10 % 1-2 years 25% 2 to 5 years 28% 5

5 to years

31%
31%

10+ years

It comes as no surprise that just like last year most surveyed testers have 5+ years of experience. This points to the fact that testing is not a temporary task that people do while they look for “better opportunities” in their companies or in life

Looking inside the numbers we see that testers in Eastern Europe, Latin America and Asia tend to have on average less experience than their colleagues in North

America, Australia and Western Europe.

We also see that in companies that don’t follow any formal development model (respondents replied they don’t follow a structured model or principle) testers tend to have significantly less experience than in companies following a structured development model, regardless of the model they choose.

development model, regardless of the model they choose. Salary Information Salary before taxes (including bonus and

Salary Information

Salary before taxes (including bonus and perks if any)

 

0-1 years

1-2 years

2-5 years

5-10 years

10+ years

Africa

5

 

5

NA

 

27

42

Latin America

NA

 

NA

24

 

18

34

India

9

 

11

16

 

23

38

Easter Europe / Russia

8

 

13

19

 

26

38

Asia

NA

 

8

26

 

33

64

Middle East

10

 

40

44

 

67

68

Western Europe /

         

APAC

30

 

43

50

 

69

89

USA / Canada

48

 

67

79

 

90

110

* Salaries in thousands of USD

* NA - not enough data to provide meaningful information

Compared to the data from the previous years, we see an increase in across the board for most areas and experience levels.

An interesting point here is that depending on the geographical area, the “jump” on the salary can happen during the interval of 2-5 years or experience or the one of 5-10 years of experience in the field.

Sponsored by

one of 5-10 years of experience in the field. Sponsored by © 2016 - PractiTest &

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Titles of Testing Professionals

Share

Titles of Testing Professionals Share -6- Is every second tester a test lead…? Test Engineers /

-6-

Is every second tester a test lead…?

Test Engineers / Test AnalystsShare -6- Is every second tester a test lead…? 37 % 9.5 % Other 4.5 %

37%

9.5% %

Other

4.5% %

Consultants

Engineers / Test Analysts 37 % 9.5 % Other 4.5 % Consultants 2 % Test Architect

2%

Test

Architect

Test Leads / Test Managers37 % 9.5 % Other 4.5 % Consultants 2 % Test Architect 34 % 8 %

34%

8% 8

3% 3

2 % Test Architect Test Leads / Test Managers 34 % 8 % 3 % 2

2%

Automation

Testers

Software

Engineer

Project

Manager

3 % 2 % Automation Testers Software Engineer Project Manager We asked respondents what their professional

We asked respondents what their professional title is, and we still see that among our answers there is a similar number of Test Leads, Managers and Directors, as there are Test Analysts and Test Engineers.

Do we have just as many leads as we have testers? And if so, where are they leading us to? :-)

Looking “inside” the numbers we saw that the places where most respondents stated they work as “consultants” is in Western Europe and Australia/ NZ - something to keep in mind for those considering this option.

Among the “other” responses, we saw a large number of respondents who, in addition to working as testers, also fill the role of Scrum Master in their teams.

Testing can report to a number of departments in the organization

Project Development CIO / CTO Management Manager VP / Director of Quality 2016 2016 2016
Project
Development
CIO / CTO
Management
Manager
VP / Director
of Quality
2016
2016
2016
2016
37%
29%
23%
11%
2015
2015
2015
2015
33%
24%
33%
10%

This time, we see an interesting shift in the answers for this questions from last year. There is an increase in the percentages of people submitting the testing function reports to Project Management (37% vs 33% last year) and to the Development Manager (29% this year vs 23.5% last year), than to the VP or Director of Quality (23% this year vs 33% last year).

We believe this is the result of two separate trends, one where independent testing groups are starting to become part of organic development teams (Agile or Scrum), and a second trend where testing teams become part of the project management function in order to maintain the independence of the practice.

What do testers dowith all their (spare) time?

The most interesting trend here is that more than a third of the responding testers are handling integrations and deployment tasks, showing a small increase from last year’s number (from 35% to 37.5%).

We also see a sharp decreases in the number of testers handling the testing and development environments (down to 49% from 63% last year).

development environments (down to 49% from 63% last year). Sponsored by Handle documentation Manage the testing

Sponsored by

environments (down to 49% from 63% last year). Sponsored by Handle documentation Manage the testing &

Handle documentationenvironments (down to 49% from 63% last year). Sponsored by Manage the testing & development environments

Manage the testing & development environments49% from 63% last year). Sponsored by Handle documentation Integrations & deployments Requirements gathering

Integrations & deploymentsManage the testing & development environments Requirements gathering Develop internal tools Customer

Requirements gatheringdevelopment environments Integrations & deployments Develop internal tools Customer Support & training Unit

Develop internal toolsIntegrations & deployments Requirements gathering Customer Support & training Unit Testing (in addition to

Customer Support & trainingdeployments Requirements gathering Develop internal tools Unit Testing (in addition to other testing function)

Unit Testing (in addition to other testing function)Develop internal tools Customer Support & training Professional Services & Sales support 5 1 % 4

Professional Services & Sales supportUnit Testing (in addition to other testing function) 5 1 % 4 9 % 38 %

testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3
testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3
testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3
testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3
testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3
testing function) Professional Services & Sales support 5 1 % 4 9 % 38 % 3

51%

49%

38%

37%

35%

30%

21%

10%

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -7- How Testers are working Testers blend different approaches to do their work Exploratory /

-7-

Share -7- How Testers are working Testers blend different approaches to do their work Exploratory /

How Testers are working

Testers blend different approaches to do their work

working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair
working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair
working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair
working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair
working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair
working Testers blend different approaches to do their work Exploratory / Scripted Bug User Pair

Exploratory /

Scripted

Bug

User

Pair

Coordinated

Session based

testing

Hunts

simulations

Testing

user testing

testing

These numbers remain more or less unchanged year to year, with a small increase in the percentage of respondents running Exploratory or Session based testing, and a small decrease in the number of respondents running Scripted testing.

More interesting were the comments left on this question, where people mentioned they are also performing reviews and demos in order to catch issues in the system - nice and interesting approaches indeed!

Plenty of tasks to do other than checking the software 64% Requirement analysis 33% Code
Plenty of tasks to do other than checking the software
64%
Requirement
analysis
33%
Code review
meetings
49%
Risk analysis
55%
52%
Retrospective
Test reviews
meetings

63%

High or low level test planning

61%

Update

meetings

Sponsored by

or low level test planning 61 % Update meetings Sponsored by © 2016 - PractiTest &

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -8- Testing documentation is becoming leaner High level test plans 62 % Mind maps 33

-8-

Testing documentation is becoming leaner

High level test plansShare -8- Testing documentation is becoming leaner 62 % Mind maps 33 % Checklists 54 %

documentation is becoming leaner High level test plans 62 % Mind maps 33 % Checklists 54

62%

documentation is becoming leaner High level test plans 62 % Mind maps 33 % Checklists 54

Mind mapsdocumentation is becoming leaner High level test plans 62 % 33 % Checklists 54 % Test

is becoming leaner High level test plans 62 % Mind maps 33 % Checklists 54 %

33%

Checklistsis becoming leaner High level test plans 62 % Mind maps 33 % 54 % Test

leaner High level test plans 62 % Mind maps 33 % Checklists 54 % Test charters

54%

Test chartersHigh level test plans 62 % Mind maps 33 % Checklists 54 % 22 % Detailed

test plans 62 % Mind maps 33 % Checklists 54 % Test charters 22 % Detailed

22%

Detailed test scriptsplans 62 % Mind maps 33 % Checklists 54 % Test charters 22 % 50 %

% Checklists 54 % Test charters 22 % Detailed test scripts 50 % Lean documentation 20

50%

Lean documentation54 % Test charters 22 % Detailed test scripts 50 % 20 % 41 % Low

charters 22 % Detailed test scripts 50 % Lean documentation 20 % 41 % Low level

20%

22 % Detailed test scripts 50 % Lean documentation 20 % 41 % Low level test

41%

Low level test plans22 % Detailed test scripts 50 % Lean documentation 20 % 41 % Live docs 19

Live docs
Live docs
Lean documentation 20 % 41 % Low level test plans Live docs 19 % We see

19%

documentation 20 % 41 % Low level test plans Live docs 19 % We see a

We see a trend towards less scripted documentation with more people working with Mind-maps (33% vs 21.5% last year) and Checklists (54% vs 52.5% last year),

while at the same time detailed scripts and low level test plans are becoming less popular.

Formal training is on the rise 76% 68% On the job training & Peer Mentoring
Formal training is on the rise
76%
68%
On the job training &
Peer Mentoring
Self-taught (books,
magazines, Internet, etc)
34%
23% (2016) |17% (2015)
Certifications
Formal training
5%
5%
Testing diploma
Other

We see that formal training is increasing in popularity (up to 22,5% from 17% last year). Looking into the answers in more detail we see this is especially popular in India and Western Europe, while very unpopular in North America.

Something similar happens with certifications, where we

Sponsored by

similar happens with certifications, where we Sponsored by see that they are still popular in Western

see that they are still popular in Western Europe and Australia/NZ, while not very popular in North America.

Among the interesting “other” responses on how people learn testing we saw: Community Events and Conferences, Rapid Software Testing training, Learning by doing, Reading IEEE829 (really?!), Weekend Testing

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share Skills
Share
Skills

-9-

Share Skills -9- What skills do you need to be a good tester? Not important Important

What skills do you need to be a good tester?

Not importantSkills -9- What skills do you need to be a good tester? Important Very Important General

What skills do you need to be a good tester? Not important Important Very Important General

Important

do you need to be a good tester? Not important Important Very Important General testing methodologies

Very Important

General testing methodologiesto be a good tester? Not important Important Very Important Mobile technologies Web technologies Embedded systems

Mobile technologiesImportant Very Important General testing methodologies Web technologies Embedded systems Enterprise software &

Web technologiesImportant General testing methodologies Mobile technologies Embedded systems Enterprise software & processes

Embedded systemstesting methodologies Mobile technologies Web technologies Enterprise software & processes Performance & load

Enterprise software & processesMobile technologies Web technologies Embedded systems Performance & load Functional automation & scripting

Performance & loadEmbedded systems Enterprise software & processes Functional automation & scripting Security testing

Functional automation & scriptingEnterprise software & processes Performance & load Security testing Communication skills Customer facing skills

Security testingPerformance & load Functional automation & scripting Communication skills Customer facing skills Agile

Communication skillsload Functional automation & scripting Security testing Customer facing skills Agile methodologies Testing in the

Customer facing skills& scripting Security testing Communication skills Agile methodologies Testing in the Cloud Big Data Testing

Agile methodologiesSecurity testing Communication skills Customer facing skills Testing in the Cloud Big Data Testing Business Skills

Testing in the Cloudskills Customer facing skills Agile methodologies Big Data Testing Business Skills Programming Skills 4 % 4

Big Data Testingfacing skills Agile methodologies Testing in the Cloud Business Skills Programming Skills 4 % 4 8

Business SkillsAgile methodologies Testing in the Cloud Big Data Testing Programming Skills 4 % 4 8 %

Programming SkillsTesting in the Cloud Big Data Testing Business Skills 4 % 4 8 % 49 %

4%

48%

49%

 
 
 

11%

 

47%

42%

 
 
 

4%

40%

57%

 
 
 

32%

 

54%

15%

 
 
 

37%

 

50%

14%

 
 
 

10%

 

51%

40%

5 0 % 14 %   10 %   51 % 40 % 6 % 3
5 0 % 14 %   10 %   51 % 40 % 6 % 3
5 0 % 14 %   10 %   51 % 40 % 6 % 3

6%

5 0 % 14 %   10 %   51 % 40 % 6 % 3

33%

61%

%   10 %   51 % 40 % 6 % 3 3 % 61 %
%   10 %   51 % 40 % 6 % 3 3 % 61 %

11%

43%

10 %   51 % 40 % 6 % 3 3 % 61 % 11 %
10 %   51 % 40 % 6 % 3 3 % 61 % 11 %

46%

%   51 % 40 % 6 % 3 3 % 61 % 11 % 4
2% 21% 78%
2%
21%
78%

15%

43%

42%

 
 
 

8%

49%

43%

 
 
 

26%

53%

21%

 
 
 

35%

50%

15%

 
 
 

23%

53%

25%

 
 
 

19%

56%

25%

% 5 3 % 25 %   19 % 5 6 % 25 % Respondents are
% 5 3 % 25 %   19 % 5 6 % 25 % Respondents are
% 5 3 % 25 %   19 % 5 6 % 25 % Respondents are

Respondents are grading the skills somewhat different than in previous years.

We see them giving more importance to things like Mobile Technologies, Web Technologies, Agile Methodologies and Customer Facing Skills; while taking away from the importance of skills around Enterprise Software.

Another point to mention is that the most important skill, Communication Skills, is even higher this year than ever before!

We also asked for additional important skills that were not listed as options, and some of the interesting comments to note are: problem solving, flexibility, critical thinking, empathy, foresight, integrity, optimism, courage, humor, and imagination!

Sponsored by

optimism, courage, humor, and imagination! Sponsored by © 2016 - PractiTest & Tea Time with Testers.

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -10-
Share -10-
Share -10-

-10-

Share -10-
Share -10-
Share -10-
Share -10-
Share -10-
Share -10-
Share -10-
Share -10-

We turn to social media to keep up to date in testing

Twitter, Facebook, Linkedin & Blogs

Testing Books

Online Communities & Forums

Testing conferences, meetups & seminars

Testing Magazines

From other fields that help to improve testing (e.g. psychology, writing, etc)

Formal training

Testing competitions

Other

writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1
writing, etc) Formal training Testing competitions Other 65 % 6 0 % 56 % 5 1

65%

60%

56%

51%

46%

31%

28%

8%

7%

More and more testers are turning to social media in order to keep up to date with their testing knowledge! This response went up to 65% from 57.5% last year.

Most of the other responses also went up but not as steeply as this one.

We also asked for “other” ways of keeping up to do date and some of the answers worth mentioning were: participating in crowdsourcing projects, giving talks and learning from the feedback, webinars, pairing with developers, and one that we really liked “Looking beyond testing like DevOps and open source development contributions”

Sponsored by

and open source development contributions” Sponsored by © 2016 - PractiTest & Tea Time with Testers.
© 2016 - PractiTest & Tea Time with Testers. All rights reserved.
© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -11- Plenty of good testing gatherings, not only the very large conferences This year we

-11-

Share -11- Plenty of good testing gatherings, not only the very large conferences This year we

Plenty of good testing gatherings, not only the very large conferences

This year we asked as an “open question” what formal or informal conferences had respondents attended during the last 3 years, and we got a large number of answers - with many small and local tester gatherings:

of answers - with many small and local tester gatherings: CAST Agile Testing Days Nordic Testing

CAST

answers - with many small and local tester gatherings: CAST Agile Testing Days Nordic Testing Days

Agile Testing Days

Nordic Testing Days

TestBash

CAST Agile Testing Days Nordic Testing Days TestBash JaSST (Japan Symposium on SoftwareTesting) Let’s Test Star

JaSST (Japan Symposium on SoftwareTesting)

Let’s Test

Star Conference/s

Symposium on SoftwareTesting) Let’s Test Star Conference/s WACATE CukeUp! Weekend Testing Selenium Rapid

WACATE

on SoftwareTesting) Let’s Test Star Conference/s WACATE CukeUp! Weekend Testing Selenium Rapid Software

CukeUp!

Weekend Testing

Selenium

Rapid Software

 

Conference/s

Testing courses

Rapid Software   Conference/s Testing courses Testing meetups Scrum master certification/s GTAC

Testing meetups

  Conference/s Testing courses Testing meetups Scrum master certification/s GTAC Copenhagen Context

Scrum master

certification/s

courses Testing meetups Scrum master certification/s GTAC Copenhagen Context Ministry of Testing courses QA or

GTAC

Copenhagen

Context

Ministry of Testing courses

GTAC Copenhagen Context Ministry of Testing courses QA or the Highway TTP Training Tabara de Testare

QA or the Highway

Context Ministry of Testing courses QA or the Highway TTP Training Tabara de Testare (Rumania) EXPO:QA

TTP Training

Ministry of Testing courses QA or the Highway TTP Training Tabara de Testare (Rumania) EXPO:QA STP-CON

Tabara de Testare (Rumania)

QA or the Highway TTP Training Tabara de Testare (Rumania) EXPO:QA STP-CON SIGiST Testwarez Dutch Testing

EXPO:QA

the Highway TTP Training Tabara de Testare (Rumania) EXPO:QA STP-CON SIGiST Testwarez Dutch Testing Day North

STP-CON

SIGiST

Training Tabara de Testare (Rumania) EXPO:QA STP-CON SIGiST Testwarez Dutch Testing Day North West Tester Gathering

Testwarez

Tabara de Testare (Rumania) EXPO:QA STP-CON SIGiST Testwarez Dutch Testing Day North West Tester Gathering The

Dutch Testing Day

North West Tester Gathering

The interesting part is that many people are listing online events together with events they attended in person. A good point to take into account, is people who responded that they would have liked to attend, but

Sponsored by

that they would have liked to attend, but Sponsored by Romanian testing conference their company did

Romanian testing conference

their company did not agree to send them to any conference - meaning there are always alternatives out there! They may not be as good or fun as attending live, but second best is sometimes a good alternative :-)

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -12- Testing Process 23 % Project Management tools Do you use tools to track your

-12-

Share -12- Testing Process 23 % Project Management tools Do you use tools to track your

Testing Process

23%

Project Management tools

Do you use tools to track your testing?

There is a slight rise in the use of Bug trackers and Exploratory testing tools, while the rest of the solutions keep more or less stable. Among the “others” we saw people working with Google docs, Wikis, Kanban-boards, Notepad, Post-It notes, and our personal favorite was “adidas-style (=walking and talking)”

favorite was “adidas-style (=walking and talking)” 82 % Bug trackers 66 % Excel, Word, Mail and

82%

Bug trackers

66%

Excel, Word, Mail and the like

82 % Bug trackers 66 % Excel, Word, Mail and the like 20 % 50 %
82 % Bug trackers 66 % Excel, Word, Mail and the like 20 % 50 %
82 % Bug trackers 66 % Excel, Word, Mail and the like 20 % 50 %

20%

82 % Bug trackers 66 % Excel, Word, Mail and the like 20 % 50 %

50%

Test or QA Management tools

Mail and the like 20 % 50 % Test or QA Management tools Exploratory & note-taking

Exploratory &

note-taking tools

23% 18% 14% | 2015
23%
18%
14% | 2015
Exploratory & note-taking tools 23% 18% 14% | 2015 Agile is strong, and DevOps is getting

Agile is strong, and DevOps is getting stronger

82%
82%
39% 42% | 2015
39%
42% | 2015

Agile or

Waterfall or

DevOps

TDD

Agile like

waterfall like

18%
18%

Work based on their own unique model or principle

16% BDD
16%
BDD

We continue to see companies working based on blends of multiple methodologies.

Agile is still king with close to 90% of the respondents

Sponsored by

still king with close to 90% of the respondents Sponsored by 16% Work based on Context
16%
16%

Work based on Context Driven Models

6% Don’t follow any structure model or principl
6%
Don’t follow any
structure model
or principl

(almost the same as last year), but the main changes came from a decrease in Waterfall approaches (39% from 42%) and a very marked increase in DevOps adoption (23% from 14% last year).

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -13- Does your organization have automation? 86 % Have automation Areas of automation 11 %

-13-

Does your organization have automation?

Share -13- Does your organization have automation? 86 % Have automation Areas of automation 11 %

86%

Have automation

Areas of automation

have automation? 86 % Have automation Areas of automation 11 % | 12 % (2015) Don’t

11% | 12% (2015)

Don’t have automation in their projects

% | 12 % (2015) Don’t have automation in their projects 4 % | 2 %
% | 12 % (2015) Don’t have automation in their projects 4 % | 2 %

4% | 2% (2015)

Don’t know if they have automation

75%

46% | 40% (2015)

26%

21% | 14% (2015)

Functional or

Functional or

Continuous

Test Data

Write BDD scripts

Regression Testing

 

Integration

Integration
 

Generation

Generation
Generation

with Specflow, Gherkin, etc

Data Write BDD scripts Regression Testing   Integration   Generation with Specflow, Gherkin, etc
Data Write BDD scripts Regression Testing   Integration   Generation with Specflow, Gherkin, etc
Data Write BDD scripts Regression Testing   Integration   Generation with Specflow, Gherkin, etc

46%

Load & Stress Testing

We see an interesting increase in the percentage of respondents saying they use automation for Continuous Integration (45.5% vs 40% last year), and we believe this is the reason that Unit Testing also increased this year as they are directly related.

43%

Unit Testing

23%

Home-built scripts used as required

The other answer that showed an interesting increase was the use of BDD, getting to 21% from 13.5% last year.

Do you know how much automation you have?

4% 21% <90% 50-90%
4%
21%
<90%
50-90%

Sponsored by

automation you have? 4% 21% <90% 50-90% Sponsored by 37 % 10-50% 27 % 10%> 12

37%

10-50%
10-50%

27%

10%>
10%>

12%

I don’t know
I don’t know

The amount of automation per team is more or less the same as in the previous survey.

The interesting part from this question is that we see more people answering that they don’t know how much

their companies are automating…

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -14- Testing Challenges Test Team Challenges Extremely Challenging Challenging Not challenging Budget Team Size

-14-

Testing Challenges

Test Team Challenges

Share -14- Testing Challenges Test Team Challenges Extremely Challenging Challenging Not challenging Budget Team Size

Extremely ChallengingShare -14- Testing Challenges Test Team Challenges Challenging Not challenging Budget Team Size Hiring Training Testing

Challenges Test Team Challenges Extremely Challenging Challenging Not challenging Budget Team Size Hiring Training

Challenging

Test Team Challenges Extremely Challenging Challenging Not challenging Budget Team Size Hiring Training Testing

Not challenging

BudgetChallenges Extremely Challenging Challenging Not challenging Team Size Hiring Training Testing tools More involvement in

Team SizeExtremely Challenging Challenging Not challenging Budget Hiring Training Testing tools More involvement in the work

HiringChallenging Challenging Not challenging Budget Team Size Training Testing tools More involvement in the work of

TrainingChallenging Not challenging Budget Team Size Hiring Testing tools More involvement in the work of the

Testing toolsChallenging Not challenging Budget Team Size Hiring Training More involvement in the work of the company

More involvement in the work of the companychallenging Budget Team Size Hiring Training Testing tools Timeframes Time spent on side tasks and not

TimeframesTesting tools More involvement in the work of the company Time spent on side tasks and

Time spent on side tasks and not doing actual testingtools More involvement in the work of the company Timeframes Political & cultural issues Communicating the

Political & cultural issuesTime spent on side tasks and not doing actual testing Communicating the value of testing Working

Communicating the value of testingand not doing actual testing Political & cultural issues Working with offshore / outsourcing 14 %

Working with offshore / outsourcing& cultural issues Communicating the value of testing 14 % 5 2 % 34 %  

14%

52%

34%

   
   
   

16%

55%

29%

 
 
 

36%

51%

12%

 
 
 

16%

60%

24%

 
 
 

13%

53%

33%

 
 
 

16%

58%

26%

 
 
 

21%

59%

20%

 
 
 

13%

51%

36%

 
 
 

16%

44%

40%

 
 
 

14%

53%

33%

 
 
 

12%

43%

45%

% 5 3 % 33 %   12 % 4 3 % 45 % Among the
% 5 3 % 33 %   12 % 4 3 % 45 % Among the
% 5 3 % 33 %   12 % 4 3 % 45 % Among the

Among the “other” challenges faced by testing teams we saw: The inability to engage more cutting edge practices, integrating waterfall and agile approaches, poor communication with customers, working on an industry without standards, growing too fast, lack of

time for planning, lack of C-Level support, too many metrics, developers who don’t know how to write testable code, “getting adoption of great ideas in terrible environments”, and more.

of great ideas in terrible environments”, and more. Sponsored by © 2016 - PractiTest & Tea

Sponsored by

ideas in terrible environments”, and more. Sponsored by © 2016 - PractiTest & Tea Time with
ideas in terrible environments”, and more. Sponsored by © 2016 - PractiTest & Tea Time with
ideas in terrible environments”, and more. Sponsored by © 2016 - PractiTest & Tea Time with

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.
7

Share

Share -15- What changes have you made in the way you test? We asked an open

-15-

Share -15- What changes have you made in the way you test? We asked an open

What changes have you made in the way you test?

We asked an open question about the changes testers made during the last year to the way they work and why they made them. We got lots of interesting answers - among them:

Getting closer to devs and investing more energy into improving their ability (and willingness) to test.made them. We got lots of interesting answers - among them: Using Docker to isolate development

Using Docker to isolate development environments and do integration testing between service and database during CI builds.into improving their ability (and willingness) to test. Moving towards a blend of TDD, BDD and

Moving towards a blend of TDD, BDD and DevOps, selected on a by-feature basis. Acknowledgement that one approach is not necessarily correct across the board.testing between service and database during CI builds. New test approach in which we use 1-on-1

New test approach in which we use 1-on-1 talks with all stakeholder to set expectations during the testing phase. This was made because stakeholders were only seeing the test results at the end of testing, and now they are involved from the begin.one approach is not necessarily correct across the board. Paired more with the developers to try

Paired more with the developers to try and mitigate against common bugs getting past the Dev environments. Introduced 3-Amigos Sessions before story kick offs so that everyone has the same understanding about what we are building.end of testing, and now they are involved from the begin. More manual tests than before.

More manual tests than before. Reducing time-to-market increases the number of new features to test, and manual tests are more effective for new features.has the same understanding about what we are building. We adopted Nightwatch and Selenium for automating

We adopted Nightwatch and Selenium for automating regression tests, as well as JMeter for load testing. There is a big push to automate the work, but not a clear path to implement these tools effectively.test, and manual tests are more effective for new features. Splitting automated regression sets into subsets

Splitting automated regression sets into subsets linked to the CI environment in order to get faster feedback.but not a clear path to implement these tools effectively. I started writing checklists during requirement

I started writing checklists during requirement analysis phase - it helps to understand gaps in technical documentation.to the CI environment in order to get faster feedback. Sponsored by I've empowered myself to

Sponsored by

to understand gaps in technical documentation. Sponsored by I've empowered myself to become active in testing

I've empowered myself to become active in testingto understand gaps in technical documentation. Sponsored by a lot sooner in the development process by

a lot sooner in the development process by using

postman to test API calls before UIs are built. I've made progress in convincing my team to include me in technical discussion/planning early on so that

I can begin test documentation/mind mapping early.

Going the agile route, organizing a stand up meeting for the QA team every morning to have better visibility on what they do.so that I can begin test documentation/mind mapping early. In my team we've removed all meetings

In my team we've removed all meetings that do not provide value. Instead we focus on one daily standup between two main sites: U.S. and Sweden. Will continue our fresh journey of moving to a more exploratory way of testing and how to manage administration around that.every morning to have better visibility on what they do. We have move from writing traditional

We have move from writing traditional test cases and scripts and moving to writing these in BDD format in Gherkin and having Dev execute them automatically in Cucumber.way of testing and how to manage administration around that. Started using mind maps to gains

Started using mind maps to gains better understanding of what areas we need to consider to have full coverage in application testing.and having Dev execute them automatically in Cucumber. Getting involved in the project from the initial

Getting involved in the project from the initialto consider to have full coverage in application testing. stages, and testing the modules developed instead

stages, and testing the modules developed instead

of waiting until the feature is completed. Test cases

and decision tables were written prior to start of the project, so that developers and testers can be on the same page.

We are transforming our test approach from technical QA to more business process focused. Heavy emphasis on supporting the Agile/Scrum methodology and the associated automation.so that developers and testers can be on the same page. Take more breaks, using the

Take more breaks, using the pomodoro technique.the Agile/Scrum methodology and the associated automation. Exploratory testing has been introduced © 2016 - PractiTest

Exploratory testing has been introducedautomation. Take more breaks, using the pomodoro technique. © 2016 - PractiTest & Tea Time with

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Understanding of the relevant technologies Good writing & communication skills Share Ability to think outside

Understanding of the relevant technologies

Understanding of the relevant technologies Good writing & communication skills Share Ability to think outside the

Good writing & communication skills

Share Ability to think outside the box
Share
Ability to think outside
the box

Passionate about

testing

-16-

What do Managers look for when hiring a tester? We asked hiring managers what are
What do Managers look
for when hiring a tester?
We asked hiring managers what are they
looking for today in their testers when hiring
new positions, and among the things they
are looking for we found the following:

Your Predictions to the Future

for we found the following: Your Predictions to the Future Scripting knowledge Understanding of Agile Explainability

Scripting knowledge

Understanding of Agile

to the Future Scripting knowledge Understanding of Agile Explainability of testing Lateral thinking Self learner

Explainability of testing

Lateral thinking

of Agile Explainability of testing Lateral thinking Self learner Ambition & initiative Where do you see

Self learner

Ambition & initiative

Where do you see yourself in 5 years?

I will be a tester or a test manager 46% I will be a testing
I
will be a tester or a test manager
46%
I
will be a testing consultant
21%
I
don’t know what I will be doing 5 years from now
19%
I
will be working in a business role
7%
I
will be working as a programmer / programming lead
5%
I
will be retired
2%
I
will not be in the technological industry
1%

Sponsored by

will not be in the technological industry 1% Sponsored by We see that most people want

We see that most people want to stay in the testing arena within the next 5 years, although an important number of respondents want to work in consulting jobs and not on in-house testing jobs (up to 20.5% from 19% last year).

There is still a large number of people who don’t know what they will be doing in 5 years from now, and we believe that this points to a lack of a defined career path and maybe even a lack of a defined career in testing as a whole…

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -17- How concerned are you about your job stability? The stabilization trend we started to

-17-

How concerned are you about your job stability?

Share -17- How concerned are you about your job stability? The stabilization trend we started to

The stabilization trend we started to see last year is only increasing, and so people are less concerned in general about their job stability (53% this year vs. 42% two years ago).

their job stability (53% this year vs. 42% two years ago). 53% 2015 42% 34% 13%
their job stability (53% this year vs. 42% two years ago). 53% 2015 42% 34% 13%
53% 2015 42% 34% 13%
53%
2015
42%
34%
13%

Not concerned

Somewhat concerned

Very concerned

How would we want to see the testing world changed for the best?

We asked testers what would they like to see change in the testing world to make it better for all of us, and here are some of the most interesting answers:

Everyone working together to do the best testing that they can do, rather than fighting whether a particular School or Method is the only one true way forward. It's getting to be like religion in some aspects. We all have a common interest in "testing" let’s push that forward.” - And to that we say AMEN!of us, and here are some of the most interesting answers: basically get the decision-making roles,

basically getlet’s push that forward.” - And to that we say AMEN! the decision-making roles, so we

the

decision-making roles, so we don't have to learn (again) from the mistake of relying too much on automated checks.

the

right

people

in

Give people time AND encouragement to learn during office hoursof relying too much on automated checks. the right people in More conferences in “Third World”

More conferences in “Third World” countries, where most of the testers are.people time AND encouragement to learn during office hours More mentoring so that all the testers

More mentoring so that all the testers can improve their skills.“Third World” countries, where most of the testers are. Less politics, more cooperation. Sponsored by What

Less politics, more cooperation.mentoring so that all the testers can improve their skills. Sponsored by What I'd really like

Sponsored by

their skills. Less politics, more cooperation. Sponsored by What I'd really like to see is a

Whattheir skills. Less politics, more cooperation. Sponsored by I'd really like to see is a framework

I'd really like to see is a framework for

"selling" testing to people who don't really understand testing (or software development) because it's something I struggle with all the time

I really wish that people would stop saying how easybecause it's something I struggle with all the time And just let the testers do their

And just let the testers do their job and

it is to test

quit getting in the way.

Raise the recognition of the organization for the importance of testing.do their job and it is to test quit getting in the way. Continue to have

Continue to have low barriers to entry to get into other testing roles.of the organization for the importance of testing. Communicating that DevOps is not a substitute for

Communicating that DevOps is not a substitute for QA.have low barriers to entry to get into other testing roles. Less ego from all the

Less ego from all the parties involved.roles. Communicating that DevOps is not a substitute for QA. © 2016 - PractiTest & Tea

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -18- A Final Note “What do you want to do when you grow up?”, We

-18-

Share -18- A Final Note “What do you want to do when you grow up?”, We

A Final Note

“What do you want to do when you grow up?”, We don’t think that many of us would have answered this question by saying, “I want to be a Tester when I grow up!”

Still, we believe that many of us today feel proud to tell our friends and family that we work as Testers and explaining about the responsibility and the challenges we face as part of our job.

As we went over the answers submitted and put this report together, we realised that testers do not only take their profession seriously today but also feel like professionals at what they do.

We feel that we testers are doing meaningful contribution in our teams and in our products, we are also using more advanced tools and methodologies, and overall we are behaving more like a community of professionals that interacts and learns from each other’s knowledge and experience.

There are many changes affecting our work, such as the trends like DevOps, the globalization of the testing teams, and the use of more advanced testing methods and technologies. And we want to continue reviewing all these points in our next reports!

There are also many challenges ahead of us, for example hiring the right people for the job, getting the right knowledge and skills, introducing advanced automation to our testing process, coping with the constant changes and the increasing challenges in time to release, etc. But we think that all of these challenges are good opportunities as they point towards progress in our field and in our areas of responsibility within our teams and organizations.

As we mentioned in the introduction of this report, being a tester seems to be an exciting thing at this period of time! And we think, things are going to be even more exciting!

Starting from reviewers and collaborators, and of course everyone who took the time to seriously answer the State of Testing Survey, once again a big thanks.

Let’s see what future has in store for we testers. We are excited about State of Testing Report 2017 already, and you?

Until next year! Lalit and Joel

Sponsored by

and you? Until next year! Lalit and Joel Sponsored by © 2016 - PractiTest & Tea

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -19- About Tea-time with testers Tea-time with Testers, is the largest-circulated software testing monthly in

-19-

Share -19- About Tea-time with testers Tea-time with Testers, is the largest-circulated software testing monthly in
Share -19- About Tea-time with testers Tea-time with Testers, is the largest-circulated software testing monthly in
Share -19- About Tea-time with testers Tea-time with Testers, is the largest-circulated software testing monthly in

About Tea-time with testers

Tea-time with Testers, is the largest-circulated software testing monthly in the world. As the wave of change sweeps business, testing field and community of testers like never before, Tea-time with Testers has ensured that its readers have all the necessary upgrades to challenge tomorrow. It takes its readers deeper to give a complete understanding of the world of software testing. Ever since its inception in 2011, it has set one benchmark after another in testing publication circle. It was the first to do serious reporting on software testing theories and thoughts. And then again, it is the first to bring a whole new genre of technical/corporate journal- ism more up close and more incisive. It is the only monthly magazine in global testing community known for quality of its content, authors and unique way of presenting the information. Today, Tea-time with Test- ers commands the highest circulation and readership among all English language testing magazines in the world.

To learn more visit site:

http://www.teatimewithtesters.com/

About PractiTest

PractiTest is an end-to-end QA and Test management solution,designed to help users control their testing and development process, focusing on how to manage their project and its information, and how to communicate testing outcomes to all the relevant stakeholders.

The software allow users to organize requirements, create and run tests, tracks bugs etc. Integrations are available with top bug tracking tools including: JIRA, Bugzilla ,RedMine and Pivotal Tracker as well as automa- tion tools such as Selenium, JUnit, SoapUI,QTP,Jenkins,- Circle CI ,productivity applications such as Slack and many more.

To learn more and get your 15 days free trial visit our site: https://www.practitest.com

Sponsored by

visit our site: https://www.practitest.com Sponsored by © 2016 - PractiTest & Tea Time with Testers. All

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.

Share

Share -20- Collaborators The state of testing could not have become a reality without the help

-20-

Share -20- Collaborators The state of testing could not have become a reality without the help

Collaborators

The state of testing could not have become a reality without the help of our collaborators.

have become a reality without the help of our collaborators. www.qualityremarks.com www.qahiccupps.blogspot.co.uk

www.qualityremarks.com

the help of our collaborators. www.qualityremarks.com www.qahiccupps.blogspot.co.uk www.testknight.de

www.qahiccupps.blogspot.co.uk

www.qualityremarks.com www.qahiccupps.blogspot.co.uk www.testknight.de www.linkeshkannavelu.com

www.testknight.de

www.qahiccupps.blogspot.co.uk www.testknight.de www.linkeshkannavelu.com www.thetestersedge.com

www.linkeshkannavelu.com

www.testknight.de www.linkeshkannavelu.com www.thetestersedge.com www.mrslavchev.com

www.thetestersedge.com

www.linkeshkannavelu.com www.thetestersedge.com www.mrslavchev.com www.masaoapril.hatenablog.com

www.mrslavchev.com

www.thetestersedge.com www.mrslavchev.com www.masaoapril.hatenablog.com www.nickytests.blogspot.co.il

www.masaoapril.hatenablog.com

www.mrslavchev.com www.masaoapril.hatenablog.com www.nickytests.blogspot.co.il www.huibschoots.nl

www.nickytests.blogspot.co.il

www.masaoapril.hatenablog.com www.nickytests.blogspot.co.il www.huibschoots.nl www.infoq.com Sponsored by

www.huibschoots.nl

www.nickytests.blogspot.co.il www.huibschoots.nl www.infoq.com Sponsored by www.adventuresinqa.com
www.infoq.com Sponsored by
www.infoq.com
Sponsored by
www.huibschoots.nl www.infoq.com Sponsored by www.adventuresinqa.com www.testingcurator.com

www.adventuresinqa.com

www.infoq.com Sponsored by www.adventuresinqa.com www.testingcurator.com www.testingisbelieving.blogspot.co.uk

www.testingcurator.com

Sponsored by www.adventuresinqa.com www.testingcurator.com www.testingisbelieving.blogspot.co.uk

www.testingisbelieving.blogspot.co.uk

www.testingcurator.com www.testingisbelieving.blogspot.co.uk www.bernieberger1.blogspot.co.il www.asktester.com

www.bernieberger1.blogspot.co.il

www.bernieberger1.blogspot.co.il www.asktester.com www.quikerqe.com www.perze.blogspot.co.il

www.asktester.com

www.bernieberger1.blogspot.co.il www.asktester.com www.quikerqe.com www.perze.blogspot.co.il

www.quikerqe.com

www.asktester.com www.quikerqe.com www.perze.blogspot.co.il www.richrtesting.wordpress.com

www.perze.blogspot.co.il

www.asktester.com www.quikerqe.com www.perze.blogspot.co.il www.richrtesting.wordpress.com www.djdegrood.wordpress.com

www.richrtesting.wordpress.com

www.perze.blogspot.co.il www.richrtesting.wordpress.com www.djdegrood.wordpress.com www.qualitytesting.info

www.djdegrood.wordpress.com

www.richrtesting.wordpress.com www.djdegrood.wordpress.com www.qualitytesting.info www.stephenjanaway.co.uk

www.qualitytesting.info

www.djdegrood.wordpress.com www.qualitytesting.info www.stephenjanaway.co.uk www.allthingsquality.com

www.stephenjanaway.co.uk

www.qualitytesting.info www.stephenjanaway.co.uk www.allthingsquality.com www.teamqualitypro.com

www.allthingsquality.com

www.stephenjanaway.co.uk www.allthingsquality.com www.teamqualitypro.com www.andrei.contan.ro

www.teamqualitypro.com

www.allthingsquality.com www.teamqualitypro.com www.andrei.contan.ro www.a-sisyphean-task.com

www.andrei.contan.ro

www.teamqualitypro.com www.andrei.contan.ro www.a-sisyphean-task.com www.testingmvd.wordpress.com

www.a-sisyphean-task.com

www.andrei.contan.ro www.a-sisyphean-task.com www.testingmvd.wordpress.com www.qahatesyou.com www.qxf2.com

www.testingmvd.wordpress.com

www.a-sisyphean-task.com www.testingmvd.wordpress.com www.qahatesyou.com www.qxf2.com www.testpappy.wordpress.com

www.qahatesyou.com

www.testingmvd.wordpress.com www.qahatesyou.com www.qxf2.com www.testpappy.wordpress.com © 2016 -

www.qxf2.com

www.testingmvd.wordpress.com www.qahatesyou.com www.qxf2.com www.testpappy.wordpress.com © 2016 - PractiTest & Tea

www.testpappy.wordpress.com

© 2016 - PractiTest & Tea Time with Testers. All rights reserved.