Testing at the Speed of DevOps

© 2017 by
© 2017
2016 by .
© 2017 by
 customers
Forbes Top 10 Global
2000 Companies
investment

employees computer 6
investment
services

4 computer services
330+
6 major banks

4 life insurance
locations
4 diversified insurance
Austria
Germany
Switzerland
United Kingdom
The Netherlands founded awards
Poland 2007
USA Leader in: support
Australia
B-Series Funding Gartner MQ
Insight Venture Partners ASP Award 2016
India Forrester Wave
© 2017 by $165M (2017)
 Testing
Present

The reliance on
80% manual testing is the
Manual Testing
top technical challenge
in app development.
World Quality Report, 2015/16

20% UI
Test automation
Automated Testing
API
requires developers.

Testing Present
© 2017 by
 Testing Testing
Present Future

Exploratory Tests

Automated UI Tests
80%
Manual Testing

API Tests +85%

20% UI
Orchestrated Service Virtualization
Automated Testing - key enabler for high automation rates -
API

Testing Future
© 2017 by
 Fast Feedback To The Impact Of Change.
If You Want To Transform to DevOps.

Develop The Least Amount Of Test Cases. Cover The Maximum Amount Of Business Risk.
Stop Chasing Test Coverage. Reduce Redundancy.
Start Chasing Risk Coverage.

Empower Everybody To Build Complex, Powerful, Script-free, Business-Readable Automation.

1 Automation Expert supports 10 Manual Testers move towards Automation.

3 Clear Principles
© 2017 by
 The Analysts View

© 2017 by
 Nov 2016

Dec 2015

Aug 2014

Jan 2011

© 2017 by
 … 2015 position

* … see Gartner’s article on HPE’s SpinOff,

Nov 10th, 2016

Nov 2016

Dec 2015

Aug 2014

Jan 2011

© 2017 by
 Nov 2016

Dec 2015

Aug 2014

“It should be considered by enterprises that have struggled to

Jan 2011

make test automation work, and by those seeking to support

agile continuous automation practices.”

© 2017 by
“Tricentis’ Tosca Testsuite makes automation easy with model-based
automation.”

© 2017 by
 Strong
Challengers Contenders Performers Leaders

Strong

Tricentis

Current
Offering

2015
© 2017 by
Weak

Weak Strategy Strong

 Strong
Challengers Contenders Performers Leaders

Strong

Tricentis

Current
Offering

2016
© 2017 by
Weak

Weak Strategy Strong

 Automate Explore Manage Optimize Report

Test Risk-based
API Exploratory Testing Analytics
Management Testing

Cross BI & Manual Test Data Risk

Mobile
Browser Big Data Testing Management Analysis

SAP Integrations Service

Virtualization Dashboards

Model-Based
Test Automation

30+ Technologies Scripting

Impact
Framework Robotics
Packaged Apps Migration Analysis

© 2017 by
 The Continuous Testing Maturity Model
“Where Are You & Where Do You Need To Be?”

© 2017 by
 Explore
Session Based Exploratory Testing

Risk-/Value based functional structure

Optimize
Test Case Design
UI- and API based test automation
Automate

Active Test Data Management

Manage
Test Driven Service Virtualization

Integrate
CT Integration (CI, CD)
© 2017 by
 Focus Area M1 M2 M3 M4 M5

Exploratory Testing
Explore

Risk-/Value-based
Functional Structure

Optimize Testcase Design

UI Automation: Script-based LIMITED

UI Automation: Model-based HAPPY PATHS

LIMITED
Automate API Automation DEV ONLY DEV ONLY

Active Test Data Management

LIMITED
Test Driven Service
Manage Virtualization

CT Integration (CI, CD) LIMITED LIMITED

Integrate

© 2017 by Most enterprise customers are on level M2 when they decide for Tosca.
 Can You Scale At Speed?

© 2017 by
 Model-based tests are
reusable and maintainable
without technical expertise

© 2017 by
 Logical Name Value Action Technical Name Value Range

Create Vehicle Insurance

Enter Vehicle Data Vehicle Data
Make Audi Input Make -
Scan Application….
Engine Performance [kW] 200 Input Engine Performance [kW] -
Year of Construction {Year} Input Year of Construction 2015;2014;2013;2012
Number of Seats 5 Input Number of Seats 1;2;3;4;5;6;7;8;9
Fuel Petrol Input Fuel Petrol;Diesel;Gas;Other
List Price [$] 35.000 Input List Price [$] -
License Plate Number B-CD 123 Input License Plate Number -
Usage Private Input Usage Private;Commercial
Annual Mileage 10.000 Input Annual Mileage -
Next {CLICK} Input Next {CLICK};{RIGHTCLICK}
Enter Insurant Data Insurant Data
Enter Product Data Product Data
Start Date 01/03/2016 Input Start Date 01/03/2016;01/04/2016
Insurance Sum [$] 7Mio Input Insurance Sum [$] 3Mio;7Mio;10Mio;15Mio
Payment Option Yearly Input Payment Option Yearly;Quarterly;Monthly
Next {CLICK} Input Next {CLICK}
Verify Quote Details Quote Details
Price List Select
Insurance Sum Select
Gross Premium [$] 1.535,22 Verify It’s like playing Lego.
Business Information Technical Information

Models And More

© 2017 by
© 2016 by

Tosca Business Readable UI Test Case

© 2017 by
© 2016 by

Tosca Business Readable API Test Case

© 2017 by
 How Continuous Is Your Testing ?

© 2017 by
 CT CT
CT CT

CT
CT
CT

CT Dev Ops CT

CT CT CT

CT CT CT CT

“DevOps is all about Continuous Testing!”

© 2017 by
Plan Code Version Build Provision Test Deploy Report

Tosca DEX

Tosca CI
XCode

MS Insights
integration test results
unit test results

Integrate Integrate Integrate Integrate Integrate Monitor

Tosca
Prioritize Explore Virtualize Distribute Report Diagnose
Connect
Design Manage Automate Execute Tosca
Configure Diagnostics

Tricentis Delivery Pipeline

© 2017 by
 BUILD CONTINUOUS
PLAN CODE & TEST DESIGN TESTING DEPLOY MONITOR

Plan Code & Test Design Version Build Provision Automated Test Deploy Monitor

HP UFT
Selenium… Exploratory Testing Dashboards

Tosca ToscaCI Integrations

Connect Cross DEX Server Risk
Mobile
Browser Analysis
Model-Based
Test Automation

30+ Technologies
BI &
Packaged Apps SAP
Test Big Data DevTest: Daily executions Release Test: Executed Analytics
Management Service Load Test
or check-in based, covers with a reduced velocity,
Virtualization
unit tests, ST and SIT covers E2E Tests.

Risk-based Test Data

Testing Management API Tosca
Connect

Tosca Cloud
© 2017 by
 BUILD CONTINUOUS
PLAN CODE TESTING DEPLOY MONITOR

XCode Report KPI’s:

Power of the Set
Coverage
Execution-State

Tricentis Tosca
AGILE: Creation of TestCases while Development.
ToscaCI
TCD for logical Early scanning of
TestCases. UI on DEV level

TD-Management API-Tests when ToscaCI

for runtime Data. possible.
DEX Report Results:
Server PDF
Excel
ToscaCI XML
Executable TestCases for each Stage HTML
Development, Sys-Integration, E2E-Test.
Create … … Distributed Execution with
Tosca Requirements “Tricentis Tosca DEX”
in early stages for Build-Server [Linux & Windows Server] on multiple machines in Synchronize:
Test-planning. Customization build the Code, deploy it, and Test-
Execution is triggered through Tosca
parallel, with UI & NonUI Defects
TestCases at the same time. TestCases
Over 370 Custom Controls for over 100 Continuous Integration (ToscaCI). Execution-Results
Applications versioned in SVN. with Custom
Tosca/ALM
Integration

Real World Scenario: Tier 1 Global Bank

© 2017 by
 Shift Left Your Testing

© 2017 by
 Sprint Sprint
Start End
Time
Efficiency
100%
Gain

+4x
Creation
Start testing early.

6x Shift left test automation. Degree of

API Completion
+
Maintenance
UI

20x
+
Execution
0%

API Testing
© 2017 by
 Efficiency
Gain

+4x
Creation

+
Maintenance
6x Migrate

20x
+
Execution

API Testing
© 2017 by
 Web Database SAP
Cross Browser Oracle SAP NetWeaver
Web Services SQL Server SAP S/4 HANA
Flash IBM DB2 SAP Fiori
Java ODBC SAP Solution Mgr
MongoDB IDOC
Mobile TBOM/BPCA
iOS SAP GUI
Continuous
Android mySAP HTML
Integration
Jenkins
API Bamboo MS Office/Docs
REST, SOAP, JSON, TeamCity Word, Outlook,
XML, HTTP, WSDL, Electric Cloud Excel, PDF
XSD, IBM GitHUB
WebSphere MQ, Terminal Emulation
ISO20222, SEPA, HOST EXPLORER
TOSCA Migration Utility
SWIFT, JMS Software DEV IBM PersCom Today:
Java (Swing, AWT, SWT, FX) PuTTY CLI QTP/UFT/SoapUI/Selenium/Worksoft
Microsoft .NET Fw Tomorrow:
Platform PowerBuilder
Selenium Execution Any Test Framework, Test Tool
Citrix AngularJS
Windows RDP/RDS Support or Scripting Technology
VB/Delphi/Gupta
AWS/Azure NUNIT/JUNIT
Win32/WPF/C++

Wide Platform/Interface/Environment/API Support…. Packaged Apps….

© 2017 by
 TOSCA Connect

Requirements &
Defects

Synchronization &
Traceability

Lifecycle, Quality & Test Management

© 2017 by
 Support
Training
Professional Services
Educate. Help. Augment.
© 2017 by
TOSCA Career paths
tied to Heartbeat concept Test Design
Specialist 2

Test Design
Specialist 1
1 day
Automation Automation
Specialist 1 Specialist 2
(fit for Heartbeat 1) (fit for Heartbeat 2)

3 days

Automation
Engineer 1

3 days 2 days

Automation
Engineer 2

2 days

All “stations” hold certificates.

3 days
In addition to the three roles, we offer Special
Topic Courses as either instructor-led or self-
paced learning.

© 2017 by 37
 Live Demo
© 2017 by