TRN4033 CloudMigration Metro XTTS

Oracle Database Cloud Migration
Fast, simple, universal
Mike Dietrich Soner Toraman

Master Product Manager Product Owner Relational Databases
Database Upgrades & Migrations METRO-NOM GmbH
Oracle Corporation
Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Database Cloud Migration: Fast, simple, universal
a n y
G e rm
Mike Dietrich https://MikeDietrichDE.com

Master Product Manager
Oracle Database Upgrades and Migrations MikeDietrichDE
Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Database Cloud Migration: Fast, simple, universal 2
Slides download and other resources
• https://MikeDietrichDE.com/slides
Overview
Photo by asoggetti on Unsplash

Copyright © 2018, Oracle and/or its affiliates. All rights reserved. | Oracle Database Cloud Migration: Fast, simple, universal
ExaCC: Exadata Cloud at Customer
• https://www.oracle.com/technetwork/database/exadata/exacc-x7-ds-4126773.pdf
Project Goal
• Cross platform migration
– AIX (Big Endian) to Linux (Little Endian)
– Options:
• Data Pump
– Simple but slow due to complexity and amount of data
• Transportable Tablespaces
– More prep work due to complexity but can deal with high amounts of data
• Full Transportable Export/Import
– Combines both but may be harder due to unforeseeable log errors
• All-purpose migration path

– Even for same-Endianness migrations
Decision
• Build a universal Transportable Tablespaces solution
• Utilize the ZDLRA for cross platform incremental backup/restore
Photo by Javier Allegue Barros on Unsplash

Strategy Overview
Restore/Recover
Inc Backup Transport
Rebuild Meta
Migration with Transportable Tablespaces - Overview
Rebuild meta information
(views, synonyms, trigger, roles etc)
SOURCE Database 12.1.0.2 DESTINATION Database 12.2.0.1

VIEWS VIEWS
Read Only
SYSTEM CODE
SYSTEM CODE
SCOTT SYSAUX SCOTT SYSAUX

UNDO PRIVS UNDO PRIVS
HUGO HUGO
TEMP TEMP
TTS: Using Incremental Backups
impdp"'"sys/sys
expdp "'"sys/sysasassysdba"'"
sysdba"'"…
…
TRANSPORT_DATAFILES=…
TRANSPORT_TABLESPACES=TS1,TS2 …
Convert and apply
Downtime!!! backups
SOURCE Database 12.1.0.2 DESTINATION Database 12.2.0.1

VIEWS Read Write VIEWS
Read Only
SYSTEM CODE SYSTEM CODE
SCOTT SYSAUX SCOTT SYSAUX

Data Pump / Scripts
UNDO PRIVS UNDO PRIVS
HUGO HUGO
TEMP TEMP
What is the plan?
Photo by Alvaro Reyes on Unsplash

Timeline
Backups Restore Level 0
Restore Level 1
Restore Level 1 TTS

Meta
Migration Details
Part 1 - The ZDLRA
ZDLRA: Strategy Overview
Restore/Recover
dbmigusera.pl
Customized PERL scripts
for Recovery Appliance
Rebuild Meta
Zero Data Loss Recovery Appliance
• Install most recent libra.so
– MOS Note: 2219812.1 - ZDLRA: Download new sbt library
• Download package dbmigusera.pl incl. xtt.properties
– MOS Note: 2460552.1 - Cross Platform Database Migration using ZDLRA
• Deploy package dbmigusera.pl
• Customize xtt.properties
# SBT parameter configuration to be used for restore and recover operations
sbtlibparms="SBT_LIBRARY=/u01/app/oracle/product/12.2.0.1/dbhome_1/lib/libra.so, …')"
# The number of datafiles that will be restored / recovered in parallel.

resparallel=16
# The list of tablespaces to be migrated

ttsnames=T14_1,T14_2,T14_3,T14_4,T14_5,T14_6,T14_7,T14_8,T14_9,T14_10,T14_11
# The directory to which the datafiles will be restored

storageondest=+DATAC1/dbmig/datafile
sourceplatid=2
dbid=4173218531
retrycount=2
Restore and Recover
Level 0 Backup Restore
Restore/Recover
Inc Backup
$ perl dbmigusera.pl --restore …
Restore and Recover
Level 1 Backup Restore-Recover
Restore/Recover
Inc Backup
$ perl dbmigusera.pl --recover …
Restore and Recover
Level 1 Backup Restore-Recover
Restore/Recover
Inc Backup
$ perl dbmigusera.pl --recover …
Migration Details
Part 2 - Transportable Tablespaces to ExaCC
TTS: Strategy Overview
Custom TTS
Restore/Recover
Customized Transportable
Tablespaces Scripts
Rebuild Meta
Check Script on all Sources
• Check script
– Checks for objects in SYSTEM tablespace
– Size of database
– Tablespaces
– Object count meta objects
CHECK
– And more …
• AWR extract
• Plan Capture
Prep Work on ExaCC
• Build a new database

– Identical character set
– Identical national character set
Restore/Recover
– Identical time zone version
Transport – As PDB
Rebuild Meta • Adjustments
– Rename USERS tablespace to
USERS_DROP_ME_LATER
– Set Guaranteed Restore Point for testing
Prep Work on Source
• Move tables out of SYSTEM TS

• Generate scripts
– Set tablespaces read/only, and reverse
– Create dummy tablespaces, and reverse
– Create temporary tablespaces
– Create User, create Profiles
– Create Grants, Roles, Directories
– Grants to create MVs, DB-Links
– Create Functions used in Tables/Indexes
– Create Global Temporary Tables
– xtt.properties tablespace list
Incremental Backup-Restore - No Downtime
• Level 0 backup restore

– $ perl dbmigusera.pl --restore
• Level 1 backup restore/recover

Restore/Recover
– $ perl dbmigusera.pl --recover
Transport
• Repeat …
Rebuild Meta
Prep Work on ExaCC
• Create
– Profiles
– Dummy tablespaces
Restore/Recover – Temporary tablespaces
– Users
Transport
– Directories
Rebuild Meta • Drop
– Dummy tablespaces
• Create
– Grants, Roles, Directories, Functions for tables/indexes
• From dfcopy.txt (xtt PERL):

– Generate TRANSPORT_DATAFILES strings
Final Incremental Backup-Restore - Downtime
Tablespaces
Read Only
• Level 1 backup restore/recover
– $ perl dbmigusera.pl --recover
Restore/Recover
Transport
Rebuild Meta
Export Tablespace and Meta Information
• Metadata export
– function, package, procedure,
database_link, sequence, view,
Restore/Recover synonym
Transport • TTS export
Rebuild Meta
• Important:
– GATHER_SCHEMA_STATS('SYS')
– GATHER_SCHEMA_STATS('SYSTEM')
Meta Data TTS

Export Export
TTS Import
• TTS Import
– Afterwards tablespaces are attached
– Duration: 60 mins in test environment
Restore/Recover
Transport
Rebuild Meta
TTS
Import
Rebuild of Meta Information
• Meta Import
–Rebuilds:
• Functions
Restore/Recover
• Packages
Transport • Procedures
Rebuild Meta
• Database links
• Sequences
• Views
• Synonyms
Metadata
Import
Check Script: Comparison
• Clean up
– Drop GRP
– Other treatments
• Run check script
CHECK CHECK – Comparison Before/After
• Encryption
Back to reality …
Oracle Database Cloud Migration
@Metro|nom
Oracle Open World, 25.10.2018
36
Introduction
37
Oracle Database Cloud Migration @ Metro|nom
Introduction
Soner Toraman
Product Owner Relational Databases @
Team: 13 DBAs
Managing > 2500 Databases
2100 Oracle Databases
Backup Infrastructure ZDRLA
38
Introduction
00 employees
s 20
0,000 employee
15
es
IT-Servic
on
€37 Billi ons
IT-Soluti
tries
25 Coun
39
1 Our Vision
what was our trigger & strategy?
Agenda 2 Cloud Migration Tool And The Reality

what‘s behind? how did we use it?
3 Best Practices
facts and recommendations
40
Our Vision
41
Our Vision
Why shift to cloud@customer?
agility cost transparency cloud ready flexibility
y
xit ses go ud
e es ce o
pl c u n cl
m o yo rie lic
co pr as pe b
ce if
y y ex pu
du pl pa in to
re si
m
ga
lif
t
42
Our Vision
OCPUs Cloud@Customer IBM Power Systems
Phase4 DUS
Phase3 FRA IBM 2 OCC
IBM 2 OCC
Phase2 FRA
IBM 2 OCC
Phase1 DUS
IBM 2 OCC
Oracle Public Cloud
1y 2y 3y 4y t
43
Our Vision
2018 2022
Jul. ‚18 Aug. ‚18 Sep. ‚18 Oct. ‚18 Nov. ‚18 Dec. ‚18 Jan. ‚19 Feb. ‚19 Mar. ‚19 Apr. ‚19 Mai. ‚19 Jun. ‚19 Jul. ‚19 Nov. ‚20
Cross-platform
PoC migration 200
Core Applications databases
FRA Frozen FRA Approx. 1500
OCC/ECC database
Cross-platform migrations
migration 40 DUS Frozen DUS In 4y
databases on ECC
Cross-platform
migration 204
databases on OCC
Restore/Recover
Rebuild Meta
44
Our Vision
DC1 Düsseldorf
DC2 Frankfurt
Availability Zone 1 Availability Zone 2 Availability Zone 1 Availability Zone 2
Oracle Cloud
Backup
Oracle Cloud
Archive
45
Cloud Migration Tool
And The Reality
46
CMT and the Reality
!!
e!
im
nt
Our expectations: ow
D
o
N
One Click Migration
Higher Management
!!
e!
im
nt
Experts ow
D
um
im
in
M
Pretasks Migration PostTasks

Migration in 3 Steps
47
CMT and the Reality
!!
e!
im
nt
ow
What did we get? D
um
m
i ni
M
PreTasks Migration PostTasks

Migration in 3 Steps
hard one easy one easy one
Error-prone
Too many manual interventions
48
CMT and the Reality
PreTasks Migration PostTasks
generate >50 scripts, which have

to be partially customized
m
te
sys
s,
sy ts ly
in ip ts on
Source ts s cr r ip d
ec e s c a …
ob
j
vl0 th 1 vl1 re vl1 TS
or pl te p lvl th
e
pl to pl rtT
f u r a u y u B ku po
k ck ne ck p ck tD c ex
ec ba ba co ba se ba
ch ge
b
pd lvl
0 vl1 vl1
… n
rl rl TS tio
cr
ea
te
st
or
e
co
ve
ve rtT ryp t
re re co po c
Target re Im en
49
Best Practices
50
Best Practices
• Automate your Pretasks
- no modifications of generated scripts - avoid human errors
• Define directory structures
- you should know where to find your logfiles and scripts
• Use a shared directory for scripts & logfiles
- avoid switching from source to target vice versa and copy activities
• Do the Pretasks 2-3 days before
- risk of major changes in the database
• Don‘t concentrate on databases with individual errors
- you have a fallback in place
• Check the load on your ZDLRA
- when you do mass migrations
• Check the load on your target infrastructure
- even it is a ExaCC
• Give feedback to the authors of the cloud migration tool
- they will enhance the tool
51
Best Practices
• Errors during import of XML tables

- don‘t worry, export/import separatly
• Scan your logfiles
- exclude known uncritical errors
• The order of your imports are important
- you can‘t grant privileges to users which don't exist
• Monitor the filesystems you need for your migration
- this can be show stopper when you do mass migrations
• Install most recent libra.so
- MOS Note: 2219812.1 - ZDLRA: Download new sbt library
• Do not neglect the ZDLRA

- It‘s an appliance but needs a lot of love
52
Best Practices
Our wishes …
• for the Pretasks
… a procedure included within the database
• additional feature for the cloud migration tool

… make sure that the tool is using the latest incremental backup when recover
53
54
Thank you for
Soner Toraman
your attention!
Slides download and other resources
• https://MikeDietrichDE.com/slides

TRN4033 CloudMigration Metro XTTS

Загружено:

Сведения о документе

Оригинальное название

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

TRN4033 CloudMigration Metro XTTS

Загружено:

Авторское право:

Доступные форматы

Oracle Database Cloud Migration

Fast, simple, universal

Mike Dietrich Soner Toraman

Mike Dietrich https://MikeDietrichDE.com

Photo by asoggetti on Unsplash

• All-purpose migration path

Photo by Javier Allegue Barros on Unsplash

Inc Backup Transport

SOURCE Database 12.1.0.2 DESTINATION Database 12.2.0.1

SCOTT SYSAUX SCOTT SYSAUX

SOURCE Database 12.1.0.2 DESTINATION Database 12.2.0.1

SCOTT SYSAUX SCOTT SYSAUX

Photo by Alvaro Reyes on Unsplash

Backups Restore Level 0

Restore Level 1 TTS

# The number of datafiles that will be restored / recovered in parallel.

# The list of tablespaces to be migrated

# The directory to which the datafiles will be restored

• Build a new database

• Move tables out of SYSTEM TS

• Level 0 backup restore

• Level 1 backup restore/recover

• From dfcopy.txt (xtt PERL):

Meta Data TTS

Agenda 2 Cloud Migration Tool And The Reality

Why shift to cloud@customer?

agility cost transparency cloud ready flexibility

OCPUs Cloud@Customer IBM Power Systems

Phase3 FRA IBM 2 OCC

Inc Backup Transport

Availability Zone 1 Availability Zone 2 Availability Zone 1 Availability Zone 2

One Click Migration

Pretasks Migration PostTasks

PreTasks Migration PostTasks

hard one easy one easy one

PreTasks Migration PostTasks

generate >50 scripts, which have

• Errors during import of XML tables

• Do not neglect the ZDLRA

• additional feature for the cloud migration tool

Вам также может понравиться