Live Partition Mobility (LPM)

IBM Power Systems
Live Partition Mobility (LPM)
© 2010 IBM Corporation
IBM Power Systems
Where to find Live Partition Mobility Information
What’s New in LPM – updated each release of firmware
Find the latest feature here – even before Redbook is updated
http://www01.ibm.com/support/knowledgecenter/POWER8/p8hc3/p8hc3_whatsnew.htm?cp
=POWER8%2F1-8-1-3-7-0
IBM PowerVM Live Partition Mobility Redbook
http://www.redbooks.ibm.com/abstracts/sg247460.html
•
•
rt/knowledgecenter/POWER8/p8hc3/p8hc3_whatsnew.htm?cp=POWER8%2F1-8-13-7-0
IBM PowerVM Live Partition Mobility Redbook
•
2
http://www.redbooks.ibm.com/abstracts/sg247460.html
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility
Move a running partition from one
POWER6/POWER7/POWER8 server to another with no
application downtime
Reduce planned downtime by
moving workloads to another server
during system maintenance
3
Rebalance processing
power across servers when
and where you need it
© 2010 IBM Corporation
IBM Power Systems
Partition Mobility: Active and Inactive LPARs
Active Partition Mobility
 Active Partition Migration is the actual movement of a running LPAR from one
physical machine to another without disrupting the operation of the OS and
applications running in that LPAR.
 Applicability
 Workload consolidation (e.g. many to one)
 Workload balancing (e.g. move to larger system)
 Planned CEC outages for maintenance/upgrades
 Impending CEC outages (e.g. hardware warning received)
Inactive Partition Mobility
 Inactive Partition Migration transfers a partition that is logically ‘powered off’ (not
running) from one system to another.
Partition Mobility supported on POWER6™ ,POWER7TM
and Power8 with AIX 5.3, AIX 6.1, AIX 7.1 and Linux and
System i
4
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility
System #1
System #2
Suspended
AIX Client
Partition
1
M M M M M M M
A
en0
(if)
vscsi0
ent1
HMC
VLAN
Hypervisor
VASI
vhost0
ent1
Mover
Service
vtscsi0
ent2
SEA
fcs0
ent0
Shell
AIX Client
Partition
1
Create
virtual
SCSI
Once
Finish
enough
the
migration
memory
Validate
environment
devices
Create
shell
pages
and
remove
havepartition
been
the
Start
migrating
for
appropriate
on
target
system
moved,
original
suspend
LPAR
memory
pagesthe
resources
source
definitions
system
M M M M M M M
en0
(if)
A
ent1
vscsi0
VLAN
Hypervisor
en2
(if)
VIOS
ent1
vhost0
VASI
en2
(if)
ent2
SEA
vtscsi0
Mover
Service
VIOS
ent0
fcs0
Storage
Subsystem
A
5
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility – Control Points
System #1
(Source System)
System #2
(Destination System)
AIX Client Partition 1
AIX Client Partition 1
(Mobile Partition)
POWER
Hypervisor
Virtual I/O Server
ent1
virt
vhost0
vtscsi0
HMC
hdiskX
ent2
SEA
fcs0
ent0
ent1
virt
2
en2
if
HMC
en2
if
HMC
ent2
SEA
ent0
fcs0
Virtual I/O Server
Service
Processor
POWER
Hypervisor
Service
Processor
1
Ethernet Network
Storage Area Network
Shared Disk
(Storage Device)
LUN
Physical
Volume LUN
6
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility Minimum Requirements






Multiple POWER6 or POWER7 or Power8 systems
PowerVM Enterprise Edition activations on systems
System Firmware Recommended Min E*340_039 for POWER6
All Power7 and Power8 firmware releases supported
HMC Version 7 Releases 3.2, 3.3, 3.4 (for remote HMC support), 3.5, 7.1
VIO Server
– V1.5.2.1-FP-11.1 for POWER6
– V2.1.2.11-FP-22.1 for POWER7
 Integrated Virtualization Manager if there is no HMC
 Shared SAN between servers
 Supported client operating systems
–
–
–
–
–
7
Minimum AIX V5.3 TL7 SP1 or AIX V6.1 SP1 for POWER6
Minimum AIX V5.3 TL9 SP7 or AIX V6.1 TL2 SP8 for POWER7
Minimum SuSE Linux for Power V10 SP1
Minimum RedHat Linux for Power Version 5.1 (RHSA-2007:0993-13)
Moving LPAR can only contain virtual resources
• Virtual SCSI
• Virtual Fibre Channel
• Virtual Ethernet
• Default virtual serial adapters
© 2010 IBM Corporation
IBM Power Systems
From “What’s New” website - Firmware support matrix for
partition mobility
8
© 2010 IBM Corporation
IBM Power Systems
Managed System (host) Requirements
© 2010 IBM Corporation
IBM Power Systems
PowerVMTM Editions
Express
Standard
Enterprise
1+2 / Server
10 / Core
10 / Core
IVM
IVM, HMC
IVM, HMC
Virtual I/O Server



Shared Dedicated Capacity



NPIV





Maximum LPARs
Management
Multiple Shared Processor Pools
10
Active Memory Sharing

Live Partition Mobility

© 2010 IBM Corporation
IBM Power Systems
PowerVM Enterprise Edition
Managed System (host) - Properties
11
© 2010 IBM Corporation
IBM Power Systems
Live Partition Capability Status - HMC
12
© 2010 IBM Corporation
IBM Power Systems
From “What’s New website” – Concurrent Migrations
Restrictions:
 Firmware levels 7.2 and 7.3 are restricted to eight concurrent migrations.
 With a 1 GB network adapter, up to four concurrent migrations are supported. From VIOS Version 2.2.2.0 or
later, you must have a 10 GB network adapter to support eight concurrent migrations.
 From VIOS Version 2.2.2.0, or later, you must have more than one pair of VIOS partitions to support more than
eight concurrent mobility operations.
 The Suspend/Resume feature for logical partitions is not supported on POWER8™ processor-based servers.
 Systems that are managed by the Integrated Virtualization Manager (IVM) support up to 8 concurrent migrations.
 To support the migration of up to 16 active or suspended mobile partitions from the source server to a single or
multiple destination servers, the source server must have at least two VIOS partitions that are configured as
mover service partitions. Each mover service partition must support up to 8 concurrent partition migration
operations. If all 16 partitions are to be migrated to the same destination server, then the destination server must
have at least two mover service partitions configured, and each mover service partition must support up to 8
concurrent partition migration operations.
13
© 2010 IBM Corporation
IBM Power Systems
Logical Memory Block (LMB) Size
System #1
(Source System)
System #2
(Destination System)
Two (2) – POWER6/7 Servers
AIX Client Partition 1
(Mobile Partition)
AIX Client Partition 1
LMB size
LMB size
Virtual I/O Server
ent1
virt
vhost0
vtscsi0
ent1
virt
hdiskX
ent2
SEA
fcs0
ent0
en2
if
en2
if
ent2
SEA
ent0
fcs0
Virtual I/O Server
POWER
Hypervisor
POWER
Hypervisor
Ethernet Network
HMC
Storage Area Network
Shared Disk
(Storage Device)
LUN
Physical
Volume LUN
14
© 2010 IBM Corporation
IBM Power Systems
Logical Memory Block (Memory Region Size)
Managed System - Properties
MUST match on Source / Destination Power Servers
15
© 2010 IBM Corporation
IBM Power Systems
Logical Memory Block (Memory Region Size)
LMB Modification Requires Reboot of Managed System
16
© 2010 IBM Corporation
IBM Power Systems
Virtual I/O Server (VIOS) Requirements
© 2010 IBM Corporation
IBM Power Systems
Mover Service Partition (MSP)
 Required for ACTIVE Partition Mobility only
 Provides VIO Server functions:
– Asynchronously extracts, transports, installs partition
state during migrations
 MSP must contain a single VASI virtual device
– Virtual asynchronous services interface (VASI)
– Provides communication between Hypervisors to gain
access to partition state
18
© 2010 IBM Corporation
IBM Power Systems
VIOS – MSP Flag set “ON” (Active Migration)
Source Server
19
Destination Server
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility (LPM) - Networking
POWER7 – Server-A
POWER7 – Server-B
Same SUBNET on Source and Destination
ENT0
SEA
ENT1
SEA
SEA
SEA
Ethernet
Controller
20
© 2010 IBM Corporation
IBM Power Systems
Virtual Machine (LPAR) Requirements
© 2010 IBM Corporation
IBM Power Systems
Processor Architecture Compatibility
Virtual Machine – Manage Profile
Mode Supported by Destination Host
22
© 2010 IBM Corporation
IBM Power Systems
Virtual Client I/O & Services
No Physical I/O
23
Virtual Machine Services
© 2010 IBM Corporation
IBM Power Systems
Virtual Client – Networking
Destination host must support Client VLAN
Virtual Ethernet
24
Supported VLAN
© 2010 IBM Corporation
IBM Power Systems
NPIV Provisioned Storage
Each WWPN pair Must be zoned to same LUN
25
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility (LPM) - NPIV
POWER7 – Server-A
POWER7 – Server-B
Multi-Pathing Software
FCS0
NPIV Capable adapter required on Destination
FCS1
World Wide Port Names Float between Servers
npiv
26
npiv
npiv
npiv
© 2010 IBM Corporation
IBM Power Systems
LPM
27
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility (LPM) - VSCSI
POWER7 – Server-A
Repeat Process for every Possible Destination
MPIO
No_Reserve
28
POWER7 – Server-B
No_Reserve
No_Reserve
No_Reserve
© 2010 IBM Corporation
IBM Power Systems
Virtual Client – Memory Restrictions
Inactive Mobility ONLY
29
© 2010 IBM Corporation
IBM Power Systems
Virtual Client – Shared Processor Pool
MSPP configuration not required on Destination host
30
© 2010 IBM Corporation
IBM Power Systems
Processor & Memory Availability
Destination host must have processor / memory Resources
31
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility - Migration
© 2010 IBM Corporation
IBM Power Systems
33
© 2010 IBM Corporation
IBM Power Systems
34
© 2010 IBM Corporation
IBM Power Systems
35
© 2010 IBM Corporation
IBM Power Systems
Initiating Live Partition Mobility
Migration Activities
 Migrate
 Validate
 Recover
36
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility - Validation
37
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility - Validation
Possible Results
 Errors
 Warnings
 Migration Screen
38
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility - Migrate
39
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility - Migrating
40
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility – Migration Completed
41
© 2010 IBM Corporation
IBM Power Systems
Live Partition Mobility – Migration Completed
42
© 2010 IBM Corporation
IBM Power Systems
43
© 2010 IBM Corporation
IBM Power Systems
44
© 2010 IBM Corporation
IBM Power Systems
End of Presentation
© 2010 IBM Corporation