So whats the story? Back in 2010 IBM released the Storwize V7000 and subsequently the Storwize V7000 Unified. The IBM Storwize V7000 is IBMs next generation mid-range storage Virtualization platform. The platform has been built utilising many features from IBMs best of breed solutions including SVC, DS8000 and XIV. The features list is huge and my favourites include Easy Tier, the Dynamic Migration capabilities, the External Storage Subsystem Virtualization capabilities (these are not vendor limited - V6.3 Supported Hardware List, Device Driver, Firmware and Recommended Software Levels for IBM Storwize V7000) VAAI integration, vCenter integration and Clustered Systems. In a sentence it's a solid mid-range storage subsystem containing many features you would only expect to see on an enterprise level storage subsystem.
Data migration from an SVC presenting a DS3k, DS4k & DS5k to a V7000. It looks simple doesn't it? However I recently came across a scenario with an environment running old 4F2 SVC nodes and planned to migrate all data under the SVC on DS3k, DS4k and DS5k storage onto a V7000. This presented a problem in that the V7000 can only be presented as a host to an SVC running 5.1.0.8 and above - V5.1.x - Supported Hardware List, Device Driver and Firmware Levels for IBM SVC A quick check over the Node and UPS Interoperability Matrix for SVC shows that the 4F2s are only compatible with SVC code level 4.3.x.
Hmmmm so what now? If you are running any of the SVC nodes - CG8s, CF8s, 8A4s, 8G4s, 8F4s and 8F2s. I suggest you upgrade from 4.3.x to a minimum of 5.1.0.8. The upgrade process from 4.3.x to 5.1.x takes approx 1 hour, ensure you complete the required planning prior to upgrading the system If you are feeling adventurous I would follow this upgrade process to get the SVC running the latest code release 4.3.x.x >> 5.1.0.11 >> 6.3.0.2. Once upgraded to 5.1.0.8 or higher you can follow these steps to migrate the VDisks under your SVC onto the V7000:- Create the V7000 as a host on the SVC
- Create the relevant pools of MDisks on your V7000
- Create the SVC as a host on the V7000
- Create replica sized VDisks on the V7000 as per the VDisks currently presented via your SVC
- Present the VDisks on your V7000 to the SVC
- Export SVC VDisks to Image Mode on the matching VDisks created on the V7000
- Upgrade SDDSM drivers
- Shutdown host
- Remove SVC VDisk mapping to host
- Remove V7000 VDisk mapping to SVC
- Map V7000 VDisk to same LUN number on host
- Start up host, confirm via datapath querys that the relevant drives and paths are connected to the host via the V7000
However if you have 4F2 nodes or you have change limitations in place and cannot run or upgrade to 5.1.0.8 or higher on your SVC the migration process becomes slightly more difficult.
The
only option (I can see) for migration of physical hosts accessing VDisks on 4F2 SVC nodes running
4.3.1.11 is to migrate the VDisks on
the SVC to image mode (on supported swing kit) and then import these VDisks under the V7000. The high level migration process for a 4F2 SVC cluster presenting DS3k, DS4k and DS5K is detailed below:
- Create identically sized VDisks on the array being used as the Swing Kit as per size of VDisk which is going to be migrated to Image Mode on the SVC **Ensure you spread the LDs across the muliple arrays and controllers on the swing kit (if possible) and provision the storage on the swing kit with sufficient redundancy as production data will be temporarily running on the swing kit.
- Map the Logical Drive to Host Group SVC
- Once the Drive has been mapped, login to the SVC and select Work with Managed Disks >> Discover MDisks
- The newly Presented MDisk should then be discovered in an online state and Unmanaged mode
- Create an MDisk group for the Swing Kit
- On the SVC select Work with Virtual Disks, Virtual Disks, select the VDisk that is going to be migrated to an Image Mode VDisk and select Migrate to an Image Mode VDisk
- Confirm the copy to migrate to the Image Mode VDisk
- Select the Target MDisk which is the MDisk presented up from the temporary array
- Select the MDisk Group which will be the MDisk group previously create
- Confirm the number of threads to devote this process (The default is 4 which makes the process the highest priority - this can be changed to prioritise simultaneous migrations)
- Verify the Migration Attributes and once confirmed they are correct, select finish
- Now go to manage progress, view progress, Image Mode Migration and click on refresh then the progress % to view the detailed progress info of the of migrating data from a virtual disk (VDisk) to an image mode VDisk
- Once the conversion is complete the VDisk will be displayed an image mode VDisk
- Logon to the server and confirm the SAN drives are visible and all applications accessing data on these drives are accessible
- Logon to host
- Confirm if host OS is x86 or x64
- Open command prompt and run datapath query device from within current SDDSM installation directory and take a note of the output
- Update SDDDSM driver to latest V7000 Driver
- Once completed the SDDDSM driver installation prompts for a reboot.
- Once host has been rebooted confirm that the host boots successfully
- Shutdown host
- Edit Host to Logical Drive Mapping on DS Storage Manager
- Prior to changing the mapping ensure you take a note of the LUN ID
- Remove mapping of LD to SVC
- Select Create Host-to-Logical Drive Mappings
- Select Host Group V7000 (you will need to create this on DS Storage Manager)
- Select Logical Drive containing image mode VDisk
- Ensure the same LUN number is used when presenting the LD to the V7000
- Select Finish- Confirm the LD is now mapped to Host Group V7000
- Login to the V7000, select external storage subsystems and select array presented to the V7000 containing image mode VDisk, detect MDisks
- The LD should be detected as an MDisk
- Right click the MDisk and select import
- Confirm the default settings (Import as generic volume and
Enable Caching and select next)
**DO NOT SELECT A POOL TO MIGRATE THE MDISK INTO** - Select Finish - You will be informed that the volume will be placed in a temporary migration storage pool. Select Ok to continue
- The Import MDisks task will then complete
- The MDisk mode is now Image rather than Unmanaged
- On the V7000 go into volume and you will see a new volumes within Storage Pool MigrationPool_xxxx
- Rename the imported VDisk from controller1_xxxxxxxxxxxxxxxxxx to original VDisk name on SVC
- Right click volume and select map to host. Chose the relevant Host and change the SCSI ID to the LUN ID documented previously
- Select Map Volumes and the V7000 will complete the volume mapping to the Host
- Boot the Host and confirm it comes up successfully and the Image mode VDisk on the Swing Kit is visible
- Login to V7000 >> Go to Volumes >> Right click the Volume you wish to create a VDisk Mirror for (this will be within MigrationPool_xxxx) select Volume Copy Actions >> Add Mirrored Copy
- You are then prompted to Select the Volume Type & Storage Pool for the VDisk Mirror >> Once confirmed the Add Volume Copy task then starts and completed
- Refresh the Volumes page and you will note that two copies exist under volume. Copy0 is within Storage Pool MigrationPool_xxxx and Copy1 within Storage Pool you specified when creating the VDisk mirror. During the Volume Syncronization Copy0 is the primary volume this is shown by the * at the end of the Copy Volume Name
- Logging onto the host if you run a datapath query device as expected will see the host can see two devices (the array containing the Image Mode VDisk & V7000)
- Once the volume synchronization for the VDisk mirror completes, confirm Volume Mirrors are in Sync
- Promote Striped Volume (V7000 Internal to Primary)
- Stop all IO on Host
- Re-Activate Disk on Host
- Delete Image mode volume from mirror
- Remove the mapping of the VDisk Image mode volume via Storage Manager
- Reboot Host
- Re-Activate Disk on Host following device ID change
- Reboot Host
- Confirm Host comes online and all applications are accessible
Hurrah you are now successfully migrated onto your V7000. Its also worth noting that you will want to complete the following tidy up tasks following the successful migration of a VDisk:
- Delete VDisk to Host Mapping on SVC for Migrated VDisk
- Delete the VDisk that has been migrated onto the V7000
- Delete Host on SVC once no VDisks are being presented to the host via the SVC
- Delete the zones within the Fabrics associating the SVC to the Host that no longer has any associated VDisks
- Delete the Logical Drive containing the VDisk Image on the Swing Kit
Fortunately the migration path for virtual machines using Storage VMotion is a lot simpler and involves No Downtime! (Providing you are running on ESX 3.5 or above, if you are still running 3.5 you will need to run the SVM interactively via the CLI, via the remote CLI or the SVM VI Client plugin) To complete the SVM you will need to present the VDisks provisioned for ESX/ESXi datastores up to your ESX Host Group on the V7000 and SVM the VMs to the new storage. If you are running vSphere 5 you can also take advantage of creating fresh VMFS5 datastores on the V7000 and SVM from your old VMFS3 datastores onto these.
I hope this makes sense and helps all of you who cannot upgrade your SVC past 4.3.x and are looking to migrate onto V7000. If your confused or need more information on the V7000/V7000U and getting your environment successfully migrated onto these please feel free to comment on the blog or contact me via wbush@virtualvizion.com
Instead of migrating as a image mode vdisk. you can directly migrate the vdisk to new v7000. by presenting the V7000 back of the SVC and create a diskgroup at SVC and doa vdisk migration.
ReplyDeleteHi Rajesh, Thanks for your comment. Indeed you can present the V7000 behind the SVC, create the relevant Mdisk pools on the SVC and perform a VDisk migration. But as mentioned in the post this only possible if the SVC is running 5.1.0.8 or above which is not possible on 4F2 SVC nodes which are only compatible with SVC code level 4.3.x. Hence the reason for the alternative migration method for those with 4F2 SVC nodes.
ReplyDeletehi
ReplyDeleteI am reading the SVC guide but I am a little confused I have DS5100 with existing date and a V7000 We just want to take advantage of the V7000 and manage and map volumes using the V7000 so we want to virtualize the DS5100 keeping the data in the DS5100 but anything I read refers to as migrating data off the DS storage and I just want to keep data in it not move it to my V7000.
For what I get I must have import the disks with existing data from DS5100 as image mode but If I continue it says
"If you want to migrate the data from the external volume (that is being imported) to existing V7000 MDisks" but I don't want that but this guide never says what to do when I want keep the data
any idea o help thanks a lot
Hi,
ReplyDeleteThanks for getting in touch. The blog post describes the migration procedure frrom storage virtualized beneath SVC 4F2 nodes to the V7000. The simply virtualize your DS5100 beneath the V7000 make the following changes:
Check the IBM V7000 Supported Hardware List, Device Driver, Firmware and Recommended Software Levels for the level of V7000 FW you are running and confirm the DS5100 and connected hosts are running compatible FW and device drivers. If not upgrade the relevant FW and device drivers to supported levels
Create a Zone allowing the DS5100 to become visible to the V7000
Define the V7000 as host on DS5100
The following process then needs to be completed for each physical host accessing data on the DS5100:
Shutdown and disable applications
Take host down to single path to DS5100
Uninstall MPIO driver
Reboot confirm host OK then shut down
Remove mapping between host and LUN on DS5100
Map LUN to V7000
Import LUN as image mode volume
Zone host to V7000 via single path
Create new host definition
Map LUNs to host via single path using same LUN ID as existing LUNs
Install SDDDSM MPIO driver
Zone additional paths to host
Confirm host can see all paths via datapath query device
This now means you have image mode volumes on your DS5100 managed via the V7000. You can then look at mirroring the volumes onto the V7000 promoting the secondary copy (on the V7000) to the primary if you wish to move the data from the DS5100 onto the V7000 which is an online process.
*Storwize V7000 system supports attachment to external storage through SAN fabric only. When attaching external storage each node in Storwize V7000 must see the same external storage controller ports. As a best practice two redundant fabrics should be used for redundancy in the event
one of the fabrics should go offline for either a planned or unplanned outage. In each fabric create a zone with just the IBM Storwize V7000 ports. Create additional zones for the
external storage systems to be virtualized. In each fabric create a zone with the IBM Storwize V7000 ports from each node canister, along with up to a maximum of eight (8) FC ports from the external storage system. The Storwize V7000 supports up to maximum of sixteen (16) ports from a given
external storage system to be virtualized, eight (8) in each fabric.
Hi,
ReplyDeleteAre there any workload considerations to be made? Can I assume the V7000 can handle the same workload as a regular 2 node SVC cluster can? Are there any guidelines to this? Thanks in advance.
Hi,
ReplyDeleteGood Question. The SVC and V7000 controller nodes are essentially the same (bar minor cache and CPU differences) just packaged in different hardware with the V7000 not requiring the 1U UPS as embedded batteries within the PSUs.
A few useful articles to review when considering workloads in VMware environments are below
http://www.esg-global.com/lab-reports/ibm-storwize-v7000-real-world-mixed-workload-performance-in-vmware-environments/
http://www-03.ibm.com/support/techdocs/atsmastr.nsf/5cb5ed706d254a8186256c71006d2e0a/100d2700204e9df6862577b500211afe/$FILE/0002_V7000_VMware%20Storage_Practices.pdf
https://www.ibm.com/developerworks/mydeveloperworks/blogs/storagevirtualization/entry/configuring_ibm_storwize_v7000_and_svc_for_optimal_performance_part_121?lang=en
Feel free to get in contact if you want to discuss workload considerations in more detail
Hi William , thank you for your blog , I need your suggestion, I have to migrate data from SVC to FS9200, could you comment what all points need to check before proceed?
ReplyDelete