storage migration

View previous topic View next topic Go down

storage migration

Post by Nicki on Sat Apr 12, 2008 1:13 pm

Hi,

I am pretty new in the Vxfs and VCS stuff as its usually not used on AIX - but I have to upgrade the powerpath software and migrate the whole storage to another symmetrix next week.
I already tried the powerpath upgrade a couple of weeks ago but somehow it failed and corrupted my RAC cluster - shared disks had no longer been shared and one of the nodes did not come up at all, and the storage was not really accessible - we could not even write into new created and mounted filesystems.
Does anyone have a slight idea what I did wrong - to avoid similar issues next week? Is there a way to protect the cluster config from being overwritten?

Thanks in advance for any hint you can give me ...

Kind regards
Nicki

Nicki

Posts : 11
Join date : 2008-04-12
Location : Belfast

View user profile http://www.linkedin.com/in/nickipaul

Back to top Go down

Re: SAN Migration

Post by spanner on Sat Apr 12, 2008 5:26 pm

Nicky,

its unclear from the post, but was the migration performed on an AIX server or Solaris and what steps did u take? It, should not make any difference - I am just curious Smile

What did you do to recover the situation, perhaps it may help us to figure out what went wrong..

spanner

Posts : 14
Join date : 2008-04-10
Location : Somewhere in Somerset - where there is a lot of mud - and sounds a bit "Horsey"

View user profile http://www.linkedin.com/in/sarbpanesar

Back to top Go down

Re: storage migration

Post by Nicki on Sun Apr 13, 2008 2:30 pm

Hi Spanner,
the powerpath upgrade was on AIX ... and I am really not sure what I did wrong ... I stated already I am not that experienced in these things. To recover the whole thing I had to change the diskgroup that was no longer shared back to shared, remove / recreate the fencing disks (as the command that should clean the split brain condition I had, did not fix the problem - the cluster still did not come up after the reboot), manually mount the disks, manually start rac, re-activate cssd in the clusterconfiguration to bring up oracle and boot a couple of times. I am not even sure hat really fixed the problems - but I am scared that it happens again next time.
Thats why I am asking how-to-do-it the right way. I think I messed something up by throwing away the disks - on AIX LVM pretty easy but seems I have done something wrong with the veritas disks ... But most confusing for me was that even the backout (booting from cloned disks) not fixed the problem ...
Rgds
Nicki

Nicki

Posts : 11
Join date : 2008-04-12
Location : Belfast

View user profile http://www.linkedin.com/in/nickipaul

Back to top Go down

Re: storage migration

Post by spanner on Tue Apr 15, 2008 3:55 pm

Hmm - sorry Nicki but I do not know how to answer your question on this one. Hope you do not experience the same issue with your other migration.

spanner

Posts : 14
Join date : 2008-04-10
Location : Somewhere in Somerset - where there is a lot of mud - and sounds a bit "Horsey"

View user profile http://www.linkedin.com/in/sarbpanesar

Back to top Go down

Re: storage migration

Post by Nicki on Sun Apr 20, 2008 7:16 am

Hi,

today I retried the powerpath upgrade and this time everything went ok Smile

the steps I did :

BRING DOWN CLUSTER AND ALL NON-CLUSTER-MANAGED VOLUMEGROUPS

# hastop -all
# umount -a
# varyoffvg <volumegroup>

- if required upgrade firmware at this stage -

BRING STORAGE OUT OF VERITAS CONTROL

# vxdisk list
# vxdisk offline <all devices that are shown as online>

BRING STORAGE OUT OF POWERPATH CONTROL

# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0

*** REMOVE / REINSTALL POWERPATH SOFTWARE ***

BRING STORAGE UNDER POWERPATH CONTROL

# /usr/sbin/powermt check_registration
# cfgmgr
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save
# for i in $(lspv| awk '/power/ {print $1}') ; do rmdev -dl $i ; done
# for i in $(lspv| awk '!/rootvg/ {print $1}') ; do rmdev -dl $i ; done
# rmdev -Rdl fscsi0
# rmdev -Rdl fscsi1
# rmdev -Rdl powerpath0
# /usr/lpp/EMC/Symmetrix/bin/emc_cfgmgr
# powermt config
# powermt save

VARYON AND MOUNT ALL NON-VERITAS-MANAGED VOLUMEGROUPS

# varyonvg <volumegroup>
# mount -a

BRING STORAGE INTO VERITAS CONTROL WITHOUT ONLINING

# vxdctl enable

REBOOT ALL CLUSTERNODES AT THE SAME TIME

After the restart all clusternodes came up properly and RAC started without any issues.

Nicki

Posts : 11
Join date : 2008-04-12
Location : Belfast

View user profile http://www.linkedin.com/in/nickipaul

Back to top Go down

Re: storage migration

Post by spanner on Thu Apr 24, 2008 12:56 am

thats good news and thanks for posting the steps Laughing

spanner

Posts : 14
Join date : 2008-04-10
Location : Somewhere in Somerset - where there is a lot of mud - and sounds a bit "Horsey"

View user profile http://www.linkedin.com/in/sarbpanesar

Back to top Go down

Re: storage migration

Post by Sponsored content Today at 11:14 am


Sponsored content


Back to top Go down

View previous topic View next topic Back to top

- Similar topics

 
Permissions in this forum:
You cannot reply to topics in this forum