Saturday, July 7, 2018

Move OCR and Voting Disk from one diskgroup to another - RAC

This note explains how to replace disks from "GRID" Diskgroup.
This should be used as a Ref.

 SQL> select GROUP_NUMBER,NAME,ALLOCATION_UNIT_SIZE,STATE,TOTAL_MB,FREE_MB from V$asm_diskgroup where NAME='GRID';

 GROUP_NUMBER NAME                           ALLOCATION_UNIT_SIZE STATE
------------ ------------------------------ -------------------- -----------
  TOTAL_MB    FREE_MB
---------- ----------
           3 GRID                                        1048576 MOUNTED
      8192       7790

=======================================
Create New diskgroup(CRS) with suitable redundancy for OCR and Voting files =======================================

 asmca -silent -createDiskGroup -diskGroupName GRID_NEW -diskList 
/dev/mapper/ASM_20160428_2G_EMC_2467_59A9,\
/dev/mapper/ASM_20160428_2G_EMC_2467_59AA,\
/dev/mapper/ASM_20160428_2G_EMC_2467_59AB,\
/dev/mapper/ASM_20160428_2G_EMC_2467_59AC  -redundancy EXTERNAL -au_size 1

 =======================================
Ensure that the new diskgroup is mounted on all cluster nodes
=======================================

 $ asmcmd
ASMCMD> lsdg GRID_NEW
State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512   4096  1048576      3936     3835                0            3835              0             N  GRID_NEW/

 ASMCMD> lsdg GRID*
State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512   4096  1048576      8192     7790                0            7790              0             Y  GRID/
MOUNTED  EXTERN  N         512   4096  1048576      3936     3835                0            3835              0             N  GRID_NEW/
ASMCMD>

 oragrid@blph334(338) +ASM2 /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1
$ asmcmd
ASMCMD> lsdg GRID_NEW
State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512   4096  1048576      3936     3835                0            3835              0             N  GRID_NEW/
ASMCMD> lsdg GRID*
State    Type    Rebal  Sector  Block       AU  Total_MB  Free_MB  Req_mir_free_MB  Usable_file_MB  Offline_disks  Voting_files  Name
MOUNTED  EXTERN  N         512   4096  1048576      8192     7790                0            7790              0             Y  GRID/
MOUNTED  EXTERN  N         512   4096  1048576      3936     3835                0            3835              0             N  GRID_NEW/
ASMCMD>

 =======================================
Move OCR and Vote file from <Current diskgroup> to <New DG>
=======================================

 $ ocrcheck
$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       5708
         Available space (kbytes) :     256412
         ID                       :  667132489
         Device/File Name         :      +GRID
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check bypassed due to non-privileged user

 oragrid@prin046(3600) +ASM1 /home/oragrid

 oragrid@vaib333(1228) +ASM1 /home/oragrid/scratch_dir
$ ocrcheck -config
Oracle Cluster Registry configuration is :
         Device/File Name         :      +GRID
oragrid@vaib333(1229) +ASM1 /home/oragrid/scratch_dir
$
=============Existing chcek==========

 $ ocrconfig -showbackup

 vaib333     2015/03/23 01:57:11     /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1/backup00.ocr

 vaib333     2015/03/22 21:57:10     /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1/backup01.ocr

 vaib333     2015/03/22 17:57:08     /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1/backup02.ocr

 vaib333     2015/03/22 01:57:05     /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1/day.ocr

 vaib333     2015/03/13 07:04:07     /opt/app/oragrid/oracle/product/11.2.0.4/cdata/prin1c1/week.ocr
PROT-25: Manual backups for the Oracle Cluster Registry are not available
oragrid@vaib333(1212) +ASM1 /home/oragrid/scratch_dir/3_grid_config
$

 =============Existing chcek==========
oragrid@vaib333(1215) +ASM1 /home/oragrid/scratch_dir/3_grid_config
$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   036b9c2d731f4ff0bfa9992c59a11974 (/dev/mapper/ASM_2.0G_EMC_360000970000195701845533033414242) [GRID]
Located 1 voting disk(s).
oragrid@vaib333(1216) +ASM1 /home/oragrid/scratch_dir/3_grid_config

 =============================================
Move OCR and Vote file from <Current diskgroup> to <>
=============================================

 *****$ORACLE_HOME/bin/bin/ocrconfig -add +GRID_NEW

 oragrid@vaib333(1233) +ASM1 /home/oragrid/scratch_dir
$ sudo /opt/app/oragrid/oracle/product/grid/bin/ocrconfig -add +GRID_NEW
oragrid@vaib333(1234) +ASM1 /home/oragrid/scratch_dir
$

 $ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4408
         Available space (kbytes) :     257712
         ID                       :  506290951
         Device/File Name         :      +GRID
                                    Device/File integrity check succeeded
         Device/File Name         :  +GRID_NEW
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check bypassed due to non-privileged user

 oragrid@vaib333(1235) +ASM1 /home/oragrid/scratch_dir
$ ocrcheck -config
Oracle Cluster Registry configuration is :
         Device/File Name         :      +GRID
         Device/File Name         :  +GRID_NEW
oragrid@vaib333(1236) +ASM1 /home/oragrid/scratch_dir
$

 *****sudo /opt/app/oragrid/oracle/product/grid/bin/ocrconfig -delete +GRID

 oragrid@vaib333(1237) +ASM1 /home/oragrid/scratch_dir
$ sudo /opt/app/oragrid/oracle/product/grid/bin/ocrconfig -delete +GRID
oragrid@vaib333(1238) +ASM1 /home/oragrid/scratch_dir
$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4408
         Available space (kbytes) :     257712
         ID                       :  506290951
         Device/File Name         :  +GRID_NEW
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check bypassed due to non-privileged user

 oragrid@vaib333(1239) +ASM1 /home/oragrid/scratch_dir
$
*****sudo /opt/app/oragrid/oracle/product/grid/bin/crsctl replace votedisk +GRID_NEW

 $ sudo /opt/app/oragrid/oracle/product/grid/bin/crsctl replace votedisk +GRID_NEW
Successful addition of voting disk 4c8c3d6276164fa1bf936dfcda593648.
Successful deletion of voting disk 036b9c2d731f4ff0bfa9992c59a11974.
Successfully replaced voting disk group with +GRID_NEW.
CRS-4266: Voting file(s) successfully replaced
oragrid@vaib333(1240) +ASM1 /home/oragrid/scratch_dir
$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   4c8c3d6276164fa1bf936dfcda593648 (/dev/mapper/ASM_20150114_984M_EMC_1845_51CF) [GRID_NEW]
Located 1 voting disk(s).
oragrid@vaib333(1241) +ASM1 /home/oragrid/scratch_dir
$

 =======================================
Startup CRS using New SPFILE from <CRS> Diskgroup
=======================================

 oragrid@vaib333(1245) +ASM1 /home/oragrid/odba
$ sql

 SQL*Plus: Release 11.2.0.4.0 Production on Mon Mar 23 04:28:57 2015

 Copyright (c) 1982, 2013, Oracle.  All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

 SQL> show parameter spfile

 NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
spfile                               string      +GRID/prin1c1/asmparameterfil
                                                 e/registry.253.855072119
+GRID/prin1c1/asmparameterfile/REGISTRY.253.875077465
SQL> create pfile='/home/oragrid/odba/init_grid_change.ora' from spfile;

 File created.

 SQL> exit
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
oragrid@vaib333(1246) +ASM1 /home/oragrid/odba
$ ls -ltr

 =====================Existing check=================
oragrid@vaib333(1216) +ASM1 /home/oragrid/scratch_dir/3_grid_config
$ gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
         /opt/app/oragrid/oracle/product/11.2.0.4/bin/gpnptool.bin get -o-

 <?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="4" ClusterUId="3e2619da2b1d4f77ff446142990b2b07" ClusterName="prin1c1" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="130.5.112.0" Adapter="bond0.575" Use="public"/><gpnp:Network id="net2" IP="172.29.70.0" Adapter="bond0.3099" Use="cluster_interconnect"/><gpnp:Network id="net3" IP="172.29.71.0" Adapter="bond0.3098" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/mapper/ASM_*" SPFile="+GRID/prin1c1/asmparameterfile/registry.253.855072119"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>2VcFJkjR5eq0+WBXwkCY1pr1un4=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>QOimZxCf12N8xLK3RxRY469BNr106lyI4xGqoz3RoE9eu5VKlQZiYtgfviYu7nvczJvbbg8JwXhHtZu0uBlZzHoAv3g8xGB69u/TmPP/GPPuaMCamofPCBCQGyds5jy8zzrqRGaI0Yt9w9g9qg7qjoHvxywBKaudNXy58TCjjf4=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.
oragrid@vaib333(1217) +ASM1 /home/oragrid/scratch_dir/3_grid_config
$
=======================================
oragrid@vaib333(1250) +ASM1 /home/oragrid/odba
$ sqlplus "/as sysasm"

 SQL*Plus: Release 11.2.0.4.0 Production on Mon Mar 23 04:31:56 2015

 Copyright (c) 1982, 2013, Oracle.  All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

 SQL> create spfile='+GRID_NEW' from pfile='/home/oragrid/odba/init_grid_change.ora';

 File created.

 SQL> exit

 =====================After check=================
oragrid@vaib333(1253) +ASM1 /home/oragrid/odba
$ gpnptool get
Warning: some command line parameters were defaulted. Resulting command line:
         /opt/app/oragrid/oracle/product/11.2.0.4/bin/gpnptool.bin get -o-

 <?xml version="1.0" encoding="UTF-8"?><gpnp:GPnP-Profile Version="1.0" xmlns="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:gpnp="http://www.grid-pnp.org/2005/11/gpnp-profile" xmlns:orcl="http://www.oracle.com/gpnp/2005/11/gpnp-profile" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.grid-pnp.org/2005/11/gpnp-profile gpnp-profile.xsd" ProfileSequence="5" ClusterUId="3e2619da2b1d4f77ff446142990b2b07" ClusterName="prin1c1" PALocation=""><gpnp:Network-Profile><gpnp:HostNetwork id="gen" HostName="*"><gpnp:Network id="net1" IP="130.5.112.0" Adapter="bond0.575" Use="public"/><gpnp:Network id="net2" IP="172.29.70.0" Adapter="bond0.3099" Use="cluster_interconnect"/><gpnp:Network id="net3" IP="172.29.71.0" Adapter="bond0.3098" Use="cluster_interconnect"/></gpnp:HostNetwork></gpnp:Network-Profile><orcl:CSS-Profile id="css" DiscoveryString="+asm" LeaseDuration="400"/><orcl:ASM-Profile id="asm" DiscoveryString="/dev/mapper/ASM_*" SPFile="+GRID_NEW/prin1c1/asmparameterfile/registry.253.875075585"/><ds:Signature xmlns:ds="http://www.w3.org/2000/09/xmldsig#"><ds:SignedInfo><ds:CanonicalizationMethod Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"/><ds:SignatureMethod Algorithm="http://www.w3.org/2000/09/xmldsig#rsa-sha1"/><ds:Reference URI=""><ds:Transforms><ds:Transform Algorithm="http://www.w3.org/2000/09/xmldsig#enveloped-signature"/><ds:Transform Algorithm="http://www.w3.org/2001/10/xml-exc-c14n#"> <InclusiveNamespaces xmlns="http://www.w3.org/2001/10/xml-exc-c14n#" PrefixList="gpnp orcl xsi"/></ds:Transform></ds:Transforms><ds:DigestMethod Algorithm="http://www.w3.org/2000/09/xmldsig#sha1"/><ds:DigestValue>PfeU/j5+D8xOFt/1MfmCVffxVr4=</ds:DigestValue></ds:Reference></ds:SignedInfo><ds:SignatureValue>FeB3+H+CVLn4o9QDvyK7qVwn1sNFhGb9BChPIrgqVuwHEmVTjnrOmc5urw7TERfiaNDNqREttERWZnp548nhSkTr6trHLQYkmngCq1fgXNs67riieJxPk1+wQ0MSQ8pldm1eiGfb37Rrya6hnK8KZl/s+kJvFgF3ueu/7N+xLhY=</ds:SignatureValue></ds:Signature></gpnp:GPnP-Profile>
Success.
oragrid@vaib333(1254) +ASM1 /home/oragrid/odba

 =========================
Ensure ALL Cluster Resources are started successfully 
=========================

 sudo /opt/app/oragrid/oracle/product/grid/bin/crsctl stop cluster -all

 sudo /opt/app/oragrid/oracle/product/grid/bin/crsctl start cluster -all

 oragrid@vaib333(1277) +ASM1 /home/oragrid
$  ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          3
         Total space (kbytes)     :     262120
         Used space (kbytes)      :       4408
         Available space (kbytes) :     257712
         ID                       :  506290951
         Device/File Name         :  +GRID_NEW
                                    Device/File integrity check succeeded

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

                                     Device/File not configured

          Cluster registry integrity check succeeded

          Logical corruption check bypassed due to non-privileged user

 oragrid@vaib333(1278) +ASM1 /home/oragrid
$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   4c8c3d6276164fa1bf936dfcda593648 (/dev/mapper/ASM_20150114_984M_EMC_1845_51CF) [GRID_NEW]
Located 1 voting disk(s).
oragrid@vaib333(1279) +ASM1 /home/oragrid

 ===============================
unmount the old dg on both node and do the stop /restart cluster 
===============================
Drop the old dg

 asmcmd
dropdg -r < old dg group
**check in crsctl resources deleted or not
***check asm_diskgroups parameter

 we can rename this GRID_NEW to original as GRID if we want.

Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)