반응형

[상태 확인]

[oracle@datarac1 ~]$ sqlplus "/as sysdba"
SQL*Plus: Release 19.0.0.0.0 - Production on Wed May 31 09:51:29 2023
Version 19.19.0.0.0
Copyright (c) 1982, 2022, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.19.0.0.0
SQL> col USERNAME for a15
SQL> select USER_ID, USERNAME, ACCOUNT_STATUS from dba_users where USERNAME in ('SYS','SYSTEM');
   USER_ID USERNAME        ACCOUNT_STATUS
---------- --------------- --------------------------------
         0 SYS             OPEN
         9 SYSTEM          OPEN
SQL>

[SYSTEM User 삭제]

SQL> show user
USER is "SYS"
SQL>
SQL> drop user system;
drop user system
*
ERROR at line 1:
ORA-28050: specified user or role cannot be dropped
SQL> drop user system CASCADE;
drop user system CASCADE
*
ERROR at line 1:
ORA-28050: specified user or role cannot be dropped
SQL>

[SYS User 삭제]

SQL> show user
USER is "SYSTEM"
SQL>
SQL> drop user sys;
drop user sys
*
ERROR at line 1:
ORA-28050: specified user or role cannot be dropped
SQL> drop user sys CASCADE;
drop user sys CASCADE
*
ERROR at line 1:
ORA-28050: specified user or role cannot be dropped
SQL>

[결론]
안된다.
그러니 이상한 소리 하지 말아라..

반응형
반응형

현 상태 확인

[root@datarac1 bin]# id
uid=0(root) gid=0(root) groups=0(root) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@datarac1 bin]# pwd
/u01/app/19.0.0/grid/bin
[root@datarac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         :   +OCRVOTE
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]#
[root@datarac1 bin]# ./ocrcheck -details
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         : +OCRVOTE/datarac/OCRFILE/registry.255.1137239017
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]#
[root@datarac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   8e99de0aed5d4f45bff8818da83cea68 (/dev/oracleasm/asm-disk01) [OCRVOTE]
 2. ONLINE   1c4f3d989f684fbebf542f9bfb363318 (/dev/oracleasm/asm-disk02) [OCRVOTE]
 3. ONLINE   124978c179a24f20bf37f7db95407eed (/dev/oracleasm/asm-disk03) [OCRVOTE]
Located 3 voting disk(s).
[root@datarac1 bin]#

--OCR/VOTE가 사용하는 ASM Disk 확인
[oracle@datarac1 ~]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 ~]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 ~]$ sqlplus "/as sysdba"
SQL*Plus: Release 19.0.0.0.0 - Production on Tue May 23 09:21:38 2023
Version 19.19.0.0.0
Copyright (c) 1982, 2022, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.19.0.0.0
SQL> set linesize 150
SQL> col name for a20
SQL> col state for a10
SQL> col path for a40
SQL> select name, group_number "g_no", disk_number "d_no", state, redundancy, path from v$asm_disk order by 6;
NAME                       g_no       d_no STATE      REDUNDA PATH
-------------------- ---------- ---------- ---------- ------- ----------------------------------------
OCRVOTE_0000                  2          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk01
OCRVOTE_0001                  2          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk02
OCRVOTE_0002                  2          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk03
DATA1_0000                    1          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk04
DATA1_0001                    1          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk05
DATA1_0002                    1          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk06
                              0          3 NORMAL     UNKNOWN /dev/oracleasm/asm-disk07
                              0          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk08
                              0          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk09
                              0          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk10
10 rows selected.
SQL>

OCR/VOTE용 ASM Disk Group에 ASM DISK 추가 삭제

--OCR/VOTE용 ASM Disk Group에 ASM DISK 추가
[oracle@datarac1 ~]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 ~]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 ~]$
[oracle@datarac1 ~]$
[oracle@datarac1 ~]$
[oracle@datarac1 ~]$ sqlplus "/as sysasm"
SQL*Plus: Release 19.0.0.0.0 - Production on Tue May 23 10:39:17 2023
Version 19.19.0.0.0
Copyright (c) 1982, 2022, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.19.0.0.0
SQL> select * from v$asm_operation;
no rows selected
SQL> ALTER DISKGROUP OCRVOTE ADD DISK '/dev/oracleasm/asm-disk07' REBALANCE POWER 5;
Diskgroup altered.
SQL> select * from v$asm_operation;
GROUP_NUMBER OPERA PASS      STAT      POWER     ACTUAL      SOFAR   EST_WORK
------------ ----- --------- ---- ---------- ---------- ---------- ----------
  EST_RATE EST_MINUTES ERROR_CODE                                       CON_ID
---------- ----------- -------------------------------------------- ----------
           2 REBAL COMPACT   WAIT          5          5          0          0
         0           0                                                       0

           2 REBAL REBALANCE RUN           5          5         62         62
      4241           0                                                       0

           2 REBAL REBUILD   DONE          5          5          0          0
         0           0                                                       0


GROUP_NUMBER OPERA PASS      STAT      POWER     ACTUAL      SOFAR   EST_WORK
------------ ----- --------- ---- ---------- ---------- ---------- ----------
  EST_RATE EST_MINUTES ERROR_CODE                                       CON_ID
---------- ----------- -------------------------------------------- ----------
           2 REBAL RESYNC    DONE          5          5          0          0
         0           0                                                       0
SQL> select * from v$asm_operation;
no rows selected
SQL>
SQL> set linesize 150
SQL> col name for a20
SQL> col state for a10
SQL> col path for a40
SQL> select name, group_number "g_no", disk_number "d_no", state, redundancy, path from v$asm_disk order by 6;

NAME                       g_no       d_no STATE      REDUNDA PATH
-------------------- ---------- ---------- ---------- ------- ----------------------------------------
OCRVOTE_0000                  2          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk01
OCRVOTE_0001                  2          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk02
OCRVOTE_0002                  2          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk03
DATA1_0000                    1          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk04
DATA1_0001                    1          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk05
DATA1_0002                    1          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk06
OCRVOTE_0003                  2          3 NORMAL     UNKNOWN /dev/oracleasm/asm-disk07
                              0          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk08
                              0          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk09
                              0          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk10

10 rows selected.

SQL>exit
--OCR/VOTE 확인
[root@datarac1 bin]# id
uid=0(root) gid=0(root) groups=0(root) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@datarac1 bin]# pwd
/u01/app/19.0.0/grid/bin
[root@datarac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         :   +OCRVOTE
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]#
[root@datarac1 bin]#
[root@datarac1 bin]# ./ocrcheck -details
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         : +OCRVOTE/datarac/OCRFILE/registry.255.1137239017
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   8e99de0aed5d4f45bff8818da83cea68 (/dev/oracleasm/asm-disk01) [OCRVOTE]
 2. ONLINE   1c4f3d989f684fbebf542f9bfb363318 (/dev/oracleasm/asm-disk02) [OCRVOTE]
 3. ONLINE   124978c179a24f20bf37f7db95407eed (/dev/oracleasm/asm-disk03) [OCRVOTE]
Located 3 voting disk(s).
[root@datarac1 bin]#
--OCR/VOTE용 ASM Disk Group에 ASM DISK 삭제
[oracle@datarac1 ~]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 ~]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 ~]$ sqlplus "/as sysasm"
SQL*Plus: Release 19.0.0.0.0 - Production on Tue May 23 10:46:20 2023
Version 19.19.0.0.0
Copyright (c) 1982, 2022, Oracle.  All rights reserved.
Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.19.0.0.0
SQL> set linesize 150
SQL> col name for a20
SQL> col state for a10
SQL> col path for a40
SQL> select name, group_number "g_no", disk_number "d_no", state, redundancy, path from v$asm_disk order by 6;
NAME                       g_no       d_no STATE      REDUNDA PATH
-------------------- ---------- ---------- ---------- ------- ----------------------------------------
OCRVOTE_0000                  2          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk01
OCRVOTE_0001                  2          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk02
OCRVOTE_0002                  2          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk03
DATA1_0000                    1          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk04
DATA1_0001                    1          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk05
DATA1_0002                    1          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk06
OCRVOTE_0003                  2          3 NORMAL     UNKNOWN /dev/oracleasm/asm-disk07
                              0          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk08
                              0          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk09
                              0          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk10

10 rows selected.
QL>
SQL> ALTER DISKGROUP OCRVOTE DROP DISK OCRVOTE_0000;
Diskgroup altered.
SQL> select * from v$asm_operation;
GROUP_NUMBER OPERA PASS      STATE           POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- --------- ---------- ---------- ---------- ---------- ---------- ---------- -----------
ERROR_CODE                                       CON_ID
-------------------------------------------- ----------
           2 REBAL COMPACT   WAIT                1          1          0          0          0           0
                                                      0

           2 REBAL REBALANCE RUN                 1          1         53         94       2148           0
                                                      0

           2 REBAL REBUILD   DONE                1          1          0          0          0           0
                                                      0


GROUP_NUMBER OPERA PASS      STATE           POWER     ACTUAL      SOFAR   EST_WORK   EST_RATE EST_MINUTES
------------ ----- --------- ---------- ---------- ---------- ---------- ---------- ---------- -----------
ERROR_CODE                                       CON_ID
-------------------------------------------- ----------
           2 REBAL RESYNC    DONE                1          1          0          0          0           0
                                                      0


SQL> select * from v$asm_operation;
no rows selected
SQL> select name, group_number "g_no", disk_number "d_no", state, redundancy, path from v$asm_disk order by 6;
NAME                       g_no       d_no STATE      REDUNDA PATH
-------------------- ---------- ---------- ---------- ------- ----------------------------------------
                              0          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk01
OCRVOTE_0001                  2          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk02
OCRVOTE_0002                  2          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk03
DATA1_0000                    1          0 NORMAL     UNKNOWN /dev/oracleasm/asm-disk04
DATA1_0001                    1          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk05
DATA1_0002                    1          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk06
OCRVOTE_0003                  2          3 NORMAL     UNKNOWN /dev/oracleasm/asm-disk07
                              0          2 NORMAL     UNKNOWN /dev/oracleasm/asm-disk08
                              0          1 NORMAL     UNKNOWN /dev/oracleasm/asm-disk09
                              0          3 NORMAL     UNKNOWN /dev/oracleasm/asm-disk10

10 rows selected.
SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.19.0.0.0
[oracle@datarac1 ~]$
--OCR/VOTE 확인
[root@datarac1 bin]# id
uid=0(root) gid=0(root) groups=0(root) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@datarac1 bin]# pwd
/u01/app/19.0.0/grid/bin
[root@datarac1 bin]# ./ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         :   +OCRVOTE
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]# ./ocrcheck -details
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     491684
         Used space (kbytes)      :      84516
         Available space (kbytes) :     407168
         ID                       : 1930868031
         Device/File Name         : +OCRVOTE/datarac/OCRFILE/registry.255.1137239017
                                    Device/File integrity check succeeded
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
                                    Device/File not configured
         Cluster registry integrity check succeeded
         Logical corruption check succeeded
[root@datarac1 bin]# ./crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   1c4f3d989f684fbebf542f9bfb363318 (/dev/oracleasm/asm-disk02) [OCRVOTE]
 2. ONLINE   124978c179a24f20bf37f7db95407eed (/dev/oracleasm/asm-disk03) [OCRVOTE]
 3. ONLINE   626f4793a1794fc9bfeec52aa161bbcf (/dev/oracleasm/asm-disk07) [OCRVOTE]
Located 3 voting disk(s).
[root@datarac1 bin]# exit

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

반응형
반응형

Oracle DB S/W addnode

[oracle@datarac1 addnode]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 addnode]$ env | grep SID
ORACLE_SID=DATARAC1
[oracle@datarac1 addnode]$ pwd
/u01/app/oracle/product/19.0.0/db_1/addnode
[oracle@datarac1 addnode]$ ls
addnode_oraparam.ini  addnode_oraparam.ini.sbs  addnode.pl  addnode.sh
[oracle@datarac1 addnode]$
[oracle@datarac1 addnode]$
[oracle@datarac1 addnode]$ ./addnode.sh -silent -ignoreSysPrereqs -ignorePrereqFailure \
> -waitForCompletion CLUSTER_NEW_NODES=datarac3
[WARNING] [INS-13013] Target environment does not meet some mandatory requirements.
   CAUSE: Some of the mandatory prerequisites are not met. See logs for details. /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-51-48PM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-51-48PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.

Prepare Configuration in progress.

Prepare Configuration successful.
..................................................   7% Done.

Copy Files to Remote Nodes in progress.
..................................................   12% Done.
..................................................   18% Done.
..............................
Copy Files to Remote Nodes successful.
You can find the log of this install session at:
 /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-51-48PM.log

Instantiate files in progress.

Instantiate files successful.
..................................................   52% Done.

Saving cluster inventory in progress.
..................................................   89% Done.

Saving cluster inventory successful.
The Cluster Node Addition of /u01/app/oracle/product/19.0.0/db_1 was successful.
Please check '/u01/app/oraInventory/logs/silentInstall2023-05-22_05-51-48PM.log' for more details.

Setup Oracle Base in progress.

Setup Oracle Base successful.
..................................................   96% Done.

As a root user, execute the following script(s):
        1. /u01/app/oracle/product/19.0.0/db_1/root.sh

Execute /u01/app/oracle/product/19.0.0/db_1/root.sh on the following nodes:
[datarac3]


Successfully Setup Software with warning(s).
..................................................   100% Done.
[oracle@datarac1 addnode]$

추가 Node에서 root.sh 실행

[root@datarac3 ~]# id
uid=0(root) gid=0(root) groups=0(root) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@datarac3 ~]#
[root@datarac3 ~]# /u01/app/oracle/product/19.0.0/db_1/root.sh
Check /u01/app/oracle/product/19.0.0/db_1/install/root_datarac3.localdomain_2023-05-22_18-00-18-763394494.log for the output of root script
[root@datarac3 ~]#

DB Instance 추가

[oracle@datarac1 ~]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 ~]$ env | grep SID
ORACLE_SID=DATARAC1
[oracle@datarac1 ~]$
[oracle@datarac1 ~]$ dbca -silent -addInstance -gdbName DATARAC -nodeName datarac3 -instanceName DATARAC3
Prepare for db operation
40% complete
Adding instance
48% complete
52% complete
56% complete
60% complete
64% complete
68% complete
72% complete
80% complete
Completing instance management.
86% complete
100% complete
Instance "DATARAC" added successfully on node "datarac3".
Look at the log file "/u01/app/oracle/cfgtoollogs/dbca/DATARAC/DATARAC.log" for further details.
[oracle@datarac1 ~]$

최종 상태 확인

[oracle@datarac1 ~]$ crsctl status res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.chad
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.net1.network
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.ons
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.DATA1.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       datarac1               STABLE
ora.OCRVOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               Started,STABLE
      2        ONLINE  ONLINE       datarac2               Started,STABLE
      3        ONLINE  ONLINE       datarac3               Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.cvu
      1        ONLINE  ONLINE       datarac1               STABLE
ora.datarac.db
      1        ONLINE  ONLINE       datarac1               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       datarac2               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
      3        ONLINE  ONLINE       datarac3               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
ora.datarac1.vip
      1        ONLINE  ONLINE       datarac1               STABLE
ora.datarac2.vip
      1        ONLINE  ONLINE       datarac2               STABLE
ora.datarac3.vip
      1        ONLINE  ONLINE       datarac3               STABLE
ora.qosmserver
      1        ONLINE  ONLINE       datarac1               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       datarac1               STABLE
--------------------------------------------------------------------------------
[oracle@datarac1 ~]$

 

반응형
반응형

Oracle GI S/W addnode

[oracle@datarac1 addnode]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 addnode]$
[oracle@datarac1 addnode]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 addnode]$
[oracle@datarac1 addnode]$ ls
addnode_oraparam.ini  addnode_oraparam.ini.sbs  addnode.pl  addnode.sh
[oracle@datarac1 addnode]$
[oracle@datarac1 addnode]$ ./addnode.sh -silent -ignoreSysPrereqs -ignorePrereqFailure \
> -waitForCompletion CLUSTER_NEW_NODES=datarac3 CLUSTER_NEW_VIRTUAL_HOSTNAMES=datarac3-vip
[WARNING] [INS-40111] The specified Oracle Base location is not empty on following nodes: [datarac3].
   ACTION: Specify an empty location for Oracle Base.

[WARNING] [INS-13013] Target environment does not meet some mandatory requirements.
   CAUSE: Some of the mandatory prerequisites are not met. See logs for details. /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-03-32PM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-03-32PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.

Copy Files to Remote Nodes in progress.
..................................................   6% Done.
..................................................   11% Done.
....................
Copy Files to Remote Nodes successful.

Prepare Configuration in progress.

Prepare Configuration successful.
..................................................   21% Done.
You can find the log of this install session at:
 /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-03-32PM.log

Instantiate files in progress.

Instantiate files successful.
..................................................   49% Done.

Saving cluster inventory in progress.
..................................................   83% Done.

Saving cluster inventory successful.
The Cluster Node Addition of /u01/app/19.0.0/grid was successful.
Please check '/u01/app/oraInventory/logs/silentInstall2023-05-22_05-03-32PM.log' for more details.

Setup Oracle Base in progress.

Setup Oracle Base successful.
..................................................   90% Done.

Update Inventory in progress.
You can find the log of this install session at:
 /u01/app/oraInventory/logs/addNodeActions2023-05-22_05-03-32PM.log

Update Inventory successful.
..................................................   97% Done.

As a root user, execute the following script(s):
        1. /u01/app/oraInventory/orainstRoot.sh
        2. /u01/app/19.0.0/grid/root.sh

Execute /u01/app/oraInventory/orainstRoot.sh on the following nodes:
[datarac3]
Execute /u01/app/19.0.0/grid/root.sh on the following nodes:
[datarac3]

The scripts can be executed in parallel on all the nodes.

Successfully Setup Software with warning(s).
..................................................   100% Done.
[oracle@datarac1 addnode]$

추가 Node에서 root.sh 실행

[root@datarac3 ~]# id
uid=0(root) gid=0(root) groups=0(root) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[root@datarac3 ~]# /u01/app/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.

Changing groupname of /u01/app/oraInventory to dba.
The execution of the script is complete.
[root@datarac3 ~]#
[root@datarac3 ~]#
[root@datarac3 ~]# /u01/app/19.0.0/grid/root.sh
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/19.0.0/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /u01/app/19.0.0/grid/crs/install/crsconfig_params
The log of current session can be found at:
  /u01/app/oracle/crsdata/datarac3/crsconfig/rootcrs_datarac3_2023-05-22_05-36-54PM.log
2023/05/22 17:37:01 CLSRSC-594: Executing installation step 1 of 19: 'ValidateEnv'.
2023/05/22 17:37:01 CLSRSC-363: User ignored prerequisites during installation
2023/05/22 17:37:01 CLSRSC-594: Executing installation step 2 of 19: 'CheckFirstNode'.
2023/05/22 17:37:02 CLSRSC-594: Executing installation step 3 of 19: 'GenSiteGUIDs'.
2023/05/22 17:37:09 CLSRSC-594: Executing installation step 4 of 19: 'SetupOSD'.
Redirecting to /bin/systemctl restart rsyslog.service
2023/05/22 17:37:10 CLSRSC-594: Executing installation step 5 of 19: 'CheckCRSConfig'.
2023/05/22 17:37:13 CLSRSC-594: Executing installation step 6 of 19: 'SetupLocalGPNP'.
2023/05/22 17:37:16 CLSRSC-594: Executing installation step 7 of 19: 'CreateRootCert'.
2023/05/22 17:37:16 CLSRSC-594: Executing installation step 8 of 19: 'ConfigOLR'.
2023/05/22 17:37:32 CLSRSC-594: Executing installation step 9 of 19: 'ConfigCHMOS'.
2023/05/22 17:37:32 CLSRSC-594: Executing installation step 10 of 19: 'CreateOHASD'.
2023/05/22 17:37:35 CLSRSC-594: Executing installation step 11 of 19: 'ConfigOHASD'.
2023/05/22 17:37:48 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2023/05/22 17:38:19 CLSRSC-594: Executing installation step 12 of 19: 'SetupTFA'.
2023/05/22 17:38:19 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2023/05/22 17:38:20 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2023/05/22 17:39:12 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2023/05/22 17:39:14 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2023/05/22 17:39:26 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2023/05/22 17:41:34 CLSRSC-343: Successfully started Oracle Clusterware stack
2023/05/22 17:41:34 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
clscfg: EXISTING configuration version 19 detected.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
2023/05/22 17:42:21 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2023/05/22 17:42:39 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
[root@datarac3 ~]#

Node 추가 상태 확인

[oracle@datarac1 ~]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 ~]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 ~]$ crsctl status res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.chad
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.net1.network
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
ora.ons
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
               ONLINE  ONLINE       datarac3               STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.DATA1.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       datarac1               STABLE
ora.OCRVOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               Started,STABLE
      2        ONLINE  ONLINE       datarac2               Started,STABLE
      3        ONLINE  ONLINE       datarac3               Started,STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  ONLINE       datarac3               STABLE
ora.cvu
      1        ONLINE  ONLINE       datarac1               STABLE
ora.datarac.db
      1        ONLINE  ONLINE       datarac1               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       datarac2               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
ora.datarac1.vip
      1        ONLINE  ONLINE       datarac1               STABLE
ora.datarac2.vip
      1        ONLINE  ONLINE       datarac2               STABLE
ora.datarac3.vip
      1        ONLINE  ONLINE       datarac3               STABLE
ora.qosmserver
      1        ONLINE  ONLINE       datarac1               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       datarac1               STABLE
--------------------------------------------------------------------------------
[oracle@datarac1 ~]$

 

 

반응형
반응형

사전작업
현 상태확인

[oracle@datarac1 grid]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 grid]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 grid]$ crsctl status res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
ora.chad
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
ora.net1.network
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
ora.ons
               ONLINE  ONLINE       datarac1               STABLE
               ONLINE  ONLINE       datarac2               STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.DATA1.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       datarac2               STABLE
ora.OCRVOTE.dg(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               Started,STABLE
      2        ONLINE  ONLINE       datarac2               Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       datarac1               STABLE
      2        ONLINE  ONLINE       datarac2               STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       datarac2               STABLE
ora.datarac.db
      1        ONLINE  ONLINE       datarac1               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
      2        ONLINE  ONLINE       datarac2               Open,HOME=/u01/app/o
                                                             racle/product/19.0.0
                                                             /db_1,STABLE
ora.datarac1.vip
      1        ONLINE  ONLINE       datarac1               STABLE
ora.datarac2.vip
      1        ONLINE  ONLINE       datarac2               STABLE
ora.qosmserver
      1        ONLINE  ONLINE       datarac2               STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       datarac2               STABLE
--------------------------------------------------------------------------------
[oracle@datarac1 grid]$

전체 Node /etc/hosts 파일 내용 추가

[oracle@datarac1 grid]$ cat /etc/hosts
127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
#Real
192.168.56.201  datarac1.localdomain  datarac1
192.168.56.202  datarac2.localdomain  datarac2
192.168.56.203  datarac3.localdomain  datarac3
#Interconnect
100.100.100.201 datarac1-priv.localdomain     datarac1-priv
100.100.100.202 datarac2-priv.localdomain     datarac2-priv
100.100.100.203 datarac3-priv.localdomain     datarac3-priv
#VIP
192.168.56.211  datarac1-vip.localdomain      datarac1-vip
192.168.56.212  datarac2-vip.localdomain      datarac2-vip
192.168.56.213  datarac3-vip.localdomain      datarac3-vip
#SCAN
192.168.56.215  datarac-scan.localdomain      datarac-scan
[oracle@datarac1 grid]$

Passwordless SSH Setting

[oracle@datarac1 deinstall]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 deinstall]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 deinstall]$ pwd
/u01/app/19.0.0/grid/deinstall
[oracle@datarac1 deinstall]$ ls
bootstrap_files.lst  bootstrap.pl  deinstall  deinstall.pl  deinstall.xml  jlib  readme.txt  response  sshUserSetup.sh  utl
[oracle@datarac1 deinstall]$
[oracle@datarac1 deinstall]$
[oracle@datarac1 deinstall]$
[oracle@datarac1 deinstall]$ ./sshUserSetup.sh -user oracle -hosts "datarac1 datarac2 datarac3" -noPromptPassphrase -advanced
The output of this script is also logged into /tmp/sshUserSetup_2023-05-22-16-07-46.log
Hosts are datarac1 datarac2 datarac3
user is oracle
Platform:- Linux
Checking if the remote hosts are reachable
PING datarac1.localdomain (192.168.56.201) 56(84) bytes of data.
64 bytes from datarac1.localdomain (192.168.56.201): icmp_seq=1 ttl=64 time=0.073 ms
64 bytes from datarac1.localdomain (192.168.56.201): icmp_seq=2 ttl=64 time=0.079 ms
64 bytes from datarac1.localdomain (192.168.56.201): icmp_seq=3 ttl=64 time=0.060 ms
64 bytes from datarac1.localdomain (192.168.56.201): icmp_seq=4 ttl=64 time=1.03 ms
64 bytes from datarac1.localdomain (192.168.56.201): icmp_seq=5 ttl=64 time=0.046 ms

--- datarac1.localdomain ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 116ms
rtt min/avg/max/mdev = 0.046/0.257/1.031/0.387 ms
PING datarac2.localdomain (192.168.56.202) 56(84) bytes of data.
64 bytes from datarac2.localdomain (192.168.56.202): icmp_seq=1 ttl=64 time=0.619 ms
64 bytes from datarac2.localdomain (192.168.56.202): icmp_seq=2 ttl=64 time=0.531 ms
64 bytes from datarac2.localdomain (192.168.56.202): icmp_seq=3 ttl=64 time=0.393 ms
64 bytes from datarac2.localdomain (192.168.56.202): icmp_seq=4 ttl=64 time=0.622 ms
64 bytes from datarac2.localdomain (192.168.56.202): icmp_seq=5 ttl=64 time=0.620 ms

--- datarac2.localdomain ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 111ms
rtt min/avg/max/mdev = 0.393/0.557/0.622/0.089 ms
PING datarac3.localdomain (192.168.56.203) 56(84) bytes of data.
64 bytes from datarac3.localdomain (192.168.56.203): icmp_seq=1 ttl=64 time=1.12 ms
64 bytes from datarac3.localdomain (192.168.56.203): icmp_seq=2 ttl=64 time=0.513 ms
64 bytes from datarac3.localdomain (192.168.56.203): icmp_seq=3 ttl=64 time=0.399 ms
64 bytes from datarac3.localdomain (192.168.56.203): icmp_seq=4 ttl=64 time=0.516 ms
64 bytes from datarac3.localdomain (192.168.56.203): icmp_seq=5 ttl=64 time=0.438 ms

--- datarac3.localdomain ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 91ms
rtt min/avg/max/mdev = 0.399/0.596/1.117/0.265 ms
Remote host reachability check succeeded.
The following hosts are reachable: datarac1 datarac2 datarac3.
The following hosts are not reachable: .
All hosts are reachable. Proceeding further...
firsthost datarac1
numhosts 3
The script will setup SSH connectivity from the host datarac1.localdomain to all
the remote hosts. After the script is executed, the user can use SSH to run
commands on the remote hosts or copy files between this host datarac1.localdomain
and the remote hosts without being prompted for passwords or confirmations.

NOTE 1:
As part of the setup procedure, this script will use ssh and scp to copy
files between the local host and the remote hosts. Since the script does not
store passwords, you may be prompted for the passwords during the execution of
the script whenever ssh or scp is invoked.

NOTE 2:
AS PER SSH REQUIREMENTS, THIS SCRIPT WILL SECURE THE USER HOME DIRECTORY
AND THE .ssh DIRECTORY BY REVOKING GROUP AND WORLD WRITE PRIVILEGES TO THESE
directories.

Do you want to continue and let the script make the above mentioned changes (yes/no)?
yes

The user chose yes
User chose to skip passphrase related questions.
Creating .ssh directory on local host, if not present already
Creating authorized_keys file on local host
Changing permissions on authorized_keys to 644 on local host
Creating known_hosts file on local host
Changing permissions on known_hosts to 644 on local host
Creating config file on local host
If a config file exists already at /home/oracle/.ssh/config, it would be backed up to /home/oracle/.ssh/config.backup.
Creating .ssh directory and setting permissions on remote host datarac1
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS FOR group AND others ON THE HOME DIRECTORY FOR oracle. THIS IS AN SSH REQUIREMENT.
The script would create ~oracle/.ssh/config file on remote host datarac1. If a config file exists already at ~oracle/.ssh/config, it would be backed up to ~oracle/.ssh/config.backup.
The user may be prompted for a password here since the script would be running SSH on host datarac1.
Warning: Permanently added 'datarac1,192.168.56.201' (ECDSA) to the list of known hosts.
oracle@datarac1's password:
Done with creating .ssh directory and setting permissions on remote host datarac1.
Creating .ssh directory and setting permissions on remote host datarac2
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS FOR group AND others ON THE HOME DIRECTORY FOR oracle. THIS IS AN SSH REQUIREMENT.
The script would create ~oracle/.ssh/config file on remote host datarac2. If a config file exists already at ~oracle/.ssh/config, it would be backed up to ~oracle/.ssh/config.backup.
The user may be prompted for a password here since the script would be running SSH on host datarac2.
Warning: Permanently added 'datarac2,192.168.56.202' (ECDSA) to the list of known hosts.
Done with creating .ssh directory and setting permissions on remote host datarac2.
Creating .ssh directory and setting permissions on remote host datarac3
THE SCRIPT WOULD ALSO BE REVOKING WRITE PERMISSIONS FOR group AND others ON THE HOME DIRECTORY FOR oracle. THIS IS AN SSH REQUIREMENT.
The script would create ~oracle/.ssh/config file on remote host datarac3. If a config file exists already at ~oracle/.ssh/config, it would be backed up to ~oracle/.ssh/config.backup.
The user may be prompted for a password here since the script would be running SSH on host datarac3.
Warning: Permanently added 'datarac3,192.168.56.203' (ECDSA) to the list of known hosts.
oracle@datarac3's password:
Done with creating .ssh directory and setting permissions on remote host datarac3.
Copying local host public key to the remote host datarac1
The user may be prompted for a password or passphrase here since the script would be using SCP for host datarac1.
oracle@datarac1's password:
Done copying local host public key to the remote host datarac1
Copying local host public key to the remote host datarac2
The user may be prompted for a password or passphrase here since the script would be using SCP for host datarac2.
Done copying local host public key to the remote host datarac2
Copying local host public key to the remote host datarac3
The user may be prompted for a password or passphrase here since the script would be using SCP for host datarac3.
oracle@datarac3's password:
Done copying local host public key to the remote host datarac3
Creating keys on remote host datarac1 if they do not exist already. This is required to setup SSH on host datarac1.

Creating keys on remote host datarac2 if they do not exist already. This is required to setup SSH on host datarac2.

Creating keys on remote host datarac3 if they do not exist already. This is required to setup SSH on host datarac3.
Generating public/private rsa key pair.
Your identification has been saved in .ssh/id_rsa.
Your public key has been saved in .ssh/id_rsa.pub.
The key fingerprint is:
SHA256:6HgRpPpDC5xRNJ/9dUuP3DUBykwkBtyBZiWzed92AA8 oracle@datarac3.localdomain
The key's randomart image is:
+---[RSA 1024]----+
|   .+ o+==oE ... |
|   . = B*.= =   .|
|  . . *o.. +.oo..|
| . +   o.....+.=o|
|  = . o S .. o+.o|
|   + + .    . .  |
|    = o          |
|     o           |
|                 |
+----[SHA256]-----+
Updating authorized_keys file on remote host datarac1
Updating known_hosts file on remote host datarac1
Updating authorized_keys file on remote host datarac2
Updating known_hosts file on remote host datarac2
Updating authorized_keys file on remote host datarac3
Updating known_hosts file on remote host datarac3
cat: /home/oracle/.ssh/known_hosts.tmp: No such file or directory
cat: /home/oracle/.ssh/authorized_keys.tmp: No such file or directory
SSH setup is complete.

------------------------------------------------------------------------
Verifying SSH setup
===================
The script will now run the date command on the remote nodes using ssh
to verify if ssh is setup correctly. IF THE SETUP IS CORRECTLY SETUP,
THERE SHOULD BE NO OUTPUT OTHER THAN THE DATE AND SSH SHOULD NOT ASK FOR
PASSWORDS. If you see any output other than date or are prompted for the
password, ssh is not setup correctly and you will need to resolve the
issue and set up ssh again.
The possible causes for failure could be:
1. The server settings in /etc/ssh/sshd_config file do not allow ssh
for user oracle.
2. The server may have disabled public key based authentication.
3. The client public key on the server may be outdated.
4. ~oracle or ~oracle/.ssh on the remote host may not be owned by oracle.
5. User may not have passed -shared option for shared remote users or
may be passing the -shared option for non-shared remote users.
6. If there is output in addition to the date, but no password is asked,
it may be a security alert shown as part of company policy. Append the
additional text to the <OMS HOME>/sysman/prov/resources/ignoreMessages.txt file.
------------------------------------------------------------------------
--datarac1:--
Running /usr/bin/ssh -x -l oracle datarac1 date to verify SSH connectivity has been setup from local host to datarac1.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may be OK but being prompted for a password is ERROR.
Mon May 22 16:08:28 KST 2023
------------------------------------------------------------------------
--datarac2:--
Running /usr/bin/ssh -x -l oracle datarac2 date to verify SSH connectivity has been setup from local host to datarac2.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may be OK but being prompted for a password is ERROR.
Mon May 22 16:08:28 KST 2023
------------------------------------------------------------------------
--datarac3:--
Running /usr/bin/ssh -x -l oracle datarac3 date to verify SSH connectivity has been setup from local host to datarac3.
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL. Please note that being prompted for a passphrase may be OK but being prompted for a password is ERROR.
Mon May 22 16:08:29 KST 2023
------------------------------------------------------------------------
------------------------------------------------------------------------
Verifying SSH connectivity has been setup from datarac1 to datarac1
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL.
Mon May 22 16:08:30 KST 2023
------------------------------------------------------------------------
------------------------------------------------------------------------
Verifying SSH connectivity has been setup from datarac1 to datarac2
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL.
Mon May 22 16:08:30 KST 2023
------------------------------------------------------------------------
------------------------------------------------------------------------
Verifying SSH connectivity has been setup from datarac1 to datarac3
IF YOU SEE ANY OTHER OUTPUT BESIDES THE OUTPUT OF THE DATE COMMAND OR IF YOU ARE PROMPTED FOR A PASSWORD HERE, IT MEANS SSH SETUP HAS NOT BEEN SUCCESSFUL.
Mon May 22 16:08:31 KST 2023
------------------------------------------------------------------------
-Verification from complete-
SSH verification complete.
[oracle@datarac1 deinstall]$

추가 node에 대한 Run cluvfy 실행

[oracle@datarac1 grid]$ id
uid=54321(oracle) gid=54322(dba) groups=54322(dba) context=unconfined_u:unconfined_r:unconfined_t:s0-s0:c0.c1023
[oracle@datarac1 grid]$ env | grep SID
ORACLE_SID=+ASM1
[oracle@datarac1 grid]$ pwd
/u01/app/19.0.0/grid
[oracle@datarac1 grid]$
[oracle@datarac1 grid]$ ./runcluvfy.sh stage -pre nodeadd -help

USAGE:
runcluvfy.sh stage -pre nodeadd -n <node_list>
                                [-vip <vip_list>] [-fixup] [-fixupnoexec]
                                [-method sudo -user <user_name> [-location <dir_path>]|-method root] [-verbose]
                                [-json] [-html]
                                [-save [-savedir <save_dir>]]

<vip_list> is the comma-separated list of virtual IP addresses that will be applied to the comma-separated list of non-domain qualified node names entered.
-json Specifies that the user wants the detailed report to be output in a JSON format. If the -json option is missing, then the detailed report is output in text to standard output format.
-html Specifies that the user wants the detailed report to be output in html format. If a browser recognized by CVU is available on the system, the results will be reported using that browser. Otherwise, the user will have to use -save option to get a copy of the report in html format which can be viewed by the user using a browser of his or her choice. If -html option is missing, then the detailed report is output in text format.
-save Specifies that the user wants the validation reports to be saved for future reference. The reports named cvucheckreport_<timestamp>.(htm|txt|json) as requested are saved in the location of the user's choice if specified using the -savedir option. If the -savedir option has not been specified, then the reports are saved in the default location <CV-HOME>/cv/report.
<node_list> is the comma-separated list of non-domain qualified node names which will be added to the cluster.
-method is the privilege delegation method, 'sudo' or 'root', to be used for root user access.
<user_name> is the user name to access all the nodes with root privileges.
<dir_path> is the full file system path for the 'sudo' executable.

DESCRIPTION:
Performs the appropriate checks on the nodes to be added to the existing cluster, and verifies the integrity of the cluster before the nodes can be added.  If '-fixup' option is specified, on verification failure, fix up operations are performed if feasible.  If '-fixupnoexec' option is specified, on verification failure, the fix up data will be generated and the instruction for manual execution of the generated fix ups will be displayed.

[oracle@datarac1 grid]$
[oracle@datarac1 grid]$
[oracle@datarac1 grid]$ ./runcluvfy.sh stage -pre nodeadd -n datarac3

Performing following verification checks ...

  Physical Memory ...PASSED
  Available Physical Memory ...PASSED
  Swap Size ...PASSED
  Free Space: datarac3:/usr,datarac3:/var,datarac3:/etc,datarac3:/u01/app/19.0.0/grid,datarac3:/sbin,datarac3:/tmp ...PASSED
  Free Space: datarac1:/usr,datarac1:/var,datarac1:/etc,datarac1:/u01/app/19.0.0/grid,datarac1:/sbin,datarac1:/tmp ...PASSED
  User Existence: oracle ...
    Users With Same UID: 54321 ...PASSED
  User Existence: oracle ...PASSED
  User Existence: root ...
    Users With Same UID: 0 ...PASSED
  User Existence: root ...PASSED
  Group Existence: dba ...PASSED
  Group Membership: dba ...PASSED
  Run Level ...PASSED
  Hard Limit: maximum open file descriptors ...PASSED
  Soft Limit: maximum open file descriptors ...PASSED
  Hard Limit: maximum user processes ...PASSED
  Soft Limit: maximum user processes ...PASSED
  Soft Limit: maximum stack size ...FAILED (PRVG-0449)
  Architecture ...PASSED
  OS Kernel Version ...PASSED
  OS Kernel Parameter: semmsl ...PASSED
  OS Kernel Parameter: semmns ...PASSED
  OS Kernel Parameter: semopm ...PASSED
  OS Kernel Parameter: semmni ...PASSED
  OS Kernel Parameter: shmmax ...FAILED (PRVG-1205, PRVG-1201)
  OS Kernel Parameter: shmmni ...PASSED
  OS Kernel Parameter: shmall ...PASSED
  OS Kernel Parameter: file-max ...PASSED
  OS Kernel Parameter: ip_local_port_range ...PASSED
  OS Kernel Parameter: rmem_default ...PASSED
  OS Kernel Parameter: rmem_max ...PASSED
  OS Kernel Parameter: wmem_default ...PASSED
  OS Kernel Parameter: wmem_max ...PASSED
  OS Kernel Parameter: aio-max-nr ...PASSED
  OS Kernel Parameter: panic_on_oops ...PASSED
  Package: kmod-20-21 (x86_64) ...PASSED
  Package: kmod-libs-20-21 (x86_64) ...PASSED
  Package: binutils-2.30-49.0.2 ...PASSED
  Package: libgcc-8.2.1 (x86_64) ...PASSED
  Package: libstdc++-8.2.1 (x86_64) ...PASSED
  Package: sysstat-10.1.5 ...PASSED
  Package: ksh ...PASSED
  Package: make-4.2.1 ...PASSED
  Package: glibc-2.28 (x86_64) ...PASSED
  Package: glibc-devel-2.28 (x86_64) ...PASSED
  Package: libaio-0.3.110 (x86_64) ...PASSED
  Package: nfs-utils-2.3.3-14 ...PASSED
  Package: smartmontools-6.6-3 ...PASSED
  Package: net-tools-2.0-0.51 ...PASSED
  Package: policycoreutils-2.9-3 ...PASSED
  Package: policycoreutils-python-utils-2.9-3 ...PASSED
  Users With Same UID: 0 ...PASSED
  Current Group ID ...PASSED
  Root user consistency ...PASSED
  Package: cvuqdisk-1.0.10-1 ...PASSED
  Node Addition ...
    CRS Integrity ...PASSED
    Clusterware Version Consistency ...PASSED
    '/u01/app/19.0.0/grid' ...PASSED
  Node Addition ...PASSED
  Host name ...PASSED
  Node Connectivity ...
    Hosts File ...PASSED
    Check that maximum (MTU) size packet goes through subnet ...PASSED
    subnet mask consistency for subnet "100.100.100.0" ...PASSED
    subnet mask consistency for subnet "192.168.56.0" ...PASSED
  Node Connectivity ...PASSED
  Multicast or broadcast check ...PASSED
  ASM Integrity ...PASSED
  Device Checks for ASM ...
    Package: cvuqdisk-1.0.10-1 ...PASSED
    ASM device sharedness check ...
      Shared Storage Accessibility:/dev/oracleasm/asm-disk04,/dev/oracleasm/asm-disk05,/dev/oracleasm/asm-disk06,/dev/oracleasm/asm-disk01,/dev/oracleasm/asm-disk02,/dev/oracleasm/asm-disk03 ...PASSED
    ASM device sharedness check ...PASSED
    Access Control List check ...PASSED
  Device Checks for ASM ...PASSED
  Database home availability ...PASSED
  OCR Integrity ...PASSED
  Time zone consistency ...PASSED
  Network Time Protocol (NTP) ...
    '/etc/chrony.conf' ...PASSED
    Daemon 'chronyd' ...PASSED
    NTP daemon or service using UDP port 123 ...PASSED
    chrony daemon is synchronized with at least one external time source ...FAILED (PRVG-13606)
  Network Time Protocol (NTP) ...FAILED (PRVG-13606)
  User Not In Group "root": oracle ...PASSED
  Time offset between nodes ...PASSED
  resolv.conf Integrity ...PASSED
  DNS/NIS name service ...PASSED
  User Equivalence ...PASSED
  Software home: /u01/app/19.0.0/grid ...PASSED
  /dev/shm mounted as temporary file system ...PASSED
  zeroconf check ...FAILED (PRVE-10077)

Pre-check for node addition was unsuccessful.
Checks did not pass for the following nodes:
        datarac3,datarac1


Failures were encountered during execution of CVU verification request "stage -pre nodeadd".

Soft Limit: maximum stack size ...FAILED
datarac3: PRVG-0449 : Proper soft limit for maximum stack size was not found
            on node "datarac3" [Expected >= "10240" ; Found = "8192"].

OS Kernel Parameter: shmmax ...FAILED
datarac3: PRVG-1205 : OS kernel parameter "shmmax" does not have expected
            current value on node "datarac3" [Expected = "4169566208" ;
            Current = "4169564160"; Configured = "4169564160"].
datarac3: PRVG-1201 : OS kernel parameter "shmmax" does not have expected
            configured value on node "datarac3" [Expected = "4169566208" ;
            Current = "4169564160"; Configured = "4169564160"].

Network Time Protocol (NTP) ...FAILED
  chrony daemon is synchronized with at least one external time source ...FAILED
  datarac3: PRVG-13606 : chrony daemon is not synchronized with any external
              time source on node "datarac3".

  datarac1: PRVG-13606 : chrony daemon is not synchronized with any external
              time source on node "datarac1".

zeroconf check ...FAILED
datarac3: PRVE-10077 : NOZEROCONF parameter was not  specified or was not set
            to 'yes' in file "/etc/sysconfig/network" on node
            "datarac3.localdomain"


CVU operation performed:      stage -pre nodeadd
Date:                         May 22, 2023 4:25:54 PM
CVU version:                  19.19.0.0.0 (040623x8664)
Clusterware version:          19.0.0.0.0
CVU home:                     /u01/app/19.0.0/grid
Grid home:                    /u01/app/19.0.0/grid
User:                         oracle
Operating system:             Linux5.4.17-2011.7.4.el8uek.x86_64
[oracle@datarac1 grid]$

 

반응형

+ Recent posts