更新12cRU時遇到以下錯誤 ==Following patches FAILED in apply: Reason: Failed during Patching: oracle.opatch.opatchsdk.OPatchException: Re-link fails on target "proc". Re-link fails on target "procob". After fixing the cause of failure Run opatchauto resume ] OPATCHAUTO-68061: The orchestration engine failed. OPATCHAUTO-68061: The orchestration engine failed with return code 1 OPATCHAUTO-68061: Check the log for more details. OPatchAuto failed. 若錯誤一樣為OPATCHAUTO-68061 但其他錯誤資訊比對不同，可以參考其他MOS文件處理 OPATCHAUTO-68061: The Orchestration Engine Failed. OPATCHAUTO-68061: The Orchestration Engine Failed Applying Patch. Failed to Start CRS Service with OPATCHAUTO-68061 When Rolling Back GI RU （以下主要內容過程為RAC rolling patch,還包含處理一個衝突的one-off patch） 單節點的patch 可以參考Oracle Patch for Single Instance
步驟
1. 停止12c ORACLE_HOME所有資料庫
$ srvctl stop home -o /u01/app/oracle/product/12.2.0.1/dbhome_1 -s ~/o12crac1.lst -n rac1
2.檢視目前patch
[oracle@rac1 OPatch]$ ./opatch lspatches
28589509;
29314424;OCW APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29314424)
29314339;Database Apr 2019 Release Update : 12.2.0.1.190416 (29314339)
27475613;OJVM RELEASE UPDATE: 12.2.0.1.180417 (27475613)
3. analyze 檢查出衝突
[root@rac1 ~]# /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatchauto apply /cloudfs/29757449 -oh /u01/app/oracle/product/12.2.0.1/dbhome_1 -analyze
Analysis for applying patches has failed:
Host:rac1
RAC Home:/u01/app/oracle/product/12.2.0.1/dbhome_1
Version:12.2.0.1.0
Analysis for patches has failed.
==Following patches FAILED in analysis for apply:
Patch: /cloudfs/29757449
Reason: Failed during Analysis: CheckConflictAgainstOracleHome Failed, [ Prerequisite Status: FAILED, Prerequisite output:
The details are:
Please rebuild the superset patch [29757449] to make sure it supersedes all the relevant patch(es) [29314339,28589509].
The rebuild patch should contain bug fix [25223839, 27748954, 24697323, 25963024, 27394703, 25437699, 21520266, 25435038, 27607563, 29376346, 26546664, 25872127, 22364044, 28774416, 27115422, 24907917, 23741944, 24796092, 26911000, 22310426, 25598 …
OPATCHAUTO-72053: Analysis for the patches failed.
OPATCHAUTO-72053: Command execution failed.
OPATCHAUTO-72053: Please check the summary for more details.
[oracle@rac1 28589509]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch lspatches
28589509;
29314424;OCW APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29314424)
29314339;Database Apr 2019 Release Update : 12.2.0.1.190416 (29314339)
27475613;OJVM RELEASE UPDATE: 12.2.0.1.180417 (27475613)
28589509 是基於版RU版本的one-off，解決方法須退回該one-off，再下載要新打的RU對應版本的one-off來更新
4.rollback one-off
[oracle@rac1 28589509]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch rollback -id 28589509
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2022, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/12.2.0.1/dbhome_1
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/12.2.0.1/dbhome_1/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.2.0.1.4
Log file location : /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatch/opatch2022-07-28_11-56-32AM_1.log
Patches will be rolled back in the following order:
28589509
The following patch(es) will be rolled back: 28589509
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = ‘/u01/app/oracle/product/12.2.0.1/dbhome_1’)
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Rolling back patch 28589509…
RollbackSession rolling back interim patch ‘28589509’ from OH ‘/u01/app/oracle/product/12.2.0.1/dbhome_1’
Patching component oracle.rdbms, 12.2.0.1.0…
RollbackSession removing interim patch ‘28589509’ from inventory
Log file location: /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatch/opatch2022-07-28_10-56-32AM_1.log
OPatch succeeded.
5.衝突檢查
[oracle@rac1 28589509]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch prereq CheckConflictAgainstOHWithDetail -phBaseDir /cloudfs/29757449
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2022, Oracle Corporation. All rights reserved.
PREREQ session
Oracle Home : /u01/app/oracle/product/12.2.0.1/dbhome_1
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/12.2.0.1/dbhome_1/oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.2.0.1.4
Log file location : /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatch/opatch2022-07-28_11-58-12AM_1.log
Invoking prereq “checkconflictagainstohwithdetail”
Prereq “checkConflictAgainstOHWithDetail” passed.
OPatch succeeded.
6. opatchauto analyze
[root@rac1 ~]# /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatchauto apply /cloudfs/29757449 -oh /u01/app/oracle/product/12.2.0.1/dbhome_1 -analyze
OPatchauto session is initiated at Tue Jul 28 11:58:42 2022
System initialization log file is /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatchautodb/systemconfig2022-07-28_11-59-04AM.log.
Session log file is /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatchauto/opatchauto2022-07-28_11-59-46AM.log
The id for this session is R5PE
Executing OPatch prereq operations to verify patch applicability on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Patch applicability verified successfully on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Verifying SQL patch applicability on home /u01/app/oracle/product/12.2.0.1/dbhome_1
SQL patch applicability verified successfully on home /u01/app/oracle/product/12.2.0.1/dbhome_1
OPatchAuto successful.
——————————–Summary——————————–
Analysis for applying patches has completed successfully:
Host:rac1
RAC Home:/u01/app/oracle/product/12.2.0.1/dbhome_1
Version:12.2.0.1.0
==Following patches were SUCCESSFULLY analyzed to be applied:
Patch: /cloudfs/29757449
Log: /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2022-07-28_11-59-53AM_1.log
OPatchauto session completed at Tue Jul 28 12:00:07 2022
Time taken to complete the session 1 minute, 20 seconds
You have new mail in /var/spool/mail/root
7.opatchauto apply (OPATCHAUTO-68061)
[root@rac1 ~]# /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatchauto apply /cloudfs/29757449 -oh /u01/app/oracle/product/12.2.0.1/dbhome_1
OPatchauto session is initiated at Tue Jul 28 12:03:24 2022
(省略)
Performing prepatch operation on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Perpatch operation completed successfully on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Start applying binary patch on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Failed while applying binary patches on home /u01/app/oracle/product/12.2.0.1/dbhome_1
Execution of [OPatchAutoBinaryAction] patch action failed, check log for more details. Failures:
Patch Target : rac1->/u01/app/oracle/product/12.2.0.1/dbhome_1 Type[rac]
Details: [
—————————Patching Failed———————————
Command execution failed during patching in home: /u01/app/oracle/product/12.2.0.1/dbhome_1, host: rac1.
Command failed: /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatchauto apply /cloudfs/29757449 -oh /u01/app/oracle/product/12.2.0.1/dbhome_1 -target_type rac_database -binary -invPtrLoc /u01/app/oracle/product/12.2.0.1/dbhome_1/oraInst.loc -jre /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/jre -persistresult /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/auto/dbsessioninfo/sessionresult_rac1_rac.ser -analyzedresult /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/auto/dbsessioninfo/sessionresult_analyze_rac1_rac.ser
Command failure output:
==Following patches FAILED in apply:
Patch: /cloudfs/29757449
Log: /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2022-07-28_12-02-04AM_1.log
Reason: Failed during Patching: oracle.opatch.opatchsdk.OPatchException: Re-link fails on target “proc“.
Re-link fails on target “procob“.
After fixing the cause of failure Run opatchauto resume
]
OPATCHAUTO-68061: The orchestration engine failed.
OPATCHAUTO-68061: The orchestration engine failed with return code 1
OPATCHAUTO-68061: Check the log for more details.
OPatchAuto failed.
8. 檢視log
$ more /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatchauto/core/opatch/opatch2022-07-28_12-02-04AM_1.log
(省略)
‘
[Jul 28, 2022 13:08:02 AM] [INFO] 6) OUI-67200:Make failed to invoke “/usr/bin/make -f ins_precomp.mk procob ORACLE_HOME=/u01/app/oracle/product/12.2.0.1/dbhome_1″….’/u01/app/19.0.0.0/grid/lib/libons.so: undefined reference to `memcpy@GLIBC_2.14′
/bin/chmod: cannot access ‘/u01/app/oracle/product/12.2.0.1/dbhome_1/precomp/lib/procob’: No such file or directory
make[1]: *** [/u01/app/oracle/product/12.2.0.1/dbhome_1/precomp/lib/procob] Error 1
make: *** [procob] Error 2
‘
因為使用opatchauto會同時去應對/u01/app/19.0.0.0/grid/lib/ ，我的環境是19cGI 上面分別有19c與12c的DB HOME，即便指令有指定-oh /u01/app/oracle/product/12.2.0.1/dbhome_1也會報錯，解法是使用opatch apply
9.opatch apply
[oracle@rac1 29757449]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch apply
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2022, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/12.2.0.1/dbhome_1
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/12.2.0.1/dbhome_1//oraInst.loc
OPatch version : 12.2.0.1.17
OUI version : 12.2.0.1.4
(省略)
Patch 29757449 successfully applied.
Sub-set patch [29314339] has become inactive due to the application of a super-set patch [29757449].
Please refer to Doc ID 2161861.1 for any possible further required actions.
Log file location: /u01/app/oracle/product/12.2.0.1/dbhome_1/cfgtoollogs/opatch/opatch2022-07-28_13-17-32AM_1.log
OPatch succeeded.
[oracle@rac1 29757449]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch lspatches
29757449;Database Jul 2019 Release Update : 12.2.0.1.190716 (29757449)
29314424;OCW APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29314424)
27475613;OJVM RELEASE UPDATE: 12.2.0.1.180417 (27475613)
OPatch succeeded.
10. 下載對應版本的one-off後打回去
[oracle@rac1 509_07]$ cd 28589509/
[oracle@rac1 28589509]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch apply -local -silent
Oracle Interim Patch Installer version 12.2.0.1.17
Copyright (c) 2022, Oracle Corporation. All rights reserved.
（省略）
OPatch succeeded.
[oracle@rac1 28589509]$ /u01/app/oracle/product/12.2.0.1/dbhome_1/OPatch/opatch lspatches
28589509;
29757449;Database Jul 2019 Release Update : 12.2.0.1.190716 (29757449)
29314424;OCW APR 2019 RELEASE UPDATE 12.2.0.1.190416 (29314424)
27475613;OJVM RELEASE UPDATE: 12.2.0.1.180417 (27475613)
11.開啟資料庫
srvctl start home -o /u01/app/oracle/product/12.2.0.1/dbhome_1 -s ~/o12crac1.lst -n rac1
到這裡一個節點已經完成patch，接著重複以上的步驟於另外一個節點，執行完畢再執行post patch，也就是步驟12(只需要在一個節點執行)
12.執行datapatch
[oracle@rac2 OPatch]$ cd $ORACLE_HOME/OPatch
[oracle@rac2 OPatch]$ export ORACLE_SID=orcl2
[oracle@rac2 OPatch]$ ./datapatch -verbose
SQL Patching tool version 12.2.0.1.0 Production on Tue Jul 28 13:55:16 2022
Copyright (c) 2012, 2019, Oracle. All rights reserved.
Log file for this invocation: /u01/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_308085_2022_07_28_13_55_16/sqlpatch_invocation.log
Connecting to database…OK
Bootstrapping registry and package to current versions…done
Determining current state…done
Current state of SQL patches:
Patch 27475613 (OJVM RELEASE UPDATE: 12.2.0.1.180417 (27475613)):
Installed in the binary registry and the SQL registry
Bundle series DBRU:
ID 190716 in the binary registry and ID 190416 in the SQL registry
Adding patches to installation queue and performing prereq checks…
Installation queue:
Nothing to roll back
The following patches will be applied:
29757449 (DATABASE JUL 2019 RELEASE UPDATE 12.2.0.1.190716)
Installing patches…
Patch installation complete. Total patches installed: 1
Validating logfiles…
Patch 29757449 apply: SUCCESS
logfile: /u01/app/oracle/cfgtoollogs/sqlpatch/29757449/23009673/29757449_apply_orcl_2022Jul28_13_56_45.log (no errors)
SQL Patching tool complete on Tue Jul 28 13:57:08 2022
SQL> select PATCH_ID,VERSION,ACTION,STATUS,ACTION_TIME from dba_registry_sqlpatch order by ACTION_TIME;
PATCH_ID VERSION ACTION STATUS ACTION_TIME
———- ——————– ————— ———————– ——————
29314339 12.2.0.1 APPLY SUCCESS 21-JUL-19 11.04.37.904055 AM
29757449 12.2.0.1 APPLY SUCCESS 28-JUL-22 14.07.18.381411 AM
