srvctl start database fails with CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname02'

Posted by
  
  • Yesterday users started complaining they are seeing (ORA-12514 TNS:listener does not currently know of service requested in connect descriptor).
  • Checked DB status from srvctl and could see instances are up and running. 
srvctl status database -d orcl
Instance orcl1 is running on node hostname01
Instance orcl2 is running on node hostname02
  • When checked service status in srvctl could see service is not running
srvctl status service -d orcl
Service orcl_srvc is not running.

  • Tried to start service and received below error 

srvctl start service -d orcl
PRCD-1133 : failed to start services  for database orcl
PRCR-1095 : Failed to start resources using filter (((NAME starts ora.orcl.) AND (NAME ends .svc)) AND (TYPE == ora.service.type))
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname01'
CRS-2632: There are no more servers to try to place resource 'ora.orcl.orcl.gob.ue.com.svc' on that would satisfy its placement policy
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname02'
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname01'
CRS-2632: There are no more servers to try to place resource 'ora.orcl.genhista.svc' on that would satisfy its placement policy
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname02'
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname01'
CRS-2632: There are no more servers to try to place resource 'ora.orcl.genhista_srvc.svc' on that would satisfy its placement policy
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname02'
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname01'
CRS-2632: There are no more servers to try to place resource 'ora.orcl.orcl_srvc.svc' on that would satisfy its placement policy
CRS-2800: Cannot start resource 'ora.orcl.db' as it is already in the INTERMEDIATE state on server 'hostname02'

  • Checked the status for the orcl services from grid home with crsctl command.

crsctl stat res ora.orcl.db
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------

ora.orcl.db
      1        ONLINE  INTERMEDIATE hostname01           Stuck Archiver,HOME=
                                                             /u01/app/oracle/prod
                                                             uct/19.0.0.0/dbhome_
                                                             1,STABLE
      2        ONLINE  INTERMEDIATE hostname02           Stuck Archiver,HOME=
                                                             /u01/app/oracle/prod
                                                             uct/19.0.0.0/dbhome_

                                                             1,STABLE

  •  Found Archiver error. Connected to database instance and checked FRA usage. 

SQL> select name
,      round(space_limit / 1024 / 1024) size_mb
,      round(space_used  / 1024 / 1024) used_mb
,      decode(nvl(space_used,0),0,0,round((space_used/space_limit) * 100)) pct_used
from v$recovery_file_dest
order by name
/
  2    3    4    5    6    7
NAME  SIZE_MB    USED_MB   PCT_USED
----- --------- ---------- ----------
+RECO 12582912   12581418        100

  • FRA is 100 % utilized. Increased db_recovery_file_dest_size and checked service status.

    srvctl status service -d orcl
    Service orcl_srvc is running on instance(s) orcl1,orcl2
  •  Issue is resolved. 

Comments

Post a Comment