Lost disk on diskgroup -ASM.

[vkritsimas]

We have created a new diskgroup (currently empty)  with normal redundancy within ASM (3 disks) and it looks like the issue persists on this new diskgroup too.

Sat Nov 07 07:36:49 2015

WARNING: Waited 15 secs for write IO to PST disk 0 in group 11.

WARNING: Waited 15 secs for write IO to PST disk 2 in group 11.

WARNING: Waited 15 secs for write IO to PST disk 0 in group 11.

WARNING: Waited 15 secs for write IO to PST disk 2 in group 11.

Sat Nov 07 07:36:49 2015

NOTE: process _b000_+asm1 (26349) initiating offline of disk 0.2452385562 (ASMGRP_0000) with mask 0x7e in group 11

NOTE: process _b000_+asm1 (26349) initiating offline of disk 2.2452385560 (ASMGRP_0002) with mask 0x7e in group 11

NOTE: checking PST: grp = 11

GMON checking disk modes for group 11 at 80 for pid 29, osid 26349

ERROR: no read quorum in group: required 2, found 1 disks

NOTE: checking PST for grp 11 done.

NOTE: initiating PST update: grp = 11, dsk = 0/0x922c6f1a, mask = 0x6a, op = clear

NOTE: initiating PST update: grp = 11, dsk = 2/0x922c6f18, mask = 0x6a, op = clear

GMON updating disk modes for group 11 at 81 for pid 29, osid 26349

ERROR: no read quorum in group: required 2, found 1 disks

WARNING: Offline for disk ASMGRP_0000 in mode 0x7f failed.

WARNING: Offline for disk ASMGRP_0002 in mode 0x7f failed.

Sat Nov 07 07:36:49 2015

NOTE: cache dismounting (not clean) group 11/0x098C9F83 (ASMGRP)

NOTE: messaging CKPT to quiesce pins Unix process pid: 26351, image: oracle@dcdb75.local.domain (B001)

Sat Nov 07 07:36:49 2015

NOTE: halting all I/Os to diskgroup 11 (ASMGRP)

Sat Nov 07 07:36:58 2015

WARNING: dirty detached from domain 11

NOTE: cache dismounted group 11/0x098C9F83 (ASMGRP)

NOTE: cache deleting context for group ASMGRP 11/0x098c9f83

SQL> alter diskgroup ASMGRP dismount force /* ASM SERVER:160210819 */

GMON dismounting group 11 at 82 for pid 30, osid 26351

NOTE: Disk ASMGRP_0000 in mode 0x7f marked for de-assignment

NOTE: Disk ASMGRP_0001 in mode 0x7f marked for de-assignment

NOTE: Disk ASMGRP_0002 in mode 0x7f marked for de-assignment

SUCCESS: diskgroup ASMGRP was dismounted

SUCCESS: alter diskgroup ASMGRP dismount force /* ASM SERVER:160210819 */

Sat Nov 07 07:36:58 2015

NOTE: diskgroup resource ora.ASMGRP.dg is offline

SUCCESS: ASM-initiated MANDATORY DISMOUNT of group ASMGRP

Note.

We have two-node  asm cluster  with  Oracle 11.2.0.4  and Oracle linux 6.3.

[Renifa]

Hi,

The ASM instance ensures that any disk in a newly created disk group is addressable and is not currently a member of another disk group. You must use FORCE only when adding a disk that was dropped FORCE. If a disk is dropped NOFORCE, then use can add it NOFORCE. For example, a disk might have failed and was dropped from its disk group. After the disk is repaired, it is no longer part of any disk group, but ASM still recognizes that the disk had been a member of a disk group. You must use the FORCE flag to include the disk in a new disk group. In addition, the disk must be addressable, and the original disk group must not be mounted. Otherwise, the operation fails.

Also verify the timeout settings from ASM and the storage system. If your using iSCSI refer to the following KB "https://kb.netapp.com/support/index?page=content&id=3013731" (Login Required)

Thanks.