Disk Failures on OnTap Simulator 9.5

Jim_Robertson

Has anyone had any issues with multiple disk failures on the OnTap simulator?  We have two single-node simulators setup (running on VMWare 6.0), and have had multiple occasions over the past year where multiple disks will fail in very quick succession, and it ends up failing the aggregate.  I can't imagine what would cause some, but not all the virtual disks to fail, since they are all part of the same disk that has been assigned to the simulator in VMWare.

At this point, the simulator is dead in the water, because the root volumes for all the vservers were on the failed aggregate.  I tried unfailing the disks, but now they are "orphaned" and the hot spares that tried to replace the failed disks are marked as "reconstruct stalled".  It won't even let me delete any of the volumes, or the failed aggregate.

Does anyone have any suggestions for how to recover from this short of blowing away the entire simulator and rebuilding from scratch?  Also, any suggestions for why this may be happening and how to prevent it in the future would be nice as well (or, at least how to quickly recover from it).

Thanks!

SeanHatfield

On a new sim thats never booted before you can control it with bootargs in the loader.  Once its up and running you can make adjustments from the systemshell and nodeshell.

This will get you a list of disks:

run local disk show -v

Then you can pull one out of the shelf (must be owned by the local node):

run local disk simpull v0.29

And then delete it:

systemshell local "sudo rm /sim/dev/,disks/,pulled/v0.29*"

Repeat as needed until you've removed all the unwanted disks.