Subscribe

Simulator ONTAP 8.3 - Root Volume Space Problem

[ Edited ]

I have installed two instances of the ESX version of the 8.3 Simulator and within a few days I run into space problems on the root volume.  See the messages below from the console.  I have also runto into this same problem with instances installed in ESX in a Partner's lab.  It appears that there are logs or some other file(s) that are continually being created and filling up the root volume.  The Partner dug a little deeper and reports that it looks like the Simulator is buitl on a Linux image and that it is the Linux image that is actually having a space problem. 

 

CONSOLE OUTPUT:

login as: admin
Using keyboard-interactive authentication.
Password:
***********************
**  SYSTEM MESSAGES  **
***********************

CRITICAL: This node is not healthy because the root volume is low on space
(<10MB). The node can still serve data, but it cannot participate in cluster
operations until this situation is rectified. Free space using the nodeshell or
contact technical support for assistance.


cdot83::>

 

VM Characteristics:  See Attachment.

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

 

Rbrinson -

 

Yes the sims run out of space given the default root volume size.

 

Common practice is to add another idisk to the aggr and grow the root volume, and turn off snapshots.


I hope this response has been helpful to you.

At your service,

Eugene E. Kashpureff, Sr.
Independent NetApp Consultant http://www.linkedin.com/in/eugenekashpureff
Senior NetApp Instructor, IT Learning Solutions http://sg.itls.asia/netapp
(P.S. I appreciate 'kudos' on any helpful posts.)

 

 

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

At this point, I cannot issue any meaningful commands to make this happen.  Every command I issue seems to get thwarted due to databases being offline, like the VLDB.  Can you give me some additional guidance on what commands to issue to accomplish your sugestion?

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

You could try deleting some unneeded files (like logs) from system shell.

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

Thanks - we removed a bunch of log files, which resolved the issue temporarily.  However, the same problem came back within a couple of days.

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

 

Rbrinson -

 

Ouch ! It may be easiest to reinstall the sim.

 

Can you delete any snapshots on the root vol ?

Will it let you unlock the diag user and drop down in the system shell ?

You could then try deleting log files ... ?


I hope this response has been helpful to you.

At your service,

Eugene E. Kashpureff, Sr.
Independent NetApp Consultant http://www.linkedin.com/in/eugenekashpureff
Senior NetApp Instructor, IT Learning Solutions http://sg.itls.asia/netapp
(P.S. I appreciate 'kudos' on any helpful posts.)

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

The point is to free some space to allow you to increase root volume size.

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

The fundamental problem is the root aggregate and root volume are too small.

 

If you can some get some files cleaned off and get back into the cluster shell you can increase its size with the following procedure.

I wrote this from the cluster shell perspective as part of a larger document, but if you can't get back into the cluster shell the node shell equivilents should work just as well.

 

Increasing the size of the simulator root volume
 
Steps:
    1. log in to the cluster shell
    2. Assign any unowned disks by entering the following command:

      run * disk assign all

    3. Identify the root aggregate by entering the following command:

      storage aggregate show -node node_name -root true

      Example:
      demo1::> storage aggregate show -node demo1-01 -root true
      Aggregate     Size Available Used% State   #Vols  Nodes            RAID Status
      --------- -------- --------- ----- ------- ------ ---------------- ------------
      aggr0        900MB   42.72MB   95% online       1 demo1-01         raid_dp,
                                                                         normal

    4. Add 3 disks to the root aggregate by entering the following command:

      storage aggregate add-disks -aggregate root_aggregate -diskcount 3

    5. Use the root aggregate name to identify the root volume by entering the following command:

      volume show -node node_name -aggregate root_aggregate

      Example:
      demo1::> volume show -node demo1-01 -aggregate aggr0
      Vserver   Volume       Aggregate    State      Type       Size  Available Used%
      --------- ------------ ------------ ---------- ---- ---------- ---------- -----
      demo1-01  vol0         aggr0        online     RW      851.5MB    529.8MB   37%

    6. Increase the size of the root volume by 2.5GB by entering the following command:

      run -node node_name vol size root_volume +2560m 

 

 

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

[ Edited ]

And here's the quick&dirty node shell variant:

 

From the problem node's console:

  1. login to the cluster shell
  2. run local
  3. disk assign all
  4. aggr status
    The root aggr will have "root" in the option list. Typically its aggr0
  5. aggr add aggregate_name 3@1g
    Assuming the default 1gb disks were used.  Adjust as necessary.
  6. vol status
    The root vol will have "root" in the options list.  typically its vol0
  7. vol size root_volume +2290m
    The size increase availble may vary depending on the type of disks used.  2560m or 2290m are most common.  Try 2560 first, if that fails fall back to 2290, if that fails the error will give the max size in kb
  8. exit
  9. reboot

You may or may not need a second reboot to remove the recovery flag in the loader.  If required it will tell you when you log in from the node shell.

 

After a clean reboot, go back and disable aggr snaps and vol snaps on the root, delete any existing snaps, and clean out old logs and asup files in the mroot.

 

 

Re: Simulator ONTAP 8.3 - Root Volume Space Problem

Good day,

 

I am having same issue, but when trying to add disk on my root aggregate it is having ERROR: data base is not open.

 

can someone please help me with this.

 

Thank you.