Trying to pull files from FAS 3270

[JLogan3o13]

I am in a unique position, and am hoping someone can provide some guidance. A customer of mine had a server hosted by another company. Said company shuttered its doors unexpectedly, leaving my customer unable to get to his data. I have, with the hosting companies permission, obtained the natapp appliance on which the VM in question was sitting.

My thought was, if I can get the appliance up to where I can access volumes, I can pull the VM files off the storage and then import into my own vCenter. Then I would not need to worry about getting the ESX hosts (which I also have) up and talking to the appliance for vCenter.

I have been able to cable it up, and get in through the console cable in a putty session. From here I booted OnTap. I can see under network interface show what I assume is the management port (e0M). What I need to do is find a way to ip this appliance to my network so I can pull the VM files from it. I have a cable plugged into e0a, but if I do network interface show e0a I get "There are no entries matching your query"

I am not a netapp guy by any means, I work almost completely in the VMware space with EMC storage. Am hoping someone can walk me through getting this appliance IP'd so I can pull the necessary data off.

[SpindleNinja]

You'll probably end up needing to re-ip more than just e0M and e0a,   Can you post the output of 

"rdfile /etc/rc"

from each controler? 

note: i'm assuming this is a 7mode system. 

[JLogan3o13]

I get that rdfile is not a recognized command...

I just closed the putty session and logged back in, and now see this, which scrolled by too fast last time for me:

login: admin

Password:

******************************************************

* This is a serial console session. Output from this *

* session is mirrored on the SP console session.     *

******************************************************

***********************

**  SYSTEM MESSAGES  **

***********************

The contents of the root volume may have changed and the local management

configuration may be inconsistent and/or the local management databases may be

out of sync with the replicated databases. This node is not fully operational.

Contact support personnel for the root volume recovery procedures.

[SpindleNinja]

Oh.  looks like Clustered though...

Can you run these?  

version 

cluster show 

network interface show

[JLogan3o13]

Version shows the error:

(vserver services ndmp version)

Error: show failed: database sequential_identifier_byname is not open

cluster show comes back with "show is not a recognized command"

I did a cluster ? and see the following options:

     create Create a cluster
     date> Manage cluster's date and time setting
     join Join an existing cluster using the specified
    member's IP address or by cluster name
    setup Setup wizard
    statistics> Display cluster statistics
    time-service> Manage cluster time services

I did a cluster date show and get the following:

     Node Date Time zone
     --------- ------------------------- -------------------------
     RCISTORE-01
     8/14/2019 15:36:30 -04:00 America/Detroit

network interface show gives me what I am assuming is the console connection (e0M):

Logical Status Network Current Current Is
Vserver Interface Admin/Oper Address/Mask Node Port Home
----------- ---------- ---------- ------------------ ------------- ------- ----
RCI_Communications
Reliant-01 up/down 10.22.20.11/24 RCISTORE-01 e0M true

[SpindleNinja]

Thinking through some other troubleshooting steps...  There is something for sure not right with the cluster/nodes.  

Is the output the same if you console in to the other controller?  

How is it cabled?    Here's a reference doc: https://library.netapp.com/ecm/ecm_download_file/ECMP1213632 

Couple more for you to run: 

aggr show 

vol show 

vserver show 

set d; debug vreport show  

set adv; cluster ring show  

[JLogan3o13]

Here are the outputs. I will try plugging into the other port here in a moment:

aggr show:

Warning: Only local entries can be displayed at this time.

Aggregate Size Available Used% State #Vols Nodes RAID Status
--------- -------- --------- ----- ------- ------ ---------------- ------------
aggr0_clus1_n01
1004GB 46.72GB 95% online 1 RCISTORE-01 raid_dp,
normal
aggr1_data_n01
7.84TB 15.71GB 99% online 4 RCISTORE-01 mixed_raid_
type,
hybrid,
normal
aggr1_data_n02
7.84TB 106.9MB 99% online 3 RCISTORE-01 mixed_raid_
type,
hybrid,
normal
aggr2_data_n01
3.92TB 3.92TB 0% online 0 RCISTORE-01 raid_dp,
normal
aggr2_data_n02
3.92TB 3.92TB 0% online 0 RCISTORE-01 raid_dp,
normal
5 entries were displayed.

vol show:

     Error: "show" is not a recognized command

vol ?
     file> File related commands

vol file ?
     compact-data Apply Adaptive Data Compaction to a Snapshot copy of a file

vserver show:

     Error: "show" is not a recognized command

vserver ?
     audit> Manage auditing of protocol requests that the Vserver services
     check> The check directory
     cifs> Manage the CIFS configuration of a Vserver
     nfs> Manage the NFS configuration of a Vserver
     services> The services directory
     vscan> Manage Vscan

vserver check ?
     lif-multitenancy> The lif-multitenancy directory

vserver cifs show

     Error: show failed: database sequential_identifier_byname is not open

vserver nfs show

     Error: show failed: database sequential_identifier_byname is not open

vserver vscan ?
     connection-status> Display connection status of Vscan servers
     disable Disable Vscan on a Vserver
     enable Enable Vscan on a Vserver
     scanner-pool> Manage Vscan scanner pools
     show Display Vscan status

vserver vscan show

     Error: show failed: database sequential_identifier_byname is not open

set d; debug vreport show

     Warning: These diagnostic commands are for use by NetApp personnel only.
     Do you want to continue? {y|n}: y

     Error: "vreport" is not a recognized command

set adv; cluster ring show

     Error: "ring" is not a recognized command

[SpindleNinja]

Double check your Cluster cabling and SAS cabling too. 

[JLogan3o13]

That could very well be incorrect, I re-cabled everything the way they had it when I picked the equipment up, via a number of screenshots I took as they unplugged each cable. Is there an easy doc out there for proper cabling?

[SpindleNinja]

https://library.netapp.com/ecm/ecm_download_file/ECMP1213632  this is the setup guide, good place to start. 

[JLogan3o13]

Thanks, I will read through the doc this evening.

[SpindleNinja]

Sounds good, also, see if the other node is a little more "happy".  from what I can tell so far, there is a cluster, but the nodes are not able to see each other.     

[paul_stejskal]

It almost looks like a partial cluster shell. Do you have full admin rights?

[aborzenkov]

---

@paul_stejskal wrote:

It almost looks like a partial cluster shell.

---

Funny that nobody seems to pay any attention to “node is not fully operational” message shown in one of the first posts.

As I understand, this system was not in production anyway, at which point the simplest solution is to reinitialize it from scratch.

[SpindleNinja]

I noticed it.   but aggr show showed several aggrs,  so I was happy at one point, which got me thinking it was split / couldn't talk to it's partner.   

[AlexDawson · Accepted solution]

Hi there!

Are you still interested in moving this to resolution? It looks like this system is in an unknown and incorrectly running state.

As you are not the original purchasor, our support center will not be able to assist.

I suggest either engaging with a NetApp Partner in your region who can provide professional services (list at https://partner-connect.netapp.com/en/partner-directory) or sending the system to company like Kroll who can do specialised recovery from ONTAP systems. I'm inclined to suggest the Kroll, as at this point, the data integrity may be compromised.

Hope this helps!