NetApp OneCollect: The tool for easy, consolidated diagnostic data collection

by Member on ‎2017-01-17 09:38 AM - last edited 2 weeks ago by Community Manager

Introduction: 

NetApp OneCollect is a data collection tool that collects data from ONTAP, E-Series, Solid Fire, various operating system hosts and switches.  OneCollect tool can be used by Customers, Partners and Internal users.  The collected data is used for troubleshooting, solution validation, migration and upgrade assessments.  This data will be stored in ASUP and presented for use by various other tools like SmartSolve, ConfigAdvisor and Unified Parser.

 

OneCollect image.png

 

Key Features

  • Can be installed on Windows, Linux and OS X(Mac)
  • Collects data from ONTAP, E-Series, SolidFire, solution based collection including FlexPod, MCC.
  • Collects data from host Operating Systems including Windows, Linux, VMware ESX, AIX, HP-UX, Solaris.
  • Collects FC and Network data from Cisco and Brocade switches.
  • Collect data can be viewed using OneCollect raw data viewer and SmartSolve.
  • Supports auto discovery of environment, parallel execution and scheduling collection jobs.
  • Sends collected data to NetApp AutoSupport for use by assessment and troubleshooting tools.

GA

  • March 14, 2017

NetApp® OneCollect 1.0

 

Support and Questions

  • Community-based support only at this time
  • If you have any questions please post a reply to this article or contact ng-OneCollect-support@netapp.com
Comments
Frequent Contributor

Thanks a lot for your sharing.  That's wonderful tool and hope the official version could be released sooner.  here are a few request from team.

1. Could onecollect collect the existing ASUP?  especially those weekly ASUP

2. the ASUP uploaded has the title "Onecollect notification ...".  Could myAUSP or other tools accept and handle this kind ASUP?  I remember many tools only accept weekly ASUP.

3.  For host and switch data, Could onecollect replace nSANity?  if so, could it save the output as nSANity format because many other tools accept nSANity output.

4.  is there a plan to collect perfstat?  

New Contributor

Hi Chao,

 

Thank you for your interest in OneCollect.  OneCollect 1.0 GA is planned on 3/14. Please find the responses below.

 

1. Could onecollect collect the existing ASUP?  especially those weekly ASUP

<Pradeep> Currently it doesn't collect but its in the roadmap

 

2. the ASUP uploaded has the title "Onecollect notification ...".  Could myAUSP or other tools accept and handle this kind ASUP?  I remember many tools only accept weekly ASUP.

<Pradeep> SmartSolve and Unified Parser can search and retrieve OneCollect ASUPs and parse the data.  We have MyASUP in the roadmap for not just displaying raw ASUPs but also possibly use some data within OneCollect and not present in regular ASUPs.

 

3.  For host and switch data, Could onecollect replace nSANity?  if so, could it save the output as nSANity format because many other tools accept nSANity output.

<Pradeep> Yes. OneCollect tool is replacing nSANity. The output formats will be supported by Unified Parser.  SANview is going away and most other tools are part of governance to consume new OneCollect format.  It's not a major change as we using nSANity code for mostly underneath but there are few schema changes.

 

4.  is there a plan to collect perfstat?

<Pradeep>  No.  Persftat is going away.   We should be using PerfArchive starting from 8.3.  Anything prior to 8.3 will use existing PerfStat 8.4 release which is the last release and no further updates planned.

 

Thanks,

Pradeep,

Product Manager

OneCollect and Perf Supportability Tools

Frequent Contributor

Many Thanks Pradeep.  Does onecollect have plan to support to retrieve existing PerfArchive?  BTW, out-of-box tool (ex. perfstat) is still necessary for those secure site.  Please consider about that.

 

New Contributor

Hi Chao,

 

Yes, we do have in the roadmap to collect perfarchives and core files but may be not in the upcoming 1.1 release.  I am working on gathering requirements for next release.  Please let me know if you need anything else.  I can share the current PRD.  Please let me know your email address. 

 

For secure sites, we need to collect perfarchives and upload manually.  Current perfstat and latx will exist but no further enhancements coming in it.

 

Thanks,

Pradeep.

New Contributor

Congratulations on the release of OneCollect!  Awesome job!  Awesome tool!

Great tool! I am using this now more often for collecting and upload to UP.   I am however coming across an issue where all three tools are exhibiting the same behvior (nsanity,ict, one collect) on a specific set of ESXi hosts for a client.  The error that I get from all of these tools when I run it against the ESX host is the same.   The ESX hosts are running 5.5u2.  The error seems to be happening on post processing of esxcfg-info command.   I have run the command manually it finishes on the host successfully.  I am hoping you can shed some light as it seems all three tools use the same code base and exhibit the same behavior.   

 

ESX Host 1

 

03-18 01:48:51:INFO: Vmware:miavm101.bftg.com: Running esxcfg-info -a -F xml
03-18 01:58:50:INFO: Failed to run command: esxcfg-info -a -F xml. Exception: 'Timeout waiting for command to complete'
03-18 01:58:54:WARNING: Error while post-processing command: esxcfg-info -a -F xml. Error: Opening and ending tag mismatch: vm-disk-
resource line 2515059 and command_out, line 2515061, column 15

 

ESX Host 2

 

03-18 10:14:20:INFO: Failed to run command: esxcfg-info -a -F xml. Exception: 'Timeout waiting for command to complete'
03-18 10:14:29:WARNING: Error while post-processing command: esxcfg-info -a -F xml. Error: Opening and ending tag mismatch: world-32
967-stats- line 2104651 and command_out, line 2104667, column 15

New Contributor

Hi Aleeyee,

   

   Thanks for the feedback! Looks like the log you posted is from ICT, but the root cause is clear- 'Timeout waiting for command to complete' and OneCollect would show same error. This means that command output did not complete within the set time limit (10min in case of OneCollect/nsanity). We have set a time limit of max 10min and a size limit of 100MB for output from any command; this is to avoid the case where a command would produce enormous/infinite output and to maintain sanity of the result file.

 

     However we do have a workaround for this in OneCollect, if you are sure the command is taking more time and has a definite output within the size limit. Please follow the steps below:

 

1. Stop OneCollect Process (From task manager in Windows or using kill in Linux/Mac)

2. Edit the CONFIG file in the path <user_home_directory>\NetApp\OneCollect\Config and add the below line at the end of file e.g to increase to 20min (maintain same case/syntax)

 

COLLECTION_TIMEOUT=1200

 

3. Restart OneCollect. (By clicking OneCollect.exe under C:\Program Files(x86)\NetApp\OneCollect in Windows, ./onecollect from install dir on Mac/Linux)

 

Please let us know if that works.

 

Thanks,

   Nithin

 

 

 

Frequent Contributor

Hi Sir

 

I found the uploaded OneCollect ASUP was moved to individual category and could only be searched by entering SN/Jobname... in OneCollect field.  is it true?  

Partner said they uploaded OneCollect ASUP but I can't fine them.  is there a log show me what happened? May I manually upload ASUP file collected by OneCollect?  

Hi Chao,

 

I believe you meant SmartSolve.  Yes, you can search using serial number or job name.  Search by case id is coming in couple of weeks.

 

You can get the job name from Partner by which you can search it.  Collection Logs are available in user system <home directory>/OneCollectData/LogFiles diectory.

 

Thanks,

Pradeep.

Hi,

 

great tool!
Is there some relationship with the OneCollect Field I've seen in SmartSolve portal?
If yes, which ones?

I've tried to input a serial name but there are no result.

24-03-2017 14-04-24.jpg

New Contributor

 Hi @gmilazzoitag,

 

 

Thank you very much for the feeback.

 

Yes, Onecollect ASUPs are integrated in SmartSolve.  You can search using serial number, job name or case id.

 

It will display only OneCollect AutoSupports.  To be able to search OneCollect Autosupports, there must be OneCollect Autosupports uploaded already using OneCollect tool (OneCollect tool can upload ASUPs after data collection).  There will be one autosupport per device that is collected.

 

Thanks,

Pradeep.

Warning!

This NetApp Community is public and open website that is indexed by search engines such as Google. Participation in the NetApp Community is voluntary. All content posted on the NetApp Community is publicly viewable and available. This includes the rich text editor which is not encrypted for https.

In accordance to our Code of Conduct and Community Terms of Use DO NOT post or attach the following:

  • Software files (compressed or uncompressed)
  • Files that require an End User License Agreement (EULA)
  • Confidential information
  • Personal data you do not want publicly available
  • Another’s personally identifiable information
  • Copyrighted materials without the permission of the copyright owner

Files and content that do not abide by the Community Terms of Use or Code of Conduct will be removed. Continued non-compliance may result in NetApp Community account restrictions or termination.