NetApp OneCollect is a data collection tool that collects data from ONTAP, E-Series, Solid Fire, various operating system hosts and switches. OneCollect tool can be used by Customers, Partners and Internal users. The collected data is used for troubleshooting, solution validation, migration and upgrade assessments. This data will be stored in ASUP and presented for use by various other tools like SmartSolve, ConfigAdvisor and Unified Parser.
Key Features
Can be installed on Windows, Linux and OS X(Mac)
Collects data from ONTAP, E-Series, SolidFire, solution based collection including FlexPod, MCC.
Collects data from host Operating Systems including Windows, Linux, VMware ESX, AIX, HP-UX, Solaris.
Collects FC and Network data from Cisco and Brocade switches.
Collect data can be viewed using OneCollect raw data viewer and SmartSolve.
Supports auto discovery of environment, parallel execution and scheduling collection jobs.
Sends collected data to NetApp AutoSupport for use by assessment and troubleshooting tools.
Thanks a lot for your sharing. That's wonderful tool and hope the official version could be released sooner. here are a few request from team.
1. Could onecollect collect the existing ASUP? especially those weekly ASUP
2. the ASUP uploaded has the title "Onecollect notification ...". Could myAUSP or other tools accept and handle this kind ASUP? I remember many tools only accept weekly ASUP.
3. For host and switch data, Could onecollect replace nSANity? if so, could it save the output as nSANity format because many other tools accept nSANity output.
Thank you for your interest in OneCollect. OneCollect 1.0 GA is planned on 3/14. Please find the responses below.
1. Could onecollect collect the existing ASUP? especially those weekly ASUP
<Pradeep> Currently it doesn't collect but its in the roadmap
2. the ASUP uploaded has the title "Onecollect notification ...". Could myAUSP or other tools accept and handle this kind ASUP? I remember many tools only accept weekly ASUP.
<Pradeep> SmartSolve and Unified Parser can search and retrieve OneCollect ASUPs and parse the data. We have MyASUP in the roadmap for not just displaying raw ASUPs but also possibly use some data within OneCollect and not present in regular ASUPs.
3. For host and switch data, Could onecollect replace nSANity? if so, could it save the output as nSANity format because many other tools accept nSANity output.
<Pradeep> Yes. OneCollect tool is replacing nSANity. The output formats will be supported by Unified Parser. SANview is going away and most other tools are part of governance to consume new OneCollect format. It's not a major change as we using nSANity code for mostly underneath but there are few schema changes.
4. is there a plan to collect perfstat?
<Pradeep> No. Persftat is going away. We should be using PerfArchive starting from 8.3. Anything prior to 8.3 will use existing PerfStat 8.4 release which is the last release and no further updates planned.
Many Thanks Pradeep. Does onecollect have plan to support to retrieve existing PerfArchive? BTW, out-of-box tool (ex. perfstat) is still necessary for those secure site. Please consider about that.
Yes, we do have in the roadmap to collect perfarchives and core files but may be not in the upcoming 1.1 release. I am working on gathering requirements for next release. Please let me know if you need anything else. I can share the current PRD. Please let me know your email address.
For secure sites, we need to collect perfarchives and upload manually. Current perfstat and latx will exist but no further enhancements coming in it.
Great tool! I am using this now more often for collecting and upload to UP. I am however coming across an issue where all three tools are exhibiting the same behvior (nsanity,ict, one collect) on a specific set of ESXi hosts for a client. The error that I get from all of these tools when I run it against the ESX host is the same. The ESX hosts are running 5.5u2. The error seems to be happening on post processing of esxcfg-info command. I have run the command manually it finishes on the host successfully. I am hoping you can shed some light as it seems all three tools use the same code base and exhibit the same behavior.
ESX Host 1
03-18 01:48:51:INFO: Vmware:miavm101.bftg.com: Running esxcfg-info -a -F xml 03-18 01:58:50:INFO: Failed to run command: esxcfg-info -a -F xml. Exception: 'Timeout waiting for command to complete' 03-18 01:58:54:WARNING: Error while post-processing command: esxcfg-info -a -F xml. Error: Opening and ending tag mismatch: vm-disk- resource line 2515059 and command_out, line 2515061, column 15
ESX Host 2
03-18 10:14:20:INFO: Failed to run command: esxcfg-info -a -F xml. Exception: 'Timeout waiting for command to complete' 03-18 10:14:29:WARNING: Error while post-processing command: esxcfg-info -a -F xml. Error: Opening and ending tag mismatch: world-32 967-stats- line 2104651 and command_out, line 2104667, column 15
Thanks for the feedback! Looks like the log you posted is from ICT, but the root cause is clear- 'Timeout waiting for command to complete' and OneCollect would show same error. This means that command output did not complete within the set time limit (10min in case of OneCollect/nsanity). We have set a time limit of max 10min and a size limit of 100MB for output from any command; this is to avoid the case where a command would produce enormous/infinite output and to maintain sanity of the result file.
However we do have a workaround for this in OneCollect, if you are sure the command is taking more time and has a definite output within the size limit. Please follow the steps below:
1. Stop OneCollect Process (From task manager in Windows or using kill in Linux/Mac)
2. Edit the CONFIG file in the path <user_home_directory>\NetApp\OneCollect\Config and add the below line at the end of file e.g to increase to 20min (maintain same case/syntax)
COLLECTION_TIMEOUT=1200
3. Restart OneCollect. (By clicking OneCollect.exe under C:\Program Files(x86)\NetApp\OneCollect in Windows, ./onecollect from install dir on Mac/Linux)
I found the uploaded OneCollect ASUP was moved to individual category and could only be searched by entering SN/Jobname... in OneCollect field. is it true?
Partner said they uploaded OneCollect ASUP but I can't fine them. is there a log show me what happened? May I manually upload ASUP file collected by OneCollect?
I believe you meant SmartSolve. Yes, you can search using serial number or job name. Search by case id is coming in couple of weeks.
You can get the job name from Partner by which you can search it. Collection Logs are available in user system <home directory>/OneCollectData/LogFiles diectory.
Yes, Onecollect ASUPs are integrated in SmartSolve. You can search using serial number, job name or case id.
It will display only OneCollect AutoSupports. To be able to search OneCollect Autosupports, there must be OneCollect Autosupports uploaded already using OneCollect tool (OneCollect tool can upload ASUPs after data collection). There will be one autosupport per device that is collected.
As a partner I've asked a customer to run OneCollect against the devices in a SAN environment we're planning an upgrade for. But now I have no idea where to go to get to the data. Customer has said it's gone to NetApp but I can't work out which portal I should use to get to the ASUP with the OneCollect output data.
Alternatively, there doesn't seem to be any easy way for me to get the customer to send me the results files and import them into OneCollect for me to view locally.
Customer should be giving you the Job name which he created in OneCollect tool. If you have access to SmartSolve tool, you can search using Job name or NetApp serial number in SmartSolve and view the data. You can also search ONTAP data collected using OneCollect tool in Unified Parser by specifying ONTAP serial number.
Am I right that Unified Parser is accessible only to NetApp employees? I get empty page when follow link from field portal to Unified Parser with my partner account.
On top of that, SmartSolve is only available to Support Services Certified (SSC) Partners and original equipment manufacturer(OEM) partners. So Premier partners with a Professional Services focus such as ourselves can't even use it to view the OneCollect data. Therefore the new tools for increasing our chances of being successful with migrations and transitions are kinda pointless.
Unified Parser is available to Customers and all Partners too. Please email to ng-OneCollect-Support2@netapp.com with your NetApp SSO user id. We will take it up with Unified Parser team and let you know.
I was confused by Onecollect plug-ins. the URL in the InA manual does not work ( http://mysupport.netapp.com/NOW/download/tools/Onecollect/) . in same manual, it said there are the independent plug-in installation packages are available for the following plug-ins:
ONTAP 7-Mode
Clustered Data ONTAP
E-Series
FlexPod
MetroCluster in Clustered Data ONTAP
I just wonder if basic Onecollect could collect data from above system? at least I found nothing incorrect to collect cDOT system.
Thanks for the feedback. The documentation errors with respect to wrong URL and the confusion on plug-ins available for download are fixed and we will update the manual in portal soon.
However, to clarify your question on plug-ins, all the profiles that you see in the OneCollect tool can be considered as plug-ins and we can selectively update each of those profiles if there are any updates to commands. In this release, we have bundled all the plugins together with the framework and are installed by default. So there is no need to install any of these separately unless there is an update which would be notified to users (under 'Notifications' tab in the tool when there is active network connection).
I have a requirement to provide a list from my virtual environment including the following:
Server Name
Operating System
DISM version
SnapDrive version
SnapManager for SQL version
I have a predetermined list of VMs to target.
Based on the outcome of this list will determine if I need to perform any upgrades. Can OneCollect provide me with this information or is there another tool available? Alternatively should I be looking at writing a PowerShell script to do this for me?
THanks for your feedback! We can add these to our roadmap. We are planning to make the data directory path configurable like the install directory path, so that it would be possible to have all binaries and data in a mapped network location or pen drive.
Just to rule out any browser compatibility issues, the supported browsers are Firefox version 55 or higher, Chrome version 63 or higher and latest Microsoft Edge browser. If the browser falls under supported category, please try to delete or backup database file located at <user home dir>\NetApp\OneCollect\Db after stopping OneCollect process and restart the OneCollect process. Let us know if that works!
1. Tried on our two-node (one HA-pair) AFF cluster, on both a node's management port and the cluster management port, and it will run then get stuck. I've re-ran several times, usually stops between 20-35%, but it has gone to 52% once and stopped there.
2. Tried on our eight node FAS cluster, same as above. It runs for a while and then gets stuck
The job log does not show an error. It shows the last command it was running.
3. Tried it on a brand new test cluster with no SVM or SVM LIF's, it ran, but of course there is nothing on that.
Sorry for the inconvenience caused! When the jobs were stuck forever, did the memory usage on your system shot up or the application hung? We will work on having a custom debug build and then we could have webex to troubleshoot and get it working. Please message you email id.
It would be good to have feature where when to collect data for a vcenter server, it also collects all the required informaiton for the ESXi hosts too? Can this be achieved?
Could you please send across the collected data files to ng-OneCollect-Support@netapp.com? The data files could be found at <user home directory>\OneCollectData\JobFiles\<Job name>.
as far as I can see even with the current version 1.5 of OneCollect you can't collect perfarchives (aka Counter Manager data) from FAS-systems (be it 7-Mode or cDOT).
Is this feature still on the roadmap?
For some customers it simply is not allowed to connect their systems to ActiveIQ to get the fancy performance graphs.
And I can't use OCUM to get performance data since it does not support 7-Mode systems.
And Perfstats are also quite an effort if you for example want a week of data. The output gets really huge and the processing afterwards also takes some time.
Currently in these situations I always have to the mount the correct etc-path and then collect the Performance Archiver files manually which is quite the effort.
Would be awesome if you could tell OneCollect to download the perfarchives from say the latest X hours/days.
Then you could use CMPG to produce some performance graphs.
I am using OneCollect 1.8 while I am uploding the collected logs to Autosupport it takes so long and while I refresh the page it says Failed. Some time I am not able to open Onecollect saying "Page error". I was uploaded 162 host but report I received from Interop Advisor it containes only 45 host. can any one please let me know best practises for using OneCollect tool.