Re: Harvest Graphite issues, new volumes missing

FRAZERBRADBURN · ‎2020-08-12

Hi,

We have been running harvest for many year now and this is the first time i've seen this issue. We have two instances one which is working fine the other which is not.

Recently I have noticed that whisper directory is not updating with new volumes, we recently expanded the cluster and I can see my new nodes but I cannot see new volumes .

I can see the poller is collating statistics for these new volumes and I don't see any errors in the polling

/opt/netapp-harvest/netapp-worker -v

I'm not seeing any errors either in the harvest logs so I'm out of ideas why graphite/whisper would not be writing the detail, I have checked permissions on folders and it all looks normal to me.

I have played with the interval these get updated and restarted harvest multiple times all to no avail.

I would very much appreciate any pointers. We are running

vachagan_gratian · ‎2020-08-12

Hi Frazer,

When you run Harvest with the -v flag, it should print the output strings that are sent to Graphite (something like "M = netapp.perf.DC1.cluster.node ..."). Can you check if your new volumes are in these strings?

FRAZERBRADBURN · ‎2020-08-12

Hi Vachagan,

Yes I do see them

[2020-08-12 16:00:09] [DEBUG ] M= netapp.perf.***.****.svm.*****.vol.*****.read_data 0.0616455078125 1597244404

yannb · ‎2020-08-13

Is it possible that for some reason the data directory has a privileges issue ? Did you do anything in NAbox as root ?

you can collect a support bundle in NAbox and send it to ftp://ftp.netapp.com/to-ntap/ and give me the exact file name.

FRAZERBRADBURN · ‎2020-08-13

I was thinking on the same lines myself.

I noticed that whisper files had some as www-data:www-data and others as www-data:root, I have just chown'd everything under whisper/ to www-data:www-data, no change yet but I shall get a log bundle.

vachagan_gratian · ‎2020-08-13

Can you also check if you see anything in the Carbon logs? E.g. it might be that the volume names include characters that Whisper fails to parse.

$ cat storage/log/carbon-cache/carbon-cache-*/console.log* | grep -E "[Ee]rr|[Ww]arn"

and:

$ cat storage/log/carbon-cache/carbon-cache-*/listener.log* | grep -E "[Ee]rr|[Ww]arn"

FRAZERBRADBURN · ‎2020-08-13

$ cat storage/log/carbon-cache/carbon-cache-*/console.log* | grep -E "[Ee]rr|[Ww]arn"


01/10/2019 22:44:09 :: /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:858: urllib3.exceptions.InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
01/10/2019 22:44:10 :: /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:858: urllib3.exceptions.InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
01/10/2019 22:44:12 :: /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:858: urllib3.exceptions.InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
01/10/2019 22:44:14 :: /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:858: urllib3.exceptions.InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
01/10/2019 22:44:18 :: /usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py:858: urllib3.exceptions.InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings

$ cat storage/log/carbon-cache/carbon-cache-*/listener.log* | grep -E "[Ee]rr|[Ww]arn"

Nothing for this

FRAZERBRADBURN · ‎2020-08-13

Found more

12/08/2020 08:37:16 :: socket.error: [Errno 98] Address already in use
root@gueanetappperf:/opt/graphite# cat storage/log/carbon-cache/carbon-cache-*/*console*.log | grep -E "[Ee]rr|[Ww]arn"
13/08/2020 09:24:39 :: /usr/local/lib/python2.7/dist-packages/twisted/python/util.py:723: exceptions.UserWarning: tried to drop privileges and setuid 33 but uid is already 33; should we be root? Continuing.
13/08/2020 11:35:42 :: /usr/local/lib/python2.7/dist-packages/twisted/python/util.py:723: exceptions.UserWarning: tried to drop privileges and setuid 33 but uid is already 33; should we be root? Continuing.
13/08/2020 09:24:39 :: /usr/local/lib/python2.7/dist-packages/twisted/python/util.py:723: exceptions.UserWarning: tried to drop privileges and setuid 33 but uid is already 33; should we be root? Continuing.
13/08/2020 11:35:42 :: /usr/local/lib/python2.7/dist-packages/twisted/python/util.py:723: exceptions.UserWarning: tried to drop privileges and setuid 33 but uid is already 33; should we be root? Continuing.

yannb · ‎2020-08-13

Please post the result of

ps auxww

and

ls -l /opt/graphite/storage/whisper/netapp

FRAZERBRADBURN · ‎2020-08-13

ls -l

drwxr-xr-x 5 www-data www-data 4096 Mar 18 10:45 capacity
drwxr-xr-x 5 www-data www-data 4096 Mar 18 10:42 perf
drwxr-xr-x 4 www-data www-data 4096 Oct 2 2017 poller

USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 28768 5024 ? Ss 09:24 0:00 /sbin/init
root 2 0.0 0.0 0 0 ? S 09:24 0:00 [kthreadd]
root 3 0.0 0.0 0 0 ? S 09:24 0:00 [ksoftirqd/0]
root 5 0.0 0.0 0 0 ? S< 09:24 0:00 [kworker/0:0H]
root 7 0.0 0.0 0 0 ? S 09:24 0:00 [rcu_sched]
root 8 0.0 0.0 0 0 ? S 09:24 0:00 [rcu_bh]
root 9 0.0 0.0 0 0 ? S 09:24 0:00 [migration/0]
root 10 0.0 0.0 0 0 ? S 09:24 0:00 [watchdog/0]
root 11 0.0 0.0 0 0 ? S 09:24 0:00 [watchdog/1]
root 12 0.0 0.0 0 0 ? S 09:24 0:00 [migration/1]
root 13 0.0 0.0 0 0 ? S 09:24 0:00 [ksoftirqd/1]
root 15 0.0 0.0 0 0 ? S< 09:24 0:00 [kworker/1:0H]
root 16 0.0 0.0 0 0 ? S< 09:24 0:00 [khelper]
root 17 0.0 0.0 0 0 ? S 09:24 0:00 [kdevtmpfs]
root 18 0.0 0.0 0 0 ? S< 09:24 0:00 [netns]
root 19 0.0 0.0 0 0 ? S 09:24 0:00 [khungtaskd]
root 20 0.0 0.0 0 0 ? S< 09:24 0:00 [writeback]
root 21 0.0 0.0 0 0 ? SN 09:24 0:00 [ksmd]
root 22 0.0 0.0 0 0 ? SN 09:24 0:00 [khugepaged]
root 23 0.0 0.0 0 0 ? S< 09:24 0:00 [crypto]
root 24 0.0 0.0 0 0 ? S< 09:24 0:00 [kintegrityd]
root 25 0.0 0.0 0 0 ? S< 09:24 0:00 [bioset]
root 26 0.0 0.0 0 0 ? S< 09:24 0:00 [kblockd]
root 29 0.3 0.0 0 0 ? S 09:24 0:09 [kswapd0]
root 30 0.0 0.0 0 0 ? S< 09:24 0:00 [vmstat]
root 31 0.0 0.0 0 0 ? S 09:24 0:00 [fsnotify_mark]
root 37 0.0 0.0 0 0 ? S< 09:24 0:00 [kthrotld]
root 38 0.0 0.0 0 0 ? S< 09:24 0:00 [ipv6_addrconf]
root 39 0.0 0.0 0 0 ? S< 09:24 0:00 [deferwq]
root 40 0.1 0.0 0 0 ? S 09:24 0:04 [kworker/u4:1]
root 75 0.0 0.0 0 0 ? S< 09:24 0:00 [mpt_poll_0]
root 76 0.0 0.0 0 0 ? S< 09:24 0:00 [mpt/0]
root 77 0.0 0.0 0 0 ? S< 09:24 0:00 [ata_sff]
root 78 0.0 0.0 0 0 ? S< 09:24 0:00 [kpsmoused]
root 81 0.0 0.0 0 0 ? S 09:24 0:00 [scsi_eh_0]
root 82 0.0 0.0 0 0 ? S< 09:24 0:00 [scsi_tmf_0]
root 83 0.0 0.0 0 0 ? S 09:24 0:00 [scsi_eh_1]
root 84 0.0 0.0 0 0 ? S< 09:24 0:00 [scsi_tmf_1]
root 85 0.0 0.0 0 0 ? S 09:24 0:00 [scsi_eh_2]
root 86 0.0 0.0 0 0 ? S< 09:24 0:00 [scsi_tmf_2]
root 98 0.0 0.0 0 0 ? S< 09:24 0:00 [kworker/0:1H]
root 99 0.0 0.0 0 0 ? S< 09:24 0:01 [kworker/1:1H]
root 126 0.0 0.0 0 0 ? S 09:24 0:00 [jbd2/sda6-8]
root 127 0.0 0.0 0 0 ? S< 09:24 0:00 [ext4-rsv-conver]
root 157 0.0 0.0 0 0 ? S 09:24 0:00 [kauditd]
root 169 0.0 0.0 41532 7324 ? Ss 09:24 0:00 /lib/systemd/systemd-journald
root 171 0.0 0.0 40820 3304 ? Ss 09:24 0:00 /lib/systemd/systemd-udevd
root 191 0.0 0.0 0 0 ? S< 09:24 0:00 [kdmflush]
root 192 0.0 0.0 0 0 ? S< 09:24 0:00 [bioset]
root 197 0.0 0.0 0 0 ? S< 09:24 0:00 [ttm_swap]
root 335 0.0 0.0 0 0 ? S 09:24 0:00 [jbd2/sde1-8]
root 336 0.0 0.0 0 0 ? S< 09:24 0:00 [ext4-rsv-conver]
root 339 0.0 0.0 0 0 ? S 09:24 0:00 [jbd2/dm-0-8]
root 340 0.0 0.0 0 0 ? S< 09:24 0:00 [ext4-rsv-conver]
root 342 0.0 0.0 0 0 ? S 09:24 0:00 [jbd2/sda1-8]
root 344 0.0 0.0 0 0 ? S< 09:24 0:00 [ext4-rsv-conver]
root 349 0.0 0.0 0 0 ? S< 09:24 0:00 [loop0]
root 350 0.0 0.0 0 0 ? S 09:24 0:00 [jbd2/loop0-8]
root 351 0.0 0.0 0 0 ? S< 09:24 0:00 [ext4-rsv-conver]
grafana 631 0.2 0.6 766388 50132 ? Ssl 09:24 0:04 /usr/sbin/grafana-server --config=/etc/grafana/grafana.ini --pidfile=/var/run/grafana/grafana-server.pid --packaging=deb cfg:default.paths.logs=/var/log/grafana cfg:default.paths.data=/var/lib/grafana cfg:default.paths.plugins=/var/lib/grafana/plugins cfg:default.paths.provisioning=/etc/grafana/provisioning
logstash 636 1.9 5.3 3574044 438436 ? SNsl 09:24 0:48 /usr/local/nabox/java/bin/java -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -Djava.awt.headless=true -Dfile.encoding=UTF-8 -XX:+HeapDumpOnOutOfMemoryError -Xmx1g -Xms256m -Xss2048k -Djffi.boot.library.path=/usr/share/logstash/vendor/jruby/lib/jni -Xbootclasspath/a:/usr/share/logstash/vendor/jruby/lib/jruby.jar -classpath : -Djruby.home=/usr/share/logstash/vendor/jruby -Djruby.lib=/usr/share/logstash/vendor/jruby/lib -Djruby.script=jruby -Djruby.shell=/bin/sh org.jruby.Main /usr/share/logstash/lib/bootstrap/environment.rb logstash/runner.rb --path.settings /opt/logstash/etc
root 638 0.0 0.0 26248 2584 ? Ss 09:24 0:00 /usr/sbin/cron -f
root 641 0.0 0.0 55184 5260 ? Ss 09:24 0:00 /usr/sbin/sshd -D
root 655 0.0 0.0 262884 3576 ? Ssl 09:24 0:00 /usr/sbin/rsyslogd -n
root 658 0.0 0.0 4256 1696 ? Ss 09:24 0:00 /usr/sbin/acpid
elastic+ 667 0.6 28.4 4639328 2330836 ? Ssl 09:24 0:15 /usr/local/nabox/java/bin/java -Xms2g -Xmx2g -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+DisableExplicitGC -XX:+AlwaysPreTouch -server -Xss1m -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djna.nosys=true -Djdk.io.permissionsUseCanonicalPath=true -Dio.netty.noUnsafe=true -Dio.netty.noKeySetOptimization=true -Dio.netty.recycler.maxCapacityPerThread=0 -Dlog4j.shutdownHookEnabled=false -Dlog4j2.disable.jmx=true -Dlog4j.skipJansi=true -XX:+HeapDumpOnOutOfMemoryError -Des.path.home=/usr/share/elasticsearch -cp /usr/share/elasticsearch/lib/* org.elasticsearch.bootstrap.Elasticsearch -p /var/run/elasticsearch/elasticsearch.pid --quiet -Edefault.path.logs=/opt/elasticsearch/log -Edefault.path.data=/opt/elasticsearch/data -Edefault.path.conf=/opt/elasticsearch/etc
root 671 0.0 0.0 12664 1768 tty6 Ss+ 09:24 0:00 /sbin/agetty --noclear tty6 linux
root 673 0.0 0.0 12664 1920 tty5 Ss+ 09:24 0:00 /sbin/agetty --noclear tty5 linux
root 674 0.0 0.0 12664 1912 tty4 Ss+ 09:24 0:00 /sbin/agetty --noclear tty4 linux
root 675 0.0 0.0 12664 1924 tty3 Ss+ 09:24 0:00 /sbin/agetty --noclear tty3 linux
root 676 0.0 0.0 12664 1832 tty2 Ss+ 09:24 0:00 /sbin/agetty --noclear tty2 linux
root 679 0.0 0.0 13188 2020 tty1 Ss+ 09:24 0:00 /sbin/agetty --noclear tty1 linux
root 730 0.0 0.0 6280 880 ? Ss 09:24 0:00 /usr/sbin/collectdmon -P /var/run/collectd.pid -- -C /etc/collectd/collectd.conf
root 731 0.0 0.1 996832 12648 ? Sl 09:24 0:01 collectd -C /etc/collectd/collectd.conf -f
root 743 0.1 0.9 142052 80704 ? Ss 09:24 0:03 /usr/bin/perl /opt/netapp-harvest/netapp-worker -poller **.**.**.** -conf netapp-harvest.conf -confdir /opt/netapp-harvest -logdir /opt/netapp-harvest/log -daemon
root 764 26.8 1.5 191232 129252 ? Ss 09:24 10:57 /usr/bin/perl /opt/netapp-harvest/netapp-worker -poller **.**.**.** -conf netapp-harvest.conf -confdir /opt/netapp-harvest -logdir /opt/netapp-harvest/log -daemon
root 775 14.8 1.3 167476 106800 ? Rs 09:24 6:03 /usr/bin/perl /opt/netapp-harvest/netapp-worker -poller **.**.**.** -conf netapp-harvest.conf -confdir /opt/netapp-harvest -logdir /opt/netapp-harvest/log -daemon
root 790 0.0 0.2 244756 23596 ? Ss 09:24 0:00 /usr/sbin/apache2 -k start
www-data 793 0.4 0.8 1079976 67124 ? Sl 09:24 0:11 (wsgi:graphite) -k start
www-data 794 0.6 0.8 1080216 67408 ? Sl 09:24 0:15 (wsgi:graphite) -k start
www-data 795 0.5 0.8 1080496 66224 ? Sl 09:24 0:12 (wsgi:graphite) -k start
www-data 796 0.5 0.8 1079728 66172 ? Sl 09:24 0:13 (wsgi:graphite) -k start
www-data 797 0.4 0.7 1079712 63956 ? Sl 09:24 0:10 (wsgi:graphite) -k start
www-data 905 0.0 0.1 247300 16276 ? S 09:24 0:00 /usr/sbin/apache2 -k start
www-data 932 0.4 0.4 166380 35584 ? Sl 09:24 0:10 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-5.pid --instance=5 start
www-data 933 0.4 0.4 166392 35576 ? Sl 09:24 0:11 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-7.pid --instance=7 start
www-data 935 0.4 0.4 166612 35636 ? Sl 09:24 0:11 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-4.pid --instance=4 start
www-data 937 0.4 0.4 166628 35840 ? Sl 09:24 0:10 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-3.pid --instance=3 start
www-data 941 0.3 0.4 166356 35288 ? Sl 09:24 0:09 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-6.pid --instance=6 start
www-data 942 0.4 0.4 166264 35476 ? Sl 09:24 0:11 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-8.pid --instance=8 start
www-data 944 0.4 0.4 166616 35856 ? Sl 09:24 0:10 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-1.pid --instance=1 start
www-data 945 0.4 0.4 166360 35600 ? Sl 09:24 0:10 /usr/bin/python /opt/graphite/bin/carbon-cache.py --pidfile=/opt/graphite/storage/carbon-cache-2.pid --instance=2 start
root 947 0.9 0.4 91952 35156 ? S 09:24 0:23 /usr/bin/python /opt/graphite/bin/carbon-relay.py --pidfile=/opt/graphite/storage/carbon-relay-a.pid start
ntp 1089 0.0 0.0 33384 4312 ? Ss 09:25 0:00 /usr/sbin/ntpd -p /var/run/ntpd.pid -g -u 104:109
root 1094 0.0 0.0 82748 5984 ? Ss 09:25 0:01 sshd: root@pts/0
root 1096 0.0 0.0 22800 3708 pts/0 Ss 09:25 0:00 -bash
www-data 1126 0.2 0.2 248100 21000 ? S 09:26 0:05 /usr/sbin/apache2 -k start
www-data 1135 0.0 0.2 248324 21756 ? S 09:26 0:00 /usr/sbin/apache2 -k start
root 2616 0.0 0.0 0 0 ? S 09:32 0:00 [kworker/0:0]
root 2677 0.0 0.0 0 0 ? S 09:34 0:01 [kworker/u4:0]
www-data 2679 0.0 0.1 247316 16136 ? S 09:35 0:00 /usr/sbin/apache2 -k start
www-data 2680 0.0 0.1 247348 16136 ? S 09:35 0:00 /usr/sbin/apache2 -k start
www-data 2684 0.0 0.1 247260 16128 ? S 09:35 0:00 /usr/sbin/apache2 -k start
www-data 2695 0.0 0.1 247324 16144 ? S 09:36 0:00 /usr/sbin/apache2 -k start
root 2751 0.0 0.0 0 0 ? S 09:40 0:00 [kworker/u4:2]
root 2799 0.0 0.0 101132 7440 ? Ss 09:46 0:00 /usr/bin/vmtoolsd
www-data 2802 0.0 0.0 4336 812 ? S 09:46 0:00 sh -c sudo /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-094700.tgz --stdout
root 2803 0.0 0.0 43256 3240 ? S 09:46 0:00 sudo /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-094700.tgz --stdout
root 2804 0.0 0.0 11636 2652 ? S 09:46 0:00 /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-094700.tgz --stdout
root 2810 0.0 0.0 11660 2752 ? S 09:46 0:00 /bin/bash /usr/local/nabox/cmd/system/support-bundle --path nabox-support-20200813-094700.tgz --stdout
root 2856 3.4 0.0 28444 4888 ? S 09:46 0:38 tar -cz --transform s,^,./nabox-support-20200813-094700/, /opt/graphite/storage/log /opt/graphite/conf /var/log /opt/netapp-harvest /opt/conf /opt/tmp /etc/issue /etc/hosts /etc/resolv.conf /etc/network/interfaces /etc/hostname /tmp/support-bundle /tmp/vmtoolsd.log /root/.bash_history /root/install.log
root 2857 63.3 0.0 4492 1360 ? R 09:46 11:39 gzip
www-data 2862 0.0 0.1 247260 15136 ? S 09:47 0:00 /usr/sbin/apache2 -k start
www-data 2864 0.0 0.2 247428 16508 ? S 09:47 0:00 /usr/sbin/apache2 -k start
www-data 2865 0.0 0.1 247260 16208 ? S 09:47 0:00 /usr/sbin/apache2 -k start
www-data 2866 0.0 0.2 247396 16592 ? S 09:47 0:00 /usr/sbin/apache2 -k start
www-data 2873 0.0 0.2 248240 21192 ? S 09:47 0:00 /usr/sbin/apache2 -k start
www-data 2878 0.0 0.1 247268 14640 ? S 09:48 0:00 /usr/sbin/apache2 -k start
root 2879 0.0 0.0 0 0 ? S 09:48 0:00 [kworker/0:2]
www-data 2885 0.0 0.2 247244 19880 ? S 09:54 0:00 /usr/sbin/apache2 -k start
root 2886 0.0 0.0 0 0 ? S 09:54 0:00 [kworker/1:2]
root 2889 0.0 0.0 0 0 ? S 09:59 0:00 [kworker/1:1]
www-data 3111 0.0 0.2 248336 20924 ? S 10:02 0:00 /usr/sbin/apache2 -k start
www-data 3112 0.0 0.1 247236 15212 ? S 10:02 0:00 /usr/sbin/apache2 -k start
www-data 3462 0.0 0.1 247236 15180 ? S 10:03 0:00 /usr/sbin/apache2 -k start
www-data 3661 0.0 0.1 247244 14996 ? S 10:04 0:00 /usr/sbin/apache2 -k start
www-data 3880 0.0 0.0 4336 708 ? S 10:04 0:00 sh -c sudo /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-100416.tgz --stdout
root 3881 0.0 0.0 43256 3188 ? S 10:04 0:00 sudo /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-100416.tgz --stdout
root 3882 0.0 0.0 11636 2636 ? S 10:04 0:00 /bin/bash /usr/local/nabox/nabox system support-bundle --path nabox-support-20200813-100416.tgz --stdout
root 3888 0.0 0.0 11660 2708 ? S 10:04 0:00 /bin/bash /usr/local/nabox/cmd/system/support-bundle --path nabox-support-20200813-100416.tgz --stdout
root 3934 2.4 0.0 26304 2844 ? D 10:04 0:01 tar -cz --transform s,^,./nabox-support-20200813-100416/, /opt/graphite/storage/log /opt/graphite/conf /var/log /opt/netapp-harvest /opt/conf /opt/tmp /etc/issue /etc/hosts /etc/resolv.conf /etc/network/interfaces /etc/hostname /tmp/support-bundle /tmp/vmtoolsd.log /root/.bash_history /root/install.log
root 3935 45.9 0.0 4492 1344 ? S 10:04 0:31 gzip
root 3936 0.0 0.0 0 0 ? S 10:04 0:00 [kworker/1:0]
root 3938 0.0 0.0 17844 2376 pts/0 R+ 10:05 0:00 ps auxww

yannb · ‎2020-08-13

Try

chown -R www-data:root /opt/graphite/storage/whisper

Also Vachagan asked for other logs that can be useful 🙂

Harvest Graphite issues, new volumes missing

NAbox 2.5.1