n1*> statit -b n1*> statit -e Hostname: n1 ID: 1921618939 Memory: 4120 MB NetApp Release 8.2.4P6 7-Mode: Wed Jan 11 01:07:08 PST 2017 <1O> Start time: Tue Jun 23 10:33:43 +06 2020 CPU Statistics 502.361593 time (seconds) 100 % 379.292576 system time 76 % 8.742660 rupt time 2 % (5725368 rupts x 2 usec/rupt) 370.549916 non-rupt system time 74 % 1630.153796 idle time 324 % 64.235103 time in CP 13 % 100 % 1.081532 rupt time in CP 2 % (715114 rupts x 2 usec/rupt) Multiprocessor Statistics (per second) cpu0 cpu1 cpu2 cpu3 total sk switches 7297.29 5571.45 5170.74 9217.00 27256.48 hard switches 7156.37 5454.42 5063.35 8881.81 26555.95 domain switches 272.97 164.06 251.85 469.33 1158.21 CP rupts 444.11 364.57 255.59 359.23 1423.50 nonCP rupts 2882.93 2689.32 1743.48 2657.67 9973.40 IPI rupts 0.00 0.00 0.00 0.00 0.00 grab kahuna 0.00 0.00 0.00 0.00 0.00 grab kahuna usec 0.00 0.00 0.00 0.00 0.00 suspend domain 0.00 0.00 0.00 0.00 0.00 suspend domain usec 0.00 0.00 0.00 0.00 0.00 CP rupt usec 1022.05 414.10 144.44 572.30 2152.90 nonCP rupt usec 6810.13 3128.28 983.92 4327.89 15250.22 idle 802936.58 824607.18 841529.16 775908.02 3244980.94 kahuna 357.43 618.09 288.57 38787.17 40051.25 storage 36769.46 8840.97 48759.73 7550.36 101920.53 exempt 8923.26 2866.27 2743.04 2127.85 16660.43 raid 28763.79 19575.74 24864.71 15248.01 88452.24 raid_exempt 0.00 0.00 0.00 0.00 0.00 target 8781.54 23633.41 6750.55 21025.19 60190.69 dnscache 0.00 0.00 0.00 0.04 0.04 cifs 71.91 35.22 28.81 43.75 179.70 wafl_exempt 94826.33 107708.27 67832.87 129074.15 399441.63 wafl_xcleaner 1409.88 1546.18 982.41 741.21 4679.68 sm_exempt 23.32 11.75 10.01 11.87 56.95 cluster 0.00 0.00 0.00 0.00 0.00 protocol 404.73 275.22 224.78 177.05 1081.80 nwk_exclusive 1945.13 987.31 1248.53 1353.02 5533.99 nwk_exempt 2406.01 1516.28 1580.76 1338.91 6841.96 nwk_legacy 1362.88 1374.86 743.56 824.68 4305.99 hostOS 3185.56 2860.83 1284.14 888.52 8219.06 ssan_exempt 0.00 0.00 0.00 0.00 0.00 FreeBSD CPU state Statistics (per second) user 0.10 0.11 0.04 0.00 0.25 nice 0.00 0.00 0.00 0.00 0.00 sys 21.93 20.78 23.13 27.44 93.28 intr 0.01 0.00 0.01 0.05 0.06 idle 110.89 112.04 109.76 105.44 438.13 nonrt-pf-cnt 1.90 1.06 0.13 0.02 3.12 nonrt-pf-usec 4.86 2.97 0.55 0.07 8.46 rt-pf-cnt 0.00 0.00 0.00 0.00 0.00 rt-pf-usec 0.00 0.00 0.00 0.00 0.00 kern-pf-cnt 0.02 0.01 0.00 0.00 0.02 kern-pf-usec 0.06 0.02 0.00 0.00 0.08 236.098623 seconds with one or more CPUs active ( 47%) 96.471451 seconds with 2 or more CPUs active ( 19%) 31.210062 seconds with 3 or more CPUs active ( 6%) 139.627172 seconds with one CPU active ( 28%) 65.261389 seconds with 2 CPUs active ( 13%) 22.687731 seconds with 3 CPUs active ( 5%) 8.522331 seconds with all CPUs active ( 2%) Domain Utilization of Shared Domains (per second) 0.00 idle 299870.25 kahuna 0.00 storage 0.00 exempt 0.00 raid 0.00 raid_exempt 0.00 target 0.00 dnscache 0.00 cifs 0.00 wafl_exempt 0.00 wafl_xcleaner 0.00 sm_exempt 0.00 cluster 0.00 protocol 8509.32 nwk_exclusive 0.00 nwk_exempt 0.00 nwk_legacy 0.00 hostOS 0.00 ssan_exempt switch domain to domain (per second) 0.00 idle 222.04 kahuna 170.62 storage 10.22 exempt 16.48 raid 0.00 raid_exempt 0.52 target 0.01 dnscache 1.38 cifs 1.00 wafl_exempt 0.00 wafl_xcleaner 0.00 sm_exempt 0.00 cluster 0.31 protocol 13.21 nwk_exclusive 344.51 nwk_exempt 377.93 nwk_legacy 0.00 hostOS 0.00 ssan_exempt Exempt Domain Suspension Stats (per second) Miscellaneous Statistics (per second) 26555.95 hard context switches 0.00 NFS operations 0.00 CIFS operations 0.00 HTTP operations 3.64 network KB received 7.53 network KB transmitted 171773.45 disk KB read 4895.17 disk KB written 3228.49 NVRAM KB written 0.00 nolog KB written 42331.70 WAFL bufs given to clients 0.00 checksum cache hits ( 0%) 0.00 no checksum - partial buffer 469.27 FCP operations 0.00 iSCSI operations WAFL Statistics (per second) 185.47 name cache hits ( 97%) 5.17 name cache misses ( 3%) 162743.23 buf hash hits ( 68%) 75754.02 buf hash misses ( 32%) 4559.30 inode cache hits ( 100%) 0.00 inode cache misses ( 0%) 45428.21 buf cache hits ( 99%) 306.35 buf cache misses ( 1%) 94.41 blocks read 42294.16 blocks read-ahead 1381.32 chains read-ahead 178.25 dummy reads 40186.58 blocks speculative read-ahead 950.38 blocks written 2.33 stripes written 769.01 blocks page flipped 0.00 blocks over-written 0.08 wafl_timer generated CP 0.00 snapshot generated CP 0.00 wafl_avail_bufs generated CP 0.00 dirty_blk_cnt generated CP 0.00 full NV-log generated CP 0.00 back-to-back CP 0.00 flush generated CP 0.00 sync generated CP 0.00 deferred back-to-back CP 0.00 low mbufs generated CP 0.00 low datavecs generated CP 0.00 nvlog replay takeover time limit CP 7819.26 non-restart messages 60.75 IOWAIT suspends 25648646.74 next nvlog nearly full msecs 0.00 dirty buffer susp msecs 0.00 nvlog full susp msecs 0.00 nvlh susp msecs 674426 buffers RAID Statistics (per second) 192.87 xors 0.00 long dispatches [0] 0.00 long consumed [0] 0.00 long consumed hipri [0] 0.00 long low priority [0] 0.00 long high priority [0] 99.95 long monitor tics [0] 0.02 long monitor clears [0] 0.00 long dispatches [1] 0.00 long consumed [1] 0.00 long consumed hipri [1] 0.00 long low priority [1] 99.95 long high priority [1] 99.95 long monitor tics [1] 0.02 long monitor clears [1] 18 max batch 0.83 blocked mode xor 59.59 timed mode xor 0.79 fast adjustments 0.72 slow adjustments 0 avg batch start 0 avg stripe/msec 0.00 checksum dispatches 0.00 checksum consumed 2.71 tetrises written 0.00 master tetrises 0.00 slave tetrises 131.92 stripes written 61.51 partial stripes 70.42 full stripes 956.22 blocks written 249.18 blocks read 3.84 1 blocks per stripe size 6 2.95 2 blocks per stripe size 6 3.39 3 blocks per stripe size 6 5.21 4 blocks per stripe size 6 12.28 5 blocks per stripe size 6 41.45 6 blocks per stripe size 6 3.28 1 blocks per stripe size 12 1.77 2 blocks per stripe size 12 1.43 3 blocks per stripe size 12 1.48 4 blocks per stripe size 12 1.64 5 blocks per stripe size 12 1.73 6 blocks per stripe size 12 1.87 7 blocks per stripe size 12 2.19 8 blocks per stripe size 12 3.24 9 blocks per stripe size 12 4.93 10 blocks per stripe size 12 10.28 11 blocks per stripe size 12 28.97 12 blocks per stripe size 12 Network Interface Statistics (per second) iface side bytes packets multicasts errors collisions pkt drops e0a recv 2888.25 23.54 9.95 0.00 0.00 xmit 7684.74 11.74 0.00 0.00 0.00 e0b recv 0.00 0.00 0.00 0.00 0.00 xmit 0.00 0.00 0.00 0.00 0.00 e0c recv 0.00 0.00 0.00 0.00 0.00 xmit 0.00 0.00 0.00 0.00 0.00 e0d recv 0.00 0.00 0.00 0.00 0.00 xmit 0.00 0.00 0.00 0.00 0.00 e0M recv 813.00 9.97 9.95 0.00 0.00 xmit 1.91 0.02 0.00 0.00 0.00 e0P recv 32.50 0.33 0.05 0.00 0.00 xmit 25.48 0.32 0.00 0.00 0.00 Disk Statistics (per second) ut% is the percent of time the disk was busy. xfers is the number of data-transfer commands issued per second. xfers = ureads + writes + cpreads + greads + gwrites chain is the average number of 4K blocks per command. usecs is the average disk round-trip time per 4K block. disk ut% xfers ureads--chain-usecs writes--chain-usecs cpreads-chain-usecs greads--chain-usecs gwrites-chain-usecs /aggr0/plex0/rg0: 0a.00.12 3 4.46 0.34 1.21 4406 2.36 24.68 237 1.76 18.09 465 0.00 .... . 0.00 .... . 0a.00.14 4 4.63 0.34 1.21 3942 2.55 22.98 256 1.74 17.55 619 0.00 .... . 0.00 .... . 0a.00.16 27 77.31 74.74 28.58 206 1.53 31.88 584 1.05 10.42 1715 0.00 .... . 0.00 .... . 0a.00.18 26 75.76 73.77 28.40 202 1.28 38.01 541 0.70 13.94 1377 0.00 .... . 0.00 .... . 0a.00.20 25 76.02 73.92 27.85 199 1.36 34.88 567 0.73 14.95 1208 0.00 .... . 0.00 .... . 0a.00.23 26 75.94 73.92 27.05 210 1.33 36.15 592 0.69 14.63 1233 0.00 .... . 0.00 .... . 0a.00.0 25 75.77 73.66 27.14 209 1.37 35.08 566 0.73 14.08 1387 0.00 .... . 0.00 .... . 0a.00.2 26 76.52 74.47 26.90 213 1.30 36.47 583 0.76 15.45 1224 0.00 .... . 0.00 .... . 0a.00.4 26 76.12 74.05 27.00 215 1.34 36.30 571 0.72 14.65 1332 0.00 .... . 0.00 .... . 0a.00.6 25 75.77 73.69 26.98 208 1.35 35.64 540 0.74 14.91 1117 0.00 .... . 0.00 .... . 0a.00.15 25 75.82 73.66 27.11 207 1.41 34.35 605 0.76 13.79 1353 0.00 .... . 0.00 .... . 0a.00.17 25 74.92 72.83 27.37 197 1.36 35.49 550 0.73 14.55 1220 0.00 .... . 0.00 .... . 0a.00.19 25 75.90 73.83 26.97 209 1.36 35.46 551 0.70 14.22 1349 0.00 .... . 0.00 .... . 0a.00.21 26 76.11 73.93 27.08 214 1.43 33.78 629 0.74 15.41 1248 0.00 .... . 0.00 .... . /aggr0/plex0/rg1: 0a.00.1 2 2.86 0.00 .... . 1.10 58.36 204 1.76 16.92 380 0.00 .... . 0.00 .... . 0a.00.3 2 2.86 0.00 .... . 1.11 57.65 205 1.75 16.65 412 0.00 .... . 0.00 .... . 0a.00.5 41 108.97 106.56 28.74 282 1.58 35.00 725 0.84 14.03 1660 0.00 .... . 0.00 .... . 0a.00.8 41 107.41 105.23 29.01 282 1.46 38.45 655 0.72 13.99 1525 0.00 .... . 0.00 .... . 0a.00.7 42 108.49 106.29 28.68 286 1.45 38.69 661 0.75 14.26 1500 0.00 .... . 0.00 .... . 0a.00.9 42 108.63 106.51 28.68 284 1.42 39.58 639 0.71 14.56 1504 0.00 .... . 0.00 .... . 0a.00.10 42 108.99 106.83 28.59 285 1.46 39.08 660 0.71 13.81 1622 0.00 .... . 0.00 .... . 0a.00.11 42 108.97 106.75 28.57 284 1.47 38.05 694 0.75 14.19 1609 0.00 .... . 0.00 .... . /aggr0_shelf_02/plex0/rg0: 0b.02.0 1 0.80 0.00 .... . 0.36 16.31 526 0.44 14.99 661 0.00 .... . 0.00 .... . 0b.02.21 1 0.89 0.00 .... . 0.54 11.58 874 0.35 14.66 747 0.00 .... . 0.00 .... . 0b.02.1 1 0.90 0.10 1.65 10440 0.28 8.62 1055 0.52 5.42 1838 0.00 .... . 0.00 .... . 0b.02.22 0 0.37 0.11 1.57 8229 0.10 23.20 449 0.16 13.74 594 0.00 .... . 0.00 .... . 0b.02.2 0 0.38 0.11 2.13 9118 0.11 21.34 409 0.16 11.65 732 0.00 .... . 0.00 .... . 0b.02.3 0 0.38 0.10 1.12 18561 0.10 21.12 479 0.18 13.68 625 0.00 .... . 0.00 .... . 0b.02.4 0 0.46 0.17 1.01 6670 0.11 21.89 510 0.18 14.42 601 0.00 .... . 0.00 .... . 0b.02.5 0 0.37 0.08 1.05 18182 0.11 21.09 441 0.18 12.53 741 0.00 .... . 0.00 .... . 0b.02.6 0 0.49 0.18 1.62 6281 0.12 19.59 457 0.19 12.02 778 0.00 .... . 0.00 .... . 0b.02.7 0 0.44 0.14 2.03 6007 0.11 20.61 460 0.19 10.85 876 0.00 .... . 0.00 .... . 0b.02.8 0 0.36 0.09 1.00 19163 0.10 22.37 423 0.17 13.46 652 0.00 .... . 0.00 .... . 0b.02.9 0 0.39 0.13 1.00 11938 0.11 20.70 541 0.15 13.84 589 0.00 .... . 0.00 .... . 0b.02.10 0 0.52 0.24 1.00 5958 0.11 21.53 526 0.18 11.94 790 0.00 .... . 0.00 .... . 0b.02.11 0 0.42 0.15 2.82 4529 0.11 20.09 500 0.16 13.05 655 0.00 .... . 0.00 .... . /aggr0_shelf_02/plex0/rg1: 0b.02.12 0 0.40 0.00 .... . 0.18 28.47 353 0.22 24.25 470 0.00 .... . 0.00 .... . 0b.02.20 0 0.40 0.00 .... . 0.18 27.59 336 0.22 25.12 440 0.00 .... . 0.00 .... . 0b.02.14 0 0.50 0.22 1.62 6247 0.11 21.35 660 0.17 13.39 1082 0.00 .... . 0.00 .... . 0b.02.15 0 0.38 0.10 1.02 17346 0.11 23.00 534 0.17 13.14 846 0.00 .... . 0.00 .... . 0b.02.16 0 0.61 0.34 1.48 4406 0.11 22.31 478 0.15 10.71 1137 0.00 .... . 0.00 .... . 0b.02.17 0 0.58 0.32 1.49 5464 0.11 23.49 570 0.16 13.20 992 0.00 .... . 0.00 .... . 0b.02.18 0 0.53 0.24 1.82 3683 0.11 22.00 479 0.17 13.46 868 0.00 .... . 0.00 .... . 0b.02.19 0 0.46 0.19 1.84 7322 0.12 20.85 548 0.16 13.03 883 0.00 .... . 0.00 .... . Aggregate statistics: Minimum 0 0.36 0.00 0.10 0.15 0.00 0.00 Mean 13 36.12 34.73 0.81 0.57 0.00 0.00 Maximum 42 108.99 106.83 2.55 1.76 0.00 0.00 Spares and other disks: 0a.01.2 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.6 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.4 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.0 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.22 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.20 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.5 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.11 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.23 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.7 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.13 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.15 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.01.19 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0b.02.13 0 0.00 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0.00 .... . 0a.01.16 0 0.00 0.00 . 0.00 iSCSI ops Interrupt Statistics (per second) 1318.74 int_0 5.68 int_1 1025.55 int_2 1011.73 int_3 27.50 int_6 9.34 Gigabit Ethernet (IRQ 8) 0.53 Gigabit Ethernet (IRQ 9) 0.00 RTC 0.00 IPI 999.48 Msec Clock 4398.55 total n1*>