Talk with fellow users about the multiple protocols supported by NetApp unified storage including SAN, NAS, CIFS/SMB, NFS, iSCSI, S3 Object, Fibre-Channel, NVMe, and FPolicy.
Talk with fellow users about the multiple protocols supported by NetApp unified storage including SAN, NAS, CIFS/SMB, NFS, iSCSI, S3 Object, Fibre-Channel, NVMe, and FPolicy.
Hi, I have used robocopy for CIFS data migration from old ONTAP (9.1P2) to new (9.11.1P7). After initial copy and incremental, I see the volume on the new system is taking almost 3.5 TB of extra space. Also the number of files in source volume is more than that in destination volume. There are no errors in robocopy and the summary shown everything copied. I have done random checks on folders on both sides they look good. This is really strange! ----------------------------------------------------------- SOURCE USAGE ---------------------------------------------------------------- source::> vol show-space cifs_data Vserver : source_cifs Volume : cifs_data Feature Used Used% -------------------------------- ---------- ------ User Data 4.24TB 28% Filesystem Metadata 5.68GB 0% Inodes 2.05GB 0% Snapshot Reserve 768GB 5% Deduplication 34.97GB 0% Snapshot Spill 350.4GB 2% Performance Metadata 580.3MB 0% Total Used 5.37TB 36% Total Physical Used 5.19TB 35% source::> vol show -vserver source_cifs -volume cifs_data -fields files vserver volume files -------- --------- -------- source_cifs cifs_data 31876696 ------------------------------------------------- DESTINATION USAGE ---------------------------------------- dest::> vol show-space -volume cifs_data Vserver : dest-cifs Volume : cifs_data Feature Used Used% -------------------------------- ---------- ------ User Data 7.63TB 51% Filesystem Metadata 3.01GB 0% Inodes 1.50GB 0% Snapshot Reserve 768GB 5% Performance Metadata 42.77GB 0% Total Used 8.42TB 56% Total Physical Used 8.23TB 55% dest::> vol show -vserver dest-cifs -volume cifs_data -fields files vserver volume files --------------- --------- -------- dest-cifs cifs_data 21251126 ---------------------------------------------------- ROBOCOPY command used -------------------------------------------------- robocopy /e /mir /copyall /r:0 /w:0 /ETA /mt:32 /sec /secfix /dcopy:t \\source_cifs\cifs_data$\ \\dest_cifs\cifs_data$\ Is storage showing wrong usage ? or is there any bug or issue with this ? Any help is appreciated. Thanks!
... View more
Hi! So far I have configured S3 buckets for FabricPool or Veeam environments with self-signed certificates. The thing is that given the multiple applications that my customers are starting to use with S3 repositories, they see that Netapp has this possibility and I would like to test a configuration to provide this service but installing external certificates, signed by external CA. I'm reading the documentation and as I'm not a great expert in certificate matters I don't get to understand how such a configuration would be done, what requirements I need and how to implement it. I am asking for help please to guide me in this process to understand if the steps are correct. First, I have to request a certificate signing request with “security certificate generate-csr -common-name myS3.mydomain.com....”. I understand that here you indicate the name that the S3 URL will have and the production domain that signs it. Is there any special purpose of the certificate to indicate? I have to return the CA root and intermediate certificates apart from the signed certificate for myS3.mydomain.com and install them for the created SVM S3. The following steps I know and I have no problem. Now, when the S3 Object Store has to be created, the command vserver object-store-server has to be given -certifiate-name, is the common name of the generated certificate indicated here? Then the bucket is created, the user and so on. In the client authentication part, from the machine you want to access the S3, is it necessary to install a certificate?, I understand that the validation is done by entering the URL and user's access key and secret key. I don't know if there is any limitation to implement this On-Premisse solution or any other issue that I am not taking into account. Thank you very much for your help.
... View more
I have a query regarding the compatibility between nfsd and glibc. In our system, we've upgraded glibc to version 2.40 and are using NFS version 2.1.1 with NFSv3. Previously, with glibc 2.23, everything was working fine, and we weren’t using libtirpc. However, after the glibc upgrade, libtirpc was included and enabled in NFS as well. Now, none of the NFS-related services (nfsd, rpc.statd, rpc.mountd, portmap) are running. When attempting to start nfsd, the following errors occur: "unable to set any sockets for nfsd" "writing fd to kernel failed: errno 89 (Destination address required)" or "errno 111 (Connection refused)" Console logs show: "svc: failed to register nfsdv3 RPC service (errno 111)." After upgrading glibc, the --enable-obsolete-rpc option has been removed from glibc. Can anyone provide guidance on how to debug or resolve this issue?
... View more
I inherited administration of an offline domain environment with a NetApp (OnTap 9.11) and no dedicated NTP appliance Because the environment is offline, we have significant issues with time skew from the hardware. While we are looking for a better solution, at this stage we manage it by manually fixing the time roughly every month. It appears that this also led the to the previous administrators giving up on using CIFS shares. The shares exist and there is evidence they tried to make it work. But ultimately the shares are empty and other arrangements through Windows VM's are currently employed...all of which are on old OS's and need to be updated. I've been given the task of trying to fix things...and I really don't want to build new Windows servers and kick the can further down the road. The immediate issue is the time skew/sync. I want to use the domain controller as the NTP server, at least this way, the time skew *should* be the same on all devices The NetApp was already configured to use the DC as the NTP server, but it wasn't syncing. After a bit of a fight, using information from ONTAP 9 - time server rejected as unreliable - NetApp Knowledge Base. I did manage to get the NetApp to sync to the domain controller. 1 month later, go to fix the time skew. Domain controller: Time skew as expected NetApp: Time is still correct I can only surmise that this means that the NetApp is not continuously syncing with the Domain Controller. It got the time once and then just did its own thing. How can I force the NetApp to sync more often?
... View more
Hello all, I've been struggling to setup multipathing on an iSCSI boot LUN so after many days banging my head against a brick wall, I'm hoping somebody can point me in the right direction. Our development setup is as follows: FAS8200 running ONTAP 9.13.1P13 Cisco UCS X210c M7 blade server Oracle Linux 8.10 running 5.15.0-209.161.7.1.el8uek.x86_64 kernel Installation was fine, once I added ip=ibft to the boot command. I have setup two interfaces on the host and two on the FAS8200 vserver to cater for iSCSI and have established four paths: [root@vmhost-dev-b-02 ~]# iscsiadm --mode session tcp: [1] 10.31.5.101:3260,1026 iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 (non-flash) tcp: [2] 10.31.6.102:3260,1031 iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 (non-flash) tcp: [3] 10.31.6.101:3260,1030 iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 (non-flash) tcp: [4] 10.31.5.102:3260,1027 iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 (non-flash) I can see those sessions are logged on from the filer: fas8200a::> iscsi session show -vserver vsbidev1 -initiator-name iqn.2022-10.uk.ac.lboro:site-dev-b-iscsi-a:2 Tpgroup Initiator Initiator Vserver Name TSIH Name ISID Alias --------- ------- ---- ------------------------ --------- --------------------- vsbidev1 vsbidev1-01-a 2 iqn.2022-10.uk.ac.lboro:site-dev-b-iscsi-a:2 00:02:3d:00:00:01 vmhost-dev-b-02.lboro.ac.uk vsbidev1 vsbidev1-01-b 5 iqn.2022-10.uk.ac.lboro:site-dev-b-iscsi-a:2 00:02:3d:00:00:03 vmhost-dev-b-02.lboro.ac.uk vsbidev1 vsbidev1-02-a 2 iqn.2022-10.uk.ac.lboro:site-dev-b-iscsi-a:2 00:02:3d:00:00:04 vmhost-dev-b-02.lboro.ac.uk vsbidev1 vsbidev1-02-b 1 iqn.2022-10.uk.ac.lboro:site-dev-b-iscsi-a:2 00:02:3d:00:00:02 vmhost-dev-b-02.lboro.ac.uk 4 entries were displayed. Using NetApp's Linux Host Utilities I can see the LUN and four paths: [root@vmhost-dev-b-02 ~]# sanlun lun show controller(7mode/E-Series)/ device host lun vserver(cDOT/FlashRay) lun-pathname filename adapter protocol size product ---------------------------------------------------------------------------------------------------------- vsbidev1 /vol/vmhost_dev_b_02/rocky-dev-b-02 /dev/sdd host6 iSCSI 100g cDOT vsbidev1 /vol/vmhost_dev_b_02/rocky-dev-b-02 /dev/sdc host5 iSCSI 100g cDOT vsbidev1 /vol/vmhost_dev_b_02/rocky-dev-b-02 /dev/sdb host4 iSCSI 100g cDOT vsbidev1 /vol/vmhost_dev_b_02/rocky-dev-b-02 /dev/sda host3 iSCSI 100g cDOT But multipath refuses to see these devices as multipath devices: [root@vmhost-dev-b-02 ~]# multipath -l -v 3 Feb 13 14:26:14 | set open fds limit to 4096/262144 Feb 13 14:26:14 | loading /lib64/multipath/libchecktur.so checker Feb 13 14:26:14 | checker tur: message table size = 3 Feb 13 14:26:14 | loading /lib64/multipath/libprioconst.so prioritizer Feb 13 14:26:14 | foreign library "nvme" loaded successfully Feb 13 14:26:14 | sda: size = 209715200 Feb 13 14:26:14 | sda: vendor = NETAPP Feb 13 14:26:14 | sda: product = LUN C-Mode Feb 13 14:26:14 | sda: rev = 9131 Feb 13 14:26:14 | sda: h:b:t:l = 3:0:0:0 Feb 13 14:26:14 | sda: tgt_node_name = iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 Feb 13 14:26:14 | sdb: size = 209715200 Feb 13 14:26:14 | sdb: vendor = NETAPP Feb 13 14:26:14 | sdb: product = LUN C-Mode Feb 13 14:26:14 | sdb: rev = 9131 Feb 13 14:26:14 | sdb: h:b:t:l = 4:0:0:0 Feb 13 14:26:14 | sdb: tgt_node_name = iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 Feb 13 14:26:14 | sdc: size = 209715200 Feb 13 14:26:14 | sdc: vendor = NETAPP Feb 13 14:26:14 | sdc: product = LUN C-Mode Feb 13 14:26:14 | sdc: rev = 9131 Feb 13 14:26:14 | sdc: h:b:t:l = 5:0:0:0 Feb 13 14:26:14 | sdc: tgt_node_name = iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 Feb 13 14:26:14 | sdd: size = 209715200 Feb 13 14:26:14 | sdd: vendor = NETAPP Feb 13 14:26:14 | sdd: product = LUN C-Mode Feb 13 14:26:14 | sdd: rev = 9131 Feb 13 14:26:14 | sdd: h:b:t:l = 6:0:0:0 Feb 13 14:26:14 | sdd: tgt_node_name = iqn.1992-08.com.netapp:sn.c052244ddc6a11eeb08a00a098d45a03:vs.7 Feb 13 14:26:14 | dm-0: device node name blacklisted Feb 13 14:26:14 | dm-1: device node name blacklisted Feb 13 14:26:14 | dm-2: device node name blacklisted ===== paths list ===== uuid hcil dev dev_t pri dm_st chk_st vend/prod/rev dev_st 3:0:0:0 sda 8:0 -1 undef undef NETAPP,LUN C-Mode unknown 4:0:0:0 sdb 8:16 -1 undef undef NETAPP,LUN C-Mode unknown 5:0:0:0 sdc 8:32 -1 undef undef NETAPP,LUN C-Mode unknown 6:0:0:0 sdd 8:48 -1 undef undef NETAPP,LUN C-Mode unknown Feb 13 14:26:14 | libdevmapper version 1.02.181-RHEL8 (2021-10-20) Feb 13 14:26:14 | DM multipath kernel driver v1.14.0 Feb 13 14:26:14 | unloading const prioritizer Feb 13 14:26:14 | unloading tur checker I suspect the issue has something to do with the fact that root is sitting on this disk which is preventing is being changed. I've read suggestions that I need to enable multipathing at boot time and change the paths to the various partitions but I'm not sure if that will work or not. Any help or guidance would be gratefully received. Regards, Mark
... View more