topic Re: Dirs with large number files (100k) too slow for backup - NDMP OK?? in Network and Storage Protocols https://community.netapp.com/t5/Network-and-Storage-Protocols/Dirs-with-large-number-files-100k-too-slow-for-backup-NDMP-OK/m-p/71742#M6520 <HTML><HEAD></HEAD><BODY><P>I wouldn't expect this for only 100K files, but the behavior is pretty typical, and not at all unique to NetApp.&nbsp; If you put a bunch of small files anywhere you'll get similar results.&nbsp; It's an issue with the filesystem trying to scan the number of inodes.</P><P></P><P>Bill</P></BODY></HTML> Tue, 03 Dec 2013 23:53:06 GMT billshaffer 2013-12-03T23:53:06Z Dirs with large number files (100k) too slow for backup - NDMP OK?? https://community.netapp.com/t5/Network-and-Storage-Protocols/Dirs-with-large-number-files-100k-too-slow-for-backup-NDMP-OK/m-p/71737#M6519 <HTML><HEAD></HEAD><BODY><P>Problem :&nbsp; Backing up dirs with 100,000 small files fails.&nbsp; Using NetBackup and backing them up as NFS mounts on the Linux box&nbsp; times out. Tested NetBackup timeout settings extensively they still fail. Listing an individual file is OK but listing the entire contents suing the ls command is very slow&nbsp; [ 7-10 mins].&nbsp; This explains why the backups fail. Backing up the same data using NDMP via NetBackup is a respectable ~100MB/s.&nbsp; </P><P></P><P>My understanding NetApp and a 100,00 small files while always exhibit this slow behaviour - true? Any technotes on this?&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; </P></BODY></HTML> Thu, 05 Jun 2025 05:48:13 GMT https://community.netapp.com/t5/Network-and-Storage-Protocols/Dirs-with-large-number-files-100k-too-slow-for-backup-NDMP-OK/m-p/71737#M6519 JM01JM01 2025-06-05T05:48:13Z Re: Dirs with large number files (100k) too slow for backup - NDMP OK?? https://community.netapp.com/t5/Network-and-Storage-Protocols/Dirs-with-large-number-files-100k-too-slow-for-backup-NDMP-OK/m-p/71742#M6520 <HTML><HEAD></HEAD><BODY><P>I wouldn't expect this for only 100K files, but the behavior is pretty typical, and not at all unique to NetApp.&nbsp; If you put a bunch of small files anywhere you'll get similar results.&nbsp; It's an issue with the filesystem trying to scan the number of inodes.</P><P></P><P>Bill</P></BODY></HTML> Tue, 03 Dec 2013 23:53:06 GMT https://community.netapp.com/t5/Network-and-Storage-Protocols/Dirs-with-large-number-files-100k-too-slow-for-backup-NDMP-OK/m-p/71742#M6520 billshaffer 2013-12-03T23:53:06Z