Subscribe

Is NAS suitable for WEB application with million of small files and directories?

Hi all,

I have a potential customer asking to migrate the existing Window Web applications with data running in local disks to NAS.

Background:

- Using DFS technology as the file synchronization amongst the 6-7 application servers

- Over 20M objects (including files and folders)

- Over 500G+ disk space

Below is the info from the customer :

we try to robocopy (including list and data sync) one of the drive and we find the following result
- only one robocopy (single thread)
- size of this drive is ~ 380G
- # of Directory is ~ 11.1M and # of File is ~ 12.7M
- Daily change vol < 2.1G for this drive
- Time required to sync ~ 12 hr

The sales has proposed a FAS2050 in Prod and FAS2020 in DR. Is this good enough?

Also, they only have 2  hours downtime for the data migration. Is robocopy the only way can do ?

Regards,

Terrence

Re: Is NAS suitable for WEB application with million of small files and directories?

tatlee wrote:

we try to robocopy (including list and data sync) one of the drive and we find the following result
- only one robocopy (single thread) Regards,

the tool (in windows environments) you want is not robocopy but "richcopy" as it is multithreaded and fully supports NTFS ACLs

regards, ml

Re: Is NAS suitable for WEB application with million of small files and directories?

tatlee wrote:

The sales has proposed a FAS2050 in Prod and FAS2020 in DR. Is this good enough?

The downside of a fas2050 and fas2020 is that they do not support ontap 8. That does not need to be problem, but you should be aware that you never will be able to use the newest features released in ontap 8. Alternative filer would be the fas2040, which is also a bit more powerfull.

Re: Is NAS suitable for WEB application with million of small files and directories?

Robocopy in Windows 7 and Windows 2008 R2 now supports the MT flag for multithreading.

http://blog.fosketts.net/2010/03/25/robocopy-multi-threaded/