Community

Subscribe

Re: FAS6280. Disappointing performance?

You will never be able to max out system with single single-stream command like dd. You need multiple concurrent IO streams for this.

Re: FAS6280. Disappointing performance?

Aborzenkov,

thanks for your input, but why then if I setup normal server with Windows 2008 (physical one), and connect from another server via \\servername\c$, and get a file (or write a file), then I get speed 100-120MB/s constantly? I often get that question from my customers, and I can't really explain that behavior.

Do you have valid explanation to that? I would appreciate it - maybe i would understand that more

Re: FAS6280. Disappointing performance?

This might be a matter of window size or packet size of your LAN connection or the NIC itself. Test your network connection with iperf using smaller and greater window size (parameter -w4K and -w128K). With 4k you get 300Mbps, while with 128k almost a full bandwidth. Moreover, non-server (ex. laptop) 1Gbps NICs can't usually do better then 400mbps. BTW, the interesting thing you achieve 100MB/s with Windows 2008. We can't get so much with 2003.

Paweł

Highlighted

Re: FAS6280. Disappointing performance?

I am glad you started understanding the netapp systems

Now to tune your filer further you can look at some other area like.
Try looking at the way files are organized and accessed by application, as a wildcard search or big/deep directory listings are very memory intensive and can easily bring your filer to it's knees and when you say you need to host billions of files you have to be very careful as you need to have a good design in place so your host OS limitations as well filer limitations are well understood, like filename, directory structure, number of files in a directory, number of files on a system and yada yada. As everytime you store a file/directory  the inode and metadata information get's associated with it and for reading a file or directory all the details needs to be loaded in memorry, thought it depends of application working pattern however this puts a big load on server.
So, if you haven't done any design work on file/directory layout, I would strongly suggest you to get a consultant engaged and ask them to help you in designing the structure.
Cheers!

Re: FAS6280. Disappointing performance?

Couple of things, we've been playing around with the 6280's for 3 or 4 months, and i have to say we've seen pretty spetacular NFS performance with them (peak 2.5-3GB/s off disk much higher off cache) and about 1GB/s straight onto disk. (144 spindles)

Couple of things, firstly sysstat -M 1 doesnt really work anymore, i'm assuming its because alot of the subsystems now reside in BSD,  things like networking, raid and wafl (i believe, dont quote me on that)

Effectively with the way NVRAM is deployed you'll only get the benefit if you were running single systems i've been told that with clustering you're getting 2GB per head with the mirroring which will stay the same with the upgrade. you'll have 4Gb to play with single node.

with 1TB of PAM in there, the access to another 48Gb of memory probably isnt going to make a difference majorly to throughput.

A statit will give you much better/accurate information about how the cores are loaded up.

We personally havent been able to break it (other than a few software bugs we found in testing) we find the performance is pretty linear even with a couple of thousand workstations hammer a single node (deliberating trying to kill the node), obviously the total single node throughput decreases but the response times were very good.

A perfstat and/or a statit would help.

Re: FAS6280. Disappointing performance?

Most likely, the stack is also important Win2k8 is the first windows OS in years that can efficently use its tcp stack. Hence the massive network performance improvement.

Re: FAS6280. Disappointing performance?

Re the TOE thing, i heard there were driver dramas. Again its all just hearsay.  We've been using TOE on our 6080's for quite a while, for us it was the difference between it bottoming out at about 400MB/s and sustained 700MB/s with line speed peaks. the biggest pain with TOE was the lack of trunk support, we used RR DNS to work around it which wasnt to bad.

We're still trying to see whats going on with 8.0.1 and stateless offload, it seems interesting but we cant really measure the improvement. To be honest we havent tried, but we probably should one day.

Re: FAS6280. Disappointing performance?

Could you show the exact dd command you used as well as NFS mount options?

Re: FAS6280. Disappointing performance?

well, dd command is pretty common:

dd if=/dev/zero of=/tmp/testfile bs=1M count=2000

creates 2gb file

nfs mount is from ESX host, so basically default one, but we also did the same test on following nfs mount (physical linux server):

netapp:/vol/nfs1   /vhosts nfs     defaults,noatime,hard,intr     0  0

Re: FAS6280. Disappointing performance?

Hi marek, i've launched 17 streams of dd from 17 different servers against the 6280, and i've reached 408MByte/sec writing, and 621MByte/sec reading. I have to say that our FAS is not optimized for throughtput but just for random IOs and doesn't have many disks loops (two controllers are installed in different places so we need to reduce fiber patches). This caused a B in sysstat CP field.

Probably with an higher number of loops performance could be increased.

Lorenzo.