You did not provide any details of the config or how you are using IOmeter.
How is your aggr designed? NAS or SAN? If NAS, using FlexGroups? If not, why not?
ONTAP version? Network setup? Jumbo frames?
Any possible network errors?
Give us something to work with.