I am not sure whether this qualifies as “have to”, but if you use dedupe, you have less physical blocks to access and they likely are accessed more frequently, which means they have better chances to be cached by PAM.
OTOH, someone (may be, it was you – sorry, do not remember) reported that running A-SIS trashed PAM. If this is really true, and it happens with flexscale.lopri_blocks off, it looks more like a bug – for me A-SIS job definitely qualifies as low priority w.r.t. PAM caching.