ONTAP Discussions

KV Cache offloading in AI

Jackiez
160 Views

Hi, Expert,

 

      Weka mentioned they had AI KV Cache offloading fuction/solution called AMG (augmented memory grid).  I'm not sure it's new or just  decoration based on GDS.   Can ONTAP do KV Cache offloading or  is it just the capability from GDS stack ?

 

    Rgds,

    Jackie

0 REPLIES 0
Public