topic Re: Imbalanced node storage consumption in Object Storage

Imbalanced node storage consumption

JFM — Thu, 06 Jun 2024 18:15:05 GMT

In an SG GRID, there are 8 nodes, 4 are 5712, and 4 are 5760, all in the same storage pool, 2 buckets created, one for FabricPool and the other for Commvault backup destination. EC 2+1 used in the two buckets.

We noticed in recent days that one of the SG5712 node is reaching 93% while the other are around 57-70% used... SG5760 nodes are at 30% or a little bit less.

How is SG balancing the writes? Why is one node approaching 100% faster than the others?

Re: Imbalanced node storage consumption

Amitra — Fri, 07 Jun 2024 02:13:20 GMT

HI @JFM ,

As per documentation, What are erasure coding schemes?

Erasure-coding scheme (k+m)	Minimum number of deployed sites	Recommended number of Storage Nodes at each site	Total recommended number of Storage Nodes	Site loss protection?	Storage overhead
2+1	3	3	9	Yes	50%

Its recommended to have 9 nodes to balance the Erasure Coding. Considering your current ILM and number of nodes, its expected one of the node may get over utilized.

Also, SG5760 are having higher disk capacity, hence, its expected their utilization will be lesser as compared to SG5712.

You may consider Rebalance using below documentation:

https://docs.netapp.com/us-en/storagegrid-117/expand/considerations-for-rebalancing-erasure-coded-data.html

https://docs.netapp.com/us-en/storagegrid-117/expand/rebalancing-erasure-coded-data-after-adding-storage-nodes.html

Re: Imbalanced node storage consumption

JFM — Mon, 10 Jun 2024 12:29:55 GMT

Thanks.

Re: Imbalanced node storage consumption

JFM — Mon, 10 Jun 2024 13:50:00 GMT

I forgot to mention that we are in a single site configuration, not a multisite configuration. Would the answer be the same?

Re: Imbalanced node storage consumption

Amitra — Tue, 11 Jun 2024 00:06:09 GMT

HI @JFM ,

Yes. The number of nodes will determine how balanced the ILM policy is along with their capacity. As recommended, you can try to perform rebalance to see if it helps the affected node.