OnPrem S3 Connection to Gitlab Instance for GitLFS

Thomas_B — Wed, 04 Jun 2025 10:08:20 GMT

Hello,

I try to connect our OnPrem NetApp with our OnPrem Gitlab Instance with S3:

https://docs.gitlab.com/ee/administration/object_storage.html

The GitLab config:
gitlab_rails['object_store']['connection'] = {
'provider' => 'AWS',
'aws_access_key_id' => [hide]
'aws_secret_access_key' => [hide]
'endpoint' => 'https://[hide]',
'enable_signature_v4_streaming' => false,
'region' => 'us-east-1',
'path_style' => true
}

Gitlab logs following error:
<?xml version=\"1.0\" encoding=\"UTF-8\"?><Error><Code>NotSupported</Code><Message>The header x-amz-copy-source implies functionality that is not supported.</Message></Error>

Seems GitLab tries to move/rename temporary file on Storage:
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9AF8P7THZRN6CHXRJA1V7","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170705-28097-0001-1118-3e4ae001c3d945ee86dbde090298ff3e","remote_temp_object":"tmp/uploads/1638170705-28097-0001-1118-3e4ae001c3d945ee86dbde090298ff3e","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:05Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9AGK9Z5WX463PZH2R63DW","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170706-28450-0001-9553-94b6bc876eec8133f8bfd74251de4423","remote_temp_object":"tmp/uploads/1638170706-28450-0001-9553-94b6bc876eec8133f8bfd74251de4423","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:07Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9AKMWCZMDRR6GQ8T3XW4P","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170709-28450-0002-8570-27fedeb6b8c584d808957c57e4bbe3ce","remote_temp_object":"tmp/uploads/1638170709-28450-0002-8570-27fedeb6b8c584d808957c57e4bbe3ce","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:09Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9AQXSKP8XGZMVH2CYPKK6","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170714-28450-0003-9007-b6a7ba3c7acba900bf3c0d30fd91ace8","remote_temp_object":"tmp/uploads/1638170714-28450-0003-9007-b6a7ba3c7acba900bf3c0d30fd91ace8","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:14Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9B068Q8KEF1QHNEX1VN6V","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170722-28097-0002-2422-17b7a2726f6511400ae3d2fa3f9d2ebe","remote_temp_object":"tmp/uploads/1638170722-28097-0002-2422-17b7a2726f6511400ae3d2fa3f9d2ebe","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:22Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9BAAM7RD3XH9B2FHGKBC6","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170732-28097-0003-4838-c046a6b0fb984c99fc9062e248aabbbf","remote_temp_object":"tmp/uploads/1638170732-28097-0003-4838-c046a6b0fb984c99fc9062e248aabbbf","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:32Z"}
{"client_mode":"s3","copied_bytes":11,"correlation_id":"01FNN9BMC8W2BSB7AWVA8TYS61","is_local":false,"is_multipart":true,"is_remote":true,"level":"info","msg":"saved file","remote_id":"1638170743-28097-0004-4456-2d9ee2643427a1da97a69694f2db9a68","remote_temp_object":"tmp/uploads/1638170743-28097-0004-4456-2d9ee2643427a1da97a69694f2db9a68","temp_file_prefix":"821cb29737c23ad8e3b6e930558a6e06643361bf33c85efdf77cbc9bc423cbea","time":"2021-11-29T07:25:43Z"}

Is the header "x-amz-copy-source" not supported at all?

Re: OnPrem S3 Connection to Gitlab Instance for GitLFS

ThomasB2 — Wed, 15 Dec 2021 09:34:55 GMT

Thanks, but unfortunately we using ONTAP in version 9.9 and related to this:
https://docs.netapp.com/us-en/ontap/s3-config/ontap-s3-supported-actions-reference.html#object-operations
The supported header is not supported yet, but seems it will be supported in upcoming version 9.10.

topic Re: OnPrem S3 Connection to Gitlab Instance for GitLFS in Object Storage

OnPrem S3 Connection to Gitlab Instance for GitLFS

Re: OnPrem S3 Connection to Gitlab Instance for GitLFS

Re: OnPrem S3 Connection to Gitlab Instance for GitLFS