Configuration for using S3 bucket of cloud provider which is not AWS, Azure or GCP

General
1

Greetings everyone,

We are using the docker image orthancteam/orthanc:25.2.0-full. Docker verison used is 26.1.3. Kubernetes version used is 1.29.5. We need to use S3 bucket provided by Tata Communications Cloud. It is S3 compatible. Started with the following config

“AwsS3Storage” : {
“BucketName”: “<bucket_name>”,
“Region”: “us-east-1”,
“AccessKey”: “<access_key>”,
“SecretKey”: “<secret_key>”,
“Endpoint”: “<endpoint_url>”,
“ConnectionTimeout”: 300, // optional: connection timeout in seconds
“RequestTimeout”: 1200, // optional: request timeout in seconds (max time to upload/download a file)
“RootPath”: “”, // optional: see below
“MigrationFromFileSystemEnabled”: false, // optional: see below
“StorageStructure”: “flat”, // optional: see below
“EnableLegacyUnknownFiles”: true, // optional: see below
“EnableAwsSdkLogs”: true
},

When tried to upload a scan got the following error

curlCode: 6, Couldn’t resolve host name

Then changed the config to following where I replaced Endpoint key with HostName key.

“AwsS3Storage” : {
“BucketName”: “<bucket_name>”,
“Region”: “us-east-1”,
“AccessKey”: “<access_key>”,
“SecretKey”: “<secret_key>”,
“HostName”: “<endpoint_url>”,
“ConnectionTimeout”: 300, // optional: connection timeout in seconds
“RequestTimeout”: 1200, // optional: request timeout in seconds (max time to upload/download a file)
“RootPath”: “”, // optional: see below
“MigrationFromFileSystemEnabled”: false, // optional: see below
“StorageStructure”: “flat”, // optional: see below
“EnableLegacyUnknownFiles”: true, // optional: see below
“EnableAwsSdkLogs”: true
},

Then getting the following error

“response code = 403 InvalidAccessKeyId The AWS Access Key Id you provided does not exist in our records.”

Attaching few of the logs when starting up orthanc

AWS S3 Storage plugin is initializing
W0527 07:25:47.011447 MAIN AWS S3 Storage:/StoragePlugin.cpp:619] AWS S3 Storage: HybridMode is disabled: writing to object-storage and reading only from object-storage
E0527 07:25:47.018220 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSConfigFileProfileConfigLoaderInitializing config loader against fileName /root/.aws/credentials and using profilePrefix = 0
E0527 07:25:47.018250 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSConfigFileProfileConfigLoaderInitializing config loader against fileName /root/.aws/config and using profilePrefix = 1
E0527 07:25:47.018271 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSConfigFileProfileConfigLoaderUnable to open config file /root/.aws/credentials for reading.
E0527 07:25:47.018277 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSProfileConfigLoaderBaseFailed to reload configuration.
E0527 07:25:47.018288 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSConfigFileProfileConfigLoaderUnable to open config file /root/.aws/config for reading.
E0527 07:25:47.018292 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] Aws::Config::AWSProfileConfigLoaderBaseFailed to reload configuration.
E0527 07:25:47.018882 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientUsing IMDS endpoint:
E0527 07:25:47.018952 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] ClientConfigurationRetry Strategy will use the default max attempts.
E0527 07:25:47.019001 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientCreating AWSHttpResourceClient with max connections 2 and scheme http
E0527 07:25:47.019319 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHandleContainerInitializing CurlHandleContainer with size 2
E0527 07:25:47.019379 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] ClientConfigurationRetry Strategy will use the default max attempts.
E0527 07:25:47.019477 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHandleContainerPool grown by 2
E0527 07:25:48.020858 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:48.020932 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
W0527 07:25:48.020943 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:470] EC2MetadataClientRequest failed, now waiting 0 ms before attempting again.
E0527 07:25:49.022388 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:49.022460 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
E0527 07:25:49.022473 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientCan not retrieve resource from
E0527 07:25:50.023848 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:50.023920 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
W0527 07:25:50.023930 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:470] EC2MetadataClientRequest failed, now waiting 0 ms before attempting again.
E0527 07:25:51.025388 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:51.025460 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
E0527 07:25:51.025474 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientCan not retrieve resource from
E0527 07:25:52.026845 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:52.026925 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
W0527 07:25:52.026937 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:470] EC2MetadataClientRequest failed, now waiting 0 ms before attempting again.
E0527 07:25:53.028381 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHttpClientCurl returned error code 28 - Timeout was reached
E0527 07:25:53.028472 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientHttp request to retrieve credentials failed
E0527 07:25:53.028486 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientCan not retrieve resource from
E0527 07:25:53.028495 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] EC2MetadataClientUnable to pull region from instance metadata service
E0527 07:25:53.032364 MAIN AWS S3 Storage:/AwsS3StoragePlugin.cpp:474] CurlHandleContainerInitializing CurlHandleContainer with size 25

Kindly help us resolve this issue. What would be the change required to use this s3 bucket

I had installed aws cli 2.15.58 inside the orthanc pod and configured with same accesss key, secret key and region provided and was able to upload some folders into the bucket.

2

Hi,

“HostName” is not a valid config, you need to use “Endpoint”.

The EndPoint configuration is used when accessing an S3 compatible cloud provider. I.e. here is a configuration to store data on Scaleway:

 "AwsS3Storage" : {
   "BucketName": "test-orthanc",
   "Region": "fr-par",
   "AccessKey": "XXX",
   "SecretKey": "YYY",
   "Endpoint": "s3.fr-par.scw.cloud"
 }

Concerning other S3 providers, on my side, we have only tested it with minio.

Hope this helps,

Alain