Hi Team,
I am trying to track down an issue that is happening on different servers on a semi-regular basis. We use the osimis/orthanc
docker image and are currently using the latest (23.7.1) that receives scans from CTs or Xray devices. These are then forwarded to an Orthanc peer using the Accelerated Transfers plugin.
What is happening is that when a push transfer is started, then POST to /transfers/send
times out and then any further request to /jobs
also times out.
The only way I’ve been able to recover from this is to restart Orthanc, at which time the transfer is started again by sending a post to /transfers/send
and the scan is then successfully transferred.
I’ve been able to capture this with trace logs on, but there’s nothing obvious in the logs.
I’ve added 2 logs to this gist Orthanc Accelerated Transfers Frozen Transfer · GitHub
In the log of the unsuccessful transfer, the last entry before it appears to become unresponsive is New job submitted with priority 0: e72c0d9c-ab83-402b-b3c3-4fbe3f587e24
(line 81 @ 08:52:26.889859). At which point there are no more logs until I manually check the health of the orthanc system @ 08:54:11.814665 by calling /system
which works and /jobs
which timeout.
I’m currently rolling back to an older release to see if it related to a newer release. Unfortunately I can’t replicate the issue.
If there is any further advice on how I can pinpoint the issue, it would be greatly appreciated!
The config file for the system that is experiencing this issue is
{
"Transfers": {
"MaxHttpRetries": 2,
"BucketSize": 20000
},
"RegisteredUsers": {
},
"PostgreSQL": {
"Database": "...",
"Username": "...",
"Host": "...",
"EnableIndex": true,
"Password": "...",
"EnableStorage": false,
"Port": 5432,
"EnableSsl": false,
"Lock": false
},
"PythonScript": "/var/lib/orthanc/python/orthanc.py",
"OrthancPeers": {
"PEER": [
"http://x.x.x.x:8042/"
]
},
"DicomModalities": {
"MODALITY": [
"AET",
"x.x.x.x",
104
]
},
"StableAge": 30,
"AuthenticationEnabled": true,
"DicomPort": 104,
"HttpTimeout": 300,
"OverwriteInstances": true,
"Name": "Name",
"MaximumStorageSize": 40920,
"StorageDirectory": "/var/lib/orthanc/db",
"RemoteAccessAllowed": true,
"HttpsCACertificates": "/etc/ssl/certs/ca-certificates.crt",
"Plugins": [
"/run/orthanc/plugins",
"/usr/share/orthanc/plugins"
],
"DicomWeb": {
"Enable": true
},
"Gdcm": {
"Throttling": 4,
"RestrictTransferSyntaxes": [
"1.2.840.10008.1.2.4.90",
"1.2.840.10008.1.2.4.91",
"1.2.840.10008.1.2.4.92",
"1.2.840.10008.1.2.4.93"
]
},
"OrthancExplorer2": {
"Enable": true,
"IsDefaultOrthancUI": false
}
}