Failed jobs do not become expired to allow you to re-queue them without any
time pressure. You should re-queue or delete them manually, or apply AutomaticRetry(OnAttemptsExceeded = AttemptsExceededAction.Delete)
attribute to delete them automatically.
An exception occurred during performance of the job. Fewer details...
10/06/2026 13:06:06
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: Authentication failed, see inner exception.
---> Interop+OpenSsl+SslException: SSL Handshake failed with OpenSSL error - SSL_ERROR_SSL.
---> Interop+Crypto+OpenSslCryptographicException: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure
--- End of inner exception stack trace ---
at Interop.OpenSsl.DoSslHandshake(SafeSslHandlecontext, ReadOnlySpan`1input, Byte[]&sendBuf, Int32&sendCount)
at System.Net.Security.SslStreamPal.HandshakeInternal(SafeFreeCredentialscredential, SafeDeleteSslContext&context, ReadOnlySpan`1inputBuffer, Byte[]&outputBuffer, SslAuthenticationOptionssslAuthenticationOptions)
--- End of inner exception stack trace ---
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringcookie, BooleanisLive) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 145
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 59
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 44
at EP.BackgroundJobs.Engine.Jobs.WebhookJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/WebhookJob.cs:line 53
An exception occurred during performance of the job. More details...
10/06/2026 13:08:43
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: A task was canceled.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.InvestBankEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringscope, StringapiKey) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/InvestBankEventPusher.cs:line 132
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.InvestBankEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/InvestBankEventPusher.cs:line 60
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.InvestBankEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/InvestBankEventPusher.cs:line 45
at EP.BackgroundJobs.Engine.Jobs.InvestBankJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/InvestBankJob.cs:line 40
An exception occurred during performance of the job. More details...
10/06/2026 13:08:47
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 13:09:53
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: A task was canceled.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.CallBulkService(PerformContextcontext, Stringurl, MLAMessage[]message, Stringtoken, OracleConnectionconnection) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 165
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.SendMessages(List`1messages, WebhookCustomercustomer, PerformContextcontext, OracleConnectionconnection) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 135
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.SendBulkCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 108
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 39
at EP.BackgroundJobs.Engine.Jobs.MLACainiaoJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/MLACainiaoJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 13:23:02
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 13:38:32
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LandmarkJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LandmarkJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 13:40:17
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 13:53:32
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CBDJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 14:06:50
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: Authentication failed, see inner exception.
---> Interop+OpenSsl+SslException: SSL Handshake failed with OpenSSL error - SSL_ERROR_SSL.
---> Interop+Crypto+OpenSslCryptographicException: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure
--- End of inner exception stack trace ---
at Interop.OpenSsl.DoSslHandshake(SafeSslHandlecontext, ReadOnlySpan`1input, Byte[]&sendBuf, Int32&sendCount)
at System.Net.Security.SslStreamPal.HandshakeInternal(SafeFreeCredentialscredential, SafeDeleteSslContext&context, ReadOnlySpan`1inputBuffer, Byte[]&outputBuffer, SslAuthenticationOptionssslAuthenticationOptions)
--- End of inner exception stack trace ---
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringcookie, BooleanisLive) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 145
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 59
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 44
at EP.BackgroundJobs.Engine.Jobs.WebhookJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/WebhookJob.cs:line 53
An exception occurred during performance of the job. More details...
10/06/2026 14:11:54
System.Threading.Tasks.TaskCanceledException
The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
System.Threading.Tasks.TaskCanceledException: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
---> System.TimeoutException: A task was canceled.
---> System.Threading.Tasks.TaskCanceledException: A task was canceled.
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
--- End of inner exception stack trace ---
at System.Net.Http.HttpClient.HandleFailure(Exceptione, BooleantelemetryStarted, HttpResponseMessageresponse, CancellationTokenSourcects, CancellationTokencancellationToken, CancellationTokenSourcependingRequestsCts)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.CallBulkService(PerformContextcontext, Stringurl, MLAMessage[]message, Stringtoken, OracleConnectionconnection) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 165
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.SendMessages(List`1messages, WebhookCustomercustomer, PerformContextcontext, OracleConnectionconnection) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 135
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.SendBulkCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 108
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.MLACainiaoEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/MLACainiaoEventPusher.cs:line 39
at EP.BackgroundJobs.Engine.Jobs.MLACainiaoJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/MLACainiaoJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 14:12:17
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LastMileStatusUpdateJob.ProcessLastMileStatusUpdate' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LastMileStatusUpdateJob.ProcessLastMileStatusUpdate' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 15:05:38
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: Authentication failed, see inner exception.
---> Interop+OpenSsl+SslException: SSL Handshake failed with OpenSSL error - SSL_ERROR_SSL.
---> Interop+Crypto+OpenSslCryptographicException: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure
--- End of inner exception stack trace ---
at Interop.OpenSsl.DoSslHandshake(SafeSslHandlecontext, ReadOnlySpan`1input, Byte[]&sendBuf, Int32&sendCount)
at System.Net.Security.SslStreamPal.HandshakeInternal(SafeFreeCredentialscredential, SafeDeleteSslContext&context, ReadOnlySpan`1inputBuffer, Byte[]&outputBuffer, SslAuthenticationOptionssslAuthenticationOptions)
--- End of inner exception stack trace ---
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringcookie, BooleanisLive) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 145
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 59
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 44
at EP.BackgroundJobs.Engine.Jobs.WebhookJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/WebhookJob.cs:line 53
An exception occurred during performance of the job. More details...
10/06/2026 15:08:47
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LastMileStatusUpdateJob.ProcessLastMileStatusUpdate' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'LastMileStatusUpdateJob.ProcessLastMileStatusUpdate' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 15:48:29
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: The remote certificate is invalid because of errors in the certificate chain: UntrustedRoot
at System.Net.Security.SslStream.SendAuthResetSignal(ProtocolTokenmessage, ExceptionDispatchInfoexception)
at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptionssslAuthenticationOptions)
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringusername, Stringpassword) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 315
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 122
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 42
at EP.BackgroundJobs.Engine.Jobs.PTSJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/PTSJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 16:06:08
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: Authentication failed, see inner exception.
---> Interop+OpenSsl+SslException: SSL Handshake failed with OpenSSL error - SSL_ERROR_SSL.
---> Interop+Crypto+OpenSslCryptographicException: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure
--- End of inner exception stack trace ---
at Interop.OpenSsl.DoSslHandshake(SafeSslHandlecontext, ReadOnlySpan`1input, Byte[]&sendBuf, Int32&sendCount)
at System.Net.Security.SslStreamPal.HandshakeInternal(SafeFreeCredentialscredential, SafeDeleteSslContext&context, ReadOnlySpan`1inputBuffer, Byte[]&outputBuffer, SslAuthenticationOptionssslAuthenticationOptions)
--- End of inner exception stack trace ---
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringcookie, BooleanisLive) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 145
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 59
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 44
at EP.BackgroundJobs.Engine.Jobs.WebhookJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/WebhookJob.cs:line 53
An exception occurred during performance of the job. More details...
10/06/2026 16:06:28
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: The remote certificate is invalid because of errors in the certificate chain: UntrustedRoot
at System.Net.Security.SslStream.SendAuthResetSignal(ProtocolTokenmessage, ExceptionDispatchInfoexception)
at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptionssslAuthenticationOptions)
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringusername, Stringpassword) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 315
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 122
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 42
at EP.BackgroundJobs.Engine.Jobs.PTSJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/PTSJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 16:09:48
Hangfire.Storage.DistributedLockTimeoutException
Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CainiaoWebhookJob.ProcessCustomer' resource.
Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'CainiaoWebhookJob.ProcessCustomer' resource.
at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(Stringresource, TimeSpantimeout)
at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContextfilterContext)
at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1tuple)
at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstanceinstance, Func`2action, Stringmessage)
at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfilerprofiler, TInstanceinstance, Action`1action, Stringmessage)
at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilterfilter, PerformingContextpreContext, Func`1continuation)
An exception occurred during performance of the job. More details...
10/06/2026 16:49:58
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: The remote certificate is invalid because of errors in the certificate chain: UntrustedRoot
at System.Net.Security.SslStream.SendAuthResetSignal(ProtocolTokenmessage, ExceptionDispatchInfoexception)
at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptionssslAuthenticationOptions)
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringusername, Stringpassword) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 315
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 122
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 42
at EP.BackgroundJobs.Engine.Jobs.PTSJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/PTSJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 17:05:01
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: The remote certificate is invalid because of errors in the certificate chain: UntrustedRoot
at System.Net.Security.SslStream.SendAuthResetSignal(ProtocolTokenmessage, ExceptionDispatchInfoexception)
at System.Net.Security.SslStream.CompleteHandshake(SslAuthenticationOptionssslAuthenticationOptions)
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringusername, Stringpassword) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 315
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 122
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.PTSEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/PTSEventPusher.cs:line 42
at EP.BackgroundJobs.Engine.Jobs.PTSJob.ProcessCustomer(PerformContextcontext, StringcustomerName, StringaccountNumber, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/Jobs/PTSJob.cs:line 39
An exception occurred during performance of the job. More details...
10/06/2026 17:05:54
System.Net.Http.HttpRequestException
The SSL connection could not be established, see inner exception.
System.Net.Http.HttpRequestException: The SSL connection could not be established, see inner exception.
---> System.Security.Authentication.AuthenticationException: Authentication failed, see inner exception.
---> Interop+OpenSsl+SslException: SSL Handshake failed with OpenSSL error - SSL_ERROR_SSL.
---> Interop+Crypto+OpenSslCryptographicException: error:14094410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure
--- End of inner exception stack trace ---
at Interop.OpenSsl.DoSslHandshake(SafeSslHandlecontext, ReadOnlySpan`1input, Byte[]&sendBuf, Int32&sendCount)
at System.Net.Security.SslStreamPal.HandshakeInternal(SafeFreeCredentialscredential, SafeDeleteSslContext&context, ReadOnlySpan`1inputBuffer, Byte[]&outputBuffer, SslAuthenticationOptionssslAuthenticationOptions)
--- End of inner exception stack trace ---
at System.Net.Security.SslStream.ForceAuthenticationAsync[TIOAdapter](TIOAdapteradapter, BooleanreceiveFirst, Byte[]reAuthenticationData, BooleanisApm)
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
--- End of inner exception stack trace ---
at System.Net.Http.ConnectHelper.EstablishSslConnectionAsync(SslClientAuthenticationOptionssslOptions, HttpRequestMessagerequest, Booleanasync, Streamstream, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.ConnectAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.CreateHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.AddHttp11ConnectionAsync(HttpRequestMessagerequest)
at System.Threading.Tasks.TaskCompletionSourceWithCancellation`1.WaitWithCancellation(CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.GetHttp11ConnectionAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpConnectionPool.SendWithVersionDetectionAndRetryAsync(HttpRequestMessagerequest, Booleanasync, BooleandoRequestAuth, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.DiagnosticsHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.RedirectHandler.SendAsync(HttpRequestMessagerequest, Booleanasync, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageHandlerStage.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.SocketsHttpHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClientHandler.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpMessageInvoker.Send(HttpRequestMessagerequest, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest, HttpCompletionOptioncompletionOption, CancellationTokencancellationToken)
at System.Net.Http.HttpClient.Send(HttpRequestMessagerequest)
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.GetToken(PerformContextcontext, Stringapitokenurl, Stringclientsecret, Stringclientid, Stringcookie, BooleanisLive) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 145
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.SendCustomerUpdate(OracleConnectionconnection, PerformContextcontext, WebhookCustomercustomer, DataTablerecords) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 59
at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.ENBDEventPusher.Execute(PerformContextcontext, WebhookCustomercustomer, StringcourierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/ENBDEventPusher.cs:line 44