Webhook Process Encoded/218120

The job is finished. It will be removed automatically 10/08/2026 07:06:12.
// Job ID: 2546d909-b514-4acc-b162-9b6994923e6a
using EP.BackgroundJobs.Engine.Jobs;

var webhookJob = Activate<WebhookJob>();
webhookJob.ProcessCustomer(
    null,
    "Encoded",
    "218120",
    FromJson<WebhookCustomer>("{\"AccountNumber\":\"218120\",\"CustomerName\":\"Encoded\",\"Url\":\"https://encoded.ae/api/v1/external/couriers/emx/webhooks/\",\"IPSEventsURL\":null,\"Token\":\"nfU4yePffZoJPtDPgZvPwUV5P3sfFYnX\",\"SecondaryToken\":null,\"RowsCount\":500,\"Active\":true,\"Type\":\"EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher\",\"TokenUrl\":null,\"ClientID\":null,\"ClientSecret\":null,\"Cookie\":null,\"IsLive\":false,\"ProductCode\":null,\"StatusCodes\":null,\"BackDateCount\":null,\"IsEidRequired\":false,\"ExtraUrl\":null,\"Scope\":null,\"SiteId\":null,\"CertPwd\":null,\"enableCertLog\":false,\"userName\":null,\"Password\":null}"),
    "DATA SOURCE=(DESCRIPTION= (ADDRESS= (PROTOCOL=TCP) (HOST=ocprdexavm-fefsa-scan.epgprdb.epgvcn.oraclevcn.com) (PORT=1521)) (CONNECT_DATA= (SERVER=DEDICATED) (SERVICE_NAME=OPSPRD_OPSPDB01.paas.oracle.com) (FAILOVER_MODE= (TYPE=select) (METHOD=basic))));USER ID=BOC_RUN;Password=B0#8nn$C;Pooling=true;Min Pool Size=0;Connection Lifetime=180;Max Pool Size=50;Incr Pool Size=5;");

Parameters

CurrentCulture
""
CurrentUICulture
""
RetryCount
2

State

10/07/2026 07:06:12 (+51.618s) Succeeded

Latency:
3h 5m
Duration:
51.618s

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
d4465938
+50.418sTotal Number of AWBs: 1
+50.418s-------- Start AWB_NUM: 1000047646360 --------
+50.418sThe request is: {"Customer_Token":null,"AWB_Number":"1000047646360","Reference_Number":"OR1377AE","Time_Stamp":"10/07/2026 09:23:52 AM","Status":"Out for Delivery","SubStatus":"Out for Delivery","Remarks":"Courier Shipment","DateOfShipmentCreation":"06/10/2026 10:59:43 AM","ConsigneeAddress":"Masafi Street , Masafi, , Fujairah, United Arab Emirates","ConsigneeContactName":"Shaikha Hasher","ConsigneeMobNumber":"+971505006554","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+51.613sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+51.614sPush Notification to Customer Service completed successfully
+51.618s-------- End AWB_NUM: 1000047646360 --------

+1m 2ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 3: Connection request timed out

Enqueue at:
10/07/2026 07:05:18

+15.005s Failed

An exception occurred during performance of the job.

Oracle.ManagedDataAccess.Client.OracleException

Connection request timed out

Oracle.ManagedDataAccess.Client.OracleException (0x80004005): Connection request timed out
   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPwd, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassword, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, SecureString securedPassword, SecureString securedProxyPassword, OracleConnection connRefForCriteria)
   at Oracle.ManagedDataAccess.Client.OracleConnection.Open()
   at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher.Execute(PerformContext context, WebhookCustomer customer, String courierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/CustomerEventPusher.cs:line 49

+1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
eadb806a

+30.019s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 3: Timeout expired. The timeout elapsed prior to obt…

Enqueue at:
10/07/2026 07:04:03

+1m 30.001s Failed

An exception occurred during performance of the job.

Hangfire.Storage.DistributedLockTimeoutException

Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.

Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.
   at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(String resource, TimeSpan timeout)
   at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContext filterContext)
   at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1 tuple)
   at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstance instance, Func`2 action, String message)
   at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfiler profiler, TInstance instance, Action`1 action, String message)
   at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
d0eee766

+3h 2m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Enqueue at:
10/07/2026 07:02:04

10/07/2026 04:00:04 Created