Emirates Post Background Jobs

Webhook Process Encoded/218120

The job is finished. It will be removed automatically 10/09/2026 11:06:20. 
// Job ID: 47dc1040-0885-47f4-b4ba-99f088a8b552
using EP.BackgroundJobs.Engine.Jobs;

var webhookJob = Activate<WebhookJob>();
webhookJob.ProcessCustomer(
    null,
    "Encoded",
    "218120",
    FromJson<WebhookCustomer>("{\"AccountNumber\":\"218120\",\"CustomerName\":\"Encoded\",\"Url\":\"https://encoded.ae/api/v1/external/couriers/emx/webhooks/\",\"IPSEventsURL\":null,\"Token\":\"nfU4yePffZoJPtDPgZvPwUV5P3sfFYnX\",\"SecondaryToken\":null,\"RowsCount\":500,\"Active\":true,\"Type\":\"EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher\",\"TokenUrl\":null,\"ClientID\":null,\"ClientSecret\":null,\"Cookie\":null,\"IsLive\":false,\"ProductCode\":null,\"StatusCodes\":null,\"BackDateCount\":null,\"IsEidRequired\":false,\"ExtraUrl\":null,\"Scope\":null,\"SiteId\":null,\"CertPwd\":null,\"enableCertLog\":false,\"userName\":null,\"Password\":null}"),
    "DATA SOURCE=(DESCRIPTION= (ADDRESS= (PROTOCOL=TCP) (HOST=ocprdexavm-fefsa-scan.epgprdb.epgvcn.oraclevcn.com) (PORT=1521)) (CONNECT_DATA= (SERVER=DEDICATED) (SERVICE_NAME=OPSPRD_OPSPDB01.paas.oracle.com) (FAILOVER_MODE= (TYPE=select) (METHOD=basic))));USER ID=BOC_RUN;Password=B0#8nn$C;Pooling=true;Min Pool Size=0;Connection Lifetime=180;Max Pool Size=50;Incr Pool Size=5;");

Parameters

CurrentCulture 
""
CurrentUICulture 
""
RetryCount 
2

State

10/08/2026 11:06:20 (+53.956s) Succeeded

Latency:
3h 5m
Duration:
53.956s

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
d4465938
+51.165sTotal Number of AWBs: 4
+51.165s-------- Start AWB_NUM: 1000047700510 --------
+51.165sThe request is: {"Customer_Token":null,"AWB_Number":"1000047700510","Reference_Number":"OR1372AE","Time_Stamp":"10/08/2026 11:25:11 AM","Status":"Out for Delivery","SubStatus":"Out for Delivery","Remarks":"Courier Shipment","DateOfShipmentCreation":"07/10/2026 03:54:35 PM","ConsigneeAddress":"Jumeirah 1, Port de la Mer, La Sirene 2, apt. 607, , Dubai, United Arab Emirates","ConsigneeContactName":"Filipe Goncalves","ConsigneeMobNumber":"+971589952814","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+51.827sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+51.827sPush Notification to Customer Service completed successfully
+51.831s-------- End AWB_NUM: 1000047700510 --------
+51.831s-------- Start AWB_NUM: 1000047698617 --------
+51.831sThe request is: {"Customer_Token":null,"AWB_Number":"1000047698617","Reference_Number":"OR1341AE","Time_Stamp":"10/08/2026 12:03:29 PM","Status":"Out for Delivery","SubStatus":"Out for Delivery","Remarks":"Courier Shipment","DateOfShipmentCreation":"07/10/2026 03:29:05 PM","ConsigneeAddress":"Dubai - Hatta, , Dubai, United Arab Emirates","ConsigneeContactName":"Saleh Alnuaimi","ConsigneeMobNumber":"+971509987992","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+52.489sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+52.489sPush Notification to Customer Service completed successfully
+52.493s-------- End AWB_NUM: 1000047698617 --------
+52.494s-------- Start AWB_NUM: 1000047698853 --------
+52.494sThe request is: {"Customer_Token":null,"AWB_Number":"1000047698853","Reference_Number":"OR1332AE","Time_Stamp":"10/08/2026 01:01:31 PM","Status":"Out for Delivery","SubStatus":"Out for Delivery","Remarks":"Courier Shipment","DateOfShipmentCreation":"07/10/2026 03:37:07 PM","ConsigneeAddress":"#1110, Capital Centre Arjaan by Rotana, Al Khaleej Al Arabi St - Al Rawdah - W59 01, , Abu Dhabi, United Arab Emirates","ConsigneeContactName":"Richard Silver","ConsigneeMobNumber":"+971544366853","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+53.171sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+53.171sPush Notification to Customer Service completed successfully
+53.175s-------- End AWB_NUM: 1000047698853 --------
+53.175s-------- Start AWB_NUM: 1000047698853 --------
+53.176sThe request is: {"Customer_Token":null,"AWB_Number":"1000047698853","Reference_Number":"OR1332AE","Time_Stamp":"10/08/2026 02:06:49 PM","Status":"Shipment Delivered","SubStatus":"Delivered","Remarks":"Courier Shipment","DateOfShipmentCreation":"07/10/2026 03:37:07 PM","ConsigneeAddress":"#1110, Capital Centre Arjaan by Rotana, Al Khaleej Al Arabi St - Al Rawdah - W59 01, , Abu Dhabi, United Arab Emirates","ConsigneeContactName":"Richard Silver","ConsigneeMobNumber":"+971544366853","IDType":"Staff Card","IDName":"Nagi","IDNumber":"843","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+53.954sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+53.954sPush Notification to Customer Service completed successfully
+53.957s-------- End AWB_NUM: 1000047698853 --------

+1m 9ms Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 3: Timeout expired. The timeout elapsed prior to obt…

Enqueue at:
10/08/2026 11:05:22

+1m 30.004s Failed

An exception occurred during performance of the job.

Hangfire.Storage.DistributedLockTimeoutException

Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.

Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.
   at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(String resource, TimeSpan timeout)
   at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContext filterContext)
   at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1 tuple)
   at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstance instance, Func`2 action, String message)
   at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfiler profiler, TInstance instance, Action`1 action, String message)
   at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
a9770130

+19.552s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 3: Connection request timed out

Enqueue at:
10/08/2026 11:02:56

+25.457s Failed

An exception occurred during performance of the job.

Oracle.ManagedDataAccess.Client.OracleException

Connection request timed out

Oracle.ManagedDataAccess.Client.OracleException (0x80004005): Connection request timed out
   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPwd, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassword, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, SecureString securedPassword, SecureString securedProxyPassword, OracleConnection connRefForCriteria)
   at Oracle.ManagedDataAccess.Client.OracleConnection.Open()
   at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher.Execute(PerformContext context, WebhookCustomer customer, String courierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/CustomerEventPusher.cs:line 49

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
a9770130

+3h 2m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Enqueue at:
10/08/2026 11:02:08

10/08/2026 08:00:08 Created