Emirates Post Background Jobs

Webhook Process Encoded/218120

The job is finished. It will be removed automatically 10/11/2026 07:08:58. 
// Job ID: 98a39d6b-d732-4a2c-9a7f-35d52c877af3
using EP.BackgroundJobs.Engine.Jobs;

var webhookJob = Activate<WebhookJob>();
webhookJob.ProcessCustomer(
    null,
    "Encoded",
    "218120",
    FromJson<WebhookCustomer>("{\"AccountNumber\":\"218120\",\"CustomerName\":\"Encoded\",\"Url\":\"https://encoded.ae/api/v1/external/couriers/emx/webhooks/\",\"IPSEventsURL\":null,\"Token\":\"nfU4yePffZoJPtDPgZvPwUV5P3sfFYnX\",\"SecondaryToken\":null,\"RowsCount\":500,\"Active\":true,\"Type\":\"EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher\",\"TokenUrl\":null,\"ClientID\":null,\"ClientSecret\":null,\"Cookie\":null,\"IsLive\":false,\"ProductCode\":null,\"StatusCodes\":null,\"BackDateCount\":null,\"IsEidRequired\":false,\"ExtraUrl\":null,\"Scope\":null,\"SiteId\":null,\"CertPwd\":null,\"enableCertLog\":false,\"userName\":null,\"Password\":null}"),
    "DATA SOURCE=(DESCRIPTION= (ADDRESS= (PROTOCOL=TCP) (HOST=ocprdexavm-fefsa-scan.epgprdb.epgvcn.oraclevcn.com) (PORT=1521)) (CONNECT_DATA= (SERVER=DEDICATED) (SERVICE_NAME=OPSPRD_OPSPDB01.paas.oracle.com) (FAILOVER_MODE= (TYPE=select) (METHOD=basic))));USER ID=BOC_RUN;Password=B0#8nn$C;Pooling=true;Min Pool Size=0;Connection Lifetime=180;Max Pool Size=50;Incr Pool Size=5;");

Parameters

CurrentCulture 
""
CurrentUICulture 
""
RetryCount 
3

State

10/10/2026 07:08:58 (+1m 6.916s) Succeeded

Latency:
3h 7m
Duration:
1m 6.915s

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
eadb806a
+1m 3.065sTotal Number of AWBs: 7
+1m 3.065s-------- Start AWB_NUM: 1000047814701 --------
+1m 3.065sThe request is: {"Customer_Token":null,"AWB_Number":"1000047814701","Reference_Number":"OR1380AE","Time_Stamp":"10/10/2026 09:00:41 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 09:00:41 AM","ConsigneeAddress":"Apartment 1606, Al Ghurair Residence 5, Wadi Al Safa 3, , Dubai, United Arab Emirates","ConsigneeContactName":"Mohammad Awad","ConsigneeMobNumber":"+971508088126","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 3.696sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 3.696sPush Notification to Customer Service completed successfully
+1m 3.701s-------- End AWB_NUM: 1000047814701 --------
+1m 3.701s-------- Start AWB_NUM: 1000047814714 --------
+1m 3.701sThe request is: {"Customer_Token":null,"AWB_Number":"1000047814714","Reference_Number":"OR1381AE","Time_Stamp":"10/10/2026 09:01:29 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 09:01:29 AM","ConsigneeAddress":"Rawhdat - Manazel Tower -1007, , Abu Dhabi, United Arab Emirates","ConsigneeContactName":"Abdallah Zoubian","ConsigneeMobNumber":"+971551733208","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 4.280sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 4.280sPush Notification to Customer Service completed successfully
+1m 4.286s-------- End AWB_NUM: 1000047814714 --------
+1m 4.286s-------- Start AWB_NUM: 1000047814743 --------
+1m 4.286sThe request is: {"Customer_Token":null,"AWB_Number":"1000047814743","Reference_Number":"OR1386AE","Time_Stamp":"10/10/2026 09:03:23 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 09:03:23 AM","ConsigneeAddress":"306, Juma Al Majid building, Al Hamriya, Bur Dubai, , Dubai, United Arab Emirates","ConsigneeContactName":"Lennox Dabre","ConsigneeMobNumber":"+971542895147","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 4.632sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 4.632sPush Notification to Customer Service completed successfully
+1m 4.636s-------- End AWB_NUM: 1000047814743 --------
+1m 4.636s-------- Start AWB_NUM: 1000047814788 --------
+1m 4.636sThe request is: {"Customer_Token":null,"AWB_Number":"1000047814788","Reference_Number":"OR1396AE","Time_Stamp":"10/10/2026 09:06:11 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 09:06:11 AM","ConsigneeAddress":"Gurnatah street, Alzafranah 3 building,314, , Ajman, United Arab Emirates","ConsigneeContactName":"Kenan Kanaan","ConsigneeMobNumber":"+971557888421","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 5.264sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 5.264sPush Notification to Customer Service completed successfully
+1m 5.268s-------- End AWB_NUM: 1000047814788 --------
+1m 5.268s-------- Start AWB_NUM: 1000047698880 --------
+1m 5.268sThe request is: {"Customer_Token":null,"AWB_Number":"1000047698880","Reference_Number":"OR1342AE","Time_Stamp":"10/10/2026 10:42:21 AM","Status":"Out for Delivery","SubStatus":"Out for Delivery","Remarks":"Courier Shipment","DateOfShipmentCreation":"07/10/2026 03:38:18 PM","ConsigneeAddress":"STUDIO 7 Interiors Office Atelier No 11 --2 B - RAS AL KHOR industrial 2, , Dubai, United Arab Emirates","ConsigneeContactName":"Vincent Maldant","ConsigneeMobNumber":"+971505051468","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 5.891sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 5.891sPush Notification to Customer Service completed successfully
+1m 5.896s-------- End AWB_NUM: 1000047698880 --------
+1m 5.896s-------- Start AWB_NUM: 1000047816667 --------
+1m 5.896sThe request is: {"Customer_Token":null,"AWB_Number":"1000047816667","Reference_Number":"OR1365AE","Time_Stamp":"10/10/2026 10:49:23 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 10:49:23 AM","ConsigneeAddress":"Dubai - jvt - cloud tower apartment 2010, , Dubai, United Arab Emirates","ConsigneeContactName":"SALEM ALHAMMADI","ConsigneeMobNumber":"+971506176760","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 6.232sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 6.232sPush Notification to Customer Service completed successfully
+1m 6.236s-------- End AWB_NUM: 1000047816667 --------
+1m 6.236s-------- Start AWB_NUM: 1000047816848 --------
+1m 6.236sThe request is: {"Customer_Token":null,"AWB_Number":"1000047816848","Reference_Number":"OR1367AE","Time_Stamp":"10/10/2026 10:58:07 AM","Status":"Shipment Created","SubStatus":"","Remarks":"Courier Shipment","DateOfShipmentCreation":"10/10/2026 10:58:07 AM","ConsigneeAddress":"Mina al arab, lagoons 14, 501, , Ras Al Khaimah, United Arab Emirates","ConsigneeContactName":"Elena Golod","ConsigneeMobNumber":"+971557711804","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+1m 6.909sThe received result is: {"status":"success","data":{"response":{"errorCode":null,"errorMsg":null,"status":"Success"}}}
+1m 6.909sPush Notification to Customer Service completed successfully
+1m 6.913s-------- End AWB_NUM: 1000047816848 --------

+1m 30.002s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 3 of 3: Connection request timed out

Enqueue at:
10/10/2026 07:07:40

+15.001s Failed

An exception occurred during performance of the job.

Oracle.ManagedDataAccess.Client.OracleException

Connection request timed out

Oracle.ManagedDataAccess.Client.OracleException (0x80004005): Connection request timed out
   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPwd, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassword, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, SecureString securedPassword, SecureString securedProxyPassword, OracleConnection connRefForCriteria)
   at Oracle.ManagedDataAccess.Client.OracleConnection.Open()
   at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher.Execute(PerformContext context, WebhookCustomer customer, String courierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/CustomerEventPusher.cs:line 49

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
eadb806a

+1m 5.548s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 3: Connection request timed out

Enqueue at:
10/10/2026 07:05:52

+54.461s Failed

An exception occurred during performance of the job.

Oracle.ManagedDataAccess.Client.OracleException

Connection request timed out

Oracle.ManagedDataAccess.Client.OracleException (0x80004005): Connection request timed out
   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPwd, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassword, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, SecureString securedPassword, SecureString securedProxyPassword, OracleConnection connRefForCriteria)
   at Oracle.ManagedDataAccess.Client.OracleConnection.Open()
   at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher.Execute(PerformContext context, WebhookCustomer customer, String courierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/CustomerEventPusher.cs:line 49

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
25d37eee

+30.015s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 3: Timeout expired. The timeout elapsed prior to obt…

Enqueue at:
10/10/2026 07:04:06

+1m 30.002s Failed

An exception occurred during performance of the job.

Hangfire.Storage.DistributedLockTimeoutException

Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.

Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookJob.ProcessCustomer' resource.
   at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(String resource, TimeSpan timeout)
   at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContext filterContext)
   at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1 tuple)
   at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstance instance, Func`2 action, String message)
   at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfiler profiler, TInstance instance, Action`1 action, String message)
   at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
25d37eee

+3h 2m Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Enqueue at:
10/10/2026 07:02:00

10/10/2026 04:00:00 Created