Webhook Process AL AIN CLUB INVESTMENT COMPANY/395128

The job is finished. It will be removed automatically 10/08/2026 16:19:28.
// Job ID: 3ab99b5b-df24-4b0d-8040-1085e2efeb28
using EP.BackgroundJobs.Engine.Jobs;

var webhookByCustomerJob = Activate<WebhookByCustomerJob>();
webhookByCustomerJob.ProcessCustomer(
    null,
    "AL AIN CLUB INVESTMENT COMPANY",
    "395128",
    FromJson<WebhookCustomer>("{\"AccountNumber\":\"395128\",\"CustomerName\":\"AL AIN CLUB INVESTMENT COMPANY\",\"Url\":\"https://api2cart.epservices.ae/api/Tracking\",\"IPSEventsURL\":null,\"Token\":\"\",\"SecondaryToken\":null,\"RowsCount\":1000,\"Active\":true,\"Type\":\"EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher\",\"TokenUrl\":null,\"ClientID\":null,\"ClientSecret\":null,\"Cookie\":null,\"IsLive\":false,\"ProductCode\":null,\"StatusCodes\":null,\"BackDateCount\":null,\"IsEidRequired\":false,\"ExtraUrl\":null,\"Scope\":null,\"SiteId\":null,\"CertPwd\":null,\"enableCertLog\":false,\"userName\":null,\"Password\":null}"),
    "DATA SOURCE=(DESCRIPTION= (ADDRESS= (PROTOCOL=TCP) (HOST=ocprdexavm-fefsa-scan.epgprdb.epgvcn.oraclevcn.com) (PORT=1521)) (CONNECT_DATA= (SERVER=DEDICATED) (SERVICE_NAME=OPSPRD_OPSPDB01.paas.oracle.com) (FAILOVER_MODE= (TYPE=select) (METHOD=basic))));USER ID=BOC_RUN;Password=B0#8nn$C;Pooling=true;Min Pool Size=0;Connection Lifetime=180;Max Pool Size=50;Incr Pool Size=5;");

Parameters

CurrentCulture
""
CurrentUICulture
""
RetryCount
2

State

10/07/2026 16:19:28 (+50.654s) Succeeded

Latency:
18m 31.422s
Duration:
50.653s

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
2c317701
+49.392sTotal Number of AWBs: 4
+49.392s-------- Start AWB_NUM: 1000047594612 --------
+49.392sThe request is: {"Customer_Token":null,"AWB_Number":"1000047594612","Reference_Number":"#7314","Time_Stamp":"10/07/2026 04:56:04 PM","Status":"Shipment Delivered","SubStatus":"Delivered","Remarks":"","DateOfShipmentCreation":"05/10/2026 04:00:12 PM","ConsigneeAddress":"الرحبة 60 60\r\nAbu Dhabi","ConsigneeContactName":"راشد أحمد","ConsigneeMobNumber":"0504178742","IDType":"Staff Card","IDName":"Rashed","IDNumber":"1","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"6185033564394","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+49.765sThe received result is:
+49.765sPush Notification to Customer Service completed successfully
+49.769s-------- End AWB_NUM: 1000047594612 --------
+49.769s-------- Start AWB_NUM: 1000047594613 --------
+49.770sThe request is: {"Customer_Token":null,"AWB_Number":"1000047594613","Reference_Number":"#7315","Time_Stamp":"10/07/2026 06:15:32 PM","Status":"Shipment Delivered","SubStatus":"Delivered","Remarks":"","DateOfShipmentCreation":"05/10/2026 04:00:12 PM","ConsigneeAddress":"SHABIA 12, BUILDING GT 9 AUTO CARE, ROOM 103 -\r\nAbu Dhabi","ConsigneeContactName":"GUSTI ANDREAN","ConsigneeMobNumber":"0507836992","IDType":"Staff Card","IDName":"Guti","IDNumber":"Me12c174r103","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"6185044246762","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+50.060sThe received result is:
+50.060sPush Notification to Customer Service completed successfully
+50.067s-------- End AWB_NUM: 1000047594613 --------
+50.067s-------- Start AWB_NUM: 1000047595176 --------
+50.067sThe request is: {"Customer_Token":null,"AWB_Number":"1000047595176","Reference_Number":"#7316","Time_Stamp":"10/07/2026 06:28:37 PM","Status":"Shipment Delivered","SubStatus":"Delivered","Remarks":"","DateOfShipmentCreation":"05/10/2026 04:15:13 PM","ConsigneeAddress":"385c Al Muntazah St ,onehourbakery Al Rifaah - Alheera Suburb\r\nSharjah","ConsigneeContactName":"da da","ConsigneeMobNumber":"0585011585","IDType":"Staff Card","IDName":"Haihang","IDNumber":"One hour bakery ","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"6185158672618","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+50.341sThe received result is:
+50.341sPush Notification to Customer Service completed successfully
+50.347s-------- End AWB_NUM: 1000047595176 --------
+50.347s-------- Start AWB_NUM: 1000047514402 --------
+50.347sThe request is: {"Customer_Token":null,"AWB_Number":"1000047514402","Reference_Number":"#7301","Time_Stamp":"10/07/2026 07:29:01 PM","Status":"Shipment Delivered","SubStatus":"Delivered","Remarks":"","DateOfShipmentCreation":"03/10/2026 11:45:06 AM","ConsigneeAddress":"Creek Harbour, Island Park 2 Unit 803\r\nDubai","ConsigneeContactName":"Ekaterina Kubrak","ConsigneeMobNumber":"0585750360","IDType":"","IDName":"","IDNumber":"","IDExpiry":"","IDScanStatus":"","IDDetails":null,"UndeliveredReason":"","OtherReferenceNumber":"6180817993962","CountryID":null,"Esign":null,"Latitude":null,"Longitude":null}
+50.650sThe received result is:
+50.650sPush Notification to Customer Service completed successfully
+50.654s-------- End AWB_NUM: 1000047514402 --------

+57.285s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 2 of 3: Connection request timed out

Enqueue at:
10/07/2026 16:18:32

+1m 32.720s Failed

An exception occurred during performance of the job.

Oracle.ManagedDataAccess.Client.OracleException

Connection request timed out

Oracle.ManagedDataAccess.Client.OracleException (0x80004005): Connection request timed out
   at OracleInternal.ConnectionPool.PoolManager`3.Get(ConnectionString csWithDiffOrNewPwd, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OraclePoolManager.Get(ConnectionString csWithNewPassword, Boolean bGetForApp, OracleConnection connRefForCriteria, String affinityInstanceName, Boolean bForceMatch)
   at OracleInternal.ConnectionPool.OracleConnectionDispenser`3.Get(ConnectionString cs, PM conPM, ConnectionString pmCS, SecureString securedPassword, SecureString securedProxyPassword, OracleConnection connRefForCriteria)
   at Oracle.ManagedDataAccess.Client.OracleConnection.Open()
   at EP.BackgroundJobs.Engine.BusinessLogic.Implementations.CustomerEventPusher.Execute(PerformContext context, WebhookCustomer customer, String courierDatabaseConnectionString) in /src/EP.BackgroundJobs.Engine/BusinessLogic/Implementations/CustomerEventPusher.cs:line 49

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
70ee2267

+30.002s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Retry attempt 1 of 3: Timeout expired. The timeout elapsed prior to obt…

Enqueue at:
10/07/2026 16:16:07

+1m 30.004s Failed

An exception occurred during performance of the job.

Hangfire.Storage.DistributedLockTimeoutException

Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookByCustomerJob.ProcessCustomer' resource.

Hangfire.Storage.DistributedLockTimeoutException: Timeout expired. The timeout elapsed prior to obtaining a distributed lock on the 'WebhookByCustomerJob.ProcessCustomer' resource.
   at Hangfire.InMemory.InMemoryConnection.AcquireDistributedLock(String resource, TimeSpan timeout)
   at Hangfire.DisableConcurrentExecutionAttribute.OnPerforming(PerformingContext filterContext)
   at Hangfire.Profiling.ProfilerExtensions.InvokeAction[TInstance](InstanceAction`1 tuple)
   at Hangfire.Profiling.SlowLogProfiler.InvokeMeasured[TInstance,TResult](TInstance instance, Func`2 action, String message)
   at Hangfire.Profiling.ProfilerExtensions.InvokeMeasured[TInstance](IProfiler profiler, TInstance instance, Action`1 action, String message)
   at Hangfire.Server.BackgroundJobPerformer.InvokePerformFilter(IServerFilter filter, PerformingContext preContext, Func`1 continuation)

+ <1ms Processing

Server:
ep-hangfire-svc-55f796dcbf-fpxvr:1
Worker:
2c317701

+14m 1.408s Enqueued

Triggered by DelayedJobScheduler

Queue:
default

+ <1ms Scheduled

Enqueue at:
10/07/2026 16:14:06

10/07/2026 16:00:06 Created