What types of issues could lead to receiving this error from Forms?
We've verified there's clear connectivity from the Forms server to the server hosting the Audit Trail Event Hub service on TCP 10256, the Forms config page for Auditing shows the green "The connection has been verified", and indeed the Forms catalog has been created and has events populated in it (and actively populating still). But it appears we are having periods where Forms logs this event over 100 times in an hour.... and then, just as suddenly, stops logging it.
Log Name: Laserfiche-Forms-App/Admin
Source: Laserfiche-Forms-App
Date: 6/8/2023 1:24:48 PM
Event ID: 19906
Task Category: AuditTrailTmeoutSendEventToATHubErrorAdmin
Level: Error
Keywords: Session0,Session1,Session2,Session3
User: SYSTEM
Computer: [redacted domain name for this post]
Description:
Sending audit events to Audit Trail Hub Service timed out with error code SendEventTimeOut. [LFF9906-AuditTrailTmeoutSendEventToATHub]
Details:
URL:
Error: AuditTrailTmeoutSendEventToATHub
Date: 6/8/2023 1:24:48 PM (Central Standard Time)
HTTP Status Code: 500
Business Process ID: 0
Stack Trace:
Caught exception: Laserfiche.Forms.CommonUtils.Exceptions.LFFormsException
Message: Sending audit events to Audit Trail Hub Service timed out with error code SendEventTimeOut. [LFF9906-AuditTrailTmeoutSendEventToATHub]
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Laserfiche-Forms-App" Guid="{98141ca4-660b-51c6-66b4-ec37f5b2fd87}" />
<EventID>19906</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>45628</Task>
<Opcode>0</Opcode>
<Keywords>0x4000f00000000000</Keywords>
<TimeCreated SystemTime="2023-06-08T18:24:48.655195400Z" />
<EventRecordID>885734</EventRecordID>
<Correlation />
<Execution ProcessID="4352" ThreadID="8764" />
<Channel>Laserfiche-Forms-App/Admin</Channel>
<Computer>[redactedforthispost</Computer>
<Security UserID="S-1-5-18" />
</System>
<EventData>
<Data Name="message">Sending audit events to Audit Trail Hub Service timed out with error code SendEventTimeOut. [LFF9906-AuditTrailTmeoutSendEventToATHub]
Details:
URL:
Error: AuditTrailTmeoutSendEventToATHub
Date: 6/8/2023 1:24:48 PM (Central Standard Time)
HTTP Status Code: 500
Business Process ID: 0
Stack Trace:
Caught exception: Laserfiche.Forms.CommonUtils.Exceptions.LFFormsException
Message: Sending audit events to Audit Trail Hub Service timed out with error code SendEventTimeOut. [LFF9906-AuditTrailTmeoutSendEventToATHub]
</Data>
</EventData>
</Event>
What conditions should be be looking for? There are a few instances of these events in the AuditTrail event log, but they don't correlate in time or volume with what we see on the Forms side:
General error: Illegal characters in path.
Type: System.ArgumentException
Also, what happens to Forms if auditing is enabled, and it can't reach the Audit Trail Event Hub... based on another Answers post from Sam Carson, it appears to be a synchronous process, with Forms making a TCP 10256 connection to the AT Event Hub service which then writes the audit event to a message queue. Well, what if that event hub service is offline... how does Forms handle not being able to write the audit event, does it queue them somehow? (it's not using MSMQ) or does it just hold them in memory and retry and retry? or (I'm sure not from compliance perspective) just drop those audit events?