You are viewing limited content. For full access, please sign in.

Question

Question

Import Agent Configuration

asked on June 12, 2018 Show version history

Hi,

I am implementing a document processing solution.

There is currently just one server running Win 2016 in an AZURE environment with 16G of RAM and 4 core processors. It has LF Server, Import Agent, WF and an imaging software similar to Quick Fields. I installed all components using 10.3.1 ISO.

Every alternative day, up to 3000+ documents are scanned using a high performance scanner. These documents are uploaded to a monitored folder. When the documents are uploaded, a workflow starts and that workflow has 15-20 steps.

There are days when Import agent crashes (even thought it is set to recover) which results in document pile-up and when the service is restarted, CPU hits 100% and causes a lot of issues such imported documents missing pages or documents going to Error folder or diminished OCR quality, etc.

I understand that a distributed environment would function very well but the customer wants to explore if its possible to alter the solution without needing to have a whole new server that is only utilised infrequently. Or what if we will run into the same problem in a distributed environment.

Is it possible to configure Import agent to pick-up a file every 5 or 10 seconds? So that the workflow service has enough time to run it's course?

Or

Is it possible to introduce a 10 second delay in a workflow using a script if not delay activity? so I will schedule a workflow every hour and then trigger sub processes for-each entry in 10 second succession.

Or

Is it possible to limit the amount of cores used by Import Agent to half of whats available?

Or something else?

Thanks in advance.

Adarsh

1 0

Replies

replied on June 13, 2018 Show version history

Hi Adarsh,

Per CPU hits 100%, you would be better to install the update in 10.3.1. 

Per Import Agent to pick up a files, there is a configuration. Open Import Agent Configuration Utility, and then go to Profile->options->Advanced tab: Set the interval time for "Check for new files in the monitored directories every". 

Per Import Agent to limit the amount of cores, there are configuration set in registry key. When you update it, you would better to backup your registry key. Open registry key and navigate to HKEY_LOCAL_MACHINE\SOFTWARE\Laserfiche\Import Agent\Settings, add string value named as ParallelMode and set its value as true, add string value named as ImportThreadCount and set the number you want.

It requires restart Import Agent service to take effective. 

1 0
replied on June 16, 2018

Thanks Qinmei,

I have installed the update. Will checkout the performance this week and let you know.

Please correct if I’m wrong but the time interval you suggested is for looking for whether new files have arrived in the folder rather than for processing correct? If yes, it’s not very helpful. 

And regarding the Registry, thanks for step by step guide. I will make those changes if I don’t notice any improvement. 

Thanks again for answering my question.

 

Regards,

Adarsh

0 0
replied on June 18, 2018

It is the time interval for looking up for new files have arrived.

0 0
replied on June 13, 2018

Hola Adarsh, además a lo que señala Qinmei,
Te sujiero priorizar los procesos en el sistema operativo del servidor, por ejemplo el Laserfiche y Workflow podrían estar sobre el Importagent.
Sospecho que entre el Importagent y el Workflow bloquean un mismo documento el cual genera una contención del proceso.
Suerte.
Copio imagen donde puedes alterar la prioridad de los procesos.

----

Hello Adarsh, in addition to what Qinmei points out,
I would prefer to prioritize the processes in the server operating system, for example the Laserfiche and Workflow could be on the Importagent.
I suspect that between the Importagent and the Workflow they block the same document which generates a containment of the process.
Luck.
Copy image where you can alter the priority of the processes.

0 0
replied on June 16, 2018

Hi Manuel,

Thanks for your response. This looks straight forward, might give it a try.

I had tried this for a different application some time ago but didn’t have much success so it never occurred to me to try this.

Have you made this change to Import Agent and seen it’s effect? I’m not doubting but just wondering if you ran into a similar experience and this minor modification permanently resolved the issue.

 

Thanks,

Adarsh

0 0
replied on June 16, 2018

Thanks Qinmei,

I have installed the update. Will checkout the performance this week and let you know.

Please correct if I’m wrong but the time interval you suggested is for looking for whether new files have arrived in the folder rather than for processing correct? If yes, it’s not very helpful. 

And regarding the Registry, thanks for step by step guide. I will make those changes if I don’t notice any improvement. 

Thanks again for answering my question.

 

Regards,

Adarsh

replied on June 18, 2018
Hola Adarsh,
Te comento que nosotros contamos con varios servidores virtuales y en cada uno de ellos  se ejecuta un servicio de Laserfiche,  bajo este modelo de procesamiento es que ponderamos la carga de los CPUs. Tiempo atrás teníamos todos los servicios de Laserfiche en un solo servidor y para lo cual utilizamos el método que te comenté (priorización de los tareas en el servidor) y mejoro el rendimiento.
 
 
Hola Adarsh,
Te comento que nosotros contamos con varios servidores virtuales y en cada uno de ellos  se ejecuta un servicio de Laserfiche,  bajo este modelo de procesamiento es que ponderamos la carga de los CPUs. Tiempo atrás teníamos todos los servicios de Laserfiche en un solo servidor y para lo cual utilizamos el método que te comenté (priorización de los tareas en el servidor), mejoro el rendimiento.
0 0
replied on June 18, 2018

Thanks Manuel. 

I feel more confident about making this change now. I also installed an update as suggested by Qinmei, it has definitely had a positive impact. We scanned 1500 documents in a span of 10-12 minutes, it ran as expected.

I will change the CPU priority after further monitoring the performance of the system.

Thanks once again,

Adarsh

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.