You are viewing limited content. For full access, please sign in.

Question

Question

Is there a way to specify the number of documents to import in Import Agent?

asked on October 11, 2023

I have a huge amount of documents I need to import (33,000 +) from an older system that I am migrating to Laserfiche.  In order to minimize the performance hit on the server I would like to schedule the Import Agent job to only run between certain hours at night and only to process a certain number of documents, perhaps 3,000 at a time.  

If this isn't possible, perhaps Laserfiche could consider an enhancement for an upcoming release?

 

0 0

Replies

replied on October 11, 2023

This is not currently available in Import Agent. It will import all files present in the monitored folder when the profile runs.

What I've seen other people do is use a holding folder and a Powershell script hooked up to a Windows scheduled task that periodically feeds a few hundreds/thousand documents from the holding folder to the monitored folder.

3 0
replied on October 11, 2023

Hi Mike, 

Import Agent profile can be configured to run between certain hours, but it doesn't support to process only given number of documents. I think you can have an estimation about the import speed and configure appropriate time span to import at night so that rough number of documents are imported. Could you explain a more that you would like to import EXACT number of documents?

 

0 0
replied on October 12, 2023

I don't need to import an exact number of documents...I just want to keep the volume low enough so that the processing is completed within a certain time frame.  The scheduler could work, but I'm confused as to how to interpret the settings.  Looking at this screen grab, should I interpret this to mean that it will run Monday through Friday from 6 p.m. to 7 p.m. or does it mean it will run from Monday at 6 p.m. until Friday at 7 p.m.?

0 0
replied on October 12, 2023 Show version history

You would need to set it up something like this, and add any other days/times wanted:

0 0
replied on October 12, 2023

Thanks for the clarification.

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.