You are viewing limited content. For full access, please sign in.

Question

Question

Laserfiche - Slow import of MS Office files?

asked on July 1, 2016

We have a new Client that has about 100s GB worth of MS Office Documents mainly Word and Excel. Doing initial tests, we are seeing that importing a folder with a total size of about 100MB took about 36 minutes on their system and about 43 minutes on VAR kit (Intel Xeon CPU E3 -1231 @3.40GHz 3.40GHz with 4GB RAM). The VAR Kit is only running Laserfiche, Database and storage are both local

See the metrics of the files imported below.

Also, the the import process (drag & drop) settings configured to not generate any text/page and auditing disabled for the user performing the Audit.

 

Any ideas why this is taking long? Any ideas to speed this up?

0 0

Replies

replied on July 1, 2016

I would personally recommend Import Agent 10 for large data sets, since it supports multi threading which might improve speed and file size limit. 

Dragging and dropping into LF Client is limited, since it is just one thread running. 

0 0
replied on July 1, 2016

Thanks Junaid,

The only downside here with using Import Agent 10 is that these folders are nested. I am not sure important agent has the capability of replicating the folder structure as well (putting the documents in their various corresponding subfolders).

0 0
replied on July 1, 2016

Hi Karim,

You can configure the profile to retrieve files from subfolders and then also use the %(Subfolder) token in the path for where you want the files to be imported into.

As for performance, Import Agent 10 is multi-threaded so if you have a CPU that is fast and has lots of cores/logical CPUs, then that will help immensely.

Regards

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.