Question

Import Agent 10 Multi Threading

Laserfiche Import Agent

Updated October 31, 2018

asked on October 30, 2018 • Show version history

I've verified the way that Multi Threading is working in Import Agent 10. Import Agent will import one document at a time per core. So with 8 Cores, you will get 8 documents importing simultaneously, 16 cores will get you 16 documents simultaneously.

This is great, but I just wanted to ask if this is the expected behavior ? I would think 1 core could handle more than 1 document at a time.

0 0

Replies

replied on October 30, 2018

Each processor core can only handle a single task at a time (Hyperthreading notwithstanding). You can swap different tasks onto the core and have the appearance of more than one task executing at a time. However, this means that any other tasks allocated to that core must stop while the current task executes. This means that one document per core is indeed the most efficient way.

Are you experiencing a bottleneck somewhere?

1 0

replied on October 31, 2018

Hi Devin, no bottlenecks now that we updated our servers from 2 core to 16 core. It's just that in a high volume environment like we have (1000's of documents importing per hour per import agent server) it gets quite expensive to buy a server with 8 cores versus 16 cores or 32 cores etc. each time need to scale up or scale out.

0 0

replied on October 31, 2018

I would expect that any bottlenecks are more likely to be I/O or network bound rather than CPU-bound. Import Agent (and Quick Fields Agent, for that matter) doesn't really need server-grade hardware. A dedicated workstation with a fast SSD might be more cost effective.

0 0

replied on October 31, 2018

Indeed. In some of my SDK-driven import processes, I can easily saturate our Laserfiche server using a standard workstation.

0 0

replied on October 31, 2018 • Show version history

Hi Miruna, we didn't have any bottlenecks other than documents importing simultaneously. The problem we had was that a server with 2 cores can only import 2 documents simultaneously and we had to have a lot more than that to keep up with our document volume. Our only choice was to update to 16 core on each of our 2 import agent servers. And now we get 16 documents importing simultaneously.

0 0

You are not allowed to follow up in this post.

Question

Question

Import Agent 10 Multi Threading

Replies

Sign in to reply to this post.