You are viewing limited content. For full access, please sign in.

Question

Question

try catch on Migrate Entry filling drive

asked on August 25, 2023

I am trying to create a process that when a folder hits a certain location it automatically moves from the Default Volume to the Archive Volume.   When I do a simple Migrate Entry everything seems to work.   When I wrap that in a Try Catch it just runs until the hard drive runs out of space.    What am I doing wrong here?  The last migration I tried has 1000 items and 6GB of data.   It overran a 125GB hard drive.  

 

0 0

Replies

replied on August 25, 2023

What is your For Each set to?

1 0
replied on August 25, 2023 Show version history

The output entries from Search for Files and Folders in Starting Entry (Search Repository).    The only thing I can think is that the Try Catch is making it loop over and over again somehow.    The number of entries in the result are correct. 

 

Here is the query if that is useful.

 

0 0
replied on August 25, 2023

Oh... I think you led me to the answer though!   The Migrate Entry is set to Starting Entry!    That would do it I would think!   

 

What is interesting is WHY does Laserfiche allow that movement to happen 1000+ times and just take up space with duplicate identical entries!   Really hard to see all of this without attaching a debugger.

 

0 0
replied on August 25, 2023

What exactly filled up the space? Because Migrate Entries does not make copies, but running it over and over could generate extra activity in SQL (and its log) and audit logs in the repository.

 

0 0
replied on August 25, 2023 Show version history

I have no idea.   It is all data though.   It is all contained inside the volumes.   The primary LF volume is only 30GB in size.   I moved a 6GB file to a BLANK new volume and it has taken up 118GB and only stopped there because I terminated the workflow.   Looks at the time stamps starting with Archive000002.   This is the workflow filling it up.     If you know of a way to look inside I am interested.   There was nothing in the error logs or anything.  SQL is on an entirely different server.

 

 

 

0 0
replied on August 25, 2023

Your search criteria would return nothing if the starting entry was a document. If it was a folder, it would return all child entries recursively.

I'm assuming it was a folder if the activities following Search Repository have run. Migrating a folder would migrate all its child entries. Given the incorrect entry configuration in Migrate Entries, this would end up migrating all child entries of this starting entry, once for each entry found. So the same entries would be migrated multiple times.

You should be able to look in the instance details on the Messages tab and see how many results it returned. Then the total number of migrations would multiplicate rapidly from there as each child  subfolder would trigger its own duplication because calling migrate on the folder would migrate its own child entries.

With a rollover volume, you would see those subfolders get created as the documents migrated and the current one fills up.

The reason you're seeing it take more space than the original 6GB is because the Laserfiche Server performs a copy+delete under the hood and does not remove the originals until the migration is complete. This is done to ensure that no data is lost if the migration fails in the middle.

0 0
replied on August 25, 2023

Yes.. I was thinking it was something like that.   I found just over 1000 entries which is accurate for the folder and all child entries for that folder.    What is interesting is that if I search for everything in that volume I only see 74 items totaling about 6 or 7GB.   That being said I am hoping that the Laserfiche cleanup services will clean up this mess tonight.   I have given it a few extra hours of maintenance window just in case.   Glad I found this before I went to production!  

 

0 0
replied on August 28, 2023

Right, once the migration completes, there should be no more data than what you started with. Same thing would happen when you terminated the workflow and pending transactions were canceled or in-flight ones were rolled back. 

The extra folders corresponding to the physical volumes in your logical "Archive" volume will not be deleted.

For anybody reading this thread in the future, might be worth stating that Try-Catch would have no effect on the process' logic unless the Laserfiche Server returns an error.

0 0
replied on August 28, 2023

All the errant files were removed from the drive during the maintenance window.   What I am attempting to do with the Try Catch is an administrative function that allows us to see if the archive drive is full, unavailable, etc.   It simply returns the error to the IT department and then allows the data to stay on the Default volume.   I am finding that the Drive Full error does not seem to return like I anticipated though.  The workflow just seems to go into a wait state and an error is never returned that kicks it to the Catch statement.  With my limited experience I am finding this application difficult to manage from and IT standpoint.  If you have any thoughts about that I would appreciate if you shared those with me or pointed me to an appropriate feed.   We have multiple integrations and I am tired of waiting to hear from the end user that something is not working.  

 

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.