You are viewing limited content. For full access, please sign in.

Question

Question

How does moving files generate 150GB of extra data?

asked on May 4, 2021

Last night I added a new empty drive to a server. The original drive was 50GB free of 1.4TB total.

I created a new volume, on the new drive, called Archive and I migrated 500GB of files to the new archive.

The original drive now has 400GB free.

How does 150GB of extra data appear when moving files? That is a LOT of unknown data.

0 0

Replies

replied on May 4, 2021

As discussed previously, migration is a copy to the new drive followed by a deletion from the old drive. And deletion happens on a background thread. Deleting 500GB takes a while so it makes sense that, initially, the free space would be slightly lower than the amount of data you moved out.

0 0
replied on May 4, 2021

Oh I thought deletion was instantaneous since it is only writing a couple bytes indicating the new blocks available for use. For example if I Shift+Delete in Windows to delete with no recycle, it will only write a few bytes to the drive regardless of how much data I deleted.

Is it writing zeros to all the blocks?

Is there a way to get an ETA after waiting overnight? Amazon charges by time for the temp drive.

0 0
replied on May 4, 2021

Repositories have a Secure Data Deletion option you can enable that makes LFS overwrite deleted files 4, 7, 10 or 13 times. It's disabled by default, so likely not the case here.

Also want to note that 1 TB of gp2/3 EBS SSD storage on AWS is approximately $0.02/hour, so I wouldn't stress too much about the cost for any task on the order of days.

0 0
replied on May 4, 2021

Got it, but I am sure the person who is paying for the drive knows this. I just think they want an idea of when this will be complete.

I moved 500GB of data from one location to another, I have 350GB of free space now after the move. The question is, how can I get my data back if it is increasing every time I move it.

If I don't get my 500GB back, I am going to request more storage space, so that I can move the extra 150GB of unknown data back to the drive.

0 0
You are not allowed to follow up in this post.

Sign in to reply to this post.