Version 25.xx crashes backing up many folders/files

capun · Post by **capun** » 24 Nov 2023 21:03

I am not 100% when it started but at least with 25.10.xxxx and 25.20.0000.

I have a large internal HD that I use to back-up with other SSD drives data. I also have an external HD that I use to backup the internal HD, sort of like a mirror.

Each of the SSD's are Backed-up to a folder in the internal HD. For example the Internal HD Driver (X:) has a folder DriveD_Backup and so on

I set one pane to the D: Drive and the other pane to the X:DriveD_Backup folder

I then right click and Drag all the files from the D:Drive and and Drop them in the X:DriveD_Backup selecting the Backup Here option

No problems in the past, but now the XYCopy background process starts then it crashes with a "XYCopy has stopped working...."

If I copy a bunch of folders a bit of the time, I think XYCopy stops working with large folders with many sub-folders and files. In one case a folder with
1142 sub-Folders and 239 files at the root, I haven't figure out how many total files. The folder is 1.3 GB

Just a side note, if I open the Task Manager I see an Xcopy (32 bit) and a XYPlorer (32 bit) processes. Is that correct or the installer copied the wrong version. I am running Windows 10 Pro 64-bit up to date.

Any clues what is the problem?

capun · Post by **capun** » 24 Nov 2023 21:07

I didn't see an "Edit" button

I downgraded to 24.80.xxxx and it works.

Post by **admin** » 24 Nov 2023 21:36

Can you give a rough estimate of the number of files? More than 100,000? More than 1,000,000?

capun · Post by **capun** » 24 Nov 2023 22:48

The last numbers I gave you came from XYPlorer, I think it does not counts the files under each sub-folder.

The actual number to be transferred (Windows File Manager) is 5494 Folders, 150,070 files, folder size is 474 GB

Another failing folder is 11,974 Folders, 119,919 Files, 68.1 GB

Yet Another is 41,322 Folders 595,495 Files 184 GB

Post by **admin** » 24 Nov 2023 23:58

Thanks for the report.

Expect a fix tomorrow.

Post by **admin** » 25 Nov 2023 11:33

Okay, I was able to reproduce it. It seems to stop working when approaching 100,000 files, can you confirm this?

Post by **admin** » 25 Nov 2023 15:47

Should be fixed in the latest beta (v25.20.0004 - 2023-11-25 15:46).

Thanks again, good bug!

capun · Post by **capun** » 26 Nov 2023 07:44

I need to re-install it again and retry it

Is that 100k files both written and skipped?

Post by **admin** » 26 Nov 2023 08:59

Yes, both written and skipped, but I don't need your reply anymore. I'm sure the bug is fixed in the current release (v25.20.0100).

capun · Post by **capun** » 26 Nov 2023 23:14

Seems to be fixed in the 25.20.0100

Filehero · Post by **Filehero** » 30 Nov 2023 20:22

Is that possibly related?

It's popping up once "Sync Folders" on an already synced target (done with FreeFileSync) reaches 100%.

XYplorer version: 25.20.0106

Code: Select all

Error:  	9 (00000009)
Desc:   	Index außerhalb des gültigen Bereichs
Dll:    	0
Proc:   	KFW@338, cntItems=152300, cntItemFolders=15418, i/ubSource=52178/19, cntFound=3

Source: 	XYCOPY
XY ver: 	2.10.0237
OS:     	Windows 10
Date:   	30.11.2023 20:11:44

Post by **admin** » 30 Nov 2023 20:56

Hmmm. This has probably been going on for a long time, but only recently does XYcopy show this kind of error. I'll check that tomorrow.

BTW, do you often see these layout failures?

Filehero · Post by **Filehero** » 30 Nov 2023 21:49

admin wrote: ↑30 Nov 2023 20:56 BTW, do you often see these layout failures?

Yes, since around beginning of November when I upgraded to Win 11 and I decided to rebuild the target drive "T:" from scratch.

Besides the visuals I noticed a very weird overall behavior wich XYcopy background jobs: the copy dialog every once in a while just vanished and left another "stale" job in the queue. On retry with a given XY session it was like "rinse & repeat", and these jobs accumulated over time as shown when clicking on the "background job queue button" in the status bar.
However, clicking on any job entry did do nothing: no new (progress) popup, no error message - simply nothing. Restarting XY did clear the queue - but just to prepare it for the next round.

I didn't open a bug because to me there was no clear way of reproduction (for instance, is it the file number or the sheer summed size?) and the runtime for a simple test was muuuuuch to high.

I think the origin might be related to

Code: Select all

v25.00.0207 - 2023-10-24 22:34
    % Heavy Duty Performance: During several tests with huge folders (> 100,000 items), 
      several bottlenecks were identified and eliminated, i.e. replaced by more efficient 
      algorithms.

Post by **admin** » 30 Nov 2023 23:27

XYcopy shows this kind of errors only since v25.20.0101 - 2023-11-26 13:10. Before it just crashed silently.

You experienced both types of mishaps. Both will end tomorrow.

The layout problem is not related to this AFAICS. I'll put an end to that as well.

Post by **admin** » 01 Dec 2023 09:27

What's your screen resolution, 125%?

XYplorer Beta Club

Version 25.xx crashes backing up many folders/files

Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files

Re: Version 25.xx crashes backing up many folders/files