xcopy, number of files limit?

[Anon]

I use xcopy through multiple 'Scheduled Tasks' to back-up files from
different directories, to a second physical hard drive. These tasks have
worked flawlessly for years, but recently I get a 0x4 exit code on one of
them (just one of them, the remainder still work correctly).

The only thing that has changed with the malfunctioning task--to the best of
my recollection--is that the number of files in the particular directory has
grown incrementally to over 28,000.

Does xcopy have a maximum permissible number of files before it ceases to
work, or can someone identify another cause of my problem?

Cheers.

[Ian]

-Early versions of XCOPY had file-count probs but I don't think recent ones
do.

A frequent problem with backups is that of over-long filenames. Filenames
are officially limted to 256 characters, but there are some circumstances
where apps can break this limit. One notorious example is Temporary Internet
Files.

If XCOPY hits an over-long filename it will bomb-out instead of just
skipping it, EVEN if /c is specified. This is a major issue as the entire
remainder of the backup is lost, not just the over-long name. The problem
affects many GUI programs too.

It's also possible the problem may be to do with permissions, though I don't
think permissions would normally cause the process to bomb-out.

[Pegasus (MVP)]

Post by Anon
I use xcopy through multiple 'Scheduled Tasks' to back-up files from
different directories, to a second physical hard drive. These tasks have
worked flawlessly for years, but recently I get a 0x4 exit code on one of
them (just one of them, the remainder still work correctly).
The only thing that has changed with the malfunctioning task--to the best of
my recollection--is that the number of files in the particular directory has
grown incrementally to over 28,000.
Does xcopy have a maximum permissible number of files before it ceases to
work, or can someone identify another cause of my problem?
Cheers.

I have seen a few cases where xcopy.exe bombed out due to
running out of memory when dealing with very large or very
many files. Try xxcopy.exe (downloadable from various sites)
or robocopy.exe (Windows Resource Kit).

On a separate issue: You're punishing yourself or your users
if you allow folders to have more than 5,000 files each. There
is a big speed penalty.

[Ron Martell]

Post by Anon
I use xcopy through multiple 'Scheduled Tasks' to back-up files from
different directories, to a second physical hard drive. These tasks have
worked flawlessly for years, but recently I get a 0x4 exit code on one of
them (just one of them, the remainder still work correctly).
The only thing that has changed with the malfunctioning task--to the best of
my recollection--is that the number of files in the particular directory has
grown incrementally to over 28,000.
Does xcopy have a maximum permissible number of files before it ceases to
work, or can someone identify another cause of my problem?

Are these files, or at least some of them, using Long File Names? If
so then you may be up against the limit for folder contents.

The maximum that a folder can hold is 65,534 directory entries. A
short (8 + 3) filename uses only a single entry but a long file name
uses a minimum of 3 directory entries, and even more if the name is
longer than 22 characters.

Good luck

Ron Martell Duncan B.C. Canada

[Tim Slattery]

Post by Ron Martell
The maximum that a folder can hold is 65,534 directory entries. A
short (8 + 3) filename uses only a single entry but a long file name
uses a minimum of 3 directory entries, and even more if the name is
longer than 22 characters.

True for FAT32 but not for NTFS. The only limit in NTFS is
4,294,967,295 billion files on a partition.

[Ron Martell]

Post by Tim Slattery

Post by Ron Martell
The maximum that a folder can hold is 65,534 directory entries. A
short (8 + 3) filename uses only a single entry but a long file name
uses a minimum of 3 directory entries, and even more if the name is
longer than 22 characters.

True for FAT32 but not for NTFS. The only limit in NTFS is
4,294,967,295 billion files on a partition.

You are correct Tim. Thanks for catching that one.

Ron Martell Duncan B.C. Canada

[Anon]

Post by Anon
I use xcopy through multiple 'Scheduled Tasks' to back-up files from
different directories, to a second physical hard drive. These tasks have
worked flawlessly for years, but recently I get a 0x4 exit code on one of
them (just one of them, the remainder still work correctly).
The only thing that has changed with the malfunctioning task--to the best
of my recollection--is that the number of files in the particular
directory has grown incrementally to over 28,000.
Does xcopy have a maximum permissible number of files before it ceases to
work, or can someone identify another cause of my problem?
Cheers.

I gave up trying to get xcopy to work, and instead I've started using
robocopy as was suggested.
Thanks for the help.