Netware 5.10 SP11 slow when over 4000 files in folder

[ericvaningen]

I have gotten to manage a new server running NW5.10 SP11 and any time a folder has more than 4000 files its performance for all users drops to a crawl.

It has 3GB RAM and 2 Harddisk, 1 for Sys and one for user data.
Both are 95% full.

As soon I deleted enough files to get from say 4000 back to 2500 things are speedy again.
For example, running a dir in a directory with more than 4000 files will takes a long time display each line so slow you can read it with no problem, after deleting old files and running a dir with less than 4000 files, the lines fly fast on the screen.

Here is some of the Info I got:

General Information
User Count: 575
Logged-in Users: 385
Maximum Logins: 505
Connection Count: 675
Maximum Connections: 0

File System
Reads (Kbytes):
Writes (Kbytes): 1551648
Maximum Open Files: 3658588
Open Files: 200000
Maximum Record Locks: 314
Record Locks: 20000
Maximum Directory Tree Depth: 331


File caching
Dirty Disk Cache Delay Time 3sec
Maximum Concurrent Disk Cache Writes 750
Minimum File Cache Buffers 20
Minimum File Cache Report Threshold 20
Read Ahead Enabled ON
Read Ahead LRU Sitting Time Threshold 10sec

Directory caching
Directory Cache Allocation Wait Time 2sec
Directory Cache Buffer NonReferenced Delay 5sec
Dirty Directory Cache Delay Time 1sec
Maximum Concurrent Directory Cache Writes 75
Maximum Directory Cache Buffers 4000
Maximum Number Of Directory Handles 20
Maximum Number Of Internal Directory Handles 100
Minimum Directory Cache Buffers 150


I have asked to former admin if he knew about this problem, and he said he had a batch job running to clean up the most common folders that would normally go over 4000 files.

I Believe this might just be a tuning issues, it has 3GB ram and the problem is clearly not related to the number of users hitting it, since every goes down the drain with the someone starts accessing a directory with over 4000 files in them. (Files like .Doc, . Dbf., or lots of 1kb temp file etc)

I have tried to find a tuning document specific for this issue but I might not have found to right keyword to search because I have not find something that might help me.

Has anyone seen this before and found a solution? Or what should I be looking for?

[AndersG]

Ericvaningen,
> I have gotten to manage a new server running NW5.10 SP11 and any time a
> folder has more than 4000 files its performance for all users drops to a
> crawl.

There is no 5.10 SP11. Please type VERSION at the server console.

- Anders Gustafsson (Sysop)
The Aaland Islands (N60 E20)


Novell has a new enhancement request system,
or what is now known as the requirement portal.
If customers would like to give input in the upcoming
releases of Novell products then they should go to
http://www.novell.com/rms

[ericvaningen]

AndersG;1982826 wrote:
Ericvaningen,
> I have gotten to manage a new server running NW5.10 SP11 and any time a
> folder has more than 4000 files its performance for all users drops to a
> crawl.

There is no 5.10 SP11. Please type VERSION at the server console.

- Anders Gustafsson (Sysop)
The Aaland Islands (N60 E20)


Novell has a new enhancement request system,
or what is now known as the requirement portal.
If customers would like to give input in the upcoming
releases of Novell products then they should go to
http://www.novell.com/rms

Correct, it is Netware 5.1 SP8.

Eric

[AndersG]

Ericvaningen,
> Correct, it is Netware 5.1 SP8.
>
OK. And is the volume TFS or NSS? See:
http://www.novell.com/support/php/search.do?cmd=displayKC&docType=kc&externalId=10021744&sliceId=&docTypeID=DT_TID_1_1&dialogID=75202446&stateId=0%200%20146809906

- Anders Gustafsson (Sysop)
The Aaland Islands (N60 E20)


Novell has a new enhancement request system,
or what is now known as the requirement portal.
If customers would like to give input in the upcoming
releases of Novell products then they should go to
http://www.novell.com/rms

[ericvaningen]

The volumes are TFS.
The server has 3GB of physical RAM and I like to used the most of it.
Going through TID 10021744, Slow File System Performance in a directory with Excessive files, I found all values on the server being defaults.

I like to set these and if possible others to a value so that the 3GB would be put to uses, and tune it after starting with a good starting value.

This is one of our main fileserver where a lot of Clipper executables are run from, some of the production output is also written here, but most is written onto another NW6.5 SP8 Server.

Last night we updated the Lan drivers and have all servers now on Gigabit (Auto) and the same on the Switch ports (auto).
So far only the backups have really shown to have taken benefit of this change 🙂

I have attached a screen shot of the Server Memory Statistics and next I post the general information.

[ericvaningen]

General Server Information.

[AndersG]

Ericvaningen,
> 10021744
>
The best recommendation I can give is to follow the guidlines in that
TID and see if it helps.

- Anders Gustafsson (Sysop)
The Aaland Islands (N60 E20)


Novell has a new enhancement request system,
or what is now known as the requirement portal.
If customers would like to give input in the upcoming
releases of Novell products then they should go to
http://www.novell.com/rms