Anonymous_User Absent Member.
Absent Member.
999 views

Practical limit for number of objects in Net Folders with JITS

I am trying to set up a Net Folder on OES in Filr 3.2 small deployment
(test system for our large deployment production system) with around
17,000 directories at the top level. After creation and with JITS only
the Net Folder shows up empty. Another one with about 8,000 directories
works just fine.

It finally worked with the big folder also after adjusting the maximum
wait time in the Net Folder Global Settings to 40 seconds.

So I am interested in any opionion or experience regarding the practical
limit for the number of entries in a directory together with JITS or
with scheduled synchronization. I do not want my users to wait for too
long time. 40s is quite a while. Might disabling the use of directory
rights in the global Net Folder settings help to speed up things?

Günther
0 Likes
5 Replies
AutomaticReply Absent Member.
Absent Member.

Re: Practical limit for number of objects in Net Folders with JITS

Günther,

It appears that in the past few days you have not received a response to your
posting. That concerns us, and has triggered this automated reply.

These forums are peer-to-peer, best effort, volunteer run and that if your issue
is urgent or not getting a response, you might try one of the following options:

- Visit https://www.microfocus.com/support-and-services and search the knowledgebase and/or check
all the other self support options and support programs available.
- Open a service request: https://www.microfocus.com/support
- You could also try posting your message again. Make sure it is posted in the
correct newsgroup. (http://forums.microfocus.com)
- You might consider hiring a local partner to assist you.
https://www.partnernetprogram.com/partnerfinder/find.html

Be sure to read the forum FAQ about what to expect in the way of responses:
http://forums.microfocus.com/faq.php

Sometimes this automatic posting will alert someone that can respond.

If this is a reply to a duplicate posting or otherwise posted in error, please
ignore and accept our apologies and rest assured we will issue a stern reprimand
to our posting bot.

Good luck!

Your Micro Focus Forums Team
http://forums.microfocus.com



0 Likes
Knowledge Partner
Knowledge Partner

Re: Practical limit for number of objects in Net Folders wit

=?UTF-8?Q?G=c3=bcnther_Schwarz?=;2464929 wrote:
I am trying to set up a Net Folder on OES in Filr 3.2 small deployment
(test system for our large deployment production system) with around
17,000 directories at the top level. After creation and with JITS only
the Net Folder shows up empty. Another one with about 8,000 directories
works just fine.

It finally worked with the big folder also after adjusting the maximum
wait time in the Net Folder Global Settings to 40 seconds.

So I am interested in any opionion or experience regarding the practical
limit for the number of entries in a directory together with JITS or
with scheduled synchronization. I do not want my users to wait for too
long time. 40s is quite a while. Might disabling the use of directory
rights in the global Net Folder settings help to speed up things?

Günther


You might consider enabling indexing of the Net Folder in question which will make things faster, IMO.
Granted, you'll need to have some indexing power, but it does help.

Although it seems my initial JITS setting is at 60 seconds, although I can probably lower that now. Originally our Filr servers were across a WAN link to where the NAS was, so the setting had to be increased.

Also, keep in mind you were testing with a "small" deploy which I believe is everything on one box, which may have also counted for a delay for a data structure that large.

We have a clustered setup for Prod with 2 Index servers.

Not sure if the rights of the Filr user would have much to do with it, as I thought it would try to use the actual authenticated user's rights when searching/displaying. I thought the Filr proxy user was only used for either full-content indexing (scheduled indexing) and when sharing with external users.

But I could be wrong on that last bit.
0 Likes
Knowledge Partner
Knowledge Partner

Re: Practical limit for number of objects in Net Folders with JITS

On Fri, 25 Aug 2017 14:41:30 GMT, Günther Schwarz <strap@gmx.de>
wrote:

>I am trying to set up a Net Folder on OES in Filr 3.2 small deployment
>(test system for our large deployment production system) with around
>17,000 directories at the top level. After creation and with JITS only
>the Net Folder shows up empty. Another one with about 8,000 directories
>works just fine.
>
>It finally worked with the big folder also after adjusting the maximum
>wait time in the Net Folder Global Settings to 40 seconds.
>
>So I am interested in any opionion or experience regarding the practical
>limit for the number of entries in a directory together with JITS or
>with scheduled synchronization. I do not want my users to wait for too
>long time. 40s is quite a while. Might disabling the use of directory
>rights in the global Net Folder settings help to speed up things?


Günther,

When setting up a new Net Folder, I usually kick off a manual index to
get things going, instead of just relying on JIT. I also tend to do
this on a Friday so it can run the weekend without impacting much. But
our business hours permit that. We run a small deployment. While we
have lots of folder and files, we only have 70 users and not all of
them actually use Filr.

I asked around about practical limits. Don't have anything specific
regarding number of directories. But the recommendation seems to be
that a small deployment is best for proof of concept, labs, and small
businesses - say up to 150 users. But number of users alone isn't the
only factor. A system with 250 users and 100GB may suffer from less
load then a system with 50 users and 30TB. What it comes down to is
there isn't an easily stated cut-off point for using a small vs large
deployment.

In your case, you will probably need to tweak some settings for the
small deployment if you want to test it against your production
environment. And increase RAM, CPU, and JVM settings accordingly.

Hope that helps a little.

--
Ken
Knowledge Partner

If this post was helpful and you are logged into the web interface,
please show your appreciation and click on the star below... Thanks!

Create and vote for enhancements!
https://www.microfocus.com/products/enhancement-request.html
--
Ken
Knowledge Partner

Create and vote for enhancements!
https://www.microfocus.com/products/enhancement-request.html
0 Likes
G_ntherSchwarz Absent Member.
Absent Member.

Re: Practical limit for number of objects in Net Folders with JITS

On 09/01/2017 06:54 PM, KeN Etter wrote:
> When setting up a new Net Folder, I usually kick off a manual index to
> get things going, instead of just relying on JIT. I also tend to do
> this on a Friday so it can run the weekend without impacting much. But
> our business hours permit that. We run a small deployment. While we
> have lots of folder and files, we only have 70 users and not all of
> them actually use Filr.
>
> I asked around about practical limits. Don't have anything specific
> regarding number of directories. But the recommendation seems to be
> that a small deployment is best for proof of concept, labs, and small
> businesses - say up to 150 users. But number of users alone isn't the
> only factor. A system with 250 users and 100GB may suffer from less
> load then a system with 50 users and 30TB. What it comes down to is
> there isn't an easily stated cut-off point for using a small vs large
> deployment.
>
> In your case, you will probably need to tweak some settings for the
> small deployment if you want to test it against your production
> environment. And increase RAM, CPU, and JVM settings accordingly.



Thank you very much indeed for your suggestions. We use a small
deployment for testing only. So the production system will be much more
powerful. Still it might be a question of try and error if the new Net
Folders can be delivered reliably and in time for the users.
I will do an initial sync. But scheduled synchronization will not be
possible. It will have to work with JITS due to the amount of data and
regular changes.

Günther

0 Likes
Knowledge Partner
Knowledge Partner

Re: Practical limit for number of objects in Net Folders wit

Günther Schwarz;2465647 wrote:
On 09/01/2017 06:54 PM, KeN Etter wrote:
> When setting up a new Net Folder, I usually kick off a manual index to
> get things going, instead of just relying on JIT. I also tend to do
> this on a Friday so it can run the weekend without impacting much. But
> our business hours permit that. We run a small deployment. While we
> have lots of folder and files, we only have 70 users and not all of
> them actually use Filr.
>
> I asked around about practical limits. Don't have anything specific
> regarding number of directories. But the recommendation seems to be
> that a small deployment is best for proof of concept, labs, and small
> businesses - say up to 150 users. But number of users alone isn't the
> only factor. A system with 250 users and 100GB may suffer from less
> load then a system with 50 users and 30TB. What it comes down to is
> there isn't an easily stated cut-off point for using a small vs large
> deployment.
>
> In your case, you will probably need to tweak some settings for the
> small deployment if you want to test it against your production
> environment. And increase RAM, CPU, and JVM settings accordingly.



Thank you very much indeed for your suggestions. We use a small
deployment for testing only. So the production system will be much more
powerful. Still it might be a question of try and error if the new Net
Folders can be delivered reliably and in time for the users.
I will do an initial sync. But scheduled synchronization will not be
possible. It will have to work with JITS due to the amount of data and
regular changes.

Günther


We run regular scheduled syncs on our "home" directory server (which WAS across a 1 GB WAN link, BTW), and it works fine.

We have approx. 2,600 user home directories with approx. 12 million files/folders that is changing daily.

We have two filr servers, 2 index servers, and one database server in a "clustered" environment.

Now that we're at 10 GB connections (no longer across WAN link), it's even better. We still use JITS in combination with the scheduled sync.
I don't recall seeing the scheduled sync "still running" the next day on the nightly ones.
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.