roehmdo1 Absent Member.
Absent Member.
6426 views

OES 2015 SP1 After May Updates

Has anyone else noticed that novell-named uses 100% of the CPU after applying the May 2017 OES updates ??.. We have 3 different servers showing the same thing..
If I try to reboot the server, It hangs on trying to unload bind...I see that bind was updated with the may 2017 updates.
any guidance would be appreciated.. It normally takes about 24 hours after a reboot for the CPU to go to 100%
Labels (2)
0 Likes
45 Replies
Anonymous_User Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

Hi,

I see the same thing at least on my PDC DSfW server, haven't upgraded
pure OES servers with running named yet. Do you use DSfW on your
server(s) (that would by nice info for my open SR)?

What actually hangs during reboot is /usr/sbin/rndc (called by the init
scripts). You can check before with:

rcnovell-named status

If it hangs, press CTRL-C and run:

killproc -KILL /opt/novell/named/bin/novell-named
rcnovell-named start

This should fix it for some time. Didn't try downgrading to
novell-bind-9.7.0-0.47.1 yet because of the open SR.

Franz.


Am 07.06.17 um 13:54 schrieb roehmdo:
>
> Has anyone else noticed that novell-named uses 100% of the CPU after
> applying the May 2017 OES updates ??.. We have 3 different servers
> showing the same thing..
> If I try to reboot the server, It hangs on trying to unload bind...I see
> that bind was updated with the may 2017 updates.
> any guidance would be appreciated.. It normally takes about 24 hours
> after a reboot for the CPU to go to 100%
>
>


0 Likes
roehmdo1 Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

no this is a pure OES server.. I do not use DSFW on them..
these are pure SLES 11SP4 OES2015 servers
thanks for any input you can give me on a fix when they come up with it
and yes - if i use the kill command the cpu goes back normal and then restart rcnovell-named it will eventually creep back up to 100%
0 Likes
jfeyen Contributor.
Contributor.

Re: OES 2015 SP1 After May Updates

roehmdo;2459116 wrote:
no this is a pure OES server.. I do not use DSFW on them..
these are pure SLES 11SP4 OES2015 servers
thanks for any input you can give me on a fix when they come up with it
and yes - if i use the kill command the cpu goes back normal and then restart rcnovell-named it will eventually creep back up to 100%


Hi,

I patched my server last weekend and I have the same issue.
Do you have a solution and do you have an SR ticket?

Kr,

Joeri
0 Likes
Anonymous_User Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

Am 08.06.17 um 08:06 schrieb jfeyen:
>
> roehmdo;2459116 Wrote:
>> no this is a pure OES server.. I do not use DSFW on them..
>> these are pure SLES 11SP4 OES2015 servers
>> thanks for any input you can give me on a fix when they come up with it
>> and yes - if i use the kill command the cpu goes back normal and then
>> restart rcnovell-named it will eventually creep back up to 100%

>
> Hi,
>
> I patched my server last weekend and I have the same issue.
> Do you have a solution and do you have an SR ticket?


Hi,

no solution yet, not even tracked down the culprit. It's not even clear
who fails first, named or ndsd?

What do "ndsrepair -T" and "ndsrepair -E" report for you when named hangs?

The SR is 101075606951, the subject is about authentication failures
against DSfW. I had another SR opened for named, but the techs thought
they are connected, so they merged the SRs.

Franz
0 Likes
jfeyen Contributor.
Contributor.

Re: OES 2015 SP1 After May Updates

Hi,

On my server also ndsd crashed , novell-named kept running against 100% .

I opened an SR 101076180191.

Now you have the same issue, i think ndsd and novell-named are linked to each other.

They asked me to send a supportconfig , but they did not find anything.

Now they asked me to put novell-named in debug mode.

Then when it occurs again I have to send a supportconfig again.

What do "ndsrepair -T" and "ndsrepair -E" report for you when named hangs?
When my server crashes again I will check it again.

I hope they will fix it soon...

Joeri
0 Likes
Anonymous_User Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

Am 08.06.17 um 19:24 schrieb jfeyen:
> -What do "ndsrepair -T" and "ndsrepair -E" report for you when named
> hangs?-


I get the error -649 everywhere.

Franz

0 Likes
roehmdo1 Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

anyone see any patches for this yet ?
0 Likes
dbgallo1 Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

https://www.novell.com/support/kb/doc.php?id=7020907 looks like the solution, still PTF and not in the patch channel
0 Likes
jfeyen Contributor.
Contributor.

Re: OES 2015 SP1 After May Updates

dbgallo;2459520 wrote:
https://www.novell.com/support/kb/doc.php?id=7020907 looks like the solution, still PTF and not in the patch channel


I saw the same error when ndsd crashed on the 3th of June on my server:
/var/opt/novell/eDirectory/log # less ndsd.log
/opt/novell/eDirectory/sbin/ndsd: symbol lookup error: /opt/novell/eDirectory/lib64/nds-modules/libncpengine.so: undefined symbol: _Z24GetConnSockFDIPAddrandDNiPiPPcPt

However this is not a fix for novell-named ...

No response back from novell on the issue ...

Kr,

Joeri
0 Likes
Knowledge Partner
Knowledge Partner

Re: OES 2015 SP1 After May Updates

Am 14.06.2017 um 12:44 schrieb jfeyen:
>
> dbgallo;2459520 Wrote:
>> https://www.novell.com/support/kb/doc.php?id=7020907 looks like the
>> solution, still PTF and not in the patch channel

>
> I saw the same error when ndsd crashed on the 3th of June on my server:
> /var/opt/novell/eDirectory/log # less ndsd.log
> /opt/novell/eDirectory/sbin/ndsd: symbol lookup error:
> /opt/novell/eDirectory/lib64/nds-modules/libncpengine.so: undefined
> symbol: _Z24GetConnSockFDIPAddrandDNiPiPPcPt
>
> However this is not a fix for novell-named ...


Named doesn't run without ndsd. Your problem with named is very likely
simply a result of ndsd dieing.

CU,
--
Massimo Rosen
Micro Focus Knowledge Partner
No emails please!
http://www.cfc-it.de
CU,
--
Massimo Rosen
Micro Focus Knowledge Partner
No emails please!
http://www.cfc-it.de
0 Likes
Anonymous_User Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

Hi,

this is not the solution for the named hang, I just saw the hang with
the patch from the channel applied.
As a workaround I've put a file into /etc/cron.d/ that starts this
script every 5 minutes:

#!/bin/bash

/usr/bin/timeout 20 /usr/sbin/rcnovell-named status &> /dev/null

if [ $? -eq 124 ]; then
# Produce a coredump if possible
# (needs SOFTCORELIMIT="unlimited" in /etc/sysconfig/ulimit
# and a reboot(?) afterwards to make it effective)
/sbin/killproc -v -SEGV /opt/novell/named/bin/novell-named
echo "killproc -SEGV exited with status $?."
/bin/sleep 10
# -KILL just to make sure the process is really gone
/sbin/killproc -v -KILL /opt/novell/named/bin/novell-named
echo "killproc -KILL exited with status $?."
/bin/sleep 10
/usr/sbin/rcnovell-named restart
fi

An earlier version of the script (forgot SEGV for the coredump 😞 )
just triggered today, even though the patch was already applied.
But what I could see that it's likely a hanging reconfiguration thread
that is related to this. In the logs there's this:

Jun 19 08:47:33 dsfw2 [NCPL]: created thread for dynamic reconfiguration....
Jun 19 08:47:33 dsfw2 [NCPL]: Starting the dynamic reconfiguration
Jun 19 08:47:33 dsfw2 [NCPL]: Reconfiguring all the zones.
Jun 19 08:47:33 dsfw2 [NCPL]: Read the configuration for the zone:
your_domain.your_context of type: 1 with return code: 0
.... more zones as usual

But, what was missing is the "closure", which usually follows within 1
or 2 seconds:

Jun 19 08:47:xx dsfw2 [NCPL]: Dynamic reconfiguration completed.
Jun 19 08:47:xx dsfw2 [NCPL]: dynamic reconfiguration thread exiting
gracefully

I'll re-open our SR now.

Franz


Am 13.06.17 um 19:24 schrieb dbgallo:
>
> https://www.novell.com/support/kb/doc.php?id=7020907 looks like the
> solution, still PTF and not in the patch channel
>
>


0 Likes
jfeyen Contributor.
Contributor.

Re: OES 2015 SP1 After May Updates

Hi,

Support has asked to apply the June hotpatch for ndsd .

But 20 hours later the novell-named issue occurred again.

They asked for the debug logs from named.
I will provide them on the next issue with named.

Joeri
0 Likes
jfeyen Contributor.
Contributor.

Re: OES 2015 SP1 After May Updates

Any updates anyone?
0 Likes
Highlighted
roehmdo1 Absent Member.
Absent Member.

Re: OES 2015 SP1 After May Updates

Im still seeing the issue with named after applying the June Patch
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.