Highlighted
Knowledge Partner
Knowledge Partner

Re: This node is not a member of a cluster

Jump to solution

Also please post the output of

cluster stats display

(really "stats" as opposed to "status"). I'd currently suspect corruption in the SBD partition.

 

0 Likes
Highlighted
Valued Contributor.
Valued Contributor.

Re: This node is not a member of a cluster

Jump to solution


● novell-ncs.service - Novell Cluster Services(NCS)
Loaded: loaded (/usr/lib/systemd/system/novell-ncs.service; enabled; vendor preset: disabled)
Active: active (running) since Fri 2020-05-08 16:43:00 SAST; 2min 35s ago
Docs: man:cluster(8)
Process: 16588 ExecStart=/opt/novell/ncs/bin/ldncs (code=exited, status=0/SUCCESS)
Tasks: 7 (limit: 512)
CGroup: /system.slice/novell-ncs.service
├─16771 /usr/bin/python /opt/novell/ncs/bin/ncs-configd.py
├─16866 /opt/novell/ncs/bin/ncsdkd
├─16870 /usr/bin/python /opt/novell/ncs/bin/ncs-resourced.py /etc/opt/novell/ncs
├─16873 /opt/novell/ncs/bin/ncs-emaild
├─16876 /bin/sh /opt/novell/ncs/bin/ldncs
└─16877 /usr/bin/perl /sbin/cluster join

May 08 16:42:51 stats-fs1 systemd[1]: Starting Novell Cluster Services(NCS)...
May 08 16:42:52 stats-fs1 ldncs[16588]: Mounting adminfs at /admin ... already mounted..done
May 08 16:43:00 stats-fs1 ncsdkd[16866]: Created semaphore semid=327690
May 08 16:43:00 stats-fs1 ncs-emaild[16873]: Starting...
May 08 16:43:00 stats-fs1 ncs-emaild[16873]: Started
May 08 16:43:00 stats-fs1 systemd[1]: Started Novell Cluster Services(NCS).
stats-fs1:~ # cluster stats display

There was an error issuing the stats command.
stats-fs1:~ #

0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: This node is not a member of a cluster

Jump to solution

And on the other node (the one which is currently working)?

 

0 Likes
Highlighted
Valued Contributor.
Valued Contributor.

Re: This node is not a member of a cluster

Jump to solution

it just freezes


stats-fs2:~ # cluster stats display

 

0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: This node is not a member of a cluster

Jump to solution

That all points to corruption in the SBD partition (provided everything's fine from the "physical" aspect). I'd delete and recreate it. If you like you can down node1 and recheck "cluster stats display" on node2, eventually with an intermediate "sbdutil -i".

 

0 Likes
Highlighted
Valued Contributor.
Valued Contributor.

Re: This node is not a member of a cluster

Jump to solution


stats-fs2:~ # cluster stats display

Report taken: startTime= Thu Jan 9 09:19:01 2020, endTime= Fri May 8 17:29:54 2020
node=1, name=stats-fs2, heartbeat=1, tolerance=8
0x=20063769, 1x=58551, 2x=141, 3x=45, 4x=16, 5x=5, 6x=1, 7x=1, 8x=1

node 0, name stats-fs1, maxTicks=10.352 sec at Sat Apr 4 18:08:11 2020, minTicks=0.000 sec, lastTickDate Fri May 8 17:29:54 2020
1.020, 1.020, 1.020, 1.024, 1.024, 1.020, 1.020, 1.028, 1.024, 1.024, 1.028, 1.028, 1.028, 1.024, 1.028

node 1, name stats-fs2, maxTicks=5.300 sec at Mon Mar 30 22:00:54 2020, minTicks=0.714 sec, lastTickDate Fri May 8 17:29:54 2020
1.024, 1.028, 1.028, 1.028, 1.024, 1.024, 1.028, 1.040, 1.024, 1.028, 1.028, 1.032, 1.020, 1.028, 1.028

SBD STATS: maxTicks=6.814 sec at Mon Mar 30 22:00:53 2020, minTicks=3.915 sec, lastTickDate Fri May 8 17:29:51 2020
4.106, 4.017, 4.044, 4.008, 4.018, 4.002, 4.020, 4.023, 4.016, 4.002, 4.021, 4.022, 4.022, 4.014, 4.021
stats-fs2:~ # cluster view

Cluster fscluster
This node stats-fs2 [ epoch 23 master node stats-fs2 ]
Cluster nodes [ stats-fs1, stats-fs2 ]

stats-fs2:~ #

 

0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: This node is not a member of a cluster

Jump to solution

Has this been run with the first node down? Both nodes have identical lastTickDates, so they seem up.

What did you do to get the command complete (as you've mentioned it's been hanging before)?

 

0 Likes
Highlighted
Valued Contributor.
Valued Contributor.

Re: This node is not a member of a cluster

Jump to solution

rcnovell-ncs stop on node1 (broken node)

 


stats-fs1:~ # rcnovell-ncs status
● novell-ncs.service - Novell Cluster Services(NCS)
Loaded: loaded (/usr/lib/systemd/system/novell-ncs.service; enabled; vendor preset: disabled)
Active: inactive (dead)
Docs: man:cluster(8)
stats-fs1:~ # grep nodeid /var/opt/novell/ncs/gipc.conf
nodeid 10.131.145.104 0
nodeid 10.131.145.104 0
nodeid 10.131.145.105 1
stats-fs1:~ #

0 Likes
Highlighted
Knowledge Partner
Knowledge Partner

Re: This node is not a member of a cluster

Jump to solution

The output from "cluster stats" clearly indicates that two nodes write to the SBD partition. Is this a physical or virtual cluster?

 

View solution in original post

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.