Highlighted
Honored Contributor.
Honored Contributor.
5694 views

[ArcMC] Restart all appliance's processes

Jump to solution

Dear All,

I have an ArcSight Management center appliance, which works fine but sometimes per month, it shows me this message from web interface:

The application is currently unavailable. Please retry shortly.

The connectors are up and process messages, but seems that the web service is unavailable. But I can't manage the connectors.

Refering to the administrators guide, the command to restart the processes is:

<install_dir>/current/arcsight/arcmc/bin/arcmcd <command>

However, this script doesn't exist in my appliance (I think is for software versions), under the /etc/init.d directory:

[root@arcmc init.d]# ls -lart

total 176

-r-xr-xr-x.  1 root root  2053 Apr 29  2014 arcsight_sshd

-rw-r--r--.  1 root root  1160 Dec 22  2014 README

-rwxr-xr-x.  1 root root  6630 Sep 16  2015 network

-rwxr-xr-x.  1 root root  2989 Sep 16  2015 netconsole

-rwxr-xr-x.  1 root root   476 Nov  7  2015 random

-rwxr-xr-x.  1 root root  4869 Jan 29 04:49 postgresql

-rwxr-xr-x.  1 root root  3556 Feb  3 19:11 arcsight_ftpd

-rwx------.  1 root root   813 Feb 27 01:59 platform_upgrade

-rwx------.  1 root root   689 Feb 27 01:59 arcsight_snmp

-rwx------.  1 root root  6534 Feb 27 01:59 arcsight_restore

-rwx------.  1 root root  4495 Feb 27 01:59 arcsight_aps

-rwxr-xr-x.  1 root root  4386 Feb 27 02:00 stripmac

-rwxr-xr-x.  1 root root 15209 Feb 27 02:00 platform_enable

-rwxr-xr-x.  1 root root  2748 Feb 27 02:00 arcmultipath

-rwxr-xr-x.  1 root root  3692 Feb 27 02:04 apache

-rwxr-xr-x.  1 root root   188 Mar  5 00:06 arcsight_prepare

-rwxr-xr-x.  1 root root  1498 Mar  5 00:06 arcsight_mconfig

-rwxr-xr-x.  1 root root  9622 Mar  5 00:06 arcsight_logger

-rw-r--r--.  1 root root 13971 Mar 10 20:53 functions

drwxr-xr-x. 10 root root  4096 Mar 10 20:53 ..

-rwxr-xr-x.  1 root root   813 Mar 10 20:54 file_perm_bootup

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_2

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_4

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_1

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_3

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_6

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_7

-rwxr-xr-x.  1 root root  2567 Jun 27 09:55 arc_appliance_connector_8

-rwxr-xr-x.  1 root root  2567 Jul  7 11:37 arc_appliance_connector_5

drwxr-xr-x.  2 root root  4096 Jul 11 08:37 .

The arcsight_sshd is not similar with the arcmcd at all, it just give me the PID

[root@arcmc init.d]# ./arcsight_sshd status

ArcSight SSHD (1409) is running.

Any ideas of how to restart the arcmc processes?

Best regards,

Karl.

Labels (3)
0 Likes
1 Solution

Accepted Solutions
Highlighted
Honored Contributor.
Honored Contributor.

Hi,

After several months investing this issue, we finnaly conclude that monit daemon is the key.

However, at least in this appliance (arcmc 2.2) the monit daemon was not activated, so we have to started mannualy:

/opt/local/monit/bin/monit -Ic /etc/monitrc &

With this daemon you can control all the process of the appliance, i.e. to restart the web process:

/opt/local/monit/bin/monit restart web 

Or even all the processes (included smartconnectors, so it is not recommended, as restarting push connectors implies events  lossing):

/opt/local/monit/bin/monit restart all 

For detailed explanation just type:

opt/local/monit/bin/monit -h

This is the same daemon that was available in connapp, however I have noticed that in arcmc doesn't work as fine as in connapp.

Best regards,

Karl.

View solution in original post

0 Likes
14 Replies
Highlighted
Honored Contributor.
Honored Contributor.

You can manage these processes from /etc/init.d/. You will use the same process names as above, but from /etc/init.d/

EX:. [root@**************t]# /etc/init.d/arcsight_sshd start

You can stop/start/restart most processes using the monit directory:

EX:. [root@**************t]# /opt/local/monit/bin/monit restart <process name>

To see a list of processes that can be managed via monit, simply do a monit summary:

EX:. [root@**************t]# /opt/local/monit/bin/monit summary

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Dear David,

All I have are the scripts I quoted under /etc/init.d. Did you want to refer to other directory in your first message?

You can manage these processes from /etc/init.d/. You will use the same process names as above, but from /etc/init.d/

I have tried your suggestion, but with no success

In addition, as you can see, the monit is not running.

Is there a guide for the appliance? all that I found applies to the software version,

Best regards.

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

That's strange that the monit daemon isn't running, I'll have to get back to you on that one. try just typing:

/etc/init.d/arcsight_web restart

that should work for you (if restarting web is what you are wanting to do).

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Sorry, I mis-read your original post...the monit directory is the key to being able to restart all processes at once. Getting that daemon to turn on is something that I'll need to research.

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Hi David,

Thanks for your help, but I am still not able to restart the web process, as the script /etc/init.d/arcsight_web

Doesn't exists in my ArcMC.

Is there any document that can help us?, the admin guide seems to apply to software verssions,

Best regards

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

This is an appliance? There should be an /etc/init.d/ directory if you are using an appliance. Within that directory, you should be able to see all of the services. Can you post a screenshot of what is inside of your /etc/init.d/ directory?

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Hi David,

Yes, this is an appliance.

All the scripts are shown in my first message:

However, this script doesn't exist in my appliance (I think is for software versions), under the /etc/init.d directory:

[root@arcmc init.d]# ls -lart

total 176

-r-xr-xr-x.  1 root root  2053 Apr 29  2014 arcsight_sshd

-rw-r--r--.  1 root root  1160 Dec 22  2014 README

-rwxr-xr-x.  1 root root  6630 Sep 16  2015 network

-rwxr-xr-x.  1 root root  2989 Sep 16  2015 netconsole

-rwxr-xr-x.  1 root root   476 Nov  7  2015 random

-rwxr-xr-x.  1 root root  4869 Jan 29 04:49 postgresql

-rwxr-xr-x.  1 root root  3556 Feb  3 19:11 arcsight_ftpd

-rwx------.  1 root root   813 Feb 27 01:59 platform_upgrade

-rwx------.  1 root root   689 Feb 27 01:59 arcsight_snmp

-rwx------.  1 root root  6534 Feb 27 01:59 arcsight_restore

-rwx------.  1 root root  4495 Feb 27 01:59 arcsight_aps

-rwxr-xr-x.  1 root root  4386 Feb 27 02:00 stripmac

-rwxr-xr-x.  1 root root 15209 Feb 27 02:00 platform_enable

-rwxr-xr-x.  1 root root  2748 Feb 27 02:00 arcmultipath

-rwxr-xr-x.  1 root root  3692 Feb 27 02:04 apache

-rwxr-xr-x.  1 root root   188 Mar  5 00:06 arcsight_prepare

-rwxr-xr-x.  1 root root  1498 Mar  5 00:06 arcsight_mconfig

-rwxr-xr-x.  1 root root  9622 Mar  5 00:06 arcsight_logger

-rw-r--r--.  1 root root 13971 Mar 10 20:53 functions

drwxr-xr-x. 10 root root  4096 Mar 10 20:53 ..

-rwxr-xr-x.  1 root root   813 Mar 10 20:54 file_perm_bootup

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_2

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_4

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_1

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_3

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_6

-rwxr-xr-x.  1 root root  3005 Mar 26 04:06 arc_appliance_connector_7

-rwxr-xr-x.  1 root root  2567 Jun 27 09:55 arc_appliance_connector_8

-rwxr-xr-x.  1 root root  2567 Jul  7 11:37 arc_appliance_connector_5

drwxr-xr-x.  2 root root  4096 Jul 11 08:37 .

The arcsight_sshd is not similar with the arcmcd at all, it just give me the PID

Best regards,

karl.

0 Likes
Highlighted
Outstanding Contributor.
Outstanding Contributor.

Hi Karlo,

You try the following:

/opt/local/monit/bin/monit summary

Should get something like this:

Process 'snmp'                      running

Process 'postgresql'                running

File 'arcsight_primary_storage_available' accessible

Process 'web'                       running

Process 'insp'                      running

Process 'apache'                    running

Process 'arcmcagent'                running

Process 'aps'                       running

Process 'connector_1'               running

Process 'connector_2'               running

Process 'connector_3'               running

Process 'connector_4'               running

You can also use the following commands:

./monit stop all

watch -d /opt/local/monit/bin/monit summary  (confirm all are stopped [not monitored] before starting again - CTRL+C to cancel out)

./monit start all

Monit should essentially restart any failing service.

Monit logs can be found -> /opt/arcsight/userdata/logs/monit/monit.log

If you are still facing issues, I would recommend to open a case with support and provide the logs of the device for review.

Thanks and best regards,

Lar

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Hi Lar,

Thanks for the tips, I've oppened a ticket (but with no response)

At the end I just restarted everything:

/monit stop all

/monit start all

After all, everything was fine, but with the lack that ALL the services was restarted, even the connectors from the appliance.

However, is normal that after the restart the monit daemon keeps of? :

/opt/local/monit/bin/monit summary

monit: no status available -- the monit daemon is not running

Best regards,

Karl.

0 Likes
Highlighted
Honored Contributor.
Honored Contributor.

Hi,

After several months investing this issue, we finnaly conclude that monit daemon is the key.

However, at least in this appliance (arcmc 2.2) the monit daemon was not activated, so we have to started mannualy:

/opt/local/monit/bin/monit -Ic /etc/monitrc &

With this daemon you can control all the process of the appliance, i.e. to restart the web process:

/opt/local/monit/bin/monit restart web 

Or even all the processes (included smartconnectors, so it is not recommended, as restarting push connectors implies events  lossing):

/opt/local/monit/bin/monit restart all 

For detailed explanation just type:

opt/local/monit/bin/monit -h

This is the same daemon that was available in connapp, however I have noticed that in arcmc doesn't work as fine as in connapp.

Best regards,

Karl.

View solution in original post

0 Likes
Highlighted
Regular Contributor.
Regular Contributor.

Hi all,

To wake the monit up, do try to type in this command: ./monit -summary

Of course do navigate to /opt/local/monit/bin and then execute that command. I realized by entering a dash in front of the summary actually wakes the monit daemon.

I am using ArcMC 2.2 patch 1 and I have this problem every few weeks. I want to find out why and have log a case with support too. If anyone knows why is this happening every few weeks, do let me know.

Thank you

Regards

Yong Hong

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.