Outstanding Contributor.. Amishra Outstanding Contributor..
Outstanding Contributor..
171 views

Staffing Profile Financial Summary Sync Service is running past its critical runtime threshold

Jump to solution

Hello There,

We are seeing some of ERROR server:ppmLightServiceListenerContainer-2:(ServiceMessageExecutionManagerImpl.java:155):2017/04/21-10:30:00.049 EST: ID:BGPVCMC1-57695-1491770165540-1:1:1073:2:14880: Staffing Profile Financial Summary Sync Service is running past its critical runtime threshold(720min).

The Staffing Profile Financial Summary Sync Service is running over 15 odd hours... 

Any ideas please.

 

cheers,

Ajay

Regards,
Ajay Mishra
0 Likes
1 Solution

Accepted Solutions
Micro Focus Frequent Contributor
Micro Focus Frequent Contributor

Re: Staffing Profile Financial Summary Sync Service is running past its critical runtime threshold

Jump to solution

Hello Ajay,

I would recommend you to clean Quartz tables, pelase find the steps below, this is for 9.3 and 9.4, if you need steps for an early version let me know:

1. Stop the PPM instance.

2. Go to PPM_HOME/server/SERVER_NAME and delete the following directories (if present): "tmp" and "work". For every node.

3. disable the constratints temporarily
--Run the following sql
Select 'alter table ' || table_name || ' disable constraint ' || constraint_name || ';'
from user_constraints
where table_name in
('QRTZ_BLOB_TRIGGERS','QRTZ_CALENDARS','QRTZ_CRON_TRIGGERS','QRTZ_FIRED_TRIGGERS','QRTZ_JOB_DETAILS','QRTZ_JOB_LISTENERS',
'QRTZ_PAUSED_TRIGGER_GRPS','QRTZ_SCHEDULER_STATE','QRTZ_SIMPLE_TRIGGERS','QRTZ_TRIGGERS','QRTZ_TRIGGER_LISTENERS')
and Constraint_type = 'R';

You will get an result like the following (you result might be different with this example):
alter table QRTZ_BLOB_TRIGGERS disable constraint SYS_C00144375862;
alter table QRTZ_CRON_TRIGGERS disable constraint SYS_C00144375861;
alter table QRTZ_JOB_LISTENERS disable constraint SYS_C00144375858;
alter table QRTZ_SIMPLE_TRIGGERS disable constraint SYS_C00144375860;
alter table QRTZ_TRIGGERS disable constraint SYS_C00144375859;
alter table QRTZ_TRIGGER_LISTENERS disable constraint SYS_C00144375863;

Export the above result to a sql file and run it.

4. Backup below table records, then truncate records from the following tables:

truncate table PPM_SERVER_INSTANCE;

-- PPM 930 removed JMS_* tables and use ACTIVEMQ_* tables instead
truncate table ACTIVEMQ_ACKS;

truncate table ACTIVEMQ_MSGS;

truncate table QRTZ_BLOB_TRIGGERS;


truncate table QRTZ_CALENDARS;


truncate table QRTZ_CRON_TRIGGERS;


truncate table QRTZ_FIRED_TRIGGERS;


truncate table QRTZ_JOB_DETAILS;


truncate table QRTZ_JOB_LISTENERS;


truncate table QRTZ_PAUSED_TRIGGER_GRPS;


truncate table QRTZ_SCHEDULER_STATE;


truncate table QRTZ_SIMPLE_TRIGGERS;


truncate table QRTZ_TRIGGERS;


truncate table QRTZ_TRIGGER_LISTENERS;

5. Once you have truncate the above tables, go ahead and enable the constraints back

--Run the following sql
Select 'alter table ' || table_name || ' enable constraint ' || constraint_name || ';'
from user_constraints
where table_name in
('QRTZ_BLOB_TRIGGERS','QRTZ_CALENDARS','QRTZ_CRON_TRIGGERS','QRTZ_FIRED_TRIGGERS','QRTZ_JOB_DETAILS','QRTZ_JOB_LISTENERS',
'QRTZ_PAUSED_TRIGGER_GRPS','QRTZ_SCHEDULER_STATE','QRTZ_SIMPLE_TRIGGERS','QRTZ_TRIGGERS','QRTZ_TRIGGER_LISTENERS')
and Constraint_type = 'R';

You will get an result like the following (you result might be different with this example):
alter table QRTZ_BLOB_TRIGGERS enable constraint SYS_C00144375862;
alter table QRTZ_CRON_TRIGGERS enable constraint SYS_C00144375861;
alter table QRTZ_JOB_LISTENERS enable constraint SYS_C00144375858;
alter table QRTZ_SIMPLE_TRIGGERS enable constraint SYS_C00144375860;
alter table QRTZ_TRIGGERS enable constraint SYS_C00144375859;
alter table QRTZ_TRIGGER_LISTENERS enable constraint SYS_C00144375863;

Export the above result to a sql file and run it.

6. Go to PPM_HOME/bin and run "sh kUpdateHtml.sh" (in each physical server)


7. Start the PPM instance.


8. Please provide us the server.log files of all the nodes.


9. Run CheckServices.sql to make sure that the services are running and let us know the output.

If after clean this the issue persist I would recommend you to open a ticket with support.

Hope this helps,

Francisco Morales
Customer Support Engineer
2 Replies
Micro Focus Frequent Contributor
Micro Focus Frequent Contributor

Re: Staffing Profile Financial Summary Sync Service is running past its critical runtime threshold

Jump to solution

Hello Ajay,

I would recommend you to clean Quartz tables, pelase find the steps below, this is for 9.3 and 9.4, if you need steps for an early version let me know:

1. Stop the PPM instance.

2. Go to PPM_HOME/server/SERVER_NAME and delete the following directories (if present): "tmp" and "work". For every node.

3. disable the constratints temporarily
--Run the following sql
Select 'alter table ' || table_name || ' disable constraint ' || constraint_name || ';'
from user_constraints
where table_name in
('QRTZ_BLOB_TRIGGERS','QRTZ_CALENDARS','QRTZ_CRON_TRIGGERS','QRTZ_FIRED_TRIGGERS','QRTZ_JOB_DETAILS','QRTZ_JOB_LISTENERS',
'QRTZ_PAUSED_TRIGGER_GRPS','QRTZ_SCHEDULER_STATE','QRTZ_SIMPLE_TRIGGERS','QRTZ_TRIGGERS','QRTZ_TRIGGER_LISTENERS')
and Constraint_type = 'R';

You will get an result like the following (you result might be different with this example):
alter table QRTZ_BLOB_TRIGGERS disable constraint SYS_C00144375862;
alter table QRTZ_CRON_TRIGGERS disable constraint SYS_C00144375861;
alter table QRTZ_JOB_LISTENERS disable constraint SYS_C00144375858;
alter table QRTZ_SIMPLE_TRIGGERS disable constraint SYS_C00144375860;
alter table QRTZ_TRIGGERS disable constraint SYS_C00144375859;
alter table QRTZ_TRIGGER_LISTENERS disable constraint SYS_C00144375863;

Export the above result to a sql file and run it.

4. Backup below table records, then truncate records from the following tables:

truncate table PPM_SERVER_INSTANCE;

-- PPM 930 removed JMS_* tables and use ACTIVEMQ_* tables instead
truncate table ACTIVEMQ_ACKS;

truncate table ACTIVEMQ_MSGS;

truncate table QRTZ_BLOB_TRIGGERS;


truncate table QRTZ_CALENDARS;


truncate table QRTZ_CRON_TRIGGERS;


truncate table QRTZ_FIRED_TRIGGERS;


truncate table QRTZ_JOB_DETAILS;


truncate table QRTZ_JOB_LISTENERS;


truncate table QRTZ_PAUSED_TRIGGER_GRPS;


truncate table QRTZ_SCHEDULER_STATE;


truncate table QRTZ_SIMPLE_TRIGGERS;


truncate table QRTZ_TRIGGERS;


truncate table QRTZ_TRIGGER_LISTENERS;

5. Once you have truncate the above tables, go ahead and enable the constraints back

--Run the following sql
Select 'alter table ' || table_name || ' enable constraint ' || constraint_name || ';'
from user_constraints
where table_name in
('QRTZ_BLOB_TRIGGERS','QRTZ_CALENDARS','QRTZ_CRON_TRIGGERS','QRTZ_FIRED_TRIGGERS','QRTZ_JOB_DETAILS','QRTZ_JOB_LISTENERS',
'QRTZ_PAUSED_TRIGGER_GRPS','QRTZ_SCHEDULER_STATE','QRTZ_SIMPLE_TRIGGERS','QRTZ_TRIGGERS','QRTZ_TRIGGER_LISTENERS')
and Constraint_type = 'R';

You will get an result like the following (you result might be different with this example):
alter table QRTZ_BLOB_TRIGGERS enable constraint SYS_C00144375862;
alter table QRTZ_CRON_TRIGGERS enable constraint SYS_C00144375861;
alter table QRTZ_JOB_LISTENERS enable constraint SYS_C00144375858;
alter table QRTZ_SIMPLE_TRIGGERS enable constraint SYS_C00144375860;
alter table QRTZ_TRIGGERS enable constraint SYS_C00144375859;
alter table QRTZ_TRIGGER_LISTENERS enable constraint SYS_C00144375863;

Export the above result to a sql file and run it.

6. Go to PPM_HOME/bin and run "sh kUpdateHtml.sh" (in each physical server)


7. Start the PPM instance.


8. Please provide us the server.log files of all the nodes.


9. Run CheckServices.sql to make sure that the services are running and let us know the output.

If after clean this the issue persist I would recommend you to open a ticket with support.

Hope this helps,

Francisco Morales
Customer Support Engineer
Outstanding Contributor.. Amishra Outstanding Contributor..
Outstanding Contributor..

Re: Staffing Profile Financial Summary Sync Service is running past its critical runtime threshold

Jump to solution

Hello Francisco,

Thank you for your response... I shall give it a try next time.. I have restarted PPM for now and it seems to work.. All the services are running as expected. 

Things we tried before restarting was:-

1. Disabled/ Enabled services  -- No luck

2. Took baselines of staffing profiles and workplans of the impacted projects -- No luck.

3. Deleted the entries from the ITG_PENDING_ROLLUPS for staffing profiles -- No luck..

4. Finally we had to restart the services and all looks fine.

I further have a ticket open with HPE.. lets see what they have to say. 

 

Cheers and Thank you once again!

Ajay 

Regards,
Ajay Mishra
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.