Respected Contributor.. Chris_A Respected Contributor..
Respected Contributor..
951 views

Content Development - CDE Simplified to collect OA/PA metrics

Hi All!

I am trying to figure out CDE and how to extend OBR to collect and store additional HPOA metric data that we currently use.  I have attempted through the GUI, the full commandline, and the simplified.  For this post I'll focus on the simplified developmemnt flow.  The objective for this sample is to capture and store the SCOPE:APPLICATION data class.

Our environment is distrubuted with separate OBR, BO, and Vertica servers running on Linux.  The CDE I am using is on a windows VDI.

When I create the mapping file with this command:

createMappingFile.bat -usePA -paXml c:\cde\data\SAMPLE_PA_input.xml -topologyXml c:\cde\data\SAMPLE_PA_topology.xml -config c:\cde\data\dbconfig.properties -outputLocation c:\cde\workspace\SAMPLE_PA -passwords ###

I get the following errors: 

org.apache.axis2.AxisFault: com.ctc.wstx.exc.WstxUnexpectedCharException: Unexpected character '"' (code 34) in DOCTYPE declaration; expected a space between public and system identifiers
at [row,col {unknown-source}]: [1,50]

and

Error in loading XplGetPidCan't load library: C:\Program Files\HP OpenView\lbin\xpl\trc\XplGetPid.mdl

 

However the mapping file appears to create successfully. When I try and execute the final build with:

createendtoendcp.bat -mappingfile c:\cde\workspace\SAMPLE_PA\SAMPLE_MappingFile_1186509929597686.csv -topologyxml c:\cde\data\SAMPLE_PA_topology.xml -paXml c:\cde\data\SAMPLE_PA_input.xml -configfile c:\cde\data\dbconfig.properties 

I get the following error:

Error: Could not find or load main class Files

 

the CDE .log file does not report any of the errors above, only the successful creation of the mapping file.  I assume the main problem here is the last error from the createendtoendcp.bat.  Any suggestions? Any other details that would help explain the situtation?

0 Likes
7 Replies
Respected Contributor.. Chris_A Respected Contributor..
Respected Contributor..

Re: Content Development - CDE Simplified to collect OA/PA metrics

To update this - I moved the input files that I created for this example to the Linux OBR server.  I am able to execute the create scripts there.  The content pack appears to generate, but when deployed it collects no data and there are no streams listed in abcMonitor.

0 Likes
Micro Focus Expert
Micro Focus Expert

Re: Content Development - CDE Simplified to collect OA/PA metrics

Hi,

Could you please share the input policy xmls you had authored viz. [paXml c:\cde\data\SAMPLE_PA_input.xml -topologyXml c:\cde\data\SAMPLE_PA_topology.xml].

Also, kindly share the generated ETL policies from the following path in CDE workspace (or the pkg itself).

<CP name>\<CP name>.ap\source\etl\collection

Thanks & Regards,

Vineetha

 
0 Likes
Absent Member.. Federico_C Absent Member..
Absent Member..

Re: Content Development - CDE Simplified to collect OA/PA metrics

Hello Vineetha,

please i need an informaton about OBR CDE:

exists a CDE with GUI like a jpg below (taked from HPE official webpages)?

thanks and best regards

Federico  CDE.JPG

0 Likes
Highlighted
Absent Member.. MilanJ Absent Member..
Absent Member..

Re: Content Development - CDE Simplified to collect OA/PA metrics

Hi Federico,

yes, of course, this CDE exists and I was using it recently.

The screen is the most probably from CDE v10.01. You can download it from HPLN ->

https://hpln.hpe.com/contentoffering/hpe-obr-content-development-environment

and you can use it with OBR 10.01, maybe also with OBR 10.02.

Regards,

Milan

Tags (2)
0 Likes
Absent Member.. Federico_C Absent Member..
Absent Member..

Re: Content Development - CDE Simplified to collect OA/PA metrics

Hi Milan,

thanks for your reply.

today i download and install CDE10.01 and i update you.

 

thanks and best regards

Federico

 

0 Likes
Respected Contributor.. Chris_A Respected Contributor..
Respected Contributor..

Re: Content Development - CDE Simplified to collect OA/PA metrics

Hi Vineetha,

Is it possible to post .zip files for this forum, or only image files?  Since I haven't figured one out, I apologize for the wall of text.  Let me know if there is additional information that I can provide, or if you have any suggestions for this situation.

 Thanks!

Chris

SAMPLE_PA_input.xml

<?xml version="1.0" encoding="UTF-8"?>
<pa_policy xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="SHRPAFactNamespace CDE_PASchema.xsd" xmlns="SHRPAFactNamespace">
<data_sources>
<data_source name="SCOPE">
<dimensionclass name="APPLICATION" businesskeycols="APP_NUM" include="HOSTNAME,APP_NAME" exclude=""/>
<factclass name="APPLICATION" associateddimclass="APPLICATION" alias="">
<metricDefinition name="APP_NUM" aggregation="avg,min,max" datatype="Integer"/>
<metricDefinition name="APP_ALIVE_PROC" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_ACTIVE_PROC" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_COMPLETED_PROC" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_PROC_RUN_TIME" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_TOTAL_UTIL" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_SYS_MODE_UTIL" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_USER_MODE_UTIL" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_TOTAL_TIME" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_SYS_MODE_TIME" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_CPU_USER_MODE_TIME" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_IO_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_READ_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_WRITE_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_READ" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_WRITE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_IO_BYTE_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_IO_BYTE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MINOR_FAULT" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MINOR_FAULT_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MEM_RES" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MAJOR_FAULT" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MAJOR_FAULT_RATE" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MEM_UTIL" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_MEM_VIRT" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_PHYS_IO" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_PRI_WAIT_PCT" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_SUBSYSTEM_WAIT_PCT" aggregation="avg,min,max" datatype="Float"/>
<metricDefinition name="APP_DISK_SUBSYSTEM_QUEUE" aggregation="avg,min,max" datatype="Float"/>
</factclass>
</data_source>
</data_sources>
</pa_policy>

------------------------------------------------------------------------------------------

SAMPLE_PA_topology.xml

<?xml version="1.0" encoding="UTF-8"?>
<topology name="SAMPLE" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="SHRTopologyNamespace Topology.xsd" xmlns="SHRTopologyNamespace">
<cmdb_policy>
<views>
<view name="SM_PA">
<citype name="nt"/>
<citype name="unix"/>
</view>
</views>
</cmdb_policy>
<om_policy name="SM_PA">
<data_sources>
<data_source name="SCOPE">
<class name="APPLICATION" citype="nt,unix"/>
</data_source>
</data_sources>
</om_policy>
</topology>

---------------------------------------------------------------------------------------

<CP name>\<CP name>.ap\source\etl\collection I am assuming translates to

C:\CDE\workspace\SimplifiedSample\ETL_SimplifiedSample.ap\source\etl\collection.  (there is also  CoreSimplifiedSample.ap\source, but that does not contain an etl directory)

 

Ther eare three files:

ETL_SimplifiedSample_CMDB_CollectionPolicy.xml

<?xml version="1.0" encoding="UTF-8"?>
<etldefinition type="collect" collector="CMDB" domain_name="SAMPLE" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="SHRSNNamespace schema_CMDB.xsd" xmlns="SHRCMDBNamespace">
<views>
<view name = "SM_PA">
<citype name="nt">
<ciattribute name="root_class" csvColumnName="root_class" datatype="String"/>
<ciattribute name="discovered_os_vendor" csvColumnName="host_vendor" datatype="String"/>
<ciattribute name="data_origin" csvColumnName="data_origin" datatype="String"/>
<ciattribute name="last_modified_time" csvColumnName="root_updatetime" datatype="String"/>
<ciattribute name="create_time" csvColumnName="root_createtime" datatype="String"/>
<ciattribute name="name" csvColumnName="host_hostname" datatype="String"/>
<ciattribute name="root_actualdeletetime" csvColumnName="root_actualdeletetime" datatype="String"/>
<ciattribute name="discovered_os_name" csvColumnName="host_os" datatype="String"/>
<ciattribute name="display_label" csvColumnName="display_label" datatype="String"/>
<ciattribute name="host_last_boot_time" csvColumnName="host_last_boot_time" datatype="String"/>
<ciattribute name="discovered_os_version" csvColumnName="host_osversion" datatype="String"/>
<ciattribute name="host_key" csvColumnName="host_key" datatype="String"/>
<ciattribute name="host_servertype" csvColumnName="host_servertype" datatype="String"/>
<ciattribute name="internal_name" csvColumnName="internal_name" datatype="String"/>
<ciattribute name="primary_dns_name" csvColumnName="host_dnsname" datatype="String"/>
<ciattribute name="discovered_model" csvColumnName="host_model" datatype="String"/>
<ciattribute name="name" csvColumnName="data_name" datatype="String"/>
<ciattribute name="host_osaccuracy" csvColumnName="host_osaccuracy" datatype="String"/>
<ciattribute name="discovered_vendor" csvColumnName="host_manufacturer" datatype="String"/>
<ciattribute name="host_isvirtual" csvColumnName="host_isvirtual" datatype="String"/>
<ciattribute name="serial_number" csvColumnName="host_serialnumber" datatype="String"/>
<ciattribute name="root_lastaccesstime" csvColumnName="root_lastaccesstime" datatype="String"/>
<ciattribute name="host_osrelease" csvColumnName="host_osrelease" datatype="String"/>
<ciattribute name="domain_name" csvColumnName="host_osdomain" datatype="String"/>
<ciattribute name="host_osinstalltype" csvColumnName="host_osinstalltype" datatype="String"/>
<ciattribute name="snmp_sys_name" csvColumnName="host_snmpsysname" datatype="String"/>
</citype>
<citype name="unix">
<ciattribute name="domain_name" csvColumnName="host_osdomain" datatype="String"/>
<ciattribute name="discovered_vendor" csvColumnName="host_manufacturer" datatype="String"/>
<ciattribute name="discovered_os_vendor" csvColumnName="host_vendor" datatype="String"/>
<ciattribute name="discovered_os_version" csvColumnName="host_osversion" datatype="String"/>
<ciattribute name="host_servertype" csvColumnName="host_servertype" datatype="String"/>
<ciattribute name="serial_number" csvColumnName="host_serialnumber" datatype="String"/>
<ciattribute name="internal_name" csvColumnName="internal_name" datatype="String"/>
<ciattribute name="discovered_os_name" csvColumnName="host_os" datatype="String"/>
<ciattribute name="host_osinstalltype" csvColumnName="host_osinstalltype" datatype="String"/>
<ciattribute name="discovered_model" csvColumnName="host_model" datatype="String"/>
<ciattribute name="last_modified_time" csvColumnName="root_updatetime" datatype="String"/>
<ciattribute name="name" csvColumnName="data_name" datatype="String"/>
<ciattribute name="host_osrelease" csvColumnName="host_osrelease" datatype="String"/>
<ciattribute name="root_class" csvColumnName="root_class" datatype="String"/>
<ciattribute name="host_last_boot_time" csvColumnName="host_last_boot_time" datatype="String"/>
<ciattribute name="host_key" csvColumnName="host_key" datatype="String"/>
<ciattribute name="snmp_sys_name" csvColumnName="host_snmpsysname" datatype="String"/>
<ciattribute name="host_isvirtual" csvColumnName="host_isvirtual" datatype="String"/>
<ciattribute name="host_osaccuracy" csvColumnName="host_osaccuracy" datatype="String"/>
<ciattribute name="data_origin" csvColumnName="data_origin" datatype="String"/>
<ciattribute name="primary_dns_name" csvColumnName="host_dnsname" datatype="String"/>
<ciattribute name="name" csvColumnName="host_hostname" datatype="String"/>
<ciattribute name="root_lastaccesstime" csvColumnName="root_lastaccesstime" datatype="String"/>
<ciattribute name="display_label" csvColumnName="display_label" datatype="String"/>
<ciattribute name="root_actualdeletetime" csvColumnName="root_actualdeletetime" datatype="String"/>
<ciattribute name="create_time" csvColumnName="root_createtime" datatype="String"/>
</citype>
</view>
</views>
</etldefinition>

ETL_SimplifiedSample_PA_CollectionPolicy.xml

<?xml version="1.0" encoding="UTF-8"?>
<etldefinition type="collect" collector="PA" domain_name="SAMPLE" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="SHRPANamespace schema_PA.xsd" xmlns="SHRPANamespace">
<domain>
<datasource name="SCOPE">
<class name="APPLICATION" summarized="true">
<metric name="APP_MEM_VIRT" datatype="Float" identity="false"/>
<metric name="APP_MINOR_FAULT_RATE" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_READ_RATE" datatype="Float" identity="false"/>
<metric name="APP_CPU_SYS_MODE_TIME" datatype="Float" identity="false"/>
<metric name="APP_MEM_RES" datatype="Float" identity="false"/>
<metric name="APP_MAJOR_FAULT_RATE" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_READ" datatype="Float" identity="false"/>
<metric name="APP_IO_BYTE" datatype="Float" identity="false"/>
<metric name="APP_COMPLETED_PROC" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_WRITE_RATE" datatype="Float" identity="false"/>
<metric name="APP_CPU_TOTAL_TIME" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_IO" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_IO_RATE" datatype="Float" identity="false"/>
<metric name="APP_IO_BYTE_RATE" datatype="Float" identity="false"/>
<metric name="APP_ACTIVE_PROC" datatype="Float" identity="false"/>
<metric name="APP_ALIVE_PROC" datatype="Float" identity="false"/>
<metric name="APP_DISK_SUBSYSTEM_WAIT_PCT" datatype="Float" identity="false"/>
<metric name="APP_PROC_RUN_TIME" datatype="Float" identity="false"/>
<metric name="APP_CPU_USER_MODE_UTIL" datatype="Float" identity="false"/>
<metric name="APP_DISK_SUBSYSTEM_QUEUE" datatype="Float" identity="false"/>
<metric name="APP_DISK_PHYS_WRITE" datatype="Float" identity="false"/>
<metric name="APP_PRI_WAIT_PCT" datatype="Float" identity="false"/>
<metric name="APP_CPU_SYS_MODE_UTIL" datatype="Float" identity="false"/>
<metric name="APP_MEM_UTIL" datatype="Float" identity="false"/>
<metric name="APP_MAJOR_FAULT" datatype="Float" identity="false"/>
<metric name="APP_CPU_USER_MODE_TIME" datatype="Float" identity="false"/>
<metric name="APP_CPU_TOTAL_UTIL" datatype="Float" identity="false"/>
<metric name="APP_MINOR_FAULT" datatype="Float" identity="false"/>
</class>
</datasource>
</domain>
</etldefinition>

ETL_SimplifiedSample_SN_CollectionPolicy.xml

<?xml version="1.0" encoding="UTF-8"?>
<etldefinition type="collect" collector="SN" domain_name="SAMPLE" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="SHRSNNamespace schema_SN.xsd" xmlns="SHRSNNamespace">
<sncollection name="SM_PA" mappedby="CODA">
<rule citype="nt" class="APPLICATION" datasource="SCOPE">
<mapping source="host_dnsname" metric="" defaultvalue="$agentname"/>
<mapping source="host_isvirtual" metric=" " defaultvalue="NotFound"/>
<mapping source="root_createtime" metric=" " defaultvalue="NotFound"/>
<mapping source="host_last_boot_time" metric=" " defaultvalue="NotFound"/>
<mapping source="root_updatetime" metric=" " defaultvalue="NotFound"/>
<mapping source="internal_name" metric=" " defaultvalue="NotFound"/>
<mapping source="host_manufacturer" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osversion" metric=" " defaultvalue="NotFound"/>
<mapping source="host_vendor" metric=" " defaultvalue="NotFound"/>
<mapping source="data_name" metric=" " defaultvalue="NotFound"/>
<mapping source="root_lastaccesstime" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osaccuracy" metric=" " defaultvalue="NotFound"/>
<mapping source="host_snmpsysname" metric=" " defaultvalue="NotFound"/>
<mapping source="root_class" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osrelease" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osdomain" metric=" " defaultvalue="NotFound"/>
<mapping source="data_origin" metric=" " defaultvalue="NotFound"/>
<mapping source="display_label" metric=" " defaultvalue="NotFound"/>
<mapping source="host_serialnumber" metric=" " defaultvalue="NotFound"/>
<mapping source="host_servertype" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osinstalltype" metric=" " defaultvalue="NotFound"/>
<mapping source="host_os" metric=" " defaultvalue="NotFound"/>
<mapping source="host_model" metric=" " defaultvalue="NotFound"/>
<mapping source="root_actualdeletetime" metric=" " defaultvalue="NotFound"/>
<mapping source="host_key" metric=" " defaultvalue="NotFound"/>
<mapping source="CI_UID" metric=" " defaultvalue="NotFound"/>
<mapping source="host_hostname" metric=" " defaultvalue="NotFound"/>
<mapping source="host_dnsname" metric=" " defaultvalue="NotFound"/>
</rule>
<rule citype="unix" class="APPLICATION" datasource="SCOPE">
<mapping source="host_dnsname" metric="" defaultvalue="$agentname"/>
<mapping source="host_os" metric=" " defaultvalue="NotFound"/>
<mapping source="host_serialnumber" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osrelease" metric=" " defaultvalue="NotFound"/>
<mapping source="host_vendor" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osdomain" metric=" " defaultvalue="NotFound"/>
<mapping source="root_lastaccesstime" metric=" " defaultvalue="NotFound"/>
<mapping source="host_model" metric=" " defaultvalue="NotFound"/>
<mapping source="host_last_boot_time" metric=" " defaultvalue="NotFound"/>
<mapping source="host_servertype" metric=" " defaultvalue="NotFound"/>
<mapping source="host_snmpsysname" metric=" " defaultvalue="NotFound"/>
<mapping source="host_key" metric=" " defaultvalue="NotFound"/>
<mapping source="host_hostname" metric=" " defaultvalue="NotFound"/>
<mapping source="root_actualdeletetime" metric=" " defaultvalue="NotFound"/>
<mapping source="CI_UID" metric=" " defaultvalue="NotFound"/>
<mapping source="internal_name" metric=" " defaultvalue="NotFound"/>
<mapping source="display_label" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osinstalltype" metric=" " defaultvalue="NotFound"/>
<mapping source="host_dnsname" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osaccuracy" metric=" " defaultvalue="NotFound"/>
<mapping source="host_osversion" metric=" " defaultvalue="NotFound"/>
<mapping source="root_class" metric=" " defaultvalue="NotFound"/>
<mapping source="host_manufacturer" metric=" " defaultvalue="NotFound"/>
<mapping source="root_createtime" metric=" " defaultvalue="NotFound"/>
<mapping source="data_origin" metric=" " defaultvalue="NotFound"/>
<mapping source="data_name" metric=" " defaultvalue="NotFound"/>
<mapping source="host_isvirtual" metric=" " defaultvalue="NotFound"/>
<mapping source="root_updatetime" metric=" " defaultvalue="NotFound"/>
</rule>
</sncollection>
</etldefinition>

 

0 Likes
Dennis Handly Acclaimed Contributor.
Acclaimed Contributor.

Re: Content Development - CDE Simplified to collect OA/PA metrics

>Is it possible to post .zip files for this forum?

 

No, unless you want to cheat and add a ".jpg" on the end.

/t5/Announcements/Changes-to-File-Attachment-Security-Policy-on-the-Hewlett/m-p/6884253

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.