BYOBI to visualize the data in COSO Data Lake

by in IT Operations Management

Have you ever wondered how to visualize the data you collect from ITOM products using the Business Intelligence (BI) tool of your choice? The solution is to Bring Your Own BI (BYOBI) tool to visualize the data that is in the ITOM’s COSO Data Lake.

With ITOM’s COSO strategy, the data required for operations management is collected once and stored in our COSO Data Lake. Data from this lake can be used by different services. Read here for more details on COSO.

ITOM Reporting is based on Business Value Dashboard (BVD) and BYOBI.

COSO.JPGOrganizations increasingly rely on intelligent reporting and analytics on top of data spanning across multiple sources and domains. In the case of Operations Bridge (OpsBridge), COSO Data Lake receives topology data, metric data, and events from various OpsBridge components such as, Operations Agents, SiteScope, Business Process Monitor, Real User Monitor and others being added with each release. Apart from BVD, you can use your own BI (Business Intelligence) tools like Microsoft Power BI, SAP Business Intelligence, Tableau, IBM Cognos etc., on top of COSO Data Lake to create reports and dashboards you need. In Figure 1, you can see BYOBI highlighted. You can see how the BYOBI tool interacts with Vertica to show the reports.

Before you start creating the reports in the BI tools of your choice, it is important you consider the below:

  • Understand the schema on top of which you plan to create reports (Check here for COSO Data Lake schema documentation.)
  • Have a fair idea of the report you want to develop to address the business usecases.
  • Knowledge of the BI tool.

It is advisable to use a dev/test suite environment to play with the data to develop the new reports. If you plan to use the production environment, ensure you make a copy of the table you are working with and limit the amount of data; there can be an impact on the time it takes to load the report after every edit during the report development process.

View the linked whitepaper to see how Microsoft Power BI is used to build your own reports on top of COSO Data Lake. You will learn how to connect to Vertica from Power BI Desktop client and visualize the data and see how to easily create a report using the data available in COSO Data Lake.

Additonal topics of interest are:

  • Adding a datetime column in a human readable format. Currently it is stored in UTC in COSO Data Lake. Splitting the datetime column into different constituents like, hour/day/month is essential to enable drill-up and drill-down on the time axis.
  • Achieving online aggregation of the data as you drill-up and drill-down on the time axis, where you can see the hourly and daily data accordingly.
  • Publishing the reports.

You can use similar procedures, these could be specific to the BI tool you choose to use and integrate with COSO Data Lake to create reports for your usecases.

We encourage you to try out our new features and enhancements!

For further information on our offerings, visit the Operations Bridge product page, explore our documentation resources and check out our videos and blogs.


Operations Bridge