Versions Compared

Version Old Version 2 New Version Current
Changes made by

Former user

Amit Munwes

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

DPOD's Internal services are divided into the following groups:

  1. Collector

    Agents – These services collect data

    (either

    passively

    or actively by periodic polling)

    from monitored

    DataPower Gateways. The data is then and forwarded to DPOD's Big Data Store storage

    Devices then stores it in the Store.

  2. Housekeeping - Services executing scheduled tasks such as polling data from monitor devices, health checks and maintenance.

  3. Database – These services host database services for all the data stored in DPOD, (e.g. raw logs and configuration data). Refer to Components for more detail about the database.

  4. Other – Services which perform various other tasks.

The following tables list the various DPOD's services and their function

...

Agents

Service Name

Function

Syslog Agent *

Syslog Agents passively receive raw log records from monitored DataPower Gateways, process them and store them into the

Big Data

Store.

The number of process instances for this agent depends on the installation requirements

.

Syslog Keepalive

The Syslog Keepalive agent monitors the health of a Syslog Agent. The keepalive agent periodically sends syslog records to the syslog agent, which writes those records to the Big Data Store.
The Keepalive agent later verifies the Syslog's agent correct processing by reading those entries from the store and verifying they have been written correctly

.

Note: A successful Keepalive check only means that the syslog agent is functioning properly, and that it can be write data to the Big Data store.
It does not imply that data is being received from monitored devices (keepalive is a local service and will be successful even when the network is down)

WS-M Agent *

WS-M Agents passively receive message payload information from monitored DataPower Gateways on which WS-M recording has been enabled.
Payloads are processed and stored in a dedicated index set inside the Big Data store.

The number of process instances for this agent depends on the installation requirements.

WS-M Keepalive

The WS-M Keepalive monitors the health of a WS-M Agent, in the same way that the Syslog Keepalive service above works.

Device Resources Agent

This service periodically polls device resource information from monitored DataPower Gateways.
The data polled is resource consumption related and includes metrics for CPU, memory, file system, hardware etc.

Service Resources  Agent

This service periodically polls service resource information (e.g memory consumption) and configuration details from monitored DataPower Gateways.

Other

Housekeeping

Service Name

Function

Store Retention

Perform core maintenance tasks such as Store index management and scheduling task to the Housekeeping servers.

Housekeeping Server

Each service instance can perform any schedule task such as:

  • Polling devices and services resources information and store it in the store.

  • Performing various system health checks.

  • Collecting and calculating statistics to show in dashboards.

number of instances of this service type varies depend on the deployment profile selected on install (i.e. low, medium, high)

Reports/Alerts

Run reports (schedule or on demand), alerts (schedule or on demand) and DevOps portal tasks

Database

Service Name

Function

Configuration Database

Manages DPOD's internal SQL database used to retain configuration data, agent states etc.

Big-Data data nodes *

Store Nodes

Manages

various functions of

the

Big Data Store.

Big-Data data retention

Performs regular maintenance tasks (e.g. for indexes or storage) on the Big Data Store.

data collected by agents and housekeeping servers.

Other

Service Name

Function

Admin Console

Web UI allows system administrators to perform various admin task such as backup the system or configre LDAP.

Console UI

Hosts and manages the web-based Console used to interact with DPOD UI.

ReportsRuns and formats user Reports.

...

Store Dashboards

Hosts the Expert Mode dashboards UI for API-C users.


* These agents can have more than one instance, appearing as multiple processes in the operating system.