The features listed below were added to DPOD. The document's icon conventions are listed at the bottom.
...
The features listed below were added to DPOD. The document's icon conventions are listed at the bottom.
New Features in 1.0.19.0
Support for Containerized Gateways
IBM DataPower Gateways deployed in Kubernetes/OpenShift are now supported via the new DPOD Cloud Agent component.
Automatic discovery of IBM DataPower Gateways as they are deployed, scaled up or scaled down by the DataPower k8s Operator.
The collected data is stored in a persistent messaging layer until it is processed by DPOD.
The DPOD Cloud Agent is highly available and can be scaled up or down as required.
Deployment Flexibility
A new tool for exporting and importing configuration between DPOD instances (reports, alerts, gateways, roles, LDAP, etc.).
Cell members can be removed from a cell environment for decommissioning or transferring to another cell environment.
Performance
Reduced the number of log messages DPOD collects per transaction for better throughput and longer retention period.
New Features in 1.0.18.0
Alerts
Triggered alerts now include Investigate links, which display in DPOD the data that triggered each alert.
Triggered alerts now include additional field names (such as “API”, “Service”, etc.) to identify the alert's subject.
Some useless fields were removed from the triggered alert subject values.
Reports
The column headers of reports are now more human friendly (e.g.: no more
doc_count
orkey
columns).The report file format is now more human friendly (e.g.: background color for column headers).
Improved User Experience
Switching between product views (Gateway / API-C) keeps the current page.
Added Failed Objects page in API-C product view, to inspect object that are enabled but down.
Added rate limit filters in API Connect transactions page (requires offloading API Connect Analytics data to DPOD).
API Calls Version
Added support for the new IBM DataPower Operations Dashboard For API Connect Hybrid version.
A product activation key must be supplied for new installations after the initial login.
New Features in 1.0.17.0
Improved User Experience
Show elapsed time for all transactions (instead of only successful ones) in Transactions page.
Improved default filters in user preferences, including the time filter and operators (equals/not equals).
Custom logo image may be added to the Web Console (in the login page and the top navigation bar).
Alerts
A new alert for API-Connect rate limit exceeding a utilization threshold.
New Features in 1.0.16.0
Improved User Experience
A new dashboard for API activity by time interval shows statistics and detailed data of the API calls per minute/hour/day/etc.
Security
Custom roles may be used to allow users of any builtin role to access Expert Mode.
Custom roles may be used to allow users of any builtin role to view and execute report and alerts.
Sensitive data may be redacted based on patterns, to prevent DPOD from storing and displaying sensitive data.
Upgrade Assistant
A new Upgrade Assistant prepares the DPOD instance for upcoming upgrades.
Data is reindexed in the background (if required) while DPOD is up and running.
View the status of the reindexing and configure its behavior through a new page under the Manage section.
This is replacing the Data Migration Tool, that was previously used during upgrades to reindex data.
REST APIs
A new set of REST APIs for managing and executing reports.
A new set of REST APIs for managing and executing alerts.
New Features in 1.0.15.1
Important security fixes.
New Features in 1.0.15.0
Improved User Experience
Custom roles may be used to limit user access to product views (Gateway / API-C).
Custom roles may be used to allow users of any role to edit report and alerts.
Reports and alerts are displayed per product view to easily distinguish between API Connect and DataPower Gateway services.
All tables now support the new context menu which allows easier filtering and copy.
Quick setup modal after installation/upgrade allows choosing the default product view and theme.
API Connect Integration
API Connect Analytics Offload may be used to send payload and request/response headers to DPOD.
When activating API Connect Analytics Offload, payload and HTTP headers are displayed per transaction and are available for filtering.
Expert Mode provides access to the data that was captured from API Connect Analytics Offload with the ability to create custom dashboards.
Cleaner view of the assembly flow (toggle between primary policies and all policies).
Performance
Support for enhanced Syslog log target performance introduced in DataPower Gateway firmware.
New Features in 1.0.14.0
Improved User Experience
Many filters (including device, domain, service, API name, product, etc.) support wildcards (*) for matching.
Filters across the system support operators (including reports and alerts).
A new context menu in main tables (transactions, early failing, raw messages, etc.) allows easier filtering and copy.
Custom dashboards may be used as the home page.
Some widgets that could not be added to custom dashboards, such as Transactions List, are now supported.
CSV export size has been increased to 2,500 records instead of 1,000.
Any alert and report can now be duplicated, no matter if they arrive out-of-the-box or created from scratch.
API Connect Integration
Provider organization and consumer organization can be used in custom roles to limit user access.
Many filters have been added to API Connect dashboards, including provider organization, HTTP response code, HTTP method, elapsed time, request/response size, etc.
Added Top Consumers table in Recent Activity dashboard.
Status column in API Connect Transactions page was replaced by HTTP response code column.
Transaction error analysis now detects some more common error scenarios with APIC v10.
...
The deprecated Extended Transaction functionality, which required instrumentation of the processing policy, and was replaced in 1.0.8.0 by a non-intrusive alternative, has been removed.
New Features in 1.0.13.0
Improved User Experience
Quickly move to next and previous transactions from the transaction page.
Home page under User Preferences has many more options.
API Connect Integration
Added support for Web Socket Upgrade policy (requires gateway firmware 10.0.2+).
...
Added support for RHEL 8.3 (non-appliance installation only).
New Features in 1.0.12.0
Improved User Experience
Added filter operators, such as "Equal", "Not Equal", "Greater Than" and "Lower Than" to all dashboards.
Improved Time filter - add previous and next time period buttons, add new options and allow to manually edit custom time.
New Report: Service Request/Response Size Stats.
Gateways table is now sorted by name.
...
New task scheduling mechanism enhances the system stability and improves the response time of tasks including reports and alerts.
New Scheduler Info page under the Manage menu displays information about the scheduled tasks.
New Features in 1.0.11.0
Correlated Transactions Tab
...
Show amount of raw messages over time.
Show total amount of raw messages grouped by message codes.
API Connect Integration
APIC transactions status is solely determined by their front-end response code.
Improved User Experience
New user preference to enable dependency between device, domain and service filters.
New Alert: API Error Message Count Alert.
New Alert: Trans. Over 30 sec by Service Name Alert.
New Alert: Unavailable Devices Alert.
New Report: Top Transactions Count per Interval.
New Report: Top Documents Count per Interval.
New Report: Top Documents Count per Agent per Interval.
New Report: Service Latency Report - Extended.
New Report: Service and URI Total Transactions Report.
...
Added support for Gateway/APIC v10
New Features in 1.0.10.1
Important security fixes.
New Features in 1.0.10.0
API Connect Integration
Support for DataPower API Gateway.
Extended transactions page now shows API Connect transactions (when extended transactions are enabled).
Reworked API Connect transaction drill-down page to show more accurate transaction flow and latency information.
...
Improved integration with LDAP to allow more flexibility and simplicity in the LDAP registry configuration.
Improved User Experience
New report - latency statistics grouped by gateway/domain/service.
Reports and Alerts - Support TLSv1.2 for SMTP with STARTTLS.
New gateway information panel.
New internal alert on misconfigured DPOD log targets.
Better support for IDG 2018 SOMA error messages.
Speed up Failed Objects sampling to make alerts more reliable.
API Connect API Policies dashboard is now sorted by API Name and Policy Name.
API Connect URI and URL calls dashboards can now be filtered by API attributes.
New Features in 1.0.9.0
Appliance Migration Assistant
...
Most of the system's admin functionality, such as stopping or starting services, is available through a new web console.
Improved User Experience
New dashboard showing stats of gateway's MQ objects, such as Active and Idle connections.
Added a new alert and a system health metric for MQ Connections Utilization.
Added a new alert for monitoring services that did not run in the last X minutes.
Added a new alert for API Connect transactions that ended with a specific error code or with an error.
Added a new Transactions Latency Statistics report.
Added support for Sync and Firmware upgrade for IDG 2018.x firmwares.
New Features in 1.0.8.6
Custom Dashboards
Admins can design custom dashboards containing DPOD widgets.
Custom dashboards are available to all users from the Dashboards menu.
...
DPOD now supports monitoring transactions in the default domain.
Improved User Experience
When removing a monitored device from DPOD - all DPOD's log targets can be removed from the monitored device.
New Features in 1.0.8.5
API Connect Integration Improvements
...
Request and Response Size (requires firmware 7.6.0.8+ or 7.7.1.2+)
In the Transactions list page, results can be filtered using request and response size of the transactions.
Request and response sizes are displayed in the transaction details page.
Response size has been added to Activity Distribution dashboard.
Improved User Experience
Yesterday, Last Week and Last Month added to the time filter.
Raw messages can now be filtered by From/To B2B Partner Profiles.
Reports and alerts queries can have named parameters.
New reports: average service latency, average request size and services above specific elapsed time.
New alert: message code threshold.
Backup, Sync and Firmware upgrade plans can now be canceled before they start to execute.
...
Added support for RHEL 7.5.
Upgraded Java run-time and Store versions.
New Features in 1.0.8.0
System Health
An overall health overview for all gateways according to user defined metrics.
Drill-down to view the device's health in the last 60 minutes.
Non-Intrusive Extended Transactions ( requires firmware 7.7.1.1+)
Extended Transactions, which are transactions that span more than one monitored devices/services, are now being tracked in a non-intrusive way over HTTP protocol, without the need for processing policy instrumentation.
The pre v1.0.8, intrusive Extended Transaction functionality will be deprecated in the near future.
...
Support for API Connect version 2018.2.5 compatibility mode.
New DPOD Roles to allow and revoke access to API Connect field such as API Name, Space and Plan names.
API Connect views can now be set as the default system view.
Service URL/URI Calls dashboards are now available in API Connect view.
Performance and History
User can choose between supporting more TPS but gathering less data per transaction, or collecting more data and supporting less TPS. This option is available during log target setup.
APM Integration
Providing a publisher to Splunk with a Splunk application as a reference implementation for the integration (requires firmware 7.7.1+).
Publishing more analytical data fields.
Simplify setup of implementing APM integration.
...
Publish DPOD developer edition image in Docker Hub.
Improved User Experience
All dashboards can be exported to a CSV file.
Domain filter now support asterisk wildcard.
New REST API to create WS-M subscriptions.
Device Resources page now shows Ethernet Interfaces statistics.
New alert on more than 5 API Connect APIs with latency above X ms.
Provide retry functionality for failed publishing via SMTP or syslog of alerts, internal health and maintenance jobs.
Admins can use a new page to delete transactions logs that are stored in DPOD.
New Features in 1.0.7.0
Tenant Support
Added the ability to monitor transactions information on appliance with Tenants.
Resource monitoring and appliance maintenance are not available for tenants.
API Connect Integration
New API Connect Recent Activity dashboard that displays a high-level overview of APIs activity.
The Early Failing Requests Dashboard in now also available in API Connect view.
Alerts can be generated based on some of APIs latency data.
Auto Setup Domains feature detects a Domain Reset to auto-setup it again.
...
DPOD now provides the ability to upgrade virtual and physical appliance firmware (requires firmware 7.5+) - see limitations
Maintenance Plan for Syncing DataPower Appliance Configuration is now supported (initially announced as tech preview from v1.0.5)
Improved User Experience
DataPower and API Connect transactions lists may be exported to a CSV file.
The transaction error analysis now indicates whether a probe was enabled during its execution.
New latency alerts based on percentile.
Added latency percentile data to Service URL/URI Calls dashboards.
Payload capture can be enabled on multiple devices or domains at once.
DevOps Services Portal - allow to setup a separate temporary domain (for WSDL validation and promotion) for each device.
Columns can be hidden or reordered in the Transactions, Raw Messages and API Connect Transactions pages.
New Internal Monitoring page that shows DPOD's components status and recent alerts to assist monitoring DPOD internal health.
New Features in 1.0.6.0
DevOps Services Portal
DPOD now provides a new self service DevOps portal for traditional services. This is a new portal dashboard where end-users can:
Execute two new actions on SOAP Web services with localWSDL: validate and promote
The Validate action uploads your new WSDL and schema files to a temporary location, validates its compilation and creates a temporary WS-Gateway to ensure the object is up.
Promote action allows uploading a new WSDL and schema files to the target location (device and domain) and creating a new version of the service.
Execute two new actions on SOAP Web services with remoteWSDL: validate and promote
The Validate action updates a new or existing URL of a remote WSDL, validates its compilation, and creates a temporary WS-Gateway to ensure the object is up.
The Promote action updates a new or existing URL of a remote WSDL in a target location (Device and Domain), and creates a newer version of the service.
All actions require permissions set by a security policy (custom roles).
Each action may be extended or customized using Python scripts. Example scripts are open source and may be obtained from a git repository - see docs
...
DPOD now provides a new dashboard that provides statistics pertaining to service URIs. These statistics include the number of invocations and min/max/avg latency in addition to the Service API (URL) Dashboard
Improved User Experience
Users can now save favorite filter combinations and use them in subsequent sessions.
A new free text search field was added to the Transactions List page and Raw Messages Page where the user may enter a single value that will be searched across various data fields.
Service filter now supports auto completion.
All applicable filters support multi-select of values.
Users can now change the size of the series (number of values) that is displayed in charts of type "top N".
A recent notifications panel was added to The Navigation Bar. It displays the recent UI notifications for the user (not persisted).
A new "Share" button added. It allows sharing the current page (including filters, transaction ID etc.) by copying/pasting the current URL or by sending it via email
Time range filters now provides more options: last 10 minutes, start of day, start of week, this month.
Consistent behavior across pages of zoom into a transaction or use its value as a filter criteria.
...
From time to time, DPOD customers may be required to install a new DPOD installation while preserving the data already collected. for example:
Customer deployed DPOD Appliance mode at version v1.0.0 with CentOS 6.7 and now requires to migrate to CentOS 7.2 introduced at version v1.0.2+.
Customer deployed DPOD on a virtual server but load increased and now requires a physical server.
Customer deployed DPOD Appliance mode but wants to migrate to Non-Appliance mode (RHEL) to better comply with their organization security requirements and standards.
New procedure and tools were introduced to support customers with migration of an existing DPOD Store data to a new DPOD installation in each of the scenarios above.
New Features in 1.0.5.0
API Connect Integration
DPOD now has new capabilities when coupled with API Connect v5.0.7.2+ (API-C) and DPOD
Display a dedicated transaction list with only API-C transactions
Filter by API-C fields (e.g. API name, API version, catalog, HTTP method, API urls and a dozen more fields)
Calculate and display latency graphs for each policy execution inside an API (including custom policies)
Provide both API-C and DataPower views of the same transaction, and the ability to switch between them
A new dashboard of APIs and the date they were last executed in the system.
API payloads may now be captured
Automatically run setup DPOD log targets for each new API-C domain created. (This requires enablement in the monitored device configuration). Further configuration based on domain name prefix is available.
To activate API-C integration, perform (from the Web Console) a re-configuration of all your log targets in the DataPower that runs the API-C domain. You can also use the auto-setup feature to handle API-C domains created in the future.
...
To activate Side Call Analysis on DPOD run re-configuration of all your log targets in the DataPower that runs the API-C domain.
...