Enhanced API Connect Error Analysis

• The error analysis now detects a wider range of errors, including those related to property validation, parsing, mapping, GatewayScript, and OAuth tokens.

• Each error entry provides a description, investigation suggestions, and possible solutions.

• Errors are displayed per policy, alongside the policy’s log messages, and at the transaction level.

• Policies containing errors are marked with a distinctive icon in the transaction flow diagram.

MNTR-5279, MNTR-6703
MNTR-6748

Performance

• Syslog message processing performance has significantly improved, achieving up to 8X higher TPS on a single virtual machine.

• The DPOD Health dashboards now feature new metrics and internal alerts to monitor the DPOD agent performance.

• DPOD now collects fewer log messages per transaction, enhancing throughput and extending the retention period.

MNTR-4792, MNTR-5749
MNTR-6355, MNTR-6047
MNTR-6598, MNTR-6723
MNTR-6724, MNTR-6725
MNTR-6726, MNTR-6729
MNTR-6730, MNTR-6736
MNTR-6742, MNTR-6753
MNTR-6754, MNTR-6758
MNTR-6762, MNTR-6770

Reports

• Introduced a new report and alert to track the percentage of failed gateway service transactions.

MNTR-6694

Added a new page for configuring and testing email publishing via SMTP (instead of configuring it via the System Parameters page).

MNTR-6629, MNTR-6756

Added fields to the Cloud Agent CR for specifying direct external hosts and ports for each of the messaging brokers, as well as custom configuration in YAML format instead of a set of environment variables.

MNTR-6660

Created a new DPOD Cloud Agent images tool to deploy the cloud agent in offline/air-gapped environments.

MNTR-6621, MNTR-6628

Improved the gateway transaction success and error status detection, based on the indications in the log messages with the code 0x80e0084b. This mainly resolves a duplication issue where in some specific cases a single failed transaction is counted as several failed transactions, and transactions appear both in the Transactions page as well as in the Early Failing page (such as API Connect requests with an incorrect URL). This also means that the transaction time is now based on the time it completes, rather than on the time it starts, which slightly affects the behavior of the time filter in dashboards and reports.

MNTR-6664, MNTR-6699
MNTR-6712, MNTR-6739
MNTR-6760, MNTR-6768

Added support for NVMe disks for the DPOD installation.

MNTR-6620

Added allowed hosts list system parameter to restrict access to specific hosts as an optional protection against SSRF.

MNTR-6008

Added additional validations of several fields of alerts in the request of the REST APIs for adding and updating alerts in DPOD.

MNTR-6437, MNTR-6709
MNTR-6743

Improved the Setup Probe messages to show which domains have been configured.

MNTR-6663

Set default focus for a faster quick setup and EULA approval.

MNTR-6688

Changed the parameter of the script execute_on_db.sh from -h to --shutdown.

MNTR-6641

Added recommendation to users to run the MustGather script with sudo, in order to collect all available data from the system.

MNTR-6675, MNTR-6698

Renamed the report “Domain Request Size Report” to “Domain Request and Response Size Report”.

MNTR-6664

Renamed the report “Service Average Request Size Report” to “Service Average Request and Response Size”.

MNTR-6664

Renamed “Probe” to “Legacy Probe” whenever the old/legacy probe of DataPower is mentioned in DPOD (e.g.: in the Active Legacy Probes dashboard).

MNTR-6589

Added a new endpoint for providing transactional payloads. This endpoint may be utilized by customers that have their own custom way of collecting transactional payload and would like this payload to appear in the transaction details page in DPOD, instead of using the builtin features DPOD provides for collecting the payloads.

MNTR-6711

Added an installation prerequisite validation that GPG check for local RPMs is disabled.

MNTR-6706

Added a user confirmation before applying the upgrade.

MNTR-6596

Refined the GC logging configuration for all Java processes.

MNTR-6745

Added nvme-cli and tcpdump packages to the Appliance Mode installation.

MNTR-6679

Upgraded httpd access control directives used when OIDC is configured to the new httpd 2.4 directives format.

MNTR-6716, MNTR-6718

Reduced the Web Console and Admin Console session timeout from 60 minutes to 30 minutes for enhanced security.

MNTR-6191

Removed Tomcat session timeout workaround code (added in MNTR-6145 as a temporary workaround).

MNTR-6409

IBM plans to deprecate the Appliance Mode installation in the future, and provide a formal deprecation announcement and a detailed migration plan, outlining the specific timeline and steps for the deprecation. If you have any concerns or questions, please contact your IBM representative to discuss any concerns you may have with the above plan.
For more information, see Statement of Direction: Plans for Appliance Mode Installation Deprecation in DPOD.

MNTR-6697

The transaction memory chart and the transaction latency pie chart have been removed from the transaction details page in favor of the enhanced error analysis.

MNTR-6294

Removed support for DataPower Gateway firmware v2018 and API Connect v2018, which are not supported by IBM since 2023.

The Policy Variables Capture feature, which supports only v5 compatibility mode APIs, and has been deprecated since DPOD 1.0.20.0, was removed from DPOD in favor of the Probe Capture.

MNTR-6429, MNTR-6632

Removed the link to the Logs page in the System Errors grid when clicking on a device name.

MNTR-6737

Gateway probe capture fails for IDG version 10.6.1.0.

MNTR-6568

API probe capture fails for IDG version 10.6.0.3.

MNTR-6712

Appliance migration fails on IDG version 10.6.0.3.

MNTR-6728

Gateway firmware upgrade fails when newer versions of the openssl package are installed on the DPOD server.

MNTR-6740

API Connect v5 compatibility mode data is not collected by the Cloud Agent.

MNTR-6626

Disabled log categories cause the DPOD log targets on the DataPower gateway to be in down state.

MNTR-6680

The upgrade fails during the backup of the existing system due to timeout.

MNTR-6614

The error messages in the Quick Setup modal are displayed as general errors with UUIDs.

MNTR-6624

Error Analysis is missing for some gateway early failing transactions (e.g. message codes 0x8120002f and 0x80e00161).

MNTR-5663, MNTR-5664

The JSON parameters field and the headers field of reports are not validated and may include malformed JSON.

MNTR-6037

Executing scripts by the wrong user prints several error messages instead of a simple error message.

MNTR-6505

A JavaScript exception occurs when switching between tabs of API Probe when there's no data.

MNTR-6604

The script execute_on_db.sh should only allow the application user to run it.

MNTR-6668

The log files in directory /logs/montier_server don’t rotate.

MNTR-6379, MNTR-6682

The log files in directory /logs/httpd don’t rotate.

MNTR-6689

The Admin Console password gets corrupted when using the reset_admin_password.sh script.

MNTR-6627

The DPOD installation fails when the HOSTNAME variable does not exist.

MNTR-6623

Configuration import to a fresh installation of 1.0.22.1 from an upgraded system of the same version fails.

MNTR-6640

Fixed a typo in the message when validating a remote WSDL in the DevOps Service Portal.

MNTR-6415

Quick Setup modal doesn’t navigate to the login page when the session expires.

MNTR-6704

DevOps services portal validate/promote fails with the provided samples of the external scripts due to changes in Python 3.

MNTR-6588

The script app_logical_tran.sh fails to run.

MNTR-6613

Temporary files used to detect gateway restarts are not getting deleted in case of an error.

MNTR-6713

After upgrading a system with OIDC configured, the IAM service is down and login fails until the service is started.

MNTR-6676

Wrong entries are added to version-history.txt file when adding and removing cell members.

MNTR-6734

Messages are flowing outside the success/error/warning notification area.

MNTR-6738

Extended transactions are missing within the DPOD simulator.

MNTR-6741

The value used for validation of the free disk space required in /installs for the upgrade to run is too low.

MNTR-6533

Stopping DPOD services up to a specific service is done in the wrong order.

MNTR-6639

The hostname of the DPOD Appliance Mode installation does not persist when the IP address is changed.

MNTR-6601

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6413, MNTR-6507
MNTR-6578, MNTR-6597
MNTR-6643, MNTR-6644
MNTR-6646, MNTR-6647
MNTR-6649, MNTR-6651
MNTR-6653, MNTR-6657
MNTR-6695, MNTR-6715
MNTR-6731

Resolved security issues.

MNTR-6615, MNTR-6714

Implemented changes for test automation.

MNTR-6645, MNTR-6407

Refactored code and remove unused code.

MNTR-6666

Added support for publishing alerts via HTTP/S and Syslog with JSON format.

MNTR-5393

Added support for the new IBM DataPower Operations Dashboard for Virtual version.
This version is priced per Virtual Processor Core (VPC) for easy and scalable use with IBM DataPower Virtual Edition.

MNTR-6582

Improved the Developer Edition and the Docker Container for Developer Edition installation experience.

MNTR-6526

Add support for appliance mode installation with a single disk for evaluation and POC.

MNTR-6539

Add /proc/cmdline , fapolicyd status and audit logs to the gathered information in the MustGather script.

MNTR-6519, MNTR-6549

Improved the Store Query page with a new query example.

MNTR-6532

Removed the package iptables-services from the prerequisites.

MNTR-6577

Removed support for CentOS 7.x and RHEL 7.x.

MNTR-6517

Cell federation results in too many agents added to the Cell Manager's DB.

MNTR-6530, MNTR-6590

Firmware upgrade doesn't work when running on RHEL/Rocky Linux 9.x.

MNTR-6584

Custom httpd certificates configuration is lost during upgrade.

MNTR-6518, MNTR-6525
MNTR-6583

Wrong disks may be selected when creating file systems during the appliance mode installation.

MNTR-6575

Cloud Agent Probe setup uses a wrong probe expiration time.

MNTR-6512

An error message is not cleared in the Create Probe Capture page.

MNTR-6540

The UI logs are full of warnings generated when populating the transaction flow points.

MNTR-6543

Upgrade fails because /installs/backups directory does not exist.

MNTR-6522

Out of memory error occurs in large cells in the Cell Manager’s console Store node.

MNTR-6541

Import/export configuration scripts and the MustGather file don’t include the new config.yaml file.

MNTR-6579

The gather_nvme_info.sh script displays wrong values for the disks serial numbers on RHEL/Rocky Linux 9.x.

MNTR-6508

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6550, MNTR-6551
MNTR-6552, MNTR-6553
MNTR-6556, MNTR-6559
MNTR-6587, MNTR-6592

Resolved security issues.

MNTR-6515, MNTR-6516
MNTR-6554, MNTR-6547

Gateway Transaction Flow Diagram

• A new visual flow diagram displays the actions in each of the transaction’s rules.

• The diagram includes the types of actions and their latency.

Gateway Probe Capture

• Debug-level data for each action in the gateway transaction can be captured and displayed.

• The data includes content (input, output, etc.), headers, variables, action configuration, etc.

• The capture may be limited by time, transactions count, interval, service name, etc.

• This feature is only supported for IDG with firmware level IDG.10.5.0.12 and higher.

MNTR-5819, MNTR-5967
MNTR-6094, MNTR-6183
MNTR-6211, MNTR-6480
MNTR-6498, MNTR-6500
MNTR-6509

Improved Installation Experience

• The installation and upgrade are much faster, more interactive and with better error handling.

• Enhanced support for silent/automatic installation of DPOD.

• The DPOD Cloud Agent images are now available in the IBM container registry.

• Added support for RHEL / Rocky Linux 9.x.

MNTR-3298, MNTR-4792
MNTR-5130, MNTR-6030
MNTR-6202, MNTR-6315
MNTR-6408, MNTR-6438
MNTR-6457, MNTR-6464
MNTR-6504, MNTR-6506
MNTR-6510

Add a REST API for DPOD installation quick setup (used for silent/automatic installation).

MNTR-5581

Add support for Base64 encoded activation key.

MNTR-6031

The result message of the API Probe Capture REST API has slightly changed.

MNTR-6113

The Cloud Agent REST API now returns a specific error code when trying to get the details of an cloud agent that does not exist.

MNTR-6114

The result message of the Payload Capture REST API has slightly changed.

MNTR-6117

Add the Syslog message text of error messages as a keyword field in the Store to allow alert/reports use it for aggregations.

MNTR-6209

Support TLS 1.3 for Web Console, Admin Console and REST APIs.

MNTR-6347

Renamed links from Aha! to IBM Ideas Portal.

MNTR-6424

API-Connect transaction flow no longer use horizontal scroll for displaying the policies.

MNTR-6496

Add /etc/cron.d content and change iptables command to have numeric output to the gathered information in the must gather script.

MNTR-6385, MNTR-6497

Increase the stale time and reduce the timeout of background tasks to avoid marking tasks as stale when they are not.

MNTR-6465, MNTR-6466

API Probe Capture doesn’t work in a cell environment.

MNTR-6270

API Probe Capture CSV export is missing some fields.

MNTR-6036

API latency dashboards (Analytics and Long Term) data does not change according to the status filter in the successful and error charts.

MNTR-6356

An error occurs when trying to export CSV from the Payload Capture Dashboard page.

MNTR-6372

When several custom dashboards exists, only one is displayed in the menu.

MNTR-6390

The favorites “play” button does not apply the selected favorite.

MNTR-6502

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6442, MNTR-6443
MNTR-6447, MNTR-6493

Long Term Statistics

• Transaction invocation statistical data (at a 15 minutes interval) is stored for long term usage and trend analysis.

• The data (invocations, latency, etc.) is available via new dashboards and reports.

MNTR-6328, MNTR-6350

API Calls Version

• Added support for the new IBM DataPower Operations Dashboard for Cloud Pak for Integration - API Calls version.

• This version is priced based on API Call volumes and scales seamlessly with the IBM Cloud Pak for Integration add-on for API Calls.

MNTR-6344

Supported Platforms

• Added support for Rocky Linux 8.x (non-appliance installation only).

MNTR-6351

Reduced the size of the config DB (QueryExecution/ReportExecution tables) to prevents locks, internal alerts and large backups during upgrades.

MNTR-6032

Tuned the Store services heap sizes according to the deployment profile and OS memory.

MNTR-6070, MNTR-6366
MNTR-6381

Changed the memory sampling to use the MemoryStatus/Usage field instead of MemoryStatus/UsedMemory field, to be consistent with the memory utilization that is displayed by the DataPower Gateway CLI (which does not include the memory used for caching).

MNTR-6150

Limit the ephemeral port range to 10000-59999.

MNTR-6259

Revert the Docker Container for Developer Edition image name to the previous name (dpod-developer-edition).

MNTR-6272

Including the limits and sysctl configuration files in the upgrade rollback.

MNTR-6337

Prevent an additional attempt to start the services while the services are already in the process of starting up.

MNTR-6349

Add firewall rules and system units to the gathered information in the must gather script.

MNTR-6370

Disable Tomcat JMX ports.

MNTR-6136

Add support in the Message filter to not equals operator.

MNTR-6147

Increase the auto-complete filter size limit and make it configurable via a system parameter.

MNTR-6335

Misconfigured timeouts caused the audit log analysis task and other tasks to sometimes hang, eventually leading to all housekeeping workers unable to perform other background tasks.

MNTR-6061

An error occurs when parsing Syslog messages containing IPv6 addresses.

MNTR-5922

Internal alerts are triggered for log targets that are down because the domain is disabled.

MNTR-6046

An error occurs when filtering by a boolean field in the Store Browse page.

MNTR-6064

An error occurs when updating the Store allocation.

MNTR-6069, MNTR-6339

An error occurs in the quick setup modal window when LDAP is already enabled.

MNTR-6196

Tooltips are missing some information in the services page in the Admin Console.

MNTR-6271

An error occurs when reallocating unassigned shards of the Store Dashboards (Expert Mode) indices.

MNTR-6286

In a cell environment, an old upgrade process could have created a Messaging agent with a wrong name.

MNTR-6358

An error occurs in the Store Status page when the Store nodes are in failure mode.

MNTR-6359

An error message is displayed for vm.max_map_count when restarting services in the Docker Container for Developer Edition.

MNTR-6365

An error occurs while performing a secure backup of DataPower Gateways that sign the secure backup with SHA512.

MNTR-6377

An error occurs when trying to purge data by multiple transaction IDs or by multiple global transaction IDs.

MNTR-6353

Wrong output message when provided password is not valid in the reset admin password script.

MNTR-6354

API Probe Capture may not display all captured transactions when there is a time difference between the DPOD and the DataPower Gateway server.

MNTR-6373

Missing validation when fetching a role by an invalid ID.

MNTR-6116

Store nodes health table displays non-heap usage instead of heap usage.

MNTR-6368

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-4844, MNTR-6028
MNTR-6149, MNTR-6288
MNTR-6300, MNTR-6301
MNTR-6303, MNTR-6304
MNTR-6308, MNTR-6334
MNTR-6338, MNTR-6345
MNTR-6346, MNTR-6348
MNTR-6357, MNTR-6378
MNTR-6387

When hovering over a chart, the vertical line only appears when the mouse is close to a marker in the chart and doesn’t display values for all markers in the tooltip.

MNTR-6204

An error message is displayed when clicking on one of the built-in roles.

MNTR-6256, MNTR-6266

In a cell environment, the upgrade process registers the wrong messaging agent name in the configuration database for the second Cell Member.

MNTR-6206

An error message is displayed when generating the must gather file in the Docker image about missing “/var/log/messages” files.

MNTR-6264

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-5237, MNTR-6027
MNTR-6050, MNTR-6228
MNTR-6229, MNTR-6230
MNTR-6232, MNTR-6233
MNTR-6237, MNTR-6244
MNTR-6247, MNTR-6248
MNTR-6260, MNTR-6267
MNTR-6268

Experimental support for OIDC.

MNTR-5480

Allow Non-Appliance mode installation on Rocky Linux 8.x.

MNTR-6126, MNTR-6198

Additional data collected for support in the mustgather file.

MNTR-6002, MNTR-6041
MNTR-6166

Error when parsing syslog messages containing GTID with the equals sign (=).

MNTR-6100

Sessions of the Web Console and Admin Console expire too soon (after being idle for only 2 minutes).

MNTR-6145

System errors include irrelevant messages which cause false positive alerts.

MNTR-6112

app_status.sh displays command not found error messages.

MNTR-6053

Must gather file is missing many directories.

MNTR-6101

Must gather script fails when there are a lot of internal alerts.

MNTR-6119

Avoid truncating domain names when the gateway name or domain name are too long.

MNTR-6167

Fixed the Cloud Agent images digests.

MNTR-6083

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6109, MNTR-6159
MNTR-6170, MNTR-6176
MNTR-6185, MNTR-6200

Resolved security issues.

MNTR-6165

API-Connect Probe Capture

• Debug-level data for each policy in the API transaction can be captured and displayed.

• The data includes requests, responses and headers of invoke policies, inputs and outputs of map policies, context variables, etc.

• The capture may be limited by time, transactions count, interval, API name, etc.

• This feature replaces the Policy Variables Capture feature, which supports only v5/v5c APIs, and will be removed soon from DPOD.

MNTR-4638, MNTR-5570
MNTR-5910, MNTR-5918
MNTR-5973, MNTR-5992
MNTR-6005, MNTR-6055
MNTR-6056

Enhanced Support for Containerized Gateways

• Added support for monitoring IBM DataPower Gateways deployed in Kubernetes (in addition to OpenShift).

• The DPOD Cloud Agent can now be added to several DPOD environments, e.g.: for high availability.

• Added configuration options to the Cloud Agent CR, such as custom annotations, labels, resources, environment variables, etc.

• Added support for API-Connect Analytics offloading within the k8s cluster (no need for egress traffic).

• Added new DPOD Cloud agent setup page.

MNTR-960, MNTR-5283
MNTR-5516, MNTR-5724
MNTR-5647, MNTR-5722
MNTR-5742, MNTR-5748
MNTR-5774, MNTR-5779
MNTR-5784, MNTR-5806
MNTR-5813, MNTR-5877
MNTR-5929, MNTR-5961
MNTR-5979, MNTR-6045

Allowing the user to control the sampling of a specific gateway and cloud agent.

MNTR-5239

Added filters to Scheduler Info page.

MNTR-5590, MNTR-5978

New Overview, Browse and Query Store pages in Manage → DPOD Health, which includes the reallocate of unassigned shards functionality.

MNTR-5706, MNTR-5911
MNTR-5968, MNTR-5972
MNTR-5987, MNTR-5988
MNTR-5991

Keeping page scroll position when switching between tabs in the transaction details page (instead of scrolling to the top of the page).

MNTR-1837

Record REST API invocation and login data in the audit logs of the Web Console and the Admin Console.

MNTR-5539

Prevent services from starting if required port is taken by another process.

MNTR-5630, MNTR-5814

Better error handling in all SOMA, HTTP and REST API invocations from the system.

MNTR-5639, MNTR-5699
MNTR-5863, MNTR-5872
MNTR-5921, MNTR-5963
MNTR-5969, MNTR-5976

Improved user experience in self service portal (deprecated).

MNTR-5713, MNTR-5714

Removed the limitation of appliance migration to run in the Developer Edition.

MNTR-5739

Improved user notifications when federating a new cell member to be more informative.

MNTR-5764, MNTR-6048

Increased the Store thread count limit.

MNTR-5765

Secured the configuration export file by encrypting it.

MNTR-5783

Make sure the configuration export/import completes successfully even if the SSH session is terminated during the execution.

MNTR-5788, MNTR-5789
MNTR-5871, MNTR-6006

Added the custom logo to the configuration export/import.

MNTR-5795

Improved the file download processing performance (e.g.: for downloading the Audit logs from the gateways).

MNTR-5804

Change the reports server HTTP port from 8089 to 8093.

MNTR-5807

Reduced the amount of free disk space required by the must gather script to run.

MNTR-5812

Automatically try to recover from certain situations of unassigned shards in the DPOD Store.

MNTR-4030, MNTR-5818

Updated the external links to the DPOD documentation.

MNTR-5830

Improved the appliance migration process from DataPower IDG appliance to DataPower X3 appliance.

MNTR-5859

Prevented federating a cell member to a cell manager with a different version.

MNTR-5860

Increased the Store services heap size when the server’s RAM is at least 512GB.

MNTR-5861

Renamed "Raw Messages" to "Logs".

MNTR-5876

Tune the Store services heap size for the cell manager.

MNTR-5906

Tune the TomEE services heap size for the Docker Container for Developer Edition.

MNTR-5920, MNTR-5951

Reduced the number of audit log analysis files DPOD collects to 3 files by default.

MNTR-5939

Improved the DPOD Store client error handling.

MNTR-5986, MNTR-5966

Externalized the Store trans log size configuration and manage it from the Store Retention.

MNTR-6024

For certain gateway firmware levels, when Syslog log targets are configured with more than 1 connection and they get disconnected, the DataPower only tries to reconnect the first connection, while the second connection stays down, and the status of the log target is down as well.
Therefore, as a workaround, to support older firmware levels that are still supported, the number of connections has been reduced to 1.

MNTR-6042

Added password re-type when resetting the admin password via CLI.

MNTR-5181

Added restarts/reloads info to logs.

MNTR-5322

Displaying a more informative page for non-existing domains.

MNTR-5345

Generating an internal alert when the Messaging agent is down.

MNTR-5621

Allowing cell member federation to use SSH keys for authenticating to the cell member via SSH instead of user name and password.

MNTR-5641

Avoiding redundant log messages in the TomEE servers.

MNTR-5650

Displaying all events in one table in the API-Connect Extended Latency tab.

MNTR-5687

Periodically updating the domain cache and the Cloud Agent data in the Store.

MNTR-5726

Added additional product activation validations.

MNTR-5745

Added data to the must gather file (processes, umask, indices metadata, services status, etc.)

MNTR-5773, MNTR-5846
MNTR-5881

Improved user experience when IDG is down and trying to access the device from the "Gateways" page.

MNTR-5790

Added a new script to gather and display NVME details for configuring physical cell members.

MNTR-5880

New internal alert for enabled and down log targets.

MNTR-5696

Increase Syslog message size to 3K.

MNTR-5831

Improved error logging for REST APIs errors.

MNTR-5957

The Policy Variables Capture feature, which supports only v5/v5c APIs, is now deprecated and will be removed soon from DPOD.

MNTR-5909

Service status displays Unknown status in the Admin Console services status page while the service is starting or stopping.

MNTR-5598

The payload tab in API-Connect early failing transaction details page shows backend-request/response inner tabs.

MNTR-5667

Auto-setup data is missing after adding a gateway via REST API.

MNTR-5703

An error occurs when removing a cell member from a cell environment.

MNTR-5710, MNTR-5736

The domain filter in the Explore pages does not include domains of gateways that were discovered by the Cloud Agent.

MNTR-5728

The Messaging agent NUMA configuration is missing in the cell member.

MNTR-5733

An error occurs when the Upgrade Assistant is reindexing.

MNTR-5734

Appliance Migration data should not be included in the configuration import/export.

MNTR-5769

API-Connect transactions with GET requests and captured payload display a warning that the request cannot be displayed.

MNTR-5781

Cell member federation rollback fails after the federation fails.

MNTR-5787

A duplicate key error occurs when adding a new entity (user, role, report, etc.) after a configuration import.

MNTR-5792

System parameters export fails when the system parameter name or category includes the space character.

MNTR-5793

System parameters export fails when exporting all System Parameters.

MNTR-5794

The device setup data (Syslog agents, WS-M agents, etc.) should not be included in the configuration import/export.

MNTR-5796

Auto-setup tries to set up a gateway that is currently still loading domains while booting up.

MNTR-5815, MNTR-5856

Non-recent time ranges (such as Yesterday or Last Week) used in reports and alerts had a 15 seconds offset.

MNTR-5832

The DPOD services don’t start if the DPOD backup fails (e.g.: due to running out of free disk space).

MNTR-5851

The gateway’s pods CPU sampling is inaccurate.

MNTR-5853

The Cloud Agent Manager pods run out of memory and restart due to an increasing number of open files.

MNTR-5854

Warnings "Unknown service URI" are displayed in the gateway’s logs due to SOMA requests made by DPOD.

MNTR-5858

The Cloud Agent operator incorrectly expects a username attribute in the DataPower admin password secret.

MNTR-5899

Multiple API-Connect transactions with the same ID might result in showing wrong data in the transaction details page.

MNTR-5900

The database cleanup task might time out when trying to lock the QueryExecution table due to its size.

MNTR-5901

Warning messages are written to the messaging agent logs when processing WS-M messages.

MNTR-5970

WS-M Agent keepalive connections disconnect due to a low HTTP socket timeout.

MNTR-5971

Log target stats table shows partial data.

MNTR-5975

A JavaScript exception appears in the Web Console when clicking on the Payload Capture tab for a Gateway Early Failing transaction.

MNTR-5981

The message filter in the Alerts History page does not work as expected.

MNTR-5982

Report update fails when the JSON query includes a parameter.

MNTR-5996

An error occurs in the Syslog Agent when parsing syslog messages containing frontend URIs with parenthesis.

MNTR-5998

Errors occur during agent shutdown because resources are being closed more than once.

MNTR-6010

Redeploy new IBM logo.

MNTR-6062

The table grid column is too narrow in small resolutions.

MNTR-4099

Uninformative error when trying to create a role with an existing name.

MNTR-4282

Housekeeping tasks might fail after a restart of DPOD due to long configuration database transaction duration.

MNTR-4987

Cannot pass the setup modal window when LDAP is enabled.

MNTR-5606

Error occurs when populating the transaction service configuration changes when the transaction is not part of a service.

MNTR-5695

The domain filter in the Payload Capture page includes domains that don’t belong to the current Product View.

MNTR-5708

The Payload Capture page doesn’t show a proper message when a device is not found.

MNTR-5709

The must gather file includes an empty directory named conf.

MNTR-5746

Service didn’t start after process shutdown with the kill command.

MNTR-5825

After drilling down into a page from the System Health dashboard, clicking on the previous page button in browser doesn’t navigate back to the previous page.

MNTR-5632

Builtin roles that are not authorized to see the Payload Captures still have access to view Policy Variables Capture Grid.

MNTR-5678

Service memory page URL is IdgServiceMemory instead of #idgServiceMemory.

MNTR-5833

Sessions of the Web Console and Admin Console expire too soon (after being idle for only 2 minutes).

MNTR-5962

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-5725, MNTR-5740
MNTR-5751, MNTR-5753
MNTR-5756, MNTR-5757
MNTR-5758, MNTR-5759
MNTR-5762, MNTR-5928
MNTR-5959, MNTR-5965
MNTR-5983, MNTR-6066

Resolved security issues.

MNTR-5290, MNTR-5292
MNTR-5750, MNTR-5702
MNTR-5837, MNTR-5919
MNTR-5952, MNTR-5980
MNTR-6029

Support for Containerized Gateways

• IBM DataPower Gateways deployed in Kubernetes/OpenShift are now supported via the new DPOD Cloud Agent component.

• Automatic discovery of IBM DataPower Gateways as they are deployed, scaled up or scaled down by the DataPower k8s Operator.

• The collected data is stored in a persistent messaging layer until it is processed by DPOD.

• The DPOD Cloud Agent is highly available and can be scaled up or down as required.

MNTR-4884, MNTR-5208
MNTR-5304, MNTR-5319
MNTR-5419, MNTR-5431
MNTR-5564, MNTR-5582
MNTR-5599, MNTR-5624
MNTR-5636, MNTR-5645
MNTR-5688, MNTR-5697
MNTR-5705, MNTR-5717
MNTR-5718, MNTR-5719

Cell members can be removed from a cell environment for decommissioning or transferring to another cell environment.

MNTR-5482, MNTR-5519

A new tool for exporting and importing configuration between DPOD instances (reports, alerts, gateways, roles, LDAP, etc.).

MNTR-5481, MNTR-5543
MNTR-5549

Improved reliability of system services startup/shutdown sequence by polling the process readiness and by proceeding with the startup/shutdown sequence even if one of the services fails to start/stop.

MNTR-4864, MNTR-5413
MNTR-5417, MNTR-5518
MNTR-5600, MNTR-5637
MNTR-5701, MNTR-5716

Added support for the new Syslog log target attributes (buffer size and connections count) in DataPower Gateway firmware 10.5.0 and 10.0.1.9.

MNTR-4895

Reduced the time to fetch device resources data by combining several SOMA requests into a single request.

MNTR-5193

Added support for installation in AWS and Azure.

MNTR-5225

Added support for using a host alias as the log target source when configuring Syslog.

MNTR-5231

New IBM logo.

MNTR-5285

Added REST API for API Connect Analytics payload capture.

MNTR-5287

Logging invalid Syslog message in the Syslog agent logs.

MNTR-5291

Added support for multiple selection and wildcards when creating API Connect Analytics endpoint payload capture.

MNTR-5432, MNTR-5613

Reduced the number of log messages that are collected per transaction for better throughput and longer retention period.

MNTR-5455

Added X3 as a supported gateway in the description of the appliance migration limitations.

MNTR-5490

Remove the limitation of appliance migration to run under the Developer edition.

MNTR-5506

Client IP filter added to reports and alerts.

MNTR-5642

Missing description for some of the API Connect extended latency transaction actions.

MNTR-5548

Improved unassigned shards reallocation performance.

MNTR-5517

Improvements to the must gather utility packaging and collecting process.

MNTR-5552

Added description to quiesce toggle button in maintenance plans.

MNTR-5573

Removed unused properties from properties files and changed MSC_DPOD email subject prefix in alerts and reports to MSC-DPOD.

MNTR-433

Improved some column headers of reports.

MNTR-5429

Removed REST APIs for Syslog and WS-M agents.

MNTR-5515

Improved the security and the stability (e.g.: by applying timeouts and connection re-establishment) of HTTP outbound requests, and avoiding Out-of-Memory errors during downloads of large files (e.g.: backup files), by implementing a unified HTTP client for HTTP requests.

MNTR-4610, MNTR-4759
MNTR-5551, MNTR-5578
MNTR-5597, MNTR-5601
MNTR-5604, MNTR-5607
MNTR-5615, MNTR-5618
MNTR-5619, MNTR-5626
MNTR-5638, MNTR-5685
MNTR-5689

Report update fails with a non-informative message when the report name is longer than 50 chars.

MNTR-4798

Cumulative upgrade fails with the error message Directory /app/keys/store does not exist.

MNTR-5217

Domain sync fails when XML Manager is using an LB Group.

MNTR-5230

Syslog agents keepalive does not recover after Syslog agents restart.

MNTR-5398

Re-enabled backup utility in the Admin Console (reverted MNTR-5394).

MNTR-5405

The Developer edition trial limitations are not shown in Product Activation page.

MNTR-5415

The Developer edition trial period is based on browser time instead of server time.

MNTR-5416

Upgrade to 1.0.18.0 fails in the minimal deployment profile.

MNTR-5488

Filters and import service fail in DevOps Services Portal on a self service portal (deprecated).

MNTR-5498, MNTR-5700

Orphan JSON files under serviceConfigJsons directory cause out-of-memory errors.

MNTR-5501

Quick setup URL validation doesn't work in Internet Explorer 11.

MNTR-5502

flume.init.log file does not rotate on cell members due to file permissions issue.

MNTR-5505

Error when parsing Syslog messages containing front-end URI with a comma or a semicolon.

MNTR-5510

Report files may overwrite each other if they complete at the same time.

MNTR-5555

Missing Error Analysis within Gateway early failed transactions.

MNTR-5561

Errors are reported to flume.init.log file instead of the regular log files.

MNTR-5574

Rollback on failure when resetting admin password from CLI.

MNTR-5580

Transactions may be assigned with Unknown device and domain when a gateway that already has DPOD log targets is added to DPOD (e.g. when migrating the gateway’s configuration to a new gateway), even though Auto Setup is configured for the device.

MNTR-5602

Error message Failed to scan [file:/app/...jar] from classloader hierarchy appears in the TomEE server logs.

MNTR-5603

Maintenance tasks ignore the maintenance window.

MNTR-5616

Reallocation of unassigned shards fails from the Admin Console.

MNTR-5625

Audit log analyzer fails to detected truncated files and fails.

MNTR-5640

The Syslog agent may hang during shutdown due to dropped connections against the Store.

MNTR-5643

LDAP configuration fails on cell members.

MNTR-5644

DPOD backup fails on RHEL 8.x.

MNTR-5646

Error when populating transaction service configuration changes when transaction is not part of a service.

MNTR-5649

A JavaScript Exception appears in the console when clicking on the Payload Capture tab in APIC product view for a non API Connect transaction.

MNTR-5651

The Operation filter doesn’t work within the extended transactions page.

MNTR-5652

NUMA config is lost when upgrading a cell member.

MNTR-5653

Adding a local user fails.

MNTR-5654

Setup Syslog for all devices and domains doesn’t work when having multiple upgrades (Post Upgrade task).

MNTR-5655

Appliance migration fails when choosing the option "Remove source gateway".

MNTR-5658

Gateway-only reports and alerts continue to execute when changing to API Calls license.

MNTR-5407

Service configuration sampling fails when there is no FSH attached.

MNTR-5538

API-C Analytics rate limit data is not parsed for IDG 10.5.0.1 Analytics offload records.

MNTR-5541

Report execution and creation via REST API fail.

MNTR-5668

System Overview Dashboard - System Activity chart showing data from Gateway product view when in APIC product view.

MNTR-5712

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-4054, MNTR-4894
MNTR-5190, MNTR-5315
MNTR-5383, MNTR-5444
MNTR-5445, MNTR-5453
MNTR-5529, MNTR-5550
MNTR-5577, MNTR-5594
MNTR-5611, MNTR-5623
MNTR-5625, MNTR-5635
MNTR-5704

Resolved security issues.

MNTR-5289, MNTR-5339
MNTR-5341, MNTR-5342
MNTR-5343, MNTR-5344
MNTR-5349, MNTR-5412
MNTR-5493, MNTR-5527
MNTR-5620

Implemented changes for test automation.

MNTR-5466, MNTR-5526
MNTR-5546, MNTR-5568

Alerts

MNTR-5186
MNTR-5320
MNTR-5384
MNTR-5406

Triggered alerts now include Investigate links, which display in DPOD the data that triggered each alert.

Alerts

MNTR-5186

Triggered alerts now include additional field names (such as “API”, “Service”, etc.) to identify the alert's subject.

Alerts

MNTR-5186
MNTR-5316

Some useless fields were removed from the triggered alert subject values.

Reports

MNTR-5186

The column headers of reports are now more human friendly (e.g.: no more doc_count or key columns).

Reports

MNTR-5328
MNTR-5367
MNTR-5386

The report file format is now more human friendly (e.g.: background color for column headers).

Improved User Experience

MNTR-5186

Switching between product views (Gateway / API-C) keeps the current page.

Improved User Experience

MNTR-5186

Added Failed Objects page in API-C product view, to inspect object that are enabled but down.

Improved User Experience

MNTR-5186

Added rate limit filters in API Connect transactions page (requires offloading API Connect Analytics data to DPOD).

Improved User Experience

MNTR-5073
MNTR-5369

Added filters and columns in Gateways list.
Filters: Device / Cloud Agent (FFU) / Form Factor / Added By
Columns: Form Factor / Firmware Level / Added By / Cloud Agent (FFU)

API Calls Version

MNTR-5297
MNTR-5400
MNTR-5402
MNTR-5403
MNTR-5409
MNTR-5414

Added support for the new IBM DataPower Operations Dashboard For API Connect Hybrid version.

API Calls Version

MNTR-5297
MNTR-5401
MNTR-5410

A product activation key must be supplied for new installations after the initial login.

Cloud Agents

MNTR-5073

A new page for configuring Cloud Agents (FFU).

Cloud Agents

MNTR-5051
MNTR-5352
MNTR-5380
MNTR-5404

Support of Cloud Agents data in Syslog and WS-M agents (FFU).

Reports

MNTR-5392

Total API Executions Report values are inaccurate.

Internal Alerts

MNTR-5366

A false internal alert “Could not find the latest successful Reindex Manager execution” appears after upgrade.

Payload Capture

MNTR-5381

Description changed for Payload Capture in Gateway product view.

Maintenance Plans

MNTR-5390

Maintenance plans status emails contain a wrong link to the Web Console.

Maintenance Plans

MNTR-5368

Sync tasks fail to deserialize task state from the DB while unquiescing after import has failures.

Admin Console

MNTR-5394

Disabled backup utility from the Admin Console (will be re-enabled in a future version).

Admin Console

MNTR-5177

Store reallocate unassigned shards failed in a Cell environment.

Install

MNTR-5333

Wrong log message when services start was unsuccessful during installation.

Upgrade

MNTR-4996

Rephrasing error message during upgrade.

Upgrade

MNTR-5293

Retention placeholder not replaced during upgrade.

Upgrade

MNTR-5305

Cumulative upgrade 1.0.14.0 -> 1.0.17.0 creates faulty opensearch.yml in cell member.

Upgrade

MNTR-5354

Cumulative upgrade 1.0.14.0 -> 1.0.17.0 added the OpenSearchDashboard service in cell member.

Upgrade

MNTR-5351

Don't print usage when error occurred on upgrade which is not related to wrong usage.

Upgrade

MNTR-5355

Confusing error message after applying upgrade on cell member.

Upgrade

MNTR-5189

Screen is cleared and squashfs warning is not noticeable during upgrade.

Gateways Auto-Setup

MNTR-5243
MNTR-5338

Auto setup fails to correctly detect domains without log targets and might loop on the default domain if log targets are missing.

Backup and Restore

MNTR-5188
MNTR-5360
MNTR-5362

Backup and restore of DPOD now always include both application and configuration database, to guarantee consistency with the encryption keys (formerly called full backup and restore).

Store Dashboards (Expert Mode)

MNTR-5332

The OpenSearchDashboards service was starting prematurely on system startup.

Store Dashboards (Expert Mode)

MNTR-5242

Redirect the OpenSearchDashboards service logs into a log file.

Store

MNTR-5334

Longer timeouts for the Store service startup.

Configuration Database

MNTR-5220

The configuration databse service did not shut down properly.

Dependencies

MNTR-5198
MNTR-5199
MNTR-5200
MNTR-5206
MNTR-5272
MNTR-5370

Upgraded various packages and dependencies.

System

MNTR-5201
MNTR-5202
MNTR-5329
MNTR-5197
MNTR-5321
MNTR-5399

Internal stability fixes and housekeeping.

Improved User Experience

MNTR-4916

Show elapsed time for all transactions (instead of only successful ones) in Transactions page.

Improved User Experience

MNTR-4914

Improved default filters in user preferences, including the time filter and operators (equals/not equals).

Improved User Experience

MNTR-4915
MNTR-5175
MNTR-5176

Custom logo image may be added to the Web Console (in the login page and the top navigation bar).

Alerts

MNTR-5052

A new alert for API-Connect rate limit exceeding a utilization threshold.

Admin Console

MNTR-4997

Backup logs could not be downloaded from the backup process output modal.

Filters

MNTR-5125

Some values might be missing from the auto-complete filters when some of the devices send Syslog messages with a timestamp in the future.

Syslog Agents

MNTR-5042

New log file for invalid messages sent to syslog agents.

REST APIs

MNTR-5103

Return the report and alert internal IDs in the REST API response.

Store

MNTR-5039

Increase heap size on store nodes with high memory.

Security

MNTR-5047
MNTR-5185
MNTR-5187

Require password change for admin user in quick setup modal.

Internal Alerts

MNTR-5072

Fixed false alarm about the retention service not running after an upgrade.

Service Configuration

MNTR-5136

Fixed service configuration sampling failure after service or domain removed from the DataPower gateway.

Cell Environment

MNTR-4851

Stopping unused services after federation completes.

Upgrade

MNTR-4971

Improved the detection of outdated OS.

Upgrade

MNTR-4532
MNTR-5009

Remove unused properties from configuration files.

Upgrade

MNTR-5094
MNTR-5095

Configuration database might get corrupted during rollback.

Upgrade

MNTR-5093

Upgrade fails with non-DPOD mountpoints that start with /data.

Upgrade

MNTR-5165
MNTR-5174

Remove differences between an installation and an upgrade.

Upgrade

MNTR-4456

Placeholder file was not removed after an OS upgrade and reboot.

Upgrade

MNTR-4632

Invalid version in version-history.txt (e.g.: 1.0.13.7).

Upgrade

MNTR-5041

Remove heapDump.out files from /logs directory during upgrade.

Upgrade

MNTR-4871

Warn in case SquashFS configuration is detected in modprobe.

Product Activation

MNTR-5070

Update email address.

Configuration Database

MNTR-3906
MNTR-4890
MNTR-5105
MNTR-5129

Enhanced the security of the configuration database using the latest encoding and digest algorithms.

Dependencies

MNTR-5179
MNTR-5081
MNTR-5089
MNTR-5092

Upgraded OpenSearch to 1.3.2.
Upgraded OpenSearch Dashboards to 1.3.2.
Upgraded Apache TomEE to 8.0.11.
Upgraded JDK to 11.0.15+10.
Upgraded various packages and dependencies.

System

MNTR-4764
MNTR-4801
MNTR-4999
MNTR-5080
MNTR-5102
MNTR-5128

Internal stability fixes and housekeeping.