Enhanced API Connect Error Analysis

• The error analysis now detects a wider range of errors, including those related to property validation, parsing, mapping, GatewayScript, and OAuth tokens.

• Each error entry provides a description, investigation suggestions, and possible solutions.

• Errors are displayed per policy, alongside the policy’s log messages, and at the transaction level.

• Policies containing errors are marked with a distinctive icon in the transaction flow diagram.

MNTR-5279, MNTR-6703
MNTR-6748

Performance

• Syslog message processing performance has significantly improved, achieving up to 8X higher TPS on a single virtual machine.

• The DPOD Health dashboards now feature new metrics and internal alerts to monitor the DPOD agent performance.

• DPOD now collects fewer log messages per transaction, enhancing throughput and extending the retention period.

MNTR-4792, MNTR-5749
MNTR-6355, MNTR-6047
MNTR-6598, MNTR-6723
MNTR-6724, MNTR-6725
MNTR-6726, MNTR-6729
MNTR-6730, MNTR-6736
MNTR-6742, MNTR-6753
MNTR-6754, MNTR-6758
MNTR-6762, MNTR-6770

Reports

• Introduced a new report and alert to track the percentage of failed gateway service transactions.

MNTR-6694

Added a new page for configuring and testing email publishing via SMTP (instead of configuring it via the System Parameters page).

MNTR-6629, MNTR-6756

Added fields to the Cloud Agent CR for specifying direct external hosts and ports for each of the messaging brokers, as well as custom configuration in YAML format instead of a set of environment variables.

MNTR-6660

Created a new DPOD Cloud Agent images tool to deploy the cloud agent in offline/air-gapped environments.

MNTR-6621, MNTR-6628

Improved the gateway transaction success and error status detection, based on the indications in the log messages with the code 0x80e0084b. This mainly resolves a duplication issue where in some specific cases a single failed transaction is counted as several failed transactions, and transactions appear both in the Transactions page as well as in the Early Failing page (such as API Connect requests with an incorrect URL). This also means that the transaction time is now based on the time it completes, rather than on the time it starts, which slightly affects the behavior of the time filter in dashboards and reports.

MNTR-6664, MNTR-6699
MNTR-6712, MNTR-6739
MNTR-6760, MNTR-6768

Added support for NVMe disks for the DPOD installation.

MNTR-6620

Added allowed hosts list system parameter to restrict access to specific hosts as an optional protection against SSRF.

MNTR-6008

Added additional validations of several fields of alerts in the request of the REST APIs for adding and updating alerts in DPOD.

MNTR-6437, MNTR-6709
MNTR-6743

Improved the Setup Probe messages to show which domains have been configured.

MNTR-6663

Set default focus for a faster quick setup and EULA approval.

MNTR-6688

Changed the parameter of the script execute_on_db.sh from -h to --shutdown.

MNTR-6641

Added recommendation to users to run the MustGather script with sudo, in order to collect all available data from the system.

MNTR-6675, MNTR-6698

Renamed the report “Domain Request Size Report” to “Domain Request and Response Size Report”.

MNTR-6664

Renamed the report “Service Average Request Size Report” to “Service Average Request and Response Size”.

MNTR-6664

Renamed “Probe” to “Legacy Probe” whenever the old/legacy probe of DataPower is mentioned in DPOD (e.g.: in the Active Legacy Probes dashboard).

MNTR-6589

Added a new endpoint for providing transactional payloads. This endpoint may be utilized by customers that have their own custom way of collecting transactional payload and would like this payload to appear in the transaction details page in DPOD, instead of using the builtin features DPOD provides for collecting the payloads.

MNTR-6711

Added an installation prerequisite validation that GPG check for local RPMs is disabled.

MNTR-6706

Added a user confirmation before applying the upgrade.

MNTR-6596

Refined the GC logging configuration for all Java processes.

MNTR-6745

Added nvme-cli and tcpdump packages to the Appliance Mode installation.

MNTR-6679

Upgraded httpd access control directives used when OIDC is configured to the new httpd 2.4 directives format.

MNTR-6716, MNTR-6718

Reduced the Web Console and Admin Console session timeout from 60 minutes to 30 minutes for enhanced security.

MNTR-6191

Removed Tomcat session timeout workaround code (added in MNTR-6145 as a temporary workaround).

MNTR-6409

IBM plans to deprecate the Appliance Mode installation in the future, and provide a formal deprecation announcement and a detailed migration plan, outlining the specific timeline and steps for the deprecation. If you have any concerns or questions, please contact your IBM representative to discuss any concerns you may have with the above plan.
For more information, see Statement of Direction: Plans for Appliance Mode Installation Deprecation in DPOD.

MNTR-6697

The transaction memory chart and the transaction latency pie chart have been removed from the transaction details page in favor of the enhanced error analysis.

MNTR-6294

Removed support for DataPower Gateway firmware v2018 and API Connect v2018, which are not supported by IBM since 2023.

The Policy Variables Capture feature, which supports only v5 compatibility mode APIs, and has been deprecated since DPOD 1.0.20.0, was removed from DPOD in favor of the Probe Capture.

MNTR-6429, MNTR-6632

Removed the link to the Logs page in the System Errors grid when clicking on a device name.

MNTR-6737

Gateway probe capture fails for IDG version 10.6.1.0.

MNTR-6568

API probe capture fails for IDG version 10.6.0.3.

MNTR-6712

Appliance migration fails on IDG version 10.6.0.3.

MNTR-6728

Gateway firmware upgrade fails when newer versions of the openssl package are installed on the DPOD server.

MNTR-6740

API Connect v5 compatibility mode data is not collected by the Cloud Agent.

MNTR-6626

Disabled log categories cause the DPOD log targets on the DataPower gateway to be in down state.

MNTR-6680

The upgrade fails during the backup of the existing system due to timeout.

MNTR-6614

The error messages in the Quick Setup modal are displayed as general errors with UUIDs.

MNTR-6624

Error Analysis is missing for some gateway early failing transactions (e.g. message codes 0x8120002f and 0x80e00161).

MNTR-5663, MNTR-5664

The JSON parameters field and the headers field of reports are not validated and may include malformed JSON.

MNTR-6037

Executing scripts by the wrong user prints several error messages instead of a simple error message.

MNTR-6505

A JavaScript exception occurs when switching between tabs of API Probe when there's no data.

MNTR-6604

The script execute_on_db.sh should only allow the application user to run it.

MNTR-6668

The log files in directory /logs/montier_server don’t rotate.

MNTR-6379, MNTR-6682

The log files in directory /logs/httpd don’t rotate.

MNTR-6689

The Admin Console password gets corrupted when using the reset_admin_password.sh script.

MNTR-6627

The DPOD installation fails when the HOSTNAME variable does not exist.

MNTR-6623

Configuration import to a fresh installation of 1.0.22.1 from an upgraded system of the same version fails.

MNTR-6640

Fixed a typo in the message when validating a remote WSDL in the DevOps Service Portal.

MNTR-6415

Quick Setup modal doesn’t navigate to the login page when the session expires.

MNTR-6704

DevOps services portal validate/promote fails with the provided samples of the external scripts due to changes in Python 3.

MNTR-6588

The script app_logical_tran.sh fails to run.

MNTR-6613

Temporary files used to detect gateway restarts are not getting deleted in case of an error.

MNTR-6713

After upgrading a system with OIDC configured, the IAM service is down and login fails until the service is started.

MNTR-6676

Wrong entries are added to version-history.txt file when adding and removing cell members.

MNTR-6734

Messages are flowing outside the success/error/warning notification area.

MNTR-6738

Extended transactions are missing within the DPOD simulator.

MNTR-6741

The value used for validation of the free disk space required in /installs for the upgrade to run is too low.

MNTR-6533

Stopping DPOD services up to a specific service is done in the wrong order.

MNTR-6639

The hostname of the DPOD Appliance Mode installation does not persist when the IP address is changed.

MNTR-6601

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6413, MNTR-6507
MNTR-6578, MNTR-6597
MNTR-6643, MNTR-6644
MNTR-6646, MNTR-6647
MNTR-6649, MNTR-6651
MNTR-6653, MNTR-6657
MNTR-6695, MNTR-6715
MNTR-6731

Resolved security issues.

MNTR-6615, MNTR-6714

Implemented changes for test automation.

MNTR-6645, MNTR-6407

Refactored code and remove unused code.

MNTR-6666

Added support for publishing alerts via HTTP/S and Syslog with JSON format.

MNTR-5393

Added support for the new IBM DataPower Operations Dashboard for Virtual version.
This version is priced per Virtual Processor Core (VPC) for easy and scalable use with IBM DataPower Virtual Edition.

MNTR-6582

Improved the Developer Edition and the Docker Container for Developer Edition installation experience.

MNTR-6526

Add support for appliance mode installation with a single disk for evaluation and POC.

MNTR-6539

Add /proc/cmdline , fapolicyd status and audit logs to the gathered information in the MustGather script.

MNTR-6519, MNTR-6549

Improved the Store Query page with a new query example.

MNTR-6532

Removed the package iptables-services from the prerequisites.

MNTR-6577

Removed support for CentOS 7.x and RHEL 7.x.

MNTR-6517

Cell federation results in too many agents added to the Cell Manager's DB.

MNTR-6530, MNTR-6590

Firmware upgrade doesn't work when running on RHEL/Rocky Linux 9.x.

MNTR-6584

Custom httpd certificates configuration is lost during upgrade.

MNTR-6518, MNTR-6525
MNTR-6583

Wrong disks may be selected when creating file systems during the appliance mode installation.

MNTR-6575

Cloud Agent Probe setup uses a wrong probe expiration time.

MNTR-6512

An error message is not cleared in the Create Probe Capture page.

MNTR-6540

The UI logs are full of warnings generated when populating the transaction flow points.

MNTR-6543

Upgrade fails because /installs/backups directory does not exist.

MNTR-6522

Out of memory error occurs in large cells in the Cell Manager’s console Store node.

MNTR-6541

Import/export configuration scripts and the MustGather file don’t include the new config.yaml file.

MNTR-6579

The gather_nvme_info.sh script displays wrong values for the disks serial numbers on RHEL/Rocky Linux 9.x.

MNTR-6508

Upgraded dependencies and added support for this new version in the installation and upgrade processes.

MNTR-6550, MNTR-6551
MNTR-6552, MNTR-6553
MNTR-6556, MNTR-6559
MNTR-6587, MNTR-6592

Resolved security issues.

MNTR-6515, MNTR-6516
MNTR-6554, MNTR-6547

Gateway Transaction Flow Diagram

• A new visual flow diagram displays the actions in each of the transaction’s rules.

• The diagram includes the types of actions and their latency.

Gateway Probe Capture

• Debug-level data for each action in the gateway transaction can be captured and displayed.

• The data includes content (input, output, etc.), headers, variables, action configuration, etc.

• The capture may be limited by time, transactions count, interval, service name, etc.

• This feature is only supported for IDG with firmware level IDG.10.5.0.12 and higher.

MNTR-5819, MNTR-5967
MNTR-6094, MNTR-6183
MNTR-6211, MNTR-6480
MNTR-6498, MNTR-6500
MNTR-6509

Improved Installation Experience

• The installation and upgrade are much faster, more interactive and with better error handling.

• Enhanced support for silent/automatic installation of DPOD.

• The DPOD Cloud Agent images are now available in the IBM container registry.

• Added support for RHEL / Rocky Linux 9.x.

MNTR-3298, MNTR-4792
MNTR-5130, MNTR-6030
MNTR-6202, MNTR-6315
MNTR-6408, MNTR-6438
MNTR-6457, MNTR-6464
MNTR-6504, MNTR-6506
MNTR-6510

Add a REST API for DPOD installation quick setup (used for silent/automatic installation).

MNTR-5581

Add support for Base64 encoded activation key.

MNTR-6031

The result message of the API Probe Capture REST API has slightly changed.

MNTR-6113

The Cloud Agent REST API now returns a specific error code when trying to get the details of an cloud agent that does not exist.

MNTR-6114