Micro-Integration Monitors

Solace Insights Monitors for Datadog Reference explains how to read and filter the information provided by the monitors offered by your Insights Datadog account.

These monitors track the health and processing status of Micro-Integrations in your estate. Use these monitors to detect when a Micro-Integration is down, experiencing processing failures, or routing messages to the dead message queue (DMQ) due to transformation errors.

The DMQ Activity monitor is the only monitor that detects transformation failures. The Health and Processing Error Rate monitors do not detect transformation failures because poison messages are acknowledged after being sent to the DMQ.

Monitor Name Monitor Type Status Default Severity Configured Details

Micro-Integration is Down

 Metric Active

Alert

The Micro-Integration is reporting an unhealthy status or is not reporting health metrics.

Trigger Conditions:

  • Alert: Health status code greater than 200 over a 5-minute evaluation window, or no health data received for 10 minutes.
  • Recovery: Health status code returns to 200 or below.

Predicted Impact: The Micro-Integration is not processing messages. Data flow through this Micro-Integration is interrupted, and messages may accumulate on the input queue.

Recommended Actions:

  • Check the Micro-Integration status in the Cloud Console.
  • Review Micro-Integration logs in Insights for error messages.
  • Verify connectivity to input and output systems.
  • If the issue persists, contact Solace for assistance.

Micro-Integration Processing Error Rate

 Metric Active

Warning, Alert

The Micro-Integration is experiencing an elevated rate of message processing failures.

Trigger Conditions:

  • Warning: Processing error rate exceeds 2% for 5 minutes.
  • Alert: Processing error rate exceeds 5% for 5 minutes.
  • Recovery: Processing error rate drops below the warning threshold for 5 minutes.

Predicted Impact: Messages are failing to be processed and delivered to the output destination. This typically indicates connectivity issues with downstream systems.

Recommended Actions:

  • Check connectivity to the output binding destination.
  • Review the Micro-Integration Details dashboard for error breakdown by binding and exception type.
  • Verify that the destination system is available and accepting messages.
  • Check for authentication or authorization issues with the output system.

Note: This monitor does not detect transformation failures. Use the DMQ Activity monitor for transformation error detection.

Micro-Integration Dead Message Queue Activity

 Metric Active

Alert

Messages are being routed to the DMQ, indicating transformation failures or poison messages.

Trigger Conditions:

  • Alert: Any messages sent to DMQ output over a 10-minute evaluation window.
  • Recovery: DMQ message rate returns to 0.

Predicted Impact: Messages that cannot be transformed are being sent to the DMQ instead of the intended output destination. These messages require manual review and reprocessing. If left unaddressed, the DMQ may fill up and impact Micro-Integration operation.

Recommended Actions:

  • Review messages in the DMQ to identify the transformation failure pattern.
  • Check the Micro-Integration Details dashboard for error breakdown by binding.
  • Verify that the transformation logic handles the message format being received.
  • Update the transformation configuration if the input message format has changed.
  • Reprocess or discard DMQ messages after addressing the root cause.

Important: This is the only monitor that detects transformation failures. Transformation failures appear as successful processing in other metrics because the poison message is acknowledged after being sent to the DMQ.

Monitor Threshold Tuning

The default thresholds for these monitors are starting values based on typical Micro-Integration operation. You may need to adjust these thresholds based on your specific use case and traffic patterns. For information about customizing monitors, see Extending Advanced Monitoring.