PubSub+ Insights Metrics and Checks

PubSub+ Insights Advanced Monitoring utilized metrics and checks on the various default dashboards provided by Solace. Metrics give you in-depth information (statistics and states) collected from the event broker services. You can use these metrics with Datadog widgets to build visualizations. The information from the metrics is useful to not only manage all aspects of your event broker services, but gives you insight to better manage your event-driven architecture.

Here's a brief summary of what's available:

Service Checks: These metrics characterize the status of a service for monitoring within Datadog. For more information about service checks, see Datadog documentation. These are the service checks that are available with Insights:

Metrics: These are basic metrics that are collected. They are typically tied to measurements and calculated based on statistics and operational numbers logged from the event broker services. These are the metrics available:

Derived Metrics: These metrics are derived. Derived means that the metric determined based on taking a combination information sources to obtain a meaningful and value or status. These are the derived metrics available:

SLI Metrics: In Datadog, a SLI metric is calculated as the number of good requests over the total number of valid requests. This the calculated SLI available:

The following tables describe the metrics and checks available to you when you use PubSub+ Insights and PubSub+ Insights Advanced Monitoring.

Service Checks

These metrics characterize the status of a service for monitoring within Datadog. For more information about service checks, see Datadog documentation.

Service Check name

Description

System POST

system.post-status

The Power-On Self-Test (POST) status.

DNS

system.dns-status

The Domain Name System (DNS) reachability status.

Time server

time-server-status

The Network Time Protocol (NTP) server reachability status.

Disk

disk.status

The internal disk status. A valid status is disabled or up.

Interface

interface.status

The network-interface status. A valid status is disabled or up.

Config-Sync

derived_metrics.config_sync.up_or_disabled

The Config-Sync status. A valid status is Shutdown or Up.

Redundancy

derived_metrics.redundancy-up-or-disabled

The redundancy status. A valid status is Shutdown or Up.

derived_metrics.redundancy.adb_links_status

Whether the ADB Hello is Up.

derived_metrics.redundancy.is-service_active

Whether one event broker in the High Availability (HA) group is active.

derived_metrics.message_spool_service_status

Whether the message spool disk on the active event broker is in the AD-Active state.

derived_metrics.message_spool_standby_status

Whether the message spool disk on the inactive node is in the AD-Standby state.

Message Spool

message-spool-status

Whether the message spool is disabled, or in an AD-Active or AD-Standby operational state.

VPN replication

vpn.replication-status

Whether the replication service, Message VPN bridges and queues are healthy.

vpn.replication-state

Whether the local and remote Message VPN bridges are up and bound.

vpn.replication-sync-eligible

Whether the replication service entered a degraded state.

Bridge

bridge.status

Whether the inbound and outbound Message VPN bridges are healthy and the associated queues are bound.

DMR

dmr.cluster.status

Whether the Dynamic Message Routing (DMR) cluster is operational.

DMR link

dmr.link.status

Whether the DMR links and redundancy are operational.

MNR

mnr.neighbor.status

Whether the Multi-Node Routing (MNR) neighbor status is OK.

Cache Instance

cache-instance.status

Whether the cache instance is operational.

Queue

queue.unbound-and-enabled-with-messages

Whether an enabled queue has messages, but no bound clients. If no clients are consuming from the enabled queue, the queue could fill.

Topic Endpoint

topic-endpoint.unbound-and-enabled-with-messages

Whether a topic endpoint has messages but no bound consumers. If no clients are consuming from the durable topic endpoint , the durable endpoint could fill and no longer hold any more messages.

Metrics

These are basic metrics that are collected. They are typically tied to measurements and calculated based on statistics and operational numbers logged from the event broker services.

Metric Category

Description

Health Statistics

health.disk-latency-current-value

The current disk I/O latency. For more information, see Monitoring the Health of the Software Event Broker.

health.compute-latency-current-value

A comparison of the execution time of well-known functions (for example, epoll timers) against invariant timers [for example, CPU Time Stamp Counter (TSC)]. For more information, see Monitoring the Health of the Software Event Broker.

health.network-latency-current-value

A measurement of the round trip network transaction latency (for example, for a ping operation) between the instance and members of its high-availability (HA) group. For more information, see Monitoring the Health of the Software Event Broker.

health.mate-link-latency-current-value

A measurement of the completion time of a transaction over the mate-link, and is an aggregate metric as the mate-link transaction combines compute, disk, and network latencies. For more information, see Monitoring the Health of the Software Event Broker.

Memory Statistics

physical-memory-usage-percent

The percentage of physical memory used. For more information, see Configuring System Event Thresholds.

subscription-memory-usage-percent

The percentage of memory used by topic subscriptions. For more information, see Configuring System Event Thresholds.

slot-infos.slot-info.nab-buffer-load-factor

The percentage of Network Access Blade (NAB) egress buffers in use. For more information, see Configuring System Event Thresholds.

Storage Statistics

storage-element.storage-element.used-percentage

The percentage of disk usage for each storage element (jail, var, diagnostics, spool, adb, adbBackup).

Client Statistics

client.global.stats.total-clients

The total number of connections on the event broker.

client.global.stats.total-clients-connected

The total number of connected clients.

client.global.stats.total-clients-connected-with-compression

The total number of connected clients connected with compression enabled.

client.global.stats.total-clients-connected-with-ssl

The total number of clients connected using the SSL protocol.

client.global.stats.total-clients-connected-service-smf

The total number of clients connected using the Solace Message Format (SMF) protocol.

client.global.stats.total-clients-connected-service-web

The total number of clients connected using the SSL protocol.

client.global.stats.total-clients-connected-service-rest

The total number of clients connected using REST.

client.global.stats.total-clients-connected-service-mqtt

The total number of clients connected using the MQTT protocol.

client.global.stats.client-data-messages-received

The total number of data messages that were received.

client.global.stats.client-data-messages-sent

The total number of data messages that were sent.

client.global.stats.client-persistent-messages-received

The total number of persistent messages that were received.

client.global.stats.client-persistent-messages-sent

The total number of persistent messages that were sent.

client.global.stats.client-non-persistent-messages-received

The total number of non-persistent messages that were received.

client.global.stats.client-non-persistent-messages-sent

The total number of non-persistent messages that were sent.

client.global.stats.client-direct-messages-received

The total number of direct messages that were received.

client.global.stats.client-direct-messages-sent

The total number of direct messages that were sent.

client.global.stats.client-data-bytes-received

The total of client data (bytes) that were received.

client.global.stats.client-persistent-bytes-received

The total of client persistent data (bytes) that were received.

client.global.stats.client-non-persistent-bytes-received

The total of client non-persistent data (bytes) that were received.

client.global.stats.client-direct-bytes-received

The total of client direct data (bytes) that were received.

client.global.stats.client-data-bytes-sent

The total of client data (bytes) that were sent.

client.global.stats.client-persistent-bytes-sent

The total of client persistent data (bytes) that were sent.

client.global.stats.client-non-persistent-bytes-sent

The total of client non-persistent data (bytes) that were sent.

client.global.stats.client-direct-bytes-sent

The total of client direct data (bytes) that were sent .

client.global.stats.current-login-req-received-rate-per-second

The number of client connections per second.

client.global.stats.current-login-rsp-sent-rate-per-second

The number of client connection acknowledgments per second.

client.global.stats.current-ingress-rate-per-second

The incoming message rate (messages/second).

client.global.stats.current-egress-rate-per-second

The outgoing message rate (messages/second).

client.global.stats.current-ingress-byte-rate-per-second

The incoming byte rate (bytes/second).

client.global.stats.current-ingress-persistent-rate-per-second

The incoming persistent message rate (messages/second).

client.global.stats.current-ingress-nonpersistent-rate-per-second

The incoming non-persistent message rate (messages/second).

client.global.stats.current-ingress-direct-rate-per-second

The incoming direct message rate (messages/second).

client.global.stats.current-egress-byte-rate-per-second

The outgoing byte rate (bytes/second).

client.global.stats.current-egress-persistent-rate-per-second

The outgoing persistent message rate (messages/second).

client.global.stats.current-egress-nonpersistent-rate-per-second

The outgoing non-persistent message rate (messages/second).

client.global.stats.current-egress-direct-rate-per-second

The outgoing direct message rate (messages/second).

client.global.stats.zip-stats.current-ingress-compressed-rate-per-second

The incoming compressed message rate (messages/second).

client.global.stats.zip-stats.current-egress-compressed-rate-per-second

The outgoing compressed message rate (messages/second).

client.global.stats.zip-stats.current-ingress-uncompressed-rate-per-second

The incoming uncompressed message rate (messages/second).

client.global.stats.zip-stats.current-egress-uncompressed-rate-per-second

The outgoing uncompressed-message rate (messages/second).

client.global.stats.ssl-stats.current-ingress-ssl-rate-per-second

The incoming encrypted message rate (messages/second).

client.global.stats.ssl-stats.current-egress-ssl-rate-per-second

The outgoing encrypted message rate (messages/second).

client.global.stats.ingress-discards.total-ingress-discards

The total incoming message discards.

client.global.stats.egress-discards.total-egress-discards

The total outgoing message discards.

Message Spool Statistics

message-spool-info.max-disk-usage

The size of the disk (in MB) used for the Message Spool.

message-spool-info.max-message-count

The maximum number of messages that can exist at one time on the Message Spool.

message-spool-info.max-message-spool-entities

The number of endpoints supported by the Message Spool.

message-spool-info.message-count-utilization-percentage

The percentage of the maximum message count that is currently in use.

message-spool-info.transaction-resource-utilization-percentage

The percentage of transaction resources that is currently in use.

message-spool-info.transacted-session-resource-utilization-percentage

The percentage of transaction resources utilized by all transacted sessions.

This is the percentage of system resources required per transaction session, how many transactions can be handled in a session (connection that are capable of supporting transactions), and the resources required per transaction per session.

message-spool-info.transacted-session-count-utilization-percentage

The percentage of transacted sessions in use.

message-spool-info.delivered-unacked-msgs-utilization-percentage

The percentage of persistent messages delivered to consumers but not yet acknowledged. The event broker has a limited number of messages that it allows to be in a unacknowledged state.

message-spool-info.spool-files-utilization-percentage

The percentage of Message Spool files that is utilized. The event broker has a limited number of Message Spool files that it can manage.

message-spool-info.active-disk-partition-usage

The amount of space consumed on the message spool disk (MB) of the active nodes.

message-spool-info.mate-disk-partition-usage

The amount of space consumed on the message spool disk (MB) of the backup nodes.

message-spool-info.message-spool-entities-used-by-queue

The number of Message Spool entities consumed by queues.

message-spool-info.message-spool-entities-used-by-dte

The number of Message Spool entities consumed by durable topic endpoints.

message-spool-info.transacted-sessions-used

The number of transactional sessions in use.

message-spool-info.transacted-sessions-local-used

The number of local transactional sessions in use.

message-spool-info.transacted-sessions-xa-used

The count of XA transaction currently in use. XA transactions are distributed transactions managed by an external transaction manager.

message-spool-info.transactions-used

The total number of local transactions and XA transactions in use.

message-spool-info.max-transactions

The maximum number of local transactions and XA transactions.

message-spool-info.transactions-local-used

The number of local transactions in use.

message-spool-info.transactions-xa-used

The number of XA transactions in use.

message-spool-info.queue-topic-subscriptions-used

The number of topic subscriptions in use.

message-spool-info.ingress-flows-allowed

The maximum number of ingress flows.

message-spool-info.flows-allowed

The maximum number of flows. For more information, see Creating Flows.

message-spool-info.ingress-flow-count

The number of ingress flows (Guaranteed Messaging client publish flows).

message-spool-info.active-flow-count

The number of active flows. For more information, see Creating Flows.

message-spool-info.inactive-flow-count

The number of inactive (disconnected) flows. For more information, see Creating Flows.

message-spool-info.browser-flow-count

The count of browser flows. This provides you some insight to the messages in a queue.

message-spool-info.current-persist-usage

The amount of data on disk (MB).

message-spool-info.total-messages-currently-spooled

The number of messages currently spooled.

message-spool-info.current-cache-usage

The amount of cache currently used for internal broker persistent messages.

Message Spool Rates by Message VPN Statistics

message-spool-rates.total-message-vpn-spool-rates.qendpt-data-rates.current-ingress-byte-rate-per-second

The incoming message rate (bytes/second) for a queue endpoint.

message-spool-rates.total-message-vpn-spool-rates.qendpt-data-rates.current-ingress-rate-per-second

The incoming messages rate (messages/second) for a queue endpoint.

message-spool-rates.total-message-vpn-spool-rates.qendpt-data-rates.current-egress-byte-rate-per-second

The outgoing messages rate (bytes/second) for a queue endpoint.

message-spool-rates.total-message-vpn-spool-rates.qendpt-data-rates.current-egress-rate-per-second

The outgoing messages rate (messages/second) for a queue endpoint.

Message VPN Detailed Statistics

vpn.total-unique-subscriptions

The number of unique subscriptions in the Message VPN.

vpn.max-subscriptions

The configured maximum number of subscriptions for the Message VPN.

vpn.total-remote-unique-subscriptions

The number of subscriptions from remote brokers (MNR / DMR).

vpn.total-local-unique-subscriptions

The number of local subscriptions in use by consumers connected to this Message VPN.

vpn.export-subscriptions-percent-complete

The percentage of subscriptions propagated to remote brokers.

vpn.connections

The current number of connections to the Message VPN.

vpn.max-connections

The configured maximum number of connections for the Message VPN.

vpn.connections-service-smf

The total number of connections using the Solace Message Format (SMF) protocol in the Message VPN.

vpn.max-connections-service-smf

The configured maximum number of connections using the SMF protocol.

vpn.connections-service-web

The total number of connections using the Web Messaging protocol.

vpn.max-connections-service-web

The configured maximum number of connections using the Web Messaging protocol.

vpn.connections-service-rest-incoming

The total number of incoming REST connections.

vpn.max-connections-service-rest-incoming

The configured maximum number of incoming connections using the REST protocol.

vpn.connections-service-mqtt

The current number of MQTT connections.

vpn.max-connections-service-mqtt

The configured maximum number of MQTT connections

vpn.connections-service-rest-outgoing

The total number of outgoing REST connections.

vpn.max-connections-service-rest-outgoing

The configured maximum number of outgoing connections using the REST protocol.

vpn.connections-service-amqp

The current number of AMQP connections.

vpn.max-connections-service-amqp

The configured maximum number of AMQP connections.

vpn.stats.login-msgs-received

The number of client logins for the Message VPN.

vpn.stats.login-msgs-sent

The number of client login acknowledgements for the Message VPN.

vpn.stats.total-client-messages-received

The sum of data and control messages received.

vpn.stats.total-client-messages-sent

The sum of data and control messages sent.

vpn.stats.client-data-messages-received

The sum of data messages received.

vpn.stats.client-data-messages-sent

The sum of data messages received.

vpn.stats.client-control-messages-received

The sum of control messages received.

vpn.stats.client-control-messages-sent

The sum of control messages sent.

vpn.stats.client-persistent-messages-received

The sum of persistent messages received.

vpn.stats.client-persistent-messages-sent

The sum of persistent messages sent.

vpn.stats.client-non-persistent-messages-received

The sum of non-persistent messages received.

vpn.stats.client-non-persistent-messages-sent

The sum of non-persistent messages sent.

vpn.stats.client-direct-messages-received

The sum of direct messages received.

vpn.stats.client-direct-messages-sent

The sum of direct messages sent.

vpn.stats.current-ingress-rate-per-second

The number of incoming messages per second for the Message VPN.

vpn.stats.current-egress-rate-per-second

The number of outgoing messages per second for the Message VPN.

vpn.stats.average-ingress-rate-per-minute

The average of incoming messages per second sampled at 60 seconds for the Message VPN.

vpn.stats.average-egress-rate-per-minute

The average of outgoing messages per second sampled at 60 seconds for the Message VPN.

vpn.stats.current-ingress-byte-rate-per-second

The average of incoming bytes per second for the Message VPN.

vpn.stats.current-egress-byte-rate-per-second

The average of outgoing bytes per second for the Message VPN.

vpn.stats.average-ingress-byte-rate-per-minute

The average of incoming bytes per second sampled at 60 seconds for the Message VPN.

vpn.stats.average-egress-byte-rate-per-minute

The average of outgoing bytes per second sampled at 60 seconds for the Message VPN.

vpn.stats.total-client-bytes-sent

The total bytes sent for data and control messages.

vpn.stats.client-data-bytes-sent

The total bytes sent for data messages.

vpn.stats.client-persistent-bytes-sent

The total bytes sent for persistent messages.

vpn.stats.client-non-persistent-bytes-sent

The total bytes sent for non-persistent messages.

vpn.stats.client-direct-bytes-sent

The total bytes sent for direct messages.

vpn.stats.client-control-bytes-sent

The total bytes sent for control messages.

vpn.stats.total-client-bytes-received

The total bytes received for data and control messages.

vpn.stats.client-data-bytes-received

The total bytes received for data messages

vpn.stats.client-persistent-bytes-received

The total bytes received for persistent messages

vpn.stats.client-non-persistent-bytes-received

The total bytes received for non-persistent messages

vpn.stats.client-direct-bytes-received

The total bytes received for direct messages

vpn.stats.client-control-bytes-received

The total bytes received for control messages

vpn.stats.zip-stats.current-ingress-compressed-rate-per-second

The incoming compressed messages per second.

vpn.stats.zip-stats.current-egress-compressed-rate-per-second

The outgoing compressed messages per second.

vpn.stats.zip-stats.current-ingress-uncompressed-rate-per-second

The incoming uncompressed messages per second.

vpn.stats.zip-stats.current-egress-uncompressed-rate-per-second

The outgoing uncompressed messages per second.

vpn.stats.ssl-stats.current-ingress-ssl-rate-per-second

The incoming encrypted messages per second using the SSL protocol.

vpn.stats.ssl-stats.current-egress-ssl-rate-per-second

The outgoing encrypted messages per second using the SSL protocol.

vpn.stats.ssl-stats.ingress-ssl-bytes

The incoming encrypted messages using the SSL protocol, measured in bytes.

vpn.stats.ssl-stats.egress-ssl-bytes

The outgoing encrypted messages using the SSL protocol, measured in bytes.

vpn.stats.ssl-stats.average-ingress-ssl-rate-per-minute

The average incoming encrypted messages using the SSL protocol, measured in bytes and sampled at 60 seconds.

vpn.stats.ssl-stats.average-egress-ssl-rate-per-minute

The average outgoing encrypted messages using the SSL protocol, measured in bytes and sampled at 60 seconds.

vpn.stats.ingress-discards.total-ingress-discards

The total incoming message discards for the Message VPN.

vpn.stats.ingress-discards.no-subscription-match

The incoming message discards with no subscription match for the Message VPN.

vpn.stats.ingress-discards.topic-parse-error

The incoming message discards with topic-parse errors for the Message VPN.

vpn.stats.ingress-discards.parse-error

The incoming message discards with parse error for the Message VPN.

vpn.stats.ingress-discards.msg-too-big

The incoming message discards with a message size that exceeds the limit for the Message VPN.

vpn.stats.ingress-discards.ttl-exceeded

The incoming message discards with a time-to-live (TTL) expiry for the Message VPN.

vpn.stats.ingress-discards.publish-topic-acl

The incoming message discards due to publisher ACL rules for the Message VPN.

vpn.stats.ingress-discards.message-spool-congestion

The incoming message discards with Message Spool congestion for the Message VPN.

vpn.stats.ingress-discards.msg-spool-discards

The incoming message discards with Message Spool discards for the Message VPN.

vpn.stats.egress-discards.total-egress-discards

The total outgoing message discards for the Message VPN.

vpn.stats.egress-discards.transmit-congestion

The outgoing message discards due to slow consumers for the Message VPN.

vpn.stats.egress-discards.compression-congestion

The outgoing message discards due to compression congestion for the Message VPN.

vpn.stats.egress-discards.message-elided

The outgoing message discards due to message eliding for the Message VPN.

vpn.stats.egress-discards.ttl-exceeded

The outgoing message discards due to message time-to-live (TTL) expiry for the Message VPN.

vpn.stats.egress-discards.client-not-connected

The outgoing message discards due to disconnected consumers for the Message VPN.

vpn.stats.egress-discards.msg-spool-egress-discards

The total outgoing message discards for all persistent message discards for the Message VPN.

Message VPN Statistics

message-vpn.vpn.current-queues-and-topic-endpoints

The number of queues and topic endpoints on the Message VPN.

message-vpn.vpn.maximum-queues-and-topic-endpoints

The maximum number of queues and topic endpoints permitted on the Message VPN.

message-vpn.vpn.num-queues

The total number of queues on the Message VPN.

message-vpn.vpn.num-topic-endpoints

The total number of topic endpoints on the Message VPN.

message-vpn.vpn.current-messages-spooled

The current number of messages that are spooled for the Message VPN.

message-vpn.vpn.current-spool-usage-mb

The current size (MB) of all messages that are spooled for the Message VPN.

message-vpn.vpn.maximum-spool-usage-mb

The maximum storage (MB) permitted for the Message VPN.

message-vpn.vpn.current-transacted-sessions

The current number of transactional sessions (connections) in use on the Message VPN.

message-vpn.vpn.maximum-transacted-sessions

The maximum number of transactional sessions (connections) permitted on the Message VPN.

message-vpn.vpn.transacted-sessions-local-used

The current number of local-transactional sessions (connections) in use on the Message VPN.

message-vpn.vpn.transacted-sessions-xa-used

The current number of XA-transactional sessions (connections) in use on the VPN

message-vpn.vpn.current-transactions

The current number of open transactions on the Message VPN.

message-vpn.vpn.maximum-transactions

The maximum number of open transactions permitted on the Message VPN.

message-vpn.vpn.transactions-local-used

The current number of open local transactions on the Message VPN.

message-vpn.vpn.transactions-xa-used

The current number of open XA transactions on the Message VPN.

message-vpn.vpn.current-egress-flows

The current number of outgoing consumer flows for the Message VPN.

message-vpn.vpn.maximum-egress-flows

The maximum number of outgoing consumer flows permitted for the Message VPN.

message-vpn.vpn.current-ingress-flows

The current number of incoming publisher flows for the Message VPN.

message-vpn.vpn.maximum-ingress-flows

The maximum number of incoming publisher flows permitted for the Message VPN.

Message Spool Detailed Statistics

message-spool-stats.discard-spooling-not-ready

The total number of messages discards due to the Message Spool not being ready.

message-spool-stats.discard-ooo

The messages were discarded due to the sequence number being out of order.

message-spool-stats.discard-duplicate

The messages were discarded due to a duplicate sequence number.

message-spool-stats.discard-nodest

The messages were discarded due to there being no destination (or a subscription match).

message-spool-stats.discard-spool-over-quota

The messages were discarded because Message Spool quota has been exceeded.

message-spool-stats.discard-qendpt-over-quota

The messages were discarded because the persistent endpoint quota has been exceeded.

message-spool-stats.discard-max-msg-usage-exceeded

The messages were discarded because the maximum number of spooled messages permitted has been exceeded.

message-spool-stats.discard-max-msg-size-exceeded

The messages were discarded because the maximum allowed message size has been exceeded.

message-spool-stats.discard-remote-router-spooling-not-supported

The messages were discarded because the remote broker Message Spool status was down.

message_spool_stats.discard_spool_to_adb_fail

The messages were discarded because of an ADB process failure.

message_spool_stats.discard-spool-to-disk-fail

The messages were discarded due to a disk failure.

message-spool-stats.discard-spool-file-limit-exceeded

The messages were discarded because the system Message Spool file limit was exceeded.

message-spool-stats.discard-errored-message

The number of messages that were discarded because an error spooling the message was encountered.

message-spool-stats.discard-queue-not-found

The messages were discarded because the queue was missing or was not found.

message-spool-stats.spool-shutdown-discard

The messages were discarded because the Message Spool (queue, Message VPN, or system) was shutdown.

message-spool-stats.user-profile-deny-guaranteed

The messages were discarded due to client profile restrictions.

message-spool-stats.discard-publisher-not-found

The messages were discarded due to a publisher disconnection.

message-spool-stats.no-local-delivery-discard

The messages were discarded because local delivery was disabled (delivery back to publisher).

message-spool-stats.smf-ttl-exceeded

The messages were discarded due to SMF TTL (Solace Message Format Time-to-Live) expiry.

message-spool-stats.publish-acl-denied

The messages were discarded because of publisher topic ACL restrictions.

message-spool-stats.destination-group-error

The messages were rejected because one or more queues were unable to spool the message.

message-spool-stats.low-priority-msg-congestion-discard

The low-priority messages were discarded because persistent-endpoint congestion was in favor of higher priority messages.

message-spool-stats.replication-is-standby-discard

The messages were discarded because VPN replication status is in standby replication state.

message-spool-stats.sync-replication-ineligible-discard

The messages were discarded because the status of the replication bridge is Sync Ineligible.

message-spool-stats.discard-other

The messages discarded because the status is other (no matching discard category).

message-spool-stats.total-deleted-messages

The total, system-wide number of administrator-deleted messages.

message-spool-stats.total-ttl-expired-discard-messages

The total number of messages discarded due to time-to-live (TTL) expiration

message-spool-stats.total-ttl-expired-to-dmq-messages

The total number of messages discarded due to TTL expiration that were moved to a dead message queue (DMQ).

message-spool-stats.total-ttl-expired-to-dmq-failures

The total number of messages discarded due to TTL expiration that failed to be moved to the DMQ.

message-spool-stats.max-redelivery-exceeded-discard-messages

The total number of messages discarded because the max redelivery attempts set on the queue were exceeded.

message-spool-stats.max-redelivery-exceeded-to-dmq-messages

The total number of messages discarded because the maximum redelivery attempts set on the queue were exceeded and that were moved to the DMQ.

message-spool-stats.max-redelivery-exceeded-to-dmq-failures

The total number of messages discarded because the maximum redelivery attempts that were set on the queue were exceeded and that failed to be moved to the DMQ.

message-spool-stats.total-ttl-exceeded-discard-messages

The total number of messages discarded because the TTL expiration has been exceeded.

message-spool-stats.ingress-messages

The number of system-wide, incoming persistent and promoted messages.

message-spool-stats.ingress-messages-promoted

The number of system-wide, incoming direct messages promoted to persistent messages.

message-spool-stats.ingress-messages-demoted

The number of system-wide, incoming persistent messages that were demoted to direct messages.

message-spool-stats.promoted-messages-replicated

The number of system-wide, incoming direct messages promoted to persistent and forwarded to the replication mate (broker).

message-spool-stats.ingress-messages-async-replicated

The number of system-wide, asynchronous messages sent on the replication bridge.

message-spool-stats.ingress-messages-sync-replicated

The number of system-wide, synchronous messages sent on the replication bridge.

message-spool-stats.ingress-messages-from-replication-mate

The number of messages received on the replication bridge.

Bridge Statistics

bridges.bridge.client.stats.current-ingress-rate-per-second

The rate of incoming messages per second for a Message VPN bridge (or simply, bridge) connection from a remote Message VPN.

bridges.bridge.client.stats.current-egress-rate-per-second

The rate of outgoing messages per second for a bridge connection to a remote Message VPN.

bridges.bridge.client.stats.current-ingress-byte-rate-per-second

The rate of incoming bytes per second for a bridge connection from a remote Message VPN.

bridges.bridge.client.stats.current-egress-byte-rate-per-second

The rate of outgoing bytes per second for a bridge connection to a remote Message VPN.

bridges.bridge.client.stats.client-data-messages-received

The number of messages received for a bridge for all message types.

bridges.bridge.client.stats.client-data-messages-sent

The number of messages sent for a bridge for all message types.

bridges.bridge.client.stats.client-persistent-messages-received

The number of messages received for a bridge for persistent messages.

bridges.bridge.client.stats.client-persistent-messages-sent

The number of messages sent for a bridge for persistent messages.

bridges.bridge.client.stats.client-non-persistent-messages-received

The number of messages received for a bridge for non-persistent messages.

bridges.bridge.client.stats.client-non-persistent-messages-sent

The number of messages sent for a bridge for non-persistent messages.

bridges.bridge.client.stats.client-direct-messages-received

The number of messages received for a bridge for direct messages.

bridges.bridge.client.stats.client-direct-messages-sent

The number of messages sent for a bridge for direct messages.

bridges.bridge.client.stats.ingress-discards.total-ingress-discards

The number of incoming message discards for a bridge for all message types.

bridges.bridge.client.stats.egress-discards.total-egress-discards

The number of outgoing message discards for a bridge for all message types.

Multi-Node Routing Statistics

neighbor.neighbors.neighbor.stats.current-message-rate-messages-per-second.data-rate.ingress

The rate of incoming messages per second over the Multi-Node Routing (MNR) link.

neighbor.neighbors.neighbor.stats.current-message-rate-messages-per-second.data-rate.egress

The rate of outgoing message per second over an MNR link.

neighbor.neighbors.neighbor.stats.ingress-discards.total-ingress-discards

The number of incoming message discards for an MNR link.

neighbor.neighbors.neighbor.stats.egress-discards.total-egress-discards

The number of outgoing message discards for an MNR link.

Cache Instance Statistics

cache-instances.cache-instance.remote.status.cpu-utilization

The remote cache instance’s CPU utilization percentage.

cache-instances.cache-instance.remote.status.cache-requests-received

The remote cache instance cache lookup requests received from client connections.

cache-instances.cache-instance.remote.status.stats.stat[name="Cached Topics"].current-value

The total number of cached topics (indexes) on the remote cache instance.

cache-instances.cache-instance.remote.status.stats.stat[name="Messages Cached"].current-value

The current number of cached messages on the remote cache instance.

cache-instances.cache-instance.remote.status.stats.stat[name="Messages Cached (cumulative)"].current-value

The total number of messages cached by the remote cache instance since the cache was empty.

cache-instances.cache-instance.remote.status.stats.stat[name="Message Bytes Cached"].current-value

The current number of bytes consumed by cached messages on the remote cache instance (measured in bytes).

cache-instances.cache-instance.remote.status.stats.stat[name="Message Bytes Cached (cumulative)"].current-value

The current number of bytes consumed by cached messages on the remote cache instance (measured in bytes) since the cache was empty.

Queue Statistics

queues.queue.info.bind-count

The number of consumers bound to the queue.

queues.queue.info.num-messages-spooled

The number of messages spooled.

queues.queue.info.current-spool-usage-in-mb

The size (MB) of all messages currently spooled.

Queue Rate Statistics

queues.queue.rates.qendpt-data-rates.current-ingress-byte-rate-per-second

The incoming message rate for the queue endpoint measured in bytes per second.

queues.queue.rates.qendpt-data-rates.current-ingress-rate-per-second

The incoming message rate for the queue endpoint measured in messages per second.

queues.queue.rates.qendpt-data-rates.current-egress-byte-rate-per-second

The outgoing message rate for the queue endpoint measured in bytes per second.

queues.queue.rates.qendpt-data-rates.current-egress-rate-per-second

The outgoing message rate for the queue endpoint measured in bytes per second.

Topic Endpoint Statistics

topic-endpoints.topic-endpoint.info.bind-count

The number of consumers bound to a topic endpoint.

topic-endpoints.topic-endpoint.info.num-messages-spooled

The number of messages spooled.

topic-endpoints.topic-endpoint.info.current-spool-usage-in-mb

The size (MB) of all the messages currently spooled.

Topic Endpoint Rate Statistics

topic-endpoints.topic-endpoint.rates.qendpt-data-rates.current-ingress-byte-rate-per-second

The incoming message rate (bytes/second) for the topic endpoint.

topic-endpoints.topic-endpoint.rates.qendpt-data-rates.current-ingress-rate-per-second

The incoming message rate (messages/second) for the topic endpoint.

topic-endpoints.topic-endpoint.rates.qendpt-data-rates.current-egress-byte-rate-per-second

The outgoing message rate (bytes/second) for the topic endpoint.

topic-endpoints.topic-endpoint.rates.qendpt-data-rates.current-egress-rate-per-second

The outgoing message rate (messages/second) for the topic endpoint measured.

REST Delivery Point Statistics

rest.rest-delivery-points.rest-delivery-point.stats.http-post-request-messages-sent

The number of HTTP POST requests sent to the post-request-target (string to use when sending requests) when delivering messages to consumers.

rest.rest-delivery-points.rest-delivery-point.stats.http-post-request-messages-sent-connection-closed

The number of closed HTTP connections between the RDP and post-request-target.

rest.rest-delivery-points.rest-delivery-point.stats.http-post-response-messages-received

The total number of POST responses received from the post-request-target.

rest.rest-delivery-points.rest-delivery-point.stats.http-post-response-messages-received-successful

The number of successful HTTP POST responses received from the post-request-target.

rest.rest-delivery-points.rest-delivery-point.stats.http-post-response-messages-received-error

The number of HTTP errors when issuing a POST request to the post-request-target.

Derived Metrics

These metrics are derived. Derived means that the metric determined based on taking a combination information sources to obtain a meaningful and value or status.

Derived Metric

Description

Derived Client Statistics

derived-metrics.broker-resource-utilization.total-clients-connected-utilization-percentage

The percentage of client connections in use.

derived-metrics.broker-resource-utilization.total-clients-connected-service-smf-utilization-percentage

The percentage of Solace Message Format (SMF) client connections in use.

derived-metrics.broker-resource-utilization.total-clients-connected-service-web-utilization-percentage

The percentage of Web Messaging client connections in use.

derived-metrics.broker-resource-utilization.total-clients-connected-service-rest-utilization-percentage

The percentage of REST client connections in use.

derived-metrics.broker-resource-utilization.total-clients-connected-service-mqtt-utilization-percentage

The percentage of MQTT client connections in use.

derived-metrics.broker-resource-utilization.total-clients-connected-service-ssl-utilization-percentage

The percentage of SSL client connections in use.

Derived Redundancy Statistics

redundancy.virtual_routers.primary.status.activity

The primary event broker activity status, used by advanced mode agents reporting to the production sub-organization.

redundancy.virtual-routers.backup.status.activity

The backup event broker activity status, used by advanced mode agents reporting to the production sub-organization.

redundancy.oper_status.adb-link-up

Assured Delivery Blade (ADB) link status, used by advanced mode agents reporting to the production sub-organization.

redundancy.redundancy_status

Redundancy status, used by advanced mode agents reporting to the production sub-organization.

derived_metrics.redundancy.up_or_disabled

Whether the state of redundancy is Up or Disabled.

derived_metrics.redundancy.primary_is_local_active

Whether the primary node is the active node in a High-Availability (HA) pair.

derived_metrics.redundancy.backup_is_local_active

Whether the backup node the active node in a HA pair.

derived_metrics.redundancy.is_local_active

Whether one of the nodes in the HA pair is active.

derived_metrics.redundancy.is_service_active

Whether the event broker service has a healthy configuration for local activity on all nodes.

derived-metrics.redundancy.adb_links_status

Assured Delivery Blade (ADB) link and ADB Hello are both up.

derived_metrics.message_spool_service_status

Whether the Message Spool on the active node in the AD-Active state.

derived_metrics.message_spool_standby_status

Whether the Message Spool on the standby node in the expected state.

Derived Config-Sync Statistics

config_sync.status.oper_status

The operational status of Config-Sync, used by advanced mode agents that report to the production suborganization.

derived_metrics.config_sync.up_or_disabled

The operational status of Config-Sync.

Derived Message Spool Details Statistics

derived_metrics.broker_resource_utilization.spool_utilization_percentage

The percentage of space on the Message Spool disk in use.

derived_metrics.broker_resource_utilization.ingress_flow_utilization_percentage

The percentage of ingress flows in use.

derived_metrics.broker_resource_utilization.egress_flow_utilization_percentage

The percentage of total allowed egress flows utilized.

derived_metrics.broker_resource_utilization.endpoint_utilization_percentage

The percentage of message spool entities utilized by queues and topics.

derived_metrics.nab_resource_utilization.ad_cache_utilization_percentage

The Message Spool cache utilization percentage.

derived_metrics.message_spool.is_ad_active

Whether the Message Spool disk in the AD-Active state.

Derived DNS_Statistics

derived_metrics.system.dns_status

Whether the Domain Name System (DNS) is operational.

Derived Hardware HBA Link Statistics

derived_metrics.hba_link.status

Whether the Host Bus Adapter (HBA) link is online.

Derived Message VPN_Replication Statistics

derived_metrics.vpn.replication_status

Replicated message Message VPNs are enabled, bridges are connected, and have a bound queue. For more information, see Replication Overview.

derived_metrics.vpn.replication_sync_eligible.downgrade

Message VPN replication has degraded and is now asynchronous. For more information, see Replication Overview.

derived_metrics.vpn.replication_sync_eligible.reject

Message VPN replication has degraded and synchronous messages and transactions are being rejected. For more information, see Replication Overview.

Derived Message VPN Statistics

derived_metrics.vpn_resource_utilization.total_clients_connected_utilization_percentage

The percentage of Message VPN connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_smf_utilization_percentage

The percentage of SMF connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_web_utilization_percentage

The percentage of Web Messaging connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_rest_incoming_utilization_percentage

The percentage of incoming REST connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_rest_outgoing_utilization_percentage

The percentage of outgoing REST connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_mqtt_utilization_percentage

The percentage of MQTT connections in use.

derived_metrics.vpn_resource_utilization.total_clients_connected_service_amqp_utilization_percentage

The percentage of AMQP connections in use.

derived_metrics.vpn_resource_utilization.total_subscription_utilization_percentage

The percentage of total unique subscriptions in use.

Derived Message Spool by Message VPN Statistics

derived_metrics.vpn_resource_utilization.total_endpoint_utilization_percentage

The percentage of the maximum queues and topics in use.

derived_metrics.vpn_resource_utilization.spool_utilization_percentage

The percentage of Message Spool disk storage capacity that is in use.

derived_metrics.vpn_resource_utilization.transacted_session_utilization_percentage

The percentage of transacted sessions in use.

derived_metrics.vpn_resource_utilization.transaction_utilization_percentage

The percentage of transactions in use.

derived_metrics.vpn_resource_utilization.egress_flow_utilization_percentage

The percentage of egress flows in use.

derived_metrics.vpn_resource_utilization.ingress_flow_utilization_percentage

The percentage of ingress flows in use.

Derived Bridge Statistics

derived_metrics.bridge.status

The bridge's inbound, outbound, and queue status is healthy.

Derived DMR Clusters Statistics

derived_metrics.dmr.cluster.status

The Dynamic Message Routing (DMR) cluster operational status is healthy.

Derived DMR Link Statistics

derived_metrics.dmr.link.status

The DMR link operational status is healthy.

Derived Multi-node Routing Statistics

derived_metrics.mnr.neighbor.status

The status of the Multi-Node Routing (MNR) neighbor is healthy.

Derived Cache Instance Statistics

derived_metrics.cache_instance.status

The cache instance status is healthy.

derived_metrics.cache_instance.lost_message

The cache instance is reporting a lost-message status.

derived-metrics.cache-instance-resource-utilization.topic-utilization-percentage",

The percentage of topics in use.

derived-metrics.cache-instance-resource-utilization.memory-utilization-percentage",

The percentage of memory in use.

derived-metrics.cache-instance-resource-utilization.message-memory-utilization-percentage",

The percentage of cached message bytes in use.

derived-metrics.cache-instance-resource-utilization.request-queue-utilization-percentage",

The percentage of queues in use.

Derived Client Username Statistics

derived-metrics.client-username-resource-utilization.total-clients-utilization-percentage

The percentage of client username connections in use.

derived-metrics.client-username-resource-utilization.total-clients-smf-utilization-percentage

The percentage of SMF client username connections in use.

derived-metrics.client-username-resource-utilization.total-clients-web-utilization-percentage

The percentage of Web Messaging client username connections in use.

derived-metrics.client-username-resource-utilization.total-endpoints-utilization-percentage

The percentage of client username endpoints in use.

Derived Queue Statistics

derived-metrics.queue-resource-utilization.spool-utilization-percentage

The percentage of the Message Spool disk space in use.

derived-metrics.queues.unbound-and-enabled-with-messages

A queue has messages spooled and but no clients consuming from the queue.

message-spool.message-vpn.vpn.queues.unbound-and-enabled-with-messages

The number of queues on a Message VPN that are unbound and have messages in the queue.

Derived Topic Endpoint Statistics

derived-metrics.topic-endpoint-resource-utilization.spool-utilization-percentage

The percentage of Message Spool disk space in use.

derived-metrics.topic-endpoints.unbound-and-enabled-with-messages

A topic has messages spooled and no consumers.

message-spool.message-vpn.vpn.topic-endpoints.unbound-and-enabled-with-messages

The number of topics on a Message VPN that are unbound with messages.

Derived REST Delivery Point Statistics

derived-metrics.rest-delivery-point.status

The REST Delivery Point (RDP) endpoint status is healthy.

Derived Server Certificate Statistics

service.ssl.server-certificate.days-to-expire.count

The number of days remaining before the event brokers SSL certificate expires.

SLI Metrics

In Datadog, a SLI metric is calculated as the number of good requests over the total number of valid requests.

SLI Metric

Description

SLI Availability

sli.availablity.guaranteed_active_health_check.failure

The guaranteed active status is not healthy.

sli.availablity.guaranteed_active_health_check.total

The guaranteed active status has been checked.

sli.availablity.guaranteed_active_health_check.success

The guaranteed active status is healthy.