Tap and Target Metrics

Metrics logging is specified in the Singer Spec.

The SDK will automatically emit the following metrics:

  • record_count: The number of records processed by the tap or target.

  • http_request_duration: The duration of HTTP requests made by the tap.

  • sync_duration: The duration of the sync operation.

  • batch_processing_time: The duration of processing a batch of records.

Customization options

metrics_log_level

Metrics are logged at the INFO level. Developers may optionally add a metrics_log_level config option to their taps, WARNING or ERROR to disable metrics logging.

SINGER_SDK_LOG_CONFIG

Metrics are written by the singer_sdk.metrics logger, so the end user can set SINGER_SDK_LOG_CONFIG to a logging config file that defines the format and output for metrics. See the logging docs for an example file.

Additional Singer Metrics References