Exception Detector

Exception Detector

Overview

This filter plugin consumes a log stream of JSON objects which contain single-line log messages. If a consecutive sequence of log messages form an exception stack trace, they forwarded as a single, combined JSON object. Otherwise, the input log data is forwarded as is. More info at https://github.com/GoogleCloudPlatform/fluent-plugin-detect-exceptions

Note: As Tag management is not supported yet, this Plugin is mutually exclusive with Tag normaliser

Example output configurations

filters:
 - detectExceptions:
     languages: java, python
     multiline_flush_interval: 0.1

Configuration

DetectExceptions

message (string, optional)

The field which contains the raw message text in the input JSON data.

Default: ""

remove_tag_prefix (string, optional)

The prefix to be removed from the input tag when outputting a record.

Default: kubernetes

multiline_flush_interval (string, optional)

The interval of flushing the buffer for multiline format.

Default: nil

languages ([]string, optional)

Programming languages for which to detect exceptions.

Default: []

max_lines (int, optional)

Maximum number of lines to flush (0 means no limit)

Default: 1000

max_bytes (int, optional)

Maximum number of bytes to flush (0 means no limit)

Default: 0

stream (string, optional)

Separate log streams by this field in the input JSON data.

Default: ""

force_line_breaks (bool, optional)

Force line breaks between each lines when comibining exception stacks.

Default: false

match_tag (string, optional)

Tag used in match directive.

Default: kubernetes.**

Example Exception Detector filter configurations

apiVersion: logging.banzaicloud.io/v1beta1
kind: Flow
metadata:
  name: demo-flow
spec:
  filters:
    - detectExceptions:
        multiline_flush_interval: 0.1
        languages:
          - java
          - python
  selectors: {}
  localOutputRefs:
    - demo-output

Fluentd config result:

<match kubernetes.**>
  @type detect_exceptions
  @id test_detect_exceptions
  languages ["java","python"]
  multiline_flush_interval 0.1
  remove_tag_prefix kubernetes
</match>