Throttle
Throttle Filter
Overview
A sentry plugin to throttle logs. Logs are grouped by a configurable key. When a group exceeds a configuration rate, logs are dropped for this group.
Configuration
Throttle
group_key (string, optional)
Used to group logs. Groups are rate limited independently
Default: kubernetes.container_name
group_bucket_period_s (int, optional)
This is the period of of time over which group_bucket_limit applies
Default: 60
group_bucket_limit (int, optional)
Maximum number logs allowed per groups over the period of group_bucket_period_s
Default: 6000
group_drop_logs (bool, optional)
When a group reaches its limit, logs will be dropped from further processing if this value is true
Default: true
group_reset_rate_s (int, optional)
After a group has exceeded its bucket limit, logs are dropped until the rate per second falls below or equal to group_reset_rate_s.
Default: group_bucket_limit/group_bucket_period_s
group_warning_delay_s (int, optional)
When a group reaches its limit and as long as it is not reset, a warning message with the current log rate of the group is emitted repeatedly. This is the delay between every repetition.
Default: 10 seconds
Example Throttle
filter configurations
apiVersion: logging.banzaicloud.io/v1beta1
kind: Flow
metadata:
name: demo-flow
spec:
filters:
- throttle:
group_key: "$.kubernetes.container_name"
selectors: {}
localOutputRefs:
- demo-output
Fluentd Config Result
<filter **>
@type throttle
@id test_throttle
group_key $.kubernetes.container_name
</filter>