Fluentd

Fluentd remains a great tool for collecting logs, transforming them into any required format, and distributing them to various logging backends. However, in recent years, we have often transitioned to Grafana Loki and Promtail for several reasons.

We've also learned that extensive upfront log parsing carries a risk of losing logs and requires significant effort. This doesn't fit well with most projects.

Fluentd is a great tool to gather logs, transform them into any required format and distribute them to any logging backend.

At AOE we use fluentd in different contexts, but mostly to gather logs from kubernetes clusters into data backends like Elasticsearch.