Push logs to openobserve.ai

Help
1

1. The problem I’m having:

I have an open observe container that i currently send logs for my home lab to. It seems like caddy could support this which is why i am struggling… surely this has been done before?. Has anyone done this? and if not would people want a module to do this?

2

Definitely sounds like something someone could write a plugin for. I’m wondering, could Caddy’s net log writer be suitable?

Usually I imagine you’d expect a log collecting agent to be installed to grab log files and push to your log aggregator.

2 Likes
3

I also wonder if @Whitestrake 's suggestion would work to stream logs in real time over HTTP - would be very cool if OpenObserve has a way to ingest them.

OpenObserve seems to support standard protocols like…

Prometheus Metrics (Caddy supports metric scraping - Monitoring Caddy with Prometheus metrics — Caddy Documentation)
OpenTelemetry Tracing (Caddy supports tracing - tracing (Caddyfile directive) — Caddy Documentation)
Alternatively, you can configure Caddy to write access logs to a file.

In short, I think you have a few options:

  1. Set up Prometheus and scape metrics from your Caddy server, then forward them to OpenObserve.
  2. Enable Tracing in Caddy and send traces to your OpenObserve instance.
  3. Run any kind of log-tailing agent (e.g. Promtail) and configure it to forward logs to OpenObserve.

There might be other collectors/agents/tools to make this easier.

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.