dockhost/logger repository overview

Real-time container log collector and exporter for Dockhost platform.

Quick Start:

docker run -e DOCKHOST_TOKEN=your_token dockhost/logger:latest

⁠Dockhost Logger Service

Collects and exports container logs from the Dockhost platform in real-time.

⁠Overview

Dockhost Logger Service automatically discovers projects and containers on the Dockhost platform, collects their logs in real-time, and exports them through a flexible pipeline architecture. The service processes logs through configurable sources, transforms, and multiple output backends simultaneously.

⁠Features

• Automatic Discovery: Detects new projects and containers automatically
• Real-time Collection: Collects logs in real-time with deduplication
• Pipeline Architecture: Route logs through sources → transforms → backends
• Transform Types: Filter, remap, parse JSON/regex/nginx, extract levels, templates, conditional logic, and JavaScript scripting with sandbox isolation
• Multiple Backends: Export to various destinations with buffering and automatic reconnection
• Flexible Routing: Route different log streams to different backends based on project/container filters
• Graceful Shutdown: Properly closes connections and flushes buffers on termination
• Configurable: YAML-based configuration with environment variable overrides

⁠Supported Backends

⁠Quick Start

Run with minimal configuration:

docker run -e DOCKHOST_TOKEN=your_token dockhost/logger:latest

⁠Environment Variables

⁠Configuration

Mount a custom configuration file to enable backends:

docker run \
  -e DOCKHOST_TOKEN=your_token \
  -v ./config.yaml:/app/config.yaml \
  dockhost/logger:latest

Example config.yaml:

# Define log sources
sources:
    all-logs:
    auth-only:
        projects:
            - name: my-project
              containers:
                  - regex: ".*-auth"

# Transform logs
transforms:
    filter-errors:
        type: filter
        action: keep
        condition: '.level == "error"'

# Configure backends
backends:
    console-all:
        type: console
        enabled: true
        sources: [all-logs]
        config:
            format: text

    opensearch-all:
        type: opensearch
        enabled: true
        sources: [all-logs]
        config:
            host: http://localhost:9200
            index: dockhost-logs
            indexStrategy: daily

⁠Usage Examples

Quick Start:

docker run -e DOCKHOST_TOKEN=your_token dockhost/logger:latest

With custom configuration:

docker run \
  -e DOCKHOST_TOKEN=your_token \
  -v ./config.yaml:/app/config.yaml \
  dockhost/logger:latest