Skip to content

Observability Components#

This page lists all the containers that are running with the Observability, with an explanation of its purpose as well as specific configurations for each container.

Info

There is only one Observability running in any given time that will cover any number of environments that are deployed for any Critical Manufacturing MES infrastructure.

graph TD
subgraph Observability Stack
    ClickHouse[ClickHouse]
    Grafana[Grafana]
    OtelCollector[Otel Collector]
    Traefik[Traefik]
    end
    ClickHouse ---> Grafana
    Traefik ---> Grafana
    Traefik ---> OtelCollector
    OtelCollector --> ClickHouse
    Grafana --> ClickHouse

classDef mermaid_title color:#000, fill:#fafafa, stroke:#fafafa, stroke-width:0x, font-size:100%, font-weight:200;
classDef mermaid_start color:#000, fill:#fafafa, stroke:#fafafa, color:#fafafa, stroke-width:0x, font-size:100%, visibility: hidden;
classDef mermaid_businessdata color:#000, fill:#65CDE8, stroke:#65CDE8, stroke-width:0px, font-size:100%;
classDef mermaid_nonbusinessdata color:#000, fill:#B7DEE8, stroke:#B7DEE8, stroke-width:0px, font-size:100%;
classDef mermaid_entity color:#000, fill:#FB9F53, stroke:#FB9F53, stroke-width:0px, font-size:100%;
classDef mermaid_entitylinked color:#000, fill:#FCD5B5, stroke:#FCD5B5, stroke-width:0px, font-size:100%;
classDef mermaid_context color:#000, fill:#B9CDE5, stroke:#B9CDE5, stroke-width:0px, font-size:100%;
classDef mermaid_optional color:#000, fill:#B7DEE8, stroke:#65CDE8, stroke-width:1px, font-size:100%, stroke-dasharray: 5 5;
classDef mermaid_state color:#000, fill:#d7e4bd, stroke:#000, stroke-width:1px, font-size:100%, font-weight:300;
class Grafana,OtelCollector,Traefik mermaid_entity
class Clickhouse mermaid_entitylinked

click ClickHouse "#clickhouse"
click Grafana "#grafana"
click OtelCollector "#otel-collector"
click Traefik "#traefik"

ClickHouse#

ClickHouse a fast and resource efficient open-source database for real-time apps and analytics. For more information, see https://clickhouse.com/ ⧉.

Info

The observability stack may use an external ClickHouse as an alternative to the integrated ClickHouse.

Grafana#

Grafana is used to visualize the data from various Data Sources. It allows for a convenient way to build dashboards and set up alarms to monitor the state of the diverse containers and applications. For more information, see https://grafana.com/ ⧉.

Otel Collector#

The Otel Collector serves as a mediator for the telemetry data through pipelines. Otel Collector ensures that all telemetry data flows through a centralized point, allowing for a more comfortable experience while adding new sources and destinations for the telemetry data. For more information, see https://opentelemetry.io/docs/collector/ ⧉.

The OTEL collector can use various exporters. Currently, the ClickHouse Exporter is being used, which allows data to be exported after it has been processed by the OTEL processor.

Traefik#

Manages routing including port assignment and redirection. It also balances and forwards network traffic between the stack and the outside world, as well as handling certificate validations to ensure secure connections. For more information, see https://doc.traefik.io/traefik/ ⧉.

Traefik is also responsible for redirecting the requests sent from different source that are supported by the single observability stack, depending on the URL that forms the request.