Additional Components#
This section describes the requirements for additional required components that must be running for a successful installation and operation of Critical Manufacturing MES. These requirements will vary depending on the usage of each component.
Kafka#
In regards to Kafka, the system requirements might change depending on several key factors such as:
- message volume (count and size)
- throughput
- number of partitions
- replication factor
- data retention policies
Proper benchmarking and monitoring of Kafka is essential for fine-tuning resource allocation.
Minimum System Requirements#
| Item | Requirement |
|---|---|
| Version | 3.8.1 |
| Brokers | 3 |
| Memory | 8GB per broker |
| CPU | 2vCPUs per broker |
| Disk space | 1TB per broker |
Table: Minimum system requirements for Kafka
Recommended System Requirements#
| Item | Requirement |
|---|---|
| Version | 3.8.1 |
| Brokers | 3 |
| Memory | 16GB per broker |
| CPU | 4vCPUs per broker |
| Disk space | 3TB per broker |
Table: Recommended system requirements for Kafka
ACLs#
To simplify the setup of ACLs by system administrators, Kafka topics created by MES adhere to a standardized naming convention. For example, if the system name is "MESIntegrationEnvironment", all kafka topics will be created with the prefix of the system name in lower case. So, in this case, all kafka topics will have the prefix of "mesintegrationenvironment" or "_mesintegrationenvironment".
The user used by the system must have at least the following permissions:
-
Topic Permissions
- Alter
- AlterConfigs
- Create
- Delete
- Describe
- DescribeConfigs
- Read
- Write
-
Consumer Group Permissions
- Read
- Delete
- Describe
-
Cluster Permissions
- Create
- Describe
- DescribeConfigs
ClickHouse#
Minimum System Requirements#
| Item | Requirement |
|---|---|
| Version | 24.3 or 24.8 |
| Memory | 16GB |
| CPU | 4vCPUs |
| Disk space | 1TB |
Table: Minimum system requirements for ClickHouse
Recommended System Requirements#
| Item | Requirement |
|---|---|
| Version | 24.3 or 24.8 |
| Memory | 32GB |
| CPU | 8vCPUs |
| Disk space | 3TB |
Table: Recommended system requirements for ClickHouse
Mandatory Settings for ClickHouse Cloud Upgrades
When upgrading from MES versions earlier than 11.0.0 to 11.0.0 or later, and migrating from an in-stack ClickHouse deployment to an external ClickHouse Cloud setup, allow_materialized_view_with_bad_select setting must be configured before starting the upgrade. For more information, see ClickHouse Migration ⧉.
ACLs#
The user used by the system must have at least the following permissions:
- Privileges
- SELECT: Read data from tables
- INSERT: Write data into tables
- ALTER: Modify table schema
- DROP: Delete databases (during setup) or tables
- SHOW: View metadata
- CREATE: Create databases (during setup) or tables
RabbitMQ#
Minimum System Requirements#
| Item | Requirement |
|---|---|
| Version | 3.13.1 or above |
| Brokers | 1 |
| Memory | 1GB per broker |
| CPU | 2vCPUs per broker |
Table: Minimum system requirements for RabbitMQ
Recommended System Requirements#
| Item | Requirement |
|---|---|
| Version | 3.13.1 or above |
| Brokers | 2 |
| Memory | 2GB per broker |
| CPU | 4vCPUs per broker |
Table: Recommended system requirements for RabbitMQ
AWS S3 (or compatible)#
Minimum System Requirements#
| Item | Requirement |
|---|---|
| Version | -- |
| Memory | 4GB |
| CPU | 2vCPUs |
Table: Minimum system requirements for AWS S3 (or compatible)
Recommended System Requirements#
| Item | Requirement |
|---|---|
| Version | -- |
| Memory | 16GB |
| CPU | 4vCPUs |
Table: Recommended system requirements for AWS S3 (or compatible)
ClickHouse (Observability)#
Minimum System Requirements#
| Item | Requirement |
|---|---|
| Version | 24.9.2.42 |
| Memory | 16GB |
| CPU | 4vCPUs |
| Disk space | 100GB (per environment, for 7 days TTL) |
Table: Minimum system requirements for ClickHouse (Observability)
Recommended System Requirements#
| Item | Requirement |
|---|---|
| Version | 24.9.2.42 |
| Memory | 32GB |
| CPU | 8vCPUs |
| Disk space | 100GB (per environment, for 7 days TTL) |
Table: Minimum system requirements for ClickHouse (Observability)