Infra: Configure Comprehensive Prometheus and Grafana Monitoring Stack

[EDOHWARES]

Description

Set up unified platform performance monitoring using Prometheus metrics and Grafana dashboards.

Current Problem

There is no visual monitoring of job volumes, queue latencies, database connections, or API error rates, making operations blind to issues.

Proposed Solution

Expose a Prometheus metric endpoint in the backend and configure unified dashboards in Grafana.

Technical Tasks

• Integrate `prom-client` and export key system metrics (queue sizes, CPU usage, execution errors)
• Add docker-compose service configurations for Prometheus and Grafana
• Write pre-configured Grafana dashboards visualizing ingestion rates and latencies
• Set up alerts in Grafana routing to Discord/Slack on high error rates

Acceptance Criteria

• Prometheus scrapes metrics successfully from backend containers
• Grafana displays real-time charts of active queues, completed jobs, and failed actions
• Dashboards load automatically when spinning up docker-compose

Testing Requirements

• Generate heavy queue traffic and verify charts render load spikes correctly

Metadata

• Priority: Medium
• Difficulty: Medium