dbe0da057c
Three proposals addressing the 2026-02-25 trace pipeline OOM crash (114K CIDs): 1. trace-events-memory-triage: fetchmany iterator (read_sql_df_slow_iter), admission control (50K CID limit for non-MSD), cache skip for large queries, early memory release with gc.collect() 2. trace-async-job-queue: RQ-based async jobs for queries >20K CIDs, separate worker process with isolated memory, frontend polling via useTraceProgress composable, systemd service + deploy scripts 3. trace-streaming-response: chunked Redis storage (TRACE_STREAM_BATCH_SIZE=5000), NDJSON stream endpoint (GET /api/trace/job/<id>/stream), frontend ReadableStream consumer for progressive rendering, backward-compatible with legacy single-key storage All three proposals archived. 1101 tests pass, frontend builds clean. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
45 lines
1.5 KiB
Desktop File
45 lines
1.5 KiB
Desktop File
[Unit]
|
|
Description=MES Dashboard Gunicorn Service (Conda Runtime)
|
|
Documentation=https://github.com/your-org/mes-dashboard
|
|
After=network.target redis-server.service
|
|
Wants=redis-server.service
|
|
|
|
[Service]
|
|
Type=simple
|
|
User=www-data
|
|
Group=www-data
|
|
WorkingDirectory=/opt/mes-dashboard
|
|
EnvironmentFile=-/opt/mes-dashboard/.env
|
|
Environment="PYTHONPATH=/opt/mes-dashboard/src"
|
|
|
|
RuntimeDirectory=mes-dashboard
|
|
StateDirectory=mes-dashboard
|
|
PIDFile=/run/mes-dashboard/gunicorn.pid
|
|
|
|
ExecStart=/usr/bin/env bash -lc 'exec "${CONDA_BIN:-/opt/miniconda3/bin/conda}" run --no-capture-output -n "${CONDA_ENV_NAME:-mes-dashboard}" gunicorn --config gunicorn.conf.py --pid "${WATCHDOG_PID_FILE:-/run/mes-dashboard/gunicorn.pid}" --capture-output "mes_dashboard:create_app()"'
|
|
|
|
KillSignal=SIGTERM
|
|
TimeoutStopSec=30
|
|
Restart=always
|
|
RestartSec=5
|
|
|
|
StandardOutput=journal
|
|
StandardError=journal
|
|
SyslogIdentifier=mes-dashboard
|
|
|
|
# Memory protection (cgroup v2): prevents OOM from killing entire VM.
|
|
# MemoryHigh: soft limit — kernel starts reclaiming when exceeded (service stays alive).
|
|
# MemoryMax: hard limit — OOM kills only this service (host OS survives).
|
|
# Adjust based on VM RAM: MemoryHigh ≈ 70% of VM RAM, MemoryMax ≈ 85% of VM RAM.
|
|
# For 7GB VM: MemoryHigh=5G, MemoryMax=6G (leaves ~1GB for OS + Redis).
|
|
MemoryHigh=5G
|
|
MemoryMax=6G
|
|
|
|
NoNewPrivileges=yes
|
|
PrivateTmp=yes
|
|
ProtectSystem=strict
|
|
ReadWritePaths=/run/mes-dashboard /var/lib/mes-dashboard /opt/mes-dashboard/logs
|
|
|
|
[Install]
|
|
WantedBy=multi-user.target
|