Network

What the grid is doing right now.

Traffic, latency and fleet capacity, straight from the gateway. Refreshes every 15 seconds.

{{ error ? 'gateway unreachable' : 'live · ' + lastUpdatedLabel }}
Tokens served
{{ fmtCompact(metrics.total_network_tokens) }}
+{{ fmtCompact(windowTokens) }} in {{ windowLabel }} {{ fmtCompact(metrics.prompt_tokens_total) }} in · {{ fmtCompact(metrics.completion_tokens_total) }} out
Requests
{{ fmtCompact(metrics.total_network_requests) }}
+{{ fmtCompact(windowRequests) }} in {{ windowLabel }} {{ fmtRate(metrics.requests_per_minute) }} per minute now
Nodes online
{{ fmtInt(metrics.online_providers) }}
{{ fmtInt(metrics.verified_providers) }} hardware-attested {{ metrics.degraded_providers }} degraded
Avg. time to first token
{{ fmtMs(latency.avg_ttft_ms ?? metrics.avg_network_ttft_ms) }}
on operator hardware {{ Number(latency.success_rate_percent).toFixed(1) }}% success
Routing overhead
{{ fmtMs(latency.avg_router_ms) }}
node selection only
Decode speed
{{ fmtDecode(latency.avg_decode_tps ?? metrics.avg_network_decode_tps) }}
tokens per second
Success rate
{{ fmtPct(latency.success_rate_percent ?? metrics.network_success_rate_percent) }}
completed requests
Utilization
{{ fmtInt(fleet.network_utilization_percent) }}%
peak {{ fmtInt(fleet.peak_utilization_percent) }}%{{ fleet.peak_model ? ' · ' + fleet.peak_model : '' }}
Models serving
{{ fmtInt(metrics.active_models) }}
right now
Fleet power
{{ fmtPower(fleet.estimated_power_kw) }}
estimated, under load
GPU compute units
{{ fmtInt(fleet.gpu_compute_units) }}
across accelerators
CPU cores
{{ fmtInt(fleet.cpu_cores) }}
logical
System memory
{{ fmtInt(fleet.unified_ram_gb) }} GB
fleet total
Tokens per request
{{ fmtInt(fleet.avg_tokens_per_request) }}
prompt + completion

Traffic

Requests

{{ fmtCompact(windowRequests) }} total · {{ fmtRate(avgRequests) }} avg per {{ unitLabel }} · {{ fmtCompact(peakRequests) }} peak

Tokens

{{ fmtCompact(windowTokens) }} tokens · {{ seriesLen }} buckets
input output
source: {{ apiBase }}/v1/network/metrics Console · Endpoint docs