🎛️ LLM Router Admin Panel

🔑 BYOK Keys 🤖 Models 💬 Back to Chat

Model Configuration

Model Information

Select a model to view details

Generation Parameters

Controls randomness (0 = deterministic, 2 = very random)
Maximum response length in tokens
Nucleus sampling threshold
Limits vocabulary to top K tokens
Penalizes repeated tokens
Model context window size

Routing Strategy

Strategy determines how the router selects models for each request

Model Performance Metrics

Loading performance metrics...

Chat Templates

Template Format

Preview:


                        

Saved Templates

System Instructions

This prompt is prepended to every conversation

Preset Instructions

Behavior Settings

Advanced Parameters

Sampling Parameters

Performance Settings

Memory Management

System Monitoring

Model Status

Loading...

Memory Usage

0 MB

Requests Processed

0

Average Latency

0 ms

Performance History

System Logs

Logging Configuration

Analytics & Performance

Total Requests

Loading...

Success Rate

Loading...

Avg Response Time

Loading...

Cost This Month

Loading...

Model Usage Distribution

Chart will load when data is available

No usage data available yet

Error Analysis

Loading error analysis...

Usage & Billing

Provider Usage & Costs

Loading provider usage data...

Cost Optimization Recommendations

Analyzing usage patterns to generate recommendations...

Billing History

Period
Requests
Tokens
Cost
Status

Loading billing history...