LLM

Inference service

Model console

Private gateway
Private test console

What should we explore?

Messages pass through this app’s restricted server route to the shared inference service.