Models API

Use the Privatemode model API to get a list of currently available models. The API is compatible with the OpenAI list models API. To list models, send your requests to the privatemode-proxy.

List models

You can get a list of all available models using the models endpoint.

GET /v1/models

This endpoint lists all currently available models.

Returns

The response is a list of model objects.

Example request

curl localhost:8080/v1/models

Example response

{
  "object": "list",
  "data": [
    {
      "id": "ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4",
      "object": "model",
      "tasks": [
        "generate",
        "tool_calling"
      ]
    },
    {
      "id": "leon-se/gemma-3-27b-it-fp8-dynamic",
      "object": "model",
      "tasks": [
        "generate",
        "vision"
      ]
    },
    {
      "id": "intfloat/multilingual-e5-large-instruct",
      "object": "model",
      "tasks": [
        "embed"
      ]
    }
  ]
}

Supported model tasks

Response field tasks provides a lists of all tasks a model supports:

• embed: Create vector representations (embeddings) of input text.
• generate: Generate text completions or chat responses from prompts.
• tool_calling: Invoke function calls or tools (such as retrieval-augmented generation or plugins).

Note that tasks isn't part of the OpenAI API spec.