Конечные точки REST API для вывода моделей
Используйте REST API для отправки запроса на завершение чата в указанную модель с указанием организации или без нее.
Сведения о выводе GitHub Models
Rest API можно использовать для выполнения запросов вывода с помощью платформы GitHub Models .
API поддерживает следующее:
- Доступ к лучшим моделям из OpenAI, DeepSeek, Microsoft, Llama и т. д.
- Выполнение запросов вывода на основе чата с полным контролем над параметрами выборки и ответа.
- Выполнение потоковой передачи или непотоковых завершений.
- Отслеживание атрибуции и использования организации.
Run an inference request attributed to an organization
This endpoint allows you to run an inference request attributed to a specific organization. You must be a member of the organization and have enabled models to use this endpoint.
The token used to authenticate must have the models: read permission if using a fine-grained PAT or GitHub App minted token.
The request body should contain the model ID and the messages for the chat completion request. The response will include either a non-streaming or streaming response based on the request parameters.
Параметры для "Run an inference request attributed to an organization"
| Имя., Тип, Description |
|---|
content-type string Обязательное полеSetting to |
accept string Setting to |
| Имя., Тип, Description |
|---|
org string Обязательное полеThe organization login associated with the organization to which the request is to be attributed. |
| Имя., Тип, Description |
|---|
api-version string The API version to use. Optional, but required for some features. |
| Имя., Тип, Description | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
model string Обязательное полеID of the specific model to use for the request. The model ID should be in the format of {publisher}/{model_name} where "openai/gpt-4.1" is an example of a model ID. You can find supported models in the catalog/models endpoint. | ||||||||||
messages array of objects Обязательное полеThe collection of context messages associated with this chat completion request. Typical usage begins with a chat message for the System role that provides instructions for the behavior of the assistant, followed by alternating messages between the User and Assistant roles. | ||||||||||
Properties of |
| Имя., Тип, Description |
|---|
role string Обязательное полеThe chat role associated with this message Возможные значения: |
content string Обязательное полеThe content of the message |
frequency_penalty number A value that influences the probability of generated tokens appearing based on their cumulative frequency in generated text. Positive values will make tokens less likely to appear as their frequency increases and decrease the likelihood of the model repeating the same statements verbatim. Supported range is [-2, 2].
max_tokens integer The maximum number of tokens to generate in the completion. The token count of your prompt plus max_tokens cannot exceed the model's context length. For example, if your prompt is 100 tokens and you set max_tokens to 50, the API will return a completion with a maximum of 50 tokens.
modalities array of strings The modalities that the model is allowed to use for the chat completions response. The default modality is text. Indicating an unsupported modality combination results in a 422 error.
Supported values are: text, audio
presence_penalty number A value that influences the probability of generated tokens appearing based on their existing presence in generated text. Positive values will make tokens less likely to appear when they already exist and increase the model's likelihood to output new tokens. Supported range is [-2, 2].
response_format object The desired format for the response.
Can be one of these objects:
| Имя., Тип, Description | |||
|---|---|---|---|
Object object | |||
Properties of |
| Имя., Тип, Description |
|---|
type string Возможные значения: |
Schema for structured JSON response object Обязательное полеProperties of Schema for structured JSON response
| Имя., Тип, Description |
|---|
type string Обязательное полеThe type of the response. значение: |
json_schema object Обязательное полеThe JSON schema for the response. |
seed integer If specified, the system will make a best effort to sample deterministically such that repeated requests with the same seed and parameters should return the same result. Determinism is not guaranteed.
stream boolean A value indicating whether chat completions should be streamed for this request.
По умолчанию.: false
stream_options object Whether to include usage information in the response. Requires stream to be set to true.
Properties of stream_options
| Имя., Тип, Description |
|---|
include_usage boolean Whether to include usage information in the response. По умолчанию.: |
stop array of strings A collection of textual sequences that will end completion generation.
temperature number The sampling temperature to use that controls the apparent creativity of generated completions. Higher values will make output more random while lower values will make results more focused and deterministic. It is not recommended to modify temperature and top_p for the same completion request as the interaction of these two settings is difficult to predict. Supported range is [0, 1]. Decimal values are supported.
tool_choice string If specified, the model will configure which of the provided tools it can use for the chat completions response.
Возможные значения: auto, required, none
tools array of objects A list of tools the model may request to call. Currently, only functions are supported as a tool. The model may respond with a function call request and provide the input arguments in JSON format for that function.
Properties of tools
| Имя., Тип, Description | ||||
|---|---|---|---|---|
function object | ||||
Properties of |
| Имя., Тип, Description |
|---|
name string The name of the function to be called. |
description string A description of what the function does. The model will use this description when selecting the function and interpreting its parameters. |
parameters The parameters the function accepts, described as a JSON Schema object. |
type string значение: function
top_p number An alternative to sampling with temperature called nucleus sampling. This value causes the model to consider the results of tokens with the provided probability mass. As an example, a value of 0.15 will cause only the tokens comprising the top 15% of probability mass to be considered. It is not recommended to modify temperature and top_p for the same request as the interaction of these two settings is difficult to predict. Supported range is [0, 1]. Decimal values are supported.
Коды состояния http-ответа для "Run an inference request attributed to an organization"
| Код состояния | Описание |
|---|---|
200 | OK |
Примеры кода для "Run an inference request attributed to an organization"
Пример запроса
curl -L \
-X POST \
-H "Accept: application/vnd.github+json" \
-H "Authorization: Bearer <YOUR-TOKEN>" \
-H "X-GitHub-Api-Version: 2022-11-28" \
-H "Content-Type: application/json" \
https://models.github.ai/orgs/ORG/inference/chat/completions \
-d '{"model":"openai/gpt-4.1","messages":[{"role":"user","content":"What is the capital of France?"}]}'Response
Status: 200{
"choices": [
{
"message": {
"content": "The capital of France is Paris.",
"role": "assistant"
}
}
]
}Run an inference request
This endpoint allows you to run an inference request. The token used to authenticate must have the models: read permission if using a fine-grained PAT or GitHub App minted token.
The request body should contain the model ID and
the messages for the chat completion request. The response will include either a non-streaming or streaming response based on the request parameters.
Параметры для "Run an inference request"
| Имя., Тип, Description |
|---|
content-type string Обязательное полеSetting to |
accept string Setting to |
| Имя., Тип, Description |
|---|
api-version string The API version to use. Optional, but required for some features. |
| Имя., Тип, Description | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
model string Обязательное полеID of the specific model to use for the request. The model ID should be in the format of {publisher}/{model_name} where "openai/gpt-4.1" is an example of a model ID. You can find supported models in the catalog/models endpoint. | ||||||||||
messages array of objects Обязательное полеThe collection of context messages associated with this chat completion request. Typical usage begins with a chat message for the System role that provides instructions for the behavior of the assistant, followed by alternating messages between the User and Assistant roles. | ||||||||||
Properties of |
| Имя., Тип, Description |
|---|
role string Обязательное полеThe chat role associated with this message Возможные значения: |
content string Обязательное полеThe content of the message |
frequency_penalty number A value that influences the probability of generated tokens appearing based on their cumulative frequency in generated text. Positive values will make tokens less likely to appear as their frequency increases and decrease the likelihood of the model repeating the same statements verbatim. Supported range is [-2, 2].
max_tokens integer The maximum number of tokens to generate in the completion. The token count of your prompt plus max_tokens cannot exceed the model's context length. For example, if your prompt is 100 tokens and you set max_tokens to 50, the API will return a completion with a maximum of 50 tokens.
modalities array of strings The modalities that the model is allowed to use for the chat completions response. The default modality is text. Indicating an unsupported modality combination results in a 422 error.
Supported values are: text, audio
presence_penalty number A value that influences the probability of generated tokens appearing based on their existing presence in generated text. Positive values will make tokens less likely to appear when they already exist and increase the model's likelihood to output new tokens. Supported range is [-2, 2].
response_format object The desired format for the response.
Can be one of these objects:
| Имя., Тип, Description | |||
|---|---|---|---|
Object object | |||
Properties of |
| Имя., Тип, Description |
|---|
type string Возможные значения: |
Schema for structured JSON response object Обязательное полеProperties of Schema for structured JSON response
| Имя., Тип, Description |
|---|
type string Обязательное полеThe type of the response. значение: |
json_schema object Обязательное полеThe JSON schema for the response. |
seed integer If specified, the system will make a best effort to sample deterministically such that repeated requests with the same seed and parameters should return the same result. Determinism is not guaranteed.
stream boolean A value indicating whether chat completions should be streamed for this request.
По умолчанию.: false
stream_options object Whether to include usage information in the response. Requires stream to be set to true.
Properties of stream_options
| Имя., Тип, Description |
|---|
include_usage boolean Whether to include usage information in the response. По умолчанию.: |
stop array of strings A collection of textual sequences that will end completion generation.
temperature number The sampling temperature to use that controls the apparent creativity of generated completions. Higher values will make output more random while lower values will make results more focused and deterministic. It is not recommended to modify temperature and top_p for the same completion request as the interaction of these two settings is difficult to predict. Supported range is [0, 1]. Decimal values are supported.
tool_choice string If specified, the model will configure which of the provided tools it can use for the chat completions response.
Возможные значения: auto, required, none
tools array of objects A list of tools the model may request to call. Currently, only functions are supported as a tool. The model may respond with a function call request and provide the input arguments in JSON format for that function.
Properties of tools
| Имя., Тип, Description | ||||
|---|---|---|---|---|
function object | ||||
Properties of |
| Имя., Тип, Description |
|---|
name string The name of the function to be called. |
description string A description of what the function does. The model will use this description when selecting the function and interpreting its parameters. |
parameters The parameters the function accepts, described as a JSON Schema object. |
type string значение: function
top_p number An alternative to sampling with temperature called nucleus sampling. This value causes the model to consider the results of tokens with the provided probability mass. As an example, a value of 0.15 will cause only the tokens comprising the top 15% of probability mass to be considered. It is not recommended to modify temperature and top_p for the same request as the interaction of these two settings is difficult to predict. Supported range is [0, 1]. Decimal values are supported.
Коды состояния http-ответа для "Run an inference request"
| Код состояния | Описание |
|---|---|
200 | OK |
Примеры кода для "Run an inference request"
Пример запроса
curl -L \
-X POST \
-H "Accept: application/vnd.github+json" \
-H "Authorization: Bearer <YOUR-TOKEN>" \
-H "X-GitHub-Api-Version: 2022-11-28" \
-H "Content-Type: application/json" \
https://models.github.ai/inference/chat/completions \
-d '{"model":"openai/gpt-4.1","messages":[{"role":"user","content":"What is the capital of France?"}]}'Response
Status: 200{
"choices": [
{
"message": {
"content": "The capital of France is Paris.",
"role": "assistant"
}
}
]
}