跳至主要內容

GitHub Models 標誌GitHub Models

透過 Mastra 的模型路由器存取 55 個 GitHub Models 模型。系統會自動使用 GITHUB_TOKEN 環境變數完成身分驗證。

如需進一步了解，請參閱GitHub Models 文件。

.env
GITHUB_TOKEN=your-api-token
src/mastra/agents/my-agent.ts
import { Agent } from '@mastra/core/agent'

const agent = new Agent({
  id: 'my-agent',
  name: 'My Agent',
  instructions: 'You are a helpful assistant',
  model: 'github-models/ai21-labs/ai21-jamba-1.5-large',
})

// Generate a response
const response = await agent.generate('Hello!')

// Stream a response
const stream = await agent.stream('Tell me a story')
for await (const chunk of stream) {
  console.log(chunk)
}
資訊

Mastra 使用與 OpenAI 相容的 /chat/completions endpoint。部分 Provider 特有功能可能無法使用，詳情請參閱GitHub Models 文件。

模型
「模型」的直接連結

ModelContextToolsReasoningImageAudioVideoInput $/1MOutput $/1M
github-models/ai21-labs/ai21-jamba-1.5-large256K——
github-models/ai21-labs/ai21-jamba-1.5-mini256K——
github-models/cohere/cohere-command-a128K——
github-models/cohere/cohere-command-r128K——
github-models/cohere/cohere-command-r-08-2024128K——
github-models/cohere/cohere-command-r-plus128K——
github-models/cohere/cohere-command-r-plus-08-2024128K——
github-models/core42/jais-30b-chat8K——
github-models/deepseek/deepseek-r166K——
github-models/deepseek/deepseek-r1-052866K——
github-models/deepseek/deepseek-v3-0324128K——
github-models/meta/llama-3.2-11b-vision-instruct128K——
github-models/meta/llama-3.2-90b-vision-instruct128K——
github-models/meta/llama-3.3-70b-instruct128K——
github-models/meta/llama-4-maverick-17b-128e-instruct-fp8128K——
github-models/meta/llama-4-scout-17b-16e-instruct128K——
github-models/meta/meta-llama-3-70b-instruct8K——
github-models/meta/meta-llama-3-8b-instruct8K——
github-models/meta/meta-llama-3.1-405b-instruct128K——
github-models/meta/meta-llama-3.1-70b-instruct128K——
github-models/meta/meta-llama-3.1-8b-instruct128K——
github-models/microsoft/mai-ds-r166K——
github-models/microsoft/phi-3-medium-128k-instruct128K——
github-models/microsoft/phi-3-medium-4k-instruct4K——
github-models/microsoft/phi-3-mini-128k-instruct128K——
github-models/microsoft/phi-3-mini-4k-instruct4K——
github-models/microsoft/phi-3-small-128k-instruct128K——
github-models/microsoft/phi-3-small-8k-instruct8K——
github-models/microsoft/phi-3.5-mini-instruct128K——
github-models/microsoft/phi-3.5-moe-instruct128K——
github-models/microsoft/phi-3.5-vision-instruct128K——
github-models/microsoft/phi-416K——
github-models/microsoft/phi-4-mini-instruct128K——
github-models/microsoft/phi-4-mini-reasoning128K——
github-models/microsoft/phi-4-multimodal-instruct128K——
github-models/microsoft/phi-4-reasoning128K——
github-models/mistral-ai/codestral-250132K——
github-models/mistral-ai/ministral-3b128K——
github-models/mistral-ai/mistral-large-2411128K——
github-models/mistral-ai/mistral-medium-2505128K——
github-models/mistral-ai/mistral-nemo128K——
github-models/mistral-ai/mistral-small-2503128K——
github-models/openai/gpt-4.1128K——
github-models/openai/gpt-4.1-mini128K——
github-models/openai/gpt-4.1-nano128K——
github-models/openai/gpt-4o128K——
github-models/openai/gpt-4o-mini128K——
github-models/openai/o1200K——
github-models/openai/o1-mini128K——
github-models/openai/o1-preview128K——
github-models/openai/o3200K——
github-models/openai/o3-mini200K——
github-models/openai/o4-mini200K——
github-models/xai/grok-3128K——
github-models/xai/grok-3-mini128K——
55 available models

進階設定
「進階設定」的直接連結

自訂標頭
「自訂標頭」的直接連結

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: 'custom-agent',
  name: 'custom-agent',
  model: {
    url: 'https://models.github.ai/inference',
    id: 'github-models/ai21-labs/ai21-jamba-1.5-large',
    apiKey: process.env.GITHUB_TOKEN,
    headers: {
      'X-Custom-Header': 'value',
    },
  },
})

動態選擇模型
「動態選擇模型」的直接連結

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: 'dynamic-agent',
  name: 'Dynamic Agent',
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === 'complex'
    return useAdvanced
      ? 'github-models/xai/grok-3-mini'
      : 'github-models/ai21-labs/ai21-jamba-1.5-large'
  },
})
On this page