Llama-4-Scout-17B-16E — Free AI Model & API

github-models/llama-4-scout-17b-16e
chat
Context Window 512K
Max Output 4K
Rate Limit 15 RPM, 150 RPD
Cost $0.00 FREE
Free Period Since May 10, 2026
Credit Card Not required
Status Online

Overview

Llama 4 Scout 17B is Meta's efficient long-context model with 16 active experts (MoE), available free on GitHub Models. With a 512K context window — far beyond most free models — it can process entire novels, full code repositories, or multi-hour transcripts in a single request. The 17B total parameter footprint keeps inference fast and cost-effective, making it practical for retrieval-free document analysis and long-form summarization. Rate limits are 15 RPM and 150 requests per day with per-request output capped at 4K tokens. Fully OpenAI SDK-compatible and requires only a GitHub account.

Model ID
llama-4-scout-17b-16e
Base URL
https://models.inference.ai.azure.com
Specifications
Context: 512K · Output: 4K · Modality: text · OpenAI Compat: Yes

Quick Start

Integrate Llama-4-Scout-17B-16E with 3 lines of code. See the config generator for Claude Code, Cursor, and more.

from openai import OpenAI

client = OpenAI(
 base_url="https://models.inference.ai.azure.com",
 api_key="YOUR_API_KEY"
)

response = client.chat.completions.create(
 model="llama-4-scout-17b-16e",
 messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)
import OpenAI from "openai";

const openai = new OpenAI({
 baseURL: "https://models.inference.ai.azure.com",
 apiKey: "YOUR_API_KEY",
});

const completion = await openai.chat.completions.create({
 model: "llama-4-scout-17b-16e",
 messages: [{ role: "user", content: "Hello!" }],
});

console.log(completion.choices[0].message.content);
curl https://models.inference.ai.azure.com/chat/completions \
 -H "Content-Type: application/json" \
 -H "Authorization: Bearer YOUR_API_KEY" \
 -d '{
 "model": "llama-4-scout-17b-16e",
 "messages": [{"role": "user", "content": "Hello!"}]
 }'

Other Free Models from GitHub Models

Rate Limits & Constraints

Rate Limit 15 RPM, 150 RPD
Context Window 512K
Max Output Tokens 4K
Cost Free — since May 10, 2026
Credit Card Not required
OpenAI Compatible Yes — drop-in replacement

GitHub Models Platform Limitations

  • Low per-request token limits (8K input / 4K output)
  • Rate limits tied to GitHub Copilot subscription tier
  • Not suitable for large-context or long-generation tasks

Features & Use Cases

Best For

Chat

Modality Support

text

GitHub Models Highlights

  • 45+ models including GPT-4.1 and o3
  • Free for all GitHub accounts
  • Includes Llama 4, DeepSeek-R1, Mistral
  • Base URL: models.inference.ai.azure.com

Playground — Test Llama-4-Scout-17B-16E

Test Llama-4-Scout-17B-16E directly in your browser. Your API key is sent directly to GitHub Models — never stored.

Model: Llama-4-Scout-17B-16E Get Key

🔒 Your key is never stored — sent directly to the model provider via our server proxy.

Ready to chat with Llama-4-Scout-17B-16E.

Frequently Asked Questions

How do I get an API key for Llama-4-Scout-17B-16E?

Sign up at GitHub Models to get your API key. No credit card is required — just an email sign-up. Once you have the key, use the code snippets in the Quick Start section above.

Is Llama-4-Scout-17B-16E really free?

Yes. Llama-4-Scout-17B-16E is available on GitHub Models's free tier and has been free since May 10, 2026. Rate limits apply: 15 RPM, 150 RPD. Always check the provider's terms for any changes to the free tier.

What are Llama-4-Scout-17B-16E's rate limits?

15 RPM, 150 RPD Context window: 512K. Max output: 4K. No credit card required.

What are the best free alternatives to Llama-4-Scout-17B-16E?

Popular free alternatives include inclusionAI: Ring-2.6-1T, Baidu Qianfan: CoBuddy (free), Owl Alpha. You can also browse all 147+ free models on our site.

More questions? See our full FAQ →

Similar Free Models