Chat Completion

​

Overview

​

Web Search

• :online - Standard web search ($0.006 per request)
  • Returns 10 search results
  • Perfect for straightforward questions
• :online/linkup-deep - Deep web search ($0.06 per request)
  • Iteratively searches for comprehensive information
  • Ideal when initial results aren’t sufficient

​

Examples

import requests
import json

BASE_URL = "https://nano-gpt.com/api/v1"
API_KEY = "YOUR_API_KEY"

headers = {
    "Authorization": f"Bearer {API_KEY}",
    "Content-Type": "application/json"
}

# Standard web search
data = {
    "model": "chatgpt-4o-latest:online",
    "messages": [
        {"role": "user", "content": "What are the latest developments in AI?"}
    ]
}

response = requests.post(
    f"{BASE_URL}/chat/completions",
    headers=headers,
    json=data
)

# Deep web search
data_deep = {
    "model": "chatgpt-4o-latest:online/linkup-deep",
    "messages": [
        {"role": "user", "content": "Provide a comprehensive analysis of recent AI breakthroughs"}
    ]
}

​

Context Memory

• Append :memory to any model name
• Or send header memory: true
• Can be combined with web search: :online:memory
• Retention: default 30 days; configure via :memory-<days> (1..365) or header memory_expiration_days: <days>; header takes precedence

import requests

BASE_URL = "https://nano-gpt.com/api/v1"
API_KEY = "YOUR_API_KEY"

headers = {
    "Authorization": f"Bearer {API_KEY}",
    "Content-Type": "application/json"
}

# Suffix-based
payload = {
    "model": "chatgpt-4o-latest:memory",
    "messages": [{"role": "user", "content": "Keep our previous discussion in mind and continue."}]
}
requests.post(f"{BASE_URL}/chat/completions", headers=headers, json=payload)

​

Custom Context Size Override

• Parameter: model_context_limit (number or numeric string)
• Default: Derived from the selected model’s context size
• Minimum: Values below 10,000 are clamped internally
• Scope: Only affects memory compression; does not change the target model’s own window

# Enable memory via header; use model default context size
curl -s -X POST \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -H "memory: true" \
  https://nano-gpt.com/api/v1/chat/completions \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [{"role":"user","content":"Briefly say hello."}],
    "stream": false
  }'

# Explicit numeric override
curl -s -X POST \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -H "memory: true" \
  https://nano-gpt.com/api/v1/chat/completions \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [{"role":"user","content":"Briefly say hello."}],
    "model_context_limit": 20000,
    "stream": false
  }'

# String override (server coerces to number)
curl -s -X POST \
  -H "Authorization: Bearer $NANOGPT_API_KEY" \
  -H "Content-Type: application/json" \
  -H "memory: true" \
  https://nano-gpt.com/api/v1/chat/completions \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [{"role":"user","content":"Briefly say hello."}],
    "model_context_limit": "30000",
    "stream": false
  }'

​

Reasoning Parameter

{
  "reasoning": {
    "exclude": true
  }
}

​

Example

curl -X POST https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-3-5-sonnet-20241022",
    "messages": [{"role": "user", "content": "What is 2+2?"}],
    "reasoning": {"exclude": true}
  }'

​

Model suffix: :reasoning-exclude

• Behaves exactly like sending { "reasoning": { "exclude": true } }
• Only :reasoning-exclude is stripped before provider routing; all other suffixes remain active
• Works for both streaming and non-streaming responses
• Available on both Chat Completions and Text Completions

{
  "model": "claude-3-5-sonnet-20241022:reasoning-exclude",
  "messages": [{ "role": "user", "content": "What is 2+2?" }]
}

curl -X POST https://nano-gpt.com/api/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-3-5-sonnet-20241022:reasoning-exclude",
    "messages": [{"role": "user", "content": "What is 2+2?"}],
    "stream": false
  }'

​

Combine with other suffixes

• :thinking (and variants like …-thinking:8192)
• :online and :online/linkup-deep
• :memory and :memory-<days>

• claude-3-7-sonnet-thinking:8192:reasoning-exclude
• gpt-4o:online:reasoning-exclude
• claude-3-5-sonnet-20241022:memory-30:online/linkup-deep:reasoning-exclude

​

Notes and limitations

• GPU-TEE models (phala/*) require byte-for-byte SSE passthrough for signature verification. For those models, streaming cannot be filtered; the suffix has no effect on the streaming bytes.
• When assistant content is an array (e.g., vision/text parts), only text parts are filtered; images and tool/metadata content are untouched.

​

Performance Benchmarks

​

Important Notes

• Web search increases input token count, which affects total cost
• Models gain access to real-time information published less than a minute ago
• Internet connectivity can provide up to 10x improvement in factuality
• All models support web search - simply append the suffix to any model name