Skip to content

Siraya AI Documentation

Prompt caching

Initializing search

Document
SDKs & APIs
LLM Inference Handbook

Siraya AI Documentation

Document
Document
- Overview
  Overview
  - FAQ
  - Platform Overview
  - Pricing and Fee Structure
  - Quickstart
    Quickstart
    
    Audio
    
    Batch
    
    Embedding
    
    Image
    
    Search
    
    Text
    
    Video
- API Reference
  API Reference
  - Authentication
  - Embeddings API
  - Errors Code
  - Rerank API
  - Usage Accounting
  - Anthropic Claude API
    
    Anthropic Claude API
    
    Messages API
  - Batch Processing API
    
    Batch Processing API
    
    Cancel a Batch
    
    Create New Batch
    
    Get Status of a Batch
  - Billing API
    
    Billing API
    
    Balance Info
  - Extract Engine API
    
    Extract Engine API
    
    Tavily Extract API
  - Generative Model API
    
    Generative Model API
    
    Image To Image
    
    Image To Image
    
    Dreamomni2
    
    Gpt Image 1 Mini
    
    Nano Banana 2
    
    Nano Banana Pro
    
    Nano Banana
    
    Reve Edit
    
    Reve Remix
    
    Seedream V4
    
    Wan 25 Preview
    
    Image To Video
    
    Image To Video
    
    Sora 2 Pro
    
    Sora 2
    
    Speech To Text
    
    Speech To Text
    
    Gpt 4o Mini Transcribe
    
    Gpt 4o Transcribe
    
    Whisper 1
    
    Text To Image
    
    Text To Image
    
    Flux 1 SRPO
    
    Flux Dev
    
    Flux Pro
    
    Flux Srpo
    
    Gpt Image 1
    
    Hunyuan Image V3
    
    Imagen 3 001
    
    Imagen 3 002
    
    Imagen 3 Fast
    
    Imagen 4 Fast
    
    Imagen 4 Ultra
    
    Imagen 4
    
    Nano Banana 2
    
    Nano Banana Pro
    
    Nano Banana
    
    Qwen Image
    
    Seedream V4
    
    Stable Diffusion V35
    
    Wan 25 Preview
    
    Text To Speech
    
    Text To Speech
    
    Gpt 4o Mini Tts
    
    Tts 1 Hd
    
    Tts 1
    
    Text To Video
    
    Text To Video
    
    Kandinsky5 Distill
    
    Kandinsky5
    
    Kling Video V2.5
    
    Kling Video V2
    
    Minimax Hailuo 02
    
    Ovi
    
    Pixverse V5
    
    Sora 2 Pro
    
    Sora 2
    
    Veo3 Fast
    
    Veo3.1 Fast
    
    Veo3.1
    
    Veo3
    
    Wan 25 Preview
    
    Video To Video
    
    Video To Video
    
    Sora 2
  - Llm Model API
    Llm Model API
    
    Overview
    
    Parameters
    
    Streaming
  - Models API
    
    Models API
    
    List All Models
  - Openai Responses API
    
    Openai Responses API
    
    Basic Usage
    
    Error Handling
    
    Reasoning
    
    Tool Calling
  - Search Engine API
    
    Search Engine API
    
    Cloudsway Smart Search API
    
    Exa Search API
    
    Firecrawl Search API
    
    Jina DeepSearch API
    
    Perplexity Search API
    
    Tavily Search API
  - Universal API
    
    Universal API
    
    Universal Audio API
    
    Universal Image API
    
    Universal Video API
- Features
  Features
- Frameworks & Integrations
  Frameworks & Integrations
- Routing & Gateway
  Routing & Gateway
- Observability
  Observability
- Best Practice
  Best Practice
  - Performance Stress Testing in Siraya AI AI
  - Test Token Cache Rate in Siraya AI AI
- Support
  Support
SDKs & APIs
SDKs & APIs
- Anthropic Compatible API
  Anthropic Compatible API
- OpenAI Compatible API
  OpenAI Compatible API
  - Chat Completions
  - Embeddings
  - Prompt caching Prompt caching
    Table of contents
    
    Manual caching
  - Reasoning configuration
  - Structured Outputs
  - Tool Calling
  - Web Search
- OpenResponses API
  OpenResponses API
LLM Inference Handbook
LLM Inference Handbook
- Inference Optimization
  Inference Optimization
- Infrastructure And Operations
  Infrastructure And Operations
- Llm Inference Advanced
  Llm Inference Advanced
- Llm Inference Basics
  Llm Inference Basics

Table of contents

Manual caching

SDKs & APIs
OpenAI Compatible API

Prompt caching

Manual caching

For fine-grained control, you can manually mark content with cache_control:

Made with Material for MkDocs