Practical guides for the most important Llamatik workflows.

v2.0 SDK guides#

  • SDK Overview — module structure, Chat, Models, RAG, Assistant facade
  • Agent Framework — Agent { } DSL, memory, streaming, tools, workflows
  • Agent Platform — AgentRuntime, permissions, profiles, audit, built-in tools

Core (:core) guides#

  • Text generation
  • Embeddings
  • Streaming
  • Generation parameters
  • Schema-constrained JSON
  • KV cache and sessions
  • Concurrent sessions
  • Stable Diffusion image generation
  • Whisper speech-to-text
  • Multimodal vision (VLM)
  • Multi-Token Prediction (MTP)
  • Building from source (GPU backends)