AI Assistant

How can I help you today?

Start a conversation or upload files to get started

API Base URL Base URL for the API server

User ID Unique identifier for your account

Session ID Current session identifier

Memory Type How conversation history is stored

Summary Threshold Messages before summarization

Max History Tokens Token limit for history

Top K Number of retrieval results

Max Hop Graph traversal depth

Max Paths Per Pair Maximum paths between entities

Top N Paths Top ranked paths to return

History Strategy How to manage conversation history

Max History Tokens Token limit for chatbot history

Max Recent Turns Recent conversation turns to keep

Enable Cache

Include History

Temperature Response randomness (0=deterministic, 2=creative)

Top P Nucleus sampling threshold

Top K (LLM) Top-K sampling parameter

Repeat Penalty Penalty for repeating tokens

Num Predict Max tokens to predict

Context Size Model context window

Batch Size Processing batch size

GPU Layers Number of layers on GPU

Threads CPU threads to use

Random Seed Seed for reproducibility

Max Input Tokens Maximum input context tokens

Stream Response

Enable OCR

Extract text from images in PDFs