DocsGPT Settings
DocsGPT is highly configurable, allowing you to tailor it to your specific needs and preferences. You can control various aspects of the application, from choosing the Large Language Model (LLM) provider to selecting embedding models and vector stores.
This document will guide you through the basic settings you can configure in DocsGPT. These settings determine how DocsGPT interacts with LLMs and processes your data.
Configuration Methods
There are two primary ways to configure DocsGPT settings:
1. Configuration via .env
file (Recommended)
The easiest and recommended way to configure basic settings is by using a .env
file. This file should be located in the root directory of your DocsGPT project (the same directory where setup.sh
is located).
Example .env
file structure:
LLM_PROVIDER=openai
API_KEY=YOUR_OPENAI_API_KEY
LLM_NAME=gpt-4o
2. Configuration via settings.py
file (Advanced)
For more advanced configurations or if you prefer to manage settings directly in code, you can modify the settings.py
file. This file is located in the application/core
directory of your DocsGPT project.
While modifying settings.py
offers more flexibility, it's generally recommended to use the .env
file for basic settings and reserve settings.py
for more complex adjustments or when you need to configure settings programmatically.
Location of settings.py
: application/core/settings.py
Basic Settings Explained
Here are some of the most fundamental settings you'll likely want to configure:
-
LLM_PROVIDER
: This setting determines which Large Language Model (LLM) provider DocsGPT will use. It tells DocsGPT which API to interact with.- Common values:
docsgpt
: Use the DocsGPT Public API Endpoint (simple and free, as offered insetup.sh
option 1).openai
: Use OpenAI's API (requires an API key).google
: Use Google's Vertex AI or Gemini models.anthropic
: Use Anthropic's Claude models.groq
: Use Groq's models.huggingface
: Use HuggingFace Inference API.azure_openai
: Use Azure OpenAI Service.openai
(when using local inference engines like Ollama, Llama.cpp, TGI, etc.): This signals DocsGPT to use an OpenAI-compatible API format, even if the actual LLM is running locally.
- Common values:
-
LLM_NAME
: Specifies the specific model to use from the chosen LLM provider. The available models depend on theLLM_PROVIDER
you've selected.- Examples:
- For
LLM_PROVIDER=openai
:gpt-4o
- For
LLM_PROVIDER=google
:gemini-2.0-flash
- For local models (e.g., Ollama):
llama3.2:1b
(or any model name available in your setup).
- For
- Examples:
-
EMBEDDINGS_NAME
: This setting defines which embedding model DocsGPT will use to generate vector embeddings for your documents. Embeddings are numerical representations of text that allow DocsGPT to understand the semantic meaning of your documents for efficient search and retrieval.- Default value:
huggingface_sentence-transformers/all-mpnet-base-v2
(a good general-purpose embedding model). - Other options: You can explore other embedding models from Hugging Face Sentence Transformers or other providers if needed.
- Default value:
-
API_KEY
: Required for most cloud-based LLM providers. This is your authentication key to access the LLM provider's API. You'll need to obtain this key from your chosen provider's platform. -
OPENAI_BASE_URL
: Specifically used whenLLM_PROVIDER
is set toopenai
but you are connecting to a local inference engine (like Ollama, Llama.cpp, etc.) that exposes an OpenAI-compatible API. This setting tells DocsGPT where to find your local LLM server.
Configuration Examples
Let's look at some concrete examples of how to configure these settings in your .env
file.
Example for Cloud API Provider (OpenAI)
To use OpenAI's gpt-4o
model, you would configure your .env
file like this:
LLM_PROVIDER=openai
API_KEY=YOUR_OPENAI_API_KEY # Replace with your actual OpenAI API key
LLM_NAME=gpt-4o
Make sure to replace YOUR_OPENAI_API_KEY
with your actual OpenAI API key.
Example for Local Deployment
To use a local Ollama server with the llama3.2:1b
model, you would configure your .env
file like this:
LLM_PROVIDER=openai # Using OpenAI compatible API format for local models
API_KEY=None # API Key is not needed for local Ollama
LLM_NAME=llama3.2:1b
OPENAI_BASE_URL=http://host.docker.internal:11434/v1 # Default Ollama API URL within Docker
EMBEDDINGS_NAME=huggingface_sentence-transformers/all-mpnet-base-v2 # You can also run embeddings locally if needed
In this case, even though you are using Ollama locally, LLM_PROVIDER
is set to openai
because Ollama (and many other local inference engines) are designed to be API-compatible with OpenAI. OPENAI_BASE_URL
points DocsGPT to the local Ollama server.
Authentication Settings
DocsGPT includes a JWT (JSON Web Token) based authentication feature for managing sessions or securing local deployments while allowing access.
AUTH_TYPE
Overview
The AUTH_TYPE
setting in your .env
file or settings.py
determines the authentication method used by DocsGPT. This allows you to control how users authenticate with your DocsGPT instance.
Value | Description |
---|---|
None | No authentication is used. Anyone can access the app. |
simple_jwt | A single, long-lived JWT token is generated at startup. All requests use this shared token. |
session_jwt | Unique JWT tokens are generated for each session/user. |
How to Configure
Add the following to your .env
file (or set in settings.py
):
# No authentication (default)
AUTH_TYPE=None
# OR: Simple JWT (shared token)
AUTH_TYPE=simple_jwt
JWT_SECRET_KEY=your_secret_key_here
# OR: Session JWT (per-user/session tokens)
AUTH_TYPE=session_jwt
JWT_SECRET_KEY=your_secret_key_here
- If
AUTH_TYPE
is set tosimple_jwt
orsession_jwt
, aJWT_SECRET_KEY
is required. - If
JWT_SECRET_KEY
is not set, DocsGPT will generate one and store it in.jwt_secret_key
in the project root.
How Each Method Works
- None: No authentication. All API and UI access is open.
- simple_jwt:
- A single JWT token is generated at startup and printed to the console.
- Use this token in the
Authorization
header for all API requests:Authorization: Bearer <SIMPLE_JWT_TOKEN>
- The frontend will prompt for this token if not already set.
- session_jwt:
- Clients can request a new token from
/api/generate_token
. - Use the received token in the
Authorization
header for subsequent requests. - Each user/session gets a unique token.
- Clients can request a new token from
Security Notes
- Always keep your
JWT_SECRET_KEY
secure and private. - If you set it manually, use a strong, random string.
- If not set, DocsGPT will generate a secure key and persist it in
.jwt_secret_key
.
Checking Current Auth Type
- Use the
/api/config
endpoint to check the currentauth_type
and whether authentication is required.
Frontend Token Input for simple_jwt
If you have configured AUTH_TYPE=simple_jwt
, the DocsGPT frontend will prompt you to enter the JWT token if it's not already set or is invalid. Paste the SIMPLE_JWT_TOKEN
(printed to your console when the backend starts) into this field to access the application.

Exploring More Settings
These are just the basic settings to get you started. The settings.py
file contains many more advanced options that you can explore to further customize DocsGPT, such as:
- Vector store configuration (
VECTOR_STORE
, Qdrant, Milvus, LanceDB settings) - Retriever settings (
RETRIEVERS_ENABLED
) - Cache settings (
CACHE_REDIS_URL
) - And many more!
For a complete list of available settings and their descriptions, refer to the settings.py
file in application/core
. Remember to restart your Docker containers after making changes to your .env
file or settings.py
for the changes to take effect.