Free AI APIs

There are APIs offering free/free-trial access to AI APIs via reverse proxy.

Here is a well-maintained public list of Free AI APIs that may or may not be compatible with LibreChat

⚠️ OpenRouter is in a category of its own, and is highly recommended over the "free" services below. NagaAI and other 'free' API proxies tend to have intermittent issues, data leaks, and/or problems with the guidelines of the platforms they advertise on. Use the below at your own risk.

NagaAI

Since NagaAI works with LibreChat, and offers Claude, Mistral along with OpenAI models, let's start with that one: NagaAI

⚠️ Never trust 3rd parties. Use at your own risk of privacy loss. Your data may be used for AI training at best or for nefarious reasons at worst; this is true in all cases, even with official endpoints: never give an LLM sensitive/identifying information. If something is free, you are the product. If errors arise, they are more likely to be due to the 3rd party, and not this project, as I test the official endpoints first and foremost.

You will get your API key from the discord server. The instructions are pretty clear when you join so I won't repeat them.

Once you have the API key, you should adjust your .env file like this:

##########################
# OpenAI Endpoint: 
##########################

OPENAI_API_KEY=your-naga-ai-api-key
# Reverse proxy settings for OpenAI: 
OPENAI_REVERSE_PROXY=https://api.naga.ac/v1/chat/completions

# OPENAI_MODELS=gpt-3.5-turbo,gpt-3.5-turbo-16k,gpt-3.5-turbo-0301,gpt-4,gpt-4-0314,gpt-4-0613

Important : As of v0.6.6, it's recommend you use the librechat.yaml Configuration file (guide here) to add Reverse Proxies as separate endpoints.

Note: The OPENAI_MODELS variable is commented out so that the server can fetch nagaai/api/v1/models for all available models. Uncomment and adjust if you wish to specify which exact models you want to use.

It's worth noting that not all models listed by their API will work, with or without this project. The exact URL may also change, just make sure you include /v1/chat/completions in the reverse proxy URL if it ever changes.

You can set OPENAI_API_KEY=user_provided if you would like the user to add their own NagaAI API key, just be sure you specify the models with OPENAI_MODELS in this case since they won't be able to be fetched without an admin set API key.

That's it! You're all set. 🎉

Here's me using Llama2 via NagaAI

Plugins also work with this reverse proxy (OpenAI models). More info on plugins here

⚠️ Note: If you're having trouble, before creating a new issue, please search for similar ones on our #issues thread on our discord or our troubleshooting discussion on our Discussions page. If you don't find a relevant issue, feel free to create a new one and provide as much detail as possible.