shlogg · Early preview
Julien Prugne @bassochette

Break Free From OpenAI API With Ollama

Install Ollama, choose a lightweight model like deepseek-r1:7b, call the local API using curl or OpenAI client. Break free from OpenAI's costs and control!

I love tinkering with AI however I'm no AI farmer (those peeps are hot right now).
Piping everything through OpenAI API kinds of creeps me.
Because 'merica is known for spying and using populations private for imperialist fourberies.
And foremost, 'caus I don't wanna pay! oh yeah!
Solution:

Install Ollama
Chose a lightweight model
call the local api
make supposition on how to deploy

  
  
  Install Ollama

You follow the link and do the install: THE Link.
  
  
  Chose a lightweight model

I chose deepseek-r1:7b
ollama pull deepseek-r1:7b you might have to ctrl+B to exit the prompt.
My old l...