localai.io
Open in
urlscan Pro
2a06:98c1:3120::3
Public Scan
Submitted URL: http://localai.io/
Effective URL: https://localai.io/
Submission: On July 10 via api from US — Scanned from NL
Effective URL: https://localai.io/
Submission: On July 10 via api from US — Scanned from NL
Form analysis 1 forms found in the DOM
<form class="flexsearch position-relative flex-grow-1 ms-2 me-2">
<div class="d-flex flex-row"><input id="flexsearch" class="form-control" type="search" placeholder="Search" aria-label="Search" autocomplete="off">
<button id="hideFlexsearch" type="button" class="ms-2 btn btn-soft"> cancel</button>
</div>
<div id="suggestions" class="shadow rounded-1 d-none"></div>
</form>Text Content
* LocalAI
*
*
* info Overview
* rocket_launch Getting started
* Quickstart
* Try it out
* Customizing the Model
* Run models manually
* Build LocalAI from source
* Run with container images
* Run with Kubernetes
* newspaper News
* feature_search Features
* ⚡ GPU acceleration
* 📖 Text generation (GPT)
* 📈 Reranker
* 🗣 Text to audio (TTS)
* 🎨 Image generation
* 🧠 Embeddings
* 🥽 GPT Vision
* ✍️ Constrained Grammars
* 🆕🖧 Distributed Inference
* 🔈 Audio to text
* 🔥 OpenAI functions and tools
* 💾 Stores
* 🖼️ Model gallery
* sync Integrations
* settings Advanced
* Advanced usage
* Fine-tuning LLMs for text generation
* Run other Models
* Installer options
* menu_book References
* Model compatibility table
* Architecture
* LocalAI binaries
* quiz FAQ
menu search Search
* GitHub
* Twitter / X
* RSS
Enable dark modeEnable light mode
to navigateto selectto close
cancel
* Home
* Overview
On this page
* * Start LocalAI
* What is LocalAI?
* 🚀 Features
* Contribute and help
* 🌟 Star history
* 📖 License
* 🙇 Acknowledgements
* 🤗 Contributors
Table of Contents
* * Start LocalAI
* What is LocalAI?
* 🚀 Features
* Contribute and help
* 🌟 Star history
* 📖 License
* 🙇 Acknowledgements
* 🤗 Contributors
info
OVERVIEW
What is LocalAI?
> 💡 Get help - ❓FAQ 💭Discussions 💭Discord
>
> 💻 Quickstart 📣 News 🛫 Examples 🖼️ Models 🚀 Roadmap
LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in
replacement REST API that’s compatible with OpenAI API specifications for local
inferencing. It allows you to run LLMs, generate images, audio (and not only)
locally or on-prem with consumer grade hardware, supporting multiple model
families and architectures. Does not require GPU. It is created and maintained
by Ettore Di Giacinto.
START LOCALAI LINK
Start the image with Docker to have a functional clone of OpenAI! 🚀:
docker run -p 8080:8080 --name local-ai -ti localai/localai:latest-aio-cpu
# Do you have a Nvidia GPUs? Use this instead
# CUDA 11
# docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11
# CUDA 12
# docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-12
Or just use the bash installer:
curl https://localai.io/install.sh | sh
See the 💻 Quickstart for all the options and way you can run LocalAI!
WHAT IS LOCALAI? LINK
In a nutshell:
* Local, OpenAI drop-in alternative REST API. You own your data.
* NO GPU required. NO Internet access is required either
* Optional, GPU Acceleration is available. See also the build section.
* Supports multiple models
* 🏃 Once loaded the first time, it keep models loaded in memory for faster
inference
* ⚡ Doesn’t shell-out, but uses bindings for a faster inference and better
performance.
LocalAI is focused on making the AI accessible to anyone. Any contribution,
feedback and PR is welcome!
Note that this started just as a fun weekend project by mudler in order to try
to create the necessary pieces for a full AI assistant like ChatGPT: the
community is growing fast and we are working hard to make it better and more
stable. If you want to help, please consider contributing (see below)!
🚀 FEATURES LINK
* 📖 Text generation with GPTs (llama.cpp, gpt4all.cpp, … 📖 and more)
* 🗣 Text to Audio
* 🔈 Audio to Text (Audio transcription with whisper.cpp)
* 🎨 Image generation with stable diffusion
* 🔥 OpenAI functions 🆕
* 🧠 Embeddings generation for vector databases
* ✍️ Constrained grammars
* 🖼️ Download Models directly from Huggingface
* 🥽 Vision API
* 💾 Stores
* 📈 Reranker
* 🆕🖧 P2P Inferencing
CONTRIBUTE AND HELP LINK
To help the project you can:
* If you have technological skills and want to contribute to development, have
a look at the open issues. If you are new you can have a look at the
good-first-issue and help-wanted labels.
* If you don’t have technological skills you can still help improving
documentation or add examples or share your user-stories with our community,
any help and contribution is welcome!
🌟 STAR HISTORY LINK
star-history.comAprilJulyOctober20242.0k4.0k6.0k8.0k10.0k12.0k14.0kgo-skynet/LocalAIStar
HistoryDateGitHub Stars
📖 LICENSE LINK
LocalAI is a community-driven project created by Ettore Di Giacinto.
MIT - Author Ettore Di Giacinto
🙇 ACKNOWLEDGEMENTS LINK
LocalAI couldn’t have been built without the help of great software already
available from the community. Thank you!
* llama.cpp
* https://github.com/tatsu-lab/stanford_alpaca
* https://github.com/cornelk/llama-go for the initial ideas
* https://github.com/antimatter15/alpaca.cpp
* https://github.com/EdVince/Stable-Diffusion-NCNN
* https://github.com/ggerganov/whisper.cpp
* https://github.com/saharNooby/rwkv.cpp
* https://github.com/rhasspy/piper
🤗 CONTRIBUTORS LINK
This is a community project, a special thanks to our contributors! 🤗
Edit this page
Last updated 18 days ago. history
--------------------------------------------------------------------------------
Quickstart navigate_next
© 2023-2024 Ettore Di Giacinto