urlscan.io logo urlscan.io
SecurityTrails logo

localai.io Open in urlscan Pro
188.114.96.3  Public Scan

Back to summary
Submitted URL: http://localai.io/
Effective URL: https://localai.io/
Submission: On April 14 via api from US — Scanned from NL

Form analysis 1 forms found in the DOM

<form class="flexsearch position-relative flex-grow-1 ms-2 me-2">
  <div class="d-flex flex-row">
    <input id="flexsearch" class="form-control" type="search" placeholder="Search" aria-label="Search" autocomplete="off">
    <button id="hideFlexsearch" type="button" class="ms-2 btn btn-soft"> cancel </button>
  </div>
  <div id="suggestions" class="shadow rounded-1 d-none"></div>
</form>

Text Content

 * LocalAI

 * 
 * 

 * info Overview
 * rocket_launch Getting started
    * Quickstart
    * Run other Models
    * Customizing the Model
    * Run models manually
    * Build LocalAI from source

 * newspaper News
 * feature_search Features
    * ⚡ GPU acceleration
    * 📖 Text generation (GPT)
    * 🗣 Text to audio (TTS)
    * 🎨 Image generation
    * 🧠 Embeddings
    * 🆕 GPT Vision
    * ✍️ Constrained grammars
    * 🔈 Audio to text
    * 🔥 OpenAI functions and tools
    * 💾 Stores
    * 🖼️ Model gallery

 * rocket_launch Integrations
 * science Advanced
    * Advanced usage
    * Fine-tuning LLMs for text generation

 * science References
    * Model compatibility table
    * Architecture
    * Available Container images
    * All-In-One images

 * quiz FAQ


menu search Search

 * GitHub
 * Twitter / X
 * RSS

Enable dark mode Enable light mode
to navigate to select to close
cancel

 * Home
 * Overview

On this page
 * * Start LocalAI
   * What is LocalAI?
     * 🚀 Features
   * Contribute and help
   * 🌟 Star history
   * 📖 License
   * 🙇 Acknowledgements
   * 🤗 Contributors

Table of Contents
 * * Start LocalAI
   * What is LocalAI?
     * 🚀 Features
   * Contribute and help
   * 🌟 Star history
   * 📖 License
   * 🙇 Acknowledgements
   * 🤗 Contributors

info


OVERVIEW

What is LocalAI?

> 💡 Get help - ❓FAQ 💭Discussions 💭Discord
> 
> 💻 Quickstart 📣 News 🛫 Examples 🖼️ Models 🚀 Roadmap

LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in
replacement REST API that’s compatible with OpenAI API specifications for local
inferencing. It allows you to run LLMs, generate images, audio (and not only)
locally or on-prem with consumer grade hardware, supporting multiple model
families and architectures. Does not require GPU. It is maintained by mudler.


START LOCALAI LINK

Start the image with Docker to have a functional clone of OpenAI! 🚀:

docker run -p 8080:8080 --name local-ai -ti localai/localai:latest-aio-cpu
# Do you have a Nvidia GPUs? Use this instead
# CUDA 11
# docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11
# CUDA 12
# docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-12



See the 💻 Quickstart for all the options and way you can run LocalAI!


WHAT IS LOCALAI? LINK

In a nutshell:

 * Local, OpenAI drop-in alternative REST API. You own your data.
 * NO GPU required. NO Internet access is required either
   * Optional, GPU Acceleration is available. See also the build section.
 * Supports multiple models
 * 🏃 Once loaded the first time, it keep models loaded in memory for faster
   inference
 * ⚡ Doesn’t shell-out, but uses bindings for a faster inference and better
   performance.

LocalAI is focused on making the AI accessible to anyone. Any contribution,
feedback and PR is welcome!

Note that this started just as a fun weekend project by mudler in order to try
to create the necessary pieces for a full AI assistant like ChatGPT: the
community is growing fast and we are working hard to make it better and more
stable. If you want to help, please consider contributing (see below)!


🚀 FEATURES LINK

 * 📖 Text generation with GPTs (llama.cpp, gpt4all.cpp, … 📖 and more)
 * 🗣 Text to Audio
 * 🔈 Audio to Text (Audio transcription with whisper.cpp)
 * 🎨 Image generation with stable diffusion
 * 🔥 OpenAI functions 🆕
 * 🧠 Embeddings generation for vector databases
 * ✍️ Constrained grammars
 * 🖼️ Download Models directly from Huggingface
 * 🆕 Vision API
 * 💾 Stores


CONTRIBUTE AND HELP LINK

To help the project you can:

 * If you have technological skills and want to contribute to development, have
   a look at the open issues. If you are new you can have a look at the
   good-first-issue and help-wanted labels.

 * If you don’t have technological skills you can still help improving
   documentation or add examples or share your user-stories with our community,
   any help and contribution is welcome!


🌟 STAR HISTORY LINK

star-history.comAprilJulyOctober2024
2.0k4.0k6.0k8.0k10.0k12.0k14.0kgo-skynet/LocalAIStar HistoryDateGitHub Stars


📖 LICENSE LINK

LocalAI is a community-driven project created by Ettore Di Giacinto.

MIT - Author Ettore Di Giacinto


🙇 ACKNOWLEDGEMENTS LINK

LocalAI couldn’t have been built without the help of great software already
available from the community. Thank you!

 * llama.cpp
 * https://github.com/tatsu-lab/stanford_alpaca
 * https://github.com/cornelk/llama-go for the initial ideas
 * https://github.com/antimatter15/alpaca.cpp
 * https://github.com/EdVince/Stable-Diffusion-NCNN
 * https://github.com/ggerganov/whisper.cpp
 * https://github.com/saharNooby/rwkv.cpp
 * https://github.com/rhasspy/piper


🤗 CONTRIBUTORS LINK

This is a community project, a special thanks to our contributors! 🤗

Edit this page

Last updated 3 days ago. history

--------------------------------------------------------------------------------

Quickstart navigate_next



© 2023-2024 Ettore Di Giacinto