localai.io
Open in
urlscan Pro
188.114.96.3
Public Scan
Submitted URL: http://localai.io/
Effective URL: https://localai.io/
Submission: On April 14 via api from US — Scanned from NL
Effective URL: https://localai.io/
Submission: On April 14 via api from US — Scanned from NL
Form analysis
1 forms found in the DOM<form class="flexsearch position-relative flex-grow-1 ms-2 me-2">
<div class="d-flex flex-row">
<input id="flexsearch" class="form-control" type="search" placeholder="Search" aria-label="Search" autocomplete="off">
<button id="hideFlexsearch" type="button" class="ms-2 btn btn-soft"> cancel </button>
</div>
<div id="suggestions" class="shadow rounded-1 d-none"></div>
</form>
Text Content
* LocalAI * * * info Overview * rocket_launch Getting started * Quickstart * Run other Models * Customizing the Model * Run models manually * Build LocalAI from source * newspaper News * feature_search Features * β‘ GPU acceleration * π Text generation (GPT) * π£ Text to audio (TTS) * π¨ Image generation * π§ Embeddings * π GPT Vision * βοΈ Constrained grammars * π Audio to text * π₯ OpenAI functions and tools * πΎ Stores * πΌοΈ Model gallery * rocket_launch Integrations * science Advanced * Advanced usage * Fine-tuning LLMs for text generation * science References * Model compatibility table * Architecture * Available Container images * All-In-One images * quiz FAQ menu search Search * GitHub * Twitter / X * RSS Enable dark mode Enable light mode to navigate to select to close cancel * Home * Overview On this page * * Start LocalAI * What is LocalAI? * π Features * Contribute and help * π Star history * π License * π Acknowledgements * π€ Contributors Table of Contents * * Start LocalAI * What is LocalAI? * π Features * Contribute and help * π Star history * π License * π Acknowledgements * π€ Contributors info OVERVIEW What is LocalAI? > π‘ Get help - βFAQ πDiscussions πDiscord > > π» Quickstart π£ News π« Examples πΌοΈ Models π Roadmap LocalAI is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API thatβs compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families and architectures. Does not require GPU. It is maintained by mudler. START LOCALAI LINK Start the image with Docker to have a functional clone of OpenAI! π: docker run -p 8080:8080 --name local-ai -ti localai/localai:latest-aio-cpu # Do you have a Nvidia GPUs? Use this instead # CUDA 11 # docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-11 # CUDA 12 # docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:latest-aio-gpu-nvidia-cuda-12 See the π» Quickstart for all the options and way you can run LocalAI! WHAT IS LOCALAI? LINK In a nutshell: * Local, OpenAI drop-in alternative REST API. You own your data. * NO GPU required. NO Internet access is required either * Optional, GPU Acceleration is available. See also the build section. * Supports multiple models * π Once loaded the first time, it keep models loaded in memory for faster inference * β‘ Doesnβt shell-out, but uses bindings for a faster inference and better performance. LocalAI is focused on making the AI accessible to anyone. Any contribution, feedback and PR is welcome! Note that this started just as a fun weekend project by mudler in order to try to create the necessary pieces for a full AI assistant like ChatGPT: the community is growing fast and we are working hard to make it better and more stable. If you want to help, please consider contributing (see below)! π FEATURES LINK * π Text generation with GPTs (llama.cpp, gpt4all.cpp, β¦ π and more) * π£ Text to Audio * π Audio to Text (Audio transcription with whisper.cpp) * π¨ Image generation with stable diffusion * π₯ OpenAI functions π * π§ Embeddings generation for vector databases * βοΈ Constrained grammars * πΌοΈ Download Models directly from Huggingface * π Vision API * πΎ Stores CONTRIBUTE AND HELP LINK To help the project you can: * If you have technological skills and want to contribute to development, have a look at the open issues. If you are new you can have a look at the good-first-issue and help-wanted labels. * If you donβt have technological skills you can still help improving documentation or add examples or share your user-stories with our community, any help and contribution is welcome! π STAR HISTORY LINK star-history.comAprilJulyOctober2024 2.0k4.0k6.0k8.0k10.0k12.0k14.0kgo-skynet/LocalAIStar HistoryDateGitHub Stars π LICENSE LINK LocalAI is a community-driven project created by Ettore Di Giacinto. MIT - Author Ettore Di Giacinto π ACKNOWLEDGEMENTS LINK LocalAI couldnβt have been built without the help of great software already available from the community. Thank you! * llama.cpp * https://github.com/tatsu-lab/stanford_alpaca * https://github.com/cornelk/llama-go for the initial ideas * https://github.com/antimatter15/alpaca.cpp * https://github.com/EdVince/Stable-Diffusion-NCNN * https://github.com/ggerganov/whisper.cpp * https://github.com/saharNooby/rwkv.cpp * https://github.com/rhasspy/piper π€ CONTRIBUTORS LINK This is a community project, a special thanks to our contributors! π€ Edit this page Last updated 3 days ago. history -------------------------------------------------------------------------------- Quickstart navigate_next Β© 2023-2024 Ettore Di Giacinto