33 Pull requests merged by 5 people

• feat: add endpoint to list system informations

  #3449 merged Sep 5, 2024

• models(gallery): add yi-coder (and variants)

  #3482 merged Sep 5, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to 581c305186a0ff93f360346c57e21fe16e967bb7

  #3481 merged Sep 5, 2024

• fix: purge a few remaining runway model references

  #3480 merged Sep 4, 2024

• chore(deps): Bump openai from 1.42.0 to 1.43.0 in /examples/langchain/langchainpy-localai-example

  #3456 merged Sep 3, 2024

• chore(deps): Bump streamlit from 1.37.1 to 1.38.0 in /examples/streamlit-bot

  #3465 merged Sep 3, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to 8962422b1c6f9b8b15f5aeaea42600bcc2d44177

  #3478 merged Sep 3, 2024

• chore: ⬆️ Update ggerganov/whisper.cpp to 5236f0278420ab776d1787c4330678d80219b4b6

  #3475 merged Sep 3, 2024

• chore(deps): Bump langchain from 0.2.14 to 0.2.15 in /examples/langchain-chroma

  #3466 merged Sep 3, 2024

• chore(deps): Bump openai from 1.42.0 to 1.43.0 in /examples/langchain-chroma

  #3468 merged Sep 3, 2024

• chore(deps): Bump langchain from 0.2.14 to 0.2.15 in /examples/langchain/langchainpy-localai-example

  #3460 merged Sep 3, 2024

• chore(deps): Bump openai from 1.42.0 to 1.43.0 in /examples/functions

  #3452 merged Sep 3, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to 48baa61eccdca9205daf8d620ba28055c2347b64

  #3474 merged Sep 3, 2024

• chore(deps): Bump docs/themes/hugo-theme-relearn from 3a0ae52 to 550a6ee

  #3472 merged Sep 3, 2024

• chore(deps): Bump llama-index from 0.11.1 to 0.11.4 in /examples/langchain-chroma

  #3467 merged Sep 3, 2024

• chore(deps): Bump llama-index from 0.11.1 to 0.11.4 in /examples/chainlit

  #3462 merged Sep 2, 2024

• chore(deps): Bump langchain-community from 0.2.12 to 0.2.15 in /examples/langchain/langchainpy-localai-example

  #3461 merged Sep 2, 2024

• chore(deps): Bump yarl from 1.9.4 to 1.9.7 in /examples/langchain/langchainpy-localai-example

  #3459 merged Sep 2, 2024

• chore(deps): Bump certifi from 2024.7.4 to 2024.8.30 in /examples/langchain/langchainpy-localai-example

  #3457 merged Sep 2, 2024

• chore(deps): Bump langchain from 0.2.14 to 0.2.15 in /examples/functions

  #3453 merged Sep 2, 2024

• feat(vllm): add support for embeddings

  #3440 merged Sep 2, 2024

• chore(deps): update whisper.cpp

  #3443 merged Sep 2, 2024

• fix: untangle pkg/grpc and core/schema for Transcription

  #3419 merged Sep 2, 2024

• chore(model-gallery): ⬆️ update checksum

  #3446 merged Sep 2, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to 8f1d81a0b6f50b9bad72db0b6fcd299ad9ecd48c

  #3445 merged Sep 1, 2024

• models(gallery): add hubble-4b-v1

  #3444 merged Sep 1, 2024

• chore(model-gallery): ⬆️ update checksum

  #3442 merged Aug 31, 2024

• chore: ⬆️ Update ggerganov/llama.cpp to a47667cff41f5a198eb791974e0afcc1cddd3229

  #3441 merged Aug 31, 2024

• chore(deps): update llama.cpp

  #3438 merged Aug 30, 2024

• feat: Added Piper voice it-paola-medium

  #3434 merged Aug 30, 2024

• chore(model-loader): increase test coverage of model loader

  #3433 merged Aug 30, 2024

• chore(tests): replace runaway models for tests

  #3432 merged Aug 30, 2024

• chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both

  #3428 merged Aug 29, 2024

3 Pull requests opened by 1 person

• fix: speedup and improve cachability of docker build of `builder-sd`

  #3430 opened Aug 30, 2024

• feat: auth v2 - supersedes #2894

  #3476 opened Sep 2, 2024

• build: experimental PR speed improvement: filter PR change folder

  #3477 opened Sep 3, 2024

3 Issues closed by 2 people

• Add vllm support for embedding endpoint

  #3435 closed Sep 2, 2024

• LocalAI use only 100% CPU (one Core) for Rebuild and Could not release VRAM when not use model

  #3032 closed Sep 1, 2024

• Listen address and port ignored when using local-ai worker llama-cpp-rpc

  #3427 closed Aug 29, 2024

4 Issues opened by 4 people

• gpu_layers is not effective

  #3479 opened Sep 3, 2024

• Flux GGUF (Replicate, Document, Add to Model)

  #3447 opened Sep 1, 2024

• Intel ARC GPU - llama_model_load: can not find preferred GPU platform

  #3437 opened Aug 30, 2024

• Completion endpoint does not count tokens when using vLLM backend

  #3436 opened Aug 30, 2024

5 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• gpu + transformers-musicgen

  #3420 commented on Aug 30, 2024 • 0 new comments

• Support RKLLM

  #3192 commented on Sep 1, 2024 • 0 new comments

• Uninstall script

  #2865 commented on Sep 2, 2024 • 0 new comments

• Distributed inference for diffusers

  #995 commented on Sep 5, 2024 • 0 new comments

• refactor: ListModels Filtering Upgrade

  #2773 commented on Aug 31, 2024 • 0 new comments