Chat with Lex! A RAG app, using HyDE with milvus DB for vector store, VLLM for LLM inference, and FastEmbed for Embeddings!
-
Updated
Jun 4, 2024 - Python
Chat with Lex! A RAG app, using HyDE with milvus DB for vector store, VLLM for LLM inference, and FastEmbed for Embeddings!
Genshin Impact Character Chat Models tuned by Lora on LLM
MLOps library for LLM deployment w/ the vLLM engine on RunPod's infra.
Examples of serving LLM on Modal.
A discord bot which can call LLMs using either Hugging Face or vLLM on Windows platform. Combined with function calling.
Embedding based semantic search app for poetry [App and EDA notebooks]
Standardized spec and vendor-specific transforms for ChatML
Evaluate open-source language models on Agent, formatted output, command following, long text, multilingual, coding, and custom task capabilities. 开源语言模型在Agent,格式化输出,指令追随,长文本,多语言,代码,自定义任务的能力基准测试。
Call many AIs from a single API.
This repository has a lot of LLM projects done. It is the best place to start learning LLM.
EchoSight is a tool that helps visually impaired individuals by audibly describing images taken with a Raspberry Pi Camera or inputted via image path or URL across different operating systems.
Add a description, image, and links to the vllm topic page so that developers can more easily learn about it.
To associate your repository with the vllm topic, visit your repo's landing page and select "manage topics."