Lists (5)
Sort Oldest
Stars
A vector search SQLite extension that runs anywhere!
OpenTelemetry Collector
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Easy to maintain open source documentation websites.
The interoperable, open source catalog for Apache Iceberg
Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vector…
A high-throughput and memory-efficient inference and serving engine for LLMs
User-friendly WebUI for LLMs (Formerly Ollama WebUI)
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
Agentic components of the Llama Stack APIs
Get up and running with Llama 3.1, Mistral, Gemma 2, and other large language models.
The Security Toolkit for LLM Interactions
One-click deploy of a Knowledge Graph powered RAG (GraphRAG) in Azure
A modular graph-based Retrieval-Augmented Generation (RAG) system
Synthetic data generators for tabular and time-series data
Lite & Super-fast re-ranking for your search & retrieval pipelines. Supports SoTA Listwise and Pairwise reranking based on LLMs and cross-encoders and more. Created by Prithivi Da, open for PRs & C…
Fast lexical search library implementing BM25 in Python using Numpy and Scipy
LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as Delta Lake, Apache Hudi, and Apache Iceberg.
Open, Multi-modal Catalog for Data & AI
AutoMQ is a cloud-first alternative to Kafka by decoupling durability to S3 and EBS. 10x cost-effective. Autoscale in seconds. Single-digit ms latency.
Fast, portable, non-Turing complete expression evaluation with gradual typing (Go)
Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our c…
A Blazing Fast AI Gateway with integrated Guardrails. Route to 200+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23