TypeDB: the power of programming, in your database
AICI: Prompts as (Wasm) Programs
Fast ML inference & training for ONNX models in Rust
Highly Performant, Modular, Memory Safe and Production-ready Inference, Ingestion and Indexing built in Rust 🦀
An open-source computer vision framework to build and deploy apps in minutes
Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
TypeQL: the power of programming, in your database
OramaCore is the complete runtime you need for your projects, answer engines, copilots, and search. It includes a fully-fledged full-text search engine, vector database, LLM interface, and many more utilities.
InferX: Inference as a Service Platform
LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
A DuckDB extension for in-database inference
A neural network inference library, written in Rust.
A statically structurally typed JIT-compiled programming language, mainly for embedding in other programs.
A CLI tool that generates JSON Typedef schemas from example data
An ICE-based predicate synthesizer for Horn clauses.
EdgeInfer enables efficient edge intelligence by running small AI models, including embeddings and OnnxModels, on resource-constrained devices like Android, iOS, or MCUs for real-time decision-making. EdgeInfer 旨在资源受限的设备上运行小型 AI 模型（包括向量化和 Onnx 模型），如 Android、iOS 或 MCUs，实现高效的边缘智能，用于实时决策。
Kubernetes Gateway API implementation in Rust
Add a description, image, and links to the inference topic page so that developers can more easily learn about it.
To associate your repository with the inference topic, visit your repo's landing page and select "manage topics."