Secure, Fast, and Extensible Sandbox runtime for AI agents.
-
Updated
May 9, 2026 - Python
#
ai-infra
Here are 75 public repositories matching this topic...
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. 🗃️ Llama3, Mistral, etc. 🧑💻 Video Tutorials.
-
Updated
Jul 25, 2025
⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
visualization python training tracking data-science machine-learning deep-learning tensorflow logging transformers pytorch tensorboard model-versioning mlops ai-infra llm
-
Updated
May 9, 2026 - Python
A full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation.
agent security scanner vulnerability security-tools ai-security ai-infra mcp-scan llm prompt-injection llm-security llm-evaluation prompt-security agent-security ai-red-teaming openclaw-security skill-scanner llm-jailbreak skills-security
-
Updated
May 4, 2026 - Python
TurboDiffusion: 100–200× Acceleration for Video Diffusion Models
rcm distillation video-generation mlsystem diffusion-models inference-acceleration ai-infra consistency-model sageattention sparse-linear-attention
-
Updated
Apr 15, 2026 - Python
The agent runtime platform powered by context graphs.
agent open-source graph sparql rdf ontology context knowledge-graph developer-tools graph-database ontology-engineering ai-infra ai-tools neuro-symbolic-ai context-graph agent-memory agent-runtime trustgraph context-engineering context-os
-
Updated
May 8, 2026 - Python
AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识（https://forceinjection.github.io/）
-
Updated
May 8, 2026 - HTML
[ICML2025] SpargeAttention: A training-free sparse attention that accelerates any model inference.
attention vit quantization video-generation mlsys inference-acceleration ai-infra vision-transformer sparse-attention llm sageattention
-
Updated
Feb 25, 2026 - Cuda
High-performance distributed multi-tier cache system. Built in Rust.
rust ai s3 fluid high-performance-computing cloud-native model-deployment model-training lance inference-acceleration ai-infra opendal lancedb
-
Updated
May 9, 2026 - Rust
hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等
-
Updated
Apr 27, 2026 - Cuda
Official Repo of Moss
-
Updated
May 9, 2026 - Python
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
transformer video-generation mlsys inference-acceleration ai-infra linear-attention sparse-attention diffusion-transformer train-acceleration sparse-linear-attention
-
Updated
Feb 24, 2026 - Python
Implement a Pytorch-like DL library in C++ from scratch, step by step
-
Updated
Apr 15, 2026 - C++
Transform your pythonic research to an artifact that engineers can deploy easily.
kubernetes data-science machine-learning production ml data-engineering feature-extraction dataops feature-engineering raptor model-deployment kubeflow mlops ai-infra featurestore raptor-ml feature-platform reactive-ml
-
Updated
Jan 31, 2026 - Go
This is a landscape of the infrastructure that powers the generative AI ecosystem
-
Updated
Oct 16, 2024 - HTML
Cloud Native ML/DL Platform
-
Updated
Sep 9, 2020
Agent-Sandbox is an E2B compatible easy-to-use enterprise-grade sandboxes for AI Agents. Allows Agents to securely run untrusted LLM-generated Code, Browser use, Computer use, and deploy Website etc.
agent mcp sandbox container kubernetes-native code-executor ai-infra agent-sandbox computer-use browser-use ai-sandbox e2b-compatible
-
Updated
Apr 28, 2026 - Go
A High-Performance LLM Inference Engine with vLLM-Style Continuous Batching
-
Updated
Jan 2, 2026 - C++
The open-source intelligence layer for AI native development
infrastructure rust cli hooks ai opencode gemini cursor ai-agents ai-infra ai-assistant ai-tools ai-agent bitloops ai-infrastructure claude-code
-
Updated
May 8, 2026 - Rust
Improve this page
Add a description, image, and links to the ai-infra topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ai-infra topic, visit your repo's landing page and select "manage topics."