ai-agent

vllm-ascend

Name: vllm-ascend
Author: vllm-project

Community maintained hardware plugin for vLLM on Ascend

2,177 stars1,316 forksC++Updated 6/2/2026100% free · open source

About this skill

Community maintained hardware plugin for vLLM on Ascend

Topics

ascend

inference

llm

llm-serving

llmops

mlops

model-serving

transformer

vllm

What's inside — free to inspect

No purchase needed

Read the entire source before you build — unlike paid marketplaces that hide it behind a buy button.

top-level files

folders

43.0M

repo size

Apache-2.0

license

Key files

.pre-commit-config.yaml

AGENTS.md

README.md

README.zh.md

requirements-dev.txt

requirements-lint.txt

File tree

.agents/

.claude/

.gemini/

.github/

.vllm_ascend/

benchmarks/

cmake/

csrc/

docs/

examples/

tests/

tools/

vllm_ascend/

.clang-format

.gitignore

.gitmodules

.markdownlint.yaml

.pre-commit-config.yaml

.readthedocs.yaml

AGENTS.md

CLAUDE.md

CMakeLists.txt

CODE_OF_CONDUCT.md

codecov.yml

Quick Actions

Details

Creator

vllm-project

Language

C++

Related skills

More ai-agent tools founders pair with this one.

ai-agent★ 172,909

Ollama: Run AI Models Locally on Your Own Machine

Instantly deploy top open-source AI models without cloud dependencies. Perfect for founders building AI applications with complete privacy and control.

ai-agent★ 165,332

Karpathy Skills: AI Coding Wisdom for Smarter Development

Unlock advanced LLM coding strategies from a leading AI researcher. Essential reference for founders building intelligent code agents and AI products.

ai-agent★ 161,190

Transformers: Ship AI Models in Minutes, Not Months

Quickly define, train, and deploy state-of-the-art machine learning models across text, vision, and audio. Perfect for AI founders building intelligent applications.

ai-agent★ 114,247

llama.cpp

LLM inference in C/C++

ai-agent★ 81,719

RAGFlow: Build Context-Aware AI Agents 10x Faster

Python toolkit for startup founders wanting powerful retrieval-augmented generation with advanced agent capabilities. Supercharge your LLM context management with open-source AI infrastructure.

ai-agent★ 75,645

OpenHands: AI-Driven Dev

Get AI-driven development tools with OpenHands. For founders and developers.