Use vLLM on Ascend hardware for fast and efficient AI operations.
Automations like: when a new customer signs up, automatically create a new contact in Salesforce and email a welcome message, using community-maintained vLLM on Ascend hardware.
This community-maintained hardware plugin for vLLM on Ascend helps you use AI operations on your own hardware, saving costs and improving performance.
"A founder, Alex, needs to automate welcome emails for new customers on their e-commerce site. They use vLLM on Ascend to create an automation that checks for new sign-ups, creates a new contact in Salesforce, and sends a welcome email. This automation frees up time for Alex to focus on growing the business. This automation works in 5 minutes."
If you've never used AI operations before, start with this to get familiar with community-maintained hardware plugins.
If you're looking for a cost-effective way to use AI operations on your own hardware, reach for this community-maintained plugin.
This plugin is for using vLLM on Ascend hardware, not for training or managing LLMs themselves.
The vllm-ascend tool enables founders to integrate community-maintained hardware plugins for vLLM on Ascend, enhancing AI capabilities with open-source solutions.
git clone https://github.com/vllm-project/vllm-ascend.gitTo build and run a custom vLLM plugin, use `mkdir build && cd build && cmake .. && make`, then integrate the compiled plugin into your Ascend project
Read the entire source before you build โ unlike paid marketplaces that hide it behind a buy button.
Are you the creator of this tool? Claim your listing โ and earn 85% of every sale.
More ai-agent tools founders pair with this one.