Software Engineer
Rustacean, AI Infra(vLLM, vLLM-Ascend, Mooncake), Network(Server, Proxy, WASM, etc.), Cloud Platform (Openstack, k8s), Bluetooth, Linux Kernel & Driver, Embedded System.
Software Engineer
Rustacean, AI Infra(vLLM, vLLM-Ascend, Mooncake), Network(Server, Proxy, WASM, etc.), Cloud Platform (Openstack, k8s), Bluetooth, Linux Kernel & Driver, Embedded System.
Forked from zhangsicheng5/vllm-ascend
Community maintained hardware plugin for vLLM on Ascend
C++
A high-throughput and memory-efficient inference and serving engine for LLMs