# 元宝-LLM大模型推理工程师

External opening: you cannot apply through AI Native Match; apply on the official site.

Apply through the official channel. The full external receipt stays in your workspace. When signed in, three minimal event types explicitly recorded through the CLI are reported by default: selection, self-reported application and channel observation. Browsing or saving a role does not report an event; external applications do not appear under My applications.

- Company: 腾讯 (Listed company)
- Locations: 深圳
- Role: Engineering
- Apply on the official site: https://careers.tencent.com/jobdesc.html?postId=2055195929673383936

## Role description from source

1.负责开发和优化大模型推理框架；
2.主要通过GPU、CUDA性能优化的手段，结合线上实际情况，优化高性能LLM推理引擎；
3.负责大模型训练和推理前瞻性技术架构的调研和引入，技术方案不限于子图匹配、编译优化、模型量化等。
职位要求
1.本科及以上学历，计算机/电子/自动化/软件等相关专业，有AI工程优化经验的优先；
2.熟练GPU的高性能计算优化技术，深入理解计算机体系结构，熟悉并行计算优化、访存优化，低比特计算等；
3.具备丰富的基于CUDA的GPU性能优化经验；
4.了解深度学习算法基本原理，熟悉神经网络基本架构和各算子计算方式，了解至少一种深度学习训练框架及其模型文件的解析，如PyTorch、TensorFlow；
5.熟悉TensorRT-LLM、vLLM等，了解主流LLM模型，有LLM模型加速优化经验者优先。
工作年限（官方顶部字段）
两年以上工作经验

---
opening_id: e5ec2edf-c149-41f4-94e4-c846ab3ff7c7

`anm openings save --id e5ec2edf-c149-41f4-94e4-c846ab3ff7c7`
