퓨리오사AI Senior Software Engineer, Inference Engine (Platform Software)

한 줄 요약

퓨리오사AI Senior Software Engineer, Inference Engine (Platform Software) — 퓨리오사AI · Seoul, South Korea. 현재 상태: 진행·예정.

정보 갱신일 2026-10-21

조건·일정 확인

기관·대학

퓨리오사AI

지역·근무지

Seoul, South Korea

학력

학사 이상

담당 업무

• Design and implement FuriosaAI’s next-generation inference engine for large and multimodal language models—comparable in capability to frameworks such as vLLM and SGLang—optimized for throughput, latency, and memory efficiency.
• Design and implement advanced inference optimizations—such as speculative decoding, KV-cache management, tensor/model parallelism, memory-efficient execution, and scheduling—in our production inference engine.
• Design and develop capabilities for distributed and scalable inference, including prefill–decode (PD) and encode–prefill–decode (EPD) disaggregation, disaggregated speculative decoding, and hierarchical and external KV-cache storage such as HiCache and Mooncake.
• Collaborate closely with the Compiler team to co-design and optimize execution for FuriosaAI NPUs, improving system-level throughput, latency, and memory utilization.
• Proactively research, evaluate, and integrate state-of-the-art inference optimization techniques and key features of LLM serving frameworks into our production inference engine.

지원 자격

• BS degree in Computer Science, Engineering, or a related field, with at least 3 years of relevant industry experience, or equivalent practical experience
• Proficiency in Rust or C++ programming skill
• Knowledge and passion of deep learning, LLM, and/or generative AI models
• Excellent problem-solving and data analysis skills.
• Strong communication and collaboration skills.

우대 사항

• Experience in building inference serving systems for large models, encompassing batching, scheduling, caching, and load balancing.
• A deep understanding of performance optimization systems.
• Proficiency in C++/CUDA or Triton kernel development
• Contributions to open-source inference frameworks such as vLLM, SGLang, or TensorRT-LLM.
• talent@furiosa.ai

공식 출처와 다음 단계

원천 정보 갱신: 2026. 10. 21. PM 5:06

본문에 없는 자격·금액·일정은 임의로 보완하지 않습니다. 원문과 담당 기관에서 확인하세요.

관련 정보

퓨리오사AI 연구·기술직 채용 · 연구·기술직 채용공고 전체 보기