REGISTRIEREN

Dieses Stellenangebot ist nicht mehr verfügbar

XX

Lead AI Inference Engineer 100% Remote

Framework Ventures
  • US
    New York, New York, United States
  • US
    New York, New York, United States

Über

About the job You will own the inference backbone behind QVAC's local AI stack: the C++ systems layer that makes models run fast, reliably, and predictably on real user hardware. The role is centered on engineering quality at runtime level, including startup behavior, memory pressure, throughput/latency balance, and long‑session stability. You will define and evolve the core abstractions that inference features depend on, so new capabilities can be added without sacrificing performance or maintainability. This is a role for someone who enjoys low‑level problem solving, clear technical ownership, and building infrastructure that other teams trust in production. Your work directly enables private, on‑device AI experiences and helps set the technical foundation for QVAC's next generation of peer‑to‑peer AI products.
Responsibilities
Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml, onnx.
Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments.
Integrate AI features into existing products, enriching them with the latest advancements in machine learning.
Manage a cross‑functional team (pod) made of middleware (JS), foundation (C++), QA and documentation engineers to produce high‑quality deliverables.
Regularly assess, both qualitatively and quantitatively, our position in the market with regards to similar products or platforms.
Leverage the expertise of technical architects to ensure robust architectural choices and code quality.
Ensure stable releases by following precise internal release processes.
Qualifications
Excellent programming skills in C++.
Strong experience with Llama.cpp and ggml inference engines, which facilitates the deployment of models to specific GPU architectures.
Good understanding of deep learning concepts and model architectures.
Experience with transformers, LLMs, Diffusion Models.
Demonstrated ability to rapidly assimilate new technologies and techniques.
Experience managing a small, specialized, cross‑functional team (pod) of 3‑5 people.
Genuine passion for building good products that improve people's lives.
Degree in Computer Science, AI, Machine Learning, or a related field, complemented by a solid track record in AI R&D.
Bonus points if
Extensive experience with Javascript/Typescript.
Understand the difficulties, nuances and importance of p2p technology.
Experience with any of Vulkan, Metal and OpenCL.
Have productionized models.
#J-18808-Ljbffr
  • New York, New York, United States

Sprachkenntnisse

  • English
Hinweis für Nutzer

Dieses Stellenangebot wurde von einem unserer Partner veröffentlicht. Sie können das Originalangebot einsehen hier.