CAREERS

About Neural Magic

Based in Somerville, Massachusetts, Neural Magic is a series A startup backed by leading investors including Andreessen Horowitz, NEA, NEA, Pillar, VMware, Verizon Ventures, Comcast Ventures, and Amdocs. At Neural Magic we believe the future of AI is open and we are on a mission to bring the power of open-source LLMs and VLLM to every enterprise on the planet. Neural Magic accelerates AI for the enterprise and brings operational simplicity to GenAI deployments. As a leading developer and maintainer of the vLLM project and inventor of state-of-the-art techniques for model quantization and sparsification, Neural Magic provides a stable platform for enterprises to build, optimize and scale LLM deployments.

Our Mission

Neural Magic is on a mission to bring the power of open-source LLMs and vLLM to every enterprise on the planet.

Your Role

As a Full Stack Engineer Team Lead, you'll play a pivotal role in shaping the next generation of tools and platforms for AI inference serving. You'll work closely with our product and UX teams to create intuitive monitoring dashboards, insightful analyzers, and other critical components that empower users to understand and optimize their LLM deployments.

Join us in shaping the future of AI!

Responsibilities

• Lead and Collaborate: Guide a small team of front-end, full-stack, and back-end engineers, fostering a collaborative and high-performing environment.
• Drive the Roadmap: Partner with product management to translate business needs into technical solutions and actively contribute to our engineering and product roadmap.
• Build for the Future: Develop and maintain core features for our inference server platform, built upon technologies like vLLM and other cutting-edge solutions.
• Focus on Backend Excellence: Apply your deep expertise in Python-based backend development to build scalable, reliable, and performant systems.
• Full Stack Agility: Contribute to the front end using your proficiency in React, ensuring a seamless user experience.
• Data Expertise: Design and implement database solutions (SQL and NoSQL) that meet the unique demands of LLM-based applications.
• DevOps Advocate: Embrace DevOps principles and technologies (Kubernetes, CI/CD) to ensure smooth and efficient deployments.