Model Serving Engineer at Bright Vision Technologies | chakrie

Requirements

Experience

7+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Additional Requirements

Bachelor’s or Master’s degree in Computer Science or a related field.
Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
Strong proficiency in Python and a systems language such as Go, Rust, or C++.
Deep experience operating high-throughput, low-latency services in production.
Hands-on experience with LLM or large model inference frameworks such as vLLM or TensorRT-LLM.
Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
Experience with observability stacks including metrics, tracing, and structured logging.
Solid grounding in performance engineering and capacity planning.
Strong communication and incident response skills.
Open-source contributions to model serving infrastructure.
Experience with multi-region or globally distributed AI serving.
Familiarity with model quantization, distillation, and compression techniques.
Exposure to FinOps for AI workloads and cost-efficient serving design.
Experience supporting external-facing AI APIs at scale.

Responsibilities

A clear overview of what is expected, written by the people who posted it, with every detail you need to decide.

Qualifications, experience and the skills that matter most, along with anything that would make you stand out.

Practical next steps, the documents to prepare and the dates to keep in mind before you apply or get in touch.

Contact details, links to the official source and the notes our team adds after checking each listing by hand.

Skills & expertise

Qualifications, experience and the skills that matter most, along with anything that would make you stand out.

Practical next steps, the documents to prepare and the dates to keep in mind before you apply or get in touch.

Contact details, links to the official source and the notes our team adds after checking each listing by hand.

Everything else on this page, kept up to date and available to every member of Chakrie at no cost at all.

Salary & benefits

A clear overview of what is expected, written by the people who posted it, with every detail you need to decide.

Qualifications, experience and the skills that matter most, along with anything that would make you stand out.

Practical next steps, the documents to prepare and the dates to keep in mind before you apply or get in touch.

Contact details, links to the official source and the notes our team adds after checking each listing by hand.

Members only · Free to join

Sign in to see the full job details

See every requirement, the benefits, exactly how to apply and who you would be working for.

Responsibilities
Skills & expertise
Salary & benefits
How to apply
Company information

Continue with Google

Create free account Sign in

Free forever No credit card 30-second sign-up

Model Serving Engineer

Summary

Requirements

Experience

Additional Requirements

Sign in to see the full job details

Report this Job / Company (রিপোর্ট)

Summary

Requirements

Experience

Additional Requirements

Sign in to see the full job details

Report this Job / Company (রিপোর্ট)

Similar jobs