Senior Software Engineer, Infrastructure Job at CentML, San Francisco, CA

Vmp2SWVYOHBXR0ZQWm9OVFVhaDNKMXI2N1E9PQ==
  • CentML
  • San Francisco, CA

Job Description

Senior Software Engineer, Infrastructure Join to apply for the Senior Software Engineer, Infrastructure role at CentML Senior Software Engineer, Infrastructure Join to apply for the Senior Software Engineer, Infrastructure role at CentML We are a small team with a big ambition of making modern machine learning accessible for everyone. At CentML, our mission is to enable anyone with an idea to deploy ML models without breaking the bank. We believe that modern AI will fundamentally transform how people work and live and we're here to help bring that future sooner. Our founding team is made up of experts in AI, compilers and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems with a publication history of top papers and multiple academic and industry research awards from Google, Amazon, and Facebook. Position Overview: We are seeking a highly motivated and skilled senior infrastructure engineer to join our team in a key role focused on designing, developing, and maintaining the CentML platform that offers a cost effective infrastructure for serving and training large scale machine learning models. As an infrastructure engineer, you will be responsible for laying out the design of a deployment infrastructure for ML training and inference jobs over GPU clusters that spans across multiple cloud service providers like AWS, GCP, Azure, Coreweave, and OCI. You should also be responsible for leading a team of engineers and building a scalable, performant, and reliable platform, enabling our customers to seamlessly access and utilize a comprehensive suite of ML services that we offer. Responsibilities: Design and lead the development of the deployment infrastructure of the CentML platform. The deployment infrastructure manages the hardware resources necessary to deploy the ML training and inference applications. Implementing GPU cluster scheduling solutions for large scale ML training and inference workloads to efficiently utilize the hardware resources in the GPU cluster. Communicate with our product teams and define new features and goals for improving the CentML platform. Qualifications: 4+ years of experience working with containerized deployment systems (e.g, kubernetes, openshift, terraform etc.). A big plus if you have contributed to kubernetes and have expertise in container runtime technologies like docker engine, containerd, or CRI-O Experience with deploying and managing cloud infrastructure on AWS, GCP, Azure Past experience in building GPU clusters for large scale ML training and inference is desirable. Knowledge in GPU architecture and Nvidia GPU virtualization technologies is highly desirable. Strong coding skills in languages like Python, Java, Go, and/or C/C++. An open and inclusive culture and work environment Twice a week free-lunch Full health and dental benefits Parental Leave top-up for 6 months Continuous education budget Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just ask

  • An open and inclusive work environment
  • Employee stock options
  • Best-in-class medical and dental benefits
  • Parental Leave top-up for 6 months
  • Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation. CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees. Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team. Seniority level Seniority level Mid-Senior level Employment type Employment type Full-time Job function Job function Information Technology Industries Software Development Referrals increase your chances of interviewing at CentML by 2x Get notified about new Software Engineer jobs in San Francisco Bay Area . Software Engineer, Early Career 2025 Start Software Engineer, AI Platform - New Grad San Francisco, CA $130,000.00-$238,000.00 4 days ago Software Engineer, AI Intern (Summer 2025) Software Engineer Frontend (Multiple Levels) - Slack Software Engineer I (Full Time) United States San Jose, CA $98,600.00-$125,900.00 2 weeks ago San Francisco, CA $130,000.00-$190,000.00 4 days ago San Francisco, CA $170,000.00-$270,000.00 2 weeks ago San Francisco, CA $170,000.00-$250,000.00 2 weeks ago Software Engineer, Frontend (All Levels) San Francisco, CA $150,000.00-$220,000.00 1 day ago San Francisco, CA $112,000.00-$160,000.00 10 hours ago San Francisco, CA $56.25-$173,000.00 5 days ago San Francisco, CA $99,500.00-$200,000.00 8 hours ago (General Hire) Software Engineer Graduate (Advertisement Team) - 2025 Start (BS/MS) San Jose, CA $113,500.00-$250,000.00 1 day ago Software Engineer I (Intern) United States San Jose, CA $44,000.00-$130,000.00 1 week ago San Francisco, CA $170,000.00-$270,000.00 2 weeks ago Full Stack Software Engineer - Post-training Palo Alto, CA $180,000.00-$440,000.00 2 weeks ago New Grads 2025 - Software Engineer, Algorithm San Jose, CA $120,000.00-$165,000.00 8 months ago Full Stack Software Engineer (L4), Product Localization Engineering Software Engineer 4 - TV & Web Player Platform We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr CentML

Job Tags

Full time, Summer work, Internship, Flexible hours,

Similar Jobs

GES Logistics

Licensed Customs Broker Job at GES Logistics

 ...procedures and serves as the central figure in the minimization of risk to the Company. Ensures the brokerage team is compliant with Customs and the Company policies. Monitors customs regulations, reviews Federal Register for changes, adjusts procedures and advises... 

Humana

Counsel, Humana Specialty - Dental, Vision, Life and Disability Insurance Products Job at Humana

 ...complex issues where the analysis of situations or data requires an in-depth evaluation of variable factors.Background - Specialty: Humana Specialty offers Dental, Vision, Life and Disability Insurance Products to both employer groups and individual members, including... 

Securitas Security Services USA, Inc.

Armed Security Supervisor - CA DL Required Job at Securitas Security Services USA, Inc.

**Armed Security Supervisor**We help make your world a safer place.Securitas is a global company that offers the most advanced and sustainable security solutions in the industry. We are located in 47 countries and have 355,000 employees worldwide and over 150,000 clients... 

HCLTech

Senior Service Delivery Manager Job at HCLTech

 ...Resource with 14-16 years of experience Require a diverse range of skills to effectively manage the delivery of IT services. Service Management: They should have a deep understanding of service management principles, frameworks (such as ITIL), and best practices... 

Coeur d'Alene Resort

Graveyard Janitorial - CdA Resort Job at Coeur d'Alene Resort

We're looking for a reliable, detail-oriented team member to join our overnight janitorial crew. This role helps keep the Resort clean, safe, and ready for a new day while most of the world is asleep. Job Basics: Location: Coeur d'Alene, Idaho Schedule: Full-...