Software Engineer, Tools and Infrastructure
CentML
Software Engineering, Other Engineering
Toronto, ON, Canada
Posted on Nov 6, 2024
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
About the Position
As a Software Engineer, Tools and Infrastructure, you will play a pivotal role in shaping the infrastructure and development practices at CentML. You will be responsible for working on complex projects and collaborating with cross-functional teams to ensure our systems meet the highest standards of reliability performance, and security. We’re looking for a Software Engineer, Tools, and Infrastructure, with a strategic focus on performance optimization and testing.
What you'll do
- Build distributed machine learning systems that deliver state-of-the-art performance, high availability and robust fault tolerance.
- Develop tools, infrastructure, automation, and configuration management to set up and execute performance tests, to record the testing results, and to perform and visualize analyses on the results.
- Automate and optimize the functionality and performance testing workflows, improve the performance and scalability of those workflows, and identify and address bottlenecks before they impact our engineers.
- Design and set up CI/CD pipelines for continuous code testing, integration and development.
- Participate in incident response efforts, including real-time troubleshooting, root cause analysis, and postmortem reviews.
- Develop and maintain comprehensive monitoring, alerting, and logging systems that provide deep visibility into system health and performance.
- Drive continuous improvement in system reliability, performance, and scalability through the adoption of new technologies, tools, and methodologies.
- Stay current with industry trends and innovations in DevOps, software tools, and ML infrastructure, bringing new ideas and approaches to the team.
What you’ll need to be successful
- 3+ years of experience in tool/infrastructure engineering, , DevOps, or related roles with extensive experience in performance testing and managing large-scale infrastructure.
- Proven track record of building and operating highly reliable, scalable, and secure systems in a production environment.
- Deep expertise in CI workflows (e.g., GitHub Actions), cloud platforms (e.g., AWS, GCP, Azure), containerization (e.g., Docker, Kubernetes), and infrastructure-as-code (e.g., Pulumi).
- Advanced proficiency in scripting and automation using languages such as Python, Bash, or similar.
- Strong understanding of distributed systems, networking, and storage solutions, with the ability to architect complex systems from the ground up.
- Past experience working with ML frameworks (e.g., PyTorch), ML compilers (e.g., the Triton compiler), inference engine (e.g., vLLM), GPU programming (e.g., CUDA), as well as past working knowledge of ML/Deep Learning/Large Language Model algorithms and theories, are nice to have.
- Excellent problem-solving skills, with a proactive approach to identifying and resolving issues before they impact the business.
- Strong communication and collaboration skills, with the ability to work effectively across different teams and stakeholders.
- Ability to operate effectively in a fast-paced, dynamic startup environment, with a focus on delivering results.
Benefits & Perks
- An open and inclusive work environment
- Employee stock options
- Best-in-class medical and dental benefits
- Parental Leave top-up for 6 months
- Professional development budget
- Flexible vacation time to promote a healthy work-life blend
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, disability, and any other protected ground of discrimination under applicable human rights legislation.
CentML strives to respect the dignity and independence of people with disabilities and is committed to giving them the same opportunity to succeed as all other employees.
Inclusiveness is core to our culture at CentML, and we strive to ensure you get the most from your interview experience. CentML makes reasonable accommodations for applicants with disabilities. If a reasonable accommodation is needed to participate in the job application or interview process, please reach out to the Talent team.