Are you passionate about building innovative technology that powers AI and machine learning across a global organization? As part of our team, you’ll help shape the future of model deployment at scale, collaborating with talented engineers and data scientists. You’ll have the opportunity to work on impactful projects, grow your skills, and contribute to a platform that drives real business outcomes. We value creativity, collaboration, and a commitment to excellence.

As a Software Engineer in the Firmwide AI/ML Deployment Platform team, you will design and develop cloud-native solutions that support model deployment across the organization. You will work closely with data scientists and engineers to deliver features that streamline production workflows. Your contributions will help scale our platform to meet the needs of diverse internal clients, ensuring reliability and innovation. You will be part of a collaborative environment focused on continuous improvement and technical excellence.

 

Job Responsibilities:

Build and deploy infrastructure solutions for seamless integration of control plane and client accountsDevelop and implement APIs for platform functionalities such as automated retraining, scheduling, endpoint deployments, and autoscalingDesign robust features to support a growing internal customer base, including multi-region and disaster recovery capabilitiesArchitect and implement model monitoring solutions, with emphasis on LLM monitoring and automated issue correctionEngage with clients to identify strategic solutions and provide deployment and debugging supportAssist in implementing platform capabilities aligned with product requirementsDeploy infrastructure and develop managed environments for platform operations

Required Qualifications, Capabilities, and Skills:

Knowledge of AWS services and cloud-based infrastructureExperience building resilient software platformsProficiency in architecting software solutions at scaleAbility to design solutions with strategic insightProficiency in Python

Preferred Qualifications, Capabilities, and Skills:

Familiarity with monitoring tools, especially for AI/ML model monitoringProficiency in GolangExperience with AWS Sagemaker for model training and deploymentFamiliarity with Kubernetes and managing deployments to EKSKnowledge of networking concepts such as Virtual Private Clouds and DNSExperience working with LLMsExperience with Terraform or other Infrastructure as Code toolsExperience in API development and design