Senior Software Engineer - Enterprise Platform

Bachelor's degree or higher in Computer Science or related field

5+ years of experience building distributed systems, cloud infrastructure, or Kubernetes-based solutions in production environments

Past experience working with enterprise security, compliance, and privacy requirements

Advanced understanding of distributed systems concepts, cloud architectures, and performance optimization

Demonstrated ability to independently manage technical projects, from planning and specification through implementation

Excellent collaboration and communication skills, with experience coordinating across functional teams and directly with customers

Preferred experience working with AI/ML systems or familiarity with MLOps practices

Competitive compensation package.

This is a unique opportunity to be part of a rapidly growing startup in one of the most exciting engineering fields of our era.

An inclusive and supportive work culture that fosters learning and growth.

Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.

Architect and develop infrastructure and platform features tailored for enterprise customers, including self-hosted clusters, single-tenant environments, and cross-cloud workload orchestration.

Lead technical initiatives to productize secure and scalable private connectivity solutions.

Design and implement solutions addressing the complex regulatory and compliance requirements of our customers, including data residency, auditability, and enterprise data protection.

Advance our self-hosted infrastructure offerings, focusing on capacity management, release management, and observability tooling.

Collaborate on partner-focused initiatives to deliver secure, minimal Baseten deployments within partner environments.

Evaluate and implement emerging virtualization technologies to enhance platform isolation and security.

Independently develop technical specifications, collaborate cross-functionally to define product requirements, and drive projects from conception through execution.

Provide mentorship and leadership on enterprise infrastructure best practices, fostering knowledge-sharing across engineering teams.

You'll get to work on these types of projects as part of our Infrastructure team:

Multi-cloud capacity management

Inference on B200 GPUs

Multi-node inference

Fractional H100 GPUs for efficient model serving