(Senior) AI Software Engineer

Building the Future of Decentralized AI Development

At Prime Intellect, we're building the foundation for decentralized AI development at scale. Our platform combines powerful distributed training infrastructure with an intuitive developer experience, enabling researchers and engineers to train state-of-the-art models collaboratively.

We recently raised $15mm in funding (total of $20mm raised) led by Founders Fund, with participation from Menlo Ventures and prominent angels including Andrej Karpathy (Eureka AI, Tesla, OpenAI), Tri Dao (Chief Scientific Officer of Together AI), Dylan Patel (SemiAnalysis), Clem Delangue (Huggingface), Emad Mostaque (Stability AI) and many others.

Core Technical Responsibilities

This hybrid role spans across our AI platform software engineering and infrastructure. You'll be instrumental in:

Platform Development

• Build intuitive web interfaces for AI workload management and monitoring

• Develop REST APIs and backend services in Python

• Create real-time monitoring and debugging tools

• Implement user-facing features for resource management and job control
  

Infrastructure Development, Automation & Reliability

• Design and implement distributed training infrastructure in Rust

• Build high-performance networking and coordination components

• Create infrastructure automation pipelines with Ansible

• Manage cloud resources and container orchestration

• Implement scheduling systems for heterogeneous hardware (CPU, GPU, TPU)

Backend & Feature Development

• New Feature Engineering: Collaborate with the engineering team to design and implement backend features.

• API and Service Development: Enhance our platform’s REST APIs and backend services to support new capabilities and improve overall performance.

• System Integration: Ensure seamless integration of new features into our existing infrastructure, maintaining high reliability and security standards.

Development & Infrastructure Skills

• Backend Engineering: Proficiency in Python for developing automation scripts, REST APIs, and backend support tools.

• Container & Cloud Technologies: Hands-on experience with Kubernetes and cloud platforms (GCP preferred).

Technical Requirements

Platform Skills

- Strong Python backend development (FastAPI, async)

- Modern frontend development (TypeScript, React/Next.js, Tailwind)

- Experience building developer tools and dashboards

- RESTful API design and implementation

Infrastructure Skills

- Systems programming experience with Rust

- Infrastructure automation (Ansible, Terraform)

- Container orchestration (Kubernetes)

- Cloud platform expertise (GCP preferred)

- Observability tools (Prometheus, Grafana)

Nice to Have

- Experience with GPU computing and ML infrastructure

- Knowledge of AI/ML model architecture and training

- High-performance networking implementation

- Open-source infrastructure contributions

- WebSocket/real-time systems experience

Growth Opportunity

You'll join a team of experienced engineers and researchers working on cutting-edge problems in AI infrastructure. We believe in open development and encourage team members to contribute to the broader AI community through research and open-source contributions.

We value potential over perfection - if you're passionate about democratizing AI development and have experience in either platform or infrastructure development (ideally both), we want to talk to you.

Ready to help shape the future of AI? Apply now and join us in our mission to make powerful AI models accessible to everyone.