Sr. Software Engineer (AI Systems & Infrastructure) at Bitwise
Columbia, Maryland, USA -
Full Time


Start Date

Immediate

Expiry Date

19 Oct, 25

Salary

290000.0

Posted On

20 Jul, 25

Experience

12 year(s) or above

Remote Job

Yes

Telecommute

Yes

Sponsor Visa

No

Skills

Apache Kafka, Complex Systems, Distributed Systems, Java, A/B Testing, Microservices, Polygraph, User Experience, Ansible, Languages, Docker, Code, Communication Skills, Security, Python, It, Onboarding, Data Processing, Collaborative Environment, Craft

Industry

Information Technology/IT

Description

HEY!

Bitwise is a leading provider of mission-focused intelligence solutions that advance national security for the Intelligence Community and Department of Defense. We’re a small and growing company, so you can expect to hop in on the ground floor with us and be a consequential member of the team. You’ll be more than a contract performer for us – you’ll also be asked for ideas to improve our company and improve your career, and you’ll contribute to our team culture. We value growth and community above almost all else, so we gather regularly for game nights, happy hours, tech talks, and plenty more. We think you’ll like it here!
Remember, Bitwise is not a cult.

Requirements

  • Active TS/SCI with Polygraph. Candidates without a current clearance will not be considered.
  • 12+ years of experience in software engineering with focus on scalable systems.
  • Strong full-stack development experience with user-facing applications.
  • Strong programming skills in languages such as Python, Go, or Java.
  • Extensive experience with cloud platforms (e.g., AWS, GCP, Azure) and their services.
  • Proficiency in containerization technologies (Docker, Kubernetes).
  • Experience with infrastructure-as-code tools (e.g., Terraform, Ansible, Puppet).
  • Expertise in monitoring and observability tools (e.g., Prometheus, Grafana, ELK stack).
  • Familiarity with CI/CD pipelines and practices.
  • Strong problem-solving skills and ability to troubleshoot complex systems.
  • Excellent communication skills and ability to work in a collaborative environment.
  • Experience building products that prioritize user experience and product-market fit.
  • Twelve (12) years of experience with a Bachelor’s degree in a technical discipline or 4 additional years may substitute for a degree.
  • Don’t quite meet these requirements? Peep our other prime position

Preferred Skills and Experience

  • Experience working with Large Language Models (LLMs) and related infrastructure.
  • Experience with AI/ML model serving and optimization.
  • Background in product-focused engineering environments.
  • Familiarity with machine learning operations (MLOps) practices.
  • Experience with A/B testing and feature flagging for AI features.
  • Contributions to open-source projects.
  • Experience with distributed systems and microservices architectures.
  • Knowledge of security best practices and compliance requirements.
  • Experience with real-time data processing and streaming platforms (e.g., Apache Kafka, Apache Flink).
  • Familiarity with chaos engineering principles and tools
Responsibilities

We are seeking a highly experienced and driven Sr. Software Engineer to join our full stack LLM integration and delivery team. The ideal candidate will have a strong background in building scalable AI-powered applications and the infrastructure that supports them, with a focus on delivering exceptional user experiences. You will play a crucial role in architecting and developing the systems that power our cutting-edge LLM applications, ensuring they perform reliably at enterprise scale while enabling rapid iteration and deployment.

Responsibilities will include:

  • Lead the design and development of scalable LLM-powered applications and services.
  • Architect infrastructure solutions that support rapid iteration and deployment of AI features.
  • Collaborate directly with product teams to translate user needs into technical solutions.
  • Build and maintain the platforms that enable your team to ship AI features quickly and reliably.
  • Develop and manage automation tools to improve system reliability and development efficiency.
  • Implement and maintain monitoring, alerting, and logging systems.
  • Conduct capacity planning and performance tuning for AI workloads.
  • Lead and participate in incident response and post-mortem analyses.
  • Mentor junior team members and contribute to the overall growth of the engineering team.
  • Continuously identify and implement improvements to our systems and development processes.

    Requirements

  • Active TS/SCI with Polygraph. Candidates without a current clearance will not be considered.

  • 12+ years of experience in software engineering with focus on scalable systems.
  • Strong full-stack development experience with user-facing applications.
  • Strong programming skills in languages such as Python, Go, or Java.
  • Extensive experience with cloud platforms (e.g., AWS, GCP, Azure) and their services.
  • Proficiency in containerization technologies (Docker, Kubernetes).
  • Experience with infrastructure-as-code tools (e.g., Terraform, Ansible, Puppet).
  • Expertise in monitoring and observability tools (e.g., Prometheus, Grafana, ELK stack).
  • Familiarity with CI/CD pipelines and practices.
  • Strong problem-solving skills and ability to troubleshoot complex systems.
  • Excellent communication skills and ability to work in a collaborative environment.
  • Experience building products that prioritize user experience and product-market fit.
  • Twelve (12) years of experience with a Bachelor’s degree in a technical discipline or 4 additional years may substitute for a degree.
  • Don’t quite meet these requirements? Peep our other prime positions

    Preferred Skills and Experience

  • Experience working with Large Language Models (LLMs) and related infrastructure.

  • Experience with AI/ML model serving and optimization.
  • Background in product-focused engineering environments.
  • Familiarity with machine learning operations (MLOps) practices.
  • Experience with A/B testing and feature flagging for AI features.
  • Contributions to open-source projects.
  • Experience with distributed systems and microservices architectures.
  • Knowledge of security best practices and compliance requirements.
  • Experience with real-time data processing and streaming platforms (e.g., Apache Kafka, Apache Flink).
  • Familiarity with chaos engineering principles and tools.

️ Benefits at Bitwise

  • Top salaries because we’re top performers
  • Pick your PTO – Everyone values time and money differently, so we give you the flexibility to choose between 3 and 5 weeks of PTO with a corresponding adjustment to your pay. Your choice, your balance.
  • All 11 federal holidays, paid!
  • Up to 2 snow days, paid!We’ll quadruple (4x!) the first 6% you contribute to your 401(k), giving you up to a 24% company match. Contributing less than 6%? Unclaimed matches come right back to you as extra income, giving you a guaranteed 24% that goes to your retirement, to your paycheck, or both. C’mon now!
  • 100% employer-paid medical, dental, vision, life, and disability insurances. That’s a lot. Already covered on health insurance? No problem – we’ll trade you this benefit for a boost to your salary instead.
  • $5,250 annual education assistance for training, certifications, tuition, and even student loan repayments.Spot bonuses for obtained certifications, customer recognition, and just about anything else that makes us go “Hot damn!”. We hope to say that many times about you.
Loading...