SENIOR SOFTWARE ENGINEER, ARTIFICIAL INTELLIGENCE

Remote
Engineering
Remote
Full-time
About Fabric Health
At Fabric Health, we’re not just building technology; we’re fixing healthcare’s capacity problem. Our mission is to power healthcare to move faster, work smarter, and deliver better care, creating seamless, intuitive experiences that simplify and unify virtual and in-person care for thousands of providers and millions of patients nationwide. We’re a team of brilliant, thoughtful minds, deeply motivated by improving patient and provider lives, and we believe technology can truly enhance the US healthcare system.
Trusted by leading healthcare organizations: Our customers include Luminis Health, OSF HealthCare, MUSC Health, and Intermountain.
We are backed by leading investors such as Thrive Capital, GV (Google Ventures), General Catalyst, Salesforce Ventures, Vast Ventures, BoxGroup, and Atento Capital. We value working quickly for good reason, listening deeply to solve big challenges, and building products like we would for loved ones.
About the Role
We are looking for a Senior Engineer with AI expertise to lead the development of advanced language and voice technologies that transform how patients and providers interact. In this role, you will drive Fabric’s work in large language model (LLM) applications—such as retrieval-augmented generation (RAG), classification, and fine-tuning—as well as speech, natural language processing (NLP), and machine learning (ML). This is a hands-on, high-impact position at the intersection of innovation and production engineering. You will work cross-functionally to build intelligent, responsive dialogue systems and infrastructure for Fabric’s conversational AI experiences across voice and digital channels.
What You’ll Do

As a Senior Engineer, AI, you will be instrumental in bringing advanced AI concepts from prototype to production. Your primary responsibilities will include:

• Designing, building, and optimizing LLM applications (e.g., RAG, classification, summarization).
• Prototyping and productionizing ML and AI features in Python, integrating them with backend services.
• Partnering with product and medical teams to develop appropriate safeguards and business constraints for AI outputs.
• Collaborating with engineering to develop APIs for LLM applications used by other product components.
• Creating automated evaluations to measure the accuracy and performance of LLM-powered systems.
• Maintaining and improving existing NLP and AI diagnosis production components.
• Developing analytics to monitor system performance and prioritize improvements.
• Deploying AI services end-to-end in cloud-native environments using AWS and Kubernetes.
• Staying on the cutting edge by researching and testing new AI tools, APIs, and architectures.
• Contributing to our conversational AI strategy and helping shape the future of healthcare AI.

Why You Might Be a Good Fit

• You care deeply about the mission: You are passionate about deploying technology that empowers patients to engage with healthcare in their preferred language and format.
• You’re an autonomous problem solver: You excel at breaking down complex problems in the AI space and finding effective solutions, operating with autonomy and ownership.
• You’re a leader in your field: You stay current on machine learning, foundation models, and algorithms related to text and text-to-speech technologies.
• You value robust and responsible AI: You’re committed to building robust testing and monitoring pipelines that provide insight into real-time performance, and you are dedicated to developing safeguards for responsible AI use.
• You thrive on collaboration: You enjoy working cross-functionally across teams, integrating AI use cases into products by understanding their APIs and data systems.
• You’re a clear communicator: You’re skilled at communicating complex ideas clearly to both technical and non-technical audiences.

This Might Not Be The Right Fit If…

• You prefer a role that is focused purely on research rather than hands-on, production-level engineering and deployment.
• You are not comfortable with the ambiguity and fast-paced nature of developing cutting-edge AI systems from the ground up.
• You prefer to work in a silo rather than collaborating closely with product, medical, and other engineering teams.
• You are not passionate about the specific application of AI to solve real-world problems in the healthcare industry.

Your Qualifications

• A bachelor’s degree in a related field is preferred, but not required.
• 5+ years of experience in software engineering or applied machine learning, with a strong focus on building real-world AI/ML systems.
• Proficiency in backend development using Python (Flask or FastAPI), and 3+ years of hands-on experience with LLMs and LLM agents.
• Core Competencies:
• Solid understanding of embeddings and embedding databases.
• Experience in NLP or speech processing technologies.
• Familiarity with modern AI/ML frameworks and tools (e.g., Hugging Face, OpenAI API, LangChain, LangGraph).
• Experience building and deploying cloud-native applications on AWS with Kubernetes and container tools.
• Demonstrated ability to bring models from research to production, solving for latency, scale, and reliability.
• Effective communication skills and the ability to work across disciplines in a fast-paced, agile environment.

Bonus Points

• Experience with conversational agents, or real-time voice communication (e.g., WebRTC, telephony), ASR, TTS, or voice assistants.
• Prior work on multimodal AI interfaces or agent-based dialogue systems.
• Experience hosting, scaling, and fine-tuning open-source models.
• A passionate interest in improving healthcare access and outcomes through applied AI.

The national pay range for this role is $150,000.00 - $190,000.00 per year. Actual compensation will be determined by factors such as the candidate’s geographic market, experience, skills, and qualifications. Certain roles may also be eligible for additional compensation, including a comprehensive benefits package such as medical, dental, vision, unlimited PTO, and a 401(k) plan, stock options and bonuses. If your compensation requirement is greater than our posted range, please still consider applying; a determination can be made based on unique qualifications. Expected compensation ranges for this role may change over time.

Learn more about Fabric

• LinkedIn
• Awards
• Press Releases
• Careers Page

At Fabric, we believe that a diverse workforce is essential to our success. We are an equal opportunity employer and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, veteran status, or any other legally protected characteristic. We actively encourage individuals from all backgrounds to apply.

LI-Remote

Ready to apply?
Powered by
First name *
Last name *
Email *
LinkedIn URL *
Phone number *
Location *
Resume *
Click to upload or drag and drop here
Cover letter
Click to upload or drag and drop here
How did you hear about this job? *
Select an option
If you selected ’Other,’ please specify where you heard about us. If you selected ‘Employee Referral,’ please provide the referring person’s full name.
Are you authorized to work in The United States for any employer? *
Yes
No
Do you now or will you in the future require employer-sponsored visa authorization to work in the United States (e.g., H-1B, TN, etc., including after the expiration of a student visa’s work authorization)? *
Yes
No
Which state are you currently based in? *
Select an option
What is your base salary expectations? *
Based on your research, what is one specific thing you’ve learned about Fabric Health’s mission or products that caught your interest? *
What aspects of this position’s responsibilities and day-to-day work do you find most compelling? *
Describe your approach to team leadership and your involvement in driving strategic initiatives. *
Voluntary Self-Identification
To comply with government reporting requirements, we invite candidates to participate in the self-identification survey below. Your completion of this form is entirely optional, and your decision will neither influence the hiring process nor any subsequent stages. Any information you choose to share will be kept confidential and stored in a secure file. As outlined in our Equal Employment Opportunity policy, we uphold a commitment to non-discrimination based on any protected group status specified in applicable laws.
Gender
Please select
Race
Please select
Race and ethnicity descriptions
Expand
Voluntary Self-Identification of Veteran Status
VEVRAA requires Government contractors to take affirmative action to employ and advance in employment protected veterans. To help us measure the effectiveness of our outreach and recruitment efforts of veterans, we are asking you to tell us if you are a veteran covered by VEVRAA. If you believe that you belong to any of the following categories of protected veterans, please indicate by making the appropriate selection.
Veteran status descriptions
Collapse
Disabled veteran
A veteran who served on active duty in the U.S. military and is entitled to disability compensation (or who but for the receipt of military retired pay would be entitled to disability compensation) under laws administered by the Secretary of Veterans Affairs, or was discharged or released from active duty because of a service-connected disability
Recently separated veteran
A veteran separated during the three-year period beginning on the date of the veteran’s discharge or release from active duty in the U.S military, ground, naval, or air service
Active duty wartime or campaign badge veteran
A veteran who served on active duty in the U.S. military during a war, or in a campaign or expedition for which a campaign badge was authorized under the laws administered by the Department of Defense
Armed Forces service medal veteran
A veteran who, while serving on active duty in the U.S. military ground, naval, or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985 (61 Fed. Reg. 1209).
Veteran status
Please select
PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.
By applying you agree to Gem’s terms and privacy policy.
Save your info to apply to other roles faster & help employers reach you.
Apply and save
Apply without saving
Req ID: 21

• Designing, building, and optimizing LLM applications (e.g., RAG, classification, summarization).
• Prototyping and productionizing ML and AI features in Python, integrating them with backend services.
• Partnering with product and medical teams to develop appropriate safeguards and business constraints for AI outputs.
• Collaborating with engineering to develop APIs for LLM applications used by other product components.
• Creating automated evaluations to measure the accuracy and performance of LLM-powered systems.
• Maintaining and improving existing NLP and AI diagnosis production components.
• Developing analytics to monitor system performance and prioritize improvements.
• Deploying AI services end-to-end in cloud-native environments using AWS and Kubernetes.
• Staying on the cutting edge by researching and testing new AI tools, APIs, and architectures.
• Contributing to our conversational AI strategy and helping shape the future of healthcare AI