Back to Jobs

AI Prompt & Product Engineer

Remote, USA Full-time Posted 2025-11-24
About the Role We’re hiring an AI Prompt & Product Engineer to help turn cutting-edge AI into real impact in healthcare. You’ll be responsible for shaping how our platform thinks, speaks, and solves problems — from designing prompts and fine-tuning models to scoping MVPs and testing new AI workflows. In an early-stage startup, no two days look the same. Some days you’ll be experimenting with multi-agent setups or refining intake flows; others you’ll be pressure-testing our platform, breaking it on purpose, and helping translate ambitious client ideas into something we can ship in weeks, not months. If you enjoy blending engineering, product, and experimentation — this role is for you. What You’ll Do Prompt Design & Model Development • Craft and refine prompts that support healthcare tasks like scheduling, eligibility checks, patient education, and intake. • Contribute to fine-tuning by preparing datasets, running training jobs, and evaluating results. • Explore new model behaviors and compare approaches across LLMs. • Build internal tools and scripts to test and benchmark prompts at scale. Product Discovery & Workflow Design • Translate broad client requests into focused, testable solutions. • Work with clinicians and staff to uncover bottlenecks and identify the core workflows worth automating. • Break down complex problems into phased rollouts that let us learn quickly while reducing risk. • Prototype new use cases and validate them with real users. Testing & Quality Assurance • Be the first user and toughest critic of our AI platform. • Design testing scenarios that catch edge cases and failure modes early. • Define metrics to measure conversation quality, accuracy, and user trust. • Stress-test new features, models, and integrations before release. Engineering & Technical Leadership • Contribute directly to product code with Python/JavaScript for automation, integrations, and evaluation pipelines. • Partner with engineers on architecture and deployment decisions. • Identify opportunities to apply emerging AI techniques (RAG, multi-agent orchestration, lightweight fine-tuning). • Explain technical trade-offs clearly to both internal and external stakeholders. What You Bring Core Experience • 2+ years in AI/ML engineering, product engineering, or similar roles (startup or fast-paced environments a plus). • Hands-on experience with LLMs, prompt engineering, and evaluation. • Proficiency in Python and/or JavaScript/TypeScript. • A track record of turning complex requirements into shipped products. • Comfort with hypothesis-driven development and rapid iteration. Technical Background • Knowledge of AI frameworks, APIs, and fine-tuning techniques. • Understanding of conversational AI design and multi-agent systems. • Familiarity with A/B testing and metrics-driven decision-making. • Ability to collaborate closely with engineers on system design and implementation. Nice to Have • Background in healthcare technology or regulated environments. • Familiarity with standards like HL7/FHIR or insurance workflows. • Awareness of compliance requirements (HIPAA, SOC 2). • Interest in AI safety, reliability, and alignment. Who You Are • You thrive in ambiguity and enjoy experimenting your way to clarity. • You want to see AI solve real, human problems in healthcare, not just toy use cases. • You’re comfortable moving between roles — one day coding, the next mapping out workflows with clinicians. • You believe speed, learning, and responsibility go hand in hand. About the Role We’re looking for a Prompt Engineer to join our early-stage healthcare AI startup. In this role, you’ll design, test, and optimize prompts and workflows that power real-world use cases such as patient scheduling, insurance eligibility and prior auth, medical history collection, and patient education. You’ll also contribute to model fine-tuning and evaluation to ensure outputs meet the accuracy, compliance, and usability standards needed in healthcare. Expect to wear many hats — from prototyping prompts to coding integrations — as we rapidly iterate and scale. Key Responsibilities • Design, refine, and test prompts to enable accurate and reliable outputs for healthcare scheduling, insurance workflows, patient intake, and education. • Build and maintain reusable prompt libraries and evaluation frameworks to improve performance and reproducibility. • Contribute to fine-tuning models (collecting and curating datasets, running training jobs, evaluating outputs) to improve domain-specific accuracy. • Write code to automate testing, integrate AI workflows into APIs and applications, and monitor performance in production. • Collaborate directly with clinicians and operations teams to understand real-world pain points and rapidly prototype solutions. • Establish quality guardrails to ensure safety, compliance, and trust in patient-facing outputs. • Contribute to broader product development beyond prompts—helping with data pipelines, integrations, and deployment. Required Qualifications • Bachelor’s degree in Computer Science, Data Science, or related field (or equivalent startup experience). • Proficiency in Python and/or JavaScript/TypeScript for scripting, automation, and API integration. • Hands-on experience with large language models (OpenAI, Anthropic, etc.) and prompt design. • Familiarity with fine-tuning workflows (data preprocessing, evaluation metrics, supervised/LoRA training, or similar). • Strong problem-solving skills and creativity in working with language and workflows. • Excellent communication skills to translate between technical, clinical, and operational needs. • Comfort operating in a fast-paced startup environment with limited structure. Preferred Qualifications • Experience with healthcare data standards and workflows (EHR, HL7/FHIR, insurance claims). • Knowledge of cloud platforms (AWS, GCP, Azure) and deployment best practices. • Familiarity with compliance frameworks (HIPAA, SOC 2). • Experience working cross-functionally in small teams where responsibilities overlap. What We’re Looking For • Entrepreneurial mindset — resourceful, adaptable, and eager to experiment. • Excitement about applying AI to reduce friction in healthcare access and operations. • Willingness to roll up your sleeves and contribute wherever needed — from prompt design to coding to dataset prep for fine-tuning. Apply tot his job Apply To this Job

Similar Jobs

Asset Management Program Manager- Remote

Remote, USA Full-time

Content Moderator ? Yelp, Yelp Removing Spam Comments ? The EliteJob

Remote, USA Full-time

LPN Bilingual Spanish - Telephonic Care Coordinator - Evernorth

Remote, USA Full-time

**Experienced Part-Time Remote Online Chat Representative for Moms – Flexible Work-From-Home Opportunity**

Remote, USA Full-time

Remote Tax Preparer (All States) – Training and Software Provided at No Additional Cost

Remote, USA Full-time

Aetna Remote Jobs-

Remote, USA Full-time

Experienced Full-Time Data Entry Clerk for Finance Department – Monday to Friday Schedule with Competitive Pay and Excellent Benefits at blithequark

Remote, USA Full-time

Manager, Accountant Channel Sales (Central)

Remote, USA Full-time

**Experienced Home-Based Data Entry Specialist – Weekly Pay Option with Flexible Research Opportunities**

Remote, USA Full-time

Experienced Remote Data Entry and Market Research Participant – Flexible Work from Home Opportunities with blithequark

Remote, USA Full-time

Email Designer for a DTC E-Commerce Brand /US-based/Remote/

Remote, USA Full-time

Experienced Remote Customer Support Representative – Delivering Exceptional Service and Building Lasting Customer Relationships with blithequark

Remote, USA Full-time

Walmart Part-Time (Customer Service Remote) Jobs - Hiring Now

Remote, USA Full-time

Senior Manager, Supply Chain Management - Remote

Remote, USA Full-time

Sitefinity Developer

Remote, USA Full-time

Hiring Customer Success Specialists – Night shift only

Remote, USA Full-time

Online Amazon jobs work from home no experience

Remote, USA Full-time

Experienced Customer Service and Sales Specialist for arenaflex - Delivering Exceptional Customer Experiences and Driving Business Growth through Innovative Solutions and Technical Expertise

Remote, USA Full-time

Join Today: Part-Time Project Coordinator

Remote, USA Full-time

Sr Mgr Product Amazon Now Minute Delivery (Remote)

Remote, USA Full-time