AI / ML Architect/Developer/Tester ( 3 roles) – GenAI (LLM & RAG)
AI / ML Architect – GenAI (LLM & RAG)
Location: Philadelphia, PA (Hybrid – onsite PI meetings once a month / quarter)
Duration: 6+ Months Contract
AWS SageMaker, Bedrock, S3 · Python · LLMs · RAG · Vector DB (OpenSearch/DynamoDB)
Role Focus:
• Test LLM & RAG pipelines (prompt accuracy, grounding, hallucination checks)
• Validate ML models (data, features, inference, drift)
• Test AWS ML workflows (training, endpoints, pipelines)
• Ensure governance, auditability, and compliance readiness
Must-Have:
• 4+ yrs QA/testing (data, ML, or AI systems)
• Hands-on testing of LLM/GenAI applications
• Python for test automation & data validation
• Understanding of model behavior & evaluation metrics
Nice-to-Have:
• Regulated domains (Insurance / BFS)
Apply tot his job
Apply To this Job