This job offer is no longer available
About
Astir IT Solutions . We are currently working with our client on a senior-level opportunity for
Agentic AI QA Engineer at Dallas, TX (Need Locals)! Based on your background, I believe this role could be a strong fit. Job Title: Agentic AI QA Engineer Location: Dallas, TX (Need Locals) Experience: 7+ years Position type: Contract W2/C2C
Required Qualifications 7+ years in Software QA/Testing, with 2+ years in AI/ML or LLM-based systems; hands-on experience testing agentic/multi-agent architectures. Strong programming skills in Python or TypeScript/JavaScript; experience building test harnesses, simulators, and fixtures. Experience with LLM evaluation (exact/soft match, BLEU/ROUGE, BERTScore, semantic similarity via embeddings), guardrails, and prompt testing. Expertise in distributed systems testing latency profiling, resiliency patterns (circuit breakers, retries), chaos engineering, and message queues. Familiarity with orchestration frameworks (LangChain, LangGraph, LlamaIndex, DSPy, OpenAI Assistants/Actions, Azure OpenAI orchestration, or similar). Proficiency with CI/CD (GitHub Actions/Azure DevOps), observability (OpenTelemetry, Prometheus/Grafana, Datadog), and feature flags/canaries. Solid understanding of privacy/security/compliance in AI systems (PII handling, content policies, model safety). Excellent communication and leadership skills; proven ability to work cross-functionally with Ops, Data, and Engineering. Preferred Qualifications Experience with multi-agent simulators, agent graph testing, and tooling latency emulation. Knowledge of MLOps (model versioning, datasets, evaluation pipelines) and A/B experimentation for LLMs. Background in cloud (AWS), serverless, containerization, and event-driven architectures. Prior ownership of cost/latency/SLAs for AI workloads in production If you are currently open to new opportunities, I would appreciate the chance to connect and discuss this role in more detail. Please let me know a convenient time for a quick call, or feel free to share your updated resume. Looking forward to hearing from you. Thanks & Regards. Sai Sr. Account Manager Astir IT Solutions, Inc. Email ID: sair@ , Contact: 732-694-6000 * 795
Languages
- English
Notice for Users
This job was posted by one of our partners. You can view the original job source here.