About
Astir IT Solutions . We are currently working with our client on a senior-level opportunity for
Agentic AI QA Engineer at Dallas, TX (Need Locals)! Based on your background, I believe this role could be a strong fit. Job Title: Agentic AI QA Engineer Location: Dallas, TX (Need Locals) Experience: 7+ years Position type: Contract W2/C2C
Required Qualifications • 7+ years in Software QA/Testing, with 2+ years in AI/ML or LLM-based systems; hands-on experience testing agentic/multi-agent architectures. • Strong programming skills in Python or TypeScript/JavaScript; experience building test harnesses, simulators, and fixtures. • Experience with LLM evaluation (exact/soft match, BLEU/ROUGE, BERTScore, semantic similarity via embeddings), guardrails, and prompt testing. • Expertise in distributed systems testing latency profiling, resiliency patterns (circuit breakers, retries), chaos engineering, and message queues. • Familiarity with orchestration frameworks (LangChain, LangGraph, LlamaIndex, DSPy, OpenAI Assistants/Actions, Azure OpenAI orchestration, or similar). • Proficiency with CI/CD (GitHub Actions/Azure DevOps), observability (OpenTelemetry, Prometheus/Grafana, Datadog), and feature flags/canaries. • Solid understanding of privacy/security/compliance in AI systems (PII handling, content policies, model safety). • Excellent communication and leadership skills; proven ability to work cross-functionally with Ops, Data, and Engineering. Preferred Qualifications • Experience with multi-agent simulators, agent graph testing, and tooling latency emulation. • Knowledge of MLOps (model versioning, datasets, evaluation pipelines) and A/B experimentation for LLMs. • Background in cloud (AWS), serverless, containerization, and event-driven architectures. Prior ownership of cost/latency/SLAs for AI workloads in production If you are currently open to new opportunities, I would appreciate the chance to connect and discuss this role in more detail. Please let me know a convenient time for a quick call, or feel free to share your updated resume. Looking forward to hearing from you. Thanks & Regards. Sai Sr. Account Manager Astir IT Solutions, Inc. www.astirit.com Email ID: sair@astirit.com , Contact: 732-694-6000 * 795
Languages
- English
Notice for Users
This job comes from a TieTalent partner platform. Click "Apply Now" to submit your application directly on their site.