Qvest.US
Senior Engineer (Applied AI / ML)
- Location
- Austin, Texas, United States
- Work type
- Remote · Full-time
- Posted
- (2 years ago)
About the role
Who We Are
About the IDC
The Senior AI Engineer is a dual role combining technical leadership with hands-on AI engineering. Operating at the intersection of business strategy and technical execution, this role is responsible for interfacing directly with client business stakeholders to identify, evaluate, and prioritize high-value AI opportunities - and then leading the hands-on engineering to build and deploy those solutions.
In this role, you will engineer agentic systems - open-loop, conversational, tool-calling, and beyond, integrate AI and machine learning models with custom enterprise AI workflows, create rigorous evaluation frameworks, and deliver end-to-end, production-ready AI products. You will also support facilitation of discovery workshops, map operational pain points into structured AI specifications, and rapidly move from concept to working prototypes and production-grade software.
Rapid prototyping skills are essential, but we are not looking for someone who only knows how to vibe-code flashy demos. Successful candidates will keenly appreciate the difference between a proof of concept and a production system, know what level of engineering rigor each stage demands, and be capable of owning the full journey from prototype through production.
What you'll do
2. Architecture & Core AI Engineering
Agentic Systems & Harness Design: Design and build robust single- and multi-agent systems, including tool use, control loops, context and state management, planning, delegation, structured outputs, and failure recovery. Build the harnesses and runtime primitives that make agent behavior reliable, inspectable, and maintainable. Full-Stack Product Engineering: Work comfortably across the stack - from front-end experiences and backend services to APIs, data infrastructure, and cloud deployment - to get software shipped. You do not need to be a specialist at every layer, but you should bring strong software engineering fundamentals, learn quickly, and be willing to work wherever the product needs you most. Retrieval & Enterprise Integration: Build retrieval and grounding capabilities where appropriate-including semantic and hybrid search, reranking, metadata filtering, and RAG- - and integrate AI systems with enterprise APIs, data platforms, workflows, and user-facing applications. Machine Learning Foundations & Model Adaptation: Bring a strong grounding in machine learning fundamentals. While most initiatives begin with frontier or open-source pretrained models, understand when fine-tuning is warranted and how to apply techniques such as LoRA/PEFT, dataset preparation, training pipelines, and model evaluation.3. LLMOps, Governance & Production Hardening
AI Evaluation, Observability & Quality: Build rigorous evaluation and observability frameworks for probabilistic AI systems, combining offline benchmarks, task-specific metrics, LLM-as-judge, human evaluation, regression testing, and production telemetry. Measure quality, latency, cost, and failure modes, then use those signals to systematically improve models, prompts, tools, retrieval, and system architecture. Safety, Guardrails & Reliability: Design enterprise-grade protections including moderation, PII handling, prompt-injection defenses, permission-aware tool use, fallback logic, and graceful failure modes to keep AI systems safe, predictable, and resilient in production.What you'll bring
- Experience: 5+ years in software engineering or technical product engineering, with 1+ years dedicated to building and deploying Generative AI / LLM applications in production.
- Curiosity, Judgment & Consulting Poise: Bring intellectual curiosity, humility, and a commitment to first-principles thinking. We want people who actively shape solutions with the business, challenge assumptions constructively, and redesign the work when needed - while doing so with the empathy, communication skills, and stakeholder awareness expected of a trusted consultant.
- Product & Business-Facing Acumen: Demonstrated success in client-facing or internal product leadership roles (e.g., Forward-Deployed Engineer, AI Solutions Architect, Technical Product Manager). Proven ability to facilitate discovery workshops, extract requirements, and pitch technical solutions to executive audiences.
- Programming & API Architecture: Expert proficiency in Python and strong software engineering fundamentals, with experience designing modern stateless and stateful services for real-time, interactive, and batch workloads. Comfortable working across protocols and integration patterns such as REST, WebSockets, MCP, streaming APIs, and event-driven architectures.
- Spec-Driven & Agentic Engineering Tools: Hands-on experience utilizing spec-driven AI development tools and agentic IDEs (e.g., Cursor, Codex, OpenCode, etc) to write structured software specifications, orchestrate autonomous code generation, and execute end-to-end task flows.
- AI Orchestration & Harness Design: Understand modern agent frameworks and when to use - or avoid - them. Be comfortable building custom harnesses and control loops when greater flexibility, reliability, or control is needed.
- Retrieval Architecture & Agentic Search: Deep expertise designing and optimizing retrieval systems, including embedding search, hybrid retrieval, metadata filtering, reranking, and agentic search patterns. Know how to measure retrieval quality, diagnose failure modes, and systematically tune relevance, recall, precision, latency, and cost.
- Cloud & DevOps: Solid experience with cloud infrastructure (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and CI/CD automation.