Qvest.US
Staff Engineer (Applied AI / ML)
- Location
- Austin, Texas, United States
- Work type
- Remote · Full-time
- Salary
- USD 80,000 – 400,000 / year
- Posted
- (2 years ago)
About the role
Who We Are
About the IDC
The Staff AI Engineer is a dual role combining technical leadership with hands-on AI engineering. Operating at the intersection of business strategy and technical execution, this role is responsible for interfacing directly with client business stakeholders to identify, evaluate, and prioritize high-value AI opportunities - and then leading the hands-on engineering to build and deploy those solutions.
In this role, you will engineer agentic systems - open-loop, conversational, tool-calling, and beyond, integrate AI and machine learning models with custom enterprise AI workflows, create rigorous evaluation frameworks, and deliver end-to-end, production-ready AI products. You will also support facilitation of discovery workshops, map operational pain points into structured AI specifications, and rapidly move from concept to working prototypes and production-grade software.
Rapid prototyping skills are essential, but we are not looking for someone who only knows how to vibe-code flashy demos. Successful candidates will keenly appreciate the difference between a proof of concept and a production system, know what level of engineering rigor each stage demands, and be capable of owning the full journey from prototype through production.
What you'll do
1. AI Discovery & Technical Product Leadership
Stakeholder Ideation: Support client discovery workshops, whiteboarding sessions, and interviews with client business and product owners to identify operational bottlenecks suitable for AI intervention. Successful candidates will be comfortable engaging directly and frequently with the client, demoing work early and often, gathering feedback, and closing tight iterative loops throughout the development process. Use Case Prioritization & ROI Analysis: Evaluate potential AI use cases across business impact, technical viability, data readiness, and ROI to build prioritized product roadmaps and PoC scopes. Recommend pragmatic alternatives when the requested approach is unlikely to be the simplest, highest-value, or most effective solution. Requirements to Spec Translation: Bridge the gap between vague business asks and clear technical architecture, translating functional requirements into PRDs, technical specifications, and verifiable prompt/eval criteria. Constructively challenge proposed solutions when appropriate and recommend simpler or more effective technical approaches. Rapid Prototyping (0-to-1): Rapidly build and demonstrate working proof-of-concept (PoC) apps and interactive demos (within 2–3 week cycles) to validate value with local executive stakeholders before full investment. Prototype-to-Production Hardening (1-to-N): Evolve successful prototypes into reliable, secure, maintainable production systems by strengthening architecture, testing, observability, scalability, evaluation, and operational readiness while preserving delivery velocity.3. LLMOps, Governance & Production Hardening
AI Evaluation, Observability & Quality: Build rigorous evaluation and observability frameworks for probabilistic AI systems, combining offline benchmarks, task-specific metrics, LLM-as-judge, human evaluation, regression testing, and production telemetry. Measure quality, latency, cost, and failure modes, then use those signals to systematically improve models, prompts, tools, retrieval, and system architecture. Safety, Guardrails & Reliability: Design enterprise-grade protections including moderation, PII handling, prompt-injection defenses, permission-aware tool use, fallback logic, and graceful failure modes to keep AI systems safe, predictable, and resilient in production.What you'll bring
- Experience: 7+ years in software engineering or technical product engineering, with 1+ years dedicated to building and deploying Generative AI / LLM applications in production.
- Curiosity, Judgment & Consulting Poise: Bring intellectual curiosity, humility, and a commitment to first-principles thinking. We want people who actively shape solutions with the business, challenge assumptions constructively, and redesign the work when needed - while doing so with the empathy, communication skills, and stakeholder awareness expected of a trusted consultant.
- Product & Business-Facing Acumen: Demonstrated success in client-facing or internal product leadership roles (e.g., Forward-Deployed Engineer, AI Solutions Architect, Technical Product Manager). Proven ability to facilitate discovery workshops, extract requirements, and pitch technical solutions to executive audiences.
- Programming & API Architecture: Expert proficiency in Python and strong software engineering fundamentals, with experience designing modern stateless and stateful services for real-time, interactive, and batch workloads. Comfortable working across protocols and integration patterns such as REST, WebSockets, MCP, streaming APIs, and event-driven architectures.
- Spec-Driven & Agentic Engineering Tools: Hands-on experience utilizing spec-driven AI development tools and agentic IDEs (e.g., Cursor, Codex, OpenCode, etc) to write structured software specifications, orchestrate autonomous code generation, and execute end-to-end task flows.
- AI Orchestration & Harness Design: Understand modern agent frameworks and when to use - or avoid - them. Be comfortable building custom harnesses and control loops when greater flexibility, reliability, or control is needed.
- Retrieval Architecture & Agentic Search: Deep expertise designing and optimizing retrieval systems, including embedding search, hybrid retrieval, metadata filtering, reranking, and agentic search patterns. Know how to measure retrieval quality, diagnose failure modes, and systematically tune relevance, recall, precision, latency, and cost.
- Cloud & DevOps: Solid experience with cloud infrastructure (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and CI/CD automation.
- erfaces, integration mechanisms (e.g., async vs. synchronous), middleware, etc.
- Experience with typical AuthN/AuthZ methods and products
- Experience managing data, including the selection of persistence product, design of database schema, constraints and transaction boundaries, read/write design trade-off decisions and how it relates to mutable vs. immutable data state
- Experience balancing feature development vs. technical debt accumulation in order to deliver business needs while also maintaining quality over time
- Bachelor's degree in engineering, information systems, computer science, business administration, or other related fields