Principal AI Architect – Agentic AI & GenAI

Full-Time | 12–18 Years | Remote + ~30% Travel

Preferred Locations: California, Texas, New Jersey, North Carolina, Georgia

***Open to H1 Transfers***

We are looking for a hands-on Principal AI Architect with a strong software engineering foundation and deep experience building enterprise GenAI, RAG and Agentic AI solutions.

This is an individual contributor role combining hands-on architecture and engineering with client-facing consulting. The ideal candidate should be equally comfortable designing a production AI system, reviewing or writing code, and leading a technical discovery or architecture workshop with enterprise clients.

Responsibilities

• Architect and build production-grade GenAI, RAG and Agentic AI applications
• Design end-to-end agent workflows involving LLMs, retrieval, tools/APIs, enterprise systems, state and human approvals
• Design RAG pipelines covering ingestion, chunking, embeddings, vector search, metadata filtering, hybrid retrieval and reranking
• Integrate AI agents with enterprise applications, APIs, databases and data platforms
• Apply distributed systems and software architecture principles to AI applications operating at enterprise scale
• Design for authentication, authorization, multi-tenancy, PII protection, auditability, observability and AI guardrails
• Work hands-on with prototypes, reference implementations and production solutions
• Conduct client discovery sessions, architecture workshops and technical presentations
• Translate business problems into practical AI architectures and implementation approaches
• Guide AI-assisted development and review/debug code generated through agentic coding workflows

Required Experience

• 12–18 years of software engineering and architecture experience with strong hands-on technical depth
• Strong background in Java and/or .NET/C#, APIs, microservices and distributed systems
• Hands-on experience building GenAI, RAG and Agentic AI solutions
• Strong understanding of chunking strategies, embeddings, vector databases, HNSW/ANN indexing, hybrid search and reranking
• Experience with LangGraph, LangChain, LlamaIndex, Semantic Kernel or comparable frameworks
• Experience with agent orchestration, tool/function calling, state management, memory and human-in-the-loop patterns
• Strong experience with Kafka, RabbitMQ or similar event-driven technologies
• Good understanding of SQL/NoSQL data modelling, caching, retries, idempotency, timeouts, backpressure and failure handling
• Deep experience with at least one cloud platform: AWS, Azure or GCP
• Experience with containers, CI/CD, production deployments and application observability
• Experience using Claude Code, Cursor, OpenAI Codex or equivalent AI-assisted/agentic development tools
• Strong client-facing communication with experience conducting technical discovery, consulting and architecture workshops

We are looking for someone who understands the engineering underneath AI platforms, rather than relying solely on managed GenAI services. Candidates should be able to explain architectural trade-offs, demonstrate solutions they have personally built, and take an AI solution from business problem through architecture to working implementation.

This is not a people-management role. It is a senior hands-on IC opportunity for an architect who wants to remain close to engineering while working directly with enterprise clients.

Are you looking for remote jobs near your area? At Yulys, thousands of employers are looking for exceptional talent like yours. Find a perfect job now.