AI Large Language Model (LLM) Technology Architecture Senior Manager/Associate Director

Overview

As a Lead/Principal AI Architect, you will be the technical authority for AI architecture across client engagements and the practice. You own end-to-end AI platform design spanning classical ML, generative AI, and agentic systems, aligned to business objectives and enterprise standards. You work with CIOs and senior leaders to shape enterprise AI strategy and translate it into a coherent technical vision. You lead cross-domain architects, govern architecture artifacts, and drive production-ready, scalable AI solutions that deliver lasting value.

Responsibilities

• Shape and align enterprise AI strategy with client leadership
• Lead enterprise AI assessments and create implementation roadmaps
• Own end-to-end architecture for complex AI platforms across domains
• Translate governance principles into concrete technical solutions
• Develop prototypes and proofs of concept to de-risk decisions
• Evaluate tools, frameworks, and platforms with evidence-based recommendations
• Define multi-agent ecosystems, memory, and tool/skill use with a centralized AI gateway
• Establish foundation models, inference strategies, and high-throughput, low-latency deployment
• Oversee security, governance, observability, performance, and scalability across domains
• Create and govern architecture artifacts (ADRs, reference architectures, data flows) for delivery at scale
• Contribute to the practice’s AI point of view and external representation through publications and talks
• Lead cross-functional teams to resolve cross-domain tensions into a unified system
• Develop reusable reference architectures and assets with an adopt-over-build approach
• Conduct architecture workshops with executives and engineering teams
• Define identity, authorization, guardrails, and risk scoring across systems
• Implement FinOps practices for cost visibility and budgeting
• Set standards for memory, context assembly, and semantic retrieval within the platform
• Administer the MCP control plane across internal and third-party servers

Key requirements

• Extensive experience designing and deploying enterprise-grade AI solutions (agentic, generative, and classical ML) on at least one cloud vendor
• Proven experience in LLM and Generative AI space
• Strong background in architecting and operationalizing LLM-driven applications
• Deep expertise in ML/DL/NLP and big-data analytics
• Multiple years of hands-on machine architecture experience in industry
• Comfort with designing production-grade AI platforms and governance frameworks

• Executive-level collaboration with CIOs/CTOs
• Thought leadership and external representation
• Strategic storytelling and stakeholder management
• Enterprise AI architecture
• Agentic systems design and orchestration
• Memory and context management for AI platforms

…