GenAI Ops Solution Architect

GenAI Ops Solution Architect
Permanent Full Time

5 days Strongsville, OH, Dallas, TX, or Pittsburgh, PA.

Visa : USC, GC, EAD (Only W2, No Sponsorship)





Position Description

GenAI Ops Solution Architect who will lead the design, governance, and evolution of enterprise-scale Generative AI platforms and solutions.
This role is responsible for defining architecture standards, platform capabilities, integration patterns, governance controls, and engineering practices that enable secure, scalable, and reusable GenAI adoption across the enterprise.
The architect will work closely with business stakeholders, engineering teams, platform teams, governance organizations, and cloud providers to establish a centralized GenAIOps capability supporting Retrieval Augmented Generation (RAG), Agentic AI, ModelOps, Evaluation, Observability, and AI Governance.



Enterprise GenAI Architecture

• Define and govern the enterprise GenAI platform architecture.
• Establish architecture standards, design patterns, and reusable frameworks for enterprise AI adoption.
• Lead solution design for RAG, Document Intelligence, Agentic AI, Evaluation, Observability, and Governance capabilities.
• Define reference architectures and integration patterns for onboarding GenAI use cases.

• Drive the design and implementation of centralized GenAIOps capabilities including:
  • RAG & Retrieval Services
  • AgentOps
  • ModelOps / LLMOps
  • Evaluation Pipelines
  • Observability & Monitoring
  • AI Governance & Controls
• Establish reusable engineering patterns and shared platform services.

• Lead architecture reviews and technical governance processes.
• Ensure alignment with enterprise security, compliance, risk, and regulatory requirements.
• Define standards for Responsible AI, auditability, traceability, and human-in-the-loop controls.
• Participate in governance forums and stakeholder reviews.

• Define cloud architecture and deployment strategies across Azure, AWS, or hybrid environments.
• Establish enterprise integration patterns for APIs, data platforms, document repositories, workflow systems, and identity providers.
• Lead architecture decisions around scalability, resiliency, security, and performance.

• Provide technical leadership to Value Engineers, Context Engineers, Alignment Engineers, and ModelOps teams.
• Support platform onboarding and use case architecture activities.
• Mentor engineering teams and drive adoption of best practices.
• Evaluate emerging GenAI technologies and recommend platform enhancements.

• Collaborate with business and technology leaders to align architecture decisions with strategic objectives.
• Support roadmap planning, platform evolution, and capability expansion initiatives.
• Act as the primary architecture authority for enterprise GenAI initiatives.

• 10+ years of experience in Solution Architecture, Enterprise Architecture, Cloud Architecture, or Platform Engineering.
• 3+ years of experience designing and implementing Generative AI and enterprise AI solutions.
• Deep understanding of:
  • Large Language Models (LLMs)
  • Retrieval Augmented Generation (RAG)
  • Agentic AI
  • Prompt Engineering
  • AI Evaluation Frameworks
  • ModelOps / LLMOps
  • AI Governance
• Experience designing enterprise-scale cloud solutions on Azure, AWS, or GCP.
• Strong knowledge of microservices, APIs, event-driven architectures, and distributed systems.
• Experience leading architecture governance and enterprise technology standards.
• Strong stakeholder management and executive communication skills.

• Establish a scalable and reusable enterprise GenAI platform.
• Accelerate onboarding of GenAI use cases through reusable architecture patterns.
• Ensure alignment with governance, security, and compliance requirements.
• Improve platform adoption, operational efficiency, and engineering productivity.
• Enable sustainable long-term ownership through architecture standardization and knowledge transfer.