Logo
SAIC

LLM Platform Architect

SAIC, Virginia

Save Job

Job ID: 2506494 Location: REMOTE WORK, VA, United States Date Posted: Jun 25, 2025 Category: Information Technology Subcategory: Platform Engr Schedule: Full-time Shift: Day Job Travel: No Minimum Clearance Required: None Clearance Level Must Be Able to Obtain: Public Trust Potential for Remote Work: Remote Benefits: Click here We are seeking a highly experienced Platform Architect with expertise in LLM (Large Language Model) integration and AI/ML platform engineering to lead enterprise-level platform strategy and architecture. This role is centered on designing a scalable, modular, and secure AI/ML ecosystem that integrates seamlessly across enterprise teams—including infrastructure, governance, and security organizations. You will guide the end-to-end architecture of a multi-cloud AI/ML platform that supports mission-critical workloads across federal, state, and commercial programs. The platform integrates services like Databricks, JupyterHub, AWS SageMaker, Bedrock, and emerging tools, while adhering to stringent security, compliance, and operational oversight frameworks. The role requires deep systems-level thinking with the ability to align technical direction with enterprise stakeholder needs. Key Responsibilities: Architect secure, scalable environments for enterprise-grade model development and GenAI integration, including foundational components such as Databricks, JupyterHub, SageMaker, Bedrock, and future LLM-as-a-service frameworks. Establish enterprise-ready CI/CD and infrastructure-as-code pipelines using Terraform, Bitbucket, Bamboo, supporting platform repeatability, compliance, and modular growth. Collaborate closely with enterprise infrastructure, cybersecurity, governance, and data architecture teams to ensure alignment with boundary controls, policy enforcement, and integration patterns. Lead the development of platform-wide architecture artifact system blueprints, integration diagrams, standards repositories, onboarding workflows, and internal guidance consumed by implementation teams. Design future-ready cross-cloud integration architectures across AWS (T-Cloud), Azure, GCP, and OCI to support federated model workloads and portability of GenAI services. Represent architectural direction in executive and stakeholder reviews while partnering with internal product, security, and compliance teams to ensure platform continuity. Evaluate and define mechanisms to onboard additional tooling or frameworks (e.g., Immuta, Trustworthy AI audit services) to extend core platform capabilities while preserving auditability and operational control. Guide engineering teams with design best practices and influence long-term platform evolution strategies to maintain velocity, reusability, and governance. Qualifications Required Qualifications: Bachelor’s or master’s degree in computer science, Engineering, or a related technical field. 10+ years of experience designing platform architecture, including hands-on experience with AI/ML infrastructure. Must be a U.S. Citizen with the ability to obtain and maintain a Public Trust clearance. Demonstrated experience building enterprise-scale, modular platforms across hybrid or multi-cloud ecosystems. Deep understanding of AWS services (S3, Lambda, RDS, SageMaker, Bedrock), Databricks, and infrastructure automation (Terraform). Experience working with enterprise governance, compliance, and security stakeholders to align platform design with organizational and regulatory requirements. Strong ability to define patterns for API integration, model deployment, lifecycle orchestration, and cloud-native operations. Desired Skills: Knowledge of GenAI patterns, LLM evaluation pipelines, and Responsible AI enforcement mechanisms. Experience working within government enterprise environments with boundary protection, audit, and compliance constraints. Familiarity with platform compliance standards (FedRAMP, NIST 800-53, SOC2) and model ATO strategies. Excellent communication and leadership skills to work across enterprise architecture forums and executive planning sessions. Job Description Description We are seeking a highly experienced Platform Architect with expertise in LLM (Large Language Model) integration and AI/ML platform engineering to lead enterprise-level platform strategy and architecture. This role is centered on designing a scalable, modular, and secure AI/ML ecosystem that integrates seamlessly across enterprise teams—including infrastructure, governance, and security organizations. You will guide the end-to-end architecture of a multi-cloud AI/ML platform that supports mission-critical workloads across federal, state, and commercial programs. The platform integrates services like Databricks, JupyterHub, AWS SageMaker, Bedrock, and emerging tools, while adhering to stringent security, compliance, and operational oversight frameworks. The role requires deep systems-level thinking with the ability to align technical direction with enterprise stakeholder needs. Key Responsibilities: Architect secure, scalable environments for enterprise-grade model development and GenAI integration, including foundational components such as Databricks, JupyterHub, SageMaker, Bedrock, and future LLM-as-a-service frameworks. Establish enterprise-ready CI/CD and infrastructure-as-code pipelines using Terraform, Bitbucket, Bamboo, supporting platform repeatability, compliance, and modular growth. Collaborate closely with enterprise infrastructure, cybersecurity, governance, and data architecture teams to ensure alignment with boundary controls, policy enforcement, and integration patterns. Lead the development of platform-wide architecture artifact system blueprints, integration diagrams, standards repositories, onboarding workflows, and internal guidance consumed by implementation teams. Design future-ready cross-cloud integration architectures across AWS (T-Cloud), Azure, GCP, and OCI to support federated model workloads and portability of GenAI services. Represent architectural direction in executive and stakeholder reviews while partnering with internal product, security, and compliance teams to ensure platform continuity. Evaluate and define mechanisms to onboard additional tooling or frameworks (e.g., Immuta, Trustworthy AI audit services) to extend core platform capabilities while preserving auditability and operational control. Guide engineering teams with design best practices and influence long-term platform evolution strategies to maintain velocity, reusability, and governance. Qualifications Required Qualifications: Bachelor’s or master’s degree in computer science, Engineering, or a related technical field. 10+ years of experience designing platform architecture, including hands-on experience with AI/ML infrastructure. Must be a U.S. Citizen with the ability to obtain and maintain a Public Trust clearance. Demonstrated experience building enterprise-scale, modular platforms across hybrid or multi-cloud ecosystems. Deep understanding of AWS services (S3, Lambda, RDS, SageMaker, Bedrock), Databricks, and infrastructure automation (Terraform). Experience working with enterprise governance, compliance, and security stakeholders to align platform design with organizational and regulatory requirements. Strong ability to define patterns for API integration, model deployment, lifecycle orchestration, and cloud-native operations. Desired Skills: Knowledge of GenAI patterns, LLM evaluation pipelines, and Responsible AI enforcement mechanisms. Experience working within government enterprise environments with boundary protection, audit, and compliance constraints. Familiarity with platform compliance standards (FedRAMP, NIST 800-53, SOC2) and model ATO strategies. Excellent communication and leadership skills to work across enterprise architecture forums and executive planning sessions. Target salary range: $160,001 - $200,000. The estimate displayed represents the typical salary range for this position based on experience and other factors. Overview SAIC accepts applications on an ongoing basis and there is no deadline. SAIC is a premier Fortune 500 mission integrator focused on advancing the power of technology and innovation to serve and protect our world. Our robust portfolio of offerings across the defense, space, civilian and intelligence markets includes secure high-end solutions in mission IT, enterprise IT, engineering services and professional services. We integrate emerging technology, rapidly and securely, into mission critical operations that modernize and enable critical national imperatives. We are approximately 24,000 strong; driven by mission, united by purpose, and inspired by opportunities. SAIC is an Equal Opportunity Employer. Headquartered in Reston, Virginia, SAIC has annual revenues of approximately $7.5 billion. For more information, visit saic.com . For ongoing news, please visit our newsroom . CHANTILLY,VA,United States Information Technology REMOTE WORK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology SUFFOLK,VA,United States Information Technology Are you an SAIC Employee? Please apply through the internal career site here > #J-18808-Ljbffr