AI ML Ops
About This Job
Trách nhiệm chính
- Operate, secure, and optimize TCB's AI platform ecosystem including AWS Bedrock, agentic AI solutions, and internal machine learning services.
- Deploy, operate, and maintain AI infrastructure on AWS platforms such as Bedrock, SageMaker, EKS, and Lambda.
- Ensure platform availability, scalability, and performance in accordance with agreed SLA and latency targets.
- Design, implement, and optimize CI/CD pipelines for AI models, prompts, and AI agents.
- Establish model lifecycle management including versioning, evaluation, testing, deployment, and rollback mechanisms.
- Automate AI delivery processes to improve deployment reliability and reduce operational risks.
- Establish observability frameworks covering logs, metrics, traces, token consumption, and AI output quality.
- Monitor system health and proactively identify operational risks.
- Investigate and resolve incidents following Jira ITSM and organizational service management processes.
- Monitor and analyze AI platform consumption and token usage across departments.
- Implement budgeting controls, quota management, cost alerts, and optimization initiatives.
- Manage access controls and authentication through Azure AD (Microsoft Entra ID) and enterprise identity services.
- Implement AI guardrails and governance controls to ensure secure and responsible AI usage.
- Collaborate with software engineering, infrastructure, security, and business teams to transition AI solutions into production.
- Develop and maintain operational runbooks, knowledge articles, and technical documentation on Confluence.
- Provide operational guidance and best practices for AI platform users and stakeholders.
- Support continuous improvement initiatives across AI operations and platform management.
Yêu cầu
- Bachelor's degree in Information Technology, Computer Science, Computer Engineering, Artificial Intelligence, or related disciplines.
- Minimum 4 years of experience in DevOps, SRE, Cloud Engineering, or related infrastructure roles.
- Minimum 1 year of hands‑on experience operating AI/ML or Generative AI/LLM systems in production environments.
- Strong experience with AWS services including IAM, VPC, Bedrock, SageMaker, EKS, Lambda, or equivalent cloud AI services.
- Practical experience with Docker, Kubernetes, Terraform, and CI/CD tools such as GitHub Actions or GitLab CI.
- Proficiency in Python and Bash scripting.
- Good understanding of APIs, RAG (Retrieval-Augmented Generation), Vector Databases, Prompt Engineering, and Model Evaluation.
- Experience with monitoring and observability platforms such as CloudWatch, Prometheus, Grafana, or similar solutions.
- Knowledge of ITIL / ITSM processes and operational governance.
Yêu cầu ưu tiên
- AWS certifications such as AWS Certified Solutions Architect, AWS Certified DevOps Engineer Professional, AWS Certified Machine Learning Specialty.
- Experience in FinOps practices and cloud cost optimization.
- Experience with Azure AD / Microsoft Entra ID and SSO integration.
- Experience working in insurance, banking, or financial services environments.
- Strong automation mindset and continuous improvement approach.
- English proficiency sufficient for reading technical documentation, collaborating with technology vendors, and supporting platform operations.
Thông tin khác
- Location: Hà Nội, Vietnam.
- Facility: Insurance.
- Category: IT & Data.
- Job Type: Not specified.
- Headcount: 1 (default).
- Application deadline: Not specified.