Senior Data Engineer (Azure)
About This Job
Trách nhiệm chính
- Design, develop, and maintain scalable data pipelines and data processing workflows using Azure and Databricks.
- Build data ingestion, transformation, and integration processes across multiple data sources.
- Develop and maintain ETL/ELT pipelines supporting analytics, reporting, and AI use cases.
- Develop data processing solutions using SQL, Python, and PySpark.
- Design and optimize datasets and data models for efficient downstream consumption.
- Perform data validation and implement data quality checks to ensure accuracy and reliability.
- Monitor, troubleshoot, and optimize data pipelines and processing performance.
- Collaborate with Data Analysts, AI Engineers, architects, and business stakeholders to understand data requirements.
- Support deployment and productionization of data solutions.
- Maintain clear technical documentation covering data flows, transformations, dependencies, and business rules.
- Follow appropriate engineering, security, data governance, and development standards.
Yêu cầu
- At least 5 years of experience in Data Engineering, Data Platform Engineering, or a similar role.
- Strong hands‑on experience with Microsoft Azure and Databricks.
- Strong SQL skills, including complex queries, data transformations, and query optimization.
- Strong practical experience with Python and/or PySpark.
- Proven experience designing and implementing ETL/ELT pipelines.
- Experience working with large datasets and integrating data from multiple sources.
- Good understanding of data modelling, data quality, and data integration principles.
- Experience working with cloud‑based data platforms and modern data architectures.
- Good understanding of software engineering practices, version control, testing, and CI/CD.
- Strong analytical and problem‑solving skills.
- Ability to work independently and collaborate effectively with both technical and business stakeholders.
Yêu cầu ưu tiên
- Experience within insurance, financial services, or another regulated industry.
- Knowledge of additional Azure data services and cloud data architecture.
- Experience working with data lakes, lakehouse architectures, and enterprise data platforms.
- Familiarity with data governance, metadata, lineage, and data security principles.
- Exposure to Databricks Genie and AI‑enabled data and analytics capabilities.
- Experience supporting data platforms used for AI/ML or Generative AI workloads.
- Experience working in Agile delivery environments.
Thông tin khác
- The application process may not receive a response within 10 workdays due to high volume of applications.
- The role is based in Thành phố Hồ Chí Minh, Vietnam.
- The company is a global digital transformation firm with over 12,000 technology experts operating in 20+ countries.