Build Silver tables in PySpark on Delta Lake from the Bronze ASTRA tables: third normal form, asserted keys, validated relationships, Unknown and Not Applicable records, code translation from reference tables.
Build Gold facts and dimensions from the approved specifications: daily full rebuild, no source identifiers, non-nullable foreign keys, control totals that reconcile to source.
Review and correct AI-generated code before it is merged.
Protect MyGTS, a live report that reads shared Silver tables, by running the regression baseline after every change.
Yêu cầu
6+ years in data engineering, with at least 3 years in PySpark (or Spark SQL) on Delta Lake in production.
Good at English.
Has built Silver and Gold layers on a medallion platform (Databricks, Synapse or Fabric) : can explain MERGE, idempotent reloads, partitioning, schema evolution and how a daily full rebuild differs from an incremental load.
Dimensional modelling in practice: surrogate keys, Unknown members, conformed dimensions, facts at a stated grain.
Strong SQL. Has reconciled a warehouse to its source system with control totals.
Has worked with Git, pull requests and CI checks as the normal way of delivering code.
Has integrated more than one source system into the same target tables, or migrated a pipeline from one source to another.
Hình thức làm việc
Hybrid Working
Thông tin khác
This position is open to Vietnamese candidates or candidates currently residing in Vietnam only.
This job can be filled in Hanoi/Danang - Hybrid Working, Ho Chi Minh - Remote Full-time.
Build Silver tables in PySpark on Delta Lake from the Bronze ASTRA tables: third normal form, asserted keys, validated relationships, Unknown and Not Applicable records, code translation from reference tables.
Build Gold facts and dimensions from the approved specifications: daily full rebuild, no source identifiers, non-nullable foreign keys, control totals that reconcile to source.
Review and correct AI-generated code before it is merged.
Protect MyGTS, a live report that reads shared Silver tables, by running the regression baseline after every change.
Yêu cầu
6+ years in data engineering, with at least 3 years in PySpark (or Spark SQL) on Delta Lake in production.
Good at English.
Has built Silver and Gold layers on a medallion platform (Databricks, Synapse or Fabric) : can explain MERGE, idempotent reloads, partitioning, schema evolution and how a daily full rebuild differs from an incremental load.
Dimensional modelling in practice: surrogate keys, Unknown members, conformed dimensions, facts at a stated grain.
Strong SQL. Has reconciled a warehouse to its source system with control totals.
Has worked with Git, pull requests and CI checks as the normal way of delivering code.
Has integrated more than one source system into the same target tables, or migrated a pipeline from one source to another.
Hình thức làm việc
Hybrid Working
Thông tin khác
This position is open to Vietnamese candidates or candidates currently residing in Vietnam only.
This job can be filled in Hanoi/Danang - Hybrid Working, Ho Chi Minh - Remote Full-time.