Yayınlanma: 5 gün önce
Data Engineer
- İş yerinde
- Tam zamanlı
- Airflow
- Azure
- BigQuery
- Data Engineering
İlan açıklaması
Employment Details
- Position: Senior Data Engineer
- Employment Type: TEMP-FTE
- Experience Required: 3-5 Years
Job Summary
We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong experience with Azure Data Factory, Databricks, ETL processes, and CI/CD practices to support enterprise data integration and analytics initiatives.
Key Responsibilities
- Architect and implement high-performance ETL/ELT pipelines using Azure Data Factory.
- Optimize data workflows for cost, speed, and scalability.
- Ensure data quality, lineage, and security across systems.
- Establish CI/CD, monitoring, and documentation standards for data engineering.
Must-Have Skills
- Azure Data Factory (ADF).
- Experience building and maintaining scalable data pipelines.
- Strong experience with Cloud Data Services, especially Databricks.
- Experience with ETL/ELT tools.
- Experience implementing and managing CI/CD pipelines.
Good-to-Have Skills
- Strong SQL and Python and/or Scala programming skills.
- Experience with Snowflake, Synapse Analytics, Redshift, or BigQuery.
- Experience with Airflow, dbt, Glue, Talend, or Fivetran.
- Knowledge of Kafka or Kinesis.
- Experience with Git, data quality, data lineage, and data governance practices.
- Knowledge of partitioning, performance tuning, and incremental loading.
- Experience with Azure DevOps, Docker, Kubernetes, or Terraform.
- Exposure to Data Lake and Lakehouse architectures.
Education
- Minimum bachelor's degree in computer science, Information Technology, Software Engineering, Data Science, Computer Engineering, or a related discipline.
Diğer ilanlar: Malezya
A2R Supervisor - Costing & Inventory
Baxter Kuala Lumpur, Kuala Lumpur, Malezya🇲🇾
Global Liabilities Accountant (1 Year Contract)
Baxter Kuala Lumpur, Kuala Lumpur, Malezya🇲🇾
Exploring Voice Talent Capabilities for AI Training Projects
Asialocalize Uzaktan · Kuala Lumpur, Kuala Lumpur, Malezya🇲🇾
Safety Management (Protege)
Airbus Kampung Baru Subang, Selangor, Malezya🇲🇾
HSE Coordinator (Malaysia)
STACK Infrastructure Johor Bahru, Johore, Malezya🇲🇾
Material Controller (Malaysia)
STACK Infrastructure Johor Bahru, Johore, Malezya🇲🇾
ENGR SR, PROCESS; MFG
Jobs onsemi Seremban, Negeri Sembilan, Malezya🇲🇾
Indirect Tax Senior Accountant (Mandarin Speaker)
Sanofi Kuala Lumpur, Kuala Lumpur, Malezya🇲🇾