Pubblicata 4 giorni fa
Data Engineer
- In sede
- Tempo pieno
- Airflow
- Azure
- BigQuery
- Data Engineering
Descrizione dell’offerta
Employment Details
- Position: Senior Data Engineer
- Employment Type: TEMP-FTE
- Experience Required: 3-5 Years
Job Summary
We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong experience with Azure Data Factory, Databricks, ETL processes, and CI/CD practices to support enterprise data integration and analytics initiatives.
Key Responsibilities
- Architect and implement high-performance ETL/ELT pipelines using Azure Data Factory.
- Optimize data workflows for cost, speed, and scalability.
- Ensure data quality, lineage, and security across systems.
- Establish CI/CD, monitoring, and documentation standards for data engineering.
Must-Have Skills
- Azure Data Factory (ADF).
- Experience building and maintaining scalable data pipelines.
- Strong experience with Cloud Data Services, especially Databricks.
- Experience with ETL/ELT tools.
- Experience implementing and managing CI/CD pipelines.
Good-to-Have Skills
- Strong SQL and Python and/or Scala programming skills.
- Experience with Snowflake, Synapse Analytics, Redshift, or BigQuery.
- Experience with Airflow, dbt, Glue, Talend, or Fivetran.
- Knowledge of Kafka or Kinesis.
- Experience with Git, data quality, data lineage, and data governance practices.
- Knowledge of partitioning, performance tuning, and incremental loading.
- Experience with Azure DevOps, Docker, Kubernetes, or Terraform.
- Exposure to Data Lake and Lakehouse architectures.
Education
- Minimum bachelor's degree in computer science, Information Technology, Software Engineering, Data Science, Computer Engineering, or a related discipline.
Altre offerte: Malaysia
SENIOR SPECIALIST NURSE, INTENSIVE CARE UNIT
KPJ Seremban Specialist Hospital Seremban, Negeri Sembilan, Malaysia🇲🇾
STATE REGISTERD NURSE, OPERATION THEATRE-5
Johor Specialist Hospital Johor Bahru, Johor, Malaysia🇲🇾
Associate - Financial Risk Management
PwC Kuala Lumpur, Kuala Lumpur, Malaysia🇲🇾
Cloud Solution Engineer
Prudential Kuala Lumpur, Kuala Lumpur, Malaysia🇲🇾
STS Specialist Account Management Tier 1
3550 MSD RDC Costa Rica SRL Più località🇲🇾 🇨🇷 🇨🇿
Senior Accounting Manager
Kyndryl Da remoto · Kuala Lumpur, Kuala Lumpur, Malaysia🇲🇾
Executive Director, Data and AI Enablement
RGA Global Services Malaysia Sdn. Bhd. Kuala Lumpur, Kuala Lumpur, Malaysia🇲🇾
APAC Claims Automation & Business Intelligence Analyst
Chubb External Malaysia 🇲🇾