ประกาศเมื่อ 2 ชั่วโมงที่แล้ว
Data Engineer
- ทำงานในสถานที่
- AWS
- Data Engineering
- Python
- Snowflake
รายละเอียดงาน
We are looking for a Data Engineer to join our team, helping to design and build the data platform underpinning the company's analytics product. In this role, you will develop reliable ingestion and transformation processes that make source data usable, traceable and suitable for downstream application and BI requirements.
- · Contribute to data platform design using AWS and Snowflake.
- · Implement ETL/ELT processes and data pipelines.
- · Automate ingestion from agreed source systems and document-processing outputs.
- · Develop transformations and data structures supporting analytical use cases.
- · Implement data validation, error handling and appropriate recovery or reprocessing processes.
- · Collaborate with financial-domain stakeholders to understand data definitions and reconciliation rules.
- · Identify and investigate missing, inconsistent, duplicate or otherwise invalid data.
- · Support visibility into pipeline execution, failures and data freshness.
- · Document data flows, transformation logic, dependencies and operating procedures.
- · Collaborate with back-end engineers and BI specialists to deliver usable datasets and resolve integration issues.
- · Prepare knowledge transfer for the team responsible for maintaining the platform after the initial engagement.
Requirements
- Professional experience with AWS and Snowflake.
- ·Experience using data platform design.
- ·A strong understanding of ETL/ELT implementation.
- ·A clear understanding of data pipeline development.
- ·An in-depth knowledge of automated data ingestion, data validation and error handling.
- · Strong SQL and practical data modelling skills.
- · Experience making data pipelines repeatable, testable and maintainable.
- · Understanding of data quality, lineage and reconciliation.
- · Ability to investigate failures across ingestion, transformation and storage.
- · Awareness of access controls and responsible handling of sensitive financial or personal data.
- · Ability to explain data assumptions and limitations to business stakeholders.
In addition to the above, it would be advantageous to bring a clear understanding of financial or accounting datasets, semi-structured data, document-derived data, Python or another relevant scripting language, workflow orchestration, automated data testing or Snowflake performance and cost optimization.
งานอื่นใน โปรตุเกส
Senior Manager GBS Data & Platform
adidas Group Porto, Porto, โปรตุเกส🇵🇹
Remote in Portugal | French Accountant
Atlean World ระยะไกล · โปรตุเกส 🇵🇹
Project Manager Telecommunications
Capgemini Service SAS Vila Nova de Gaia, Porto, โปรตุเกส🇵🇹
Copeiro - Pestana Churchill Bay
Pestana Management - Serviços ฟุงชาล, มาเดรา, โปรตุเกส🇵🇹
Técnico de Manutenção Hoteleira (m/f) - Pousada Convento de Beja 1
Pestana Management - Serviços Palmela, เมืองเซตูเบล, โปรตุเกส🇵🇹
Commissioning Lead
Winthrop Technologies Sines, เมืองเซตูเบล, โปรตุเกส🇵🇹
Accounting General Ledger Trainee
Greenvolt ลิสบอน, Lisbon, โปรตุเกส🇵🇹
Employee & Labour Relations Specialist
Greenvolt ลิสบอน, Lisbon, โปรตุเกส🇵🇹
SPA Receptionist - ME Lisbon
Melia Hotels International Lisbon, โปรตุเกส🇵🇹
Assistant F&B Director - ME Lisbon
Melia Hotels International Lisbon, โปรตุเกส🇵🇹
Gerente de Loja (M/F) - Mr. Blue Strada Outlet
Mr. Blue ลิสบอน, Lisbon, โปรตุเกส🇵🇹
Técnico(a) de Engenharia de Apoio Técnico (PT) 1
Mota-Engil Avis, Portalegre, โปรตุเกส🇵🇹
iPhone Video Data Collection - Paid Task ($70)
Mindrift ระยะไกล · หลายสถานที่🇵🇹
Record Videos at Home for AI - $70 One-Time Task
Mindrift ระยะไกล · หลายสถานที่🇵🇹