Geplaatst: 51 minuten geleden
Lead Data Engineer
- Remote
- Airflow
- AWS
- Azure
- Data Engineering
Vacaturetekst
Softeta is a software engineering partner for finance, energy, industrial, and other high-stakes sectors.
We specialize in building and modernizing backend-heavy, integration-critical systems where speed, accuracy, and reliability are non-negotiable. With more than 100 AI and custom software experts across engineering hubs in Lithuania and Poland, we embed ourselves directly in client operations, delivering custom software, automation, and AI where they create the most value. Clients such as SEB, NordVPN, and carVertical trust us with systems that serve millions of users worldwide.
Our commitment to excellence led us to create Cobble, Softeta’s own AI-native development workflow. Built by our engineers, it standardizes how developers work with AI agents, from requirements to working code.
We are looking for a Lead Data Engineer to join a project for our client in the banking business. You will design and improve systems for data ingestion, processing, storage, and sharing, helping teams access reliable and secure data for their daily operations and business decisions.
Key Responsibilities
- Design, build, and improve data architectures with a focus on performance, scalability, and reliability.
- Develop and maintain ETL/ELT pipelines for data ingestion, transformation, storage, and sharing.
- Integrate data across systems and ensure consistent, reliable synchronization.
- Maintain high standards of data quality, security, and availability, supported by monitoring and alerting.
- Collaborate with analysts, software engineers, and business stakeholders to translate data needs into practical solutions.
- Lead and manage the data engineering team, providing technical guidance, mentoring, task prioritization, and performance management while fostering collaboration and continuous improvement.
- Oversee team development, resource allocation, and delivery to ensure alignment with business objectives and project timelines.
Technologies - Python, Spark, AWS, S3, Glue, Iceberg, SQL, Medallion architecture, Data Mesh approach.
Requirements
- 7+ years of experience in data engineering or a similar role. Experience in financial services, particularly risk or finance, is a strong advantage.
- Strong SQL and Python skills. Familiarity with additional ETL tools as Spark is a plus.
- Hands-on experience with at least one cloud platform (AWS, Azure, or GCP).
- Experience with Docker and Kubernetes, alongside familiarity with DevOps practices, Terraform, test automation, infrastructure as code, and security best practices.
- Familiarity with orchestration or transformation tools such as Airflow or dbt.
- Knowledge of system integration approaches, including real-time, message-based, and event-driven integrations.
Benefits
- Diverse and technically challenging projects.
- Training budget for professional and personal growth.
- Flexible working hours and a hybrid or remote workplace model.
- Flexible schedule and an Agile/SCRUM environment.
- Technical equipment that you can choose.
Meer vacatures bij Softeta
Andere vacatures in Polen
Specjalista / Specjalistka ds. Przetargów Szpitalnych
Antal Warschau, Woiwodschap Mazovië, Polen🇵🇱
Zleceniobiorca (K/M) w salonie Guess w G City Promenada, Warszawa
Guess Europe Sagl Warschau, Woiwodschap Mazovië, Polen🇵🇱
Time & Attendance / Workforce Management Consultant
Helprise Wrocław, Woiwodschap Neder-Silezië, Polen🇵🇱
Portfolio Manager
Helprise Remote · Krakau, Woiwodschap Klein-Polen, Polen🇵🇱
Intern IT Product (Commercial)
Fortrea Remote · Warschau, Woiwodschap Mazovië, Polen🇵🇱
Kierownik Regionalny w Dziale Zwierząt Towarzyszących (k/m/n)
6F9 - Zoetis Polska S.p.z.o.o Warschau, Woiwodschap Mazovië, Polen🇵🇱
(Mid, Sr) Systems Development Engineer
BorgWarner Krakau, Woiwodschap Klein-Polen, Polen🇵🇱
Team Lead – Systems Engineering
BorgWarner Krakau, Woiwodschap Klein-Polen, Polen🇵🇱
Firmware/Software Platform Engineer, Senior
Zebra Technologies Meerdere locaties🇵🇱
Specjalista / Specjalistka ds. Zakupów (k/m/n)
Unison Engine Components Poland Sp. z o.o. Dzierżoniów, Woiwodschap Neder-Silezië, Polen🇵🇱
Inżynier / Inżynierka Konstruktor / Konstruktorka (k/m/n)
Unison Engine Components Poland Sp. z o.o. Dzierżoniów, Woiwodschap Neder-Silezië, Polen🇵🇱
Advanced Lead Engineer - Mechanical Component (w/m/x)
GE Aerospace Warschau, Woiwodschap Mazovië, Polen🇵🇱