Dodano 2 tygodnie temu
Senior PostgreSQL / Data Engineer
- Zdalnie
- Pełny etat
- Airflow
- Data Engineering
- Kafka
- Python
Opis oferty
We are looking for an experienced Senior PostgreSQL / Data Engineer to join a team building a high-performance, enterprise-grade data platform for the financial markets / FX domain.
This is a great opportunity for someone who enjoys working with large-scale data, complex PostgreSQL environments and near real-time processing. The platform handles approximately 40 million messages every day and provides up-to-date market data with refresh intervals as short as one second.
About the project
You will contribute to the design, development and optimization of a data platform responsible for:
- Processing data for 46 currency pairs
- Handling approximately 40 million messages per day
- Processing data in near real-time
- Managing large-scale data storage with 2-year retention
- Integrating the platform with messaging systems such as RabbitMQ
- Providing downstream teams with access to frequently refreshed data, with updates available every 1 second
- Ensuring high availability, scalability and performance
- Designing solutions capable of supporting large data volumes in a demanding financial environment
Qualifications
Must-have:
- Strong commercial experience with PostgreSQL
- Very good understanding of PostgreSQL architecture
- Hands-on experience with table partitioning
- Strong knowledge of database indexing and query optimization
- Experience with B-Tree, Hash, GIN, GiST and/or BRIN indexes
- Experience building or maintaining ETL processes
- Experience working with large-scale / Big Data environments
- Good knowledge of Linux
- Experience working with performance-critical database environments
- Fluent Polish and English
Nice to have:
- Python
- Kafka or RabbitMQ
- Apache Airflow
- CI/CD
- Experience in the banking, financial services or FX domain
- Experience with real-time or near real-time data processing
Additional Information
We hereby inform you that Inetum Polska sp. z o.o. has implemented an internal reporting (whistleblowing) procedure. The content of the procedure and the possibility to submit an internal report are available at:
Więcej ofert w firmie Inetum
Regular Data Engineer / I
Inetum Warszawa, Województwo mazowieckie, Polska🇵🇱
Senior Data Engineer with German / M
Inetum Zdalnie · Warszawa, Województwo mazowieckie, Polska🇵🇱
Inne oferty: Polska
Pentester / Specjalista ds. Testów Penetracyjnych (Mid)
Antal Sp. z o.o. Warszawa, Województwo mazowieckie, Polska🇵🇱
Senior Java Developer with German
Kyotu Technology Zdalnie · Wrocław, Województwo dolnośląskie, Polska🇵🇱
Senior Fullstack Developer (Java + Angular) | Branża Ubezpieczeniowa
Edge One Solutions Sp. z o.o Warszawa, Województwo mazowieckie, Polska🇵🇱
Data Engineer
ITFS Wrocław, Województwo dolnośląskie, Polska🇵🇱
Kierownik / Kierowniczka Projektu IT
IT Factory Zdalnie · Wiele lokalizacji🇵🇱
Business and System Analyst (K/M)
Alior Bank SA Gdańsk, Województwo pomorskie, Polska🇵🇱
Creative Project Manager/ka
Altavia Kamikaze + K2 Warszawa, Województwo mazowieckie, Polska🇵🇱
Fullstack Developer (Java, Angular) / System Analyst
Antal Sp. z o.o. Warszawa, Województwo mazowieckie, Polska🇵🇱
Technical Data Governance Specialist (On-site)
Capgemini Invent Wiele lokalizacji🇵🇱
Inżynier / Inżynierka Rozwiązań Cloud & Modern Workplace
Orange Polska Zdalnie · Warszawa, Województwo mazowieckie, Polska🇵🇱
Internal Service Delivery Manager
emagine Polska Warszawa, Województwo mazowieckie, Polska🇵🇱
Data Architect with German
Link Group Zdalnie · Wiele lokalizacji🇵🇱