Posted 6 weeks ago
Data Engineer - Fabric
- Onsite
- Full Time
- Azure
- Data Engineering
- Python
- Apache Spark
Job description
We are looking for an experienced Data Engineer who will be responsible for designing, building,
and maintaining scalable data pipelines and solutions on Microsoft Fabric platforms. The ideal
candidate will have solid programming skills, strong knowledge of data processing frameworks,
and hands-on capability in optimizing data workflows.
Key Responsibilities:
• Design and implement end-to-end Microsoft Fabric solutions, including data integration, transformation, and analytics.
• Proficiency in Microsoft Fabric’s Notebook for developing Apache Spark jobs.
• Hands-on experience with Python, PySpark and SparkSQL/TSQL for data transformations.
• Experience working with File Transfer Services - FTS (GoAnywhere preferred - automated and secure data movement across environments)
• Advanced SQL skills and proficiency in data integration techniques, ETL/ELT processes, and data pipeline architectures.
• Extensive knowledge of MS Fabric components like: Lakehouses, OneLake, Data Pipelines, Real-Time Analytics, Power BI Integration, Semantic Model.
• Familiarity with Azure services such as Azure Synapse, Azure Data Lake, and Azure SQL.
Requirements
Mandatory Skills:
• Expertise in Microsoft Azure/Fabric data services.
• Strong proficiency in Python and SQL.
• Hands-on experience with PySpark for distributed data processing.
• Solid understanding of ETL/ELT development and data pipeline orchestration.
Other jobs in India
Finance Business Partners Hyd 171121
ADP Hyderabad, Telangana, India🇮🇳
Lead - Engineering, Dahanu, ACG Capsules
ACG Associated Capsules Pvt Ltd Dāhānu, Maharashtra, India🇮🇳