Posted 5 days ago

Lead Data Engineer

Multiple locations 🇮🇳
  • Onsite
  • Full Time
  • Data Engineering
  • Python
  • Apache Spark
  • SQL

₹2,500,000 - ₹3,400,000 year

Job description

Required Skills & Experience

  • 7+ years of experience in Data Engineering, Data Platform Development or related technical roles.
  • Strong hands-on experience with Databricks.
  • Strong programming experience in Python and PySpark.
  • Advanced SQL skills, including complex queries, joins, aggregations and data transformations.
  • Strong experience with Apache Spark and distributed data processing.
  • Hands-on experience designing and developing ETL/ELT pipelines.
  • Experience with REST APIs and API-based data integrations.
  • Working knowledge of Databricks Unity Catalog, including data governance, access management and metadata.
  • Understanding of Delta Lake and lakehouse architecture.
  • Hands on experience in Databricks AI Genie / or any Agentic AI framework.
  • Working knowledge of CI/CD practices and Git-based development workflows.
  • Experience designing governed data pipelines and maintaining enterprise data quality.

Preferred Skills

  • Hands-on experience integrating enterprise data with Planisware.
  • Experience with Databricks Genie and Databricks-based AI/BI capabilities.
  • Experience with LangGraph, LangChain, Semantic Kernel, CrewAI or similar agentic frameworks.
  • Experience building knowledge graphs using Neo4j or other graph technologies.
  • Experience with RAG, vector search and enterprise data retrieval patterns.
  • Experience implementing automated data quality and pipeline monitoring.
  • Exposure to enterprise project portfolio management (PPM), resource management or financial planning datasets.

More jobs at Techblocks

Other jobs in India

Technical Specialist

Refinitiv India Shared Services Private Limited India 🇮🇳

Onsite Full Time 5 hours ago

Generic

SmartX Technologies India 🇮🇳

Internship 2 hours ago