Lead - Data Engineer

Vacancy description

Lead - Data Engineer

We are seeking an experienced Azure Data Engineer with deep expertise in Databricks and Delta Lake to join our growing data engineering team. This role will focus on building robust, scalable data pipelines and delivering high-quality data solutions using the Medallion architecture in a Delta Lakehouse environment. You will work closely with cross-functional teams to support data-driven decision-making across the organization.

Highlights of the offer

  • Job offer expiration: 25/05/2025
  • Type of work: Hybrid
  • Role: Individual Contributor / Specialist
  • Location: Asia, India, Bengaluru

Responsibilities

Key Responsibilities:

  • Design, implement, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Develop and optimize data workflows using Delta Lake following the Medallion architecture (Bronze, Silver, Gold layers).
  • Build and manage Databricks notebooks, clusters, and job workflows for data ingestion, transformation, and analytics.
  • Integrate data from diverse sources (structured/unstructured) into the data lake and ensure data quality and consistency across layers.
  • Implement data governance, quality checks, and lineage tracking using Databricks features and other Azure services.
  • Collaborate with data Architects, Business Super Users, and BI Developers to support analytics and reporting requirements.
  • Apply performance tuning, partitioning strategies, and caching for optimized query performance.
  • Work with CI/CD pipelines using Azure DevOps or equivalent tools to ensure seamless deployment of data solutions.
  • Ensure data security and compliance with company and regulatory standards.

Our requirements

Required Skills & Qualifications:

  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
  • 3+ years of experience as a Data Engineer with strong skills in the Azure Ecosystem.
  • Expertise in Azure Databricks and Delta Lake with practical experience implementing Medallion architecture (Bronze/Silver/Gold layers).
  • Strong programming skills in Python and/or Scala, and advanced SQL knowledge.
  • Experience with Azure Data Lake Storage Gen2, Azure Data Factory, and Azure Synapse Analytics.
  • Solid understanding of data modeling, big data concepts, and data lakehouse architectures.
  • Familiarity with performance tuning and job orchestration in large-scale distributed systems.
  • Experience working with version control (e.g., Git) and CI/CD pipelines (e.g., Azure DevOps).
  • Strong problem-solving skills and attention to detail.

Additional Qualifications:

  • Experience with real-time data processing (e.g., using Structured Streaming).
  • Familiarity with Power BI or other reporting/visualization tools.
  • Certification in Azure (e.g., DP-203: Data Engineering on Microsoft Azure) is a plus.
  • Exposure to data governance and data cataloging tools (e.g., Purview, Unity Catalog).

We offer

At KK Wind Solutions, we offer you the opportunity to collaborate with colleagues across cultures in developing innovative greentech solutions. Founded on our long history as an industry pioneer and strong financial position, we are always looking for ways to improve our business and encourage new ideas and fresh perspectives. Combined with a flat hierarchical structure and a positive and informal working environment with a can-do attitude, this allows our employees to grow both personally and professionally.

Potential Benefits (Depending on Role)

Further information

If the above matches your field of interest and your qualifications, please send your application and resume as soon as possible. Interviews are held on an ongoing basis.

 

For further information, please contact:
Tanmay Bhattacharya +91 80 68260 101
 

About KK Wind Solutions

Building on more than 40 years of experience, KK Wind Solutions is a leading systems supplier to the renewable energy industry. Our capabilities span developing state-of-the-art technologies, high-quality lean manufacturing, and flexible aftermarket services. KK Wind Solutions is owned by A.P. Moller Holding, the parent company of the A.P. Moller Group, established in 1904 by Arnold Peter Møller. We are a global and diverse team of over 3,700 people, working towards delivering products and services that enable a future powered by renewable energy.


At KK Wind Solutions, our culture and DNA are built on a foundation of can-do attitude and innovation. We actively foster an inclusive work environment that embraces diversity, rejects any form of discrimination, and provides equal opportunities for all people. Our commitment lies in cultivating a strong culture centred around health, safety, wellbeing, and effective teamwork.


Visit www.kkwindsolutions.com to learn more about our company and career opportunities.