Data Engineer - Assistant Manager

Kavi India is looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and infrastructure that power analytics, reporting, and machine learning initiatives across the organization. The ideal candidate has a strong foundation in data modelling, distributed systems, and cloud-based data platforms.

• Design, build, and optimize scalable ETL/ELT pipelines to ingest, transform, and load data from diverse sources.
• Develop and maintain data warehouse/data lake architectures, ensuring data quality, consistency, and reliability.
• Collaborate with data scientists, analysts, and product teams to understand data requirements.
• Build and maintain batch and real-time streaming data pipelines using tools like Apache Spark, Kafka, or Airflow.
• Implement data quality checks, monitoring, and alerting to ensure pipeline reliability and data integrity.
• Optimize database and query performance for large-scale datasets.
• Design and maintain data models, schemas, and cloud data infrastructure resources.
• Implement and enforce data governance, security, and compliance best practices.
• Troubleshoot and resolve production data pipeline issues in a timely manner.

• Bachelor's degree in Computer Science, Engineering, or a related field
• 8+ years of hands-on experience as a Data Engineer or in a similar role
• Strong programming skills in Python and/or Scala; solid SQL expertise
• Experience with ETL/ELT tools and orchestration frameworks (Apache Airflow, dbt, Luigi)
• Hands-on experience with big data technologies (Apache Spark, Hadoop, Kafka)
• Proficiency with relational databases and NoSQL databases
• Experience working with cloud data platforms and services (AWS, Azure, GCP)
• Solid understanding of data modeling concepts and data warehousing solutions (Snowflake, Redshift, BigQuery, Databricks)