Senior Python ETL Developer – Data Engineering & Database Migration

Senior Python ETL Developer responsible for designing, building, and maintaining ETL/ELT pipelines to migrate data from Microsoft SQL Server to PostgreSQL on Google Cloud Platform. Leverages Python, Pandas, SQL, and GCP services to ensure data quality, performance, and scalability.

• Design, develop, and maintain end‑to‑end ETL/ELT pipelines using Python and Pandas
• Build reusable components for data extraction, transformation, validation, and loading
• Extract data from Microsoft SQL Server and migrate to PostgreSQL on GCP
• Implement bulk‑loading strategies using PostgreSQL COPY and appropriate drivers
• Develop file‑based workflows for CSV, JSON, and Parquet formats
• Implement source‑to‑target mappings, schema transformations, and data quality checks
• Build reconciliation mechanisms for row counts, duplicates, nulls, and aggregate comparisons
• Ensure pipelines are restartable, idempotent, and include robust logging and error handling
• Optimize Python code, Pandas operations, SQL queries, and database interactions for performance
• Integrate migration workflows with GCP services and write automated tests
• Maintain technical documentation and participate in code reviews
• Provide technical guidance and mentor team members on Python, ETL architecture, and database migration

• 10+ years overall IT experience
• Strong proficiency in Python 3.x and object‑oriented programming
• Extensive experience with Pandas DataFrames and Series
• Proficient in SQL, including joins, CTEs, and query optimization
• Hands‑on experience with Microsoft SQL Server and PostgreSQL
• Experience with GCP Cloud SQL, Cloud Storage, Secret Manager, and Cloud Logging
• Knowledge of Docker, Git, and automated testing (pytest)
• Familiarity with CI/CD practices
• Experience with data validation, reconciliation, and idempotent pipeline design
• Ability to mentor and guide junior developers