I am Ganpat Patel, a Data Engineer based in Paris. I design and build robust, scalable data platforms โ from real-time ingestion across diverse sources to orchestrated workflows using Airflow, distributed processing with PySpark and Databricks and modern cloud platforms across GCP, Azure and AWS.
Recently at Deezer, I built a CI/CD migration framework, transitioning pipelines from Jenkins to GitHub Actions, while auditing and redesigning existing workflows. In parallel, I worked on a GCP-based monitoring solution to improve FinOps visibility and cloud cost tracking. Prior to that at Mu Sigma, I led a team managing a large suite of ADF pipelines and production data assets, spearheaded a data integrity initiative recalibrating hundreds of Hive tables to resolve historical data corruption, and developed a Neo4j graph analytics MVP to identify disease trends in pet healthcare.
Years of Experience
3.5+
Certifications
4+
Production Pipelines Managed
170+
Production Tables Maintained
2000+
Data Assets Restored
150+
Monitoring Solutions Built
3+
Spoken Languages
๐ฌ๐งEnglishB2 โ IELTS
๐ซ๐ทFrenchB1 โ TCF
๐ฎ๐ณHindiC2 โ Native
๐ฎ๐ณRajasthaniC2 โ Native
๐ฎ๐ณKannadaA2 โ Spoken only
Beyond the Data โ Interests & Passions
๐บ๏ธGeography
๐Geopolitics
๐History
โ๏ธTraveling
๐Cricket
๐คฏParadox Theories
02 โ Skills
My Skills
Technical Stack
Python
Language
S
SQL
Language
Scala
Language
Terraform
IaC
Apache Airflow
Orchestration
Apache Kafka
Streaming
d
dbt
Transformation
PySpark
Processing
Databricks
Platform
D
Delta Lake
Storage
GCP
Cloud
A
Azure
Cloud
A
AWS
Cloud
BigQuery
Warehouse
Snowflake
Warehouse
Docker
Infrastructure
Kubernetes
Infrastructure
GitHub Actions
DevOps
PostgreSQL
Database
Neo4j
Graph DB
MongoDB
Database
Cassandra
Database
P
Power BI
Visualisation
Grafana
Monitoring
Dataiku
Platform
FastAPI
API
Streamlit
App
Claude Code
Platform
GitHub Copilot
Platform
Soft Skills
Problem Solving
Execution
Critical Thinking
Strategy
Storytelling
Communication
Collaboration
Teamwork
Ideation
Creativity
Adaptability
Execution
Stakeholder Communication
Communication
Ownership
Leadership
Prioritization
Execution
Leadership
Leadership
Time Management
Execution
Decision-Making
Strategy
Attention to Detail
Execution
Business Acumen
Strategy
03 โ Certifications
Verified Credentials
Click any card to verify on the issuer's official site.
Designed and maintained reliable real-time data pipelines feeding downstream systems for reporting and analytics.
Managed scalable GCP infrastructure using Terraform to keep deployments reproducible and consistent across environments.
Improved the robustness and monitoring of Airflow workflows under production constraints to maintain system reliability.
Contributed to the Syslog-to-Kafka migration through code refactoring, bug fixing, and hackathon collaboration.
Orchestration
SQL
Airflow
DevOps
GCP
Terraform
Python
Mu Sigma
Trainee Decision Scientist-3
๐ Bengaluru, Karnataka, India
Jan 2024 โ Jul 2024
Led daily ETL processes and maintained the availability of 1500+ Hive assets consumed for reporting and insight generation.
Monitored and managed 40+ Azure Data Factory pipelines, resolving failures to keep critical workflows on track.
Coordinated with upstream source teams and business stakeholders to ensure timely delivery and data integrity.
Drove enhancements to existing pipeline structures and continuous ETL improvements for better operational efficiency.
Orchestration
PyCharm
SQL
Azure DevOps Server
DevOps
Microsoft Azure
Azure Data Factory
PySpark
Azure Data Lake
ServiceNow
Git
Python
Mu Sigma
Trainee Decision Scientist-2
๐ Bengaluru, Karnataka, India
Oct 2022 โ Jan 2024
Supported data-driven decision-making across multiple engagements using analytical tools and engineering workflows.
Managed ETL refresh processes and solved downstream reporting discrepancies to ensure on-time data availability.
Recalibrated 150+ historical data assets to fix corruption caused by backfills without proper upsert handling.
Delivered a Neo4j graph analytics proof of concept and analytical reports that surfaced actionable client insights.
PyCharm
React
DevOps
Azure Databricks
Power BI
Azure Data Factory
Data Analysis
PySpark
Azure Data Lake
Neo4j
Git
Advanced Excel
Tata Consultancy Services
Assistant System Engineer
๐ Bengaluru, Karnataka, India
Aug 2021 โ Sep 2022
Worked with a major European energy organization on IT Service Management using the ServiceNow platform.
Handled incidents, changes, requests, reports, knowledge, service catalog, flows, workflows, notifications, and scripting.
Configured lists, forms, filters, import sets, transform maps, plugins, and related development activities.
Strengthened platform expertise by clearing the ServiceNow CSA certification during the role.
ServiceNow Administration
Scripting
IT Service Management
Service Desk
ServiceNow
Internship
Data Science Intern
Exposys Data Labs
๐ Bengaluru, Karnataka, India
Jul 2020 โ Aug 2020
Focused on customer segmentation using K Means clustering to analyze customer behavior and build practical business-facing ML solutions. The internship provided hands-on experience in data analysis, pattern discovery, and real-world machine learning application.
Churn Management
Data Science
Data Analysis
Python
Internship
Data Science Intern
Great Learning
๐ India
Jun 2020 โ Aug 2020
Completed a 9-week program with 7 weeks of training and 2 weeks of project work, delivering 2 mini-projects and 1 major project. The experience strengthened practical problem-solving, teamwork, and deadline-driven delivery in data science.
Data Science
Data Cleaning
Exploratory Data Analysis
Python
Internship
Machine Learning Intern
Verzeo
๐ India
Jul 2019 โ Aug 2019
Completed a 2-month machine learning internship supported by the Microsoft Technology Associate program, working on predictive models, NLP use cases, and deep learning tasks. The experience built a strong foundation in preprocessing, model selection, and evaluation.
Machine Learning
Natural Language Processing
Python
Education
Master's in Computer Science
Data Science & Analytics
EPITA
๐ Paris, France
Sep 2024 โ Apr 2026
Completed an MSc in Computer Science with a specialization in Data Science and Analytics. The program built depth across data analysis, machine learning, deep learning, and big data systems through hands-on projects focused on large-scale datasets, predictive models, and production-ready data solutions.
Data Analysis
Machine Learning
Deep Learning
Big Data
MBA in Business Analytics
Executive Programme
Manipal Academy of Higher Education
๐ Manipal, India
Jun 2023 โ Aug 2025
Completed an MBA in Business Analytics with structured training in business strategy and data-driven decision making. Built a strong foundation in analytics, big data, digital and web analytics, predictive modeling, and data visualization through industry-oriented case studies and practical projects.
Grade: 9.21
Python
Business Analytics
Data Science
Bachelor of Engineering
Computer Science & Engineering
Visvesvaraya Technological University
๐ Belagavi, India
Aug 2017 โ Aug 2021
Completed a BE in Computer Science and Engineering with a strong foundation in algorithms, data structures, programming, software engineering, and database management. Projects and coursework strengthened problem-solving skills and prepared me for real-world software and data challenges.
Grade: 7.92 CGPA
Code Troopers
NSS
Eco Club
Class Committee
Algorithms
Data Structures
Software Engineering
Databases
05 โ Projects
What I've Built
RECENT
Feb 2025 โ Apr 2025
The Flight Detective
Streamlit app predicting flight prices with Airflow automating data ingestion and scheduled prediction jobs. Integrated Great Expectations for data validation and Grafana for real-time monitoring.
Evaluating deep learning models (LSTM, GRU, TextCNN) for fake news classification. Using real-time web data and LLM-based models (RoBERTa) to improve classification accuracy.
PySpark pipeline analysing the NYC taxi trip dataset on AWS S3. Custom Haversine and Manhattan distance UDFs, aggregations by hour, weekday and busiest pickup/dropoff zones, with results written back to S3.
Optimised frameglass pairing and ordering using greedy algorithms with MinHash and Locality Sensitive Hashing (LSH). Enhanced tag diversity using disjoint tags technique.
40+ production pipelines managing 1500+ Hive data assets at Mu Sigma. Built monitoring, alerting and ETL discrepancy resolution โ improved success rate by 6%.
Azure ADF
PySpark
SQL
Databricks
Python
2023
Neo4j Knowledge Graph POC
Graph analytics MVP modelling disease trends in pet healthcare for a Fortune 500 analytics client. Built using Neo4j and Cypher queries for relationship analysis.
Neo4j
Cypher
Python
Graph Analytics
2023
Hash Value Recalibration
2-phase data integrity project recalibrating 150+ Hive data tables to resolve historical data corruption. Coordinated with cross-functional stakeholders for validation.
ETL
Python
Hive
Azure
2021
TapShip
Platform connecting farmers to national markets โ end-to-end from logistics data ingestion to delivery tracking. Built during university as a full-stack project.
Verify
