Hello there!
I love data. It excites me. But for me, data engineering is mostly about responsibility: making sure the right data is ready, on time and trustworthy before anyone builds a dashboard, a model or a decision on top of it.
01 โ About
That is what I do today as a Data Engineer apprentice at SoonGo at Station F, alongside a Mastรจre in Data Engineering & AI at Ynov Paris. I am also building DxPilot, an AI assistant that helps doctors reach better diagnoses.
Before this I was at Deezer, working on real-time pipelines, GCP infrastructure with Terraform and production Airflow workflows. At Mu Sigma I looked after more than 1,500 Hive tables and 40+ Azure Data Factory pipelines for a large US retailer. That job taught me how much people downstream depend on data simply being there and being right. I started out at TCS.
I studied at EPITA (MSc in Data Science & Analytics) and Manipal (MBA in Business Analytics). Day to day I mostly work with Python, SQL, Spark, Kafka, Airflow, Databricks and the major clouds.
If you are working on data platforms or trying to make your data more reliable, I would love to hear about it ๐ฉ
02 โ Skills
03 โ Certifications
Click any card to verify on the issuer's official site.
Google Associate Cloud EngineerGoogle
Verify (opens in a new tab)Microsoft Certified: Fabric Data Engineer AssociateMicrosoftVerify (opens in a new tab)Databricks Certified Data Engineer ProfessionalDatabricksVerify (opens in a new tab)Microsoft Certified: Azure Data FundamentalsMicrosoftVerify (opens in a new tab)Data Streaming Engineer FoundationsConfluentVerify (opens in a new tab)Databricks Certified Data Engineer AssociateDatabricksVerify (opens in a new tab)Astronomer Certification for Apache Airflow 3 FundamentalsAstronomerVerify (opens in a new tab)Astronomer Certification DAG Authoring for Apache Airflow 3AstronomerVerify (opens in a new tab)Microsoft Certified: Azure FundamentalsMicrosoftVerify (opens in a new tab)Dataiku Core DesignerDataikuVerify (opens in a new tab)Dataiku ML PractitionerDataikuVerify (opens in a new tab)Neo4j Certified ProfessionalNeo4jVerify (opens in a new tab)04 โ Experience
Data Engineer - Alternance
Paris
Joined SoonGo as Data Engineer Apprentice! ๐ Looking forward to working on data solutions, analytics systems and cloud tech while contributing to impactful projects and learning from great startup ecosystem at Station F.
Project Manager and Data
Europe
DxPilot is an AI-powered Clinical Decision Support System (CDSS) that helps doctors make faster, more accurate diagnoses by generating clinical insights throughout the examination. Operating within a human-in-the-loop framework it acts as an intelligent assistant for doctors.
Data Engineer Intern
Paris, รle-de-France, France
As a Data Engineer Intern, I worked on building and maintaining real-time data pipelines and managing cloud infrastructure to support operational decision-making systems.
Trainee Decision Scientist-3
Bengaluru
As Trainee Decision Scientist-3, I worked on data engineering solution and managing 1500+ data assets which are being consumed by down-stream users for reporting and insight generation for one of the leading USA Retail giant.
Trainee Decision Scientist-2
Bengaluru, Karnataka, India
As Trainee Decision Scientist-2, I worked on data-driven decision-making processes and utilizing various analytical tools and techniques to provide insights and solutions to one of the leading US Retail giant. I have worked on 4 different engagements:
Assistant System Engineer
Bengaluru, Karnataka, India
As an Assistant System Engineer at Tata Consultancy Services in Bangalore, I had the opportunity to work with a prestigious European Energy Organization, where I focused on IT Service Management. During my tenure, I was able to demonstrate my proficiency in ServiceNow by clearing the CSA certification exam. My responsibilities included handling various aspects of ServiceNow, such as lists, forms, filters, incident management, change management, request management, report management, knowledge management, service catalog, flow designer, workflow, scripting, notification, import set, transform maps, plugins, and other related configuration and development activities. Through my work, I gained valuable experience in managing IT services for a large organization and developed my skills in ServiceNow administration and development. Overall, my experience at Tata Consultancy Services has provided me with a strong foundation in IT Service Management and a deep understanding of ServiceNow.
Exposys Data Labs
Bengaluru, Karnataka, India
During my internship, I focused on customer segmentation using the K Means Clustering algorithm to achieve desired outcomes. Through this project, I gained hands-on experience in applying machine learning techniques to real-world data and developing solutions to business problems. I was able to analyze large datasets, identify patterns, and group customers into distinct segments based on their behavior and characteristics. By implementing K Means Clustering, I was able to effectively target specific customer groups and personalize marketing strategies, leading to improved customer satisfaction and business performance. Overall, this internship allowed me to gain practical knowledge in data analysis and machine learning, enhancing my skillset for future opportunities.
Great Learning
India
The program I participated in was a 9-week long endeavor, which included 7 weeks of training and 2 weeks dedicated to project work. During the course of the program, I completed 2 mini-projects and 1 major project. The program provided me with the opportunity to gain practical experience in my field of study and allowed me to apply the knowledge I had acquired in a real-world setting. Through the mini-projects and major project, I was able to demonstrate my ability to solve problems, work effectively in a team, and meet project deadlines. Overall, the program was a valuable learning experience that helped me develop my skills and prepare for my future career.
Verzeo
Bengaluru
I completed a 2-month internship focused on machine learning, which was supported by the Microsoft Technology Associate Program. During this internship, I gained hands-on experience with various machine learning techniques and tools. I worked on several projects, including developing predictive models, building natural language processing models, and using deep learning algorithms for image recognition tasks. The program provided me with a comprehensive understanding of the various aspects of machine learning, including data preprocessing, model selection, and evaluation. This experience was invaluable in helping me develop my skills and knowledge in the field of machine learning.
Data Engineering & AI
Ynov Paris
Paris, France
Mastรจre in Data Engineering & AI at Ynov Paris, alongside my apprenticeship as a Data Engineer at SoonGo (Station F).
Data Science & Analytics
EPITA
Paris, France
I completed a Master of Science in Computer Science with a specialization in Data Science and Analytics (DSA) at EPITA. This rigorous program provides a strong foundation in both theoretical concepts and practical applications of data science, including data analysis, machine learning, deep learning and big data technologies. Through coursework and project-based learning, I have gained hands-on experience in working with large-scale datasets, building predictive models and deploying data-driven solutions in production environments. The program also emphasizes problem-solving, critical thinking and the use of modern tools and frameworks, preparing me to tackle real-world challenges in data science and analytics.
Executive Programme
Manipal Academy of Higher Education
Manipal, India
I completed an Online MBA in Business Analytics at Manipal Institute of Higher Education (MAHE), gaining structured training in business strategy and data-driven decision-making. Throughout the program, I developed a strong foundation in data analytics, big data analytics, digital and web analytics, predictive modeling, and data visualization, enabling me to approach business problems with a data-driven mindset. The flexible online learning format allowed me to balance academic rigor with practical application through real-world case studies and industry-oriented projects. I enhanced my proficiency in analytical tools and technologies while strengthening my strategic and managerial decision-making skills, preparing me to navigate the complexities of the modern, data-centric business environment.
Grade: 9.21
Computer Science & Engineering
Visvesvaraya Technological University
Belagavi, India
I earned my Bachelor of Engineering degree in Computer Science and Engineering VTU in 2021. Throughout my academic journey, I maintained a commendable academic record, achieving a 7.92 CGPA. During my undergraduate studies, I was exposed to a variety of core computer science concepts, including algorithms, data structures, programming languages, software engineering, and database management. Through various projects and assignments, I honed my technical skills and developed a strong foundation in computer science principles. My degree has equipped me with the necessary knowledge and skills to succeed in the field of computer science and has prepared me for the challenges and opportunities that lie ahead in my career.
Grade: 7.92 CGPA
05 โ Projects
Feb 2025
A production-style ML system for predicting flight prices. New data is ingested every minute and validated with Great Expectations against 7 data quality rules, which separate good records from bad ones and send Teams alerts for critical issues. Airflow runs scheduled predictions every two minutes through a FastAPI model service. A Streamlit app handles single and batch predictions, PostgreSQL stores the history and Grafana dashboards monitor data quality and predictions. Everything runs with Docker Compose.
Jul 2025
An end-to-end platform that checks whether a news claim is true. Trained on the LIAR dataset, it combines an ensemble of LSTM, GRU and TextCNN models with retrieval-augmented generation: FAISS finds similar past claims, a scraper collects live web evidence and a BERT classifier scores how relevant that evidence is. An LLM (LangChain + Groq) then writes a justification for the verdict. I handled Dockerization, web scraping, data cleaning and bug fixing across the stack, which runs on Streamlit, FastAPI and PostgreSQL with JWT login and per-user history.
Apr 2026
A PySpark pipeline that reads raw NYC taxi trips from S3, computes Haversine and Manhattan distances with custom UDFs and aggregates demand: top pickup and drop-off zones, trip counts and average duration by hour and weekday. Results are written back to S3 as CSV, and the job can run on EMR.
Mar 2025
I modelled the UCI Online Retail dataset (541,909 transactions) in three NoSQL paradigms to compare how each handles different queries. MongoDB stores invoices as documents with nested items for fast lookups and aggregations. Neo4j links customers, invoices and products for relationship and recommendation queries. Redis handles caching, catalogue lookups and a spend-based customer leaderboard with sorted sets. Data is loaded in batches of 1,000 with Python.
2022 โ 2024
40+ production pipelines managing 1500+ Hive data assets at Mu Sigma. Built monitoring, alerting and ETL discrepancy resolution โ improved success rate by 6%.
Apr 2026
An interactive Streamlit dashboard that explores how attendance and motivation relate to exam scores, deployed on AWS EC2 with a bash user-data script that installs everything and pulls the app and data from S3. Alongside it, I built a serverless AWS Lambda function that enriches NYC taxi trips stored in S3 with Haversine and Manhattan distances.
Apr 2026
My EPITA capstone research on automated misinformation detection. On the LIAR benchmark (12,836 political statements, 6 truth labels) I compared a GRU with GloVe embeddings, a multi-input CNN and an LSTM that adds speaker and context metadata, to measure how much metadata improves classification. The work includes a literature review, a survey and a study of whether adding real-time web data and LLMs would make this production-ready.
2023
Graph analytics MVP modelling disease trends in pet healthcare for a Fortune 500 analytics client. Built using Neo4j and Cypher queries for relationship analysis.
2023
2-phase data integrity project recalibrating 150+ Hive data tables to resolve historical data corruption. Coordinated with cross-functional stakeholders for validation.
Apr 2026
Privacy design for a travel safety app, built around GDPR and Cavoukian's 7 principles of Privacy by Design. I anonymised the user dataset and de-identified it with ARX, then wrote the privacy policy and terms of use and designed an opt-in/opt-out consent screen covering lawful basis, data subject rights and retention.
Apr 2026
A layered Java application that loads contacts and students from CSV into an embedded H2 database, with JDBC, the DAO pattern and a business-logic service layer providing full CRUD. It is covered by nine JUnit test classes.
Apr 2026
Our team's solver for EPITA's Kaggle Week, a Hash Code-style challenge to order photos into the most "interesting" slideshow. We paired portrait photos with complementary tags using two pointers, indexed frames with MinHash LSH so we never had to compare every pair and built the sequence greedily from the best LSH candidate at each step.
Apr 2025
I implemented the VAT algorithm to check whether a dataset actually has cluster structure before running a clustering model, and wrote a report analysing how it works.
Feb 2025
A community platform where citizens report local problems such as potholes, leaks or broken streetlights with photos and a location on an OpenStreetMap map. Votes from the community set the priority, and anyone can follow an issue's status. An admin panel lets departments manage issues and track how quickly they resolve them, while a leaderboard rewards active users. Built with PHP, MySQL, JavaScript, Leaflet.js and Bootstrap.
Jan 2025
A house price prediction model taken beyond the notebook: I split it into reusable training and inference steps and packaged it as an installable Python module, following clean code practices.
Jan 2025
A web app for tracking money lent to and borrowed from friends. A dashboard shows totals and net balance, and transactions can be settled or unsettled in one click. Built with PHP 8.2 and MySQL 8.1 and fully containerised with Docker Compose.
Nov 2020 โ Jul 2021
For our final-year project we built a marketplace that lets farmers in India sell crops directly to buyers anywhere in the country. Farmers list their produce and set a minimum price, buyers bid and once a deal closes, drivers can take on the delivery. The platform has a PHP web app, an Android client, order and transport management and a price forecast based on the previous year's prices.
Oct 2020 โ Dec 2020
A PHP web marketplace for renting houses, appliances, furniture and vehicles. Users filter by location and price, then book the item they want in a few clicks.
Oct 2020 โ Nov 2020
I explored the Google Play Store dataset to find which app attributes drive ratings, then built a machine learning model to predict the rating of new apps.
Aug 2020
During my Exposys Data Labs internship I used K-Means clustering to group customers with similar characteristics, giving a clearer basis for targeted marketing.
Aug 2020
Using historical La Liga data on every participating team (goals scored and conceded, top-6 finishes, seasons played, best position), I built performance metrics and visualisations to compare teams and estimate likely title contenders.
Jul 2020
I analysed individual medical insurance costs and used statistical tests to find which customer attributes significantly affect charges, the kind of insight insurers use to price their policies.
Jul 2020
I analysed an Amazon purchases dataset with pandas, answering business questions about customer behaviour and spending patterns.
Jan 2020 โ Feb 2020
A device that monitors a driver's eyes and raises an alert whenever they stay closed for too long. After three warnings, it automatically messages a chosen contact about the driver's condition.
Oct 2019 โ Dec 2019
A smart meter prototype that reads live voltage and current from sensors, calculates power (P = V ร I) and stores the readings in a database so customers can monitor their consumption in real time.
Sep 2019 โ Nov 2019
A web application with a relational database backend for a retail store, built to manage day-to-day sales and stock transactions in one place.
Aug 2019
Our team worked on developing a machine learning model aimed at predicting the presence of ASD disease based on a set of parameters. We began by sourcing and processing relevant data, and subsequently trained the model on the identified parameters. Rigorous testing of the model followed, which resulted in obtaining a high accuracy score. Our diligent efforts have led us to develop a sophisticated and reliable predictive model, which is well-equipped to make accurate predictions regarding the presence of ASD disease. We are confident that our model will contribute towards advancing research in this field and lead to improved outcomes for patients.
Sep 2018 โ Nov 2018
We successfully developed a small-scale prototype for an intelligent lighting system, which has the potential to be implemented throughout entire homes. This system is equipped with a PIR (Passive Infrared) sensor, which effectively detects the presence of humans within a room, allowing the system to adjust lighting accordingly. Our prototype demonstrates the capability of creating an energy-efficient lighting system, which only activates when necessary. This innovative technology has the potential to revolutionize the way we use energy in our homes and buildings, and we are excited about the future possibilities for this project.
Apr 2018 โ May 2018
I am proud to have designed and developed a cutting-edge RFID based Smart Mobile Locker. The locker is equipped with advanced RFID technology that provides enhanced security features, allowing users to unlock the locker with an RFID tag. This technology is a significant improvement over traditional locks and offers convenience, efficiency, and peace of mind. With this innovative system, users can be confident that their valuables are safe and secure. I am thrilled to have been able to contribute to the advancement of locker technology, and I look forward to continuing to develop innovative solutions in the future.
06 โ Achievements
Award ยท Jul 2021
I am pleased to announce that I secured the second place in the Societal Impact (Broad Area) category at the national-level virtual hackathon called "HACKOTHSAV." This two-day event was an excellent opportunity for me to showcase my skills and demonstrate my passion for creating solutions that make a positive impact on society. The Societal Impact category was particularly important to me because it allowed me to focus on the broader picture of how technology can be leveraged to address critical social challenges. I am grateful for the opportunity to participate in this hackathon and look forward to continuing to apply my knowledge and skills to make a meaningful difference in the world.
Award ยท Jun 2021
I am pleased to announce that I secured the first place in the 6th Industry Institute Conclave on Electronics, Computational and Communication Technologies held at Sahyadri College of Engineering and Management in Mangalore on June 26, 2021. This prestigious event was organized in collaboration with the IEEE Mangalore Subsection, and provided a platform for me to showcase my skills and knowledge in these cutting-edge technologies. It is an honor to have been recognized for my achievements in this field, and I am grateful for the opportunity to participate in this competition. I look forward to continuing my work in this field and making meaningful contributions to the industry.
Award ยท Oct 2019
I am pleased to share that I was recognized as the Runner-up in the IIOT-2K19 competition for my project, "Smart Energy Meter," which I presented at the SMVITM Bantakal. This project aimed to create an innovative solution for monitoring energy usage, which can help reduce energy consumption and promote sustainable energy practices. Through my project, I was able to demonstrate my technical skills and creativity in the field of IoT and Energy Management. I am proud to have been recognized for my work in this highly competitive event, and I look forward to continuing to develop my skills and knowledge in this exciting field.
Award ยท May 2019
I am delighted to announce that my teammate, Raunak Choudhary, and I were awarded first prize in a Coding Competition organized by the Code Troopers Club of SMVITM, Udupi. It was an honor to participate in the competition alongside other skilled coders, and we are thrilled to have emerged as the winners. The competition was an excellent opportunity for us to demonstrate our coding abilities and showcase our teamwork skills. We are grateful to the Code Troopers Club for organizing this event and providing a platform for young coders to showcase their talent. We look forward to participating in more such competitions in the future.
Publication ยท Apr 2018
INTERNATIONAL JOURNAL OF CREATIVE RESEARCH THOUGHTS (IJCRT), ISSN:2320-2882
Today, we are fully dependent on technology, every second we use technology. But only this isnโt any destination of advanced technology as per our future dreams and expectation have more requirements. We have enough knowledge to make it better for our future with that. Thatโs why every new version of technology rises with solving the drawbacks of the previous one. Today all sectors which are providing us platforms for technological development are growing with new determination to give a good future. And wireless services are the fastest-growing among them. We can see its network growth in the past few years at a wide level. So we can say that it is the most preferred services for all and showing its requirement for the future as per the concept as IoT comes in limelight for the future. Presently wireless traveled from 1G to 4G with great success and our next steps are towards 5G and beyond. We can imagine that 5G technology will change the experience for call quality, data transmission, and mobile features. In this paper, we will discuss past achievements, present condition and future scope for wireless networks with 5G technology, its basic architecture, challenges and major effect on our life and future.
Read the publication (opens in a new tab)Open to full-time Data Engineering opportunities across Europe. Based in Paris, with flexibility for remote work and relocation.
ganpat.patel.012@gmail.comยฉ 2026 Ganpat Patel