Ali Bin Kashif

Senior Data Engineer

Feb 2026 - Present

MarketLytics

• Built an end-to-end Azure data platform for a healthcare enterprise using ADF, ADLS, Synapse, and dbt. The platform processes millions of records monthly and supports enterprise analytics while reducing cloud costs by 20–30% through optimized orchestration and resource usage.


• Integrated Azure Data Lake with Databricks by orchestrating ADF pipelines that export Synapse tables to Parquet in ADLS. These datasets are consumed by Databricks pipelines and Delta tables for scalable Spark processing, advanced analytics, and AI/ML model development.


• Developed Databricks pipelines and lakehouse data models enabling large-scale analytics workloads and machine learning experimentation on top of the Azure data platform.


• Implemented a Microsoft Fabric workspace including Power BI semantic models, business intelligence reports, and AI data agents to enable self-service analytics and conversational data exploration for business teams.


• Optimized Fabric capacity utilization by automating pause/resume schedules during off-hours and weekends, reducing compute costs by approximately 60% while maintaining performance during business hours.

Data Engineer II

July 2025 - Jan 2026

MarketLytics

• Designed & built a data warehouse in BigQuery using the medallion architecture (raw, transformed, production layers). Ingested data from 10+ marketing & payment sources (Stripe, Google Ads, Meta Ads, TikTok Ads, Spotify Ads, Reddit Ads, Vibe.co Ads, Bing Ads, etc.) using Airbyte (built-in + custom connectors) and Python ETL pipelines. Modelled data with SQL for dashboards and machine learning models, enabling unified marketing analytics and faster decision-making.


• Led a complete refactor of a client's data infrastructure that was previously scattered across 30+ Google Cloud Functions with no CI/CD or documentation. I consolidated these into a single FastAPI-based microservice, containerized with Docker, and deployed on Cloud Run. Using Terraform, automated the entire infrastructure setup and introduced GitHub Actions for CI/CD, ensuring automated builds, testing, and deployments. Integrated Slack alerts and structured logging for better observability. This transformation reduced deployment time by 80%, improved reliability, and made the system fully maintainable with clear version control and documentation.


• Implemented data partitioning and clustering in the production tables in the gold layer of data warehouse and built a scalable API for serving Marketing Modelling Mix (MMM) data to the end users of mobile application using FastAPI, dockerized and deployed on Cloud Run reducing query time by 60%.

Data Engineer I

Aug 2024 - July 2025

MarketLytics

At MarketLytics, I specialize in building scalable data solutions that unlock insights, improve efficiency, and reduce operational costs. My work involves building robust pipelines, integrating advanced analytics, and delivering impactful products to solve critical data problems for clients.

• Developed a multi-source revenue tracking pipeline ingesting Stripe, PayPal, Shopify, Thrivecart & Clickfunnels data into BigQuery; created scheduled queries for data modelling and transformation and built Looker dashboards for a unified view that reduced manual revenue tracking effort by 80%.


• Reduced costs by 90% with a BigQuery → GCS → Snowflake migration pipeline, replacing an inefficient client’s existing solution.


• Built and deployed Muawin, a real-time anomaly detection system that uses the SARIMA model to monitor key metrics of e-commerce and send automated Slack alerts and reports. The product was containerized with Docker, deployed on Cloud Run, and uses Flask as a backend.


• Developed a real-time revenue attribution pipeline (webhooks → BigQuery → GA4) achieving 95% accuracy, with PII anonymisation via hashing.


• Built custom GPTs and chatbots integrated with BigQuery, allowing clients to chat with their data and instantly generate tables, visualizations, and aggregated insights through natural language prompts.


• Developed complex queries for data transformation and analytics in Databricks and Metabase, enabling data-driven decision-making for stakeholders.


• Migrated data transformation layer from scheduled BigQuery queries to dbt Cloud, enabling proper lineage, version control, and improved collaboration across teams.

Freelance Data Scientist/Analyst

Dec 2023 - Nov 2024

Upwork

• Developed an anomaly detection system (Prophet, Flask, Cloud Run, Docker) with Slack alerts, helping client detect irregularities in real time.


• Built web scrapers for E-Commerce sites in Python using Scrapy and BS.


• Built data extraction scripts to extract data from unstructured data like PDFs to a structured format like CSVs, JSON, XML etc.

Data and AI Engineer Trainee

June 2024 - August 2024

MarketLytics

• Developed an efficient anomaly detection system using Python and the Prophet model to identify unusual patterns and trends.
• Integrated web analytics data from Google Analytics 4 into Google BigQuery.
• Implemented real-time alerts on Slack with comprehensive report generation.
• Created the API using Flask and containerized using Docker.
• Deployed the pipeline on Google Cloud Run, ensuring a robust and scalable architecture for the pipeline.

Product Impact: Muawin helps clients monitor their web analytics data effectively, enhancing their ability to respond swiftly and accurately to data irregularities.