Azure and Databricks consulting for the UAE, Saudi Arabia, Qatar and wider MENA

Case studies

Selected work delivered by our founder in senior architecture and leadership roles across the UAE and the region. Client names are withheld to respect confidentiality.

Food and FMCG, United Arab Emirates

A metadata-driven data quality and remediation framework for finance reporting

Client

A large regional food and restaurant group running finance, COGS and SKU profitability reporting on Azure.

Challenge

Finance, COGS, inventory and transfer-profit figures depended on complex ERP data and allocation logic. Issues were often found late, during review of management reports, and legacy Oracle and ODI processes made root causes slow to trace.

Approach

  • Designed a reusable, metadata-driven data quality framework on Azure Databricks with configurable rules
  • Defined validation and reconciliation rules for source-to-target accuracy, master data, calculations and missing data
  • Built exception management and root-cause workflows across ERP data, transformations and allocations
  • Re-engineered Oracle and ODI workloads as incremental ELT with reconciliation controls
  • Coordinated remediation with finance, FP&A and business owners before production reporting
5 finance and supply-chain pipeline domains under one framework
  • Quality KPIs, exception and reconciliation reporting owned in one place
  • Issues traced to source before reports are released
  • Governed Medallion lakehouse feeding Power BI
  • Azure Databricks
  • Delta Lake
  • PySpark
  • Spark SQL
  • Microsoft Fabric
  • Azure Data Factory
  • Oracle / ODI
  • Power BI

Online grocery, United Arab Emirates

A near-real-time lakehouse at less than a third of the cost

Client

A fast-growing online grocery delivery platform.

Challenge

The business needed fresher operational analytics from its PostgreSQL application databases and event streams, while platform costs were rising faster than usage.

Approach

  • Architected an Azure Databricks lakehouse on Delta Lake with Event Hubs ingestion
  • Implemented change data capture from PostgreSQL using Spark Structured Streaming
  • Built 50+ Azure Data Factory pipelines and analytics datasets for BI
  • Added validation, monitoring and reconciliation controls across pipelines
  • Optimised clusters, storage and compute, and led a distributed team of 15+ engineers and analysts
71% lower monthly platform cost, from $12,000 to $3,500
  • Near-real-time analytics from operational systems
  • Lower and predictable monthly spend
  • Stronger delivery governance and engineering quality
  • Azure Databricks
  • Delta Lake
  • Spark Streaming
  • Event Hubs
  • PostgreSQL CDC
  • Azure Data Factory

Telecommunications, Iraq

Medallion architecture and cloud modernisation for a mobile operator

Client

A mobile network operator in Iraq, engaged through a global management consultancy.

Challenge

Reporting accuracy and compliance depended on large, varied datasets without a consistent architecture for ingestion, validation and consumption.

Approach

  • Designed a three-layer Bronze, Silver and Gold architecture for enterprise analytics
  • Developed Data Factory and Databricks solution designs and integration patterns
  • Led client discovery and architecture reviews, translating needs into data models
  • Applied profiling, validation, governance and quality rules across datasets
3 governed layers from raw events to trusted analytics
  • Improved reporting accuracy and reliability
  • A clear modernisation path to the cloud
  • More efficient event pipelines and lower warehouse cost
  • Azure Data Factory
  • Azure Databricks
  • BigQuery
  • dbt
  • Talend
  • Python

Consumer technology, United Arab Emirates

Building and leading a data function for a loyalty and offers platform

Client

A consumer app offering loyalty and discount products across the region.

Challenge

Rapid growth created demand for customer, app and commercial analytics that ad hoc reporting could not meet.

Approach

  • Led the data engineering and BI teams as data engineering manager and acting head of data
  • Built an Azure data warehouse with batch and incremental pipelines and dimensional data marts
  • Implemented big-data processing with Spark SQL, Python and MongoDB
  • Standardised governance and reporting delivery in Power BI and Tableau
6 years leading data engineering and BI
  • Executive, customer and app analytics on governed datasets
  • Repeatable, standardised reporting delivery
  • Azure
  • Spark SQL
  • Python
  • MongoDB
  • Power BI
  • Tableau

Talk to a senior data architect, not a sales team

A 30-minute call to understand your platform and where it is holding you back. You will leave with practical next steps, whether or not we work together.