Salesforce Commerce Cloud Data Engineering Pipeline

Project Objective

Design and implement a scalable, production-ready data engineering pipeline that ingests Salesforce Commerce Cloud (SFCC) REST API data, processes nested JSON structures, and delivers analytics-ready datasets to a data warehouse using Azure Databricks and Lakehouse architecture.

Architecture Overview

🛠️Software Toolkits:

Pipeline Highlights

  •  Incremental data extraction from SFCC REST APIs (Customers, Orders, Products)
  •  Raw JSON ingestion(Bronze layer) and storage in ADLS Gen2 Archive
  •  Nested JSON flattening and schema normalization using Databricks (Silver layer)
  •  Incremental loads using watermark strategy
  •  Dimensional modeling (fact & dimension tables) for analytics
  •  Gold-layer analytics datasets optimized for BI & reporting

Connect with me:

✉ Reach me:
jharajnish@outlook.in