SAP SAC monitoring data pipeline loading usage stats into SAP Datasphere
The project provides a Python‑based pipeline that pulls monitoring data from SAP Analytics Cloud, cleans and transforms it, then loads it into SAP Datasphere using atomic transactions. It handles pagination, UTF‑8 BOM issues, HTTP 429 retries, and OAuth token refresh, ensuring reliable, idempotent runs. Designed for SAP BTP Cloud Foundry deployments, it serves data engineers needing automated, repeatable ingestion of SAC usage metrics. Its built‑in logging, schema‑drift detection, and rollback mechanisms make it more resilient than ad‑hoc scripts.
Visit author’s GitHub →SinanOtc/btp-datapipeline