Designing Scalable Data Architectures That Support Continuous Regulatory Oversight
Main Article Content
Abstract
The paper discusses the application of an extension of a simple lakehouse architecture, one that employs a compliance fabric to provide a better reliability, the lineage of data, as well as the enforcement of policy usage of workloads of corporate taxes. The comparison between the original architecture and the enhanced compliance based system is made through conducting controlled tests on ingestion, transformation, lineage completeness, and audit readiness. The finding shows that automatic policy checks and lineage capture do not reduce the performance because they minimize the metadata gaps and improve consistency. The study also indicates higher traceability on the processing of various steps and lesser error in compliance in reporting. The results reveal that the compliance layers introduced to a lakehouse increase the levels of trust, quality, and regulatory compliance.