from d -7 latency to real -time: the convergence of data mesh and event -driven architectures (EDA) in the orchestration of scalable financial ecosystems
from d -7 latency to real -time: the convergence of data mesh and event -driven architectures (EDA) in the orchestration of scalable financial ecosystems
DOI:
https://doi.org/10.51473/rcmos.v2i2.2022.1880Keywords:
Data Mesh. Event -Driven Architecture. Financial Systems. Data Latency. Data Engineering. Real -Time.Abstract
This article proposes a robust architectural model for large financial corporations facing the challenge of migrating from monolithic Data Warehouses and batch processes to federated ecosystems based on the Data Mesh paradigm. The central focus of the ana lysis lies in the drastic reduction of latency in data ingestion and consumption, addressing the transition from seven -day processing windows (D -7) to real -time (Online). Through an analytical approach grounded in software engineering and distribut ed systems theory, it investigates how the implementation of Event -Driven Architectures (EDA) acts as the necessary connective tissue to enable the decentralization proposed by Data Mesh. The case study presents the reverse engineering of a real digital tr ansformation, discussing the technical challenges of eventual consistency, computational governance in data meshes, and the strategic centralization of event consumption as a catalyst for the Customer 360º vision. The research concludes that the integration between autonomous data domains and continuous information f lows is the only sustainable path for competitiveness in the modern financial sector.
Downloads
References
BREWER, ERIC. CAP twelve years later: how the “rules” have changed. Computer, v. 45, n. 2, p. 23–29, 2012. DOI: https://doi.org/10.1109/MC.2012.37
DEHGHANI, ZHAMAK. Data mesh: delivering data-driven value at scale. Sebastopol: O’Reilly Media, 2020.
EVANS, ERIC. Domain-driven design: tackling complexity in the heart of software. Boston: Addison-Wesley Professional, 2003.
HOHPE, GREGOR; WOOLF, BOBBY. Enterprise integration patterns: designing, building, and deploying messaging solutions. Boston: Addison-Wesley Professional, 2003.
INMON, WILLIAM H. Building the data warehouse. 4. ed. Indianapolis: Wiley, 2005.
KIMBALL, RALPH; ROSS, MARGY. The data warehouse toolkit: the definitive guide to dimensional modeling. 3. ed. Indianapolis: Wiley, 2013.
KLEPPMANN, MARTIN. Designing data-intensive applications: the big ideas behind reliable, scalable, and maintainable systems. Sebastopol: O’Reilly Media, 2017.
KREPS, JAY. I heart logs: event data, stream processing, and data integration. Sebastopol: O’Reilly Media, 2014.
NEWMAN, SAM. Building microservices: designing fine-grained systems. 2. ed. Sebastopol: O’Reilly Media, 2021.
STOPFORD, BEN. Designing event-driven systems: concepts and patterns for streaming services with Apache Kafka. Sebastopol: O’Reilly Media, 2018.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2022 Willian Gouveia de Aguiar (Autor)

This work is licensed under a Creative Commons Attribution 4.0 International License.




