What is data mesh?
Much in the same way that software engineering teams transitioned from monolithic applications to micro service architecture.The data mesh in many ways is the data platform version of micro services.
Data mesh is a decentralised approach to share, access, and manage data in complex and large scale environment.
Data mesh is a new approach in sourcing, managing, and accessing data for analytical use cases at scale.
What are data mesh principles?
There are 4 core principles embodied in data mesh to achieve scalability while delivering quality and integrity.
1) Data as a product.
2) Federated Computational Governance.
3) Domain-oriented decentralized data ownership.
4) Self-Serve Data Infrastructure as a platform.
Data as a product: So each domain operates its data end to end. Accountability lies with the data owner within the domain. Because Pipelines in this respect become a first-class concern of the domains themselves.
Federated computational governance: So to ensure that each data owner can trust the others and share its data products, an enterprise data governance body must be established to implement data quality, central visibility of data ownership, data access management, and data privacy policies.
Domain-oriented decentralized data ownership: So the enterprise should ideally define and model each data-domain node within the mesh by applying the principles of domain-oriented and design.
Self-Serve data infrastructure as a platform: So a data mesh requires a self-serve data platform that allows users to abstract the technical complexity and also focus on their individual data use cases.
So what are the Datamesh Benefits?
1. So Faster Access and Accurate Data Delivery
2. Flexibility and Independence
3. Cross-Functional Teams for Improved Transparency
4. Robust Data Governance for End-to-End Compliance
5. Improved Agility and Scalability
6. Platform Connectivity and Data Security
7. So Data Security
