Skip to main content

Architecture

Overview​

The following diagram illustrates the architecture of the Stream2Vault (S2V) platform, showcasing its integration with enterprise services and its interaction with users. Here’s a breakdown of the key components and their relationships:

img alt

Stream2Vault Service​

This is the core backend service of the Stream2Vault platform, responsible for validating and generating metadata and configurations needed for Data Vault automation.

  • It communicates directly with the S2V Client for validating and generating outputs.
  • It integrates with the Authentication Service to validate user credentials and permissions.

Organisation Enterprise Services​

Authentication Service​

Handles user authentication for both the S2V Client and the S2V Service. Ensures secure access to enterprise resources, such as Git repositories and databases.

Git Service​

Manages code generated by the S2V Service, enabling version control and collaboration. Acts as a bridge between the generated metadata/code and the organisation's CI/CD pipelines for automated deployment.

Database Service​

Receives and stores the deployed Data Vault structures. Works as the target system for Data Vault objects generated and validated by the Stream2Vault platform. Deployments are managed through the CI/CD pipeline, ensuring automated, seamless integration into the database environment.

Stream2Vault Client​

The S2V Client is the interface used by data modelers and other stakeholders. It enables data modeling, where users design or modify the metadata and Data Vault objects. It interacts with the S2V Service to validate and generate configurations for deployment. Authenticates with the Authentication Service to ensure secure operations within the organisational environment.

Workflow​

Authentication​

The user authenticates via the S2V Client, which in turn interacts with the enterprise Authentication Service. The S2V Service also verifies its connection with the Authentication Service.

Validation and Generation​

The user performs data modeling tasks through the S2V Client, which passes the inputs to the S2V Service for validation and generation.

Code Management​

Generated outputs are managed through the Git Service, enabling version control and integration into enterprise CI/CD pipelines.

Deployment​

The CI/CD pipeline handles the deployment of validated configurations to the Database Service, ensuring efficient and automated Data Vault deployment.

Summary​

This architecture ensures seamless collaboration between the Stream2Vault platform and organisational enterprise services. It integrates secure authentication, robust code management, and automated deployments, providing a streamlined experience for data modelers and technical teams.