-
Frontend: (Staticc Web Assets)
- Built with React.js
- Hosted on AWS S3 and served via AWS CloudFront for low latency and high availability.
- Authentication handled via AWS Cognito.
- Provides a user-friendly interface for users to interact with the portal.
-
Backend: (API Layer)
- Amazon API Gateway -> AWS Lambda functions which is implementing the operations such as register event, view events, subscribe etc.
-
Database: (Data Storage)
- Amazon DynamoDB for storing event definitions, schema, versioning etc 4 Subscription Notification:
- Send notification to the broker's control plane to update routing rules.
-
Ingestion Layer:
- HTTPS Ingestion: It can put message in SQS Ingestion Queue
- SQS Ingestion: Producers can send directly to the SQS Ingestion Queue
- SNS Ingestion: Producers publish to SNS Topic then SNS subscription to the SQS Ingestion Queue
- Event Bridge Ingestion: Producers can send events to Event Bridge which has a rule to route to the SQS Ingestion Queue
-
Validation Pipeline:
- SQS Ingestion Queue will forward messages to the Lambda Validation Function
- Default Batch Size can be 10 and can be configured based on the use case
- Fetch Schema from DynamoDb and validate payload against the JSON Schema
- Enrich the metadata such as timestamp, trace id etc
- If validation fails, send the message to the DLQ
- If validation is successful, send the message to the Event Bridge Central Bus
-
Event Routing:
-
Monitoring and Logging:
- Use AWS CloudWatch for monitoring the metrics such as number of events ingested, validation failures, routing failures etc
- Use AWS CloudWatch Logs for logging the validation errors, routing errors etc
-
Security:
- Use AWS IAM for fine-grained access control to the resources
- Use AWS KMS for encrypting the data at rest and in transit
-
Scalability and High Availability:
- All components are serverless and can scale automatically based on the load
- Use multiple Availability Zones for high availability
-
Cost Optimization:
- Use AWS Lambda with provisioned concurrency for predictable workloads
- Use S3 Intelligent-Tiering for storing static web assets
- Use DynamoDB On-Demand for unpredictable workloads