Pixis: A codeless AI infrastructure to nitro-boost your marketing.

Services used

• Amazon RDS: We leveraged Amazon RDS as our primary storage solution for various types of data including campaign data, ad accounts, cross-platform engagement score, ML datasets, tenant data, and more. By using Amazon RDS, we were able to easily manage and scale our relational databases while ensuring high availability and durability. 
• MQ: In our solution, we utilized MQ with RabbitMQ as a message broker to enable communication and coordination between our microservices. We configured it to handle long-running background tasks, such as processing recommendation data, image and video rendering, and other computationally intensive tasks, allowing for smoother and more efficient workflow management. 
• AWS Trusted Advisor: In our solution, we are using Trusted Advisor to identify overprovisioned resources and improve our security posture. By regularly running Trusted Advisor checks, we are able to stay on top of potential issues and ensure that our infrastructure is optimized for performance, security, and cost.
• AWS CloudTrail: AWS CloudTrail enables auditing, security monitoring, and operational troubleshooting by tracking user activity and API usage. The AWS CloudTrail logs, continuously monitors, and retains account activity related to actions across our AWS infrastructure.
• AWS ECR: In our solution, we utilized AWS ECR to securely manage and scan the Docker images of our microservices. This helped us maintain the reliability and security of our system while ensuring the high performance of our services. 
• NAT gateway: In our solution, we used NAT gateway to allow our resources in private subnets to securely access the internet and other AWS services, without exposing them directly to the public internet. 
• AWS Lambda: We used AWS Lambda to trigger and run machine learning pipelines and alerts.
• Redis: We leveraged Redis to store user sessions, which allowed us to easily retrieve session data and provide a better user experience. Additionally, Redis helped us reduce data access latency by caching frequently accessed data in memory, which reduced the need for costly database queries. 
• Amazon EKS: We leveraged Amazon EKS to easily manage and scale our microservices and background jobs on a containerized infrastructure. EKS provided us with a managed Kubernetes environment, allowing us to focus on application development and deployment without worrying about the underlying infrastructure. We used EKS to easily deploy, manage, and scale our containerized applications, and to automate container deployments and updates. 
• Amazon CloudWatch: We used AWS cloudwatch to generate alarms and for application log generation and as a monitoring solution to monitor the resource utilization metrics.
• Amazon S3 buckets: We leveraged Amazon S3 buckets as a highly scalable and secure storage solution for storing various types of data in our system, including configuration files and customer data files. With S3’s ability to store and retrieve any amount of data from anywhere on the web, we were able to easily manage, secure, and retrieve files whenever required.
• AWS SecurityHub: We utilized Security Hub to get a comprehensive view of our security state in AWS and to ensure our environment adhered to security industry standards and best practices.
• AWS NLB: We utilized AWS NLB as our load balancer to distribute incoming traffic across multiple targets in different availability zones. This helped us achieve higher availability and fault tolerance for our application.
• AWS Cloudwatch alarm: In our solution, we set up CloudWatch alarms to monitor various metrics such as CPU utilization, memory usage, and network traffic for our AWS resources. Whenever a metric crossed a threshold, an alarm was triggered and sent notifications to our team via email or SMS. 
• Amazon CloudWatch: In our solution, we used CloudWatch for logging and monitoring of various AWS native services such as Amazon RDS and Amazon MQ. We were able to set up customized metrics, dashboards, and alarms to monitor the health of our infrastructure and quickly respond to any issues.
• AWS secrets manager: In our solution, we used AWS Secrets Manager to store and manage the secret data of our microservices, including database credentials, API keys, and other sensitive information. This helped us keep our secrets secure and easily manage and retrieve them when needed.
• Fluent bit: We deployed Fluent Bit as our log processor and forwarder to collect, process, and forward logs from our microservices to AWS CloudWatch. This helped us gain real-time visibility into our application and infrastructure logs and make informed decisions based on the insights provided by the log data.
• Grafana: We used them for infrastructure and service monitoring. Using these tools, we help the client monitor various data points related to the infrastructure and applications, such as:
  • Number of containers running
  • ML pipeline status
  • CPU percentage
  • RAM usage at a cluster level
  • Services running currently
  • Node-level monitoring
  • Network traffic
  • Disk I/Os

Using these monitoring tools, Simform can proactively identify and resolve issues before they impact end-users, ensuring a high level of performance and availability for the client’s microservices-based architecture.