A blog site on our Real life experiences with various phases of DevOps starting from VCS, Build & Release, CI/CD, Cloud, Monitoring, Containerization.
Continue reading “From Messy Logs to Structured Analytics using AWS S3, Lambda, and Athena”
When managing infrastructure-as-code using Terraform, the state file is a key component, as it keeps track of what resources are associated with your configuration and how they are configured relative to one another. Teams will suffer from corrupted state and conflicting updates if they are left on their own to store and coordinate state.As teams compete for overall dominance, resources are neglected. Continue reading “Terraform state locking with S3 and DynamoDB explained”
The Amazon Simple Storage Service, or S3, is a powerful serverless object storage solution that offers exceptional scalability, availability, security, and performance. According to the official description, it enables users across all sectors to securely store any volume of data for various applications. To enhance cost-efficiency, security, and compliance, S3 provides a wide range of configuration options tailored to meet diverse business needs. Continue reading “Amazon S3 Security Essentials: Protect Your Data with These Key Practices”
We were fortunate enough to get an opportunity to do an Elasticsearch cluster snapshot and restore on a production highly active cluster. The indices we needed to restore were around 2 – 3 TB in size.
Our task was to take a snapshot from an old cluster (v 6.4.2) which had several huge indices and restore a few of them to a new cluster (v7.9.2). This endeavour was supposed to bring the load down from the old cluster.
Continue reading “Elasticsearch Backup and Restore in Production”
