Lambda Function Setup Guide for Security Group Event Notifications in Slack

Overview

This document provides a step-by-step guide to creating a Lambda function that sends notifications to Slack when a security group rule is modified in AWS.

Prerequisites

  1. AWS Account with necessary permissions to create and configure Lambda, IAM, CloudTrail, and CloudWatch Logs.
  2. Slack workspace with permissions to create a new app and generate an incoming webhook URL.

Architecture

Security Group Rule Event -> CloudTrail -> CloudWatch Logs -> Lambda Function -> Slack Continue reading “Lambda Function Setup Guide for Security Group Event Notifications in Slack”

Advanced-Data Modeling Techniques for Big Data Applications

As businesses start to use big data, they often face big challenges in managing, storing, and analyzing the large amounts of information they collect.

Traditional data modeling techniques which were designed for more structured and predictable data environments, can lead to performance issues, scalability problems, and inefficiencies when applied to big data. Continue reading “Advanced-Data Modeling Techniques for Big Data Applications”

Lambda Function Setup Guide for IAM Event Notifications in Slack

Overview

This document provides a step-by-step guide to creating a Lambda function that sends notifications to Slack when:

  • A new IAM user is created.
  • A permission (policy) is attached to an IAM user.

Prerequisites

  1. AWS Account with necessary permissions to create and configure Lambda, IAM, CloudTrail, and CloudWatch Logs.
  2. Slack workspace with permissions to create a new app and generate an incoming webhook URL.

Continue reading “Lambda Function Setup Guide for IAM Event Notifications in Slack”

Integration of Prometheus with Cortex

As we promised in our previous blog Prometheus as Scale – Part 1 that in our next blog we will be writing about the implementation part of Cortex with Prometheus, so here we are with our promise. But before going to the implementation part, we would suggest you guys go through our first blog to know the need for it.

Previously we talked that Prometheus is becoming a go-to option for people who want to implement event-based monitoring and alerting. The implementation and management of Prometheus are quite easy. But when we have a large infrastructure to monitor or the infrastructure has started to grow you require to scale monitoring solution as well.

A few days back we were also in a similar kind of situation where one of our client’s infrastructure was growing as per the need and they need a resilient, scalable, and reliable monitoring system. Since they were already using the Prometheus, so we explored our option and came across an interesting project called “Cortex“.

Continue reading “Integration of Prometheus with Cortex”

Introduction To Inodes

Today we had an interesting problem for a project. We were getting the message ‘disk is full’ despite having plenty of free space. Luckily my first thought was ‘inodes?’

 I logged in and checked inode usage

$ df -i
Filesystem   Inodes    IUsed    IFree   IUse% Mounted on
/dev/xvda1   525312   524844   468   100%   /
tmpfs           1007942   1102  1006840    1% /run

This shows that all the inodes on the disk itself are full.

 High inode usage is usually caused by a massive number of small files. In this case, the session files are normally stored somewhere temporary and removed when not in use. Either there could have been a bug in the code not removing them or it was a higher traffic website.

So we can see that inode is a very important aspect of Linux, so this blog will take u to a detailed journey to inodes.

Continue reading “Introduction To Inodes”