DevOps Archives - Page 20 of 91 - DEVOPS DONE RIGHT.

Nifi and Zookeeper Cluster Setup with Terraform

Recently while trying to set up Apache Nifi in cluster mode manually, I faced the challenge of performing same tasks on all nodes manually. In addition configuring the right cluster configurations was not easy. In my last blog here, I have covered the advantages of having nifi cluster over standalone and the manual steps to configure a Nifi cluster with external zookeeper.
In this article, I will show you how you can set up a three-node Zookeeper and Nifi cluster with terraform which will minimize the steps we have to perform with manual setup.

Apache NiFi is an open-source data integration and automation tool that enables the automation of data flow between different systems. NiFi provides a user-friendly interface to design, control, and manage the flow of data between various sources and destinations. The tool is particularly useful in handling data from different sources, applying transformations, and routing it to different systems in real-time.

Advantage of Using Terraform for Nifi

Terraform allows you to define your NiFi cluster infrastructure as code, making it easily versioned, shareable, and easy to understand. This ensures that your infrastructure is consistent across different environments. This helps in maintaining consistency and reducing the chances of configuration drift. As your NiFi cluster requirements evolve, Terraform makes it simple to scale your infrastructure up or down by adjusting the configuration.

Setting Up Apache Nifi Cluster with External Zookeeper

The Role of RBAC in Securing Your CI/CD Pipeline

Explore the importance of implementing RBAC in CI/CD pipelines and how it helps in protecting the integrity and confidentiality of software development processes.

Role-based Access Control (RBAC) is a security solution developed to facilitate access to user permissions in a system according to their roles and responsibilities. Although RBAC is the basis of access management in many domains, the significance of RBAC in CI/CD pipelines just can not be ignored. From preventing unauthorized modifications of sensitive code repositories to risks associated with security threats, RBAC is an important aspect of protecting the integrity and confidentiality of software development processes.

This blog will discuss the importance of implementing RBAC in CI/CD pipelines, analyzing why enterprises should implement access controls in their application delivery processes. By analyzing and implementing the core principles of RBAC and its effect on pipeline security, teams are empowered to efficiently manage threats, promote teamwork and make the workflow seamless. Explore what value RBAC bring to enhance the security of the CI/CD pipeline from new attack vectors and threats. So, let’s dive in!

Cassandra to ScyllaDB Migration Without Any Downtime

Enterprises need multiple things to run their business successfully. One of the critical things is the data store they use for storing the data that applications and different analytics platforms will use. To ensure that business is healthy, companies need reliable databases, and according to their tech budget and expertise, they choose databases.

While working and consulting with an enterprise, they ran Cassandra to support their NoSQL data-store operations. Cassandra was working really well but now when the company grew, they needed help to support the NoSQL store. They experienced cascading latencies by Cassandra Hot’s partition as the traffic increased with the events and campaigns. Also, garbage collection was becoming the bottleneck because it heavily impacted the database performance, resulting in poor application performance. Also, one more significant reason was that they wanted to avoid managing the database and were looking for an expert company that could manage it for them without significant application changes.

Why ScyllaDB?

While exploring the different solutions for the database, ScyllaDB caught our attention. We were curious about the solution and did multiple proofs of concept on the ScyllaDB. We finally decided this would be the right choice for our environment and scale. A few primary reasons for our decision were:

Introduction

Why ScyllaDB?