Nifi Cluster Setup with External Zookeeper

Apache NiFi is an open-source data integration and automation tool that enables the automation of data flow between different systems. NiFi provides a user-friendly interface to design, control, and manage the flow of data between various sources and destinations. The tool is particularly useful in handling data from different sources, applying transformations, and routing it to different systems in real-time.

Why use the Nifi cluster over the standalone?

  • Performance: Clusters can handle higher throughput and provide better performance than standalone instances due to load distribution.
  • Fault Tolerance: Clusters provide high availability and fault tolerance such as if one node fails, the other nodes take over the processing.
  • Scalability: Clusters allow for scalability by adding more nodes, whereas standalone instances have limitations in scaling.


Continue reading “Nifi Cluster Setup with External Zookeeper”

The Fallacies of Platform Engineering

Delve into the intricacies of implementing platform engineering strategies and the misconceptions that surround it.

In today’s rapidly evolving tech landscape, the significance of platform engineering cannot be overstated. It serves as the bedrock upon which countless digital ecosystems are built, from mobile applications to cloud-based services and everything in between. Yet, for all its importance, the world of platform engineering is riddled with misconceptions & misunderstandings that can lead to costly mistakes, project delays and suboptimal outcomes. To navigate this complex terrain successfully, it is crucial to identify and address these fallacies head-on.

By exposing these fallacies and offering insights into platform engineering best practices, we aim to empower engineers, developers and decision-makers to make more informed choices and in turn, create more robust and effective platforms.

Throughout this exploration, we’ll delve into the intricacies of implementing platform engineering strategies, examining its core principles and the misconceptions that surround it. We’ll also discuss real-world examples and case studies to illustrate the consequences of falling prey to these fallacies. 

Continue reading “The Fallacies of Platform Engineering”

Securing Nifi Cluster with TLS Toolkit

Apache NiFi is an easy-to-use, powerful, and reliable system to process and distribute data. As data flows between different systems it’s a good practice to ensure the integrity of the data being processed. Securing a NiFi cluster is essential for various reasons, primarily to protect sensitive data, ensure system integrity, and prevent unauthorized access. Apache NiFi provides a TLS toolkit using which we can self-sign Certificate Authority (CA) and easily issue and sign certificates in the format expected by NiFi. Continue reading “Securing Nifi Cluster with TLS Toolkit”

Enabling CORS on Azure APIM

You can set up cross-origin resource sharing (CORS) using the built-in CORS policy in Azure API Management or by adjusting the automatically available settings in the overview of the developer portal.

What is Azure API Management?

Azure API Management is a comprehensive platform provided by Microsoft Azure that allows organizations to create, publish, secure, and analyze APIs. Whether you’re exposing APIs to external developers or managing internal APIs within your organization, Azure APIM simplifies the process and offers a range of features to ensure your APIs are both accessible and secure.

Key Features of Azure APIM:

1. API Gateway: Azure APIM acts as a gateway between your APIs and consumers. It handles requests, routing, and caching, improving API performance and reliability.

2. Security and Authentication: Secure your APIs with authentication, authorization, and OAuth support. Set up rate limiting and IP filtering to protect against abuse.

3. Developer Portal: Provide a developer-friendly portal where external developers can discover and consume your APIs. Publish documentation, code samples, and interactive API testing tools.

Continue reading “Enabling CORS on Azure APIM”

The 7 Core Elements of an Internal Developer Platform

Delve into the pivotal aspects of IDP and DevOps integration. Also, explore the fundamental components that constitute the bedrock of an Internal Developer Platform.

In the ever-accelerating world of software development, the need for agile and efficient workflows has never been more crucial. As organizations strive to stay ahead in this digital era, they are increasingly turning to Internal Developer Platforms (IDPs) as a key strategy to supercharge their development processes. 

Scaling with Internal Developer Platforms contributes to faster delivery, improved ROI, reduced time to market and improved business growth. An IDP is a comprehensive ecosystem of tools, services and best practices meticulously designed to empower developers, streamline workflows and expedite the delivery of software products.

In this blog, we embark on an exploration of the fundamental components that constitute the bedrock of an Internal Developer Platform – the seven core elements that drive innovation, collaboration and efficiency in the realm of software development. 

From self-service infrastructure to robust security measures, these elements are the building blocks of modern software development excellence. Join us on this journey as we delve into the pivotal aspects of IDP and DevOps integration. Discover how IDP and Microservices development is revolutionizing how software is created, delivered and maintained in the digital age.

Continue reading “The 7 Core Elements of an Internal Developer Platform”