Delivering Real-Time Energy Intelligence For 50,000+ Connected Devices
AI Icon OpsTree AI Experience Center Explore Now →

Delivering Real-Time Energy Intelligence for 50,000+ Connected Devices

A leading IoT-powered automation provider, enabling energy and asset efficiency for commercial buildings across India and beyond. With 2,500+ deployments, 50,000+ connected assets, and 200M+ data points processed daily, the company helps enterprises achieve 10–20% energy savings through seamless monitoring and automation solutions.

The Problem Statement

The organization faced challenges in managing the growing scale of IoT operations. Massive data inflows made real-time analytics difficult, while storage demands continued to rise. At the same time, coordinating hundreds of cron jobs across microservices created operational complexity, leading to performance bottlenecks and impacting overall reliability.

Challenges

Massive Data Volumes

Processing and managing high-frequency IoT data streams from diverse sources without performance bottlenecks.

Real-Time Insights

Enabling immediate analytics and alerting to support timely decision-making.

Scalable Storage

Archiving large datasets efficiently while ensuring quick retrieval when needed.

Distributed Cron Jobs

Coordinating and monitoring numerous scheduled tasks across multiple microservices.

Complex Dependencies

Managing interlinked workflows and task execution sequences without errors.

Operational Reliability

Minimizing downtime through automated retries and robust failure recovery mechanisms.

Solutions

Kafka Integration

Implemented Kafka for high-throughput, real-time streaming, and reliable data ingestion from IoT devices.

Druid Deployment

Used Druid for fast analytics, ad-hoc queries, and scalable long-term data storage. 

Airflow Orchestration

Centralized cron management with Apache Airflow to schedule, monitor, and automate workflows across services. 

HA Configuration

Deployed Kafka, Druid, and Airflow in High Availability mode for maximum uptime and resilience.

Migrated 10 TB of legacy data to Druid for improved query performance. 

Kubernetes & Terraform

Automated infrastructure provisioning and scaling for consistent, repeatable deployments. 

Outcomes

Seamlessly migrated 10 TB of historical data to Druid without impacting ongoing operations.

Enabled ingestion and analysis of 1 Gbps IoT streaming data in real time. 

Achieved resilient Kafka, Druid, and Airflow deployments, ensuring minimal downtime and uninterrupted operations.

Consolidated 100+ disparate cron jobs into Airflow for better control and monitoring. 

Reduced complex query execution time from hours to just seconds or minutes.

Faster & Secure Software Delivery With BuildPiper!!

See the Impact We've Made

Achieving 300% Productivity Boost for an EdTech Leader with GenAI Using Amazon Bedrock

Read More

Uninterrupted live class streaming with 100k concurrent users

Read More
Get in Touch!
Experience Faster Time-to-Market
w

Possibilities ReImagined

w