Letting Data Speak!
Case Study
AWS Cloud-based Data Pipeline for Industry 4.0 Insights
About the Client
An Industry 4.0 solution provider serving the manufacturing industry
Challenge
The client needed to develop a comprehensive solution for manufacturing companies to gain business insights and enable data science applications. Multiple machines in manufacturing facilities were generating vast amounts of data points using Industry 4.0 devices and posting them to an MQTT endpoint. The challenge was to create an AWS cloud-based data pipeline to ingest this data and calculate fact tables for dashboard visualization and future data science purposes.
Key Results
Developed an AWS cloud-based data pipeline capable of processing data from multiple (100k+) Industry 4.0 devices sending messages every second
Created a scalable system to populate multiple fact tables for generating business insights at various organizational levels and time intervals
Implemented data APIs to provide seamless access to the data warehouse for a third-party application layer
Solution
The team implemented a comprehensive AWS-based solution to address the client's needs:
Utilized Confluent Kafka MQTT proxy to listen to MQTT messages from Industry 4.0 devices, mapping each MQTT topic to a universal Kafka topic
Developed multiple data pipelines using Python:A pipeline to ingest raw data from Confluent Kafka MQTT proxy into a PostgreSQL database A pipeline to process historical data and populate fact tables with business insights at various levels (hourly to yearly, machine to organization) A pipeline to synchronize master data from the application layer to the data warehouse
Created data APIs using Flask to provide requested data in JSON format, enabling the third-party team to generate violations and dashboards
Deployed the entire solution on AWS EC2 instances, with AWS Lambda functions for automated shutdown and restart to optimize cost management
Technologies Used
AWS (EC2, Lambda)
Confluent Kafka MQTT proxy
Python
PostgreSQL
Flask
MQTT
Other Case Study Items
IoT-based Cloud Platform for Medical Device Management
JashDS developed a comprehensive IoT-based cloud platform for a medical device management company, enabling efficient monitoring and control of anti-microbial devices across multiple facilities. The solution incorporated real-time telemetry handling, advanced analytics, and a user-friendly mobile application, resulting in 50% improved operational efficiency and better forecasting accuracy.
Optimizing CNC Machine Maintenance with AI
JashDS helped a leading Indian automotive manufacturer reduce unplanned CNC machine downtime by 30% and achieve 25% maintenance cost savings. By implementing AI-driven predictive maintenance using real-time data analysis and machine learning algorithms, we optimized performance and extended machine lifespan.
Optimizing Assembly Line Operations with Pick-to-Light System
JashDS revolutionized a diesel engine manufacturer's assembly lines by implementing a pick-to-light system across 36 stations, resulting in a 25% increase in efficiency. The solution integrated real-time monitoring, inventory management, and asynchronous multithreading to optimize high-volume production processes.