Architecture

Email notifications play a vital role in monitoring and troubleshooting potential issues while building data pipelines. Hence in this blog we will be using AWS SES to automate Emails when a particular condition, such as completion of a Data Pipeline is executed.

DevOps on the Cloud offers great flexibility for developers to collaborate on projects using native tools. In this blog post, we will be setting up a CI/CD pipeline on AWS for scalable deployment of ML applications/ Data Engineering Pipelines.

Apache Superset is a modern data exploration and visualization platform. Superset is fast, lightweight, intuitive and loaded with options that make it easy for users of all skill sets to explore and visualize the data. It can handle simple charts to highly detailed geospatial charts.

Farmer Suicides are a major issue in India due to various factors. One of the major concerns being the financial aspect of managing and …