Recently I have completed a data centre migration project for a major university. The project involved migrating the on-premise data centre to the AWS. I come from an application development background, but when I got the opportunity to work on the project, I wholeheartedly seized it, one chief reason being the sheer importance and scale… Continue reading Securing a monolith API in AWS – DNS comes to the rescue.
You have a problem: – As a project manager, you are under pressure; the developers have finished developing the application and waiting to deploy it to an environment. The team has developed a modernized web portal for the existing loyalty program. It has a web application developed in Java with a Node.js backend API which… Continue reading From nowhere to AWS: A proposal
Nine out of ten individuals who have come to this article likely have coded a monolith application or definitely at least have interacted with one, and the sole individual who has to google the meaning of monolith is a developer in Netflix who started his/her career a few years back. Yes, there are monoliths everywhere,… Continue reading Microservice Architecture: A realization.
In this post, I am going to tangentially touch a very complex and vast topic of load balancing the application and database and will design a possible HA application architecture. When someone mentions load balancing in IT, one perhaps immediately thinks of solutions or approaches to clustering the application servers to distribute the client requests… Continue reading Architecting high availability design
Cloud Foundry is a Platform as a Service, that is PaaS, it helps in rapid application development by freeing developer from the hassle of application deployment and subsequent management of the run time. There are numerous tutorials out on internet to learn Cloud Foundry architecture and concepts therefore I will not focus on explaining CF… Continue reading Rapid Application Development with Cloud Foundry
In this blog I am going to give introduction about using the Spring Cloud Eureka for service registry and Ribbon for client side load balancing. The purpose of this blog is to show a setup using these technologies on AWS, and share tips and troubleshooting information. I will provide code snippet wherever possible. The focus… Continue reading Spring Boot, Netflix Eureka and Ribbon
This post is part of the series of posts in which I will evaluate various big data tools. In this blog I will show how to use zeppelin to do some data science. Zeppelin is very easy to use and there are various videos and tutorials out on the web to know it. My focus… Continue reading Datascience with zeppelin
In this post I have shown how to connect end to end Spark, MongoDB, Rest interface and web client to consume rest service created using Spring boot on Azure. This post is an addition to my previous post of streaming analysis of twitter data on Azure using Spark. Here I will show how to give… Continue reading Integrate Spring boot Rest API, Spark, MongoDB and Azure
This post is about streaming analysis of live twitter data on Azure using spark on HORTONWORKS and persisting data to mongodb. With this post also the main idea is to help out flocks in troubleshooting. I will post issues which came up with this approach. In my previous post I used AWS and HBase with… Continue reading Streaming analysis of Twitter data using HDP2.4, Spark, Mongodb on Azure
This post is third in the series ‘Spark streaming troubleshooting on cloudera 5.9 AWS cluster’. Here I have integrated HBase with the spark streaming. Relevant data has been extracted from the live twitter tweets related with USA election results and saved to table electionSentiments on HBase. For this I used 5 worker nodes, 1 gateway… Continue reading Spark streaming troubleshooting on cloudera 5.9 AWS cluster:Part3