Cloud Foundry is a Platform as a Service, that is PaaS, it helps in rapid application development by freeing developer from the hassle of application deployment and subsequent management of the run time. There are numerous tutorials out on internet to learn Cloud Foundry architecture and concepts therefore I will not focus on explaining CF… Continue reading Rapid Application Development with Cloud Foundry
In this blog I am going to give introduction about using the Spring Cloud Eureka for service registry and Ribbon for client side load balancing. The purpose of this blog is to show a setup using these technologies on AWS, and share tips and troubleshooting information. I will provide code snippet wherever possible. The focus… Continue reading Spring Boot, Netflix Eureka and Ribbon
This post is part of the series of posts in which I will evaluate various big data tools. In this blog I will show how to use zeppelin to do some data science. Zeppelin is very easy to use and there are various videos and tutorials out on the web to know it. My focus… Continue reading Datascience with zeppelin
In this post I have shown how to connect end to end Spark, MongoDB, Rest interface and web client to consume rest service created using Spring boot on Azure. This post is an addition to my previous post of streaming analysis of twitter data on Azure using Spark. Here I will show how to give… Continue reading Integrate Spring boot Rest API, Spark, MongoDB and Azure
This post is about streaming analysis of live twitter data on Azure using spark on HORTONWORKS and persisting data to mongodb. With this post also the main idea is to help out flocks in troubleshooting. I will post issues which came up with this approach. In my previous post I used AWS and HBase with… Continue reading Streaming analysis of Twitter data using HDP2.4, Spark, Mongodb on Azure
This post is third in the series ‘Spark streaming troubleshooting on cloudera 5.9 AWS cluster’. Here I have integrated HBase with the spark streaming. Relevant data has been extracted from the live twitter tweets related with USA election results and saved to table electionSentiments on HBase. For this I used 5 worker nodes, 1 gateway… Continue reading Spark streaming troubleshooting on cloudera 5.9 AWS cluster:Part3
This is second part of spark streaming troubleshooting on cloudera hadoop cluster on aws. Here I will focus on the code- I created an application to process the live tweets which contains words related with USA 2016 elections. Below program connects to twitter and fetches tweets which have words such as Hillary, Donad, Trump, Obama, Clinton… Continue reading Spark streaming troubleshooting on cloudera 5.9 AWS cluster:Part-2
