Analyzing huge sensor data in near realtime with Apache Spark Streaming

2015-11-25 | #apache #bigdata #iot #pensource #spark

For this demo I downloaded and installed Apache Spark 1.5.1 Suppose you have a stream of data from several (industrial) machines likeMACHINE,TIMESTAMP,SIGNAL1,SIGNAL2,SIGNAL3,... 1,2015-01-01 11:00:01,1.0,1.1,1.2,1.3,.. 2,2015-01-01 11:00:01,2.2,2.1,2.6,2.8,. 3,2015-01-01 11:00:01,1.1,1.2,1.3,1.3,. 1,2015-01-01 11:00:02,1.0,1.1,1.2,1.4,. 1,2015-01-01 11:00:02,1.

Continue reading 


Howto collecting twitter data in 15 minutes

2015-10-16 | #Me

For this tutorial I assume you are using a Debian/Ubuntu Linux system but it could be easily adapted for other Openrating Systems Install the software apt-get install openjdk-7-jdk wget [http://apache.panu.it/karaf/4.0.2/apache-karaf-4.0.2.tar.gz](http://apache.panu.it/karaf/4.0.2/apache-karaf-4.0.2.tar.gz) tar xvfz apache-karaf-4.

Continue reading 