Emerging technologies relating to big data

Big data processing framework:

• Introduction into Apache Spark: http://www.infoq.com/articles/apache-spark-introduction
• Start with Spark: http://spark.apache.org/documentation.html
• Streaming processing framework (Apache Storm): https://storm.apache.org/

Distributed Computing Platform:

• Project Page of Apache Mesos : http://mesos.apache.org/
• Apache Yarn: http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html

Apache ZooKeeper: A highly available, scalable, distributed, configuration, consensus, group membership, leader election, naming, and coordination service, which implements a degenerated version of Paxos algorithm, called ZAB (a total ordered broadcast protocol).

• Apache ZooKeeper: https://zookeeper.apache.org/

HBase:

• hbase shell https://learnhbase.wordpress.com/2013/03/02/hbase-shell-commands/

Graph processing:

• pregel: http://people.apache.org/~edwardyoon/documents/pregel.pdf
• giraph: http://giraph.apache.org/

Advertisements