Emerging technologies relating to big data

Big data processing framework:

Distributed Computing Platform:

Apache ZooKeeper: A highly available, scalable, distributed, configuration, consensus, group membership, leader election, naming, and coordination service, which implements a degenerated version of Paxos algorithm, called ZAB (a total ordered broadcast protocol).

HBase:

Graph processing:

Advertisements

Server Virtualization Comparision

Please visit the following links for more details:

Docker

Introduction into Docker: Difference to other virtualization technology

References about Docker: container technology

Business Insights: (Container Technology)

Docker Container:

Docker Configuration:

Docker Swarm:

Docker Issues and Pitfalls:

  • [see only one docker nodes in docker swarm infos]:
    The Docker nodes were all copies of the same virtual machine that had already started Docker before cloning, which ended up creating the same Docker ID in /etc/docker/key.json. I stopped Docker, removed the key file, and then restarted so each daemon would create a new key file.
    Reference: https://forums.docker.com/t/docker-swarm-issues/2132

Links relating to Cloud Computing

How Amazon’s cloud works:
http://www.enterprisetech.com/2014/11/14/rare-peek-massive-scale-aws/

AWS Introductions:
Introduction to Amazon Elastic Compute Cloud (EC2)
Introduction to Amazon Simple Storage Service (S3)
AWS Compliance Shared Responsibility Model
Introduction to Amazon VPC
Amazon Elastic Compute Cloud User Guide for Linux
Introduction to Amazon Elastic Map Reduce (EMR)

NIST Cloud Definition:
http://www.nist.gov/itl/cloud/index.cfm

MapReduce:
https://ittec.wordpress.com/2015/09/02/mapreduce/ (related own blog post)

Cloudonomics:
A Rigorous Approach to Cloud Benefit Quantification (Cloudonomics)

OpenStack:
Deploying OpenStack with Fuel (OpenStack Training Video)

Microsoft Azure:
Azure for DreamSpark registration
Microsoft Azure user login page
Microsoft Azure Portal page

Microsoft Azure: (German language links)
DreamSpark Azure Subscription (German)
Tutorial how to use dreamspark (German)

Cloud IDEs

Just found an article  about the pros and cons of Cloud IDEs by Natasha Tasha from Hongkiat.com:

http://www.hongkiat.com/blog/cloud-ide-developers/

Take a look at this article, maybe it will be a help. My experience with Cloud9 is great, the only thing, which still can be improved, is that cloud9 is not running in IE10/11 by the time of this blog post.