Oracle Big Data Appliance Software / Service Roles Layout on V2.1.1

Asset ID:	1-79-1546586.1
Update Date:	2013-08-12
Keywords:

Solution Type Predictive Self-Healing Sure

Solution 1546586.1 : Oracle Big Data Appliance Software / Service Roles Layout on V2.1.1

Applies to:

Big Data Appliance Integrated Software - Version 2.1.1 and later
Big Data Appliance X3-2 Starter Rack - Version All Versions to All Versions [Release All Releases]
Big Data Appliance X3-2 In-Rack Expansion - Version All Versions to All Versions [Release All Releases]
Big Data Appliance X3-2 Hardware - Version All Versions to All Versions [Release All Releases]
Big Data Appliance X3-2 Full Rack - Version All Versions to All Versions [Release All Releases]
Linux x86-64

Purpose

The information provided will show the software layout where services run on Oracle Big Data Appliance (Sun Fire X4270 M2 or Oracle Big Data Appliance X3-2) Full Rack and Starter Rack installations when using Mammoth version 2.1.1.

Scope

This is intended for the BDA Administrator as well as for developers.

Details

Overview

The information provided describes the software services layout on Oracle Big Data Appliance (BDA) (Sun Fire X4270 M2 or Oracle Big Data Appliance X3-2) Full Rack and Starter Rack installations when using Mammoth version 2.1.1. The table below shows the service type, the service roles, and node name for the servers in the Big Data Cluster. The table below also describes the node that each service runs on. All services are installed on all servers, but individual services run only on designated nodes in the Hadoop cluster. The table will show the nodes where the services run on the primary rack. Services that run on all nodes run on all racks of a multi-rack installation.

Note: For 6-node Starter Rack clusters TaskTrackers also reside on Node01 and Node02. The next smallest cluster supported is nine nodes and all clusters with sizes of nine nodes and up will have the standard 18-node layout as shown in the BDA Full Rack column. For clusters of size nine nodes or more, TaskTrackers will not reside on Node01 and Node02.

Service Type	Service Role	Node Name	Oracle Big Data Appliance Starter Rack	Oracle Big Data Appliance Full Rack
Cloudera Management Services	Cloudera Manager Agents	All nodes	Node01 to Node06	Node01 to Node18
Cloudera Management Services	Cloudera Manager Server	JobTracker node	Node03	Node03
HDFS	Balancer	First NameNode	Node01	Node01
HDFS	DataNode	All Nodes	Node01 to Node06	Node01 to Node18
HDFS	Failover Controller	First NameNode and Second NameNode	Node01 and Node02	Node01 and Node02
HDFS	First NameNode	First NameNode	Node01	Node01
HDFS	JournalNode	First NameNode, Second NameNode, JobTracker node	Node01 to Node03	Node01 to Node03
HDFS	Second NameNode	Second NameNode	Node02	Node02
Hive	Hive Server	JobTracker node	Node03	Node03
Hue	Beeswax Server	JobTracker node	Node03	Node03
Hue	Hue Server	JobTracker node	Node03	Node03
MapReduce	JobTracker	JobTracker node	Node03	Node03
MapReduce	TaskTracker	All non-critical nodes	Node01, Node02, Node04, Node05, Node06	Node04 to Node18
MySQL	MySQL Backup Server	Second NameNode	Node02	Node02
MySQL	MySQL Master Server	JobTracker node	Node03	Node03
NoSQL (If selected to be installed)	Oracle NoSQL Database Administration	Second NameNode	Node02	Node02
NoSQL (If selected to be installed)	Oracle NoSQL Database Server processes	All nodes	Node01 to Node06	Node01 to Node18
ODI (If selected to be installed and Big Data Connectors are licensed)	Oracle Data Integrator Agent	JobTracker node	Node03	Node03
Oozie	Oozie Server	JobTracker node	Node03	Node03
Puppet	Puppet Agents	All nodes	Node01 to Node06	Node01 to Node18
Puppet	Puppet Master	First NameNode	Node01	Node01
ZooKeeper	ZooKeeper Server	First NameNode, second NameNode, JobTracker node	Node01 to Node03	Node01 to Node03

In-Rack Expansions Software Layout

The flexibility of an In-Rack Expansion provides the ability to configure the cluster with different options. For In-Rack Expansions the following installation options are available:

1. With a Starter Rack and one In-Rack Expansion

a. Create a new cluster on the new six nodes. In this installation the new 6-node cluster will have the standard 6-node layout as shown in the Oracle Big Data Appliance Starter Rack Column above.

b. Extend the existing 6-node cluster on to the new servers to become a 12-node cluster. In this installation the new 12-node cluster will have the same layout as a Oracle Big Data Appliance Full Rack cluster. Note that in this option there will be no TaskTrackers on nodes 1 and 2.

2. With a Starter Rack and two In-Rack Expansions the following options are available:

a. Create three 6-node clusters. In this case the software layout / service roles will be the same as in the Oracle Big Data Appliance Starter Rack column.

b. Create two 9-node clusters. In this case the software layout / service roles will be the same as in the Oracle Big Data Appliance Full Rack column.

c. Create a 6-node cluster and a 12-node cluster. In this case the software layout / service roles will be the same as in the Oracle Big Data Appliance Starter Rack column for the 6-node cluster. The software layout / service roles will be the same as in the Oracle Big Data Appliance Full Rack column for the 12-node cluster.

d. Create a full 18-node cluster. In this case the software layout / service roles will be the same as in the Oracle Big Data Appliance Full Rack column.

3. With a Starter Rack and an extension of 3-nodes:

It is possible to extend the cluster by only 3-nodes. Once this is done and the cluster becomes a 9-node cluster the 6-node Starter Rack configuration software layout / service roles will become the same as the Oracle Big Data Appliance Full Rack cluster. The TaskTrackers on node01 and node02 will no longer be there. There will then be 6 Task Trackers instead of 5 Task Trackers. There will also be an increase in stability and suitability for a production cluster since it will no longer be running task trackers on the name nodes.

Attachments

This solution has no attachment