org.apache.hadoop.net

类 NetworkTopologyWithNodeGroup

java.lang.Object

org.apache.hadoop.net.NetworkTopology

org.apache.hadoop.net.NetworkTopologyWithNodeGroup

@InterfaceAudience.LimitedPrivate(value={"HDFS","MapReduce"})
@InterfaceStability.Unstable
public class NetworkTopologyWithNodeGroup
extends NetworkTopology

The class extends NetworkTopology to represents a cluster of computer with a 4-layers hierarchical network topology. In this network topology, leaves represent data nodes (computers) and inner nodes represent switches/routers that manage traffic in/out of data centers, racks or physical host (with virtual switch).

另请参阅:

NetworkTopology

嵌套类概要

从类继承的嵌套类/接口 org.apache.hadoop.net.NetworkTopology

NetworkTopology.InvalidTopologyException

字段概要

字段

限定符和类型	字段和说明
static String	DEFAULT_NODEGROUP

从类继承的字段 org.apache.hadoop.net.NetworkTopology

DEFAULT_HOST_LEVEL, DEFAULT_RACK, LOG, netlock, numOfRacks, r

构造器概要

构造器

构造器和说明
NetworkTopologyWithNodeGroup()

方法概要

方法

限定符和类型	方法和说明
void	add(Node node) Add a leaf node Update node counter & rack counter if necessary
protected Node	getNodeForNetworkLocation(Node node) Return a reference to the node given its string representation.
String	getNodeGroup(String loc) Given a string representation of a node group for a specific network location
String	getRack(String loc) Given a string representation of a rack for a specific network location To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full NetworkTopology.getRack(String) method.
boolean	isNodeGroupAware() Check if network topology is aware of NodeGroup
boolean	isOnSameNodeGroup(Node node1, Node node2) Check if two nodes are on the same node group (hypervisor) The assumption here is: each nodes are leaf nodes.
boolean	isOnSameRack(Node node1, Node node2) Check if two nodes are on the same rack
void	pseudoSortByDistance(Node reader, Node[] nodes) Sort nodes array by their distances to reader It linearly scans the array, if a local node is found, swap it with the first element of the array.
void	remove(Node node) Remove a node Update node counter and rack counter if necessary

从类继承的方法 org.apache.hadoop.net.NetworkTopology

chooseRandom, contains, countNumOfAvailableNodes, getDistance, getFirstHalf, getInstance, getLastHalf, getLeaves, getNode, getNumOfLeaves, getNumOfRacks, isSameParents, swap, toString

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

字段详细资料

DEFAULT_NODEGROUP

public static final String DEFAULT_NODEGROUP

另请参阅:

常量字段值

构造器详细资料

NetworkTopologyWithNodeGroup

public NetworkTopologyWithNodeGroup()

方法详细资料

getNodeForNetworkLocation

protected Node getNodeForNetworkLocation(Node node)

从类复制的说明: NetworkTopology

Return a reference to the node given its string representation. Default implementation delegates to NetworkTopology.getNode(String).

To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full NetworkTopology.add(Node) method.

覆盖:

getNodeForNetworkLocation 在类中 NetworkTopology

参数:

node - The string representation of this node's network location is used to retrieve a Node object.

返回:

a reference to the node; null if the node is not in the tree

另请参阅:

NetworkTopology.add(Node), NetworkTopology.getNode(String)

getRack

public String getRack(String loc)

从类复制的说明: NetworkTopology

Given a string representation of a rack for a specific network location To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full NetworkTopology.getRack(String) method.

覆盖:

getRack 在类中 NetworkTopology

参数:

loc - a path-like string representation of a network location

返回:

a rack string

getNodeGroup

public String getNodeGroup(String loc)

Given a string representation of a node group for a specific network location

参数:

loc - a path-like string representation of a network location

返回:

a node group string

isOnSameRack

public boolean isOnSameRack(Node node1,
                   Node node2)

从类复制的说明: NetworkTopology

Check if two nodes are on the same rack

覆盖:

isOnSameRack 在类中 NetworkTopology

参数:

node1 - one node

node2 - another node

返回:

true if node1 and node2 are pm the same rack; false otherwise

isOnSameNodeGroup

public boolean isOnSameNodeGroup(Node node1,
                        Node node2)

Check if two nodes are on the same node group (hypervisor) The assumption here is: each nodes are leaf nodes.

覆盖:

isOnSameNodeGroup 在类中 NetworkTopology

参数:

node1 - one node (can be null)

node2 - another node (can be null)

返回:

true if node1 and node2 are on the same node group; false otherwise

抛出:

IllegalArgumentException - when either node1 or node2 is null, or node1 or node2 do not belong to the cluster

isNodeGroupAware

public boolean isNodeGroupAware()

Check if network topology is aware of NodeGroup

覆盖:

isNodeGroupAware 在类中 NetworkTopology

add

public void add(Node node)

Add a leaf node Update node counter & rack counter if necessary

覆盖:

add 在类中 NetworkTopology

参数:

node - node to be added; can be null

抛出:

IllegalArgumentException - if add a node to a leave or node to be added is not a leaf

remove

public void remove(Node node)

Remove a node Update node counter and rack counter if necessary

覆盖:

remove 在类中 NetworkTopology

参数:

node - node to be removed; can be null

pseudoSortByDistance

public void pseudoSortByDistance(Node reader,
                        Node[] nodes)

Sort nodes array by their distances to reader It linearly scans the array, if a local node is found, swap it with the first element of the array. If a local node group node is found, swap it with the first element following the local node. If a local rack node is found, swap it with the first element following the local node group node. If neither local node, node group node or local rack node is found, put a random replica location at position 0. It leaves the rest nodes untouched.

覆盖:

pseudoSortByDistance 在类中 NetworkTopology

参数:

reader - the node that wishes to read a block from one of the nodes

nodes - the list of nodes containing data for the reader