org.apache.hadoop.net

类 NetworkTopology

java.lang.Object

org.apache.hadoop.net.NetworkTopology

直接已知子类:

NetworkTopologyWithNodeGroup

public class NetworkTopology
extends Object

The class represents a cluster of computer with a tree hierarchical network topology. For example, a cluster may be consists of many data centers filled with racks of computers. In a network topology, leaves represent data nodes (computers) and inner nodes represent switches/routers that manage traffic in/out of data centers or racks.

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	NetworkTopology.InvalidTopologyException

字段概要

字段

限定符和类型	字段和说明
static int	DEFAULT_HOST_LEVEL
static String	DEFAULT_RACK
static org.apache.commons.logging.Log	LOG
protected ReadWriteLock	netlock
protected int	numOfRacks
protected static Random	r

构造器概要

构造器

构造器和说明
NetworkTopology()

方法概要

方法

限定符和类型	方法和说明
void	add(Node node) Add a leaf node Update node counter & rack counter if neccessary
Node	chooseRandom(String scope) randomly choose one node from scope if scope starts with ~, choose one from the all nodes except for the ones in scope; otherwise, choose one from scope
boolean	contains(Node node) Check if the tree contains node node
int	countNumOfAvailableNodes(String scope, Collection<Node> excludedNodes) return the number of leaves in scope but not in excludedNodes if scope starts with ~, return the number of nodes that are not in scope and excludedNodes;
int	getDistance(Node node1, Node node2) Return the distance between two nodes It is assumed that the distance from one node to its parent is 1 The distance between two nodes is calculated by summing up their distances to their closest common ancestor.
static String	getFirstHalf(String networkLocation) Divide networklocation string into two parts by last separator, and get the first part here.
static NetworkTopology	getInstance(Configuration conf) Get an instance of NetworkTopology based on the value of the configuration parameter net.topology.impl.
static String	getLastHalf(String networkLocation) Divide networklocation string into two parts by last separator, and get the second part here.
List<Node>	getLeaves(String scope) return leaves in scope
Node	getNode(String loc) Given a string representation of a node, return its reference
protected Node	getNodeForNetworkLocation(Node node) Return a reference to the node given its string representation.
int	getNumOfLeaves() Return the total number of nodes
int	getNumOfRacks() Return the total number of racks
String	getRack(String loc) Given a string representation of a rack for a specific network location To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full getRack(String) method.
boolean	isNodeGroupAware() Check if network topology is aware of NodeGroup
boolean	isOnSameNodeGroup(Node node1, Node node2) Return false directly as not aware of NodeGroup, to be override in sub-class
boolean	isOnSameRack(Node node1, Node node2) Check if two nodes are on the same rack
protected boolean	isSameParents(Node node1, Node node2) Compare the parents of each node for equality To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full isOnSameRack(Node, Node) method.
void	pseudoSortByDistance(Node reader, Node[] nodes) Sort nodes array by their distances to reader It linearly scans the array, if a local node is found, swap it with the first element of the array.
void	remove(Node node) Remove a node Update node counter & rack counter if neccessary
protected static void	swap(Node[] nodes, int i, int j)
String	toString() convert a network tree to a string

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

字段详细资料

DEFAULT_RACK

public static final String DEFAULT_RACK

另请参阅:

常量字段值

DEFAULT_HOST_LEVEL

public static final int DEFAULT_HOST_LEVEL

另请参阅:

常量字段值

LOG

public static final org.apache.commons.logging.Log LOG

numOfRacks

protected int numOfRacks

netlock

protected ReadWriteLock netlock

r

protected static final Random r

构造器详细资料

NetworkTopology

public NetworkTopology()

方法详细资料

getInstance

public static NetworkTopology getInstance(Configuration conf)

Get an instance of NetworkTopology based on the value of the configuration parameter net.topology.impl.

参数:

conf - the configuration to be used

返回:

an instance of NetworkTopology

add

public void add(Node node)

Add a leaf node Update node counter & rack counter if neccessary

参数:

node - node to be added

抛出:

IllegalArgumentException - if add a node to a leave or node to be added is not a leaf

getNodeForNetworkLocation

protected Node getNodeForNetworkLocation(Node node)

Return a reference to the node given its string representation. Default implementation delegates to getNode(String).

To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full add(Node) method.

参数:

node - The string representation of this node's network location is used to retrieve a Node object.

返回:

a reference to the node; null if the node is not in the tree

另请参阅:

add(Node), getNode(String)

remove

public void remove(Node node)

Remove a node Update node counter & rack counter if neccessary

参数:

node - node to be removed

contains

public boolean contains(Node node)

Check if the tree contains node node

参数:

node - a node

返回:

true if node is already in the tree; false otherwise

getNode

public Node getNode(String loc)

Given a string representation of a node, return its reference

参数:

loc - a path-like string representation of a node

返回:

a reference to the node; null if the node is not in the tree

getRack

public String getRack(String loc)

Given a string representation of a rack for a specific network location To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full getRack(String) method.

参数:

loc - a path-like string representation of a network location

返回:

a rack string

getNumOfRacks

public int getNumOfRacks()

Return the total number of racks

getNumOfLeaves

public int getNumOfLeaves()

Return the total number of nodes

getDistance

public int getDistance(Node node1,
              Node node2)

Return the distance between two nodes It is assumed that the distance from one node to its parent is 1 The distance between two nodes is calculated by summing up their distances to their closest common ancestor.

参数:

node1 - one node

node2 - another node

返回:

the distance between node1 and node2 node1 or node2 do not belong to the cluster

isOnSameRack

public boolean isOnSameRack(Node node1,
                   Node node2)

Check if two nodes are on the same rack

参数:

node1 - one node

node2 - another node

返回:

true if node1 and node2 are pm the same rack; false otherwise

抛出:

IllegalArgumentException - when either node1 or node2 is null, or node1 or node2 do not belong to the cluster

isNodeGroupAware

public boolean isNodeGroupAware()

Check if network topology is aware of NodeGroup

isOnSameNodeGroup

public boolean isOnSameNodeGroup(Node node1,
                        Node node2)

Return false directly as not aware of NodeGroup, to be override in sub-class

isSameParents

protected boolean isSameParents(Node node1,
                    Node node2)

Compare the parents of each node for equality

To be overridden in subclasses for specific NetworkTopology implementations, as alternative to overriding the full isOnSameRack(Node, Node) method.

参数:

node1 - the first node to compare

node2 - the second node to compare

返回:

true if their parents are equal, false otherwise

另请参阅:

isOnSameRack(Node, Node)

chooseRandom

public Node chooseRandom(String scope)

randomly choose one node from scope if scope starts with ~, choose one from the all nodes except for the ones in scope; otherwise, choose one from scope

参数:

scope - range of nodes from which a node will be choosen

返回:

the choosen node

getLeaves

public List<Node> getLeaves(String scope)

return leaves in scope

参数:

scope - a path string

返回:

leaves nodes under specific scope

countNumOfAvailableNodes

public int countNumOfAvailableNodes(String scope,
                           Collection<Node> excludedNodes)

return the number of leaves in scope but not in excludedNodes if scope starts with ~, return the number of nodes that are not in scope and excludedNodes;

参数:

scope - a path string that may start with ~

excludedNodes - a list of nodes

返回:

number of available nodes

toString

public String toString()

convert a network tree to a string

覆盖:

toString 在类中 Object

getFirstHalf

public static String getFirstHalf(String networkLocation)

Divide networklocation string into two parts by last separator, and get the first part here.

参数:

networkLocation -

返回:

getLastHalf

public static String getLastHalf(String networkLocation)

Divide networklocation string into two parts by last separator, and get the second part here.

参数:

networkLocation -

返回:

swap

protected static void swap(Node[] nodes,
        int i,
        int j)

pseudoSortByDistance

public void pseudoSortByDistance(Node reader,
                        Node[] nodes)

Sort nodes array by their distances to reader It linearly scans the array, if a local node is found, swap it with the first element of the array. If a local rack node is found, swap it with the first element following the local node. If neither local node or local rack node is found, put a random replica location at postion 0. It leaves the rest nodes untouched.