| 程序包 | 说明 |
|---|---|
| org.apache.hadoop.hdfs.server.namenode |
| 限定符和类型 | 字段和说明 |
|---|---|
DatanodeDescriptor[] |
DatanodeDescriptor.BlockTargetPair.targets |
| 限定符和类型 | 方法和说明 |
|---|---|
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes)
choose local node of localMachine as the target.
|
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseRandom(String nodes,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseReplicaToDelete(FSInodeInfo inode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
abstract DatanodeDescriptor |
BlockPlacementPolicy.chooseReplicaToDelete(FSInodeInfo srcInode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> existingReplicas,
Collection<DatanodeDescriptor> moreExistingReplicas)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(FSInodeInfo srcInode,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicy.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas nodes for writer to replicate
a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
abstract DatanodeDescriptor[] |
BlockPlacementPolicy.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor |
FSNamesystem.getDatanode(DatanodeID nodeID)
Get data node by storage ID.
|
DatanodeDescriptor |
FSNamesystem.getRandomDatanode() |
| 限定符和类型 | 方法和说明 |
|---|---|
ArrayList<DatanodeDescriptor> |
FSNamesystem.getDatanodeListForReport(FSConstants.DatanodeReportType type) |
ArrayList<DatanodeDescriptor> |
FSNamesystem.getDecommissioningNodes() |
Iterator<DatanodeDescriptor> |
BlockPlacementPolicyWithNodeGroup.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
protected Iterator<DatanodeDescriptor> |
BlockPlacementPolicyDefault.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
| 限定符和类型 | 方法和说明 |
|---|---|
void |
CorruptReplicasMap.addToCorruptReplicasMap(Block blk,
DatanodeDescriptor dn)
Mark the block belonging to datanode as corrupt.
|
protected int |
BlockPlacementPolicyWithNodeGroup.addToExcludedNodes(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes)
Find other nodes in the same nodegroup of localMachine and add them
into excludeNodes as replica should not be duplicated for nodes
within the same nodegroup
|
protected int |
BlockPlacementPolicyDefault.addToExcludedNodes(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes)
Add localMachine and related nodes to excludedNodes
for next replica choosing.
|
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes)
choose local node of localMachine as the target.
|
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected void |
BlockPlacementPolicyWithNodeGroup.chooseRemoteRack(int numOfReplicas,
DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxReplicasPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected void |
BlockPlacementPolicyDefault.chooseRemoteRack(int numOfReplicas,
DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxReplicasPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(FSInodeInfo srcInode,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicy.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas nodes for writer to replicate
a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
abstract DatanodeDescriptor[] |
BlockPlacementPolicy.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
protected boolean |
BlockPlacementPolicyDefault.isGoodTarget(DatanodeDescriptor node,
long blockSize,
int maxTargetPerLoc,
boolean considerLoad,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes)
Determine if a node is a good target.
|
void |
FSNamesystem.stopDecommission(DatanodeDescriptor node)
Stop decommissioning the specified datanodes.
|
| 限定符和类型 | 方法和说明 |
|---|---|
void |
BlockPlacementPolicy.adjustSetsWithChosenReplica(Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne,
DatanodeInfo cur)
Adjust rackmap, moreThanOne, and exactlyOne after removing replica on cur.
|
void |
BlockPlacementPolicy.adjustSetsWithChosenReplica(Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne,
DatanodeInfo cur)
Adjust rackmap, moreThanOne, and exactlyOne after removing replica on cur.
|
void |
BlockPlacementPolicy.adjustSetsWithChosenReplica(Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne,
DatanodeInfo cur)
Adjust rackmap, moreThanOne, and exactlyOne after removing replica on cur.
|
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes)
choose local node of localMachine as the target.
|
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalNode(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyWithNodeGroup.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseLocalRack(DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected void |
BlockPlacementPolicyDefault.chooseRandom(int numOfReplicas,
String nodes,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseRandom(String nodes,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxNodesPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected void |
BlockPlacementPolicyWithNodeGroup.chooseRemoteRack(int numOfReplicas,
DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxReplicasPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
protected void |
BlockPlacementPolicyDefault.chooseRemoteRack(int numOfReplicas,
DatanodeDescriptor localMachine,
HashMap<Node,Node> excludedNodes,
long blocksize,
int maxReplicasPerRack,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes) |
DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseReplicaToDelete(FSInodeInfo inode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
DatanodeDescriptor |
BlockPlacementPolicyDefault.chooseReplicaToDelete(FSInodeInfo inode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
abstract DatanodeDescriptor |
BlockPlacementPolicy.chooseReplicaToDelete(FSInodeInfo srcInode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> existingReplicas,
Collection<DatanodeDescriptor> moreExistingReplicas)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
abstract DatanodeDescriptor |
BlockPlacementPolicy.chooseReplicaToDelete(FSInodeInfo srcInode,
Block block,
short replicationFactor,
Collection<DatanodeDescriptor> existingReplicas,
Collection<DatanodeDescriptor> moreExistingReplicas)
Decide whether deleting the specified replica of the block still makes
the block conform to the configured block placement policy.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(FSInodeInfo srcInode,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
abstract DatanodeDescriptor[] |
BlockPlacementPolicy.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
HashMap<Node,Node> excludedNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
DatanodeDescriptor[] |
BlockPlacementPolicyDefault.chooseTarget(String srcPath,
int numOfReplicas,
DatanodeDescriptor writer,
List<DatanodeDescriptor> chosenNodes,
long blocksize)
choose numOfReplicas data nodes for writer
to re-replicate a block with size blocksize
If not, return as many as we can.
|
void |
JspHelper.DFSNodesStatus(ArrayList<DatanodeDescriptor> live,
ArrayList<DatanodeDescriptor> dead) |
void |
JspHelper.DFSNodesStatus(ArrayList<DatanodeDescriptor> live,
ArrayList<DatanodeDescriptor> dead) |
void |
FSNamesystem.DFSNodesStatus(ArrayList<DatanodeDescriptor> live,
ArrayList<DatanodeDescriptor> dead) |
void |
FSNamesystem.DFSNodesStatus(ArrayList<DatanodeDescriptor> live,
ArrayList<DatanodeDescriptor> dead) |
protected boolean |
BlockPlacementPolicyDefault.isGoodTarget(DatanodeDescriptor node,
long blockSize,
int maxTargetPerLoc,
boolean considerLoad,
List<DatanodeDescriptor> results,
boolean avoidStaleNodes)
Determine if a node is a good target.
|
Iterator<DatanodeDescriptor> |
BlockPlacementPolicyWithNodeGroup.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
Iterator<DatanodeDescriptor> |
BlockPlacementPolicyWithNodeGroup.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
protected Iterator<DatanodeDescriptor> |
BlockPlacementPolicyDefault.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
protected Iterator<DatanodeDescriptor> |
BlockPlacementPolicyDefault.pickupReplicaSet(Collection<DatanodeDescriptor> first,
Collection<DatanodeDescriptor> second)
Pick up replica node set for deleting replica as over-replicated.
|
void |
JspHelper.sortNodeList(ArrayList<DatanodeDescriptor> nodes,
String field,
String order) |
void |
BlockPlacementPolicy.splitNodesWithRack(Collection<DatanodeDescriptor> dataNodes,
Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne)
Split data nodes into two sets, one set includes nodes on rack with
more than one replica, the other set contains the remaining nodes.
|
void |
BlockPlacementPolicy.splitNodesWithRack(Collection<DatanodeDescriptor> dataNodes,
Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne)
Split data nodes into two sets, one set includes nodes on rack with
more than one replica, the other set contains the remaining nodes.
|
void |
BlockPlacementPolicy.splitNodesWithRack(Collection<DatanodeDescriptor> dataNodes,
Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne)
Split data nodes into two sets, one set includes nodes on rack with
more than one replica, the other set contains the remaining nodes.
|
void |
BlockPlacementPolicy.splitNodesWithRack(Collection<DatanodeDescriptor> dataNodes,
Map<String,List<DatanodeDescriptor>> rackMap,
List<DatanodeDescriptor> moreThanOne,
List<DatanodeDescriptor> exactlyOne)
Split data nodes into two sets, one set includes nodes on rack with
more than one replica, the other set contains the remaining nodes.
|
Copyright © 2009 The Apache Software Foundation