ReplicationSourceManager (HBase 0.98.7-hadoop1 API)

Constructor Summary

Constructors
Constructor and Description
`ReplicationSourceManager(ReplicationQueues replicationQueues, ReplicationPeers replicationPeers, ReplicationTracker replicationTracker, org.apache.hadoop.conf.Configuration conf, Stoppable stopper, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path logDir, org.apache.hadoop.fs.Path oldLogDir, UUID clusterId)` Creates a replication manager and sets the watch on all the other registered region servers

Method Summary

Methods
Modifier and Type	Method and Description
`protected ReplicationSourceInterface`	`addSource(String id)` Add a new normal source to this region server
`void`	`cleanOldLogs(String key, String id, boolean queueRecovered)` Cleans a log file and all older files from ZK.
`void`	`closeRecoveredQueue(ReplicationSourceInterface src)` Clear the references to the specified old source
`void`	`deleteSource(String peerId, boolean closeConnection)` Delete a complete queue of hlogs associated with a peer cluster
`org.apache.hadoop.fs.FileSystem`	`getFs()` Get the handle on the local file system
`protected Map<String,SortedSet<String>>`	`getHLogs()` Get a copy of the hlogs of the first source on this rs
`protected Map<String,SortedSet<String>>`	`getHlogsByIdRecoveredQueues()` Get a copy of the hlogs of the recovered sources on this rs
`org.apache.hadoop.fs.Path`	`getLogDir()` Get the directory where hlogs are stored by their RSs
`org.apache.hadoop.fs.Path`	`getOldLogDir()` Get the directory where hlogs are archived
`List<ReplicationSourceInterface>`	`getOldSources()` Get a list of all the old sources of this rs
`protected ReplicationSourceInterface`	`getReplicationSource(org.apache.hadoop.conf.Configuration conf, org.apache.hadoop.fs.FileSystem fs, ReplicationSourceManager manager, ReplicationQueues replicationQueues, ReplicationPeers replicationPeers, Stoppable stopper, String peerId, UUID clusterId)` Factory method to create a replication source
`List<ReplicationSourceInterface>`	`getSources()` Get a list of all the normal sources of this rs
`String`	`getStats()` Get a string representation of all the sources' metrics
`protected void`	`init()` Adds a normal source per registered peer cluster and tries to process all old region server hlog queues
`void`	`join()` Terminate the replication on this region server
`void`	`logPositionAndCleanOldLogs(org.apache.hadoop.fs.Path log, String id, long position, boolean queueRecovered, boolean holdLogInZK)` Provide the id of the peer and a log key and this method will figure which hlog it belongs to and will log, for this region server, the current position.
`void`	`peerListChanged(List<String> peerIds)` The list of registered peer clusters has changed.
`void`	`peerRemoved(String peerId)` A peer cluster has been removed (i.e.
`void`	`regionServerRemoved(String regionserver)` A region server has been removed from the local cluster
`void`	`removePeer(String id)` Thie method first deletes all the recovered sources for the specified id, then deletes the normal source (deleting all related data in ZK).

Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - ReplicationSourceManager
```
public ReplicationSourceManager(ReplicationQueues replicationQueues,
                        ReplicationPeers replicationPeers,
                        ReplicationTracker replicationTracker,
                        org.apache.hadoop.conf.Configuration conf,
                        Stoppable stopper,
                        org.apache.hadoop.fs.FileSystem fs,
                        org.apache.hadoop.fs.Path logDir,
                        org.apache.hadoop.fs.Path oldLogDir,
                        UUID clusterId)
```
    Creates a replication manager and sets the watch on all the other registered region servers
    
    Parameters:
    replicationQueues - the interface for manipulating replication queues
    replicationPeers -
    replicationTracker -
    conf - the configuration to use
    stopper - the stopper object for this region server
    fs - the file system to use
    logDir - the directory that contains all hlog directories of live RSs
    oldLogDir - the directory where old logs are archived
    clusterId -
- Method Detail
  - logPositionAndCleanOldLogs
```
public void logPositionAndCleanOldLogs(org.apache.hadoop.fs.Path log,
                              String id,
                              long position,
                              boolean queueRecovered,
                              boolean holdLogInZK)
```
    Provide the id of the peer and a log key and this method will figure which hlog it belongs to and will log, for this region server, the current position. It will also clean old logs from the queue.
    
    Parameters:
    log - Path to the log currently being replicated from replication status in zookeeper. It will also delete older entries.
    id - id of the peer cluster
    position - current location in the log
    queueRecovered - indicates if this queue comes from another region server
    holdLogInZK - if true then the log is retained in ZK
  - cleanOldLogs
```
public void cleanOldLogs(String key,
                String id,
                boolean queueRecovered)
```
    Cleans a log file and all older files from ZK. Called when we are sure that a log file is closed and has no more entries.
    
    Parameters:
    key - Path to the log
    id - id of the peer cluster
    queueRecovered - Whether this is a recovered queue
  - init
```
protected void init()
             throws IOException,
                    ReplicationException
```
    Adds a normal source per registered peer cluster and tries to process all old region server hlog queues
    
    Throws:
    
    IOException
    
    ReplicationException
  - addSource
```
protected ReplicationSourceInterface addSource(String id)
                                        throws IOException,
                                               ReplicationException
```
    Add a new normal source to this region server
    
    Parameters:
    id - the id of the peer cluster
    
    Returns:
    the source that was created
    
    Throws:
    
    IOException
    
    ReplicationException
  - deleteSource
```
public void deleteSource(String peerId,
                boolean closeConnection)
```
    Delete a complete queue of hlogs associated with a peer cluster
    
    Parameters:
    peerId - Id of the peer cluster queue of hlogs to delete
  - join
```
public void join()
```
    Terminate the replication on this region server
  - getHLogs
```
protected Map<String,SortedSet<String>> getHLogs()
```
    Get a copy of the hlogs of the first source on this rs
    
    Returns:
    a sorted set of hlog names
  - getHlogsByIdRecoveredQueues
```
protected Map<String,SortedSet<String>> getHlogsByIdRecoveredQueues()
```
    Get a copy of the hlogs of the recovered sources on this rs
    
    Returns:
    a sorted set of hlog names
  - getSources
```
public List<ReplicationSourceInterface> getSources()
```
    Get a list of all the normal sources of this rs
    
    Returns:
    lis of all sources
  - getOldSources
```
public List<ReplicationSourceInterface> getOldSources()
```
    Get a list of all the old sources of this rs
    
    Returns:
    list of all old sources
  - getReplicationSource
```
protected ReplicationSourceInterface getReplicationSource(org.apache.hadoop.conf.Configuration conf,
                                              org.apache.hadoop.fs.FileSystem fs,
                                              ReplicationSourceManager manager,
                                              ReplicationQueues replicationQueues,
                                              ReplicationPeers replicationPeers,
                                              Stoppable stopper,
                                              String peerId,
                                              UUID clusterId)
                                                   throws IOException
```
    Factory method to create a replication source
    
    Parameters:
    conf - the configuration to use
    fs - the file system to use
    manager - the manager to use
    stopper - the stopper object for this region server
    peerId - the id of the peer cluster
    
    Returns:
    the created source
    
    Throws:
    
    IOException
  - closeRecoveredQueue
```
public void closeRecoveredQueue(ReplicationSourceInterface src)
```
    Clear the references to the specified old source
    
    Parameters:
    src - source to clear
  - removePeer
```
public void removePeer(String id)
```
    Thie method first deletes all the recovered sources for the specified id, then deletes the normal source (deleting all related data in ZK).
    
    Parameters:
    id - The id of the peer cluster
  - regionServerRemoved
```
public void regionServerRemoved(String regionserver)
```
    Description copied from interface: ReplicationListener
    
    A region server has been removed from the local cluster
    
    Specified by:
    
    regionServerRemoved in interface ReplicationListener
    
    Parameters:
    regionserver - the removed region server
  - peerRemoved
```
public void peerRemoved(String peerId)
```
    Description copied from interface: ReplicationListener
    
    A peer cluster has been removed (i.e. unregistered) from replication.
    
    Specified by:
    
    peerRemoved in interface ReplicationListener
    
    Parameters:
    peerId - The peer id of the cluster that has been removed
  - peerListChanged
```
public void peerListChanged(List<String> peerIds)
```
    Description copied from interface: ReplicationListener
    
    The list of registered peer clusters has changed.
    
    Specified by:
    
    peerListChanged in interface ReplicationListener
    
    Parameters:
    peerIds - A list of all currently registered peer clusters
  - getOldLogDir
```
public org.apache.hadoop.fs.Path getOldLogDir()
```
    Get the directory where hlogs are archived
    
    Returns:
    the directory where hlogs are archived
  - getLogDir
```
public org.apache.hadoop.fs.Path getLogDir()
```
    Get the directory where hlogs are stored by their RSs
    
    Returns:
    the directory where hlogs are stored by their RSs
  - getFs
```
public org.apache.hadoop.fs.FileSystem getFs()
```
    Get the handle on the local file system
    
    Returns:
    Handle on the local file system
  - getStats
```
public String getStats()
```
    Get a string representation of all the sources' metrics

Class ReplicationSourceManager

Constructor Summary

Method Summary

Methods inherited from class java.lang.Object

Constructor Detail

ReplicationSourceManager

Method Detail

logPositionAndCleanOldLogs

cleanOldLogs

init

addSource

deleteSource

join

getHLogs

getHlogsByIdRecoveredQueues

getSources

getOldSources

getReplicationSource

closeRecoveredQueue

removePeer

regionServerRemoved

peerRemoved

peerListChanged

getOldLogDir

getLogDir

getFs

getStats