tachyon.master

Class MasterClient

java.lang.Object

tachyon.master.MasterClient

All Implemented Interfaces:

Closeable, AutoCloseable

public final class MasterClient
extends Object
implements Closeable

The master server client side. Since MasterService.Client is not thread safe, this class has to guarantee thread safe.

Constructor Summary

Constructors

Constructor and Description
MasterClient(InetSocketAddress masterAddress, boolean useZookeeper, ExecutorService executorService)
MasterClient(InetSocketAddress masterAddress, ExecutorService executorService)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	addCheckpoint(long workerId, int fileId, long length, String checkpointPath)
void	close() Clean the connect.
void	connect() Connects to the Tachyon Master; an exception is thrown if this fails.
ClientDependencyInfo	getClientDependencyInfo(int did)
ClientFileInfo	getFileStatus(int fileId, String path)
long	getUserId()
List<ClientWorkerInfo>	getWorkersInfo()
boolean	isConnected()
List<ClientFileInfo>	listStatus(String path)
void	shutdown()
void	user_completeFile(int fId)
int	user_createDependency(List<String> parents, List<String> children, String commandPrefix, List<ByteBuffer> data, String comment, String framework, String frameworkVersion, int dependencyType, long childrenBlockSizeByte)
int	user_createFile(String path, String ufsPath, long blockSizeByte, boolean recursive)
long	user_createNewBlock(int fId)
int	user_createRawTable(String path, int columns, ByteBuffer metadata)
boolean	user_delete(int fileId, String path, boolean recursive)
boolean	user_freepath(int fileId, String path, boolean recursive)
long	user_getBlockId(int fId, int index)
ClientBlockInfo	user_getClientBlockInfo(long blockId)
ClientRawTableInfo	user_getClientRawTableInfo(int id, String path)
List<ClientBlockInfo>	user_getFileBlocks(int fileId, String path)
int	user_getRawTableId(String path)
String	user_getUfsAddress()
NetAddress	user_getWorker(boolean random, String hostname)
void	user_heartbeat()
boolean	user_mkdirs(String path, boolean recursive)
boolean	user_rename(int fileId, String srcPath, String dstPath)
void	user_reportLostFile(int fileId)
void	user_requestFilesInDependency(int depId)
void	user_setPinned(int id, boolean pinned)
void	user_updateRawTableMetadata(int id, ByteBuffer metadata)
void	worker_cacheBlock(long workerId, long workerUsedBytes, long storageDirId, long blockId, long length)
Set<Integer>	worker_getPinIdList()
List<Integer>	worker_getPriorityDependencyList()
Command	worker_heartbeat(long workerId, long usedBytes, List<Long> removedBlockIds, Map<Long,List<Long>> addedBlockIds)
long	worker_register(NetAddress workerNetAddress, long totalBytes, long usedBytes, Map<Long,List<Long>> currentBlockList) Register the worker to the master.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MasterClient

public MasterClient(InetSocketAddress masterAddress,
            ExecutorService executorService)

MasterClient

public MasterClient(InetSocketAddress masterAddress,
            boolean useZookeeper,
            ExecutorService executorService)

Method Detail

addCheckpoint

public boolean addCheckpoint(long workerId,
                    int fileId,
                    long length,
                    String checkpointPath)
                      throws IOException

Parameters:

workerId - if -1, means the checkpoint is added directly by the client from underlayer fs.

fileId -

length -

checkpointPath -

Returns:

true if checkpoint is added for the fileId and false otherwise

Throws:

FileDoesNotExistException

SuspectedFileSizeException

BlockInfoException

IOException

close

public void close()

Clean the connect. E.g. if the client has not connect the master for a while, the connection should be shut down.

Specified by:

close in interface Closeable

Specified by:

close in interface AutoCloseable

connect

public void connect()
             throws IOException

Connects to the Tachyon Master; an exception is thrown if this fails.

Throws:

IOException

getClientDependencyInfo

public ClientDependencyInfo getClientDependencyInfo(int did)
                                             throws IOException

Throws:

IOException

getFileStatus

public ClientFileInfo getFileStatus(int fileId,
                           String path)
                             throws IOException

Throws:

IOException

getUserId

public long getUserId()
               throws IOException

Throws:

IOException

getWorkersInfo

public List<ClientWorkerInfo> getWorkersInfo()
                                      throws IOException

Throws:

IOException

isConnected

public boolean isConnected()

listStatus

public List<ClientFileInfo> listStatus(String path)
                                throws IOException

Throws:

IOException

shutdown

public void shutdown()

user_completeFile

public void user_completeFile(int fId)
                       throws IOException

Throws:

IOException

user_createDependency

public int user_createDependency(List<String> parents,
                        List<String> children,
                        String commandPrefix,
                        List<ByteBuffer> data,
                        String comment,
                        String framework,
                        String frameworkVersion,
                        int dependencyType,
                        long childrenBlockSizeByte)
                          throws IOException

Throws:

IOException

user_createFile

public int user_createFile(String path,
                  String ufsPath,
                  long blockSizeByte,
                  boolean recursive)
                    throws IOException

Throws:

IOException

user_createNewBlock

public long user_createNewBlock(int fId)
                         throws IOException

Throws:

IOException

user_createRawTable

public int user_createRawTable(String path,
                      int columns,
                      ByteBuffer metadata)
                        throws IOException

Throws:

IOException

user_delete

public boolean user_delete(int fileId,
                  String path,
                  boolean recursive)
                    throws IOException

Throws:

IOException

user_getBlockId

public long user_getBlockId(int fId,
                   int index)
                     throws IOException

Throws:

IOException

user_getClientBlockInfo

public ClientBlockInfo user_getClientBlockInfo(long blockId)
                                        throws IOException

Throws:

IOException

user_getClientRawTableInfo

public ClientRawTableInfo user_getClientRawTableInfo(int id,
                                            String path)
                                              throws IOException

Throws:

IOException

user_getFileBlocks

public List<ClientBlockInfo> user_getFileBlocks(int fileId,
                                       String path)
                                         throws IOException

Throws:

IOException

user_getRawTableId

public int user_getRawTableId(String path)
                       throws IOException

Throws:

IOException

user_getUfsAddress

public String user_getUfsAddress()
                          throws IOException

Throws:

IOException

user_getWorker

public NetAddress user_getWorker(boolean random,
                        String hostname)
                          throws NoWorkerException,
                                 IOException

Throws:

NoWorkerException

IOException

user_heartbeat

public void user_heartbeat()
                    throws IOException

Throws:

IOException

user_mkdirs

public boolean user_mkdirs(String path,
                  boolean recursive)
                    throws IOException

Throws:

IOException

user_rename

public boolean user_rename(int fileId,
                  String srcPath,
                  String dstPath)
                    throws IOException

Throws:

IOException

user_reportLostFile

public void user_reportLostFile(int fileId)
                         throws IOException

Throws:

IOException

user_requestFilesInDependency

public void user_requestFilesInDependency(int depId)
                                   throws IOException

Throws:

IOException

user_setPinned

public void user_setPinned(int id,
                  boolean pinned)
                    throws IOException

Throws:

IOException

user_updateRawTableMetadata

public void user_updateRawTableMetadata(int id,
                               ByteBuffer metadata)
                                 throws IOException

Throws:

IOException

user_freepath

public boolean user_freepath(int fileId,
                    String path,
                    boolean recursive)
                      throws IOException

Throws:

IOException

worker_cacheBlock

public void worker_cacheBlock(long workerId,
                     long workerUsedBytes,
                     long storageDirId,
                     long blockId,
                     long length)
                       throws IOException,
                              FileDoesNotExistException,
                              SuspectedFileSizeException,
                              BlockInfoException

Throws:

IOException

FileDoesNotExistException

SuspectedFileSizeException

BlockInfoException

worker_getPinIdList

public Set<Integer> worker_getPinIdList()
                                 throws IOException

Throws:

IOException

worker_getPriorityDependencyList

public List<Integer> worker_getPriorityDependencyList()
                                               throws IOException

Throws:

IOException

worker_heartbeat

public Command worker_heartbeat(long workerId,
                       long usedBytes,
                       List<Long> removedBlockIds,
                       Map<Long,List<Long>> addedBlockIds)
                         throws IOException

Throws:

IOException

worker_register

public long worker_register(NetAddress workerNetAddress,
                   long totalBytes,
                   long usedBytes,
                   Map<Long,List<Long>> currentBlockList)
                     throws BlockInfoException,
                            IOException

Register the worker to the master.

Parameters:

workerNetAddress - Worker's NetAddress

totalBytes - Worker's capacity

usedBytes - Worker's used storage

currentBlockList - Blocks in worker's space.

Returns:

the worker id assigned by the master.

Throws:

BlockInfoException

org.apache.thrift.TException

IOException