tachyon.master

Class MasterServiceHandler

java.lang.Object

tachyon.master.MasterServiceHandler

All Implemented Interfaces:

MasterService.Iface

public class MasterServiceHandler
extends Object
implements MasterService.Iface

The Master server program. It maintains the state of each worker. It never keeps the state of any user.

Constructor Summary

Constructors

Constructor and Description
MasterServiceHandler(MasterInfo masterInfo)

Method Summary

Methods

Modifier and Type	Method and Description
boolean	addCheckpoint(long workerId, int fileId, long fileSizeBytes, String checkpointPath)
ClientFileInfo	getFileStatus(int fileId, String path)
List<ClientWorkerInfo>	getWorkersInfo()
List<ClientFileInfo>	liststatus(String path)
void	user_completeFile(int fileId)
int	user_createDependency(List<String> parents, List<String> children, String commandPrefix, List<ByteBuffer> data, String comment, String framework, String frameworkVersion, int dependencyType, long childrenBlockSizeByte)
int	user_createFile(String path, String ufsPath, long blockSizeByte, boolean recursive)
long	user_createNewBlock(int fileId)
int	user_createRawTable(String path, int columns, ByteBuffer metadata)
boolean	user_delete(int fileId, String path, boolean recursive) Delete file
boolean	user_freepath(int fileId, String path, boolean recursive)
long	user_getBlockId(int fileId, int index)
ClientBlockInfo	user_getClientBlockInfo(long blockId) Get block's ClientBlockInfo.
ClientDependencyInfo	user_getClientDependencyInfo(int dependencyId)
ClientRawTableInfo	user_getClientRawTableInfo(int id, String path) Get RawTable's info; Return a ClientRawTable instance with id 0 if the system does not contain the table.
List<ClientBlockInfo>	user_getFileBlocks(int fileId, String path) Get file blocks info.
int	user_getRawTableId(String path) Return 0 if does not contain the Table, return fileId if it exists.
String	user_getUfsAddress()
long	user_getUserId()
NetAddress	user_getWorker(boolean random, String host) Get local worker NetAddress
void	user_heartbeat() Returns if the message was received.
boolean	user_mkdirs(String path, boolean recursive)
boolean	user_rename(int fileId, String srcPath, String dstPath)
void	user_reportLostFile(int fileId)
void	user_requestFilesInDependency(int depId)
void	user_setPinned(int fileId, boolean pinned)
void	user_updateRawTableMetadata(int tableId, ByteBuffer metadata)
void	worker_cacheBlock(long workerId, long workerUsedBytes, long storageDirId, long blockId, long length) Update information of the block newly cached to master, including used Tachyon space size in bytes, the id of the storage directory in which the block is, the id of the block and the size of the block in bytes.
Set<Integer>	worker_getPinIdList()
List<Integer>	worker_getPriorityDependencyList()
Command	worker_heartbeat(long workerId, long usedBytes, List<Long> removedBlockIds, Map<Long,List<Long>> addedBlockIds) Heart beat between worker and master, worker update used Tachyon space in bytes, removed blocks and added blocks in each storage directory by eviction and promotion to master, and return the command from master to worker.
long	worker_register(NetAddress workerNetAddress, long totalBytes, long usedBytes, Map<Long,List<Long>> currentBlockIds) Worker register and synch up capacity of Tachyon space, used space bytes and blocks in each storage directory to master, the return value rv % 100,000 is really workerId, rv / 1000,000 is master started time.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MasterServiceHandler

public MasterServiceHandler(MasterInfo masterInfo)

Method Detail

addCheckpoint

public boolean addCheckpoint(long workerId,
                    int fileId,
                    long fileSizeBytes,
                    String checkpointPath)
                      throws FileDoesNotExistException,
                             SuspectedFileSizeException,
                             BlockInfoException,
                             org.apache.thrift.TException

Specified by:

addCheckpoint in interface MasterService.Iface

Throws:

FileDoesNotExistException

SuspectedFileSizeException

BlockInfoException

org.apache.thrift.TException

getFileStatus

public ClientFileInfo getFileStatus(int fileId,
                           String path)
                             throws InvalidPathException,
                                    org.apache.thrift.TException

Specified by:

getFileStatus in interface MasterService.Iface

Throws:

InvalidPathException

org.apache.thrift.TException

getWorkersInfo

public List<ClientWorkerInfo> getWorkersInfo()
                                      throws org.apache.thrift.TException

Specified by:

getWorkersInfo in interface MasterService.Iface

Throws:

org.apache.thrift.TException

liststatus

public List<ClientFileInfo> liststatus(String path)
                                throws InvalidPathException,
                                       FileDoesNotExistException,
                                       org.apache.thrift.TException

Specified by:

liststatus in interface MasterService.Iface

Throws:

InvalidPathException

FileDoesNotExistException

org.apache.thrift.TException

user_completeFile

public void user_completeFile(int fileId)
                       throws FileDoesNotExistException,
                              org.apache.thrift.TException

Specified by:

user_completeFile in interface MasterService.Iface

Throws:

FileDoesNotExistException

org.apache.thrift.TException

user_createDependency

public int user_createDependency(List<String> parents,
                        List<String> children,
                        String commandPrefix,
                        List<ByteBuffer> data,
                        String comment,
                        String framework,
                        String frameworkVersion,
                        int dependencyType,
                        long childrenBlockSizeByte)
                          throws InvalidPathException,
                                 FileDoesNotExistException,
                                 FileAlreadyExistException,
                                 BlockInfoException,
                                 TachyonException,
                                 org.apache.thrift.TException

Specified by:

user_createDependency in interface MasterService.Iface

Throws:

InvalidPathException

FileDoesNotExistException

FileAlreadyExistException

BlockInfoException

TachyonException

org.apache.thrift.TException

user_createFile

public int user_createFile(String path,
                  String ufsPath,
                  long blockSizeByte,
                  boolean recursive)
                    throws FileAlreadyExistException,
                           InvalidPathException,
                           BlockInfoException,
                           SuspectedFileSizeException,
                           TachyonException,
                           org.apache.thrift.TException

Specified by:

user_createFile in interface MasterService.Iface

Throws:

FileAlreadyExistException

InvalidPathException

BlockInfoException

SuspectedFileSizeException

TachyonException

org.apache.thrift.TException

user_createNewBlock

public long user_createNewBlock(int fileId)
                         throws FileDoesNotExistException,
                                org.apache.thrift.TException

Specified by:

user_createNewBlock in interface MasterService.Iface

Throws:

FileDoesNotExistException

org.apache.thrift.TException

user_createRawTable

public int user_createRawTable(String path,
                      int columns,
                      ByteBuffer metadata)
                        throws FileAlreadyExistException,
                               InvalidPathException,
                               TableColumnException,
                               TachyonException,
                               org.apache.thrift.TException

Specified by:

user_createRawTable in interface MasterService.Iface

Throws:

FileAlreadyExistException

InvalidPathException

TableColumnException

TachyonException

org.apache.thrift.TException

user_delete

public boolean user_delete(int fileId,
                  String path,
                  boolean recursive)
                    throws TachyonException,
                           org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Delete file

Specified by:

user_delete in interface MasterService.Iface

Throws:

TachyonException

org.apache.thrift.TException

user_getBlockId

public long user_getBlockId(int fileId,
                   int index)
                     throws FileDoesNotExistException,
                            org.apache.thrift.TException

Specified by:

user_getBlockId in interface MasterService.Iface

Throws:

FileDoesNotExistException

org.apache.thrift.TException

user_getClientBlockInfo

public ClientBlockInfo user_getClientBlockInfo(long blockId)
                                        throws FileDoesNotExistException,
                                               BlockInfoException,
                                               org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Get block's ClientBlockInfo.

Specified by:

user_getClientBlockInfo in interface MasterService.Iface

Throws:

FileDoesNotExistException

BlockInfoException

org.apache.thrift.TException

user_getClientDependencyInfo

public ClientDependencyInfo user_getClientDependencyInfo(int dependencyId)
                                                  throws DependencyDoesNotExistException,
                                                         org.apache.thrift.TException

Specified by:

user_getClientDependencyInfo in interface MasterService.Iface

Throws:

DependencyDoesNotExistException

org.apache.thrift.TException

user_getClientRawTableInfo

public ClientRawTableInfo user_getClientRawTableInfo(int id,
                                            String path)
                                              throws TableDoesNotExistException,
                                                     InvalidPathException,
                                                     org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Get RawTable's info; Return a ClientRawTable instance with id 0 if the system does not contain the table. path if valid iff id is -1.

Specified by:

user_getClientRawTableInfo in interface MasterService.Iface

Throws:

TableDoesNotExistException

InvalidPathException

org.apache.thrift.TException

user_getFileBlocks

public List<ClientBlockInfo> user_getFileBlocks(int fileId,
                                       String path)
                                         throws FileDoesNotExistException,
                                                InvalidPathException,
                                                org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Get file blocks info.

Specified by:

user_getFileBlocks in interface MasterService.Iface

Throws:

FileDoesNotExistException

InvalidPathException

org.apache.thrift.TException

user_getRawTableId

public int user_getRawTableId(String path)
                       throws InvalidPathException,
                              org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Return 0 if does not contain the Table, return fileId if it exists.

Specified by:

user_getRawTableId in interface MasterService.Iface

Throws:

InvalidPathException

org.apache.thrift.TException

user_getUfsAddress

public String user_getUfsAddress()
                          throws org.apache.thrift.TException

Specified by:

user_getUfsAddress in interface MasterService.Iface

Throws:

org.apache.thrift.TException

user_getUserId

public long user_getUserId()
                    throws org.apache.thrift.TException

Specified by:

user_getUserId in interface MasterService.Iface

Throws:

org.apache.thrift.TException

user_getWorker

public NetAddress user_getWorker(boolean random,
                        String host)
                          throws NoWorkerException,
                                 org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Get local worker NetAddress

Specified by:

user_getWorker in interface MasterService.Iface

Throws:

NoWorkerException

org.apache.thrift.TException

user_heartbeat

public void user_heartbeat()
                    throws org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Returns if the message was received. Intended to check if the client can still connect to the master.

Specified by:

user_heartbeat in interface MasterService.Iface

Throws:

org.apache.thrift.TException

user_mkdirs

public boolean user_mkdirs(String path,
                  boolean recursive)
                    throws FileAlreadyExistException,
                           InvalidPathException,
                           TachyonException,
                           org.apache.thrift.TException

Specified by:

user_mkdirs in interface MasterService.Iface

Throws:

FileAlreadyExistException

InvalidPathException

TachyonException

org.apache.thrift.TException

user_rename

public boolean user_rename(int fileId,
                  String srcPath,
                  String dstPath)
                    throws FileAlreadyExistException,
                           FileDoesNotExistException,
                           InvalidPathException,
                           org.apache.thrift.TException

Specified by:

user_rename in interface MasterService.Iface

Throws:

FileAlreadyExistException

FileDoesNotExistException

InvalidPathException

org.apache.thrift.TException

user_reportLostFile

public void user_reportLostFile(int fileId)
                         throws FileDoesNotExistException,
                                org.apache.thrift.TException

Specified by:

user_reportLostFile in interface MasterService.Iface

Throws:

FileDoesNotExistException

org.apache.thrift.TException

user_requestFilesInDependency

public void user_requestFilesInDependency(int depId)
                                   throws DependencyDoesNotExistException,
                                          org.apache.thrift.TException

Specified by:

user_requestFilesInDependency in interface MasterService.Iface

Throws:

DependencyDoesNotExistException

org.apache.thrift.TException

user_setPinned

public void user_setPinned(int fileId,
                  boolean pinned)
                    throws FileDoesNotExistException,
                           org.apache.thrift.TException

Specified by:

user_setPinned in interface MasterService.Iface

Throws:

FileDoesNotExistException

org.apache.thrift.TException

user_freepath

public boolean user_freepath(int fileId,
                    String path,
                    boolean recursive)
                      throws TachyonException,
                             org.apache.thrift.TException

Specified by:

user_freepath in interface MasterService.Iface

Throws:

TachyonException

org.apache.thrift.TException

user_updateRawTableMetadata

public void user_updateRawTableMetadata(int tableId,
                               ByteBuffer metadata)
                                 throws TableDoesNotExistException,
                                        TachyonException,
                                        org.apache.thrift.TException

Specified by:

user_updateRawTableMetadata in interface MasterService.Iface

Throws:

TableDoesNotExistException

TachyonException

org.apache.thrift.TException

worker_cacheBlock

public void worker_cacheBlock(long workerId,
                     long workerUsedBytes,
                     long storageDirId,
                     long blockId,
                     long length)
                       throws FileDoesNotExistException,
                              SuspectedFileSizeException,
                              BlockInfoException,
                              org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Update information of the block newly cached to master, including used Tachyon space size in bytes, the id of the storage directory in which the block is, the id of the block and the size of the block in bytes.

Specified by:

worker_cacheBlock in interface MasterService.Iface

Throws:

FileDoesNotExistException

SuspectedFileSizeException

BlockInfoException

org.apache.thrift.TException

worker_getPinIdList

public Set<Integer> worker_getPinIdList()
                                 throws org.apache.thrift.TException

Specified by:

worker_getPinIdList in interface MasterService.Iface

Throws:

org.apache.thrift.TException

worker_getPriorityDependencyList

public List<Integer> worker_getPriorityDependencyList()
                                               throws org.apache.thrift.TException

Specified by:

worker_getPriorityDependencyList in interface MasterService.Iface

Throws:

org.apache.thrift.TException

worker_heartbeat

public Command worker_heartbeat(long workerId,
                       long usedBytes,
                       List<Long> removedBlockIds,
                       Map<Long,List<Long>> addedBlockIds)
                         throws BlockInfoException,
                                org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Heart beat between worker and master, worker update used Tachyon space in bytes, removed blocks and added blocks in each storage directory by eviction and promotion to master, and return the command from master to worker. addedBlockIds maps from id of storage directory to the blocks added in it.

Specified by:

worker_heartbeat in interface MasterService.Iface

Throws:

BlockInfoException

org.apache.thrift.TException

worker_register

public long worker_register(NetAddress workerNetAddress,
                   long totalBytes,
                   long usedBytes,
                   Map<Long,List<Long>> currentBlockIds)
                     throws BlockInfoException,
                            org.apache.thrift.TException

Description copied from interface: MasterService.Iface

Worker register and synch up capacity of Tachyon space, used space bytes and blocks in each storage directory to master, the return value rv % 100,000 is really workerId, rv / 1000,000 is master started time. currentBlocks maps from id of storage directory to the blocks it contains.

Specified by:

worker_register in interface MasterService.Iface

Throws:

BlockInfoException

org.apache.thrift.TException