tachyon.master

Class Dependency

java.lang.Object

tachyon.master.ImageWriter

tachyon.master.Dependency

public class Dependency
extends ImageWriter

Describe the lineage between files. Used for recomputation.

Field Summary

Fields

Modifier and Type	Field and Description
List<Integer>	mChildrenFiles
String	mCommandPrefix
String	mComment
long	mCreationTimeMs
List<ByteBuffer>	mData
DependencyType	mDependencyType
String	mFramework
String	mFrameworkVersion
int	mId
List<Integer>	mParentDependencies
List<Integer>	mParentFiles

Constructor Summary

Constructors

Constructor and Description
Dependency(int id, List<Integer> parents, List<Integer> children, String commandPrefix, List<ByteBuffer> data, String comment, String framework, String frameworkVersion, DependencyType type, Collection<Integer> parentDependencies, long creationTimeMs) Create a new dependency

Method Summary

Methods

Modifier and Type	Method and Description
void	addChildrenDependency(int childDependencyId) Add a child dependency, which means one of the children of the current dependency is a parent of the added dependency.
void	addLostFile(int fileId) A file lost.
void	childCheckpointed(int childFileId) A child file has been checkpointed.
ClientDependencyInfo	generateClientDependencyInfo() Generate a ClientDependencyInfo, which is used for the thrift server.
List<Integer>	getChildrenDependency() Get the children dependencies of this dependency.
String	getCommand() Get the command used for the recomputation.
List<Integer>	getLostFiles() Get the lost files of the dependency.
boolean	hasCheckpointed() Return true if the dependency has checkpointed, which means all the children files are checkpointed.
boolean	hasChildrenDependency() Return true if it has children dependency.
boolean	hasLostFile() Return true if there exists lost file of the dependency.
String	toString()
void	writeImage(com.fasterxml.jackson.databind.ObjectWriter objWriter, DataOutputStream dos) Write image to the specified DataOutputStream.

Methods inherited from class tachyon.master.ImageWriter

writeElement

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

mId

public final int mId

mCreationTimeMs

public final long mCreationTimeMs

mParentFiles

public final List<Integer> mParentFiles

mChildrenFiles

public final List<Integer> mChildrenFiles

mCommandPrefix

public final String mCommandPrefix

mData

public final List<ByteBuffer> mData

mComment

public final String mComment

mFramework

public final String mFramework

mFrameworkVersion

public final String mFrameworkVersion

mDependencyType

public final DependencyType mDependencyType

mParentDependencies

public final List<Integer> mParentDependencies

Constructor Detail

Dependency

public Dependency(int id,
          List<Integer> parents,
          List<Integer> children,
          String commandPrefix,
          List<ByteBuffer> data,
          String comment,
          String framework,
          String frameworkVersion,
          DependencyType type,
          Collection<Integer> parentDependencies,
          long creationTimeMs)

Create a new dependency

Parameters:

id - The id of the dependency

parents - The input files' id of the dependency

children - The output files' id of the dependency

commandPrefix - The prefix of the command used for recomputation

data - The list of the data used for recomputation

comment - The comment of the dependency

framework - The framework of the dependency, used for recomputation

frameworkVersion - The version of the framework

type - The type of the dependency, DependencyType.Wide or DependencyType.Narrow

parentDependencies - The id of the parents' dependencies

creationTimeMs - The create time of the dependency, in milliseconds

Method Detail

addChildrenDependency

public void addChildrenDependency(int childDependencyId)

Add a child dependency, which means one of the children of the current dependency is a parent of the added dependency.

Parameters:

childDependencyId - The id of the child dependency to be added

addLostFile

public void addLostFile(int fileId)

A file lost. Add it to the dependency.

Parameters:

fileId - The id of the lost file

childCheckpointed

public void childCheckpointed(int childFileId)

A child file has been checkpointed. Remove it from the uncheckpointed children list.

Parameters:

childFileId - The id of the checkpointed child file

generateClientDependencyInfo

public ClientDependencyInfo generateClientDependencyInfo()

Generate a ClientDependencyInfo, which is used for the thrift server.

Returns:

the generated ClientDependencyInfo

getChildrenDependency

public List<Integer> getChildrenDependency()

Get the children dependencies of this dependency. It will return a duplication.

Returns:

the duplication of the children dependencies

getCommand

public String getCommand()

Get the command used for the recomputation. Note that it will clear the set of lost files' id.

Returns:

the command used for the recomputation

getLostFiles

public List<Integer> getLostFiles()

Get the lost files of the dependency. It will return a duplication.

Returns:

the duplication of the lost files' id

hasCheckpointed

public boolean hasCheckpointed()

Return true if the dependency has checkpointed, which means all the children files are checkpointed.

Returns:

true if all the children files are checkpointed, false otherwise

hasChildrenDependency

public boolean hasChildrenDependency()

Return true if it has children dependency.

Returns:

true if it has children dependency, false otherwise

hasLostFile

public boolean hasLostFile()

Return true if there exists lost file of the dependency.

Returns:

true if the dependency has lost file, false otherwise

toString

public String toString()

Overrides:

toString in class Object

writeImage

public void writeImage(com.fasterxml.jackson.databind.ObjectWriter objWriter,
              DataOutputStream dos)
                throws IOException

Description copied from class: ImageWriter

Write image to the specified DataOutputStream. Use the specified ObjectWriter.

Parameters:

objWriter - The used object writer

dos - The target data output stream

Throws:

IOException