org.apache.nutch.fetcher
Class FetcherOutput

java.lang.Object
  org.apache.nutch.fetcher.FetcherOutput

All Implemented Interfaces:

Writable

public final class FetcherOutput

extends Object

implements Writable

An entry in the fetcher's output. This includes all of the fetcher output except the raw and stripped versions of the content, which are placed in separate files.

Note by John Xing: As of 20041022, option -noParsing is introduced in Fetcher.java. This changes fetcher behavior. Accordingly there are necessary modifications in this class. Check Fetcher.java and ParseSegment.java for details.

Author:

Doug Cutting

Field Summary

static String	DIR_NAME
static String	DIR_NAME_NP
static String	DONE_NAME
static String	ERROR_NAME

Constructor Summary

FetcherOutput()

FetcherOutput(FetchListEntry fetchListEntry, MD5Hash md5Hash, ProtocolStatus protocolStatus)

Method Summary

boolean	equals(Object o)
String[]	getAnchors()
long	getFetchDate()
FetchListEntry	getFetchListEntry()
MD5Hash	getMD5Hash()
ProtocolStatus	getProtocolStatus()
UTF8	getUrl()
byte	getVersion()
static void	main(String[] argv)
static FetcherOutput	read(DataInput in)
void	readFields(DataInput in) Reads the fields of this object from in.
void	setFetchDate(long fetchDate)
void	setProtocolStatus(ProtocolStatus protocolStatus)
String	toString()
void	write(DataOutput out) Writes the fields of this object to out.

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

DIR_NAME

public static final String DIR_NAME

See Also:

Constant Field Values

DIR_NAME_NP

public static final String DIR_NAME_NP

See Also:

Constant Field Values

DONE_NAME

public static final String DONE_NAME

See Also:

Constant Field Values

ERROR_NAME

public static final String ERROR_NAME

See Also:

Constant Field Values

Constructor Detail

FetcherOutput

public FetcherOutput()

FetcherOutput

public FetcherOutput(FetchListEntry fetchListEntry,
                     MD5Hash md5Hash,
                     ProtocolStatus protocolStatus)

Method Detail

getVersion

public byte getVersion()

readFields

public final void readFields(DataInput in)
                      throws IOException

Description copied from interface: Writable

Reads the fields of this object from in. For efficiency, implementations should attempt to re-use storage in the existing object where possible.

Specified by:

readFields in interface Writable

Throws:

IOException

write

public final void write(DataOutput out)
                 throws IOException

Description copied from interface: Writable

Writes the fields of this object to out.

Specified by:

write in interface Writable

Throws:

IOException

read

public static FetcherOutput read(DataInput in)
                          throws IOException

Throws:

IOException

getFetchListEntry

public FetchListEntry getFetchListEntry()

getMD5Hash

public MD5Hash getMD5Hash()

getProtocolStatus

public ProtocolStatus getProtocolStatus()

setProtocolStatus

public void setProtocolStatus(ProtocolStatus protocolStatus)

getFetchDate

public long getFetchDate()

setFetchDate

public void setFetchDate(long fetchDate)

getUrl

public UTF8 getUrl()

getAnchors

public String[] getAnchors()

equals

public boolean equals(Object o)

toString

public String toString()

main

public static void main(String[] argv)
                 throws Exception

Throws:

Exception