|
|||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use JobConf | |
org.apache.nutch.mapReduce | A system for scalable, fault-tolerant, distributed computation over large data collections. |
org.apache.nutch.mapReduce.lib | Library of generally useful mappers, reducers, and partitioners. |
Uses of JobConf in org.apache.nutch.mapReduce |
Methods in org.apache.nutch.mapReduce with parameters of type JobConf | |
RunningJob |
JobClient.submitJob(JobConf job)
Submit a job to the MR system |
static void |
JobClient.runJob(JobConf job)
Utility that submits a job, then polls for progress until the job is complete. |
void |
ReduceTask.run(JobConf job,
TaskUmbilicalProtocol umbilical)
|
RecordWriter |
OutputFormat.getRecordWriter(NutchFileSystem fs,
JobConf job,
String name)
Construct a RecordWriter . |
void |
MapTask.run(JobConf job,
TaskUmbilicalProtocol umbilical)
|
abstract void |
Task.run(JobConf job,
TaskUmbilicalProtocol umbilical)
Run this task as a part of the named job. |
RecordWriter |
SequenceFileOutputFormat.getRecordWriter(NutchFileSystem fs,
JobConf job,
String name)
|
RecordWriter |
TextOutputFormat.getRecordWriter(NutchFileSystem fs,
JobConf job,
String name)
|
abstract RecordReader |
InputFormatBase.getRecordReader(NutchFileSystem fs,
FileSplit split,
JobConf job)
|
protected File[] |
InputFormatBase.listFiles(NutchFileSystem fs,
JobConf job)
Subclasses may override to, e.g., select only files matching a regular expression. |
FileSplit[] |
InputFormatBase.getSplits(NutchFileSystem fs,
JobConf job,
int numSplits)
Splits files returned by {#listFiles(NutchFileSystem,JobConf) when they're too big. |
RecordReader |
TextInputFormat.getRecordReader(NutchFileSystem fs,
FileSplit split,
JobConf job)
|
FileSplit[] |
InputFormat.getSplits(NutchFileSystem fs,
JobConf job,
int numSplits)
Splits a set of input files. |
RecordReader |
InputFormat.getRecordReader(NutchFileSystem fs,
FileSplit split,
JobConf job)
Construct a RecordReader for a FileSplit . |
RecordReader |
SequenceFileInputFormat.getRecordReader(NutchFileSystem fs,
FileSplit split,
JobConf job)
|
void |
Configurable.configure(JobConf job)
Initializes a new instance from a JobConf . |
Uses of JobConf in org.apache.nutch.mapReduce.lib |
Methods in org.apache.nutch.mapReduce.lib with parameters of type JobConf | |
void |
IdentityReducer.configure(JobConf job)
|
void |
HashPartitioner.configure(JobConf job)
|
void |
IdentityMapper.configure(JobConf job)
|
void |
LongSumReducer.configure(JobConf job)
|
void |
InverseMapper.configure(JobConf job)
|
void |
RegexMapper.configure(JobConf job)
|
void |
TokenCountMapper.configure(JobConf job)
|
|
|||||||||||
PREV NEXT | FRAMES NO FRAMES |