Package uk.gov.gchq.gaffer.hdfs.operation.handler.job.factory

Interface JobFactory<O extends MapReduce>

All Known Subinterfaces:

AddElementsFromHdfsJobFactory, SampleDataForSplitPointsJobFactory

All Known Implementing Classes:

AccumuloAddElementsFromHdfsJobFactory, AccumuloSampleDataForSplitPointsJobFactory

public interface JobFactory<O extends MapReduce>

Field Summary

Fields

Modifier and Type	Field	Description
static String	MAPPER_GENERATOR
static String	SCHEMA
static String	VALIDATE

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.mapred.JobConf	createJobConf(O operation, String mapperGeneratorClassName, Store store)	Creates an JobConf to be used for the add from hdfs.
default List<org.apache.hadoop.mapreduce.Job>	createJobs(O operation, Store store)	Creates a job with the store specific job initialisation and then applies the operation specific JobInitialiser.
void	setupJob(org.apache.hadoop.mapreduce.Job job, O operation, String mapperGenerator, Store store)	Sets up all parts of the Job to be used on the add from hdfs.

Field Detail

SCHEMA

static final String SCHEMA

See Also:

Constant Field Values

MAPPER_GENERATOR

static final String MAPPER_GENERATOR

See Also:

Constant Field Values

VALIDATE

static final String VALIDATE

See Also:

Constant Field Values

Method Detail

createJobs

default List<org.apache.hadoop.mapreduce.Job> createJobs(O operation,
                                                         Store store)
                                                  throws IOException

Creates a job with the store specific job initialisation and then applies the operation specific JobInitialiser.

Parameters:

operation - The operation.

store - The store executing the operation.

Returns:

The created job.

Throws:

IOException - for IO issues.

createJobConf

org.apache.hadoop.mapred.JobConf createJobConf(O operation,
                                               String mapperGeneratorClassName,
                                               Store store)
                                        throws IOException

Creates an JobConf to be used for the add from hdfs.

Parameters:

operation - The Operation.

mapperGeneratorClassName - Class name for the MapperGenerator class.

store - The store.

Returns:

The JobConf.

Throws:

IOException - For IO issues.

setupJob

void setupJob(org.apache.hadoop.mapreduce.Job job,
              O operation,
              String mapperGenerator,
              Store store)
       throws IOException

Sets up all parts of the Job to be used on the add from hdfs.

Parameters:

job - The Job to be executed.

operation - The Operation.

mapperGenerator - Class Name for the MapperGenerator class.

store - The store.

Throws:

IOException - For IO issues.