Package uk.gov.gchq.gaffer.accumulostore.operation.hdfs.handler.job.factory

Class AccumuloAddElementsFromHdfsJobFactory

java.lang.Object

uk.gov.gchq.gaffer.accumulostore.operation.hdfs.handler.job.factory.AccumuloAddElementsFromHdfsJobFactory

All Implemented Interfaces:

AddElementsFromHdfsJobFactory, JobFactory<AddElementsFromHdfs>

public class AccumuloAddElementsFromHdfsJobFactory
extends Object
implements AddElementsFromHdfsJobFactory

Field Summary

Fields

Modifier and Type	Field	Description
static String	INGEST_HDFS_DATA_GENERATOR_S_OUTPUT_S
static String	INVALID_FIELD_MUST_BE_GREATER_THAN_OR_EQUAL_TO_ONE_GOT_S

Fields inherited from interface uk.gov.gchq.gaffer.hdfs.operation.handler.job.factory.JobFactory

MAPPER_GENERATOR, SCHEMA, VALIDATE

Constructor Summary

Constructors

Constructor	Description
AccumuloAddElementsFromHdfsJobFactory()
AccumuloAddElementsFromHdfsJobFactory(org.apache.hadoop.conf.Configuration configuration)

Method Summary

Modifier and Type	Method	Description
org.apache.hadoop.mapred.JobConf	createJobConf(AddElementsFromHdfs operation, String mapperGeneratorClassName, Store store)	Creates an JobConf to be used for the add from hdfs.
void	prepareStore(Store store)	Prepares the store for the add from hdfs.
void	setupJob(org.apache.hadoop.mapreduce.Job job, AddElementsFromHdfs operation, String mapperGenerator, Store store)	Sets up all parts of the Job to be used on the add from hdfs.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface uk.gov.gchq.gaffer.hdfs.operation.handler.job.factory.JobFactory

createJobs

Field Detail

INVALID_FIELD_MUST_BE_GREATER_THAN_OR_EQUAL_TO_ONE_GOT_S

public static final String INVALID_FIELD_MUST_BE_GREATER_THAN_OR_EQUAL_TO_ONE_GOT_S

See Also:

Constant Field Values

INGEST_HDFS_DATA_GENERATOR_S_OUTPUT_S

public static final String INGEST_HDFS_DATA_GENERATOR_S_OUTPUT_S

See Also:

Constant Field Values

Constructor Detail

AccumuloAddElementsFromHdfsJobFactory

public AccumuloAddElementsFromHdfsJobFactory(org.apache.hadoop.conf.Configuration configuration)

AccumuloAddElementsFromHdfsJobFactory

public AccumuloAddElementsFromHdfsJobFactory()

Method Detail

prepareStore

public void prepareStore(Store store)
                  throws StoreException

Description copied from interface: AddElementsFromHdfsJobFactory

Prepares the store for the add from hdfs. For example this could create a table to store the elements in.

Specified by:

prepareStore in interface AddElementsFromHdfsJobFactory

Parameters:

store - The store.

Throws:

StoreException - If an error occurs.

createJobConf

public org.apache.hadoop.mapred.JobConf createJobConf(AddElementsFromHdfs operation,
                                                      String mapperGeneratorClassName,
                                                      Store store)
                                               throws IOException

Description copied from interface: JobFactory

Creates an JobConf to be used for the add from hdfs.

Specified by:

createJobConf in interface JobFactory<AddElementsFromHdfs>

Parameters:

operation - The Operation.

mapperGeneratorClassName - Class name for the MapperGenerator class.

store - The store.

Returns:

The JobConf.

Throws:

IOException - For IO issues.

setupJob

public void setupJob(org.apache.hadoop.mapreduce.Job job,
                     AddElementsFromHdfs operation,
                     String mapperGenerator,
                     Store store)
              throws IOException

Description copied from interface: JobFactory

Sets up all parts of the Job to be used on the add from hdfs.

Specified by:

setupJob in interface JobFactory<AddElementsFromHdfs>

Parameters:

job - The Job to be executed.

operation - The Operation.

mapperGenerator - Class Name for the MapperGenerator class.

store - The store.

Throws:

IOException - For IO issues.