Package uk.gov.gchq.gaffer.spark.operation.scalardd

Class ImportRDDOfElements

java.lang.Object

uk.gov.gchq.gaffer.spark.operation.scalardd.ImportRDDOfElements

All Implemented Interfaces:

Closeable, AutoCloseable, Input<org.apache.spark.rdd.RDD<Element>>, Operation

public class ImportRDDOfElements
extends Object
implements Input<org.apache.spark.rdd.RDD<Element>>

A ImportRDDOfElements takes a RDD containing Elements and adds them to a target Gaffer store.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	ImportRDDOfElements.Builder

Nested classes/interfaces inherited from interface uk.gov.gchq.gaffer.operation.Operation

Operation.BaseBuilder<OP extends Operation,B extends Operation.BaseBuilder<OP,?>>

Field Summary

Fields

Modifier and Type	Field	Description
static String	HADOOP_CONFIGURATION_KEY

Constructor Summary

Constructors

Constructor	Description
ImportRDDOfElements()

Method Summary

Modifier and Type	Method	Description
org.apache.spark.rdd.RDD<Element>	getInput()
Map<String,String>	getOptions()
void	setInput(org.apache.spark.rdd.RDD<Element> input)
void	setOptions(Map<String,String> options)
ImportRDDOfElements	shallowClone()	Operation implementations should ensure a ShallowClone method is implemented.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface uk.gov.gchq.gaffer.operation.io.Input

close

Methods inherited from interface uk.gov.gchq.gaffer.operation.Operation

_getNullOrOptions, addOption, containsOption, getOption, getOption, validate, validateRequiredFieldPresent

Field Detail

HADOOP_CONFIGURATION_KEY

public static final String HADOOP_CONFIGURATION_KEY

See Also:

Constant Field Values

Constructor Detail

ImportRDDOfElements

public ImportRDDOfElements()

Method Detail

getInput

public org.apache.spark.rdd.RDD<Element> getInput()

Specified by:

getInput in interface Input<org.apache.spark.rdd.RDD<Element>>

setInput

public void setInput(org.apache.spark.rdd.RDD<Element> input)

Specified by:

setInput in interface Input<org.apache.spark.rdd.RDD<Element>>

getOptions

public Map<String,String> getOptions()

Specified by:

getOptions in interface Operation

Returns:

the operation options. This may contain store specific options such as authorisation strings or and other properties required for the operation to be executed. Note these options will probably not be interpreted in the same way by every store implementation.

setOptions

public void setOptions(Map<String,String> options)

Specified by:

setOptions in interface Operation

Parameters:

options - the operation options. This may contain store specific options such as authorisation strings or and other properties required for the operation to be executed. Note these options will probably not be interpreted in the same way by every store implementation.

shallowClone

public ImportRDDOfElements shallowClone()

Description copied from interface: Operation

Operation implementations should ensure a ShallowClone method is implemented. Performs a shallow clone. Creates a new instance and copies the fields across. It does not clone the fields. If the operation contains nested operations, these must also be cloned.

Specified by:

shallowClone in interface Operation

Returns:

shallow clone