Package uk.gov.gchq.gaffer.spark.operation.scalardd

Class SplitStoreFromRDDOfElements

java.lang.Object

uk.gov.gchq.gaffer.spark.operation.scalardd.SplitStoreFromRDDOfElements

All Implemented Interfaces:

Closeable, AutoCloseable, Input<org.apache.spark.rdd.RDD<Element>>, Operation

public class SplitStoreFromRDDOfElements
extends Object
implements Operation, Input<org.apache.spark.rdd.RDD<Element>>

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SplitStoreFromRDDOfElements.Builder

Nested classes/interfaces inherited from interface uk.gov.gchq.gaffer.operation.Operation

Operation.BaseBuilder<OP extends Operation,B extends Operation.BaseBuilder<OP,?>>

Constructor Summary

Constructors

Constructor	Description
SplitStoreFromRDDOfElements()

Method Summary

Modifier and Type	Method	Description
Double	getFractionToSample()
org.apache.spark.rdd.RDD<Element>	getInput()
Integer	getMaxSampleSize()
Integer	getNumSplits()
Map<String,String>	getOptions()
void	setFractionToSample(Double fractionToSample)
void	setInput(org.apache.spark.rdd.RDD<Element> input)
void	setMaxSampleSize(Integer maxSampleSize)
void	setNumSplits(Integer numSplits)
void	setOptions(Map<String,String> options)
Operation	shallowClone()	Operation implementations should ensure a ShallowClone method is implemented.
uk.gov.gchq.koryphe.ValidationResult	validate()	Validates an operation.

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface uk.gov.gchq.gaffer.operation.io.Input

close

Methods inherited from interface uk.gov.gchq.gaffer.operation.Operation

_getNullOrOptions, addOption, containsOption, getOption, getOption, validateRequiredFieldPresent

Constructor Detail

SplitStoreFromRDDOfElements

public SplitStoreFromRDDOfElements()

Method Detail

validate

public uk.gov.gchq.koryphe.ValidationResult validate()

Description copied from interface: Operation

Validates an operation. This should be used to validate that fields have been be configured correctly. By default no validation is applied. Override this method to implement validation.

Specified by:

validate in interface Operation

Returns:

validation result.

getInput

public org.apache.spark.rdd.RDD<Element> getInput()

Specified by:

getInput in interface Input<org.apache.spark.rdd.RDD<Element>>

setInput

public void setInput(org.apache.spark.rdd.RDD<Element> input)

Specified by:

setInput in interface Input<org.apache.spark.rdd.RDD<Element>>

getOptions

public Map<String,String> getOptions()

Specified by:

getOptions in interface Operation

Returns:

the operation options. This may contain store specific options such as authorisation strings or and other properties required for the operation to be executed. Note these options will probably not be interpreted in the same way by every store implementation.

setOptions

public void setOptions(Map<String,String> options)

Specified by:

setOptions in interface Operation

Parameters:

options - the operation options. This may contain store specific options such as authorisation strings or and other properties required for the operation to be executed. Note these options will probably not be interpreted in the same way by every store implementation.

shallowClone

public Operation shallowClone()
                       throws org.apache.commons.lang3.exception.CloneFailedException

Description copied from interface: Operation

Operation implementations should ensure a ShallowClone method is implemented. Performs a shallow clone. Creates a new instance and copies the fields across. It does not clone the fields. If the operation contains nested operations, these must also be cloned.

Specified by:

shallowClone in interface Operation

Returns:

shallow clone

Throws:

org.apache.commons.lang3.exception.CloneFailedException - if a Clone error occurs

getFractionToSample

public Double getFractionToSample()

setFractionToSample

public void setFractionToSample(Double fractionToSample)

getMaxSampleSize

public Integer getMaxSampleSize()

setMaxSampleSize

public void setMaxSampleSize(Integer maxSampleSize)

getNumSplits

public Integer getNumSplits()

setNumSplits

public void setNumSplits(Integer numSplits)