Package uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.javardd

Class GetJavaRDDOfAllElementsHandler

java.lang.Object

uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.AbstractGetRDDHandler<GetJavaRDDOfAllElements,org.apache.spark.api.java.JavaRDD<Element>>

uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.javardd.GetJavaRDDOfAllElementsHandler

All Implemented Interfaces:

OperationHandler<GetJavaRDDOfAllElements>, OutputOperationHandler<GetJavaRDDOfAllElements,org.apache.spark.api.java.JavaRDD<Element>>

public class GetJavaRDDOfAllElementsHandler
extends AbstractGetRDDHandler<GetJavaRDDOfAllElements,org.apache.spark.api.java.JavaRDD<Element>>

A handler for the GetJavaRDDOfAllElements operation. This simply uses the operation GetRDDOfAllElements to produce an RDD and then calls toJavaRDD() to obtain a JavaRDD.

If the gaffer.accumulo.spark.directrdd.use_rfile_reader option is set to true then the RDD will be produced by directly reading the RFiles in the Accumulo table, rather than using ElementInputFormat to get data via the tablet servers. In order to read the RFiles directly, the user must have read access to the files. Also note that any data that has not been minor compacted will not be read. Reading the Rfiles directly can increase the performance.

If the gaffer.accumulo.spark.directrdd.use_rfile_reader option is not set then the standard approach of obtaining data via the tablet servers is used.

Nested Class Summary

Nested classes/interfaces inherited from class uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.AbstractGetRDDHandler

AbstractGetRDDHandler.FirstElement

Field Summary

Fields inherited from class uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.AbstractGetRDDHandler

HADOOP_CONFIGURATION_KEY, USE_BATCH_SCANNER_RDD, USE_RFILE_READER_RDD, VIEW

Constructor Summary

Constructors

Constructor	Description
GetJavaRDDOfAllElementsHandler()

Method Summary

Modifier and Type	Method	Description
org.apache.spark.api.java.JavaRDD<Element>	doOperation(GetJavaRDDOfAllElements operation, Context context, Store store)	Execute the given Output operation.

Methods inherited from class uk.gov.gchq.gaffer.sparkaccumulo.operation.handler.AbstractGetRDDHandler

addIterators, addRanges, addRangesFromPairs, convertConfigurationToString, convertStringToConfiguration

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GetJavaRDDOfAllElementsHandler

public GetJavaRDDOfAllElementsHandler()

Method Detail

doOperation

public org.apache.spark.api.java.JavaRDD<Element> doOperation(GetJavaRDDOfAllElements operation,
                                                              Context context,
                                                              Store store)
                                                       throws OperationException

Description copied from interface: OutputOperationHandler

Execute the given Output operation.

Parameters:

operation - the Output operation to be executed

context - the operation chain context, containing the user who executed the operation

store - the Store the operation should be run on

Returns:

the output for the operation.

Throws:

OperationException - thrown if the operation fails