This is the multi-page printable view of this section. Click here to print.
R
- 1: Raw Events
- 2: Re-processing
- 3: Records
- 4: REST
1 - Raw Events
This is a Stream Type used for Streams received by Stroom. Streams received by Stroom will be in a variety of text formats (CSV, delimited, fixed width, XML, JSON, etc.). Until they have been processed by a pipeline they are essentially just unstructured character data with no concept of what is a record/event. A Parser in a pipeline is required to provide the demarcation between records/events.
See Also
Stream
Stream
A Stream is the unit of data that Stroom works with and will typically contain many Events.Click to see more details...
Stream Type
Stream Type
All Streams must have a Stream Type. The list of Stream Types is configured using the Property
stroom.data.meta.metaTypes.Click to see more details...
Parser
Parser
A Parser is a Pipeline element for parsing Raw Events into a structured form. For example the Data Splitter Parser that parses text data into Records and Fields.Click to see more details...
2 - Re-processing
The act of repeating the processing of a set of input data (Stream) that have already been processed at least once. Re-Processing can be done for an individual Stream or multiple Streams using a Processor Filter.
See Also
Stream
Stream
A Stream is the unit of data that Stroom works with and will typically contain many Events.Click to see more details...
Processor filter
Processor filter
A Processor Filter is used to used to find Streams to process through the Pipeline associated with the Processor Filter. A Processor Filter consists of an expression tree to select which Streams to process and a tracker to track the what Streams have been processed.Click to see more details...
3 - Records
This is a Stream Type for Streams containing data conforming to the
records:2 XML Schema. It also refers more generally to any XML conforming to the records:2 XML Schema which is used in a number of places in Stroom, including as the output format for the DSParser and input for the IndexingFilter.See Also
-
Stream Type
Stream Type
All Streams must have a Stream Type. The list of Stream Types is configured using the Property
stroom.data.meta.metaTypes.Click to see more details... - Stream Stream A Stream is the unit of data that Stroom works with and will typically contain many Events.Click to see more details...
- records:2 XML Schema
4 - REST
REST (Representational State Transfer) is essentially an architectural style that dictates how data should be handled and “transferred” across a network. REST APIs typically use JSON to send data between the client and the server, and the HTTP methods GET, PUT, PATCH, POST and DELETE.