This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

S

1 - Search extraction

The process of extracting un-indexed Field values from the source Event to be used in search results.

2 - Searchable

A Searchable is the term given the special searchable data sources that appear at the root of the explorer tree picker when selecting a data source. These data sources are special internal data sources that are not user managed content, unlike an Index. They provide the means to search various aspects of Stroom’s internals, such as the Meta Store or Processor Tasks.

3 - Stepper

The Stepper is a tool in Stroom for developing and debugging a Pipeline. It allows the user to simulate passing a Stream through a pipeline with the ability to step from one record/event to the next or to jump to records/events based on filter criteria.

The parsers and translations can be edited while in the Stepper with the element output updating to show the effect of the change. The stepper will not write data to the file system or stream stores.

4 - Stream

A Stream is the unit of data that Stroom works with and will typically contain many Events.

5 - Stream Type

All Streams must have a Stream Type. The list of Stream Types is configured using the Property stroom.data.meta.metaTypes.

Additional Stream Types can be added however the list of Stream Types must include the following built-in types:

  • Context
  • Error
  • Events Events This is a Stream Type in Stroom. An Events stream consists of processed/cooked data that has been demarcated into individual Events.Click to see more details...
  • Meta
  • Raw Events Raw Events This is a Stream Type used for Streams received by Stroom. Streams received by Stroom will be in a variety of text formats (CSV, delimited, fixed width, XML, JSON, etc.). Until they have been processed by a pipeline they are essentially just unstructured character data with no concept of what is a record/event. A Parser in a pipeline is required to provide the demarcation between records/events.Click to see more details...
  • Raw Reference
  • Reference

Some Stream Types, such as Meta and Context only exist as child streams within another Stream.

6 - StroomQl

Stroom Query Language is Stroom’s own query language. It has similarities with Structured Query Language (SQL) as used in databases. StroomQL is sometimes referred to as sQL to distinguish it from SQL.