Feeds

Getting data into Stroom

Create the feed

Stroom organises the data it ingests and stores by Feed . A feed will typically be created for each client system and data format.

Data is sent to a Stroom feed using a POST to the /datafeed API . We will use curl to represent a client system sending data into Stroom.

1. A lot of Stroom’s functionality is available through right-click context menus. If you right-click System in the tree you can create new child items.

   Create a new folder by selecting:

   New

   Folder

   Call it something like Stroom 101:

2. Right-click on the new Stroom Quick Start folder then select this to create a feed:

   New

   Feed

   The name needs to be capitalised and unique across all feeds. Name it CSV_FEED.

   This will open a new tab for the feed.

3. We want to emulate a client system sending some data to the feed, so from the command line do

   Download mock_stroom_data.csv to your computer. Then open a terminal session and change directory to the location of the downloaded file.

   curl \
   -k \
   --data-binary @mock_stroom_data.csv \
   "https://localhost/stroom/datafeeddirect" \
   -H "Feed:CSV_FEED" \
   -H "System:TEST_SYSTEM" \
   -H "Environment:TEST"

The -H arguments add HTTP headers to the HTTP POST request. Stroom uses these headers to determine how to process the data, see Header Arguments for more details.

In this example we used /datafeeddirect rather than /datafeed.
The former goes directly into Stroom, the latter goes via Stoom Proxy where it is aggregated before being picked up by Stroom.

That’s it, there’s now data in Stroom. In the CSV_FEED tab, ensure the Data sub-tab is selected then click the new entry in the top pane and finnaly click the button: You should be able to see it in the data table in the bottom pane.

---

Now you can do all sorts of things with the data: transform it, visualise it, index it. It’s Pipelines that allow all these things to happen.