Change Log

Features and Changes

• Change the resource store to not rely on sessions. Resources are now linked to a user.

• Add ReceiptId to the INFO message on data receipt.

• Issue #5047 : Replace the property stroom.security.authentication.openid.validateAudience with stroom.security.authentication.openid.allowedAudiences (defaults to empty) and stroom.security.authentication.openid.audienceClaimRequired (defaults to false). If the IDP is known to provide the aud claim (often populated with the clientId) then set allowedAudiences to contain that value and set audienceClaimRequired to true.

• Issue #5068 : Add the config prop stroom.security.authentication.openId.fullNameClaimTemplate to allow the user’s full name to be formed from a template containing a mixture of static text and claim variables, e.g. ${firstName} ${lastName}. Unknown variables are replaced with an empty string. Default is ${name}.

• Issue #5066 : Change template syntax of openid.publicKeyUriPattern prop from positional variables ({}) to named variables (${awsRegion}). Default value has changed to https://public-keys.auth.elb.${awsRegion}.amazonaws.com/${keyId}. If this prop has been explicitly set, its value will need to be changed to named variables.

• Issue #5030 : Add new property .receive.x509CertificateDnFormat to stroom and proxy to allow extraction of CNs from DNs in legacy OPEN_SSL format. The new property defaults to LDAP, which means no change to behaviour if left as is.

• Issue #5007 : Add ceilingTime() and floorTime().

• Issue #3083 : Allow data() table function to show the Info pane.

• Issue #4965 : Add dashboard screen to show current selection parameters.

• Issue #4496 : Add parse-dateTime xslt function.

• Issue #4496 : Add format-dateTime xslt function.

• Issue #4969 : Add a checkbox to Content Templates edit screen to make it copy (and re-map) any xslt/textConverter docs in the inherited pipeline.

• Issue #4726 : Get meta for parent stream.

• Issue #4900 : Add histogram and metric stores to Plan B.

• Issue #3861 : Add Shard Id, Index Version to Index Shards searchable.

• Issue #4112 : Allow use of Capture groups in the decode() function result.

• Issue #3955 : Add case expression function.

• Issue #4484 : Change selection handling to use fully qualified keys.

• Issue #4742 : Allow embedded queries to be copies rather than references.

• Issue #4894 : Plan B query without snapshots.

• Issue #4896 : Plan B option to synchronise writes.

• Issue #4720 : Add Plan B shards data source.

• Issue #4919 : Add functions to format byte size strings.

• Issue #4901 : Add advanced schema selection to Plan B to improve performance and reduce storage requirements.

Bug Fixes

• Issue #5027 : Allow users to choose run as user for processing.

• Issue #5137 : Fix how proxy adds HTTP headers when sending downstream. It now only adds received meta entries to the headers if they are on an allow list. This list is made up of a hard coded base list accountId, accountName, classification, component, contextEncoding, contextFormat, encoding, environment, feed, format, guid, schema, schemaVersion, system, type and is supplemented by the new config property forwardHeadersAdditionalAllowSet in the forwardHttpDestinations items.

• Issue #5135 : Fix proxy multi part gzip handling.

• Uplift JDK to 21.0.8_9 in docker images and sdkmanrc.

• Issue #5130 : Fix raw size meta bug.

• Issue #5132 : Fix missing session when AWS ALB does the code flow.

• Fix the OpenID code flow to stop the session being lost after redirection back to the initiating URL.

• Issue #5101 : Fix select-all filtering when doing a reprocess of everything in a folder. It no longer tries to re-process deleted items streams.

• Issue #5086 : Improve stream error handling.

• Issue #5114 : Improve handling of loss of connection to IDP.

• Change the way security filter decides whether to authenticate or not, e.g. how it determines what is a static resource that does not need authentication.

• Issue #5115 : Use correct header during proxy forward requests.

• Issue #5121 : Proxy aggregation now keeps only common headers in aggregated data.

• Fix exception handling of DistributedTaskFetcher so it will restart after failure.

• Issue #5127 : Maintain case for proxy meta attributes when logging.

• Issue #5091 : Stop reference data loads failing if there are no entries in the stream.

• Issue #5095 : Lock the cluster to perform pipeline migration to prevent other nodes clashing.

• Issue #5099 : Fix Plan B session key serialisation.

• Issue #5090 : Fix Plan B getVal() serialisation.

• Issue #5106 : Fix ref loads with XML values where the <value> element name is not in lower case.

• Issue #5042 : Allow the import of processor filters when the existing processor filter is in a logically deleted state. Add validation to the import confirm dialog to ensure the parent doc is selected when a processor filter is selected.

• Change DocRef Info Cache to evict entries on document creation to stop stroom saying that a document doesn’t exist after import.

• Issue #5077 : Fix bug in user full name templating where it is always re-using the first value, i.e. setting every user to have the full name of the first user to log in.

• Issue #5073 : Trim the unique identity, display name and full name values for a user to ensure no leading/trailing spaces are stored. Includes DB migration V07_10_00_005__trim_user_identities.sql that trims existing values in the name, display_name and full_name columns of the stroom_user table.

• Issue #5046 : Stop feeds being auto-created when there is no content template match.

• Issue #5062 : Fix permissions issue loading scheduled executors.

• Allow clientSecret to be null/empty for mTLS auth.

• Issue #5017 : Fix stuck spinner copying embedded query.

• Issue #4974 : Fix Plan B condense job.

• Issue #4977 : Limit user visibility in annotations.

• Issue #4976 : Exclude deleted annotations.

• Issue #5002 : Fix Plan B env staying open after error.

• Issue #5003 : Fix query date time formatting.

• Issue #4974 : Improve logging.

• Issue #4974 : NPE debug.

• Issue #4983 : Upgrade Flyway to work with newer version of MySQL.

• Issue #3122 : Make date/time rounding functions time zone sensitive.

• Issue #4984 : Add debug for Plan B tagged keys.

• Issue #4991 : Add Plan B schema validation to ensure stores remain compatible especially when merging parts.

• Issue #4854 : Maintain scrollbar position on datagrid.

• Issue #4957 : Default vis settings are not added to Query pane visualisations.

• Issue #4456 : Fix selection handling across multiple components by uniquely namespacing selections.

• Issue #4886 : Fix ctrl+enter query execution for rules and reports.

• Issue #4884 : Suggest only queryable fields in StroomQL where clause.

• Issue #4945 : Increase index field name length.