set_valid_from

Type of operation: Metadata

Description

Declare the valid from of the output to be the named column, which must be a timestamp column. Beware changing time to a field that is too far off from the current timestamp field, because it may end up falling outside of the processing time window. Any row with a new timestamp value more than max_time_diff from its original timestamp is not included in the output.

The “valid from” value must be a column that already exists, not an expression, and must be a timestamp type, so you may need to re-shape columns with make_col before you use this verb.

Usage

set_valid_from [ options ], columnname

Argument

Type

Required

Multiple

options

options

Optional

Only one

columnname

fieldref

Required

Only one

Options

Option

Type

Meaning

max_time_diff

duration

The new timestamp will be no further away from the old timestamp than this (default 1h)

Accelerable

set_valid_from is always accelerable if the input is accelerable. A dataset that only uses accelerable verbs can be accelerated, making queries on the dataset respond faster.

Examples

set_valid_from ts_col

Sets the valid from designation of the output dataset as the ts_col field.

set_valid_from options(max_time_diff:duration_hr(1)), ts_col

Sets the valid from designation of the output dataset as the ts_col field, and the maximum time difference between the original valid from field and ts_col is less than one hour.

Aliases

  • setvf (deprecated)