tokenize(value: string, [separator: const string]?) -> array of string

Splits the string into an array based on separator, which is treated as a set of characters.

The default separator is " ".

Domain

This is a scalar function (calculates a single output value for a single input row).

Categories

• Semistructured
• String

Examples

tokenize("a b c d")

Returns ["a", "b", "c", "d"].

tokenize("[email protected]", "@.")

Returns ["hello", "example", "com"].