tokenize

Description

Splits the string into an array based on separator, which is treated as a set of characters. The default separator is ” “.

Return type

array

Domain

This is a scalar function (calculates a single output value for a single input row.)

Categories

Usage

tokenize( value [ , separator ] )

Argument

Type

Required

Multiple

Constant

value

string

Required

Only one

Variable

separator

string

Optional

Only one

Constant

Examples

tokenize("a b c d")

Returns [“a”, “b”, “c”, “d”].

tokenize("[email protected]", "@.")

Returns [“hello”, “example”, “com”].