Datastreams¶
Datastreams are a flexible way to manage data ingestion. With a datastream, you may:
Ingest directly to a specific source dataset, instead of the shared Observation event stream.
Control ingest permission for a datastream through one or more revokable tokens.
Pause and restart ingest.
Rotate a token for datastream without affecting other data sources.
Create up to 10 datastreams per workspace.
The Datastreams tab in Workspace Settings also shows a summary of current datastreams:

Figure 1 - Datastream Summary page
Create a datastream¶
To use a datastream, create the datastream and then create tokens for that stream. Each datastream may have multiple tokens. They may be enabled, disabled, or deleted as needed.
Once you have created a datastream, send data to it in the same way you would configure other data sources. The sections below explain the process in more detail:
Create a new datastream¶
First, create a new datastream:

Figure 2 - Open a new datastream
Go to Datastreams in Workspace settings and click New datastream.
Provide a Name and an optional Description. A good name identifies the data you expect to ingest into this stream, as it is also the name of its dataset. Create the datastream in a package by prepending the package name. For example, “IoT/Raw device data”.
Click New Datastream.
Access this stream, the source dataset, from the Datastreams list by clicking Open dataset on the right side of the window. You may also find it in the list of datasets on the Explore tab, or in the More section of the left menu.

Figure 2 - Open the dataset for a datastream
Create a token¶
To send data to a stream, you need a token. A datastream token is similar to an ingest token but restricted to a specific stream. A stream can have multiple tokens, and any user with write access to the Workspace can create one.

Figure 3 - New token for a datastream
To create a datastream token:
In the Datastreams tab, click on the datastream you want to create a token for.
Click New token
Provide a Name and an optional Description.
Click New token.
Copy your new token to a safe location, check the box to confirm, and click Go to token.
Important
Be sure to save your token. You cannot view it again after closing the confirmation dialog.
Ingest data¶
Configure your desired data source to send to Observe, using the datastream token in place of the usual ingest token. See More about sending data to Observe. Datastream observations go to the event dataset associated with the token, as they would previously be in the Observation event stream. Observe calls this dataset, the datastream source dataset.
Manage datastreams and tokens¶
Datastreams and tokens may be enabled, disabled, or deleted. You can pause ingest from a single token or an entire stream.
Note
Only Admin and Writer members may manage datastreams and tokens.
To update a stream or token, use the dropdown at the top of the page:

Figure 4 - Enabled/Disabled/Delete options for a datastream