Create and share Datasets

Create and share Datasets from the Dataset page, or from any Worksheet.

Create and publish a Dataset from a Worksheet

From a Worksheet, you can create a query and publish a new Dataset:

  1. Access a Worksheet in Observe. You can do this by selecting Worksheets in the left navigation and then selecting or creating a Worksheet, or by selecting Open in Worksheet from a variety of places in Observe.
  2. In the list of queries, click the More icon (), and select Create new dataset.

The Dataset editor allows you to customize the Dataset before you publish it.

The High Performance label means that the Observe platform is checking your OPAL for errors and warning related to Dataset acceleration, and whether or not a pipeline can be accelerated as well as the complexity of its acceleration. Dataset acceleration is required for a Dataset to be created.

Click Publish dataset when you are ready to publish your Dataset. In the series of subsequent modal windows:

  • Give the Dataset a name.
  • Configure the sharing settings for your Dataset.
  • Click Publish.

Manage your Dataset

Once you create and save a Dataset, you can view additional information about your Dataset and also configure additional properties.

Get an overview of your Dataset

Click the Overview tab to view general information about your Dataset, such as the data type, data source, status, freshness goals, and acceleration details.

View your Dataset's definition

Click the Definition tab to view or edit the OPAL query.

View your Dataset's lineage

Click Lineage to view information about how this Dataset is connected to and derived from other Datasets.

  • Links show the Datasets connected to this Dataset by foreign and primary key:
  • Lineage shows the upstream and downstream data sources for this Dataset:
  • Focus shows the connections from the direct primary key, along with foreign keys to other Datasets.

Configure Dataset properties

Click the Properties tab to review and configure the properties for your Dataset.

PropertyDescription
LabelsReview and change the name, description, and icon for this Dataset.
Access ControlReview and change the access control (sharing) settings configured for this Dataset when the Dataset was created.
TagsAdd correlation tags to your Dataset's columns and object paths. See Correlation tags.
IndexesView the indexes used for this Dataset. An index is a structure that makes Dataset queries fast and efficient.
KeysView the primary key for this Dataset.
LinksView details about the upstream and downstream links for this Dataset.
InterfacesContains field mappings for this Dataset.

Create a Dataset from the Dataset page

In addition to creating a Dataset from a Worksheet, you can also create Datasets from the Dataset page.

  1. Click New dataset on the Dataset page to begin creating a new Dataset.
  2. Select a Dataset.
  3. Specify additional filters using the builder or OPAL console.
  1. Click Publish dataset. In the series of subsequent modal windows:
  • Give the Dataset a name.
  • Configure the sharing settings for your Dataset.
  • Click Publish.

Create a reference table from the Dataset page

Click the down chevron icon () in the Create dataset button, then select Upload CSV as a reference table.

Follow the instructions in Create reference tables using the UI to complete the dialog and create the reference table.