Create and share Datasets

Create and share Datasets from the Dataset page, or from any Worksheet.

Create and publish a Dataset from a Worksheet

From a Worksheet, you can create a query and publish a new Dataset:

  1. Access a Worksheet in Observe. You can do this by selecting Worksheets in the left navigation and then selecting or creating a Worksheet, or by selecting Open in Worksheet from a variety of places in Observe.

  2. In the list of queries, click the More icon (), and select Create new dataset.

Create a Dataset from a Worksheet

The Dataset editor allows you to customize the Dataset before you publish it.

Dataset detials when creating a new Dataset from a Worksheet

The High Performance label means that the Observe platform is checking your OPAL for errors and warning related to Dataset acceleration, and whether or not a pipeline can be accelerated as well as the complexity of its acceleration. Dataset acceleration is required for a Dataset to be created.

Click Publish dataset when you are ready to publish your Dataset. In the series of subsequent modal windows:

  • Give the Dataset a name.

  • Configure the sharing settings for your Dataset.

  • Click Publish.

Manage your Dataset

Once you create and save a Dataset, you can view additional information about your Dataset and also configure additional properties.

Get an overview of your Dataset

Click the Overview tab to view general information about your Dataset, such as the data type, data source, status, freshness goals, and acceleration details.

View your Dataset’s definition

Click the Definition tab to view or edit the OPAL query.

View your Dataset’s lineage

Click Lineage to view information about how this Dataset is connected to and derived from other Datasets.

  • Links show the Datasets connected to this Dataset by foreign and primary key:

Dataset links
  • Lineage shows the upstream and downstream data sources for this Dataset:

Dataset lineage
  • Focus shows the connections from the direct primary key, along with foreign keys to other Datasets.

Dataset focus

Configure Dataset properties

Click the Properties tab to review and configure the properties for your Dataset.

Property

Description

Labels

Review and change the name, description, and icon for this Dataset.

Access Control

Review and change the access control (sharing) settings configured for this Dataset when the Dataset was created.

Tags

Add correlation tags to your Dataset’s columns and object paths. See Correlation tags.

Indexes

View the indexes used for this Dataset. An index is a structure that makes Dataset queries fast and efficient.

Keys

View the primary key for this Dataset.

Links

View details about the upstream and downstream links for this Dataset.

Interfaces

Contains field mappings for this Dataset.

Create a Dataset from the Dataset page

In addition to creating a Dataset from a Worksheet, you can also create Datasets from the Dataset page.

  1. Click New dataset on the Dataset page to begin creating a new Dataset.

  2. Select a Dataset.

  3. Specify additional filters using the builder or OPAL console.

Create a Dataset from the Datasets page
  1. Click Publish dataset. In the series of subsequent modal windows:

  • Give the Dataset a name.

  • Configure the sharing settings for your Dataset.

  • Click Publish.

Create a reference table from the Dataset page

Click the down chevron icon in the Create dataset button, then select Upload CSV as a reference table.

Create a reference table from the Dataset page

Follow the instructions in Create reference tables using the UI to complete the dialog and create the reference table.