Create and share Datasets¶
Create and share Datasets from the Dataset page, or from any Worksheet.
Create and publish a Dataset from a Worksheet¶
From a Worksheet, you can create a query and publish a new Dataset:
Access a Worksheet in Observe. You can do this by selecting Worksheets in the left navigation and then selecting or creating a Worksheet, or by selecting Open in Worksheet from a variety of places in Observe.
In the list of queries, click the More icon (…), and select Create new dataset.
The Dataset editor allows you to customize the Dataset before you publish it.
The High Performance label means that the Observe platform is checking your OPAL for errors and warning related to Dataset acceleration, and whether or not a pipeline can be accelerated as well as the complexity of its acceleration. Dataset acceleration is required for a Dataset to be created.
Click Publish dataset when you are ready to publish your Dataset. In the series of subsequent modal windows:
Give the Dataset a name.
Configure the sharing settings for your Dataset.
Click Publish.
Manage your Dataset¶
Once you create and save a Dataset, you can view additional information about your Dataset and also configure additional properties.
Get an overview of your Dataset¶
Click the Overview tab to view general information about your Dataset, such as the data type, data source, status, freshness goals, and acceleration details.
View your Dataset’s definition¶
Click the Definition tab to view or edit the OPAL query.
View your Dataset’s lineage¶
Click Lineage to view information about how this Dataset is connected to and derived from other Datasets.
Links show the Datasets connected to this Dataset by foreign and primary key:
Lineage shows the upstream and downstream data sources for this Dataset:
Focus shows the connections from the direct primary key, along with foreign keys to other Datasets.
Configure Dataset properties¶
Click the Properties tab to review and configure the properties for your Dataset.
Property |
Description |
|---|---|
Labels |
Review and change the name, description, and icon for this Dataset. |
Access Control |
Review and change the access control (sharing) settings configured for this Dataset when the Dataset was created. |
Tags |
Add correlation tags to your Dataset’s columns and object paths. See Correlation tags. |
Indexes |
View the indexes used for this Dataset. An index is a structure that makes Dataset queries fast and efficient. |
Keys |
View the primary key for this Dataset. |
Links |
View details about the upstream and downstream links for this Dataset. |
Interfaces |
Contains field mappings for this Dataset. |
Create a Dataset from the Dataset page¶
In addition to creating a Dataset from a Worksheet, you can also create Datasets from the Dataset page.
Click New dataset on the Dataset page to begin creating a new Dataset.
Select a Dataset.
Specify additional filters using the builder or OPAL console.
Click Publish dataset. In the series of subsequent modal windows:
Give the Dataset a name.
Configure the sharing settings for your Dataset.
Click Publish.
Create a reference table from the Dataset page¶
Click the down chevron icon in the Create dataset button, then select Upload CSV as a reference table.
Follow the instructions in Create reference tables using the UI to complete the dialog and create the reference table.