Snowflake Data in Observe

Snowflake Data in Observe - Datasets

Observe creates a connected graph of the Snowflake management views and observability data in Event Table data in the following datasets:

Event Datasets

Event datasets:

Name

Purpose

Links to

Origin

COPY_HISTORY

Data loading history [COPY INTO and Snowpipe]

Account, Database, Schema, Table

❄️docs

DATABASE_STORAGE_USAGE_ HISTORY

Storage usage summary (daily)

Account, Database

❄️docs

LISTING_AUTO_FULFILLMENT_ USAGE_HISTORY

Cross-cloud auto-fulfillment costs

Account, Organizational Account

❄️docs

LISTING_CONSUMPTION_DAILY

Snowflake native app or share consumption

Account, Marketplace Application

❄️docs

LISTING_EVENTS_DAILY

Activity of the marketplace listings

Account, Marketplace Application

❄️docs

LISTING_TELEMETRY_DAILY

Telemetry of the marketplace listings

Account

❄️docs

LOAD_HISTORY

Data loading history [COPY INTO]

Account, Database, Schema, Table

❄️docs

LOCK_WAIT_HISTORY

Transaction lock wait history

Account, Database, Schema, Table, Query

❄️docs

LOGIN_HISTORY

User logins

Account, User

❄️docs

MARKETPLACE_DISBURSEMENT_ REPORT

History of earnings from paid listings in the Snowflake Marketplace

Account, Marketplace Application

❄️docs

MARKETPLACE_LISTING_ INVOICE_STATUS

History of invoices related to paid listings in the Snowflake Marketplace

Account, Marketplace Application

❄️docs

METERING_DAILY_HISTORY

Snowflake features usage and billing history daily

Account

❄️docs

MONETIZED_USAGE_DAILY

History of daily consumer queries per listing, including charges accumulated for the usage

Account, Marketplace Application

❄️docs

SNOWPIPE_STREAMING_ CLIENT_HISTORY

Snowpipe Streaming client usage history

Account

❄️docs

STAGE_STORAGE_USAGE_ HISTORY

Stage storage usage summary (daily)

Account

❄️docs

STORAGE_USAGE

Storage usage summary (daily)

Account

❄️docs

TABLE_STORAGE_METRICS

Snowflake table-level storage utilization information

Account, Database, Schema, Table

❄️docs

WAREHOUSE_EVENTS_HISTORY

Virtual warehouse lifecycle events

Account, Role, User, Warehouse, Query

❄️docs

Interval Datasets

Interval datasets:

Name

Purpose

Links to

Origin

AUTOMATIC_CLUSTERING_HISTORY

Automatic clustering usage and billing history

Account, Database, Schema, Table

❄️docs

COMPLETE_TASK_GRAPHS

Completed task graph runs usage and history

Account, Database, Schema, Task

❄️docs

DATA_TRANSFER_HISTORY

Cloud to cloud data transfer usage history

Account

❄️docs

DATABASE_REPLICATION_USAGE_HISTORY

Database replication history

Account, Database

❄️docs

DOCUMENT_AI_USAGE_HISTORY

Document AI service usage history

Account, Query

❄️docs

DYNAMIC_TABLE_REFRESH_HISTORY

Dynamic table refresh history

Account, Database, Schema, Table, Query

❄️docs

EVENT_USAGE_HISTORY

Event table usage and billing

Account

❄️docs

HYBRID_TABLE_USAGE_HISTORY

Hybrid table usage history

Account, Hybrid Table

❄️docs

INTERNAL_DATA_TRANSFER_HISTORY

Snowpark Container Services internal data transfers usage history

Account

❄️docs

MATERIALIZED_VIEW_REFRESH_HISTORY

Materialized views refresh billing history

Account, Database, Schema, Table

❄️docs

METERING_HISTORY

Snowflake features usage and billing history

Account

❄️docs

PIPE_USAGE_HISTORY

Data load usage and billing [Snowpipe]

Account, Pipe

❄️docs

QUERY_HISTORY

Snowflake queries

Account, Database, Schema, Table, Role, User, Session, Session Activity

❄️docs

REPLICATION_GROUP_REFRESH_HISTORY

Refresh history for a replication or failover group

Account, Query

❄️docs

REPLICATION_GROUP_USAGE_HISTORY

Refresh usage and costs for a replication or failover group

Account

❄️docs

SEARCH_OPTIMIZATION_BENEFITS

Search optimization service benefits

Account, Table

❄️docs

SEARCH_OPTIMIZATION_HISTORY

Search optimization service usage history

Account, Table

❄️docs

SERVERLESS_TASK_HISTORY

Serverless tasks billing and usage history

Account, Database, Schema

❄️docs

Session

Snowflake user session

Account, User

❄️SESSIONS, ❄️QUERY_HISTORY

SNOWPARK_CONTAINER_SERVICES_HISTORY

Snowpark Container Services usage and billing history

Account

❄️docs

SNOWPIPE_STREAMING_FILE_MIGRATION_HISTORY

Snowpipe Streaming file to table migration history

Account, Database, Schema, Table

❄️docs

TABLE_DML_HISTORY

Table data manipulation history and effects

Account, Database, Schema, Table

❄️docs

TABLE_PRUNING_HISTORY

Table partition pruning history

Account, Database, Schema, Table

❄️docs

TASK_HISTORY

Task runs usage and history

Account, Database, Schema, Task, Query

❄️docs

WAREHOUSE_LOAD_HISTORY

Virtual warehouse workload history

Account, Warehouse

❄️docs

WAREHOUSE_METERING_HISTORY

Virtual warehouse usage and billing history

Account, Warehouse

❄️docs

Resource Datasets

Resource datasets:

Name

Purpose

Links to

Origin

Account

Snowflake account

❄️QUERY_HISTORY

Database

Snowflake database

Account, Role (owner)

❄️DATABASES

File Format

Snowflake file format

Account, Database, Schema, Role (owner)

❄️FILE_FORMATS

Function

Snowflake function

Account, Database, Schema, Role (owner)

❄️FUNCTIONS

Grant to Role

Privileges that have been granted to a role

Account, Role (Grantee), Role (Granted By)

❄️GRANTS_TO_ROLES

Grant to User

Roles that have been granted to a user

Account, Role (Granted), Role (Granted By), User

❄️GRANTS_TO_USERS

Hybrid Table

Snowflake hybrid table

Account, Database, Schema, Role (owner)

❄️HYBRID_TABLES

Marketplace Application

Snowflake Apps installed from listings in marketplace

Account

❄️APPLICATION_STATE

Network Policy

Snowflake network policy

Account, Role (owner)

❄️docs

Network Rule

Snowflake network rule

Account, Database, Schema, Role (owner)

❄️NETWORK_RULES

Organization Rate Sheet

Snowflake Organization rate sheet

Account

❄️APPLICATION_STATE

Organizational Account

Snowflake organization account

Account

❄️ACCOUNTS

Password Policy

Snowflake password policy

Account, Database, Schema, Role (owner)

❄️PASSWORD_POLICIES

Pipe

Snowflake pipe

Account, Database, Schema, Role (owner)

❄️PIPES

Procedure

Snowflake procedure

Account, Database, Schema, Role (owner)

❄️PROCEDURES

Role

Snowflake role

Account

❄️ROLES

Schema

Snowflake schema

Account, Database, Role (owner)

❄️SCHEMATA

Secret

Snowflake secret

Account, Database, Schema, Role (owner)

❄️SECRETS

Sequence

Snowflake sequence

Account, Database, Schema, Role (owner)

❄️SEQUENCES

Service

Snowflake compute service

Account, Database, Schema, Role (owner)

❄️SERVICES

Stage

Snowflake stage

Account, Database, Schema, Role (owner)

❄️STAGES

Table

Snowflake table

Account, Database, Schema, Role (owner), User

❄️TABLES, ❄️TABLE_STORAGE_METRICS

Task

Snowflake task

Account, Database, Schema

❄️TASK_HISTORY

User

Snowflake user

Account, Role (default), Role (secondary), Role (owner)

❄️USERS

View

Snowflake view

Account, Database, Schema, Role (owner), User

❄️VIEWS

Warehouse

Snowflake virtual warehouse

Account

❄️WAREHOUSE_EVENTS_HISTORY, ❄️QUERY_HISTORY

Metrics and Sessions

Metrics and sessions datasets derived:

Name

Purpose

Links to

Origin

Automatic Clustering Metering Metrics

Automatic clustering metering metrics

Account, Database, Schema, Table

AUTOMATIC_CLUSTERING_HISTORY

Compute Pool Metering Metrics

Snowpark Container Services metering metrics

Account

SNOWPARK_CONTAINER_SERVICES_HISTORY

Data Transfer Metering Metrics

Data transfer metering metrics

Account

DATA_TRANSFER_HISTORY

Event Table Metering Metrics

Event table metering metrics

Account

EVENT_USAGE_HISTORY

Hybrid Tables Metering Metrics

Hybrid table metering metrics

Account, Hybrid Table

HYBRID_TABLE_USAGE_HISTORY

Query Metrics

Query metrics

Account, Database, Schema, Table, Role, User, Session, Session Activity

QUERY_HISTORY

Serverless Task Metering Metrics

Serverless task metering metrics

Account, Database, Schema

SERVERLESS_TASK_HISTORY

Service Metering Metrics

All Snowflake services metering metrics

Account, Table, Pipe, Warehouse

METERING_HISTORY

Snowpipe Metering Metrics

Snowpipe streaming metering metrics

Account, Pipe

PIPE_USAGE_HISTORY

Table Storage Metrics

Snowflake table-level storage utilization information as metrics

Account, Database, Schema, Table

TABLE_STORAGE_METRICS

Warehouse Metering Metrics

Virtual warehouse metering metrics

Account, Warehouse

WAREHOUSE_METERING_HISTORY

Session Activity

Snowflake user session queries activity

Account, User

QUERY_HISTORY

Snowflake Event Table Datasets

Event table related datasets contain data from Snowflake Event Table:

Name

Purpose

Links to

Origin

Event Table Event

Snowflake event table - events

Account, Database, Schema

RECORD_TYPE=EVENT

Event Table Logs

Snowflake event table - logs

Account, Database, Schema, Warehouse, Role, User, Query

RECORD_TYPE=LOG

Event Table Metrics

Snowflake event table - metrics

Account, Database, Schema

RECORD_TYPE=METRICS

Event Table OTEL Metrics

Snowflake event table - metrics (via OTEL endpoint)

Account

RECORD_TYPE=METRICS

Event Table Spans

Snowflake event table - spans

Account, Database, Schema, Warehouse, Role, User, Query

RECORD_TYPE=SPAN

Span Event

Snowflake event table - span events

Account, Database, Schema, Warehouse, Role, User, Query, Event Table, Span

RECORD_TYPE=SPAN_EVENT

Dashboards

Observe provides following dashboards for display of Snowflake data

Name

Purpose

Uses

Account

Summary of objects in account and some core metrics

Account, Object views, QUERY_HISTORY

Data Export Activity

Create external integration, create stage and COPY commands

QUERY_HISTORY

Database

Summary of objects in database and some core metrics, including queries

Account, Object views, Metric datasets, QUERY_HISTORY

Login Activity

View into all the user logins

LOGIN_HISTORY

Pipe

Consumption and usage for pipes

Object views, Metric datasets

Query History

Overview of query activity

QUERY_HISTORY

Query History Metrics

Overview of query activity via precomputed metrics

Query Metrics

Schema

Summary of objects in schema and some core metrics, including queries

Account, Object views, Metric datasets, QUERY_HISTORY

Service Metering

Usage of all compute features

SERVICE_METERING

Session Activity

Overview of session activity

Session

Table

Summary of objects in schema and some core metrics, including queries

Account, Object views, Metric datasets, QUERY_HISTORY

Warehouse

Warehouse usage and activity

Warehouse, WAREHOUSE_METERING_HISTORY