Snowflake Observability¶
The Observe 4 Snowflake (O4S) helps you natively integrate with Snowflake Trail to give instant observability into the Snowflake Data Cloud, query executions, Snowpark workloads, ML/AI models, and the underlying infrastructure, so SREs and Data Engineering teams can detect anomalies, uncover root causes, and resolve them faster than ever before – no matter where they occur across your Snowflake deployment.
This integration has two components:
Observe app, which contains dataset definitions and dashboards to help you search, monitor and visualize your Snowflake accounts.
Snowflake native app, which can be installed via the Snowflake Marketplace. Simply search for
Observe For Snowflake(listing id: OBSERVE_FOR_SNOWFLAKE_IJ1RPYQ) and follow the setup instructions at Native App Install Instructions
Observe App¶
The Snowflake app for Observe can be installed by navigating to the Applications area of your Observe tenant and searching for Snowflake in the Install new tab. The app bundles a number of datasets as well as dashboard to help you explore your Snowflake estate.
Datasets¶
Installing the Snowflake for Observe app provides the following Datasets to use with your data.
Resource Datasets¶
snowflake/Account - Snowflake account
snowflake/Database - Snowflake database (SNOWFLAKE.ACCOUNT_USAGE.DATABASES view)
snowflake/File Format - Snowflake file format (SNOWFLAKE.ACCOUNT_USAGE.FILE_FORMATS view)
snowflake/Function - Snowflake function (SNOWFLAKE.ACCOUNT_USAGE.FUNCTIONS view)
snowflake/Hybrid Table - Snowflake hybrid table (SNOWFLAKE.ACCOUNT_USAGE.HYBRID_TABLES view)
snowflake/Role - Snowflake role (SNOWFLAKE.ACCOUNT_USAGE.ROLES view)
snowflake/Schema - Snowflake schema (SNOWFLAKE.ACCOUNT_USAGE.SCHEMATA view)
snowflake/Secret - Snowflake secret (SNOWFLAKE.ACCOUNT_USAGE.SECRETS view)
snowflake/Network Policy - Snowflake network policy (SNOWFLAKE.ACCOUNT_USAGE.NETWORK_POLICIES view)
snowflake/Network Rule - Snowflake network rule (SNOWFLAKE.ACCOUNT_USAGE.NETWORK_RULES view)
snowflake/Pipe - Snowflake pipe (SNOWFLAKE.ACCOUNT_USAGE.PIPES view)
snowflake/Procedure - Snowflake procedure (SNOWFLAKE.ACCOUNT_USAGE.PROCEDURES view)
snowflake/User - Snowflake user (SNOWFLAKE.ACCOUNT_USAGE.USERS view)
snowflake/View - Snowflake view (SNOWFLAKE.ACCOUNT_USAGE.VIEWS view)
snowflake/Warehouse - Snowflake virtual warehouse (derived from SNOWFLAKE.ACCOUNT_USAGE.WAREHOUSE_EVENTS_HISTORY view and SNOWFLAKE.ACCOUNT_USAGE.QUERY_HISTORY view)
snowflake/Stage - Snowflake stage (SNOWFLAKE.ACCOUNT_USAGE.STAGES view)
snowflake/Table - Snowflake table (SNOWFLAKE.ACCOUNT_USAGE.TABLES view enriched with SNOWFLAKE.ACCOUNT_USAGE.TABLE_STORAGE_METRICS view)
snowflake/Service - Snowflake compute service (SNOWFLAKE.ACCOUNT_USAGE.SERVICES view)
snowflake/Session - Snowflake user session (SNOWFLAKE.ACCOUNT_USAGE.SESSION view enriched with SNOWFLAKE.ACCOUNT_USAGE.TABLE_STORAGE_METRICS view)
snowflake/Schema - Snowflake schema (SNOWFLAKE.ACCOUNT_USAGE.SCHEMATA view)
snowflake/Secret - Snowflake secret (SNOWFLAKE.ACCOUNT_USAGE.SECRETS view)
snowflake/Sequence - Snowflake sequence (SNOWFLAKE.ACCOUNT_USAGE.SEQUENCES view)
snowflake/Task - Snowflake task (SNOWFLAKE.ACCOUNT_USAGE.TASK_HISTORY view)
Events Datasets¶
snowflake/AUTOMATIC_CLUSTERING_HISTORY - Automatic clustering usage and billing history (SNOWFLAKE.ACCOUNT_USAGE.AUTOMATIC_CLUSTERING_HISTORY view)
snowflake/COMPLETE_TASK_GRAPHS - Completed task graph runs usage and history (SNOWFLAKE.ACCOUNT_USAGE.COMPLETE_TASK_GRAPHS view)
snowflake/COPY_HISTORY - Data loading history [COPY INTO and Snowpipe] (SNOWFLAKE.ACCOUNT_USAGE.COPY_HISTORY view)
snowflake/DATA_TRANSFER_HISTORY - Cloud to cloud data transfer usage history (SNOWFLAKE.ACCOUNT_USAGE.DATA_TRANSFER_HISTORY view)
snowflake/EVENT_USAGE_HISTORY - Event table usage and billing (SNOWFLAKE.ACCOUNT_USAGE.EVENT_USAGE_HISTORY view)
snowflake/LOAD_HISTORY - Data loading history [COPY INTO] (SNOWFLAKE.ACCOUNT_USAGE.LOAD_HISTORY view)
snowflake/LOCK_WAIT_HISTORY - Transaction lock wait history (SNOWFLAKE.ACCOUNT_USAGE.LOCK_WAIT_HISTORY view)
snowflake/LOGIN_HISTORY - User logins (SNOWFLAKE.ACCOUNT_USAGE.LOGIN_HISTORY view)
snowflake/METERING_HISTORY - Snowflake features usage and billing history (SNOWFLAKE.ACCOUNT_USAGE.METERING_HISTORY view)
snowflake/PIPE_USAGE_HISTORY - Data load usage and billing [Snowpipe] (SNOWFLAKE.ACCOUNT_USAGE.PIPE_USAGE_HISTORY view)
snowflake/QUERY_HISTORY - Snowflake queries (SNOWFLAKE.ACCOUNT_USAGE.QUERY_HISTORY view)
snowflake/SERVERLESS_TASK_HISTORY - Serverless tasks billing and usage history (SNOWFLAKE.ACCOUNT_USAGE.SERVERLESS_TASK_HISTORY view)
snowflake/SNOWPARK_CONTAINER_SERVICES_HISTORY - Snowpark Container Services usage and billing history (SNOWFLAKE.ACCOUNT_USAGE.SNOWPARK_CONTAINER_SERVICES_HISTORY view)
snowflake/SNOWPIPE_STREAMING_CLIENT_HISTORY - Snowpipe Streaming client usage history (SNOWFLAKE.ACCOUNT_USAGE.SNOWPIPE_STREAMING_CLIENT_HISTORY view)
snowflake/SNOWPIPE_STREAMING_FILE_MIGRATION_HISTORY - Snowpipe Streaming file to table migration history (SNOWFLAKE.ACCOUNT_USAGE.SNOWPIPE_STREAMING_FILE_MIGRATION_HISTORY view)
snowflake/TABLE_DML_HISTORY - Table data manipulation history and effects (SNOWFLAKE.ACCOUNT_USAGE.TABLE_DML_HISTORY view)
snowflake/TABLE_PRUNING_HISTORY - Table partition pruning history (SNOWFLAKE.ACCOUNT_USAGE.TABLE_PRUNING_HISTORY view)
snowflake/TABLE_STORAGE_METRICS - Snowflake table-level storage utilization information (SNOWFLAKE.ACCOUNT_USAGE.TABLE_STORAGE_METRICS view)
snowflake/TASK_HISTORY - Task runs usage and history (SNOWFLAKE.ACCOUNT_USAGE.TASK_HISTORY view)
snowflake/WAREHOUSE_EVENTS_HISTORY - Virtual warehouse lifecycle events (SNOWFLAKE.ACCOUNT_USAGE.WAREHOUSE_EVENTS_HISTORY view)
snowflake/HYBRID_TABLE_USAGE_HISTORY - Hybrid table usage history (SNOWFLAKE.ACCOUNT_USAGE.HYBRID_TABLE_USAGE_HISTORY view)
Metrics Datasets¶
snowflake/Query Metrics - Query metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.QUERY_HISTORY view)
snowflake/Table Storage Metrics - Table storage metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.TABLE_STORAGE_METRICS view)
snowflake/Automatic Clustering Metering Metrics - Automatic clustering metering metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.AUTOMATIC_CLUSTERING_HISTORY view)
snowflake/Compute Pool Metering Metrics - Snowpark Container Services metering metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.SNOWPARK_CONTAINER_SERVICES_HISTORY view)
snowflake/Data Transfer Metering Metrics - Data transfer metering metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.DATA_TRANSFER_HISTORY view)
snowflake/Event Table Metering Metrics - Event table metering metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.EVENT_USAGE_HISTORY view)
snowflake/Hybrid Tables Metering Metrics - Hybrid table metering metrics (derived from SNOWFLAKE.ACCOUNT_USAGE.HYBRID_TABLE_USAGE_HISTORY view)
Snowflake Event Table¶
Note
These datasets are primarily for use via the Observe Logs, Metrics and Trace Explorers. For more information on Snowflake’s Event Table see here
snowflake/Event Table Logs - Snowflake event table - logs
snowflake/Event Table Metrics - Snowflake event table - metrics
snowflake/Event Table Spans - Snowflake event table - spans
snowflake/Span Event - Snowflake event table - span events
Interval Datasets (Derived)¶
snowflake/Session Activity - Snowflake user session queries activity (based on SNOWFLAKE.ACCOUNT_USAGE.QUERY_HISTORY view)