Observe shapes and relates data, making it easy to ask any question about your application, infrastructure, service, or system. It all starts with your data. In Observe, any event data that provides insight into the state of a system, is called an Observation. We will ingest a trace, log, metric, or pretty much anything else with a timestamp. Our data collectors are very permissive and support all of the popular open source collectors.
To make this data easier to work with, we transform it into datasets. Datasets are structured representations of your data and can be linked to each other. We provide datasets out the box for popular technologies, e.g. Kubernetes, AWS etc. If we don’t have your use case covered don’t sweat it. In Observe you can build these yourself with about the same amount of work it would take to create a dashboard.
There are two different interfaces for working with data in Observe: worksheets and landing pages:
Landing pages are automatically generated dashboards. They use the structure of datasets to generate visualizations, context, and navigation. When you click on a dataset card in Observe this is the default view.
Worksheets are like an infinite spreadsheet for your data. They support direct manipulation of data that include: correlation, field extraction, aggregation, visualization, and dataset creation. Each worksheet contains one or more stages, which are tables that can be dependent on the results of another stage. Linked stages are very useful for capturing all of the steps of an investigation so that it can be reused or shared with others. If you need to extend Observe we have you covered. Everything you do in a worksheet generates OPAL (Observe Processing Analytics Language), so power users can hammer away. Anyone can create a new dataset from a worksheet selecting the publish option in the UI.