Azure Cognitive Services

Azure Cognitive Services are cloud-based artificial intelligence (AI) services that help developers build cognitive intelligence into applications without having direct AI or data science skills or knowledge. These services include the Azure OpenAI Service, which provides REST API access to OpenAI powerful language models including the GPT-3, Codex and Embeddings model series.

Installed Datasets

  • Azure/Cognitive Service

  • Azure/Cognitive Services Metrics

Viewing Cognitive Services in Observe

Out of the box, Observe provides a Monitoring Dashboard:

Azure OpenAI Monitoring

The Azure OpenAI Monitoring dashboard summarizes the usage and performance of your Azure-hosted OpenAI API endpoints. From here you can answer questions such as:

  • How many requests do my endpoints receive?

  • What kinds of errors are returned?

  • How long does it take for my users to get their answers?

  • How many prompt and response tokens are used per question?

Monitoring dashboard for Azure OpenAI

Figure 1 - The Monitoring dashboard for Azure OpenAI

Installing the Azure Cognitive Services App

To install the Azure Cognitive Services app, see Microsoft Azure Setup.

Azure OpenAI Metrics

To learn more about Azure OpenAI Metrics, see the Monitoring Azure OpenAI Service documentation.