elastic/integrationsPublic

NotificationsYou must be signed in to change notification settings
Fork545
Star318

Comments

[Microsoft Foundry] Add Agent Metrics datastream#17422

Open

muthu-mps wants to merge 9 commits intoelastic:mainfrom

muthu-mps:add_agent_metrics

Open

[Microsoft Foundry] Add Agent Metrics datastream#17422
muthu-mps wants to merge 9 commits intoelastic:mainfrom
muthu-mps:add_agent_metrics

Conversation

Copy link

Contributor

muthu-mps commentedFeb 16, 2026•
edited
Loading

Enhancement

Proposed commit message

This PR adds support for Microsoft Foundry Agent metrics. The metrics is in preview state and its subject to change. Please see here for more details on theAI Agent metrics.

The AI Agent metrics is available underMicrosoft.CognitiveServices/accounts/projects resource type.

The alerting rule and the dashboard will be created once the metrics is Generally Available in Azure.

Checklist

I have reviewedtips for building integrations and this pull request is aligned with them.
I have verified that all data streams collect metrics or logs.
I have added an entry to my package'schangelog.yml file.
I have verified that Kibana version constraints are current according toguidelines.
I have verified that any added dashboard complies with Kibana'sDashboard good practices

Author's Checklist

How to test this PR locally

Related issues

Screenshots

add agent metrics datastream

1907cc8

Copy link

Contributor

github-actionsbot commentedFeb 16, 2026•
edited
Loading

✅ Vale Linting Results

No issues found on modified lines!

The Vale linter checks documentation changes against theElastic Docs style guide.

To use Vale locally or report issues, refer toElastic style guide for Vale.

Merge branch 'main' into add_agent_metrics

d45e83f

andrewkroh added documentation

Improvements or additions to documentation. Applied to PRs that modify *.md files.

Integration:azure_ai_foundryMicrosoft Foundry labels

Feb 16, 2026

muthu-mps marked this pull request as ready for review

February 17, 2026 04:40

muthu-mps requested a review froma team as acode owner

February 17, 2026 04:40

Merge branch 'main' into add_agent_metrics

55f4a14

muthu-mps changed the title~~Add Agent Metrics datastream~~[Microsoft Foundry] Add Agent Metrics datastream

Feb 17, 2026

muthu-mps added2 commits

February 17, 2026 10:38

update change log and make agent metrics disabled

f80ecd9

Merge branch 'add_agent_metrics' ofhttps://github.com/muthu-mps/inte…

a202ca5

…grations into add_agent_metrics

muthu-mps self-assigned this

Feb 17, 2026

Copy link

elastic-vault-github-plugin-prodbot commentedFeb 17, 2026

🚀 Benchmarks report

To see the full report comment with/test benchmark fullreport

muthu-mps requested a review fromCopilot

February 17, 2026 05:45

Copilotstarted reviewing on behalf ofmuthu-mps

February 17, 2026 05:46

View session

CopilotAI reviewed

Feb 17, 2026

View reviewed changes

Copy link

CopilotAI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Pull request overview

Adds a newagent_metrics metrics data stream to theazure_ai_foundry (Microsoft Foundry) integration to collect preview “AI Agents” metrics from Azure Monitor under theMicrosoft.CognitiveServices/accounts/projects resource type.

Changes:

Bumps package version to0.9.0 and adds changelog entry.
Addsagent_metrics data stream with fields, sample event, stream template, and ingest pipeline.
Updates user docs (source + built docs) with an Agent metrics section and exported fields reference.

Reviewed changes

Copilot reviewed 12 out of 12 changed files in this pull request and generated 7 comments.

Show a summary per file

File	Description
packages/azure_ai_foundry/manifest.yml	Version bump + adds`agent_metrics` to policy template and moves azure/metrics vars to input-level.
packages/azure_ai_foundry/data_stream/metrics/manifest.yml	Simplifies metrics stream vars (leaves only processors) and adds title/description.
packages/azure_ai_foundry/data_stream/agent_metrics/manifest.yml	New agent metrics data stream definition.
packages/azure_ai_foundry/data_stream/agent_metrics/agent/stream/stream.yml.hbs	New Azure Monitor metrics query template for agent metrics.
packages/azure_ai_foundry/data_stream/agent_metrics/elasticsearch/ingest_pipeline/default.yml	New ingest pipeline to normalize agent metric field names.
packages/azure_ai_foundry/data_stream/agent_metrics/fields/*	New field definitions for agent metrics (ECS/base + package + agent metrics fields).
packages/azure_ai_foundry/data_stream/agent_metrics/sample_event.json	Example event for the agent metrics data stream.
packages/azure_ai_foundry/docs/README.md	Adds Agent metrics documentation and a full example event + exported fields table.
packages/azure_ai_foundry/_dev/build/docs/README.md	Regenerated built docs to include agent metrics event/fields.
packages/azure_ai_foundry/changelog.yml	Adds`0.9.0` enhancement entry.

💡Add Copilot custom instructions for smarter, more guided reviews.Learn how to get started.

packages/azure_ai_foundry/changelog.ymlShow resolvedHide resolved

packages/azure_ai_foundry/docs/README.md


		The Microsoft Foundry agent metrics provide visibility into agent activity and usage, such as token consumption, runs, and tool calls.

		An example event for `agent` looks as following:

Copy link

CopilotAIFeb 17, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Minor grammar in the new agent metrics section: "looks as following" should be "looks as follows", and it would be clearer to reference the data stream name (e.g.agent_metrics /azure.ai_foundry.agent) rather than justagent.

Suggested change

	An example event for`agent` looks asfollowing:
	An example event forthe`agent_metrics` data stream (dataset`azure.ai_foundry.agent`) looks asfollows:

Copilot uses AI. Check for mistakes.

packages/azure_ai_foundry/data_stream/agent_metrics/agent/stream/stream.yml.hbsShow resolvedHide resolved

packages/azure_ai_foundry/data_stream/agent_metrics/agent/stream/stream.yml.hbs

Comment on lines +25 to +31

		resource_type: "Microsoft.CognitiveServices/accounts/projects"
		metrics:
		- name:
		- AgentEvents
		namespace: "Microsoft.CognitiveServices/accounts"
		timegrain: "PT1M"
		ignore_unsupported: true

Copy link

CopilotAIFeb 17, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

In the resource_groups branch, the metrics blocks usenamespace: "Microsoft.CognitiveServices/accounts" while the resource type isMicrosoft.CognitiveServices/accounts/projects (and the default resource_query branch uses/accounts/projects). This mismatch will query the wrong Azure Monitor namespace for project-scoped agent metrics; update these namespaces toMicrosoft.CognitiveServices/accounts/projects for consistency.

Copilot uses AI. Check for mistakes.

packages/azure_ai_foundry/data_stream/agent_metrics/agent/stream/stream.yml.hbsShow resolvedHide resolved

packages/azure_ai_foundry/data_stream/agent_metrics/elasticsearch/ingest_pipeline/default.ymlShow resolvedHide resolved

packages/azure_ai_foundry/data_stream/metrics/manifest.ymlShow resolvedHide resolved

muthu-mpsand others added4 commits

February 17, 2026 12:41

add upgrade note

6c25c1e

Merge branch 'main' into add_agent_metrics

705bbf3

mask subscription ids

57347d3

Merge branch 'add_agent_metrics' ofhttps://github.com/muthu-mps/inte…

a198af1

…grations into add_agent_metrics

Copy link

elasticmachine commentedFeb 17, 2026

💚 Build Succeeded

Buildkite Build
Commit:a198af1

History

💚Build #38320 succeededa202ca5
💚Build #38268 succeededd45e83f

cc@muthu-mps

andrewkroh added the Team:Obs-InfraObsObservability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] label

Feb 17, 2026

stefans-elastic approved these changes

Feb 18, 2026

View reviewed changes

jakubgalecki0 approved these changes

Feb 18, 2026

View reviewed changes

gpop63 reviewed

Feb 18, 2026

View reviewed changes

packages/azure_ai_foundry/data_stream/agent_metrics/elasticsearch/ingest_pipeline/default.yml

Comment on lines +29 to +31

		- set:
		field: error.message
		value: '{{ _ingest.on_failure_message }}'

Copy link

Contributor

gpop63Feb 18, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others.Learn more.

Suggested change

	-set:
	field:error.message
	value:'{{_ingest.on_failure_message}}'
	-set:
	field:error.message
	value:'Processor {{{_ingest.on_failure_processor_type}}} with tag {{{_ingest.on_failure_processor_tag}}} in pipeline {{{_ingest.pipeline}}} failed with message: {{{_ingest.on_failure_message}}}'