AWS::BedrockAgentCore::Evaluator

BedrockAgentCore Evaluator

Resource Type definition for AWS::BedrockAgentCore::Evaluator - Creates a custom evaluator for agent quality assessment using LLM-as-a-Judge, code-based, or derived evaluator configurations. Derived evaluators run an existing built-in or third-party evaluator's logic on a model that you supply.

Properties

6 configurable properties. 3 required. Click a row to see details.

Filter:

Property	Type	Flags
`EvaluatorConfig`	`EvaluatorConfig`	Required
`EvaluatorName`	`string`	RequiredCreate-only
`Level`	`string`	Required
`Description`	`string`
`KmsKeyArn`	`string`
`Tags`	`Array<Tag>`

Return Values

Values returned after the resource is created. Access these with Fn::GetAtt.

Attribute	Type	Description
`CreatedAt`	`string`	The timestamp when the evaluator was created.
`EvaluatorArn`	`string`	The Amazon Resource Name (ARN) of the evaluator.
`EvaluatorId`	`string`	The unique identifier of the evaluator.
`EvaluatorType`	`string`	The kind of evaluator resource. Builtin and ThirdParty are AWS-managed global evaluators that you reference but don't create; Custom, CustomCode, and CustomDerived are evaluators that you create.
`Provider`	`string`	Where the evaluator's logic comes from: AWS, a third-party library (DeepEval or AutoEval), or you. Derived evaluators inherit the provider of their base evaluator.
`Status`	`string`	The current status of the evaluator.
`UpdatedAt`	`string`	The timestamp when the evaluator was last updated.

Sample CloudFormation Template

A minimal template with required properties and common optional ones.

template.yaml

AWSTemplateFormatVersion: "2010-09-09"
Description: Sample template for AWS::BedrockAgentCore::Evaluator

Resources:
  MyResource:
    Type: AWS::BedrockAgentCore::Evaluator
    Properties:
      EvaluatorName: "my-evaluatorname"
      EvaluatorConfig: "value"
      Level: "value"
      Tags:
        - Key: Environment
          Value: Production
      Description: !Ref "AWS::StackName"

Required IAM Permissions

Permissions CloudFormation needs in your IAM role to manage this resource.

create

bedrock-agentcore:CreateEvaluatorbedrock-agentcore:GetEvaluatorbedrock-agentcore:TagResourcebedrock:InvokeModelbedrock-mantle:CreateInferencebedrock-mantle:CallWithBearerTokenlambda:GetFunctionlambda:InvokeFunctionkms:DescribeKeykms:GenerateDataKeykms:Decrypt

read

bedrock-agentcore:GetEvaluatorbedrock-agentcore:ListTagsForResourcekms:Decrypt

update

bedrock-agentcore:UpdateEvaluatorbedrock-agentcore:GetEvaluatorbedrock-agentcore:TagResourcebedrock-agentcore:UntagResourcebedrock-agentcore:ListTagsForResourcebedrock:InvokeModelbedrock-mantle:CreateInferencebedrock-mantle:CallWithBearerTokenlambda:GetFunctionlambda:InvokeFunctionkms:DescribeKeykms:GenerateDataKeykms:Decrypt

delete

bedrock-agentcore:DeleteEvaluatorbedrock-agentcore:GetEvaluator

list

bedrock-agentcore:ListEvaluators

Learn AWS the Practical Way

Our bi-weekly newsletter teaches hands-on AWS fundamentals. No certification fluff - just practical knowledge.

Subscribe to Newsletter

Quick Facts

ServiceBedrockAgentCore

Properties13

Required3

TaggingSupported

Primary IDEvaluatorArn

Supported Operations

CreateReadUpdateDeleteList

Immutable After Creation

These properties cannot be changed after the resource is created. Updating them triggers a replacement.

EvaluatorNameEvaluatorConfig/Derived/BaseEvaluatorId

Related Resources

External Links

AWS Documentation