sync_evals

Creates, updates, deletes, gets or lists a sync_evals resource.

Overview

Name	sync_evals
Type	Resource
Id	azure.ai_evaluation.sync_evals

Fields

The following fields are returned by SELECT queries:

SELECT not supported for this resource, use SHOW METHODS to view available operations for the resource.

Methods

The following methods are available for this resource:

Name	Accessible by	Required Params	Optional Params	Description
create	insert	endpoint, data_source, testing_criteria		Synchronize evaluation runs from connected resources.

Parameters

Parameters can be passed in the WHERE clause of a query. Check the Methods section to see which parameters are required or optional for each operation.

Name	Datatype	Description
endpoint	string	The service endpoint host (no scheme), e.g. myaccount.table.cosmos.azure.com:443 - value of the client endpoint parameter. (default: )

INSERT examples

create

Synchronize evaluation runs from connected resources.

INSERT INTO azure.ai_evaluation.sync_evals (
data_source,
testing_criteria,
properties,
customInference,
endpoint
)
SELECT 
'{{ data_source }}' /* required */,
'{{ testing_criteria }}' /* required */,
'{{ properties }}',
'{{ customInference }}',
'{{ endpoint }}'
RETURNING
id,
datasource_item_id,
eval_id,
run_id,
created_at,
datasource_item,
object,
results,
sample,
status
;

Manifest

# Description fields are for documentation purposes
- name: sync_evals
props:
  - name: endpoint
    value: "{{ endpoint }}"
    description: Required parameter for the sync_evals resource.
  - name: data_source
    description: |
      Identifier of the evaluator. Required.
    value:
      type: "{{ type }}"
      source:
        type: "{{ type }}"
        content:
          item:
            type: "{{ type }}"
          sample: "{{ sample }}"
  - name: testing_criteria
    description: |
      Evaluators to be used for the evaluation. Required.
    value:
      - type: "{{ type }}"
        name: "{{ name }}"
        evaluator_name: "{{ evaluator_name }}"
        evaluator_version: "{{ evaluator_version }}"
        initialization_parameters: "{{ initialization_parameters }}"
        data_mapping: "{{ data_mapping }}"
  - name: properties
    value: "{{ properties }}"
    description: |
      Evaluation's properties. Unlike tags, properties are add-only. Once added, a property cannot be removed.
  - name: customInference
    description: |
      Custom inference configuration.
    value:
      endpointUrl: "{{ endpointUrl }}"
      DeploymentId: "{{ DeploymentId }}"