Skip to docs navigation

Braintrust integration guide

Verified

How to connect Braintrust to WEXTL and use its 5 triggers and 144 actions in your workflows. About Braintrust: AI observability and evaluation platform for logging, experiments and prompts.

  • 5 triggers
  • 58 searches
  • 86 actions
  • Instant (webhooks)
  • Auth: API key

AI-assisted documentation40 min read

This documentation is compiled from our integration source code, internal specs for Braintrust, its official API documentation and anonymized requests logs we collect from our support team[2].

Open Braintrust on WEXTL →
  • Braintrust
  • WEXTL
  • BigML
  • ChatBotKit
  • Bolna
  • Cartesia
  • ElevenLabs
  • DocsBot
  • Deepgram
  • Docparser
  • CALL-E
  • Alibaba Cloud (Qwen)
  • Dappier
  • Anthropic's Claude
  • CustomGPT
  • AWS Comprehend
  • Dust
  • DeepL
  • Cody AI
  • AgentX
  • Airtop
  • Amberscript
  • AWS Transcribe
  • AWS Rekognition
  • Botsonic
  • Apiframe
  • Camb AI
  • AWS Textract
  • AltText AI
  • Bigjpg
  • DeepSeek
  • API KeypasswordRequired

    In Braintrust open Settings, then API keys, create a key and paste it here. Every request with this key can reach what its owner can reach.[1]

  • RegionselectRequired

    Pick the region of your organization. Self-hosted data planes are not supported.[1]

  1. Log in to your WEXTL account, add the Braintrust node module to your workflow, and click Create new credential.Instant triggers use webhooks. Click Create a webhook first when adding one, then create the credential.
  2. Optional: In the Credential name field, enter a name for the credential.
  3. Enter the authentication credentials you copied from your Braintrust account, or follow the on-screen instructions to create the credential.
  4. If prompted, authenticate your account and confirm access.
  5. If you want to make changes to your credential in the future, follow the steps in Manage credentials →

Watch Alerts

TriggerInstant trigger on Braintrust alert webhooks.
Output fields[3]
FieldType
Organizationobject
IDtext
Nametext
Projectobject
IDtext
Nametext
Automationobject
IDtext
Nametext
Descriptiontext
Event Typetext
Filtertext
Interval Secondsnumber
URLtext
Detailsobject
Is Testboolean
Messagetext
Time Starttext
Time Endtext
Countnumber
Related Logs URLtext
Environmenttext
Object Typetext
New Versiontext
Actiontext

Watch New Datasets

TriggerScheduled check for new datasets.
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

Watch New Experiments

TriggerFires once for each new evaluation run.
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

Watch New Projects

TriggerNewly created projects as they appear.
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

Watch New Prompts

TriggerFresh prompts picked up by polling.
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

Fetch Dataset Records

SearchPages of dataset rows.
Input fields[3]
FieldType
DatasetRequired
choice
Page Sizenumber
Cursortext
Max Xacttext
Max Root Spantext
Versiontext
Output fields[3]
FieldType
IDtext
Xact IDtext
Createddate
Pagination Keytext
Project IDtext
Dataset IDtext
Inputtext
Expectedtext

11other output fields

Fetch Experiment Events

SearchEvents recorded by one evaluation run.
Input fields[3]
FieldType
ExperimentRequired
choice
Page Sizenumber
Cursortext
Max Xacttext
Max Root Spantext
Versiontext
Output fields[3]
FieldType
IDtext
Xact IDtext
Createddate
Pagination Keytext
Project IDtext
Experiment IDtext
Inputtext
Outputtext

18other output fields

Fetch Log Events

SearchTrace events stored in project logs.
Input fields[3]
FieldType
ProjectRequired
choice
Page Sizenumber
Cursortext
Max Xacttext
Max Root Spantext
Versiontext
Output fields[3]
FieldType
IDtext
Xact IDtext
Pagination Keytext
Createddate
Organization IDtext
Project IDtext
Log IDtext
Inputtext

20other output fields

Get a Dataset

SearchDescription and owning project of a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

Get a Dataset Snapshot

SearchSource dataset and version of a snapshot.
Input fields[3]
FieldType
Dataset SnapshotRequired
choice
Output fields[3]
FieldType
IDtext
Dataset IDtext
Nametext
Descriptiontext
Xact IDtext
Createddate

Get a Dataset Summary

SearchDataset overview with page links.
Input fields[3]
FieldType
DatasetRequired
choice
Summarize Databoolean
Output fields[3]
FieldType
Project Nametext
Dataset Nametext
Project URLtext
Dataset URLtext
Data Summarytext

Get a Function

SearchFunction definition at a chosen version.
Input fields[3]
FieldType
FunctionRequired
choice
Versiontext
Environmenttext
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

8other output fields

Get a Group

SearchPermission group and its parent organization.
Input fields[3]
FieldType
GroupRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Usersarray

1other output field

Get a Project

SearchProject record with its parent organization.
Input fields[3]
FieldType
ProjectRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

Get a Project Automation

SearchSettings of a project alert.
Input fields[3]
FieldType
Project AutomationRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Configtext
Runtime Blocktext

Get a Project Group

SearchCreator of a project grouping.
Input fields[3]
FieldType
Project GroupRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Projectsarray

Get a Project Score

SearchDefinition of one grading rule.
Input fields[3]
FieldType
Project ScoreRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Score Typetext
Categoriestext

2other output fields

Get a Project Tag

SearchColor and purpose of a tag.
Input fields[3]
FieldType
Project TagRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Colortext
Positiontext

Get a Prompt

SearchPrompt content at a chosen version.
Input fields[3]
FieldType
PromptRequired
choice
Versiontext
Environmenttext
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

Get a Role

SearchPermissions held by a role.
Input fields[3]
FieldType
RoleRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Permissionstext

1other output field

Get a Service Token

SearchWhich service account owns a token.
Input fields[3]
FieldType
Service TokenRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
Service Account IDtext
Service Account Emailtext
Service Account Nametext
Organization IDtext

1other output field

Get a Span Iframe

SearchPage and messaging setting of a span iframe.
Input fields[3]
FieldType
Span IframeRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

1other output field

Get a User

SearchProfile data for a person.
Input fields[3]
FieldType
UserRequired
choice
Output fields[3]
FieldType
IDtext
Given Nametext
Family Nametext
Emailtext
Avatar URLtext
Createddate

Get a View

SearchStored view with its type.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
ViewRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
View Typetext
Nametext
Descriptiontext
Starredboolean
Createddate

5other output fields

Get an ACL

SearchTarget and scope of one rule.
Input fields[3]
FieldType
ACLRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
User IDtext
Group IDtext
Permissiontext
Restrict Object Typetext
Role IDtext

2other output fields

Get an AI Secret

SearchTimestamps of a saved provider key.
Input fields[3]
FieldType
AI SecretRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Updated Atdate
Secret Updated Atdate
Organization IDtext
Nametext
Typetext
Metadatatext

2other output fields

Get an API Key

SearchOwner and name of an API key.
Input fields[3]
FieldType
API KeyRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
User IDtext
User Emailtext
User Given Nametext
User Family Nametext

2other output fields

Get an Env Var

SearchVariable name and owning object.
Input fields[3]
FieldType
Env VarRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Nametext
Createddate
Secret Updated Atdate
Secret Updated By User IDtext
Useddate

4other output fields

Get an Environment

SearchSlug and details of an environment.
Input fields[3]
FieldType
EnvironmentRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext
Createddate
Deleted Atdate

Get an Experiment

SearchDetails and project of a run.
Input fields[3]
FieldType
ExperimentRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

Get an Experiment Summary

SearchExperiment overview with optional score rollup.
Input fields[3]
FieldType
ExperimentRequired
choice
Summarize Scoresboolean
Comparison Experimentchoice
Output fields[3]
FieldType
Project Nametext
Experiment Nametext
Project URLtext
Experiment URLtext
Comparison Experiment Nametext
Scorestext
Metricstext

Get an MCP Server

SearchAddress and creator of an MCP server.
Input fields[3]
FieldType
MCP ServerRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

Get an Organization

SearchData plane settings of an organization.
Input fields[3]
FieldType
OrganizationRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
API URLtext
Is Universal APIboolean
Is Dataplane Privateboolean
Proxy URLtext
Realtime URLtext
Createddate

3other output fields

Get Async SQL Query Results

SearchRows from a background SQL query.
Input fields[3]
FieldType
Query IDRequired
text
Page Sizenumber
Cursortext
Output fields[3]
FieldType
IDtext
Createddate
Inputtext
Outputtext
Scorestext
Metadatatext
Cursortext

Get Async SQL Query Status

SearchProgress check for a background query.
Input fields[3]
FieldType
Query IDRequired
text
Output fields[3]
FieldType
Automation IDtext
Project IDtext
Object IDtext
Statustext
Statstext
Errortext

List ACLs

SearchAccess rules attached to one object.
Input fields[3]
FieldType
LimitRequired
number
Object TypeRequired
choice
ObjectRequired
text
Userchoice
Groupchoice
Permissionchoice
Restrict Object Typechoice
Rolechoice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
User IDtext
Group IDtext
Permissiontext
Restrict Object Typetext
Role IDtext

2other output fields

List AI Secrets

SearchProvider keys saved for the organization.
Input fields[3]
FieldType
LimitRequired
number
AI Secret Nametext
Organization Nametext
Secret Typetext
Output fields[3]
FieldType
IDtext
Createddate
Updated Atdate
Secret Updated Atdate
Organization IDtext
Nametext
Typetext
Metadatatext

2other output fields

List API Keys

SearchAPI keys of an organization by name.
Input fields[3]
FieldType
LimitRequired
number
API Key Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
User IDtext
User Emailtext
User Given Nametext
User Family Nametext

2other output fields

List Custom Columns

SearchDerived columns on an object.
Input fields[3]
FieldType
LimitRequired
number
Object TypeRequired
choice
ObjectRequired
text
Subtypechoice
Varianttext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Subtypetext
Varianttext
Nametext
Expressiontext
Createddate

List Dataset Snapshots

SearchPinned dataset versions across the account.
Input fields[3]
FieldType
LimitRequired
number
Dataset Snapshot Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Dataset IDtext
Nametext
Descriptiontext
Xact IDtext
Createddate

List Datasets

SearchDatasets filtered by name or project.
Input fields[3]
FieldType
LimitRequired
number
Dataset Nametext
Project Nametext
Projectchoice
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

List Env Vars

SearchStored variables on Braintrust objects.
Input fields[3]
FieldType
LimitRequired
number
Env Var Nametext
Object Typechoice
Objecttext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Nametext
Createddate
Secret Updated Atdate
Secret Updated By User IDtext
Useddate

4other output fields

List Environments

SearchDeployment stages of the organization.
Input fields[3]
FieldType
LimitRequired
number
Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext
Createddate
Deleted Atdate

List Experiments

SearchEvaluation runs, optionally for one project.
Input fields[3]
FieldType
LimitRequired
number
Experiment Nametext
Project Nametext
Projectchoice
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

List Functions

SearchStored functions with their projects.
Input fields[3]
FieldType
LimitRequired
number
Function Nametext
Project Nametext
Projectchoice
Slugtext
Versiontext
Environmenttext
Organization Nametext
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

8other output fields

List Groups

SearchPermission groups to review.
Input fields[3]
FieldType
LimitRequired
number
Group Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Usersarray

1other output field

List Ingest Keys

SearchKeys that write logs into a project.
Input fields[3]
FieldType
LimitRequired
number
ProjectRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Organization IDtext
Project IDtext
Preview Nametext
URLtext

List MCP Servers

SearchTool servers registered on projects.
Input fields[3]
FieldType
LimitRequired
number
MCP Server Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

List Organization ACLs

SearchOrg-wide access rules.
Input fields[3]
FieldType
LimitRequired
number
Object Typechoice
Objecttext
Userchoice
Groupchoice
Permissionchoice
Restrict Object Typechoice
Rolechoice

1other input field

Output fields[3]
FieldType
Resulttext

List Organization API Keys

SearchDate-limited keys across an organization.
Input fields[3]
FieldType
LimitRequired
number
API Key Nametext
Organizationchoice
Created Afterdate
Created Beforedate
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
User IDtext
User Emailtext
User Given Nametext
User Family Nametext

2other output fields

List Organizations

SearchOrganizations your login can reach.
Input fields[3]
FieldType
LimitRequired
number
Organization Nametext
Output fields[3]
FieldType
IDtext
Nametext
API URLtext
Is Universal APIboolean
Is Dataplane Privateboolean
Proxy URLtext
Realtime URLtext
Createddate

3other output fields

List Project Automations

SearchAlerts configured for projects.
Input fields[3]
FieldType
LimitRequired
number
Project Automation Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Configtext
Runtime Blocktext

List Project Groups

SearchGrouped projects to review.
Input fields[3]
FieldType
LimitRequired
number
Project Group Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Projectsarray

List Project Scores

SearchScore definitions by project and type.
Input fields[3]
FieldType
LimitRequired
number
Project Score Nametext
Project Nametext
Projectchoice
Organization Nametext
Score Typechoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Score Typetext
Categoriestext

2other output fields

List Project Tags

SearchLabels defined across projects.
Input fields[3]
FieldType
LimitRequired
number
Project Tag Nametext
Project Nametext
Projectchoice
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Colortext
Positiontext

List Projects

SearchProject names with their descriptions.
Input fields[3]
FieldType
LimitRequired
number
Project Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

List Prompts

SearchPrompts with their slugs and versions.
Input fields[3]
FieldType
LimitRequired
number
Prompt Nametext
Project Nametext
Projectchoice
Slugtext
Versiontext
Environmenttext
Organization Nametext
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

List Roles

SearchRoles available for permissions.
Input fields[3]
FieldType
LimitRequired
number
Role Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Permissionstext

1other output field

List Service Tokens

SearchTokens issued to service accounts.
Input fields[3]
FieldType
LimitRequired
number
Service Token Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
Service Account IDtext
Service Account Emailtext
Service Account Nametext
Organization IDtext

1other output field

List Span Iframes

SearchEmbedded pages attached to spans.
Input fields[3]
FieldType
LimitRequired
number
Span Iframe Nametext
Organization Nametext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

1other output field

List Users

SearchPeople found by name or email.
Input fields[3]
FieldType
LimitRequired
number
Given Nametext
Family Nametext
Emailtext
Organization Nametext
Output fields[3]
FieldType
IDtext
Given Nametext
Family Nametext
Emailtext
Avatar URLtext
Createddate

List Views

SearchTable views stored for an object.
Input fields[3]
FieldType
LimitRequired
number
Object TypeRequired
choice
ObjectRequired
text
View Nametext
View Typechoice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
View Typetext
Nametext
Descriptiontext
Starredboolean
Createddate

5other output fields

Run a SQL Query

SearchRows from an ad hoc SQL query.
Input fields[3]
FieldType
QueryRequired
text
LimitRequired
number
Output fields[3]
FieldType
IDtext
Createddate
Inputtext
Outputtext
Scorestext
Metadatatext

Add a Feedback Entry to a Dataset

ActionReviewer grades and notes on dataset rows.
Input fields[3]
FieldType
DatasetRequired
choice
FeedbackRequired
text
Output fields[3]
FieldType
Statustext

Add a Feedback Entry to an Experiment

ActionScores and comments on experiment events.
Input fields[3]
FieldType
ExperimentRequired
choice
FeedbackRequired
text
Output fields[3]
FieldType
Statustext

Add a Feedback Entry to Project Logs

ActionScores and tags on logged project events.
Input fields[3]
FieldType
ProjectRequired
choice
FeedbackRequired
text
Output fields[3]
FieldType
Statustext

Cancel an Async SQL Query

ActionHalts a background SQL job before it finishes.
Input fields[3]
FieldType
Query IDRequired
text
Output fields[3]
FieldType
Statustext
IDtext

Create a Chat Completion

ActionModel reply to a chat, via the AI proxy.
Input fields[3]
FieldType
ModelRequired
text
MessagesRequired
text
Extra Bodytext
Output fields[3]
FieldType
IDtext
Objecttext
Creatednumber
Modeltext
Choicestext
Usagetext

Create a Completion

ActionText continuation from a proxied model.
Input fields[3]
FieldType
ModelRequired
text
PromptRequired
text
Extra Bodytext
Output fields[3]
FieldType
IDtext
Objecttext
Creatednumber
Modeltext
Choicestext
Usagetext

Create a Custom Column

ActionDerived table column built from an expression.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
SubtypeRequired
choice
NameRequired
text
ExpressionRequired
text
Varianttext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Subtypetext
Varianttext
Nametext
Expressiontext
Createddate

Create a Dataset

ActionFresh dataset inside one project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
Descriptiontext
Tagstext
Metadatatext
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

Create a Dataset Snapshot

ActionPins a dataset at a past version.
Input fields[3]
FieldType
DatasetRequired
choice
NameRequired
text
Transaction IDRequired
text
Descriptiontext
Output fields[3]
FieldType
IDtext
Dataset IDtext
Nametext
Descriptiontext
Xact IDtext
Createddate

Create a Function

ActionReusable function stored in a project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
SlugRequired
text
Function DataRequired
text
Descriptiontext
Prompt Datatext
Tagstext
Function Typechoice

2other input fields

Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

8other output fields

Create a Group

ActionSet of users that share permissions.
Input fields[3]
FieldType
NameRequired
text
Descriptiontext
Member Userstext
Member Groupstext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Usersarray

1other output field

Create a Project

ActionFresh project inside your organization.
Input fields[3]
FieldType
NameRequired
text
Descriptiontext
Organization Nametext
Project Group Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

Create a Project Automation

ActionAlert rule that calls a webhook.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
ConfigRequired
text
Descriptiontext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Configtext
Runtime Blocktext

Create a Project Group

ActionNamed collection of projects.
Input fields[3]
FieldType
NameRequired
text
Descriptiontext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Projectsarray

Create a Project Score

ActionGrading rule defined on a project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
Score TypeRequired
choice
Descriptiontext
Categoriestext
Configtext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Score Typetext
Categoriestext

2other output fields

Create a Project Tag

ActionColored label for marking items.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
Descriptiontext
Colortext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Colortext
Positiontext

Create a Prompt

ActionVersioned prompt stored in a project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
SlugRequired
text
Descriptiontext
Prompt Datatext
Tagstext
Function Typechoice
Environment Slugstext
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

Create a Role

ActionNamed permission set for people.
Input fields[3]
FieldType
NameRequired
text
Descriptiontext
Member Permissionstext
Member Rolestext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Permissionstext

1other output field

Create a Service Token

ActionToken for automation accounts.
Input fields[3]
FieldType
NameRequired
text
Service AccountRequired
text
Organization Nametext
Expires In Secondsnumber
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
Service Account IDtext
Service Account Emailtext
Service Account Nametext
Organization IDtext

2other output fields

Create a Span Iframe

ActionCustom iframe shown with spans.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
URLRequired
text
Descriptiontext
Post Messageboolean
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

1other output field

Create a Temporary Credential

ActionExpiring key for AI proxy calls.
Input fields[3]
FieldType
ModelRequired
text
Lifetime in SecondsRequired
number
Loggingtext
Output fields[3]
FieldType
Keytext

Create a View

ActionStored table layout with filters.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
View TypeRequired
choice
NameRequired
text
Descriptiontext
View Datatext
Optionstext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
View Typetext
Nametext
Descriptiontext
Starredboolean
Createddate

5other output fields

Create an ACL

ActionNew access rule on a project or other object.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
Userchoice
Groupchoice
Permissionchoice
Restrict Object Typechoice
Rolechoice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
User IDtext
Group IDtext
Permissiontext
Restrict Object Typetext
Role IDtext

2other output fields

Create an AI Secret

ActionSaves a named AI provider key.
Input fields[3]
FieldType
NameRequired
text
Typetext
Metadatatext
Secrettext
Organization Nametext
Output fields[3]
FieldType
IDtext
Createddate
Updated Atdate
Secret Updated Atdate
Organization IDtext
Nametext
Typetext
Metadatatext

2other output fields

Create an Env Var

ActionVariable attached to a Braintrust object.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
NameRequired
text
Valuetext
Metadatatext
Secret Typetext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Nametext
Createddate
Secret Updated Atdate
Secret Updated By User IDtext
Useddate

4other output fields

Create an Environment

ActionDeployment stage with its own slug.
Input fields[3]
FieldType
NameRequired
text
SlugRequired
text
Descriptiontext
Organization Nametext
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext
Createddate
Deleted Atdate

Create an Experiment

ActionEvaluation run linked to a dataset version.
Input fields[3]
FieldType
ProjectRequired
choice
Nametext
Descriptiontext
Base Experimentchoice
Datasetchoice
Dataset Versiontext
Parameters Prompttext
Parameters Versiontext

4other input fields

Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

Create an Ingest Key

ActionLogging-only key for one project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Organization IDtext
Project IDtext
Preview Nametext
URLtext

Create an MCP Server

ActionTool server entry kept in a project.
Input fields[3]
FieldType
ProjectRequired
choice
NameRequired
text
URLRequired
text
Descriptiontext
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

Create Embeddings

ActionVector embeddings from the AI proxy.
Input fields[3]
FieldType
ModelRequired
text
InputRequired
text
Extra Bodytext
Output fields[3]
FieldType
Objecttext
Datatext
Modeltext
Usagetext

Delete a Custom Column

ActionRemoves a derived column from a view.
Input fields[3]
FieldType
ColumnRequired
choice
Object Typechoice
Objecttext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Subtypetext
Varianttext
Nametext
Expressiontext
Createddate

Delete a Dataset

ActionDataset gone from its project.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

Delete a Dataset Snapshot

ActionDeletes a pinned dataset version.
Input fields[3]
FieldType
Dataset SnapshotRequired
choice
Output fields[3]
FieldType
IDtext
Dataset IDtext
Nametext
Descriptiontext
Xact IDtext
Createddate

Delete a Function

ActionDeletes a stored tool or scorer.
Input fields[3]
FieldType
FunctionRequired
choice
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

8other output fields

Delete a Group

ActionRemoves a permission group.
Input fields[3]
FieldType
GroupRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Usersarray

1other output field

Delete a Project

ActionRemoves a whole project.
Input fields[3]
FieldType
ProjectRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

Delete a Project Automation

ActionDeletes a project alert rule.
Input fields[3]
FieldType
Project AutomationRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Configtext
Runtime Blocktext

Delete a Project Group

ActionRemoves a grouping of projects.
Input fields[3]
FieldType
Project GroupRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Projectsarray

Delete a Project Score

ActionDeletes a grading rule.
Input fields[3]
FieldType
Project ScoreRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Score Typetext
Categoriestext

2other output fields

Delete a Project Tag

ActionRemoves a colored label.
Input fields[3]
FieldType
Project TagRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Colortext
Positiontext

Delete a Prompt

ActionDeletes a stored prompt from a project.
Input fields[3]
FieldType
PromptRequired
choice
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

Delete a Role

ActionRemoves a named permission set.
Input fields[3]
FieldType
RoleRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Permissionstext

1other output field

Delete a Service Token

ActionDeletes a token used by automation accounts.
Input fields[3]
FieldType
Service TokenRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
Service Account IDtext
Service Account Emailtext
Service Account Nametext
Organization IDtext

1other output field

Delete a Span Iframe

ActionIframe removed from span display.
Input fields[3]
FieldType
Span IframeRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

1other output field

Delete a View

ActionRemoves a stored table layout.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
ViewRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
View Typetext
Nametext
Descriptiontext
Starredboolean
Createddate

5other output fields

Delete an ACL

ActionDeletes a single access rule.
Input fields[3]
FieldType
ACLRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
User IDtext
Group IDtext
Permissiontext
Restrict Object Typetext
Role IDtext

2other output fields

Delete an ACL by Match

ActionDeletes the rule that matches the fields.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
Userchoice
Groupchoice
Permissionchoice
Restrict Object Typechoice
Rolechoice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
User IDtext
Group IDtext
Permissiontext
Restrict Object Typetext
Role IDtext

2other output fields

Delete an AI Secret

ActionRemoves a saved provider key.
Input fields[3]
FieldType
AI SecretRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Updated Atdate
Secret Updated Atdate
Organization IDtext
Nametext
Typetext
Metadatatext

2other output fields

Delete an API Key

ActionRevokes a personal API key.
Input fields[3]
FieldType
API KeyRequired
choice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Preview Nametext
User IDtext
User Emailtext
User Given Nametext
User Family Nametext

2other output fields

Delete an Env Var

ActionRemoves a stored variable.
Input fields[3]
FieldType
Env VarRequired
choice
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Nametext
Createddate
Secret Updated Atdate
Secret Updated By User IDtext
Useddate

4other output fields

Delete an Environment

ActionDeletes a deployment stage.
Input fields[3]
FieldType
EnvironmentRequired
choice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext
Createddate
Deleted Atdate

Delete an Experiment

ActionRemoves an evaluation run.
Input fields[3]
FieldType
ExperimentRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

Delete an MCP Server

ActionUnregisters a Model Context Protocol server.
Input fields[3]
FieldType
MCP ServerRequired
choice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

Insert Dataset Records

ActionAdds or updates dataset rows.
Input fields[3]
FieldType
DatasetRequired
choice
RecordsRequired
text
Output fields[3]
FieldType
Row Idsarray

Insert Experiment Events

ActionWrites trace events to an evaluation run.
Input fields[3]
FieldType
ExperimentRequired
choice
EventsRequired
text
Output fields[3]
FieldType
Row Idsarray

Insert Log Events

ActionWrites trace events to project logs.
Input fields[3]
FieldType
ProjectRequired
choice
EventsRequired
text
Output fields[3]
FieldType
Row Idsarray

Insert Rows Across Objects

ActionMulti-target write to experiments, datasets and logs.
Input fields[3]
FieldType
Experimenttext
Datasettext
Project Logstext
Output fields[3]
FieldType
Experimenttext
Datasettext
Project Logstext

Invoke a Function

ActionExecutes a stored function and returns its result.
Input fields[3]
FieldType
FunctionRequired
choice
Inputtext
Expectedtext
Metadatatext
Tagstext
Messagestext
Modechoice
Strictboolean

3other input fields

Output fields[3]
FieldType
Resulttext

Launch an Eval

ActionRuns an evaluation and links to its experiment.
Input fields[3]
FieldType
ProjectRequired
choice
DataRequired
text
TaskRequired
text
ScoresRequired
text
Nametext
Parameterstext
Experiment Nametext
Metadatatext

11other input fields

Output fields[3]
FieldType
Project Nametext
Experiment Nametext
Project URLtext
Experiment URLtext
Comparison Experiment Nametext
Scorestext
Metricstext

Make an API Call

universalDirect Braintrust REST API access for uncovered endpoints.
Input fields[3]
FieldType
URLRequired
text
MethodRequired
choice
Headersarray
Headerobject
Query stringarray
Parameterobject
Bodytext
Output fields[3]
FieldType
Bodytext
Headersobject
Keytext
Valuetext
Status codenumber

Preview a Dataset Restore

ActionDry run of a dataset rollback.
Input fields[3]
FieldType
DatasetRequired
choice
VersionRequired
text
Output fields[3]
FieldType
Rows To Restorenumber
Rows To Deletenumber

Restore a Dataset

ActionReverts a dataset to a past version.
Input fields[3]
FieldType
DatasetRequired
choice
VersionRequired
text
Output fields[3]
FieldType
Xact IDtext
Rows Restorednumber
Rows Deletednumber

Revoke an Ingest Key

ActionDisables a logging key.
Input fields[3]
FieldType
Ingest KeyRequired
text
Projectchoice
Output fields[3]
FieldType
IDtext
Createddate
Nametext
Organization IDtext
Project IDtext
Preview Nametext

Start an Async SQL Query

ActionBackground SQL job for big exports.
Input fields[3]
FieldType
QueryRequired
text
Batch Sizenumber
Output fields[3]
FieldType
IDtext
Project IDtext
Object IDtext
Statustext

Update a Custom Column

ActionReworks a derived table column.
Input fields[3]
FieldType
ColumnRequired
choice
Object Typechoice
Objecttext
Nametext
Expressiontext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Subtypetext
Varianttext
Nametext
Expressiontext
Createddate

Update a Dataset

ActionEdits dataset name, notes and tags.
Input fields[3]
FieldType
DatasetRequired
choice
Nametext
Descriptiontext
Tagstext
Metadatatext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Tagsarray

2other output fields

Update a Dataset Snapshot

ActionRelabels a pinned dataset version.
Input fields[3]
FieldType
Dataset SnapshotRequired
choice
Nametext
Descriptiontext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Dataset IDtext
Nametext
Descriptiontext
Xact IDtext
Createddate

Update a Function

ActionReworks a stored tool or scorer.
Input fields[3]
FieldType
FunctionRequired
choice
Nametext
Descriptiontext
Prompt Datatext
Function Datatext
Tagstext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

8other output fields

Update a Group

ActionRename a group and adjust members.
Input fields[3]
FieldType
GroupRequired
choice
Descriptiontext
Nametext
Add Member Userstext
Remove Member Userstext
Add Member Groupstext
Remove Member Groupstext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Usersarray

1other output field

Update a Project

ActionRevises project details and settings.
Input fields[3]
FieldType
ProjectRequired
choice
Nametext
Descriptiontext
Userchoice
Settingstext
Only If Unsetchoice
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Descriptiontext
Createddate
Deleted Atdate
User IDtext
Settingstext

Update a Project Automation

ActionReconfigures a project alert.
Input fields[3]
FieldType
Project AutomationRequired
choice
Nametext
Descriptiontext
Configtext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Configtext
Runtime Blocktext

Update a Project Group

ActionEdit grouped projects and name.
Input fields[3]
FieldType
Project GroupRequired
choice
Nametext
Descriptiontext
Add Member Projectstext
Remove Member Projectstext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Projectsarray

Update a Project Score

ActionTunes a grading rule.
Input fields[3]
FieldType
Project ScoreRequired
choice
Nametext
Descriptiontext
Score Typechoice
Categoriestext
Configtext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Score Typetext
Categoriestext

2other output fields

Update a Project Tag

ActionRecolors or renames a tag.
Input fields[3]
FieldType
Project TagRequired
choice
Nametext
Descriptiontext
Colortext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Colortext
Positiontext

Update a Prompt

ActionNew content for a saved prompt.
Input fields[3]
FieldType
PromptRequired
choice
Nametext
Slugtext
Descriptiontext
Prompt Datatext
Tagstext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Xact IDtext
Project IDtext
Log IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext

5other output fields

Update a Role

ActionReshape a role and its permissions.
Input fields[3]
FieldType
RoleRequired
choice
Descriptiontext
Nametext
Add Member Permissionstext
Remove Member Permissionstext
Add Member Rolestext
Remove Member Rolestext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Organization IDtext
User IDtext
Createddate
Nametext
Descriptiontext
Deleted Atdate
Member Permissionstext

1other output field

Update a Span Iframe

ActionRepoints the page embedded beside spans.
Input fields[3]
FieldType
Span IframeRequired
choice
Nametext
URLtext
Post Messagechoice
Descriptiontext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

1other output field

Update a View

ActionReshapes a stored table view.
Input fields[3]
FieldType
Object TypeRequired
choice
ObjectRequired
text
ViewRequired
choice
View Typechoice
Nametext
Descriptiontext
Starredchoice
View Datatext

2other input fields

Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
View Typetext
Nametext
Descriptiontext
Starredboolean
Createddate

5other output fields

Update ACLs in Batch

ActionBulk grant and revoke of access rules.
Input fields[3]
FieldType
Add ACLstext
Remove ACLstext
Output fields[3]
FieldType
Added ACLstext
Removed ACLstext

Update an AI Secret

ActionRotates a saved provider key.
Input fields[3]
FieldType
AI SecretRequired
choice
Nametext
Typetext
Metadatatext
Secrettext
Output fields[3]
FieldType
IDtext
Createddate
Updated Atdate
Secret Updated Atdate
Organization IDtext
Nametext
Typetext
Metadatatext

2other output fields

Update an Env Var

ActionRewrites a stored variable.
Input fields[3]
FieldType
Env VarRequired
choice
NameRequired
text
Valuetext
Metadatatext
Secret Typetext
Output fields[3]
FieldType
IDtext
Object Typetext
Object IDtext
Nametext
Createddate
Secret Updated Atdate
Secret Updated By User IDtext
Useddate

4other output fields

Update an Environment

ActionEdits a deployment stage.
Input fields[3]
FieldType
EnvironmentRequired
choice
Nametext
Slugtext
Descriptiontext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Organization IDtext
Nametext
Slugtext
Descriptiontext
Createddate
Deleted Atdate

Update an Experiment

ActionAdjusts evaluation run settings.
Input fields[3]
FieldType
ExperimentRequired
choice
Nametext
Descriptiontext
Base Experimentchoice
Datasetchoice
Dataset Versiontext
Parameters Prompttext
Parameters Versiontext

4other input fields

Output fields[3]
FieldType
IDtext
Project IDtext
Nametext
Descriptiontext
Createddate
Repo Infotext
Committext
Base Exp IDtext

10other output fields

Update an MCP Server

ActionRepoints an MCP server registration.
Input fields[3]
FieldType
MCP ServerRequired
choice
Nametext
URLtext
Descriptiontext
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Project IDtext
User IDtext
Createddate
Deleted Atdate
Nametext
Descriptiontext
URLtext

Update an Organization

ActionData plane and rendering settings.
Input fields[3]
FieldType
OrganizationRequired
choice
Nametext
API URLtext
Is Universal APIchoice
Is Dataplane Privatechoice
Proxy URLtext
Realtime URLtext
Image Rendering Modechoice
Output fields[3]
FieldType
IDtext
Nametext
API URLtext
Is Universal APIboolean
Is Dataplane Privateboolean
Proxy URLtext
Realtime URLtext
Createddate

3other output fields

Update Organization Members

ActionInvites and removes organization people.
Input fields[3]
FieldType
Invite Userstext
Remove Userstext
Organization Nametext
Organizationchoice
Output fields[3]
FieldType
Statustext
Organization IDtext
Send Email Errortext
Added Userstext

Look for Braintrust templates in the WEXTL template library.

Browse templates →
  1. WEXTL® Braintrust Source Code connector implementation.
  2. Our users use cases and automations.
  3. Official API Documentation for Braintrust.
  4. WEXTL® visual workflow builder data.

Last updated: Nov 14, 2026 17:45

How we write our apps documentation

How we compile these docs: sources, the role of AI, and how we verify.