Connect Braintrust integrations
VerifiedAI observability and evaluation platform for logging, experiments and prompts, connected to WEXTL workflows and AI agents. Your workflows can send Braintrust results straight into the tools that act on them. Start with Watch Alerts, then use Fetch Dataset Records or Fetch Experiment Events to turn the output into a next step.
- 3-day trial
- Cancel anytime
- Up to 10 minutes quick set up
- GDPR
- Data Encryption
- 2FA
- Local Data Region
Supported triggers and actions for Braintrust integration
Triggers can detect changes in Braintrust and run actions that can create, search or modify data inside Braintrust automatically[3], exactly how you set them.
- Watch Alerts Starts the workflow the moment Braintrust sends an alert webhook. Each run receives the Organization, Project, Automation and Details of the alert.
- Watch New Datasets Runs a periodic check for datasets created since the previous check and emits each one separately. Use Project to watch a single project, and Limit to cap how many each check reads.
- Watch New Experiments Runs on a schedule and emits every experiment created since the previous check. Use Project to watch just one project.
- Watch New Projects Looks for projects added since the last scheduled check and fires once per project. Use Limit to set how many it reads each time.
- Watch New Prompts Polls on a schedule for prompts created since the last run, one item each. Fill Project to follow a single project.
- Fetch Dataset Records Reads records from a dataset in pages, with Page Size to limit each page and Cursor to continue where the last run stopped. Use Version to read an earlier state.
- Fetch Experiment Events Pulls the events logged in an experiment, one item each. Pass the Cursor of the previous run to get the next page, and lower Page Size for smaller pages.
- Fetch Log Events Retrieves logged events of a project in pages, each with its ID and Xact ID. Use Version to replay a past state and Cursor to move on.
- Get a Dataset Returns one dataset with its Name, Description and Project ID.
- Get a Dataset Snapshot Opens a saved snapshot and shows the Dataset ID it was cut from and the Xact ID of that version.
- Get a Dataset Summary Summarizes a dataset with the Project Name, Dataset Name and links to the Project URL and Dataset URL. Turn on Summarize Data to add the Data Summary.
- Get a Function Fetches one function by ID. Use Version to read an earlier state, or Environment to get the version assigned there.
- Get a Group Shows a permission group, including the Organization ID it sits in.
- Get a Project Looks up a project by ID and returns its Name, Description and Organization ID.
- Get a Project Automation Reads a log alert of a project together with its Config.
- Get a Project Group Fetches one collection of projects, with the User ID that created it.
- Get a Project Score Retrieves a score definition from a project, showing its Name and Project ID.
- Get a Project Tag Reads one tag defined in a project, with its Color and Description.
- Get a Prompt Gets one prompt. Use Version to load an earlier state, or Environment to load the version assigned to that environment.
- Get a Role Fetches a role with its Description and Member Permissions.
- Get a Service Token Reads the Preview Name and Service Account ID of one service token.
- Get a Span Iframe Looks up an embedded span iframe, showing its URL and Post Message setting.
- Get a User Retrieves a person with their Given Name, Family Name, Email and Avatar URL.
- Get a View Opens a saved table view on an object, with its View Type and Name.
- Get an ACL Looks up one access rule and shows who it applies to through User ID and Group ID, along with the Object Type it covers.
- Get an AI Secret Reads the record of one stored provider secret, including Created and when Secret Updated At last changed.
- Get an API Key Fetches one API key record, showing the User ID of its owner and its Preview Name.
- Get an Env Var Reads one environment variable and shows its Name, Object Type and Object ID.
- Get an Environment Reads one deployment environment with its Name, Slug and Description.
- Get an Experiment Retrieves one experiment, showing its Description and the Project ID it runs in.
- Get an Experiment Summary Summarizes an experiment with its Project Name and Experiment Name. Turn on Summarize Scores to add scores and metrics, and set Comparison Experiment to measure against another run.
- Get an MCP Server Gets a registered MCP server and the User ID that added it, plus its URL.
- Get an Organization Reads an organization together with its API URL, and whether Is Universal API or Is Dataplane Private is set.
- Get Async SQL Query Results Collects the rows an asynchronous query produced, each with Input, Output and Scores. Page through large results with Page Size and Cursor.
- Get Async SQL Query Status Checks how far a background query has progressed by reading its Status and Stats. Run it before fetching the finished rows.
- List ACLs Lists the access rules on one object. Narrow the list with User, Group, Permission or Role, and set Limit to cap how many are returned.
- List AI Secrets Shows stored AI provider secrets, filtered by AI Secret Name or Secret Type. Each item carries timestamps for creation and last change.
- List API Keys Finds API keys by API Key Name within an organization, each with its Preview Name and owning User ID.
- List Custom Columns Pulls the computed columns defined on one object. Restrict the list to one kind of table with Subtype and Variant.
- List Dataset Snapshots Retrieves saved dataset snapshots, searchable by Dataset Snapshot Name. Each shows its Dataset ID and Xact ID.
- List Datasets Lists datasets across your organization. Search by Dataset Name, or restrict to Project Name or Project, and read each Description.
- List Env Vars Gets environment variables for one object, or finds one by Env Var Name. Each item shows its Name and Object Type.
- List Environments Shows deployment environments with their Slug and Description. Use Name to look for a specific one.
- List Experiments Returns experiments across your account. Use Experiment Name, Project Name or Project to narrow it, and read each Description.
- List Functions Browses the prompts, tools and scorers saved as functions. Use Function Name, Slug, Project, Version or Environment to find a particular one.
- List Groups Lists permission groups, searchable by Group Name, with the Organization ID of each.
- List Ingest Keys Lists the logging keys that belong to one Project, showing each Created timestamp.
- List MCP Servers Finds registered MCP servers by MCP Server Name, along with their Project ID.
- List Organization ACLs Reads access rules across the whole organization, each delivered as one Result item. Narrow by Object Type, Object, User, Group, Permission or Role.
- List Organization API Keys Lists API keys of everyone in an organization. Set a date window with Created After and Created Before, or look up one by API Key Name.
- List Organizations Shows the organizations you can reach, filtered by Organization Name, with the API URL of each.
- List Project Automations Lists log alerts matching Project Automation Name, with the User ID of each.
- List Project Groups Retrieves collections of projects. Use Project Group Name to find one by name.
- List Project Scores Gets score definitions. Use Project Score Name, Project Name, Project or Score Type to find the ones you need.
- List Project Tags Pulls tags defined on projects, matching Project Tag Name, Project Name or Project.
- List Projects Reads the projects of your organization. Use Project Name to find one by name.
- List Prompts Browses saved prompts, finding them by Prompt Name, Slug, Project, Version or Environment.
- List Roles Lists roles of your organization, matching Role Name when provided.
- List Service Tokens Shows service tokens matching Service Token Name, each with its Preview Name.
- List Span Iframes Gets embedded span iframes by Span Iframe Name, with the Project ID of each.
- List Users Finds people by Email, Given Name or Family Name, with an Avatar URL for each.
- List Views Lists saved table views on one object, optionally limited to a View Type or a View Name.
- Run a SQL Query Runs a SQL query over logs, experiments or datasets and returns rows with Input, Output and Scores. Add a Limit, since logs return only 10 rows without one.
- Add a Feedback Entry to a Dataset Attaches scores, comments, tags and expected values to records that already exist in a dataset. Each item of the JSON array needs the id of its record and can score from 0 to 1.
- Add a Feedback Entry to an Experiment Writes review feedback onto events of an experiment. Each Feedback item holds the event id plus any of scores, comment, expected, metadata, tags and source.
- Add a Feedback Entry to Project Logs Records scores, comments or tags against logged events of a project. Send one JSON item per event id.
- Cancel an Async SQL Query Stops a long-running SQL query that was started in the background, using its Query ID. The Status and ID of the query are returned.
- Create a Chat Completion Sends Messages to a Model through the Braintrust AI proxy and returns the Choices of the reply. Use Extra Body to add request keys such as temperature or max tokens.
- Create a Completion Runs a plain text Prompt against a Model through the Braintrust proxy and returns the generated Choices. Use Extra Body to add more request keys.
- Create a Custom Column Adds a computed column to a dataset, experiment or project view, defined by an Expression under a Name. Use Subtype for child objects and Variant to pick a table variant.
- Create a Dataset Starts a dataset under a Name inside a Project. Use Description, Tags and Metadata to describe it.
- Create a Dataset Snapshot Freezes a dataset as it stood at one version, by pairing a Name with the Transaction ID of that version. Add a Description to label the snapshot.
- Create a Function Saves a tool, scorer or prompt-backed function in a Project. Write Function Data as JSON, and add a Slug to give it a stable identifier.
- Create a Group Makes a group of people for permission management. List Member Users and Member Groups to seed it, then grant it access through ACLs.
- Create a Project Starts a project to hold experiments, logs, datasets and prompts. Use Project Group Name to place it in an existing group.
- Create a Project Automation Sets up a log alert on a Project. Write Config as JSON with the event type, status, a BTQL filter, an interval and a webhook action.
- Create a Project Group Collects several projects under one Name. Use Description to explain the grouping.
- Create a Project Score Defines a score that experiments and logs can be graded with, from a Name and a Score Type. Add Categories and Config as JSON to shape the score.
- Create a Project Tag Defines a tag within a Project for marking logs and experiments. Use Color to tell tags apart and Description to explain when to apply it.
- Create a Prompt Saves a prompt in a Project under a Name and Slug, with versioning handled by Braintrust. Use Prompt Data for the messages and model settings, and Environment Slugs to attach environments.
- Create a Role Defines a named role for your organization. Add Member Permissions for what it allows, and Member Roles to inherit rights from other roles.
- Create a Service Token Issues an automation token for a Service Account in place of a personal key. Use Expires In Seconds to end its life, or leave it empty so it never expires.
- Create a Span Iframe Embeds an external page beside trace spans, loaded from a URL and titled with a Name. Turn on Post Message to send the span data to that page.
- Create a Temporary Credential Mints a short-lived proxy key for one Model that lasts the Lifetime in Seconds. Add Logging to have its requests recorded in a Braintrust project.
- Create a View Saves a table view on a project, dataset or other object, with a View Type and Name. Filters and layout are stored through View Data and Options.
- Create an ACL Grants access on one Braintrust object to a User or a Group, or through a Role. Set Permission for a single right, and Restrict Object Type to narrow the rule to child objects.
- Create an AI Secret Stores a provider key such as a model API key under a Name in your organization. Add Type and Metadata to classify it, then read Secret Updated At later to see changes.
- Create an Env Var Defines an environment variable on a project or other Braintrust object, picking the owner with Object Type and Object. Fill Value to store its content, or Secret Type to store it as a secret.
- Create an Environment Registers a deployment environment under a Name and a unique Slug, which is a url-friendly identifier within the organization.
- Create an Experiment Opens an experiment in a Project. Link it to a Dataset and Dataset Version, and set Base Experiment to compare against an earlier run.
- Create an Ingest Key Issues an ingest key tied to one Project and labelled with a Name.
- Create an MCP Server Registers an MCP server in a Project, reachable at its URL under a Name. Add a Description to document it.
- Create Embeddings Converts Input text into vectors with the chosen Model, sent through the Braintrust proxy. Returns the Data, plus token Usage for the call.
- Delete a Custom Column Removes a computed column. Add Object Type and Object to narrow the lookup, and the Subtype and Variant of the deleted column are returned.
- Delete a Dataset Deletes a dataset from its project. The Description it had is returned along with its Name.
- Delete a Dataset Snapshot Removes a saved snapshot of a dataset and returns the Dataset ID and Xact ID it was taken from.
- Delete a Function Removes a function such as a tool or scorer, returning its ID and Project ID.
- Delete a Group Deletes a group of users and returns the Organization ID it belonged to.
- Delete a Project Deletes a project and returns its Description and Organization ID.
- Delete a Project Automation Removes a log alert automation from its project. The User ID that created it is returned.
- Delete a Project Group Deletes a named collection of projects. The User ID that created it is returned.
- Delete a Project Score Removes a score definition from a project, returning its Name and Project ID.
- Delete a Project Tag Deletes a tag defined in a project and returns the Color it had.
- Delete a Prompt Removes a saved prompt, returning its ID, Xact ID and Project ID.
- Delete a Role Deletes a role from your organization. The removed role is returned with its Created timestamp.
- Delete a Service Token Revokes a service token by deleting it, returning its Preview Name and Service Account ID.
- Delete a Span Iframe Removes an embedded span iframe from a project. The returned record shows the Deleted At time.
- Delete a View Deletes a saved table view on an object and returns its View Type and Name.
- Delete an ACL Deletes one access rule. The removed rule is returned with its Object Type, Object ID and User ID.
- Delete an ACL by Match Removes whichever access rule matches the Object Type and Object, narrowed with User, Group, Permission or Role.
- Delete an AI Secret Removes a stored AI provider secret from your organization and returns the record that was deleted.
- Delete an API Key Deletes a personal API key and returns its Name and Preview Name to confirm which key went.
- Delete an Env Var Deletes an environment variable and returns its Name, Object Type and Object ID.
- Delete an Environment Removes a deployment environment, returning its Slug.
- Delete an Experiment Deletes an experiment from its project, returning its Name and Description.
- Delete an MCP Server Removes a registered MCP server from a project. The returned record shows its Deleted At time.
- Insert Dataset Records Adds Records to a dataset from a JSON array. A record with an id that already exists is updated, so retrying never duplicates it.
- Insert Experiment Events Logs a JSON array of Events into an experiment and returns the Row Ids. An event whose id already exists is updated, not added twice.
- Insert Log Events Sends Events into the logs of a project and returns the Row Ids. Give each event an id to make a retry safe.
- Insert Rows Across Objects Writes events into an experiment, a dataset and project logs in a single request. Fill any of Experiment, Dataset and Project Logs, and the row IDs of each are returned.
- Invoke a Function Runs a function once on an Input, optionally with Expected, Messages and Metadata. Use Mode to change the format of the Result, and Strict to fail when a prompt variable is missing.
- Launch an Eval Starts an evaluation in a Project from Data, a Task and Scores, each written as JSON. Use Trial Count to repeat every input and Experiment Name to label the run, then follow Experiment URL.
- Make an API Call Sends a free-form request to the Braintrust REST API, signed with your saved credential.
- Preview a Dataset Restore Dry-runs a rollback of a dataset to an earlier Version and reports the Rows To Restore plus the Rows To Delete.
- Restore a Dataset Rolls a dataset back to an earlier Version, then reports the Rows Restored, Rows Deleted and the new Xact ID.
- Revoke an Ingest Key Revokes a logging key and returns its Name. Use Project to narrow the lookup.
- Start an Async SQL Query Submits a Query to run in the background, suited to exports too large for one page. Use Batch Size for rows per write, and keep the returned ID to follow its Status.
- Update a Custom Column Rewrites the Expression of a computed column, renames it with Name, or moves it to a different Object Type and Object.
- Update a Dataset Renames a dataset or rewrites its Description, and replaces Tags and Metadata. Use Clear Fields to empty values.
- Update a Dataset Snapshot Renames a snapshot and rewrites its Description. Use Clear Fields to blank values you no longer want.
- Update a Function Modifies the Prompt Data and Function Data of a function, plus Tags, Name and Description. Use Clear Fields to empty values.
- Update a Group Renames a group and manages its people through Add Member Users, Remove Member Users, Add Member Groups and Remove Member Groups.
- Update a Project Edits Name, Description or Settings. Overwrites the whole set of settings, so include every setting to keep, or turn on Only If Unset to patch just the user and session id fields.
- Update a Project Automation Edits a log alert through Name, Description and Config, where Config keys you leave out keep their value. Use Clear Fields to empty values.
- Update a Project Group Renames a project group and adjusts which projects belong to it with Add Member Projects and Remove Member Projects.
- Update a Project Score Revises a score definition. Send a new Name, Description, Score Type, Categories or Config.
- Update a Project Tag Adjusts Color, Name or Description of a tag, with Clear Fields to empty a value.
- Update a Prompt Rewrites the Prompt Data of a saved prompt, or renames it and changes Slug, Description and Tags. Use Clear Fields to empty values.
- Update a Role Renames a role and edits its rights with Add Member Permissions, Remove Member Permissions, Add Member Roles and Remove Member Roles.
- Update a Span Iframe Changes where an embedded page points with URL, along with Name, Description and Post Message. Use Clear Fields to empty values.
- Update a View Modifies a saved table view. Send a new Name, Description, View Data or Options, and set Starred to star it.
- Update ACLs in Batch Adds and removes many access rules in one call, using Add ACLs and Remove ACLs as JSON. The result lists the rules added and removed.
- Update an AI Secret Rotates a stored provider key. Change its Name, Type, Metadata or the Secret value itself.
- Update an Env Var Overwrites an environment variable with a new Value, Metadata or Secret Type.
- Update an Environment Alters the Slug, Description or Name of a deployment environment. Use Clear Fields to empty one.
- Update an Experiment Revises Name, Description or Base Experiment of an experiment, and re-links its Dataset or Dataset Version. Turn on Public to let anybody view it.
- Update an MCP Server Rewrites the URL of a registered MCP server, or its Name and Description. Use Clear Fields to blank an entry.
- Update an Organization Edits API URL, Proxy URL and Realtime URL of the data plane, plus Is Universal API and Is Dataplane Private. Use Image Rendering Mode to control how images load in the UI.
- Update Organization Members Invites people with Invite Users and removes others with Remove Users in one call. Added Users and any Send Email Error are reported.
How to integrate Braintrust in automation workflow?
Braintrust in three steps: start with "Watch Alerts", connect one credential, then add your next step.
STEP 1
Select Braintrust in workflow
Add the "Watch Alerts" trigger from Braintrust to the canvas[4].
STEP 2
Connect Braintrust
Fill in the Braintrust credential once. All 148 Braintrust modules use it[3].
STEP 3
Build a workflow
Add "Fetch Dataset Records" or "Fetch Experiment Events" after it, then connect any app[5] or the HTTP node.
How Braintrust connects and integrates with WEXTL
Save and approve your credentials once. WEXTL® stores authorization information encrypted and reuses the authentication whenever Braintrust app is called in workflows. That allows your ai automations to run without your attention, per defined schedule[7]. See the integration guide[6] for a detailed list of fields that Braintrust supports.
Full Braintrust API documentationThe following table illustrates what fields Braintrust integration require during authorization flow inside our workflow builder[4].
Connect Braintrust
API Key*Text
••••••••
Region*Text
••••••••
| Field | Type | Help |
|---|---|---|
API KeyRequired | password | In Braintrust open Settings, then API keys, create a key and paste it here. Every request with this key can reach what its owner can reach. |
RegionRequired | select | Pick the region of your organization. Self-hosted data planes are not supported. |
Connect Braintrust to popular apps on WEXTL
Enter a name of the other app you want to sync with Braintrust below. Click on selected app to explore integration options with Braintrust. If the app you search for is not available in WEXTL yet, you can use HTTP node[10] instead to integrate it directly.
Example automation with Braintrust integration
Select Watch New Projects trigger from Braintrust - this will be a starting point in your automation. Whenever event happens in Braintrust, workflow will start[7] from Watch New Projects node.
Search for Add a Feedback Entry to Project Logs, connect it as the next step of integration sequence. You can use filters between Watch New Projects and Add a Feedback Entry to Project Logs, so only important data pass from Watch New Projects to the next step. WEXTL gives you full control over the process of Braintrust automation. All parts of workflow are visible on the canvas[4].
Braintrust on WEXTL has 149 modules for combining ai automations. Explore Braintrust documentation for more.
- BraintrustWatch New Projects
- LangfusePerforms action
OR
- LangfuseTriggers
- BraintrustAdd a Feedback Entry to Project Logs
Frequently asked questions
Common questions about automating Braintrust in your workflows.
What triggers does Braintrust support?
Braintrust has 5 triggers, including "Watch Alerts", "Watch New Datasets", and "Watch New Experiments", and more. Triggers are start points of the workflow, and automations may start from them.
What actions can I run in Braintrust?
Integration has 144 actions, including "Fetch Dataset Records", "Fetch Experiment Events", and "Fetch Log Events", and more. Refer to our Braintrust Documentation for detailed inputs and outputs.
Do I need to write code to build automations?
No. The 148 Braintrust modules, like "Fetch Dataset Records", are forms on the canvas: pick a field, map data from an earlier step. Code is optional[4].
Is the integration secure?
Yes. You fill in the Braintrust credential once. WEXTL encrypts it at rest, and only your team can use it.
How does WEXTL integrate with Braintrust?
Through the official Braintrust API: 148 modules, plus "Make an API Call" for any endpoint they don't cover[3].
Can I use webhooks with Braintrust?
Yes. "Watch Alerts" is instant: Braintrust pushes each event, so there is no polling delay.
Why use WEXTL platform for Braintrust automation?
WEXTL is an AI-first visual canvas: describe the Braintrust flow in plain words and AI wires the nodes[4].
References
List of sources used to gather information about the Braintrust integration.
- Braintrust integration source code, module specs and credentials implementation.
- Internal Braintrust integration documentation, structured input and output parameters, scopes, and authentication methods.
- Official Braintrust vendor API documentation, used to verify field meanings, authentication flows, and anything our own specs don't fully capture.
- WEXTL® Visual Workflow Builder, anonymized data from our technical support team.
- WEXTL® Apps Library
- WEXTL® Braintrust App Documentation
- WEXTL® Workflow Scheduler
- WEXTL® HTTP node documentation
How we write and maintain Braintrust app documentation
Explore how WEXTL® crafted Braintrust integration page documentation. Used sources, the role of AI, and how the team validates the result.





















