Connect Braintrust integrations

Verified

AI observability and evaluation platform for logging, experiments and prompts, connected to WEXTL workflows and AI agents. Your workflows can send Braintrust results straight into the tools that act on them. Start with Watch Alerts, then use Fetch Dataset Records or Fetch Experiment Events to turn the output into a next step.

  • 3-day trial
  • Cancel anytime
  • Up to 10 minutes quick set up
  • GDPR
  • Data Encryption
  • 2FA
  • Local Data Region
  • Braintrust
  • WEXTL
  • Langfuse
  • Reka AI
  • MeetGeek
  • Granola AI
  • Camb AI
  • Parseur
  • Lyzr AI
  • CALL-E
  • AWS Transcribe
  • Tavily
  • Relevance AI
  • Anthropic's Claude
  • Placid
  • Personal AI
  • Rytr
  • Undetectable AI
  • GitLaw
  • MindStudio
  • AWS Textract

Supported triggers and actions for Braintrust integration

Triggers can detect changes in Braintrust and run actions that can create, search or modify data inside Braintrust automatically[3], exactly how you set them.

  • Watch Alerts Starts the workflow the moment Braintrust sends an alert webhook. Each run receives the Organization, Project, Automation and Details of the alert.
  • Watch New Datasets Runs a periodic check for datasets created since the previous check and emits each one separately. Use Project to watch a single project, and Limit to cap how many each check reads.
  • Watch New Experiments Runs on a schedule and emits every experiment created since the previous check. Use Project to watch just one project.
  • Watch New Projects Looks for projects added since the last scheduled check and fires once per project. Use Limit to set how many it reads each time.
  • Watch New Prompts Polls on a schedule for prompts created since the last run, one item each. Fill Project to follow a single project.
  • Fetch Dataset Records Reads records from a dataset in pages, with Page Size to limit each page and Cursor to continue where the last run stopped. Use Version to read an earlier state.
  • Fetch Experiment Events Pulls the events logged in an experiment, one item each. Pass the Cursor of the previous run to get the next page, and lower Page Size for smaller pages.
  • Fetch Log Events Retrieves logged events of a project in pages, each with its ID and Xact ID. Use Version to replay a past state and Cursor to move on.
  • Get a Dataset Returns one dataset with its Name, Description and Project ID.
  • Get a Dataset Snapshot Opens a saved snapshot and shows the Dataset ID it was cut from and the Xact ID of that version.
  • Get a Dataset Summary Summarizes a dataset with the Project Name, Dataset Name and links to the Project URL and Dataset URL. Turn on Summarize Data to add the Data Summary.
  • Get a Function Fetches one function by ID. Use Version to read an earlier state, or Environment to get the version assigned there.
  • Get a Group Shows a permission group, including the Organization ID it sits in.
  • Get a Project Looks up a project by ID and returns its Name, Description and Organization ID.
  • Get a Project Automation Reads a log alert of a project together with its Config.
  • Get a Project Group Fetches one collection of projects, with the User ID that created it.
  • Get a Project Score Retrieves a score definition from a project, showing its Name and Project ID.
  • Get a Project Tag Reads one tag defined in a project, with its Color and Description.
  • Get a Prompt Gets one prompt. Use Version to load an earlier state, or Environment to load the version assigned to that environment.
  • Get a Role Fetches a role with its Description and Member Permissions.

How to integrate Braintrust in automation workflow?

Braintrust in three steps: start with "Watch Alerts", connect one credential, then add your next step.

How Braintrust connects and integrates with WEXTL

Save and approve your credentials once. WEXTL® stores authorization information encrypted and reuses the authentication whenever Braintrust app is called in workflows. That allows your ai automations to run without your attention, per defined schedule[7]. See the integration guide[6] for a detailed list of fields that Braintrust supports.

Full Braintrust API documentation

The following table illustrates what fields Braintrust integration require during authorization flow inside our workflow builder[4].

Connect Braintrust

  • API Key*Text

    ••••••••

  • Region*Text

    ••••••••

Demonstration of Braintrust connection step inside WEXTL Workflow Builder[4].
FieldTypeHelp
API KeyRequired
password

In Braintrust open Settings, then API keys, create a key and paste it here. Every request with this key can reach what its owner can reach.

RegionRequired
select

Pick the region of your organization. Self-hosted data planes are not supported.

Connect Braintrust to popular apps on WEXTL

Enter a name of the other app you want to sync with Braintrust below. Click on selected app to explore integration options with Braintrust. If the app you search for is not available in WEXTL yet, you can use HTTP node[10] instead to integrate it directly.

Example automation with Braintrust integration

Select Watch New Projects trigger from Braintrust - this will be a starting point in your automation. Whenever event happens in Braintrust, workflow will start[7] from Watch New Projects node.

Search for Add a Feedback Entry to Project Logs, connect it as the next step of integration sequence. You can use filters between Watch New Projects and Add a Feedback Entry to Project Logs, so only important data pass from Watch New Projects to the next step. WEXTL gives you full control over the process of Braintrust automation. All parts of workflow are visible on the canvas[4].

Braintrust on WEXTL has 149 modules for combining ai automations. Explore Braintrust documentation for more.

  • BraintrustWatch New Projects
  • LangfusePerforms action

OR

  • LangfuseTriggers
  • BraintrustAdd a Feedback Entry to Project Logs
Demonstration of how visual Braintrust automation[6] looks in WEXTL.

Frequently asked questions

Common questions about automating Braintrust in your workflows.

What triggers does Braintrust support?

Braintrust has 5 triggers, including "Watch Alerts", "Watch New Datasets", and "Watch New Experiments", and more. Triggers are start points of the workflow, and automations may start from them.

What actions can I run in Braintrust?

Integration has 144 actions, including "Fetch Dataset Records", "Fetch Experiment Events", and "Fetch Log Events", and more. Refer to our Braintrust Documentation for detailed inputs and outputs.

Do I need to write code to build automations?

No. The 148 Braintrust modules, like "Fetch Dataset Records", are forms on the canvas: pick a field, map data from an earlier step. Code is optional[4].

Is the integration secure?

Yes. You fill in the Braintrust credential once. WEXTL encrypts it at rest, and only your team can use it.

How does WEXTL integrate with Braintrust?

Through the official Braintrust API: 148 modules, plus "Make an API Call" for any endpoint they don't cover[3].

Can I use webhooks with Braintrust?

Yes. "Watch Alerts" is instant: Braintrust pushes each event, so there is no polling delay.

Why use WEXTL platform for Braintrust automation?

WEXTL is an AI-first visual canvas: describe the Braintrust flow in plain words and AI wires the nodes[4].

Automate Braintrust on WEXTL®

Claim your 3-day trial to build Braintrust integrations and access every WEXTL® feature.

Cancel anytime.

References

List of sources used to gather information about the Braintrust integration.

  1. Braintrust integration source code, module specs and credentials implementation.
  2. Internal Braintrust integration documentation, structured input and output parameters, scopes, and authentication methods.
  3. Official Braintrust vendor API documentation, used to verify field meanings, authentication flows, and anything our own specs don't fully capture.
  4. WEXTL® Visual Workflow Builder, anonymized data from our technical support team.
  5. WEXTL® Apps Library
  6. WEXTL® Braintrust App Documentation
  7. WEXTL® Workflow Scheduler
  8. WEXTL® HTTP node documentation

How we write and maintain Braintrust app documentation

Explore how WEXTL® crafted Braintrust integration page documentation. Used sources, the role of AI, and how the team validates the result.