AgentX and Braintrust Integration

Demonstration of how apps are integrated in WEXTL workflow builder[4]

Build ai workflows between AgentX and Braintrust on a visual canvas. Set up data fields sync between apps once and let data flow when events come automatically. Integration will work without code and your team will see the workflow inside WEXTL® builder.

  • 3-day trial
  • Cancel anytime
  • Up to 10 minutes quick set up
  • GDPR
  • Data Encryption
  • 2FA
  • Local Data Region

Learn about AgentX and Braintrust

Detailed info you need to know about AgentX and Braintrust integrations in WEXTL. Explore which modules apps support and how you connect them.

  • AgentX

    • AI
    • 7 searches
    • 12 actions

    Hosted AI agents for starting conversations, sending messages and reading traces.[5]

  • Braintrust

    • AI
    • 5 triggers
    • 58 searches
    • 86 actions

    AI observability and evaluation platform for logging, experiments and prompts.[6]

How to connect AgentX to Braintrust

Set up your AgentX and Braintrust integration in 3 simple steps[2]. No coding required. Up to 10 minutes setup.

How does the integration between AgentX and Braintrust work in WEXTL?

WEXTL exposes actions and triggers for AgentX and Braintrust that help you connect apps and automate repetitive tasks[1]. A trigger is an event that happens, and an action is a step that performs when the event has occurred.

Braintrust triggersAgentX actions

Braintrust modules

  • Add a Feedback Entry to a Dataset Attaches scores, comments, tags and expected values to records that already exist in a dataset. Each item of the JSON array needs the id of its record and can score from 0 to 1.
  • Add a Feedback Entry to an Experiment Writes review feedback onto events of an experiment. Each Feedback item holds the event id plus any of scores, comment, expected, metadata, tags and source.
  • Add a Feedback Entry to Project Logs Records scores, comments or tags against logged events of a project. Send one JSON item per event id.
  • Cancel an Async SQL Query Stops a long-running SQL query that was started in the background, using its Query ID. The Status and ID of the query are returned.
  • Create a Chat Completion Sends Messages to a Model through the Braintrust AI proxy and returns the Choices of the reply. Use Extra Body to add request keys such as temperature or max tokens.
  • Create a Completion Runs a plain text Prompt against a Model through the Braintrust proxy and returns the generated Choices. Use Extra Body to add more request keys.
  • Create a Custom Column Adds a computed column to a dataset, experiment or project view, defined by an Expression under a Name. Use Subtype for child objects and Variant to pick a table variant.
  • Create a Dataset Starts a dataset under a Name inside a Project. Use Description, Tags and Metadata to describe it.
  • Create a Dataset Snapshot Freezes a dataset as it stood at one version, by pairing a Name with the Transaction ID of that version. Add a Description to label the snapshot.
  • Create a Function Saves a tool, scorer or prompt-backed function in a Project. Write Function Data as JSON, and add a Slug to give it a stable identifier.
  • Create a Group Makes a group of people for permission management. List Member Users and Member Groups to seed it, then grant it access through ACLs.
  • Create a Project Starts a project to hold experiments, logs, datasets and prompts. Use Project Group Name to place it in an existing group.
  • Create a Project Automation Sets up a log alert on a Project. Write Config as JSON with the event type, status, a BTQL filter, an interval and a webhook action.
  • Create a Project Group Collects several projects under one Name. Use Description to explain the grouping.
  • Create a Project Score Defines a score that experiments and logs can be graded with, from a Name and a Score Type. Add Categories and Config as JSON to shape the score.
  • Create a Project Tag Defines a tag within a Project for marking logs and experiments. Use Color to tell tags apart and Description to explain when to apply it.
  • Create a Prompt Saves a prompt in a Project under a Name and Slug, with versioning handled by Braintrust. Use Prompt Data for the messages and model settings, and Environment Slugs to attach environments.
  • Create a Role Defines a named role for your organization. Add Member Permissions for what it allows, and Member Roles to inherit rights from other roles.
  • Create a Service Token Issues an automation token for a Service Account in place of a personal key. Use Expires In Seconds to end its life, or leave it empty so it never expires.
  • Create a Span Iframe Embeds an external page beside trace spans, loaded from a URL and titled with a Name. Turn on Post Message to send the span data to that page.
  • Create a Temporary Credential Mints a short-lived proxy key for one Model that lasts the Lifetime in Seconds. Add Logging to have its requests recorded in a Braintrust project.
  • Create a View Saves a table view on a project, dataset or other object, with a View Type and Name. Filters and layout are stored through View Data and Options.
  • Create an ACL Grants access on one Braintrust object to a User or a Group, or through a Role. Set Permission for a single right, and Restrict Object Type to narrow the rule to child objects.
  • Create an AI Secret Stores a provider key such as a model API key under a Name in your organization. Add Type and Metadata to classify it, then read Secret Updated At later to see changes.
  • Create an Env Var Defines an environment variable on a project or other Braintrust object, picking the owner with Object Type and Object. Fill Value to store its content, or Secret Type to store it as a secret.
  • Create an Environment Registers a deployment environment under a Name and a unique Slug, which is a url-friendly identifier within the organization.
  • Create an Experiment Opens an experiment in a Project. Link it to a Dataset and Dataset Version, and set Base Experiment to compare against an earlier run.
  • Create an Ingest Key Issues an ingest key tied to one Project and labelled with a Name.
  • Create an MCP Server Registers an MCP server in a Project, reachable at its URL under a Name. Add a Description to document it.
  • Create Embeddings Converts Input text into vectors with the chosen Model, sent through the Braintrust proxy. Returns the Data, plus token Usage for the call.
  • Delete a Custom Column Removes a computed column. Add Object Type and Object to narrow the lookup, and the Subtype and Variant of the deleted column are returned.
  • Delete a Dataset Deletes a dataset from its project. The Description it had is returned along with its Name.
  • Delete a Dataset Snapshot Removes a saved snapshot of a dataset and returns the Dataset ID and Xact ID it was taken from.
  • Delete a Function Removes a function such as a tool or scorer, returning its ID and Project ID.
  • Delete a Group Deletes a group of users and returns the Organization ID it belonged to.
  • Delete a Project Deletes a project and returns its Description and Organization ID.
  • Delete a Project Automation Removes a log alert automation from its project. The User ID that created it is returned.
  • Delete a Project Group Deletes a named collection of projects. The User ID that created it is returned.
  • Delete a Project Score Removes a score definition from a project, returning its Name and Project ID.
  • Delete a Project Tag Deletes a tag defined in a project and returns the Color it had.
  • Delete a Prompt Removes a saved prompt, returning its ID, Xact ID and Project ID.
  • Delete a Role Deletes a role from your organization. The removed role is returned with its Created timestamp.
  • Delete a Service Token Revokes a service token by deleting it, returning its Preview Name and Service Account ID.
  • Delete a Span Iframe Removes an embedded span iframe from a project. The returned record shows the Deleted At time.
  • Delete a View Deletes a saved table view on an object and returns its View Type and Name.
  • Delete an ACL Deletes one access rule. The removed rule is returned with its Object Type, Object ID and User ID.
  • Delete an ACL by Match Removes whichever access rule matches the Object Type and Object, narrowed with User, Group, Permission or Role.
  • Delete an AI Secret Removes a stored AI provider secret from your organization and returns the record that was deleted.
  • Delete an API Key Deletes a personal API key and returns its Name and Preview Name to confirm which key went.
  • Delete an Env Var Deletes an environment variable and returns its Name, Object Type and Object ID.

AgentX modules

  • Create a Conversation Opens a new conversation on one of your AgentX agents. Set Type to Chat, Search or Ecommerce to decide how the agent will handle it.
  • Create Speech Turns Text into spoken audio through the AgentX voice API. Set Language, Gender, Speed or Accent to shape the voice, and turn on Robot for a mechanical tone.
  • Create Speech Stream Synthesizes Text as a streamed audio response from the voice API, so playback can begin before the whole clip exists. Use Language, Gender, Speed or Accent to adjust the voice.
  • Delete a Conversation Context Clears the memory context stored for a conversation held with an agent in AgentX.
  • Get a Conversation Reads one conversation of an agent together with its messages. Create a Conversation or List Conversations gives you the conversation to read.
  • Get a Message Trace Looks up the prompt trace linked to a message by its Message ID. Pass the result to Get a Trace for the full detail.
  • Get a Trace Looks up the detailed prompt trace for a Trace ID, the record of how an agent built its answer. Get a Message Trace finds the ID for a given message.
  • Get an Agent Fetches the details and current configuration of a single agent in your AgentX account.
  • Get Your Profile Reads the profile of the user who owns the API key this credential uses, which shows which AgentX account a credential belongs to.
  • List Agents Finds every agent your API key is allowed to use in AgentX, each coming back as a separate result.
  • List Conversations Collects the conversations held with one agent, ready to read or continue in later steps.
  • Make an API Call Makes an authorized free-form request to the AgentX REST API with your saved credential.
  • Send a Message Posts a Message into an existing conversation and returns the Status and Response of the agent. Use Agent Mode to switch between Chat and Search, and Context to set how much history counts, with 0 meaning as much as possible.
  • Send a Message and Wait Sends a Message and holds until the agent finishes the whole reply, buffered up to 10 MiB or 180 seconds. Use Context to cap how much earlier conversation counts.
  • Send a Message and Wait for JSON Sends a Message, optionally with Attachments or Audio, and waits until the agent completes a JSON reply. Set Context to restrict the history the agent draws on.
  • Send a Message with an Attachment Uploads a File into a conversation for the agent to read. Add a Message to go along with the file, and use Context to control how much earlier chat is considered.
  • Send Speech Recognition Submits an audio Sample (Base64) for transcription under a Call ID and Seq ID. AgentX posts the recognized text to your Callback URL, and you can leave Language empty for auto detection.
  • Update a Conversation Context Seeds a conversation with earlier user and assistant Messages as memory, without triggering a chat turn.
  • Update a Message Vote Sets the Vote on a message, found by its Message ID. Use Agent and Trace ID to tie the vote to the exchange it rates.

Explore alternative integrations

There are other apps[9] supported by WEXTL that can be paired with AgentX and Braintrust integrations. Pick any from the list below if the current combination isn't the one you need.

Automate AgentX and Braintrust on WEXTL®

Claim your 3-day trial to build AgentX with Braintrust integration and access every WEXTL® feature.

Cancel anytime.

Frequently asked questions

Common questions about connecting AgentX and Braintrust.

How do I connect AgentX and Braintrust?

Connect your AgentX and Braintrust accounts once, pick a trigger in one app and an action in the other, then map the fields so data flows automatically between them.[3]

What can I automate between AgentX and Braintrust?

Example: when the "Watch Alerts" trigger in Braintrust fires, WEXTL can "Create a Conversation" in AgentX. AgentX has 19 actions (including Create a Conversation, Create Speech, and Create Speech Stream). Braintrust has 144 actions (including Add a Feedback Entry to a Dataset, Add a Feedback Entry to an Experiment, and Add a Feedback Entry to Project Logs). Add filters and transforms between steps when you need them.[1]

Can AgentX trigger actions in Braintrust, and Braintrust in AgentX?

Yes. The integration works in both directions. Use the triggers of each app to start a workflow and the actions of the other app to update it.[2]

Do I need to write code to integrate AgentX and Braintrust?

No. AgentX-to-Braintrust automations are built visually on the canvas. You can optionally add custom JavaScript with Functions when you need advanced logic.[4]

Does AgentX integrate with Braintrust in real time?

Yes. Trigger-based automations start the moment AgentX (or Braintrust) fires a new event. Webhook-backed apps run within seconds, and polling-only apps re-check on a schedule you control.[7]

How long does it take to set up a AgentX + Braintrust integration?

A first automation typically takes 5–10 minutes: connect the credential of each app once, drop a trigger + action onto the canvas, map the fields, and turn the workflow on.

Do I need a paid plan to connect AgentX with Braintrust?

You can build your AgentX + Braintrust automation on a 3-day trial with every feature unlocked. Cancel anytime.[8]

References

List of sources used to gather information about the AgentX and Braintrust integration.

  1. AgentX and Braintrust integration source code, module specs and credentials implementation.
  2. Our AgentX and Braintrust integration documentation, structured input and output parameters, scopes, and authentication methods.
  3. Official vendor API documentation for AgentX and Braintrust, used to verify field meanings, authentication flows, and anything our own specs don't fully capture.
  4. WEXTL® visual workflow builder, anonymized data from our technical support team.
  5. AgentX integration information
  6. Braintrust integration information
  7. WEXTL® Scheduling
  8. WEXTL® Pricing and Trial
  9. WEXTL® Apps Library

How we write our apps documentation

Explore how WEXTL® crafted AgentX and Braintrust integration page documentation. Used sources, the role of AI, and how the team validates the result.

Explore AgentX and Braintrust, or get started