Braintrust and Langfuse Integration

Demonstration of how apps are integrated in WEXTL workflow builder[4]

Connect Braintrust and Langfuse to automate ai workflows. Trigger events from one app, run actions in the other and use AI to make smart decisions. Integrate apps in 3 simple steps - no code required.

  • 3-day trial
  • Cancel anytime
  • Up to 10 minutes quick set up
  • GDPR
  • Data Encryption
  • 2FA
  • Local Data Region

Learn about Braintrust and Langfuse

Detailed info you need to know about Braintrust and Langfuse integrations in WEXTL. Explore which modules apps support and how you connect them.

  • Braintrust

    • AI
    • 5 triggers
    • 58 searches
    • 86 actions

    AI observability and evaluation platform for logging, experiments and prompts.[5]

  • Langfuse

    • AI
    • 35 searches
    • 28 actions

    Ingest and query LLM traces, manage prompts and datasets, and run Langfuse evaluations and experiments.[6]

How to connect Braintrust to Langfuse

Set up your Braintrust and Langfuse integration in 3 simple steps[2]. No coding required. Up to 10 minutes setup.

How does the integration between Braintrust and Langfuse work in WEXTL?

WEXTL exposes actions and triggers for Braintrust and Langfuse that help you connect apps and automate repetitive tasks[1]. A trigger is an event that happens, and an action is a step that performs when the event has occurred.

Braintrust triggersLangfuse actions

Braintrust modules

  • Add a Feedback Entry to a Dataset Attaches scores, comments, tags and expected values to records that already exist in a dataset. Each item of the JSON array needs the id of its record and can score from 0 to 1.
  • Add a Feedback Entry to an Experiment Writes review feedback onto events of an experiment. Each Feedback item holds the event id plus any of scores, comment, expected, metadata, tags and source.
  • Add a Feedback Entry to Project Logs Records scores, comments or tags against logged events of a project. Send one JSON item per event id.
  • Cancel an Async SQL Query Stops a long-running SQL query that was started in the background, using its Query ID. The Status and ID of the query are returned.
  • Create a Chat Completion Sends Messages to a Model through the Braintrust AI proxy and returns the Choices of the reply. Use Extra Body to add request keys such as temperature or max tokens.
  • Create a Completion Runs a plain text Prompt against a Model through the Braintrust proxy and returns the generated Choices. Use Extra Body to add more request keys.
  • Create a Custom Column Adds a computed column to a dataset, experiment or project view, defined by an Expression under a Name. Use Subtype for child objects and Variant to pick a table variant.
  • Create a Dataset Starts a dataset under a Name inside a Project. Use Description, Tags and Metadata to describe it.
  • Create a Dataset Snapshot Freezes a dataset as it stood at one version, by pairing a Name with the Transaction ID of that version. Add a Description to label the snapshot.
  • Create a Function Saves a tool, scorer or prompt-backed function in a Project. Write Function Data as JSON, and add a Slug to give it a stable identifier.
  • Create a Group Makes a group of people for permission management. List Member Users and Member Groups to seed it, then grant it access through ACLs.
  • Create a Project Starts a project to hold experiments, logs, datasets and prompts. Use Project Group Name to place it in an existing group.
  • Create a Project Automation Sets up a log alert on a Project. Write Config as JSON with the event type, status, a BTQL filter, an interval and a webhook action.
  • Create a Project Group Collects several projects under one Name. Use Description to explain the grouping.
  • Create a Project Score Defines a score that experiments and logs can be graded with, from a Name and a Score Type. Add Categories and Config as JSON to shape the score.
  • Create a Project Tag Defines a tag within a Project for marking logs and experiments. Use Color to tell tags apart and Description to explain when to apply it.
  • Create a Prompt Saves a prompt in a Project under a Name and Slug, with versioning handled by Braintrust. Use Prompt Data for the messages and model settings, and Environment Slugs to attach environments.
  • Create a Role Defines a named role for your organization. Add Member Permissions for what it allows, and Member Roles to inherit rights from other roles.
  • Create a Service Token Issues an automation token for a Service Account in place of a personal key. Use Expires In Seconds to end its life, or leave it empty so it never expires.
  • Create a Span Iframe Embeds an external page beside trace spans, loaded from a URL and titled with a Name. Turn on Post Message to send the span data to that page.
  • Create a Temporary Credential Mints a short-lived proxy key for one Model that lasts the Lifetime in Seconds. Add Logging to have its requests recorded in a Braintrust project.
  • Create a View Saves a table view on a project, dataset or other object, with a View Type and Name. Filters and layout are stored through View Data and Options.
  • Create an ACL Grants access on one Braintrust object to a User or a Group, or through a Role. Set Permission for a single right, and Restrict Object Type to narrow the rule to child objects.
  • Create an AI Secret Stores a provider key such as a model API key under a Name in your organization. Add Type and Metadata to classify it, then read Secret Updated At later to see changes.
  • Create an Env Var Defines an environment variable on a project or other Braintrust object, picking the owner with Object Type and Object. Fill Value to store its content, or Secret Type to store it as a secret.
  • Create an Environment Registers a deployment environment under a Name and a unique Slug, which is a url-friendly identifier within the organization.
  • Create an Experiment Opens an experiment in a Project. Link it to a Dataset and Dataset Version, and set Base Experiment to compare against an earlier run.
  • Create an Ingest Key Issues an ingest key tied to one Project and labelled with a Name.
  • Create an MCP Server Registers an MCP server in a Project, reachable at its URL under a Name. Add a Description to document it.
  • Create Embeddings Converts Input text into vectors with the chosen Model, sent through the Braintrust proxy. Returns the Data, plus token Usage for the call.
  • Delete a Custom Column Removes a computed column. Add Object Type and Object to narrow the lookup, and the Subtype and Variant of the deleted column are returned.
  • Delete a Dataset Deletes a dataset from its project. The Description it had is returned along with its Name.
  • Delete a Dataset Snapshot Removes a saved snapshot of a dataset and returns the Dataset ID and Xact ID it was taken from.
  • Delete a Function Removes a function such as a tool or scorer, returning its ID and Project ID.
  • Delete a Group Deletes a group of users and returns the Organization ID it belonged to.
  • Delete a Project Deletes a project and returns its Description and Organization ID.
  • Delete a Project Automation Removes a log alert automation from its project. The User ID that created it is returned.
  • Delete a Project Group Deletes a named collection of projects. The User ID that created it is returned.
  • Delete a Project Score Removes a score definition from a project, returning its Name and Project ID.
  • Delete a Project Tag Deletes a tag defined in a project and returns the Color it had.
  • Delete a Prompt Removes a saved prompt, returning its ID, Xact ID and Project ID.
  • Delete a Role Deletes a role from your organization. The removed role is returned with its Created timestamp.
  • Delete a Service Token Revokes a service token by deleting it, returning its Preview Name and Service Account ID.
  • Delete a Span Iframe Removes an embedded span iframe from a project. The returned record shows the Deleted At time.
  • Delete a View Deletes a saved table view on an object and returns its View Type and Name.
  • Delete an ACL Deletes one access rule. The removed rule is returned with its Object Type, Object ID and User ID.
  • Delete an ACL by Match Removes whichever access rule matches the Object Type and Object, narrowed with User, Group, Permission or Role.
  • Delete an AI Secret Removes a stored AI provider secret from your organization and returns the record that was deleted.
  • Delete an API Key Deletes a personal API key and returns its Name and Preview Name to confirm which key went.
  • Delete an Env Var Deletes an environment variable and returns its Name, Object Type and Object ID.

Langfuse modules

  • Add an Annotation Queue Item Puts an object into an annotation queue. Use Object type for the kind of object and Object ID for which one.
  • Create a Comment Posts a comment in a Langfuse project. Use Object type and Object ID to tie the comment to an object.
  • Create a Dataset Registers a dataset in Langfuse. Use Description to say what the dataset holds.
  • Create a Dataset Item Stores an item in a named dataset. Use Input for what goes in and Expected output for what should come out.
  • Create a Prompt Saves a prompt in Langfuse. Use Name to title it and Prompt for the prompt text.
  • Create a Score Records a numeric Value under a score Name. Add a Trace ID to link the score to one trace.
  • Create an Annotation Queue Sets up an annotation queue in Langfuse. Use Description to explain what the queue is for.
  • Create an Evaluation Rule Defines an evaluation rule from a Name and a Config object.
  • Create an Evaluator Creates an evaluator in Langfuse with a Name. Use Config to set the evaluator up.
  • Delete a Blob Storage Integration Deletes a blob storage integration from Langfuse for the project.
  • Delete a Dataset Item Removes an item of a dataset from Langfuse.
  • Delete a Dataset Run Deletes one earlier run of a dataset in Langfuse.
  • Delete a Prompt Deletes a prompt. Use Version to remove only that version or Label to remove every version carrying it, and leave both empty to delete all versions.
  • Delete a Score Removes a single score from your Langfuse data.
  • Delete a Trace Deletes one logged trace from Langfuse.
  • Delete an Evaluation Rule Removes an evaluation rule from Langfuse.
  • Delete an Evaluator Deletes an evaluator saved in Langfuse.
  • Delete an LLM Connection Removes the connection to a model provider from Langfuse.
  • Delete Annotation Queue Assignments Removes the assignment of a user from an annotation queue.
  • Get a Blob Storage Integration Fetches one blob storage integration, including its ID, Name, Status and Data.
  • Get a Comment Gets one comment from Langfuse together with its Created at and Data.
  • Get a Dataset Pulls a dataset from Langfuse and shows its Name, Created at and Updated at.
  • Get a Dataset Item Reads an entry of a dataset in Langfuse, showing its Status and Data.
  • Get a Dataset Run Retrieves the Name, Status and Data of one run of a dataset.
  • Get a Prompt Gets a stored prompt from Langfuse, returning its Name and Data.
  • Get a Prompt Version Retrieves a numbered version of a prompt, with its Name and Data.
  • Get a Score Pulls one recorded score from Langfuse and returns its Name and Data.
  • Get a Session Shows a session from Langfuse, including its Created at time.
  • Get a Trace Looks up a trace in Langfuse, including its Name, Created at and Data.
  • Get an Annotation Queue Shows one annotation queue, including its Name and Status.
  • Get an Annotation Queue Item Looks up a single item in an annotation queue and gives you its ID, Name and Status.
  • Get an Evaluation Rule Returns the Name, Status and Data of an evaluation rule saved in Langfuse.
  • Get an Evaluator Fetches an evaluator from Langfuse together with its Updated at time.
  • Get Evaluator Versions Lists the saved versions of an evaluator. Use Limit to shorten the version list.
  • Get Media Looks up a media record and returns its Created at and Data.
  • Get Metrics Runs a metrics query and returns the result. Use Metrics query for the query object described in the Langfuse API docs.
  • Get Projects Lists the projects that Langfuse returns for this credential.
  • Ingest Traces (OpenTelemetry) Sends an OTLP payload of trace data to Langfuse through its OpenTelemetry endpoint.
  • List Annotation Queue Items Returns items in an annotation queue. Use Limit to stop after a set number of items.
  • List Annotation Queues Lists the annotation queues in Langfuse. Set Limit to return only the first results.
  • List Blob Storage Integrations Gets the blob storage integrations in Langfuse. Add Limit to restrict the total returned.
  • List Comments Gathers the comments in Langfuse. Pass Limit to stop at a chosen total.
  • List Dataset Items Browses dataset items. Use Dataset Name to narrow the list to one dataset, and Limit to set a maximum.
  • List Dataset Runs Gives the runs of one dataset. Use Limit to set a maximum number of runs.
  • List Datasets Fetches the datasets in Langfuse. Use Limit to stop early.
  • List Evaluation Rules Collects the evaluation rules saved in Langfuse. Set Limit for a smaller result.
  • List Evaluators Pulls the evaluators in Langfuse. Use Limit to set how many are collected.
  • List Experiment Items Returns the items of one experiment that started on or after From start time. Use To start time to end the window and Limit to bound the total.
  • List Experiments Shows experiments that started on or after From start time. Add To start time to close the window and Limit to keep the list short.
  • List LLM Connections Lists model provider connections in Langfuse, showing each Name and Status.

Explore alternative integrations

There are other apps[9] supported by WEXTL that can be paired with Braintrust and Langfuse integrations. Pick any from the list below if the current combination isn't the one you need.

Automate Braintrust and Langfuse on WEXTL®

Claim your 3-day trial to build Braintrust with Langfuse integration and access every WEXTL® feature.

Cancel anytime.

Frequently asked questions

Common questions about connecting Braintrust and Langfuse.

How do I connect Braintrust and Langfuse?

Connect your Braintrust and Langfuse accounts once, pick a trigger in one app and an action in the other, then map the fields so data flows automatically between them.[3]

What can I automate between Braintrust and Langfuse?

Example: when the "Watch Alerts" trigger in Braintrust fires, WEXTL can "Add an Annotation Queue Item" in Langfuse. Braintrust has 5 triggers (including Watch Alerts, Watch New Datasets, and Watch New Experiments). Langfuse has 63 actions (including Add an Annotation Queue Item, Create a Comment, and Create a Dataset). Add filters and transforms between steps when you need them.[1]

Can Braintrust trigger actions in Langfuse, and Langfuse in Braintrust?

Yes. The integration works in both directions. Use the triggers of each app to start a workflow and the actions of the other app to update it.[2]

Do I need to write code to integrate Braintrust and Langfuse?

No. Braintrust-to-Langfuse automations are built visually on the canvas. You can optionally add custom JavaScript with Functions when you need advanced logic.[4]

Does Braintrust integrate with Langfuse in real time?

Yes. Trigger-based automations start the moment Braintrust (or Langfuse) fires a new event. Webhook-backed apps run within seconds, and polling-only apps re-check on a schedule you control.[7]

How long does it take to set up a Braintrust + Langfuse integration?

A first automation typically takes 5–10 minutes: connect the credential of each app once, drop a trigger + action onto the canvas, map the fields, and turn the workflow on.

Do I need a paid plan to connect Braintrust with Langfuse?

You can build your Braintrust + Langfuse automation on a 3-day trial with every feature unlocked. Cancel anytime.[8]

References

List of sources used to gather information about the Braintrust and Langfuse integration.

  1. Braintrust and Langfuse integration source code, module specs and credentials implementation.
  2. Our Braintrust and Langfuse integration documentation, structured input and output parameters, scopes, and authentication methods.
  3. Official vendor API documentation for Braintrust and Langfuse, used to verify field meanings, authentication flows, and anything our own specs don't fully capture.
  4. WEXTL® visual workflow builder, anonymized data from our technical support team.
  5. Braintrust integration information
  6. Langfuse integration information
  7. WEXTL® Scheduling
  8. WEXTL® Pricing and Trial
  9. WEXTL® Apps Library

How we write our apps documentation

Explore how WEXTL® crafted Braintrust and Langfuse integration page documentation. Used sources, the role of AI, and how the team validates the result.

Explore Braintrust and Langfuse, or get started