Skip to docs navigation

Future AGI integration guide

Verified

How to connect Future AGI to WEXTL and use its 145 actions in your workflows. About Future AGI: AI agent evaluation platform for datasets, evals, simulations and annotation queues.

  • 60 searches
  • 85 actions
  • Polling
  • Auth: API key

AI-assisted documentation37 min read

This documentation is compiled from our integration source code, internal specs for Future AGI, its official API documentation and anonymized requests logs we collect from our support team[2].

Open Future AGI on WEXTL →
  • Future AGI
  • WEXTL
  • ChatBotKit
  • Alibaba Cloud (Qwen)
  • Dappier
  • CustomGPT
  • Anthropic's Claude
  • AWS Comprehend
  • Dust
  • DeepL
  • Cody AI
  • AgentX
  • Airtop
  • Amberscript
  • AWS Transcribe
  • AWS Rekognition
  • Botsonic
  • Apiframe
  • Camb AI
  • AWS Textract
  • AltText AI
  • Bigjpg
  • DeepSeek
  • Braintrust
  • BigML
  • Bolna
  • Cartesia
  • ElevenLabs
  • DocsBot
  • Deepgram
  • Docparser
  • CALL-E
  • API KeypasswordRequired

    In Future AGI open the dashboard, go to Keys, and copy the API key.[1]

  • Secret KeypasswordRequired

    The secret key that belongs to the API key. It is shown next to it in Keys.[1]

  1. Log in to your WEXTL account, add the Future AGI node module to your workflow, and click Create new credential.
  2. Optional: In the Credential name field, enter a name for the credential.
  3. Enter the authentication credentials you copied from your Future AGI account, or follow the on-screen instructions to create the credential.
  4. If prompted, authenticate your account and confirm access.
  5. If you want to make changes to your credential in the future, follow the steps in Manage credentials →

Check the Health

SearchQuick availability check of the API.
Output fields[3]
FieldType
Statusboolean
Resulttext

Compare Eval Summaries

SearchSide-by-side eval results for chosen executions.
Input fields[3]
FieldType
Run TestRequired
choice
Execution IDsRequired
text
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

Export an Annotation Queue

SearchAnnotated data pulled out of a queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Export Formatchoice
Statustext
Output fields[3]
FieldType
Statusboolean
Resultarray

Fetch an Assistant from a Provider

ActionImports an assistant configuration from a provider.
Input fields[3]
FieldType
Assistant IDRequired
text
API KeyRequired
secret
Agent Definitionchoice
Providerchoice
Output fields[3]
FieldType
Nametext
Assistant IDtext
Prompttext
Providertext
Commit Messagetext

Find Queues for a Source

SearchQueues a record already sits in.
Input fields[3]
FieldType
LimitRequired
number
Source Typechoice
Source IDtext
Sourcestext
Project IDtext
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

Get a Custom Eval Config

SearchOne tracing eval setup.
Input fields[3]
FieldType
Eval ConfigRequired
choice
Output fields[3]
FieldType
IDtext
Eval Templatetext
Nametext
Configtext
Mappingtext
Projecttext
Filterstext
Error Localizerboolean

3other output fields

Get a Dataset Annotation Summary

SearchAnnotation counts by label and annotator for a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
Labelsarray
Annotatorsarray
Headerobject
Dataset Coveragenumber
Completion Etanumber
Overall Agreementnumber

Get a Dataset Column Config

SearchConfiguration behind a dataset column.
Input fields[3]
FieldType
Column IDRequired
text
Output fields[3]
FieldType
Nametext
Templatetext
Template Configtext
Descriptiontext
Configtext
Statustext
Prompt Configtext
Modeltext

18other output fields

Get a Dataset Explanation Summary

SearchAuto-written summary text for one dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
Responsetext
Last Updateddate
Statustext
Row Countnumber
Min Rows Requirednumber

Get a Performance Summary

SearchHeadline performance of a simulation.
Input fields[3]
FieldType
Test Execution IDRequired
text
Output fields[3]
FieldType
Test Run Performance Metricstext
Top Performing Scenariosarray

Get a Run Prompt Column Config

SearchSetup of a prompt-driven column.
Output fields[3]
FieldType
Configtext

Get a Scenario

SearchSource, type and dataset of one scenario.
Input fields[3]
FieldType
ScenarioRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Sourcetext
Scenario Typetext
Dataset IDtext
Organizationtext
Datasettext

10other output fields

Get a Version Eval Summary

SearchEval results for an agent version.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
Agent VersionRequired
choice
Output fields[3]
FieldType
Statusboolean
Resultarray
Nametext
IDtext
Total Cellsnumber
Outputtext

Get an Agent Definition

SearchOne agent and its basic setup.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
Output fields[3]
FieldType
IDtext
Agent Nametext
Agent Typetext
Contact Numbertext
Inboundboolean
Target Speaks Firstboolean
Descriptiontext
Assistant IDtext

27other output fields

Get an Agent Version

SearchA single revision from the history of an agent.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
Agent VersionRequired
choice
Output fields[3]
FieldType
IDtext
Version Numbernumber
Version Nametext
Version Name Displaytext
Statustext
Status Displaytext
Scoretext
Test Countnumber

13other output fields

Get an Annotation Item Detail

SearchFull view of one queue item for annotators.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
Annotator IDtext
Include Completedboolean
View Modetext
Review Statustext
Exclude Review Statustext
Include All Annotationsboolean

1other input field

Output fields[3]
FieldType
Itemtext
Queuetext
Labelsarray
Annotationsarray
Review Commentsarray
Review Threadsarray
Existing Notestext
Span Notesarray

4other output fields

Get an Annotation Label

SearchConfiguration options of one annotation label.
Input fields[3]
FieldType
Annotation LabelRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Typetext
Organizationtext
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean

4other output fields

Get an Annotation Queue

SearchInstructions and strategy of a single queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Assignment Strategytext
Annotations Requirednumber
Reservation Timeout Minutesnumber

22other output fields

Get an Eval Structure

SearchLayout of one dataset eval.
Input fields[3]
FieldType
DatasetRequired
choice
Dataset EvalRequired
choice
Eval TypeRequired
choice
Output fields[3]
FieldType
Evalobject
IDtext
Template IDtext
Nametext
Descriptiontext
Eval Tagsarray
Template Nametext
Required Keysarray
Optional Keysarray
Variable Keysarray
Run Prompt Columnboolean

Get an Eval Summary

SearchEval outcomes for a run test.
Input fields[3]
FieldType
Run TestRequired
choice
Execution IDtext
Output fields[3]
FieldType
Statusboolean
Resultarray
Nametext
IDtext
Total Cellsnumber
Outputtext

Get an Eval Task

SearchOne tracing eval job.
Input fields[3]
FieldType
Eval TaskRequired
choice
Output fields[3]
FieldType
IDtext
Projecttext
Nametext
Filtersobject
Project IDtext
Date Rangearray
Date Presettext
Created Attext
Session IDarray
Trace IDarray
Span IDarray
Observation Typearray
Filtersarray
Span Attributes Filtersarray
Sampling Ratenumber
Last Rundate
Spans Limitnumber
Run Typetext

10other output fields

Get Annotation Queue Analytics

SearchPerformance figures for a queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Output fields[3]
FieldType
Throughputobject
Dailyarray
Total Completednumber
Avg Per Daynumber
Annotator Performancearray
Label Distributiontext
Status Breakdowntext
Totalnumber

Get Annotation Queue Progress

SearchHow far through its items a queue is.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Output fields[3]
FieldType
Totalnumber
Pendingnumber
In Progressnumber
In Reviewnumber
Completednumber
Skippednumber
Progress Pctnumber
Annotator Statsarray

1other output field

Get Call Execution Details

SearchEverything recorded about one call.
Input fields[3]
FieldType
Call Execution IDRequired
text
Output fields[3]
FieldType
IDtext
Service Provider Call IDtext
Session IDtext
Timestampdate
Call Typetext
Statustext
Durationtext
Duration Secondsnumber

58other output fields

Get Dataset Column Details

SearchFull column schema of a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
Columnsarray

Get Dataset Eval Stats

SearchEval scoring figures for a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
Statusboolean
Resultarray
IDtext
Nametext
Output Typetext
Resultarray
Total Pass Ratenumber
Total Avgtext
Total Choices Avgtext
Is Numeric Evalboolean
Is Numeric Eval Percentageboolean

Get Eval Task Aggregations

SearchUsage figures and charts for an eval task.
Input fields[3]
FieldType
Eval TaskRequired
choice
Periodchoice
Dataset Evaltext
Pagenumber
Page Sizenumber
Limitnumber
Eval Aggregationboolean
Span Aggregationboolean

3other input fields

Output fields[3]
FieldType
Eval Task IDtext
Statsobject
Total Runsnumber
Runs Periodnumber
Success Countnumber
Error Countnumber
Pass Ratenumber
Total Runs Is Lower Boundboolean
Runs Period Is Lower Boundboolean
Evalsarray
Chartarray
Logsobject
Countnumber
Nexttext
Previoustext
Resultsarray
Total Pagesnumber
Current Pagenumber
Has Moreboolean
Count Is Lower Boundboolean
Page Limit Reachedboolean
Period Requestedtext
Period Usedtext
Eval Aggregationtext

7other output fields

Get Eval Template Names

SearchNames of eval templates matching a text search.
Input fields[3]
FieldType
Search Texttext
Output fields[3]
FieldType
Statusboolean
Resultarray
IDtext
Nametext
Descriptiontext

Get Model Voices

SearchText-to-speech options for model calls.
Input fields[3]
FieldType
LimitRequired
number
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

Get or Create the Default Queue

ActionDefault queue for a source, made on demand.
Input fields[3]
FieldType
Project IDtext
Datasetchoice
Agent Definitionchoice
Output fields[3]
FieldType
Queueobject
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Is Defaultboolean
Labelsarray
Createdboolean
Actiontext

Get Queue Item Annotations

SearchWhat annotators recorded for a queue item.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
Output fields[3]
FieldType
Statusboolean
Resultarray
IDtext
Source Typetext
Source IDtext
Label IDtext
Label Nametext
Label Typetext
Label Settingstext
Label Allow Notesboolean
Valuetext
Value Historytext

Get Run Prompt Column Values

SearchComputed values of prompt-driven columns.
Input fields[3]
FieldType
DatasetRequired
choice
Column PlaceholdersRequired
text
Output fields[3]
FieldType
Resulttext

Get Run Prompt Options

SearchChoices available for prompt columns.
Output fields[3]
FieldType
Modelsarray
Tool Configtext
Available Toolsarray
Output Formatsarray
Tool Choicesarray

Get Run Prompt Stats

SearchCost and speed of dataset prompts.
Input fields[3]
FieldType
DatasetRequired
choice
Output fields[3]
FieldType
Avg Tokensnumber
Avg Costnumber
Avg Timenumber
Promptsarray

Get Run Test Details

SearchSetup of one simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Agent Definitiontext
Agent Versiontext
Agent Definition Detailtext
Source Typetext
Source Type Displaytext

19other output fields

Get Scores for a Source

SearchScores a single record has received so far.
Input fields[3]
FieldType
Source TypeRequired
choice
Source IDRequired
text
LimitRequired
number
Project IDtext
Label IDtext
Annotator IDtext
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

Get Simulation Analytics

SearchEval outcomes from SDK simulation runs.
Input fields[3]
FieldType
Run Test Nametext
Execution IDtext
Eval Nametext
Summaryboolean
Output fields[3]
FieldType
Execution IDtext
Run Test Nametext
Statustext
Messagetext
Eval Resultsarray
Eval Averagestext
System Summarytext
Eval Explanation Summarytext

1other output field

Get Simulation Metrics

SearchCall durations from SDK simulation runs.
Input fields[3]
FieldType
Run Test Nametext
Execution IDtext
Call Executiontext
Output fields[3]
FieldType
Call Execution IDtext
Execution IDtext
Statustext
Duration Secondsnumber
Started Atdate
Completed Atdate
Total Callsnumber
Completed Callsnumber

10other output fields

Get Simulation Runs

SearchCalls made in SDK simulation runs.
Input fields[3]
FieldType
Run Test Nametext
Execution IDtext
Call Executiontext
Eval Nametext
Summaryboolean
Output fields[3]
FieldType
Call Execution IDtext
Execution IDtext
Scenario IDtext
Scenario Nametext
Statustext
Started Atdate
Completed Atdate
Duration Secondsnumber

16other output fields

Get Test Execution Details

SearchCalls inside a test execution.
Input fields[3]
FieldType
Test Execution IDRequired
text
LimitRequired
number
Searchtext
Filterstext
Row Groupstext
Group Keystext
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

Get the Inter-Annotator Agreement

SearchAgreement scores between annotators.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Output fields[3]
FieldType
Overall Agreementnumber
Labelstext
Annotator Pairsarray

Get the Next Annotation Queue Item

SearchRecord that is up next for human review.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Excludetext
Beforetext
Review Statustext
Exclude Review Statustext
Include Completedboolean
View Modetext
Include All Annotationsboolean
Output fields[3]
FieldType
Itemtext

Get the Test Execution KPIs

SearchKey figures for one simulation.
Input fields[3]
FieldType
Test Execution IDRequired
text
Output fields[3]
FieldType
Total Callsnumber
Completed Callsnumber
Avg Scorenumber
Avg Responsenumber
Calls Attemptednumber
Connected Callsnumber
Calls Connected Percentagenumber
Scenario Graphstext

21other output fields

Get Version Call Executions

SearchCalls tied to an agent version.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
Agent VersionRequired
choice
LimitRequired
number
Output fields[3]
FieldType
IDtext
Phone Numbertext
Service Provider Call IDtext
Statustext
Started Atdate
Completed Atdate
Duration Secondsnumber
Recording URLtext

36other output fields

List Agent Definitions

SearchAgents available for simulation.
Input fields[3]
FieldType
LimitRequired
number
Searchtext
Agent Typechoice
Agent Definitionchoice
Output fields[3]
FieldType
IDtext
Agent Nametext
Agent Typetext
Contact Numbertext
Inboundboolean
Target Speaks Firstboolean
Descriptiontext
Assistant IDtext

19other output fields

List Agent Versions

SearchRevision history for an agent definition.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
LimitRequired
number
Output fields[3]
FieldType
IDtext
Version Numbernumber
Version Nametext
Version Name Displaytext
Statustext
Status Displaytext
Scoretext
Test Countnumber

6other output fields

List Annotation Labels

SearchLabels defined for annotators.
Input fields[3]
FieldType
LimitRequired
number
Datasettext
Project IDtext
Typechoice
Searchtext
Include Usage Countboolean
Include Archivedboolean
Archivedboolean
Output fields[3]
FieldType
IDtext
Nametext
Typetext
Organizationtext
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean

4other output fields

List Annotation Queue Items

SearchWork items of one queue by source and state.
Input fields[3]
FieldType
Annotation QueueRequired
choice
LimitRequired
number
Statustext
Source Typetext
Assigned Totext
Review Statustext
Orderingchoice
Output fields[3]
FieldType
IDtext
Queuetext
Source Typetext
Source IDtext
Statustext
Workflow Statustext
Workflow Status Labeltext
Prioritynumber

17other output fields

List Annotation Queues

SearchReview queues with status and strategy.
Input fields[3]
FieldType
LimitRequired
number
Statustext
Searchtext
Include Countsboolean
Archivedboolean
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Assignment Strategytext
Annotations Requirednumber
Reservation Timeout Minutesnumber

22other output fields

List Annotation Scores

SearchScores recorded by annotators.
Input fields[3]
FieldType
LimitRequired
number
Source Typechoice
Source IDtext
Annotation Labelchoice
Annotator IDtext
Output fields[3]
FieldType
IDtext
Source Typetext
Source IDtext
Label IDtext
Label Nametext
Label Typetext
Label Settingstext
Label Allow Notesboolean

11other output fields

List Custom Eval Configs

SearchTracing evals set up so far.
Input fields[3]
FieldType
LimitRequired
number
Project IDtext
Eval Task IDtext
Filterstext
Output fields[3]
FieldType
IDtext
Eval Templatetext
Nametext
Configtext
Mappingtext
Projecttext
Filterstext
Error Localizerboolean

3other output fields

List Dataset Evals

SearchScoring checks on a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
LimitRequired
number
Eval Typetext
Search Texttext
Eval Categorieschoice
Eval Tagsarray
Use Casesarray
Experiment IDtext

1other input field

Output fields[3]
FieldType
IDtext
Nametext
Created Atdate
Eval Recommendationsarray
Recommendationobject

List Datasets

SearchDatasets in your organization, searchable.
Input fields[3]
FieldType
LimitRequired
number
Search Texttext
Sorttext
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

List Eval Tasks

SearchSampled evaluation jobs for traces.
Input fields[3]
FieldType
LimitRequired
number
Project IDtext
Nametext
Filterstext
Sort Paramstext
Output fields[3]
FieldType
IDtext
Nametext
Created Atdate

List Personas

SearchSimulated callers with gender and type.
Input fields[3]
FieldType
LimitRequired
number
Output fields[3]
FieldType
IDtext
Persona Typetext
Persona Type Displaytext
Nametext
Descriptiontext
Gendertext
Age Grouptext
Occupationtext

24other output fields

List Run Test Scenarios

SearchScenarios included in one simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
LimitRequired
number
Output fields[3]
FieldType
IDtext
Nametext
Row Countnumber

List Run Tests

SearchSimulation tests in the workspace.
Input fields[3]
FieldType
LimitRequired
number
Searchtext
Simulation Typechoice
Prompt Template IDtext
Summaryboolean
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Agent Definitiontext
Agent Versiontext
Agent Definition Detailtext
Source Typetext
Source Type Displaytext

19other output fields

List Scenarios

SearchSimulation scenarios by source and type.
Input fields[3]
FieldType
LimitRequired
number
Searchtext
Agent Definitionchoice
Agent Typetext
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Sourcetext
Scenario Typetext
Scenario Type Displaytext
Source Typetext
Source Type Displaytext

16other output fields

List Test Executions

SearchPast runs of a simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
LimitRequired
number
Searchtext
Statustext
Output fields[3]
FieldType
IDtext
Statustext
Scenariostext
Start Timetext
Durationnumber
Error Reasontext
Success Ratenumber
Avg Response Timenumber

25other output fields

List TTS Voices

SearchSpeech voices you can choose from.
Input fields[3]
FieldType
LimitRequired
number
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Voice IDtext
Providertext
Modeltext
Voice Typetext
Created Atdate

1other output field

Add a Dataset as New

ActionSpins a copy of a dataset into a fresh one.
Input fields[3]
FieldType
DatasetRequired
choice
NameRequired
text
Columnstext
Output fields[3]
FieldType
Messagetext
Dataset IDtext
Dataset Nametext

Add a Dataset Eval

ActionEval attached to a dataset, optionally run immediately.
Input fields[3]
FieldType
DatasetRequired
choice
NameRequired
text
Template IDRequired
text
ConfigRequired
text
KB IDtext
Error Localizerboolean
Modeltext
Eval Typetext

4other input fields

Output fields[3]
FieldType
Statusboolean
Resulttext

Add a Label to an Annotation Queue

ActionAdds a label that annotators must or may fill.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Annotation LabelRequired
choice
Requiredboolean
Output fields[3]
FieldType
Labelobject
IDtext
Nametext
Typetext
Settingstext
Descriptiontext
Allow Notesboolean
Requiredboolean
Ordernumber
Createdboolean
Reopened Itemsnumber
Queue Statustext

Add a Run Prompt Column

ActionPrompt-driven column for a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
NameRequired
text
Configtext
Output fields[3]
FieldType
Statusboolean
Resulttext

Add a Static Column to a Dataset

ActionOne fixed column added to a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
New Column NameRequired
text
Column TypeRequired
choice
Sourcetext
Output fields[3]
FieldType
Statusboolean
Resulttext

Add AI Rows to a Scenario

ActionAI-generated test rows appended to a scenario.
Input fields[3]
FieldType
ScenarioRequired
choice
Num RowsRequired
number
Descriptiontext
Output fields[3]
FieldType
Messagetext
Scenario IDtext
Dataset IDtext
Num Rowsnumber

Add Columns to a Dataset

ActionExtends a dataset with new column definitions.
Input fields[3]
FieldType
DatasetRequired
choice
New Columns DataRequired
text
Output fields[3]
FieldType
Messagetext
Dataarray

Add Columns to a Scenario

ActionExtends a scenario with extra columns.
Input fields[3]
FieldType
ScenarioRequired
choice
ColumnsRequired
text
Output fields[3]
FieldType
Messagetext
Scenario IDtext
Dataset IDtext
Columnsarray

Add Empty Rows to a Dataset

ActionBlank rows appended to a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Num Rowsnumber
Output fields[3]
FieldType
Statusboolean
Resulttext

Add Eval Configs to a Run Test

ActionEval settings added to a simulation run test.
Input fields[3]
FieldType
Run TestRequired
choice
Evaluations ConfigRequired
text
Output fields[3]
FieldType
Messagetext
Created Eval Configsarray
IDtext
Nametext
Configtext
Mappingtext
Filterstext
Error Localizerboolean
Modeltext
Statustext
Eval Grouptext
Template IDtext
Run Test IDtext
Warningsarray

Add Items to an Annotation Queue

ActionQueues records for human annotation.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Itemstext
Selectiontext
Project IDtext
Output fields[3]
FieldType
Addednumber
Duplicatesnumber
Errorsarray
Queue Statustext
Total Matchingnumber
Total Matching Is Lower Boundboolean
Has Moreboolean
Next Cursortext

1other output field

Add Multiple Static Columns

ActionBatch of fixed-value columns for a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
ColumnsRequired
text
Output fields[3]
FieldType
Statusboolean
Resulttext

Add Rows from a File

ActionRows loaded into a dataset from an uploaded file.
Input fields[3]
FieldType
FileRequired
text
DatasetRequired
choice
Model Typetext
Output fields[3]
FieldType
Statusboolean
Messagetext

Add Rows from an Existing Dataset

ActionRows imported from another dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Source DatasetRequired
choice
Column MappingRequired
text
Output fields[3]
FieldType
Messagetext
Rows Addednumber

Add Rows from HuggingFace

ActionRows imported from a Hugging Face dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Hugging Face Dataset NameRequired
text
Hugging Face Dataset ConfigRequired
text
Hugging Face Dataset SplitRequired
text
Num Rowsnumber
Output fields[3]
FieldType
Messagetext

Assign Queue Items to an Annotator

ActionAssignment changes for items in a queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Item IDsRequired
array
User IDsarray
Actionchoice
Output fields[3]
FieldType
Assignednumber

Bulk Annotate Spans

ActionMass annotation of trace spans.
Input fields[3]
FieldType
RecordsRequired
text
Output fields[3]
FieldType
Messagetext
Annotations Creatednumber
Annotations Updatednumber
Notes Creatednumber
Succeeded Countnumber
Errors Countnumber
Warnings Countnumber
Warningsarray

1other output field

Bulk Create Annotation Scores

ActionSeveral annotation scores for one source.
Input fields[3]
FieldType
Source TypeRequired
choice
Source IDRequired
text
ScoresRequired
text
Notestext
Span Notestext
Span Notes Source IDtext
Queue Item IDtext
Project IDtext
Output fields[3]
FieldType
Scoresarray
Errorsarray

Bulk Delete Eval Tasks

ActionMulti-select removal of tracing eval tasks.
Input fields[3]
FieldType
Eval Task IDsRequired
choice
Output fields[3]
FieldType
Messagetext

Bulk Remove Queue Items

ActionPulls many items out of an annotation queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Item IDsRequired
array
Output fields[3]
FieldType
Removednumber

Cancel a Test Execution

ActionHalts one simulation test execution.
Input fields[3]
FieldType
Test Execution IDRequired
text
Output fields[3]
FieldType
Successboolean
Messagetext
Test Execution IDtext

Check an Eval Config Exists

ActionDuplicate check before creating an eval config.
Input fields[3]
FieldType
Eval TemplateRequired
text
ProjectRequired
text
Nametext
Configtext
Mappingtext
Filterstext
Error Localizerboolean
KB IDtext

1other input field

Output fields[3]
FieldType
IDtext
Eval Templatetext
Nametext
Configtext
Mappingtext
Projecttext
Filterstext
Error Localizerboolean

3other output fields

Clone a Dataset

ActionComplete dataset duplicate with its own ID.
Input fields[3]
FieldType
DatasetRequired
choice
New Dataset Nametext
Output fields[3]
FieldType
Messagetext
Dataset IDtext
Dataset Nametext

Complete an Annotation Queue Item

ActionFinishes one queue item and fetches the next.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
Excludearray
Exclude Review Statustext
Include Completedboolean
Output fields[3]
FieldType
Completed Item IDtext
Skipped Item IDtext
Next Itemtext

Create a Custom Eval Config

ActionTracing eval built from a template.
Input fields[3]
FieldType
Eval TemplateRequired
text
ProjectRequired
text
NameRequired
text
Configtext
Mappingtext
Filterstext
Error Localizerboolean
KB IDtext

1other input field

Output fields[3]
FieldType
IDtext
Eval Templatetext
Nametext
Configtext
Mappingtext
Projecttext
Filterstext
Error Localizerboolean

3other output fields

Create a Custom Eval Template

ActionReusable evaluation definition with required keys.
Input fields[3]
FieldType
NameRequired
text
Required KeysRequired
array
Template Typechoice
Descriptiontext
Tagsarray
Criteriatext
Output Typechoice
Configtext

4other input fields

Output fields[3]
FieldType
Eval Template IDtext

Create a Dataset

ActionNew dataset sized to your needs.
Input fields[3]
FieldType
Dataset NameRequired
text
Number Of Rowsnumber
Number Of Columnsnumber
Output fields[3]
FieldType
Messagetext
Dataset IDtext
Rows Creatednumber
Columns Creatednumber

Create a Dataset from HuggingFace

ActionImports a Hugging Face dataset as a new dataset.
Input fields[3]
FieldType
Hugging Face Dataset NameRequired
text
Hugging Face Dataset SplitRequired
text
Nametext
Model Typetext
Num Rowsnumber
Hugging Face Dataset Configtext
Output fields[3]
FieldType
Messagetext
Dataset IDtext
Dataset Nametext
Dataset Model Typetext

Create a Persona

ActionNew simulated caller profile.
Input fields[3]
FieldType
NameRequired
text
DescriptionRequired
text
Genderarray
Age Grouparray
Locationarray
Professionarray
Personalitychoice
Communication Stylechoice

18other input fields

Output fields[3]
FieldType
Nametext
Descriptiontext
Genderarray
Age Grouparray
Locationarray
Professionarray
Personalityarray
Communication Stylearray

18other output fields

Create a Run Test

ActionSimulation test pairing an agent with scenarios.
Input fields[3]
FieldType
NameRequired
text
Agent DefinitionRequired
choice
Scenario IDsRequired
choice
Descriptiontext
Dataset Row IDsarray
Eval Config IDsarray
Evaluations Configtext
Enable Tool Evaluationboolean

2other input fields

Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Agent Definitiontext
Agent Versiontext
Agent Definition Detailtext
Source Typetext
Source Type Displaytext

19other output fields

Create a Scenario

ActionNew simulation scenario, optionally with generated rows.
Input fields[3]
FieldType
NameRequired
text
Descriptiontext
Datasetchoice
Kindchoice
Script URLtext
Agent Definitionchoice
Agent Definition Version IDtext
Custom Instructiontext

21other input fields

Output fields[3]
FieldType
Messagetext
Scenarioobject
IDtext
Nametext
Descriptiontext
Sourcetext
Scenario Typetext
Scenario Type Displaytext
Source Typetext
Source Type Displaytext
Organizationtext
Datasettext
Statustext

Create an Agent Definition

ActionNew agent to run simulations against.
Input fields[3]
FieldType
Agent NameRequired
text
Agent TypeRequired
choice
Commit MessageRequired
text
Inboundboolean
Target Speaks Firstboolean
Descriptiontext
Providerchoice
API Keysecret

18other input fields

Output fields[3]
FieldType
Messagetext
Agentobject
IDtext
Agent Nametext
Agent Typetext
Contact Numbertext
Inboundboolean
Target Speaks Firstboolean
Descriptiontext
Assistant IDtext
Providertext
Languagetext

Create an Agent Version

ActionSaves another revision of an agent definition.
Input fields[3]
FieldType
Agent DefinitionRequired
choice
Agent Nametext
Agent Typechoice
Descriptiontext
Providerchoice
API Keysecret
Assistant IDtext
Authentication Methodchoice

16other input fields

Output fields[3]
FieldType
Messagetext
Versionobject
IDtext
Version Numbernumber
Version Nametext
Version Name Displaytext
Statustext
Status Displaytext
Scoretext
Test Countnumber
Pass Ratetext
Descriptiontext

Create an Annotation Label

ActionNew tag that annotators apply to data.
Input fields[3]
FieldType
NameRequired
text
TypeRequired
choice
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean
Output fields[3]
FieldType
IDtext
Nametext
Typetext
Organizationtext
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean

4other output fields

Create an Annotation Queue

ActionNew work queue for annotators.
Input fields[3]
FieldType
NameRequired
text
Label IDsRequired
choice
Descriptiontext
Instructionstext
Assignment Strategychoice
Annotations Requirednumber
Reservation Timeout Minutesnumber
Requires Reviewboolean

3other input fields

Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Assignment Strategytext
Annotations Requirednumber
Reservation Timeout Minutesnumber

22other output fields

Create an Annotation Score

ActionOne annotated value for a source.
Input fields[3]
FieldType
Source TypeRequired
choice
Source IDRequired
text
Annotation LabelRequired
choice
ValueRequired
text
Notestext
Score Sourcechoice
Queue Item IDtext
Output fields[3]
FieldType
IDtext
Source Typetext
Source IDtext
Label IDtext
Label Nametext
Label Typetext
Label Settingstext
Label Allow Notesboolean

11other output fields

Create an Empty Dataset

ActionBlank dataset ready to be filled.
Input fields[3]
FieldType
New Dataset NameRequired
text
Model Typetext
Is Sdkboolean
Rownumber
Output fields[3]
FieldType
Messagetext
Dataset IDtext
Dataset Nametext
Dataset Model Typetext

Create an Eval Task

ActionSampled evaluation of project traces.
Input fields[3]
FieldType
ProjectRequired
text
NameRequired
text
Sampling RateRequired
number
Run TypeRequired
choice
EvalsRequired
array
Filterstext
Last Runtext
Spans Limitnumber

6other input fields

Output fields[3]
FieldType
IDtext

Delete a Custom Eval Config

ActionRemoves a tracing eval setup.
Input fields[3]
FieldType
Eval ConfigRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete a Dataset Column

ActionDeletes a field from a dataset layout.
Input fields[3]
FieldType
DatasetRequired
choice
ColumnRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete a Dataset Eval

ActionDeletes an eval that scored dataset rows.
Input fields[3]
FieldType
DatasetRequired
choice
Dataset EvalRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete a Persona

ActionDeletes a caller profile used in simulations.
Input fields[3]
FieldType
PersonaRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete a Run Test

ActionDeletes a test that pairs an agent with scenarios.
Input fields[3]
FieldType
Run TestRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete a Scenario

ActionDeletes one scenario used by simulation runs.
Input fields[3]
FieldType
ScenarioRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete Agent Definitions

ActionRemoves a batch of agents and their versions.
Input fields[3]
FieldType
Agent IDsRequired
choice
Output fields[3]
FieldType
Messagetext
Agents Updatednumber
Versions Updatednumber

Delete an Annotation Label

ActionDeletes a label annotators applied to data.
Input fields[3]
FieldType
Annotation LabelRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete an Annotation Queue

ActionDeletes a queue holding annotation work.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete an Annotation Score

ActionDeletes a stored annotation value.
Input fields[3]
FieldType
Annotation Score IDRequired
text
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete an Eval Config

ActionDeletes an eval from a simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
Eval Config IDRequired
text
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete an Eval Task

ActionRemoves a sampled evaluation job.
Input fields[3]
FieldType
Eval TaskRequired
choice
Output fields[3]
FieldType
Deletedboolean
IDtext
Messagetext

Delete Dataset Rows

ActionClears selected or all rows out of a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Row IDsarray
Delete All Rowsboolean
Output fields[3]
FieldType
Statusboolean
Messagetext

Delete Datasets

ActionRemoves a batch of datasets together.
Input fields[3]
FieldType
Dataset IDsRequired
choice
Output fields[3]
FieldType
Statusboolean
Resulttext

Delete Test Executions

ActionClears executions from a run test.
Input fields[3]
FieldType
Run TestRequired
choice
Test Execution IDsarray
Select Allboolean
Output fields[3]
FieldType
Messagetext
Run Test IDtext
Deleted Countnumber
Deleted Idsarray

Duplicate a Dataset

ActionDataset copy, optionally partial.
Input fields[3]
FieldType
DatasetRequired
choice
NameRequired
text
Row IDsarray
Selected All Rowsboolean
Output fields[3]
FieldType
Messagetext
New Dataset IDtext
New Dataset Nametext
Columns Copiednumber
Rows Copiednumber

Duplicate a Persona

ActionPersona clone with its own name.
Input fields[3]
FieldType
PersonaRequired
choice
NameRequired
text
Output fields[3]
FieldType
IDtext
Persona Typetext
Persona Type Displaytext
Nametext
Descriptiontext
Gendertext
Age Grouptext
Occupationtext

27other output fields

Duplicate Dataset Rows

ActionRepeats rows within the same dataset.
Input fields[3]
FieldType
DatasetRequired
choice
Row IDsarray
Selected All Rowsboolean
Num Copiesnumber
Output fields[3]
FieldType
Messagetext
Source Rowsnumber
Copies Per Rownumber
Total New Rowsnumber
New Row Idsarray

Edit a Run Prompt Column

ActionRevises a dataset column that runs a prompt.
Input fields[3]
FieldType
DatasetRequired
choice
ColumnRequired
text
Nametext
Configtext
Output fields[3]
FieldType
Statusboolean
Resulttext

Edit a Scenario

ActionRevises a simulation scenario definition.
Input fields[3]
FieldType
ScenarioRequired
choice
Nametext
Descriptiontext
Graphtext
Prompttext
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Sourcetext
Scenario Typetext
Dataset IDtext
Organizationtext
Datasettext

10other output fields

Edit and Run a Dataset Eval

ActionModifies a dataset eval and reruns it.
Input fields[3]
FieldType
DatasetRequired
choice
Dataset EvalRequired
choice
ConfigRequired
text
Nametext
Template IDtext
KB IDtext
Error Localizerchoice
Modeltext

6other input fields

Output fields[3]
FieldType
Statusboolean
Resulttext

Execute a Run Test

ActionLaunches a simulation run.
Input fields[3]
FieldType
Run TestRequired
choice
Scenario IDschoice
Simulator IDtext
Select Allboolean
Output fields[3]
FieldType
Messagetext
Execution IDtext
Run Test IDtext
Statustext
Total Scenariosnumber
Total Callsnumber
Scenario Idsarray

Export a Queue to a Dataset

ActionAnnotation results saved as dataset rows.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Datasetchoice
Dataset Nametext
Status Filtertext
Column Mappingtext
Output fields[3]
FieldType
Dataset IDtext
Dataset Nametext
Rows Creatednumber
Columnsarray

Make an API Call

universalCustom Future AGI REST API request.
Input fields[3]
FieldType
URLRequired
text
MethodRequired
choice
Headersarray
Headerobject
Query stringarray
Parameterobject
Bodytext
Output fields[3]
FieldType
Bodytext
Headersobject
Keytext
Valuetext
Status codenumber

Merge a Dataset

ActionMoves rows from one dataset to another.
Input fields[3]
FieldType
DatasetRequired
choice
Target DatasetRequired
choice
Row IDsarray
Selected All Rowsboolean
Output fields[3]
FieldType
Messagetext
Rows Addednumber
New Columns Creatednumber
Columns Mappednumber

Pause an Eval Task

ActionTemporarily halts a tracing eval job.
Input fields[3]
FieldType
Eval TaskRequired
choice
Output fields[3]
FieldType
Messagetext

Release an Annotation Queue Item

ActionFrees a reserved queue item.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
Output fields[3]
FieldType
Releasedboolean

Remove a Label from a Queue

ActionUnlinks a label from an annotation queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Annotation LabelRequired
choice
Requiredboolean
Output fields[3]
FieldType
Removedboolean

Rerun Call Executions

ActionRepeats chosen calls of a simulation.
Input fields[3]
FieldType
Test Execution IDRequired
text
Rerun TypeRequired
choice
Call Execution IDsarray
Select Allboolean
Environment Valuestext
Output fields[3]
FieldType
Messagetext
Test Execution IDtext
Rerun Typetext
Total Processednumber
Successful Rerunsarray
Failed Rerunsarray
Call Execution IDtext
Errortext
Success Countnumber
Failure Countnumber

1other output field

Rerun Test Executions

ActionRepeats full executions of a simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
Rerun TypeRequired
choice
Test Execution IDsarray
Select Allboolean
Output fields[3]
FieldType
Messagetext
Run Test IDtext
Rerun Typetext
Total Test Executionsnumber
Resultsarray
Test Execution IDtext
Success Countnumber
Failure Countnumber
Successful Rerunsarray
Failed Rerunsarray
Dispatch Errortext
Skippedboolean
Reasontext
Overall Success Countnumber
Overall Failure Countnumber

Restore an Annotation Label

ActionUn-archives an annotation label.
Input fields[3]
FieldType
Annotation LabelRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Typetext
Organizationtext
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean

4other output fields

Resume an Eval Task

ActionRestarts a paused tracing eval job.
Input fields[3]
FieldType
Eval TaskRequired
choice
Output fields[3]
FieldType
Messagetext

Run New Evals on Executions

ActionApplies fresh evals to earlier runs.
Input fields[3]
FieldType
Run TestRequired
choice
Eval Config IDsRequired
array
Test Execution IDsarray
Select Allboolean
Enable Tool Evaluationboolean
Output fields[3]
FieldType
Messagetext
Run Test IDtext
Call Execution Countnumber
Dispatchedboolean

Skip an Annotation Queue Item

ActionPasses over one queue item.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
Excludearray
Exclude Review Statustext
Include Completedboolean
Output fields[3]
FieldType
Completed Item IDtext
Skipped Item IDtext
Next Itemtext

Start the Evals Process

ActionStarts scoring a dataset with selected evals.
Input fields[3]
FieldType
DatasetRequired
choice
User Eval IDsRequired
array
Experiment IDtext
Failed Onlyboolean
Output fields[3]
FieldType
Statusboolean
Resulttext

Submit Item Annotations

ActionStores annotator answers for one item.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Queue ItemRequired
choice
AnnotationsRequired
text
Notestext
Item Notestext
Output fields[3]
FieldType
Submittednumber

Update a Custom Eval Config

ActionEdits a tracing eval setup.
Input fields[3]
FieldType
Eval ConfigRequired
choice
Eval TemplateRequired
text
ProjectRequired
text
Nametext
Configtext
Mappingtext
Filterstext
Error Localizerchoice

2other input fields

Output fields[3]
FieldType
IDtext
Eval Templatetext
Nametext
Configtext
Mappingtext
Projecttext
Filterstext
Error Localizerboolean

3other output fields

Update a Dataset Cell Value

ActionSets the content of a single dataset cell.
Input fields[3]
FieldType
DatasetRequired
choice
RowRequired
text
ColumnRequired
choice
New Valuetext
Output fields[3]
FieldType
Statusboolean
Resulttext

Update a Dataset Column Name

ActionRelabels one column header in a dataset.
Input fields[3]
FieldType
DatasetRequired
choice
ColumnRequired
choice
New Column NameRequired
text
Output fields[3]
FieldType
Statusboolean
Resulttext

Update a Dataset Column Type

ActionChanges the data type of a column.
Input fields[3]
FieldType
DatasetRequired
choice
ColumnRequired
choice
New Column TypeRequired
choice
Previewboolean
Force Updateboolean
Output fields[3]
FieldType
Messagetext
Column IDtext
New Data Typetext
Statustext
Invalid Countnumber
Invalid Valuesarray
Valid Conversion Samplestext

Update a Persona

ActionEdits a simulated caller profile.
Input fields[3]
FieldType
PersonaRequired
choice
NameRequired
text
Descriptiontext
Gendertext
Age Grouptext
Occupationtext
Locationtext
Personalitychoice

22other input fields

Output fields[3]
FieldType
IDtext
Persona Typetext
Persona Type Displaytext
Nametext
Descriptiontext
Gendertext
Age Grouptext
Occupationtext

27other output fields

Update an Annotation Label

ActionRevises settings of an annotation label.
Input fields[3]
FieldType
Annotation LabelRequired
choice
Nametext
Typechoice
Settingstext
Projecttext
Descriptiontext
Allow Noteschoice
Clear Fieldschoice
Output fields[3]
FieldType
IDtext
Nametext
Typetext
Organizationtext
Settingstext
Projecttext
Descriptiontext
Allow Notesboolean

4other output fields

Update an Annotation Queue

ActionRevises rules and text of a queue.
Input fields[3]
FieldType
Annotation QueueRequired
choice
Nametext
Descriptiontext
Instructionstext
Assignment Strategychoice
Annotations Requirednumber
Reservation Timeout Minutesnumber
Requires Reviewchoice

5other input fields

Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Assignment Strategytext
Annotations Requirednumber
Reservation Timeout Minutesnumber

22other output fields

Update an Annotation Queue Status

ActionMoves a queue between lifecycle states.
Input fields[3]
FieldType
Annotation QueueRequired
choice
StatusRequired
choice
Output fields[3]
FieldType
IDtext
Nametext
Descriptiontext
Instructionstext
Statustext
Assignment Strategytext
Annotations Requirednumber
Reservation Timeout Minutesnumber

22other output fields

Update an Eval Config

ActionEdits an eval of a simulation test.
Input fields[3]
FieldType
Run TestRequired
choice
Eval Config IDRequired
text
Configtext
Mappingtext
Modeltext
Error Localizerchoice
KB IDtext
Template IDtext

4other input fields

Output fields[3]
FieldType
Messagetext
Eval Config IDtext
Run Test IDtext
Test Execution IDtext
Call Execution Countnumber
Notetext

Update an Eval Task

ActionAdjusts a tracing eval job.
Input fields[3]
FieldType
Edit TypeRequired
choice
Eval TaskRequired
choice
Nametext
Filterstext
Sampling Ratenumber
Spans Limitnumber
Run Typechoice
Row Typechoice

2other input fields

Output fields[3]
FieldType
Messagetext
Edit Typetext
Task IDtext

Upload a Dataset from a File

ActionNew dataset made from an uploaded file.
Input fields[3]
FieldType
FileRequired
text
New Dataset Nametext
Model Typetext
Sourcetext
Output fields[3]
FieldType
Statusboolean
Messagetext

Look for Future AGI templates in the WEXTL template library.

Browse templates →
  1. WEXTL® Future AGI Source Code connector implementation.
  2. Our users use cases and automations.
  3. Official API Documentation for Future AGI.
  4. WEXTL® visual workflow builder data.

Last updated: Nov 14, 2026 14:55

How we write our apps documentation

How we compile these docs: sources, the role of AI, and how we verify.