How to Create Agents
An Introduction to Creating your Agents
Last updated
An Introduction to Creating your Agents
Last updated
In order to add a new agent in your application, you will first need to be in the administration portal. Locate the 'Agents' tab in your left-hand navigation bar under 'Manage'.
When agents have been created, you'll find a comprehensive list of your previously configured ones along with their corresponding handles displayed here.
For instance, within this application, the agents named Maya and Sidney have been set up. Their respective handles, @Mindset's Product Guru and @Sidney Security Expert, are visible in the list under the 'Agents' tab.
To initiate the creation of a new agent, select the 'add an agent' button. Each agent represents a specific use case and purpose. Often, an agent can be built for a task or role. They can provide answers to any queries, if they have been connected to the right data sources, and execute tasks that align with their role.
After clicking the 'Add an agent' button, you'll gain access to configuring the agent according to your preferences.
Under the 'Settings' tab, you can add the basic details for your agent:
Agent name, Agent handle, and Agent description are used for identification and display to help you and your users recognize the agent. Both handle and description can be visible to users of your application.
Agent purpose is a very important field and has a significant impact on the way your agent will behave, how it will interpret questions, and how it will structure answers.
Agent visibility. Toggling this button on will enable your end-users to see and interact with the agent created, in the front-end of the application. We recommend that all the agent configuration and testing be completed prior to enabling its access to end users.
The personality tab is where your define the agents personality. This will impact the tone of responses and the way the agent will format its responses.
You can select from a number of preconfigured personality and output formatting options, or choose custom and create your own. We advise significant testing if you go with the custom option to ensure that the agent responds in a reliable and consistent manner.
You can also add in the Icebreaker message instructions which will define how an agent first greets the user.
Please note: You can find more information about each of these by either clicking the small question mark icon next to the headings or alternatively clicking here.
The policy section provides guidelines to keep the agent on track and within your defined scope. Unlike other sections, you can apply multiple policy options at the same time, which combine to produce a focused and consistent agent. Many of the options available under the policy heading have additional supporting fields to help define the policy boundaries.
You can include additional policy rules if you want to enhance the policy option available, or can use this field on its own to define a policy behavior from scratch.
One of the pre-configured policy options is 'Feedback Encouragement'. If this option is selected in the agent configuration, it means that any feedback provided by the user will only be relevant within the thread that it is given. This feedback will not train the agent in their long-term responses, nor will it impact any other user's responses, agent responses, or thread responses.
If the 'Feedback Encouragement' policy option is selected for an agent, it will increase the number of times the LLM asks 'how am I doing'.
Under the Policy tab you can also add Additional Information. This equips the agent with essential background or contextual information that influences its interactions with users. This could encompass guidelines on tone, references to external knowledge not contained within its training data, or directives on handling sensitive topics.
Capabilities
Next, you can set up your agent capabilities under the 'capabilities' heading. An agent capability is a specific set of steps that this agent is able to perform for the user. In order to find out more about capability configuration for your agents, please read our 'capabilities' article here.
Tools
In the next step of agent configuration, you'll choose the tools you want the agent to utilize when answering end-users questions, within the 'Tools' tab.
Here, you have the option to decide if you want the agent to utilize the clarification tool, prompt library, and additional accuracy checking.
Please note: The clarification tool, prompt library, and additional accuracy checking are all optional features that can be enabled individually or in combination with one another.
Further details about these functionalities can be found here.
Lastly, you can choose additional response details that the agent will incorporate when answering user inquiries. This includes, including whether to display segments, topics, and speakers to the user.
Please note: You do not have to select all 3 of these features together for the same agent.
Accuracy and relevance are something Mindset is constantly focused on improving. These new controls solve a few important challenges users were facing with getting the right level of detail and relevance in agent responses.
These controls can be found in the 'tools' tab of your agent configuration.
Number of Segments: This setting lets you adjust how many pieces of information (segments) your agent considers when formulating an answer. The default is 5 segments.
For agent use cases where a user just needs a quick, focused response, you can lower this number to 2 or 3 segments. But in other use cases where discovery and in-depth responses are needed, you can increase this number to 7-8 segments, so the agent will use more information and recommend more content.
Just keep in mind that using a lot of segments can make responses longer and potentially increase the response time since the AI has to process more information.
Relevance Threshold: Think of this as a "quality filter" for the segments. It's a score from 0 to 1 that rates how well each segment matches what the user asked.
Setting a higher threshold of 0.8 or 0.9 means your agent will only use the most directly relevant segments in its response. Great for technical responses where you need pinpoint accuracy.
Lowering the threshold to 0.5 or 0.6 allows your agent to bring in segments that are more loosely related, but could provide helpful context or spark creative ideas for more open-ended conversations.
The key is adjusting these two controls in tandem based on the specific agent use case, and then using the different testing tools we provide in the agent administration portal.
For specific, technical or compliance-driven use cases, use less high-relevance segments. For exploratory agent use cases, allow more segments with a lower relevance threshold.
We recommend experimenting to see what levels of detail and relevance work best for your typical use cases. These changes can be adjusted as required.
The 'Inject Source URL' toggle can also be enabled in the agent's configuration. When this toggle is activated, agents will create direct links to external articles after ingesting content from a website.
For segments extracted from web pages, the link will direct to the original URL of the web page from which the content was sourced.
LLM (Beta)
Under the 'LLM (Beta)' tab in the agent configuration, administrators can select the Large Language Model (LLM) that best aligns with the agent’s objectives. The selected model will dictate the agent's responses to user queries.
Large Language Models are AI systems that understand and generate human language, enabling tasks like text generation, question answering, and translation in a specific way.
Currently, you can select from the following LLM options: Mindset Recommended, GPT4o, Gemini 1.5 Pro, Claude 3 Sonnet, or Llama 3.1 405B Chat. Brief descriptions of each LLM can be found below their respective labels in the 'LLM (Beta)' tab.
We advise you to first trial each of these models in the 'Preview' tab to evaluate their performance and ensure satisfaction with the generated response outputs.
Additional information on these Large Language Model options can be found by contacting your Customer Success Representative.
Under the Design tab, the agent's primary color and text color can be configured.
To change the color simply click the 'select color' button and choose your color from the color wheel or from your designated color library.
Knowledge
Under the 'Knowledge' tab, you can select the knowledge banks that the agent can have access to.
Please note: The agent can have access to the information from multiple knowledge banks. More than one knowledge bank can be selected here.
Once the selected knowledge banks have been toggled on and saved, the agent will then be able to utilize all information from those associated banks when answering end-user questions.
Under the Bias tab select Bias Assessment to see a summary of the Agent’s available Banks of Data. This provides information on the key themes and concepts of the bank's content.
The Weighted Concepts tab displays the concepts and the related segments, with the highest weighted concepts at the top and the lowest at the bottom.
Testing
Under the Testing tab, you can run tests and compare agent responses to understand end-users experiences. Further details on the agent testing framework can be found here.
Preview
Under the 'Preview' tab, you can practice trialing out your agent to see how it responds to questions asked. We recommend you take your time testing your agent here prior to sharing it with your end-users, to ensure it is performing correctly.
Access
The Access tab allows you to choose which of your accounts have access to the selected agent.
The agent can either be configured with open access - where all application members are able to view and search published content, including users who are members of any account; or restricted access, where only members of selected accounts are able to view and search published content in the knowledge bank.
To restrict access to your agent to specific accounts, select the 'restricted access' button and click save.
Next, you can select from your list of accounts below, the ones you wish to have access to the selected agent. To do this, toggle on the button next to the account you wish to grant access to the agent, and click save.
You can additionally grant access to all of you accounts in one go by selecting the 'grant access to all' button, or revoke access for all accounts in one go by selecting the 'revoke access for all' button.
In order to find out more about access management, please refer to our article titled 'Agent entitlement and Knowledge banks'.
