Fine-Tuning AI Responses: Similarity Threshold and Temperature Settings

Customizing how your AI interacts with users is crucial for providing a helpful and accurate support experience. The Similarity Threshold and Temperature settings in your site's AI configuration play an important role in how the AI generates responses. Here's how to fine-tune these settings.

Accessing AI Settings

Sign into your site's administrative dashboard.

Navigate to Site > Settings > AI.

You will see options to adjust the AI's behavior.

Configuring Similarity Threshold

Similarity threshold: This parameter dictates the degree of resemblance between the user's inquiry and the available articles in your knowledge base that the AI must identify before providing a response. The threshold is a value between 0 and 1; setting it to 0.65 implies that the AI will retrieve and reference knowledge base content that has at least a 65% similarity to the question asked.

A higher threshold ensures that the AI only uses content that is very closely related to the user's question, which can improve the relevance and accuracy of the information provided. Conversely, a lower threshold widens the scope, allowing the AI to draw from a broader range of articles, which can be beneficial when the knowledge base covers a wide array of topics and exact matches might be less frequent.

When you set this threshold, consider the diversity and specificity of your knowledge base content. For a well-populated knowledge base with many closely related articles, a higher threshold may prevent too broad a match, ensuring users receive the most relevant content. If your knowledge base has more general information, a slightly lower threshold could be more effective to ensure the AI provides helpful responses even when an exact match isn't available

Adjusting Temperature

Temperature: This setting controls the AI's creativity. A lower temperature results in more deterministic and less varied responses, while a higher temperature allows the AI to generate more diverse and creative responses.

Setting the temperature to 0.1 typically results in the AI giving very consistent responses, which can be ideal for factual queries where you want to minimize the risk of incorrect information.

Saving Your Settings

Once you've made the necessary adjustments, click the Save button to apply the new configurations.

Conclusion

Adjusting the similarity threshold and temperature settings helps you balance between accuracy and creativity in AI responses, ensuring your AI provides useful support to your users. If you're unsure about the optimal settings, start with recommended values and adjust based on user feedback and the nature of inquiries you receive.