​

Working with Assistant Tests

The Assistant Tests section within Quality Assurance provides the tools you need to thoroughly test and refine your AI Assistants before deployment. It’s an essential step in ensuring that your Assistants meet the highest standards of quality, performance, and user experience.

​

Key Features of Assistant Tests

• Create Test Sessions: Initiate new testing sessions for your Assistants, providing a unique name and description for each session.
• Select Assistant: Choose the specific Assistant you want to test from your available Assistants.
• Interactive Chat: Engage in real-time conversations with your Assistant within a dedicated chat interface.
• Detailed Session Information: Access relevant details about the Assistant being tested, including its configuration parameters.
• Prompt, Model, and Parameters Tabs: Navigate through dedicated tabs to inspect and adjust the Assistant’s prompt, model selection, and other parameters during the testing session.
• Iterative Refinement: Use your findings from the testing session to refine your Assistant’s prompt, adjust its model selection, or modify other parameters to optimize its performance and ensure it meets your requirements.

​

Creating an Assistant Test Session

1. Navigate to Assistant Tests: From the Kosmoy Studio home page, click on the “Quality Assurance” menu in the left-hand navigation bar, then select “Assistant Tests”.

2. Add a New Test Session: Click the ”+ ADD” button located in the upper right corner of the Assistant Tests section.

3. Select Assistant: Choose the Assistant you want to test from the dropdown menu.

4. Name and Describe the Test Session: Give your test session a unique name and an optional description.

5. Click “Review”: Review the test session details (selected Assistant, name, and description).

6. Click “Create”: Create the Assistant Test session. You will be automatically redirected to the Assistant Test Page.

​

Assistant Test Cards

The Assistant Tests section displays each created test session as a card. Each card shows:

• Test Session Name: The name you assigned to the test session.
• Description: The description you provided for the test session.
• Assistant Name: The name of the assistant being tested.
• Edit Icon (Pencil): Click this icon to update the test session’s name or description.
• Delete Icon (Trash Bin): Click this icon to remove the test session.

​

Managing Assistant Test Sessions

​

Updating an Assistant Test Session

You can update the name and description of an Assistant Test session.

1. Navigate to Assistant Tests: Go to “Quality Assurance” > “Assistant Tests”.
2. Locate the Assistant Test Card: Find the card for the Assistant Test session you want to update.
3. Click the Edit (Pencil) Icon: This will open the update dialog.
4. Modify Name and/or Description: Update the session’s name and/or description as needed.
5. Click “Save”: Save the changes.

​

Removing an Assistant Test Session

You can remove an Assistant Test session if it’s no longer needed.

1. Navigate to Assistant Tests: Go to “Quality Assurance” > “Assistant Tests”.
2. Locate the Assistant Test Card: Find the card for the Assistant Test session you want to remove.
3. Click the Delete (Trash Bin) Icon: This will trigger a confirmation prompt.
4. Confirm Deletion: Confirm that you want to delete the test session.

Warning: Deleting an Assistant Test session is a permanent action and cannot be undone.

​

Assistant Test Page

The Assistant Test Page provides a dedicated environment for interacting with and evaluating your AI Assistant.

Upon creation of an Assistant Test, you are automatically redirected to the Assistant Test Page.

Key Elements:

• Test Session Name: The name of the current test session, displayed at the top of the page.
• Description: The description of the current test session.
• Assistant Details: Relevant information about the Assistant being tested, such as its configuration parameters.
• Chat Tab: The primary interface for interacting with your Assistant. Engage in real-time conversations to assess its responses and behavior.
• Prompt Tab: Inspect and modify the Assistant’s prompt during the testing session to fine-tune its responses.
• Model Tab: View and adjust the model selection for the Assistant during the testing session.
• Parameters Tab: Review and modify other parameters of the Assistant during the testing session.
• “Back” button: Returns the user to the Assistant Tests collection page.

Using the Assistant Test Page:

The Assistant Test Page allows for iterative refinement of your Assistant. Chat with your Assistant, analyze its responses, and make adjustments to its prompt, model, or other parameters as needed. This iterative process helps you optimize your Assistant’s performance before deployment.