TestRail

User: "Show me the details of test case 2260."

Agent Response: [Agent uses get_case tool]

📋 **Test Case #2260 Details**:

- **Title**: Verify user login with valid credentials
- **Section**: Authentication Tests
- **Priority**: High
- **Type**: Functional
- **Status**: Active

**Preconditions**:
- User account exists in the system
- User has valid username and password

**Steps**:
1. Navigate to the login page
2. Enter valid username
3. Enter valid password
4. Click the Login button

**Expected Result**:
User is successfully authenticated and redirected to the dashboard

This test case validates the core authentication functionality of the application.

User: "Find all high-priority test cases in project 1 that are related to the login feature."

Agent Response: [Agent uses get_cases_by_filter tool]

🔍 **High-Priority Test Cases Found** (5 cases):

1. **TC-101**: Verify login with valid credentials
   - **Priority**: High
   - **Type**: Functional
   - **Status**: Active

2. **TC-102**: Verify login with invalid password
   - **Priority**: High
   - **Type**: Negative
   - **Status**: Active

3. **TC-103**: Verify login session timeout
   - **Priority**: High
   - **Type**: Functional
   - **Status**: Active

4. **TC-104**: Verify password reset functionality
   - **Priority**: High
   - **Type**: Functional
   - **Status**: Active

5. **TC-105**: Verify multi-factor authentication
   - **Priority**: High
   - **Type**: Security
   - **Status**: Active

These test cases cover critical authentication scenarios that should be prioritized in testing cycles.

User: "Create a new test case for verifying the password reset functionality in section 5."

Agent Response: [Agent uses add_case tool]

✔️ **Test Case Created Successfully!**

- **Test Case ID**: #2305
- **Title**: Verify password reset functionality
- **Section**: Authentication Tests (Section 5)
- **Priority**: Medium
- **Type**: Functional
- **Status**: Active

**Created with the following details**:
- **Preconditions**: User has a registered account with verified email
- **Steps**: 
  1. Click "Forgot Password" link on login page
  2. Enter registered email address
  3. Click "Send Reset Link" button
  4. Check email for password reset link
  5. Click the reset link
  6. Enter new password
  7. Confirm new password
  8. Submit the form
- **Expected Result**: Password is successfully reset and user can login with the new password

The test case is now available in TestRail and ready for execution.

User: "Update test case 123 to set its priority to Critical."

Agent Response: [Agent uses update_case tool]

✔️ **Test Case Updated Successfully!**

- **Test Case ID**: #123
- **Updated Field**: Priority
- **New Value**: Critical (Priority ID: 1)
- **Previous Value**: High

The test case priority has been elevated to Critical. This change will be reflected in all test runs and reports.

User: "Show me all test suites available in project 1."

Agent Response: [Agent uses get_suites tool]

📚 **Test Suites in Project 1** (4 suites):

1. **Suite #1**: Authentication & Authorization
   - **Description**: Test cases for login, logout, password management, and user permissions
   - **Test Cases**: 45

2. **Suite #2**: User Profile Management
   - **Description**: Test cases for user profile creation, editing, and deletion
   - **Test Cases**: 32

3. **Suite #3**: Data Validation & Input
   - **Description**: Test cases for form validation and data input scenarios
   - **Test Cases**: 28

4. **Suite #4**: Performance & Load Testing
   - **Description**: Test cases for system performance under various load conditions
   - **Test Cases**: 15

**Total Test Cases**: 120

These suites organize the test cases by functional area for better management and execution planning.

User: "Search for test cases related to 'password authentication and security'."

Agent Response: [Agent uses search_index tool]

🔎 **Search Results for "password authentication and security"** (Top 5 matches):

1. **TC-2260** (Relevance: 95%): Verify user login with valid credentials
   - Covers password-based authentication flow
   - Section: Authentication Tests

2. **TC-2261** (Relevance: 92%): Verify password complexity requirements
   - Tests security policies for password creation
   - Section: Security Tests

3. **TC-2262** (Relevance: 88%): Verify password reset functionality
   - Tests secure password recovery process
   - Section: Authentication Tests

4. **TC-2263** (Relevance: 85%): Verify password encryption in database
   - Validates password security at storage level
   - Section: Security Tests

5. **TC-2264** (Relevance: 82%): Verify account lockout after failed login attempts
   - Tests security mechanism against brute force attacks
   - Section: Security Tests

These test cases cover various aspects of password authentication and security. Would you like details on any specific test case?

{
  "template_id": 1,
  "priority_id": 1,
  "type_id": 6,
  "custom_preconds": "User account exists and is active",
  "custom_steps": "1. Open login page\n2. Enter valid credentials\n3. Click Login button",
  "custom_expected": "User successfully logged in and redirected to dashboard"
}

{
  "template_id": 2,
  "priority_id": 1,
  "type_id": 6,
  "custom_preconds": "User account exists and is active",
  "custom_steps_separated": [
    {"content": "Open login page", "expected": "Login page displays with username and password fields"},
    {"content": "Enter valid username", "expected": "Username field populated correctly"},
    {"content": "Enter valid password", "expected": "Password field shows masked characters"},
    {"content": "Click Login button", "expected": "User authenticated and redirected to dashboard"},
    {"shared_step_id": 5}
  ]
}

{
  "project_id": "1",
  "include_attachments": true,
  "skip_attachment_extensions": [".png", ".jpg", ".gif"]
}

# No suite_id needed
get_cases(project_id="1")
add_case(section_id="5", title="Test case")

# suite_id required
get_cases(project_id="1", suite_id="3")
add_case(section_id="5", title="Test case")  # section must belong to suite 3

{
  "id": 1,
  "name": "Preconditions",
  "system_name": "preconds",
  "type_id": 4,  // Text type
  "label": "Preconditions"
}

{
  "project_id": "1",
  "json_case_arguments": {
    "priority_id": [1, 2],
    "suite_id": 3
  }
}

{
  "project_id": "1",
  "json_case_arguments": "{\"priority_id\": [1, 2], \"suite_id\": 3}"
}

{
  "project_id": "1",
  "json_case_arguments": "{\"priority_id\": [1, 2]}"
}

{
  "project_id": "1",
  "json_case_arguments": "{\"milestone_id\": [5], \"type_id\": [6, 9]}"
}

{
  "project_id": "1",
  "json_case_arguments": "{\"suite_id\": 3, \"created_after\": 1672531200}"
}

{
  "project_id": "1",
  "json_case_arguments": "{\"filter\": \"login\", \"limit\": 50}"
}

[
  {
    "section_id": "5",
    "title": "Verify user login with valid credentials",
    "case_properties": {
      "template_id": 1,
      "priority_id": 1,
      "type_id": 6,
      "custom_preconds": "User account exists and is active",
      "custom_steps": "1. Navigate to login page\n2. Enter valid username\n3. Enter valid password\n4. Click Login button",
      "custom_expected": "User successfully logged in and redirected to dashboard"
    }
  },
  {
    "section_id": "5",
    "title": "Verify user login with invalid password",
    "case_properties": {
      "template_id": 1,
      "priority_id": 1,
      "type_id": 6,
      "custom_preconds": "User account exists",
      "custom_steps": "1. Navigate to login page\n2. Enter valid username\n3. Enter invalid password\n4. Click Login button",
      "custom_expected": "Error message displays: 'Invalid credentials'"
    }
  },
  {
    "section_id": "5",
    "title": "Verify user logout functionality",
    "case_properties": {
      "template_id": 1,
      "priority_id": 2,
      "type_id": 6,
      "custom_preconds": "User is logged in",
      "custom_steps": "1. Click logout button\n2. Confirm logout action",
      "custom_expected": "User logged out and redirected to login page"
    }
  }
]

"Read the test cases from the CSV file, convert them to the required JSON format, and use the add_cases tool to bulk create them in TestRail project 1, section 5."

{
  "case_id": "2260",
  "filepath": "/__temp__/screenshot.png",
  "filename": "login-page-screenshot.png"
}

Problem: "Unable to add new testcase" error

Step 1: Verify section exists
- Use TestRail UI to navigate to section
- Check section_id in URL
- Confirm section belongs to correct project

Step 2: Test with minimal case
- Use add_case with only title and section_id
- Omit all case_properties initially
- If this works, add properties incrementally

Step 3: Validate template and fields
- Check Project Settings → Case Templates
- Verify template_id exists
- Ensure custom field names match (custom_ prefix)
- Verify field types match expected values

Step 4: Check permissions
- Verify write access in Project Settings → Users
- Confirm user can manually create cases in TestRail UI
- Check for project-level restrictions

1. Index test cases only (no attachments): Fast initial indexing
2. Verify search works: Test with sample queries
3. Index attachments separately: Add include_attachments flag
4. Monitor storage usage: Check PgVector database size
5. Schedule re-indexing: Periodic updates for new test cases

{
  "case_id": "123",
  "case_properties": {
    "title": "Updated: Verify user login functionality",
    "priority_id": 1
  }
}

{
  "case_id": "123",
  "case_properties": {
    "custom_steps": "1. Navigate to login page\n2. Enter valid credentials\n3. Click Login\n4. Verify successful login",
    "custom_expected": "User is authenticated and redirected to dashboard with welcome message"
  }
}

{
  "case_id": "123",
  "case_properties": {
    "template_id": 2,
    "custom_steps_separated": [
      {"content": "Open application", "expected": "Application launches successfully"},
      {"content": "Navigate to settings", "expected": "Settings page displays"},
      {"shared_step_id": 10}
    ]
  }
}

{
  "case_id": "123",
  "case_properties": {
    "title": "Comprehensive login test",
    "priority_id": 1,
    "type_id": 6,
    "estimate": "2m 30s",
    "milestone_id": 5,
    "refs": "REQ-101, REQ-102",
    "custom_preconds": "User account active and email verified",
    "custom_automation_type": 1
  }
}

Agent Instruction:
"For each test case ID in the list [123, 124, 125], update the priority_id to 1 (High) using the update_case tool."

Agent Instruction:
"1. Use get_cases_by_filter to find all test cases with priority_id=3 (Low) in project 1
 2. For each test case found, use update_case to set priority_id=2 (Medium)"