| Test Area | Connect | Workbench | Package Manager | Total |
|---|---|---|---|---|
| Product-Specific Tests | ||||
| Authenticated Repos Package Manager | — | — | 3 * | 3 |
| Authentication Connect, Workbench | 2 | 2 | — | 4 |
| Binary Packages Package Manager | — | — | 4 | 4 |
| Chronicle Observability Connect, Workbench | 1 * | 1 | — | 2 |
| Content Deployment Connect | 8 | — | — | 8 |
| Data Sources Connect, Workbench | 1 * | 1 * | — | 2 |
| Email Notifications Connect | 1 * | — | — | 1 |
| Git Ops Workbench | — | 6 | — | 6 |
| IDE Launch Workbench | — | 4 | — | 4 |
| Ide Extensions Workbench | — | 3 | — | 3 |
| Jobs Workbench | — | 2 | — | 2 |
| Package Installation Connect, Workbench | 2 | 1 | — | 3 |
| Package Repositories Package Manager | — | — | 5 | 5 |
| Private Repositories Package Manager | — | — | 1 * | 1 |
| Publish To Connect Workbench | — | 2 | — | 2 |
| Runtime Versions Connect, Workbench | 3 | 1 | — | 4 |
| Session Capacity Workbench | — | 1 | — | 1 |
| Session Capacity K8S Workbench | — | 6 | — | 6 |
| Session Idle Workbench | — | 2 | — | 2 |
| Session Lifecycle Workbench | — | 1 | — | 1 |
| System Checks Connect | 1 | — | — | 1 |
| Ui Package Manager | — | — | 3 | 3 |
| User Management Connect | 3 | — | — | 3 |
| Version Workbench | — | 1 | — | 1 |
| Cross-Cutting Tests | ||||
| API Error Handling Security | 3 | — | — | 3 |
| Auth Policy Security | 2 | — | — | 2 |
| Concurrency Performance | 3 | 3 | 3 | 9 |
| Cross-Product Integration Cross-Product | 1 | — | 1 | 2 |
| Expected Failure Demo Prerequisites | 1 | 1 | 1 | 3 |
| HTTPS Enforcement Security | 2 | 2 | 2 | 6 |
| Health Checks Prerequisites | 1 | 1 | 1 | 3 |
| Load Performance | 3 | 3 | 3 | 9 |
| Login Load Times Performance | 1 | 1 | 1 | 3 |
| Package Install Speed Performance | — | — | 2 | 2 |
| Resource Usage Performance | 2 | 2 | 2 | 6 |
| SSL/TLS Certificates Cross-Product | 3 | 3 | 3 | 9 |
| Secret Storage Config Hygiene | 2 | — | — | 2 |
| Server Health Cross-Product | 1 | 1 | 1 | 3 |
| User Simulation Performance | 3 | 3 | 3 | 9 |
| Version Verification Prerequisites | 2 | — | 2 | 4 |
| Total Scenarios | 52 | 54 | 41 | 147 |
Host Platforms
Platforms where VIP is supported and verified on every change.
Ubuntu
RHEL 9
RHEL 10
SUSE 15
macOS
Not Yet Covered
The following areas are planned for future VIP releases:
LDAP/SAML/OAuth2 auth flows in CI Requires identity provider setup
Connect scheduled content Planned for future release
Workbench HA/multi-node Planned for future release