Test Area ConnectWorkbenchPackage Manager Total
Product-Specific Tests
Authentication Connect, Workbench 2 1 3
Content Deployment Connect 8 8
Data Sources Connect, Workbench 1 * 1 * 2
Email Notifications Connect 1 * 1
IDE Launch Workbench 4 4
Package Installation Connect, Workbench 2 1 3
Package Repositories Package Manager 5 5
Private Repositories Package Manager 1 * 1
Runtime Versions Connect 3 3
Session Capacity Workbench 1 1
Session Lifecycle Workbench 1 1
System Checks Connect 1 1
User Management Connect 3 3
Cross-Cutting Tests
API Error Handling Security 3 3
Auth Policy Security 2 2
Concurrency Performance 3 3 3 9
Cross-Product Integration Cross-Product 1 1 2
Expected Failure Demo Prerequisites 1 1
HTTPS Enforcement Security 2 2 2 6
Health Checks Prerequisites 1 1 1 3
Load Performance 3 3 3 9
Login Load Times Performance 1 1 1 3
Monitoring & Logging Cross-Product 1 * 1 * 1 * 3
Package Install Speed Performance 2 2
Resource Usage Performance 2 2 2 6
SSL/TLS Certificates Cross-Product 3 3 3 9
Secret Storage Config Hygiene 2 2
Server Health Cross-Product 1 1 1 3
User Simulation Performance 3 3 3 9
Version Verification Prerequisites 3 3 3 9
Total Scenarios 523332 117

Not Yet Covered

The following areas are planned for future VIP releases:

Chronicle Not yet available in VIP
Flightdeck Not yet available in VIP
LDAP/SAML/OAuth2 auth flows in CI Requires identity provider setup
Connect scheduled content Planned for future release
Workbench HA/multi-node Planned for future release
Package Manager admin UI Planned for future release