Test Area ConnectWorkbenchPackage Manager Total
Product-Specific Tests
Authentication Connect, Workbench 2 1 3
Content Deployment Connect 8 8
Data Sources Connect, Workbench 1 * 1 * 2
Email Notifications Connect 1 * 1
IDE Launch Workbench 4 4
Package Installation Connect, Workbench 2 1 3
Package Repositories Package Manager 4 4
Private Repositories Package Manager 1 * 1
Runtime Versions Connect 3 3
Session Lifecycle Workbench 1 1
User Management Connect 3 3
Cross-Cutting Tests
API Error Handling Security 3 3
Auth Configuration Prerequisites 1 1 1 3
Auth Policy Security 2 2
Concurrency Performance 3 3 3 9
Cross-Product Integration Cross-Product 1 1 2
Expected Failure Demo Prerequisites 1 1
HTTPS Enforcement Security 2 2 2 6
Health Checks Prerequisites 1 1 1 3
Login Load Times Performance 1 1 1 3
Monitoring & Logging Cross-Product 1 * 1 * 1 * 3
Package Install Speed Performance 2 2
Resource Usage Performance 2 2 2 6
SSL/TLS Certificates Cross-Product 3 3 3 9
Secret Storage Security 2 2
Server Health Cross-Product 1 1 1 3
Version Verification Prerequisites 3 3 3 9
Total Scenarios 462726 99

Not Yet Covered

The following areas are planned for future VIP releases:

Chronicle Not yet available in VIP
Flightdeck Not yet available in VIP
LDAP/SAML/OAuth2 auth flows in CI Requires identity provider setup
Connect scheduled content Planned for future release
Workbench HA/multi-node Planned for future release
Package Manager admin UI Planned for future release