Test Area ConnectWorkbenchPackage Manager Total
Product-Specific Tests
Authenticated Repos Package Manager 3 * 3
Authentication Connect, Workbench 2 2 4
Binary Packages Package Manager 4 4
Chronicle Observability Connect, Workbench 1 * 1 2
Content Deployment Connect 8 8
Data Sources Connect, Workbench 1 * 1 * 2
Email Notifications Connect 1 * 1
Git Ops Workbench 6 6
IDE Launch Workbench 4 4
Ide Extensions Workbench 3 3
Jobs Workbench 2 2
Package Installation Connect, Workbench 2 1 3
Package Repositories Package Manager 5 5
Private Repositories Package Manager 1 * 1
Publish To Connect Workbench 2 2
Runtime Versions Connect, Workbench 3 3 6
Session Capacity Workbench 1 1
Session Capacity K8S Workbench 6 6
Session Idle Workbench 2 2
Session Lifecycle Workbench 1 1
System Checks Connect 1 1
Ui Package Manager 3 3
User Management Connect 3 3
Cross-Cutting Tests
API Error Handling Security 3 3
Auth Policy Security 2 2
Concurrency Performance 3 3 3 9
Cross-Product Integration Cross-Product 1 1 2
Expected Failure Demo Prerequisites 1 1
HTTPS Enforcement Security 2 2 2 6
Health Checks Prerequisites 1 1 1 3
Load Performance 3 3 3 9
Login Load Times Performance 1 1 1 3
Monitoring & Logging Cross-Product 1 * 1 * 1 * 3
Package Install Speed Performance 2 2
Resource Usage Performance 2 2 2 6
SSL/TLS Certificates Cross-Product 3 3 3 9
Secret Storage Config Hygiene 2 2
Server Health Cross-Product 1 1 1 3
User Simulation Performance 3 3 3 9
Version Verification Prerequisites 3 3 3 9
Total Scenarios 535942 154

Host Platforms

Platforms where VIP is supported and verified on every change.

Ubuntu
RHEL 9
RHEL 10
SUSE 15
macOS

Not Yet Covered

The following areas are planned for future VIP releases:

LDAP/SAML/OAuth2 auth flows in CI Requires identity provider setup
Connect scheduled content Planned for future release
Workbench HA/multi-node Planned for future release