What is A/B testing in UX and how would you apply it to a Salesforce interface change?

A/B testing (split testing) is a quantitative experiment where two variants of a UI element are shown to different randomly assigned user groups simultaneously to measure which performs better against a defined metric. It requires a sufficient sample size to achieve statistical significance. Applying it in Salesforce:

1. What to test: Action bar button labels ("Log Call" vs "Record Activity"), compact layout field order, home page component arrangement, or different Flow screen designs.
2. Mechanism: Salesforce does not have a native A/B testing tool. Approaches include: using permission sets to show different page layouts/components to different user groups and tracking behaviour via reports, or using CRM Analytics to segment engagement metrics.
3. Metrics: Define a primary metric before running the test (e.g., task completion rate, time to complete a flow, click-through on a Quick Action).
4. Duration: Run tests long enough to account for weekly patterns and achieve statistical significance — typically at minimum 1–2 business cycles. Avoid changing multiple variables simultaneously.