Vanguard A/B Test

Analysis of Vanguard's digital interface A/B test (March–June 2017), evaluating whether a redesigned UI improved process completion rates.

Key Findings

• Completion rate: Control 65.58% → Test 69.29% (+3.71 pp)
• Statistical Significance: The improvement is statistically significant (two-proportion z-test, p < 0.001).
• Business Threshold: Despite the improvement, it does not meet Vanguard's 5 pp cost-effectiveness threshold.
• Error Rate: The error rate increased in the Test group.

Data

To keep this repository lightweight, the raw CSV files are not included. You can access and download the datasets used for this analysis from the original source:

• Vanguard A/B Test Datasets

Project Contents

• notebooks/ — Data cleaning, Exploratory Data Analysis (EDA), KPI calculation, and hypothesis testing.
• tableau/ — Tableau dashboard workbook.
• Presentation: https://canva.link/n5m25a4009bre9c

Project Management

• Task Tracking: Trello Board

Team

Vildan Pirpiroglu · Sandra Fernández Pascual · Elena Garrigues