The Client's complex interface was particularly problematic for their growing mobile user base trying to filter through thousands of home designs. Our team implemented an AB test on their main search form, simplifying the mobile search experience while adding quick-filtering options. The new interface maintained all core functionality while dramatically improving usability.
Key achievements:
Their extensive catalog of premium house plans presented a significant conversion challenge on their mobile homepage. We focused on optimizing the search form by adding a prominent "House Plans by Style" tab, introducing clearer conversion-focused language like "Find the Perfect House Plan," and removing unnecessary complexity by eliminating the square footage filter. These strategic homepage adjustments directly addressed key user friction points on mobile devices.
We transformed the homepage search experience while preserving all critical functionality. Our implementation focused specifically on:
Metric | Control | Variation | Lift |
Users | 20,214 | 20,958 | - |
Transactions | 24 | 42 | 75% |
Conversion Rate | 0.12% | 0.20% | 68.8% |
Revenue Lift | - | - | 51.2% |
These results show strong improvement, but let's keep it real. While our test showed a 68.8% conversion lift, long-term performance typically settles at more moderate levels. What matters most is that the new design significantly outperformed the control with 95% confidence. Could we have run the test longer for more precise numbers? Yes, but the clear statistical win and positive user behavior signals made it smarter to move forward and start capturing value.
The winning version was better for 3 reasons:
Ready to unlock similar conversion gains for your mobile experience? Let's analyze your current setup and identify opportunities for data-driven optimization.
Appendix: Detailed Test Parameters and Statistical Analysis
Test Parameters
Test Parameters | Value |
Device targeting | Mobile and tablet only |
Browser targeting | Standard browsers (major versions) |
Page scope | Search and catalog pages |
Traffic allocation | Equal split between variations |
Test duration | 24 days |
Total sample size | 41,172 |
Statistical Analysis
Metric | Value |
Confidence level | 95.75% |
Z-score | 2.03 |
P-value | 0.043 |
Conservative lift estimate | 25% |