Twyman’s law states that any data or figure that looks interesting or different is usually wrong.
Sounds unbelievable, isn’t it?
But, it’s true. I saw this in action recently and wanted to share that story with you.
In June, we ran a test on our homepage and while I was looking at conversion rate by segments, I noticed that users from Windows had a 400% higher signup rate for VWO free trial as compared to users using Mac OS X.
Now, that’s baffling and our team spent a good deal of time trying to understand why was that happening. Someone in marketing hypothesized that perhaps Mac OS X users have a better design aesthetic and our homepage wasn’t appealing to them. Was it true? ...