Hi @LaurentCardinal. Great questions!
Our advantage over UT.com is:
- You can run 5x the tests for the same budget…or conversely the same number of tests for 1/5th of the budget
- You get analytics to filter responses, so you don’t have to watch all of the recordings to see results.
- It is really easy to test on your own users with Validately. Really hard to do with UT.
- Our panelist do not get graded by you. Which means that they have no incentive to make you feel good. They just respond to what they see, so you get more accurate feedback.
- We don’t force panelists to complete a test. We show you bounces and completes, but only charge you for completes. We think that you can learn as much from bounces as you can completes, so we want to show you both, whereas UT panelists always complete a test because they are being graded by you and they get paid to complete a test.
You are welcome to use mTurk to source panelists on Validately tests. Each Validately test has a share URL that you can put into mTurk. We would record what the user does so you can watch them and also produce funnel reports and qualitative reports. The downside of using mTurk for panelists is that the segmenting data on the tester isn’t validated or as granular as we offer. We source our panel from uSamp. This is uSamp’s business model to provide panels. They manage and validate the targeting criteria of the panelists. But you can use Validately either way.
Finally, yes, we would be happy to have you test it out. Email me steven @ validately. com