The SEO firm posed 5,000 questions to each unit “to see which device was smarter.”
In its discussion of results, the firm makes clear that the test was not a comparison of the full range of virtual assistant capabilities.
Rather it sought to determine which device more often gave a correct answer to a wide range of factual questions.
Percentage of 5,000 questions device attempted to answer
There were some scoring nuances that Stone Temple describes in its own blog post, which I won’t reproduce here.
As one might anticipate, however, Google was able to answer many more questions than Echo/Alexa.