Benchmarks

887 questions from two public benchmarks, the ones all 44 search modes of the 10 providers answered: 671 from OpenAI’s SimpleQA (short questions with one checkable answer) and 216 from SealQA’s Seal-Hard set (hard questions whose search results conflict or don’t help). From 8 to 13 October 2026, each question was searched once on every provider’s default search, taking its top 10 results within 60 seconds. Z.ai’s GLM-5.3-Flash, at high reasoning effort, answered each question from those results alone, with the same prompt every time, and graded each answer against the benchmark’s reference answer with OpenAI’s SimpleQA grader. Grounder optimized is each question routed as Grounder routes it on 19 October 2026, moving on to the next provider when one fails; that routing was tuned on these same searches. It searches as every account does by default, with licensed sources only: Ozone is searched beside the provider routing picks, only licensed results are kept, and the answer is made and graded from those alone. Grounder optimized, all sources is the same routing over every source: nothing is filtered out as unlicensed, and the answer is made and graded from the results of the provider routing picks. Tokens are the answering model’s input tokens per question, search latency the median time of the search alone, searches the calls made per question, sources the results returned and licensed sources the share of them from publishers who license their content to Ozone.