심층 연구—AI 연구 기술

SimpleQA is one of the best proxies for detecting hallucination levels of the model. Ninja scores 91.2% accuracy on the SimpleQA benchmark — Ninja's Deep Research has demonstrated exceptional performance in accurately identifying factual information, surpassing leading models in the field. This performance is based on rigorous tests using a vast collection of several thousand questions specifically designed to assess factuality. One of the reasons that our system is outperforming others is due to the vast amount of user feedback we received when we launched the first iteration of Deep Research, which enabled us to fine tune and improve the quality that’s now showcased by SimpleQA benchmark.

GAIA (General AI Assistants) is a groundbreaking benchmark developed by researchers from Meta, HuggingFace, AutoGPT, and GenAI that significantly advances how we evaluate AI systems' research capabilities. Unlike traditional benchmarks that focus on specialized knowledge or increasingly difficult human tasks, GAIA tests fundamental abilities essential for deep research through a set of carefully crafted questions requiring reasoning, multi-modality, web browsing, and tool-use proficiency.

The benchmark is particularly relevant for measuring the accuracy of deep research systems because it evaluates how well AI can navigate real-world information environments, synthesize data from multiple sources, and produce factual, concise answers—core skills for autonomous research tools.

By focusing on questions that require autonomous planning and execution of complex research workflows—rather than specialized domain expertise—GAIA provides a comprehensive assessment framework that aligns perfectly with evaluating the accuracy and reliability of deep research systems in practical, real-world applications. Ninja Deep Research shows comparable accuracy to OpenAI Deep Research, while offering unlimited tasks for only $15/month.