Ctrl K

Result Assessment Tool (RAT)

The Result Assessment Tool (RAT) is a free, open-source research toolbox for collecting, analyzing, and evaluating search results.

5
mentions
4
contributors

Cite this software

Description

  • Identify relevant search queries and use them as the basis for systematic search studies
  • Automatically collect search results from multiple search engines such as Google and Bing
  • Analyze results automatically, including result overlap, SEO scoring, and readability scoring
  • Optionally have search results evaluated by jurors, e.g., for relevance or quality
  • Support a wide range of study types, from classification and retrieval effectiveness to stance analysis

What is RAT?

The Result Assessment Tool (RAT) is a free, open-source research toolbox for collecting, analyzing, and evaluating search results. It supports researchers through the full workflow: defining search queries, collecting matching results from various search systems, running automatic analyses, and optionally organizing human evaluations by jurors.

How it works

RAT follows a four-step process:

StepActionDescription
1DefineIdentify relevant search queries for your study
2CollectAutomatically gather search results from search systems like Google and Bing
3AnalyzeRun automatic analyses such as result overlap, SEO, and readability scoring
4EvaluateOptionally have results evaluated by jurors for relevance or usability

Example use cases

RAT has been used in studies such as:

  • Analyzing stance in Google and Bing results for the 2024 EU Parliament Election
  • Investigating Swedish Google search queries on wind power
  • Comparing source distribution and result overlap across web search engines
  • Your own study — get started with the Knowledge Base

Resources

RAT Knowledge Base
RAT Web Tool (Login)
RAT on LinkedIn

Logo of Result Assessment Tool (RAT)
Keywords
Programming languages
  • HTML 61%
  • Python 23%
  • CSS 11%
  • JavaScript 5%
License
</>Source code
Packages

Participating organisations

HAW Hamburg

Reference papers

Mentions

Contributors

SS
Sebastian Sünkler
Lead Research Software Engineer
Hamburg University of Applied Sciences (HAW Hamburg)
OK
Oliver Koop
Community Manager
Hamburg University of Applied Sciences (HAW Hamburg)
DL
Dirk Lewandowski
Project Lead
Hamburg University of Applied Sciences (HAW Hamburg)
Sebastian Schultheiß
Research Associate
Hamburg University of Applied Sciences (HAW Hamburg)