Get started
Result Assessment Tool (RAT)
The Result Assessment Tool (RAT) is a free, open-source research toolbox for collecting, analyzing, and evaluating search results.
5
mentions
4
contributors
Cite this software
Description
- Identify relevant search queries and use them as the basis for systematic search studies
- Automatically collect search results from multiple search engines such as Google and Bing
- Analyze results automatically, including result overlap, SEO scoring, and readability scoring
- Optionally have search results evaluated by jurors, e.g., for relevance or quality
- Support a wide range of study types, from classification and retrieval effectiveness to stance analysis
What is RAT?
The Result Assessment Tool (RAT) is a free, open-source research toolbox for collecting, analyzing, and evaluating search results. It supports researchers through the full workflow: defining search queries, collecting matching results from various search systems, running automatic analyses, and optionally organizing human evaluations by jurors.
How it works
RAT follows a four-step process:
| Step | Action | Description |
|---|---|---|
| 1 | Define | Identify relevant search queries for your study |
| 2 | Collect | Automatically gather search results from search systems like Google and Bing |
| 3 | Analyze | Run automatic analyses such as result overlap, SEO, and readability scoring |
| 4 | Evaluate | Optionally have results evaluated by jurors for relevance or usability |
Example use cases
RAT has been used in studies such as:
- Analyzing stance in Google and Bing results for the 2024 EU Parliament Election
- Investigating Swedish Google search queries on wind power
- Comparing source distribution and result overlap across web search engines
- Your own study — get started with the Knowledge Base
Resources
Keywords
License
Participating organisations
Reference papers
Mentions
- 1.Author(s): Björn Ekström, Elisa Tattersall WallinPublished in Nordic Journal of Library and Information Studies by Det Kgl. Bibliotek/Royal Danish Library in 2023, page: 34-5010.7146/njlis.v4i1.136246
- 2.Author(s): Nurce Yagci, Sebastian Sünkler, Helena Häußler, Dirk LewandowskiPublished in Proceedings of the Association for Information Science and Technology by Wiley in 2022, page: 346-35710.1002/pra2.758
- 3.Author(s): Sebastian Sünkler, Dirk LewandowskiPublished in Proceedings of the Association for Information Science and Technology by Wiley in 2017, page: 405-41410.1002/pra2.2017.14505401044
Contributors
Contact person
SS
Sebastian Sünkler
Lead Research Software Engineer
Hamburg University of Applied Sciences (HAW Hamburg)
0000-0001-9848-1137
Mail SebastianSS
Sebastian Sünkler
Lead Research Software Engineer
Hamburg University of Applied Sciences (HAW Hamburg)
OK
Oliver Koop
DL
Dirk Lewandowski