SoftwareApplication
identifier: 10.5281/zenodo.3954885
name: evidence
description: doc2vec-based assisted close reading with support for abstract concept-based search and context-based search
description: - Provides AI/machine-learning support for close-reading-based research - Intuitive example based search throughout large corpora - browser-based usage / User interface - concept based search using abstract doc2vec representations - context based search using word frequency/TF-IDF represenations - automated processing of user-supplied corpora ## Machine-supported research in humanities While research in the humanities has been able to leverage the digitization of text corpora and the development of computer based text analysis tools to its benefit, the interface current systems provide the user with is incompatible with the proven method of scholarly close reading of texts which is key in many research scenarios pursuing complex research questions. What this boils down to, is the fact that it is often restrictive and difficult, if not impossible, to formulate adequate selection criteria, in particular for more complex or abstract concepts, in the framework of a keyword based search which is the standard entry point to digitized text collections. ## Querying by example - close reading with tailored suggestions `evidence` provides an alternative, intuitive entry point into collections by leveraging the doc2vec framework. Using doc2vec `evidence` learns abstract representations of the theme and content of the elements of the user's corpus. Then, instead of trying to translate the scientific query into keywords, after compiling a set of relevant elements as starting points, i.e. examples of the concept the user is interested in, the user can query the corpus based on these examples of their concept of interest. Specifically, `evidence` retrieves elements with similar abstract representations and presents them to the user, using the users feedback to refine its retrieval. Furthermore, this concept-based query mode is complemented by the ability to perform additional retrieval using `more-like-this` context based retrieval function provided by `elasticsearch`. Together, t…
code repository: https://github.com/ADAH-EviDENce/evidence
author: 0009-0004-6590-629X
author: Person
  given name: Lars
  family name: Buitinck
  name: Lars Buitinck
  affiliation: Organization
    name: KNAW Humanities Cluster
author: https://orcid.org/0009-0003-3688-0126
author: https://orcid.org/0000-0002-5529-5761
author: https://orcid.org/0000-0002-7064-4069
author: 0000-0002-0989-929X
author: https://orcid.org/0000-0002-5821-2060
author: https://orcid.org/0000-0002-5733-4795
author: https://orcid.org/0000-0002-6478-3003
keywords: Text analysis & natural language processing
programming language: CSS
programming language: Dockerfile
programming language: Go
programming language: HTML
programming language: Jupyter Notebook
programming language: Python
programming language: Shell
programming language: TypeScript
license:
  creative work: creativeWork
    name: GPL-3.0

0009-0004-6590-629X
type: Person
given name: Bas
family name: Leenknegt
name: Bas Leenknegt
affiliation: Organization
  name: KNAW Humanities Cluster

https://orcid.org/0009-0003-3688-0126
type: Person
given name: Hayco
family name: de Jong
name: Hayco de Jong
affiliation: Organization
  name: KNAW Humanities Cluster

https://orcid.org/0000-0002-5529-5761
type: Person
given name: Christiaan
family name: Meijer
name: Christiaan Meijer
affiliation: Organization
  name: Netherlands eScience Center

https://orcid.org/0000-0002-7064-4069
type: Person
given name: Jurriaan H.
family name: Spaaks
name: Jurriaan H. Spaaks
affiliation: Organization
  name: Netherlands eScience Center

0000-0002-0989-929X
type: Person
given name: Faruk
family name: Diblen
name: Faruk Diblen
affiliation: Organization
  name: Netherlands eScience Center

https://orcid.org/0000-0002-5821-2060
type: Person
given name: Stefan
family name: Verhoeven
name: Stefan Verhoeven
affiliation: Organization
  name: Netherlands eScience Center

https://orcid.org/0000-0002-5733-4795
type: Person
given name: Meiert Willem
family name: Grootes
name: Meiert Willem Grootes
affiliation: Organization
  name: Netherlands eScience Center

https://orcid.org/0000-0002-6478-3003
type: Person
given name: Willem
family name: van Hage
name: Willem van Hage
affiliation: Organization
  name: Netherlands eScience Center