Commit 18a6f0e6 authored by Bronger, Torsten's avatar Bronger, Torsten
Browse files

Improve names

parent c47a41c6
......@@ -16,23 +16,23 @@ Architecture
Database
........
At its heart, there is a MongoDB with the following collections:
At its heart, there is a MongoDB “FindRD” with the following collections:
source
findings
This contains metadata of research data publications. The only mandatory
field is the PID. It contains publications from external sources,
i.e. Zenodo, Pangaea, datapub, and all text journals. It is ever growing.
destination
items
This contains metadata of research data publications. The only mandatory
field is the PID. It contains publications from our institutional Dataverse.
It is ever growing.
aliases
This maps PID aliases to their prime PID. In “source” and “destination” are
only prime PIDs in the MongoDB documents.
This maps PID aliases to their prime PID. In “findings” and “items” are only
prime PIDs in the MongoDB documents.
crawling
crawlings
This contains the timestamp of last crawling for each crawler.
......@@ -72,9 +72,9 @@ Other crawlers
These are cron jobs.
Other crawlers are more straightforward. They harvest repositories and add
them to the “source” collection. They store their latest run in the “crawling”
collection *after* the run, to make sure that nothing is lost, while not every
time the whole repository is harvested.
them to the “findings” collection. They store their latest run in the
“crawling” collection *after* the run, to make sure that nothing is lost, while
not every time the whole repository is harvested.
Dataverse crawler
......@@ -82,8 +82,7 @@ Dataverse crawler
This is a cron job.
This crawler is special because it adds records to the “destination”
collection.
This crawler is special because it adds records to the “items” collection.
Steward
......@@ -91,7 +90,7 @@ Steward
This is a cron job.
The steward takes all PIDs from “source” that are not in “destination” and does
The steward takes all PIDs from “findings” that are not in “items” and does
something about it, e.g.:
- adds it to Dataverse
......
Supports Markdown
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment