Frequently Asked Questions
- What is the repository?
- What submissions do we accept?
- Do I need to create an account to download and/or make a submission?
- I see an error logging in
- Why should I submit my data into your repository?
- Why should I submit my tools?
- What is the PID (handle) good for?
- What is the actual depositing/archiving procedure?
- What if I want/need to update the archived data?
- What if I want to withdraw the resources in the future? Can I delete the data?
- We have started our own repository, can we somehow move records submitted to the LRT collection?
- How to cite a submission?
- How safe is my data if I store it with you?
- What license should I pick for my data/tool?
- Where can I find more information about supported licenses?
- Why we strongly prefer real authors to institutions?
- How do I get the most of my searches?
- How do I create a new version of a record?
- How do I update the submitted data?
What is the repository?
It is like a library for linguistic data and tools.
- Search for data and tools and easily download them.
- Deposit the data and be sure it is safely stored, everyone can find it, use it, and correctly cite it (giving you credit)
What submissions do we accept?
We accept any linguistic and/or NLP data and tools: corpora, treebanks, lexica, but also trained language models, parsers, taggers, MT systems, linguistic web services, etc. We do not strictly require you to upload the data itself, although it is always better to do it. Still, you can make a metadata-only record, if required. We also support online license-signing for immediate availability of restricted resources.
When uploading language resources, please try to use one of the recommended formats mentioned in LRT Standards.
Do I need to create an account to download and/or make a submission?
- You can download data and tools with a license that allows free sharing without any obstacles. Just read the license and download. This applies to all data with Creative Commons and tools with open source licenses.
- To download data and tools that require you to sign a license, you need to log in. To make a submission, you also need to log in. However, if you are from the academic world, you probably don't need any new account.
- Just click "Login" and search for your academic institution. To sign in, you can use any account with an Identity Provider that is a member of EduGAIN federation.
- If you don't have an academic account that works with us, let us know. We will make you a local account.
I see an error logging in
Please let us know through our Help Desk, if you have any trouble logging in.
Ocassionally (usually when you are the first one logging in using your home institution) you might see an error stating "The authentication was successful; however, your identity provider did provide neither your email, eppn nor targeted id." This means your home institution did not send us enough data about you to operate our service; the institution is doing so to protect your personal data. We only require an email and we are following Data Protection Code of Conduct, which helps us convince the institution we won't abuse data about you.
If you have an account with multiple providers and you login with different one each time, you might see error stating "Your email is already associated with a different user.". Please try to use the same provider each time, if that is not possible, let us know and we'll change the default one.
Why should I submit my data into your repository?
- It is free and safe.
- We respect your license. We encourage Free Data and believe it benefits not only users, but also the data providers. However we accept also more closed data and we can make users sign a license before downloading your data, if that is what you need.
- The data is visible, giving you maximal credit for your work (google, VLO, DataCite, OLAC, Data Citation Index, arXive).
- The data is easy to cite. We provide ready-to-use one-click citations in BibTex, RIS, and other popular reference formats. All the citations include permanent links created from persistent identifiers (we use handles for PIDs). These PIDs are future-proof.
- For some data, like text corpora or treebanks, we can provide additional services, like full-text or even tree-query search.
Why should I submit my tools?
- See "Why should I submit my data into your repository?". Everything applies to software tools too.
- You can just link your version control system (svn, git), if it is publicly accessible. You can also link your project page, or demo site.
What is the PID (handle) good for?
It is a special permanent URL. It provides a permanent link that will resolve correctly even if in some distant future the data is moved. Thus it should be used as URL in citations.
What is the actual depositing/archiving procedure?
During the submission of digital language resources to the repository, the data undergo a curation process in order to ensure quality and consistency. We assist you in meeting necessary requirements for sustainable resource archiving. Data have to be provided with metadata in standard formats accepted/adopted in the respective communities, persistent identifiers (PIDs) have to be assigned, IPR issues have to be resolved and clear statements with regard to licensing and possible use of the resources are to be made. The depositor is also required to electronically sign a deposition agreement acknowledging the (s)he is the holder of rights to the data and that (s)he has the right to grant the rights contained in this licence. Once the data is indeed deposited in the repository it is assigned a PID for stable reference.
What if I want/need to update the archived data?
Every change to the resources and metadata should be stored as a new version with a new PID. However if the changes are minimal (e.g., typos or clear mistakes) then contact our Help Desk with the submission PID and the changes which should be made. It is up to the reviewer to decide whether these changes should result in a new version or not.
What if I want to withdraw the resources in the future? Can I delete the data?
Yes, in this case contact our Help Desk with the submission PID and the reason. However, we need to keep a reference that the data was in our repository (because a persistent identifier was issued), so the administrative metadata will be retained indicating that the data itself were removed.
We have started our own repository, can we somehow move records submitted to the LRT collection?
We can create a tombstone page for the moved record and we can add a notice to that page saying the resource is now at a new location. The submission is effectively hidden from search, browse and harvesting (oai-pmh), but the PID still resolves. Thus instead of the actual data, we show a link to the item in your repository. Please contact the Help Desk for more details.
I don't want / cannot make the data publicly available or make them available after a specific date. Would you still archive them for me?
In accordance with the advocacy of the research infrastructures and the general development with respect to Open Access, we strongly encourage the data producers to be as open as possible. However, in other circumstances we will archive your data even if they will not be publicly available. Please, contact our Help Desk prior to completing the submission.
How to cite a submissions?
See our policies.
How safe is my data, if I store it with you?
Quite safe, probably much more than in your computer. Our storage plan:
- All the data in the repository have an on-site backup copy.
- There is another off-site copy, so even complete destruction of our building does not destroy your data.
- We check all the copies regularly and should any of them become corrupted we delete it and make a new one.
- We keep at least three copies, one of them off-site, at all times
What license should I pick for my data/tool?
We encourage using a free license. A representative selection of free
licenses as well as CC licenses (more appropriate for data) is
available directly during submission. There is a great OPEN License Selector which can guide you through the selection of appropriate license.
If for some reason you need a different license, Contact Us.
Where can I find more information about supported licenses?
The list of licenses currently supported is here. However, do not hesitate to Contact Us in case you need your specific license. The licenses can be accompanied by various requirements; eg. limiting to logged in users, filling additional details (purpose) etc.
Why do we strongly prefer real authors to institutions?
It is not about contact, it is about citations, credit and trust. That is why we have separate metadata fields for authors and for contact person. Contact to a helpdesk is perfect, not acknowledging the authors of a scholarly work is not. We support the direct citation of data (https://www.force11.org/datacitation). That is why we also give them PIDs, create formatted citations, etc. That is the reason we really want proper authors, so that they get citations and other scientists know whose work they rely on.
How do I get the most of my searches?
In contrast to other search engines this one uses OR as a default operator; see examples below that clarify this. If you are not satisfied with the results of your searches, you might wish to go beyond plain text searches. You may search only in certain fields, use negation, add score (emphasis) to some parts of the query and match more. The search engine is SOLR so use it's syntax if you know it or check it in the documentation.
- PDT wordnet vs PDT AND wordnet
- The default operator is OR; ie. the first example searches for PDT OR WordNet in all text fields.
- dc.title:P?T && -dc.title:WordNet
- Returns all items having P?T in title - ? stands for any character (eg. PDT) - and not having WordNet in the title
- dc.title:"Czech WordNet"
- Use double quotes (") for exact matches and multiword expressions
- author:(Bojar && -Tamchyna) && (dc.language.iso:(ces AND eng) OR language:(czech AND english))
- Search for items by one author and not the other; interesting are only items about both czech and english languages.
New versions/updating submitted data
As you may have read elsewhere in the repository help, we do not allow changes in the data after a submission was published. You need to create a new one by creating a new version.