selectra

Repo to pre-train a spanish language model and zero-shot classifier based on the ELECTRA model

For detailed steps to reproduce our models check out the guide.md.

HF models

• https://huggingface.co/Recognai/selectra_small
• https://huggingface.co/Recognai/selectra_medium
• https://huggingface.co/Recognai/zeroshot_selectra_small
• https://huggingface.co/Recognai/zeroshot_selectra_medium