Do you have links for these pretrained models? The only one I am aware of is Ope... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		zawerf on July 9, 2018 \| parent \| context \| favorite \| on: NLP's ImageNet Moment: From Shallow to Deep Pre-Tr... Do you have links for these pretrained models? The only one I am aware of is OpenAI's where they fine tuned a Transformer architecture for 1 month on 8 gpus: https://blog.openai.com/language-unsupervised/ https://github.com/openai/finetune-transformer-lm

sebastianruder on July 9, 2018 [–]

You can find ELMo here: https://github.com/allenai/allennlp/blob/master/tutorials/ho...

And ULMFiT here: http://nlp.fast.ai/category/classification.html

cs702 on July 9, 2018 | [–]

For those who don't know, Sebastian Ruder is a coauthor of the ULMFiT paper: https://arxiv.org/abs/1801.06146

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact