-
Notifications
You must be signed in to change notification settings - Fork 251
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add an XLMRobertaMaskedLM task model #720
Comments
I would love to work on this issue! |
/assign |
Hi @soma2000-lang are you still working on it? if not then I would take this one up ! |
@shivance yes ,I had also opened a pr for it,but had to close it for some reason.Will reopen another one. |
Hey! |
@jayam30 already opened a pr |
Hi @mattdangerw , it's already been 1month+ since this issue has gone stale. Please assign me this issue, I'm already having a crack at it to see how challenging it is. So far the tests pass in local. If you allow, I could open a PR. Thanks ! |
@shivance I am working on it but the tests are failing currently ,working on that. |
In #653 we added a masked language modeling task for RoBERTa. We can make a similar change for the
XLMRoberta
model.XLMRobertaTokenizer
to expect a mask token.XLMRobertaMaskedLMPreprocessor
preprocessor layer and tests.XLMRobertaMaskedLM
task model and tests.keras_nlp/models/__init__.py
to exportXLMRobertaMaskedLM
andXLMRobertaMaskedLMPreprocessor
.The text was updated successfully, but these errors were encountered: