Missing tie_word_embeddings in config.json causes incorrect weight tying
#1
by
louis-jan
- opened
This is to fix issue with transformers 4.54+..<5 where it sets tie_word_embeddings=True which is not expected.
awni
changed pull request status to
merged