Skip to content

Conversation

@guillaume-be
Copy link

  • Remove debugging print statement
  • Skip truncation of prompt for encoder-decoder models
  • Add right padding logic for encoder-decoder models

Emulator000 and others added 5 commits May 11, 2023 02:54
* Fix 0.12 breaking changes

* Fix Clippy warnings

* Updated changelog
- Skip truncation of prompt for encoder-decoder models
- Add right padding logic for encoder-decoder models
@guillaume-be
Copy link
Author

Hello @Emulator000 ,

This small PR fixes the behaviour you correctly identified in guillaume-be#376. Encoder-decoder models do not need to remove the prompt that was used to generate their sequence (it is otherwise included in decoder language models)

@Emulator000
Copy link
Owner

Looks fine to me, all changes are due to tch updates 🚀

@Emulator000 Emulator000 merged commit 3ba15e5 into Emulator000:master May 14, 2023
@guillaume-be guillaume-be deleted the godel-patch branch May 25, 2023 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants