This repository was archived by the owner on Jul 31, 2023. It is now read-only.
This repository was archived by the owner on Jul 31, 2023. It is now read-only.
No documentation? No support for output multiple TFR files? #73
Description
Is your feature request related to a problem? Please describe.
The whole purpose of TFR is to make hundreds of GB level training data possible by dividing them into little TFR files.. if this is not possible, then why bother just loading a giant training data in memory?
Describe the solution you'd like
I want such feature implemented just like here: https://gist.github.com/swyoon/8185b3dcf08ec728fb22b99016dd533f
Describe alternatives you've considered
I have written my own version
Additional context
no