Skip to content

Conversation

@ArneBinder
Copy link
Owner

@ArneBinder ArneBinder commented Sep 24, 2025

... in favor of pie-documents (documents, annotations, etc) and pytorch-ie (models, taskmodules, and tokenize_document).

Details and additional changes:

  • update dependencies:
    • pytorch-ie: >=0.33.0
    • pie-datasets: >=0.11.0
    • pie-modules: remove
  • Update dataset revisions in configs to latest versions on the HF hub (these include this: use pie-documents (in dataset scripts) pie-datasets#209). This is important since older versions do not work along with pie-documents.
  • Update the local version of the conll2003 dataset script with the latest version from pie-datasets.
  • Use pytorch_ie.PyTorchIEPipeline instead of pytorch_ie.AutoPipeline in configs.
  • Use generic pie_core.AnnotationPipeline instead of pytorch_ie.Pipeline in main scripts (just type annotations).
  • Annotate the example model implementation (MyTransformerTokenClassificationModel) with @Model.register() instead of @PyTorchIEModel.register(). This is important to get model loading working from now on.
  • Use serialize_document_type from pie_core.utils.hydra (instead of from pytorch_ie.utils.hydra).
  • Replace deprecated AnnotationList with AnnotationLayer.
  • Since pytorch-ie relies now on Python>=3.10 (see switch to 3.10 as min Python version pytorch-ie#500), this also changes the min Python version accordingly.
  • Update pie-core to 0.3.0 (just in the lock file).

requires:

TODO:

Note: I triple-checked that everything is running (slow tests), including drugprot experiments.

@ArneBinder ArneBinder self-assigned this Sep 24, 2025
@ArneBinder ArneBinder changed the title remove pie-modules (in favor of pie-documents) remove pie-modules Sep 24, 2025
@ArneBinder ArneBinder marked this pull request as ready for review September 24, 2025 18:54
@ArneBinder ArneBinder merged commit d7d708f into main Sep 24, 2025
2 checks passed
@ArneBinder ArneBinder deleted the remove-pie-modules branch September 24, 2025 19:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants