pdf broken encoding reader

[sinkudo]

Reader to extract code from PDF with complex background using information from PDF

added my code from project needed to extract text:

1. reader
2. config
3. h5 models
4. text post processing
5. fontforge wrapper
6. example pdf

added script to scripts dir to extract text using reader

edited index.html, api_args, manager_config, gitignore and requirements

[NastyBoget]

Please look to the logs of test pipelines - they all should pass before merge

[oksidgy]

it is dublicated code of dedoc/readers/pdf_reader/pdf_txtlayer_reader/pdfminer_reader/pdfminer_extractor.py with different that you use own layout (pass own layout ). Try to use code of dedoc/readers/pdf_reader/pdf_txtlayer_reader/pdfminer_reader/pdfminer_extractor.py with small changes of code of pdfminer_extractor.py.

For example in file dedoc/readers/pdf_reader/pdf_txtlayer_reader/pdfminer_reader/pdfminer_extractor.py:

1. do pubic function def __handle_page(...) -> def handle_page(...)
2. added small changes into code:

def handle_page(self, page: PDFPage, page_number: int, path: str, parameters: ParametersForParseDoc, Layout: Optional[LTPage] = None) -> PageWithBBox:
...
if not layout:
     layout = device.get_result()
...

So, by adding these small changes you will get rid of 300 lines of duplicate code!

[sinkudo]

done

[oksidgy]

Почему добавили еще одну функцию handle_page, если эта функция уже есть? Ее достаточно просто изменить как показано в примере выше. А то снова код дублируется, получается две почти одинаковые функции handle_page в одном классе

[sinkudo]

problems with imports (numpy) during running tests installs numpy 2.0.2 but required numpy<2.0. Runned even on dedoc without my commits on devolopment branch, but problem remains. Please check