We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent d4d3671 commit fe2f1b8Copy full SHA for fe2f1b8
itemloaders/__init__.py
@@ -449,11 +449,6 @@ def write_to_stats(
449
):
450
"""Responsible for logging the parser rules usage.
451
452
- NOTES: It's hard to easily denote which parser rule hasn't produced any
453
- data for the entire crawl, since ItemLoaders essentially don't know
454
- when the spider is going to be closed, as well as it has many
455
- instantiations all throughout the code.
456
-
457
The implementation below where each missing parsed_data is being logged
458
to the stat is clunky, but necessary. With this, we can only surmise
459
that it's safe to remove parser fallback parser if it's all just
0 commit comments