File tree Expand file tree Collapse file tree 1 file changed +1
-6
lines changed Expand file tree Collapse file tree 1 file changed +1
-6
lines changed Original file line number Diff line number Diff line change @@ -449,15 +449,10 @@ def write_to_stats(
449
449
):
450
450
"""Responsible for logging the parser rules usage.
451
451
452
- NOTES: It's hard to easily denote which parser rule hasn't produced any
453
- data for the entire crawl, since ItemLoaders essentially don't know
454
- when the spider is going to be closed, as well as it has many
455
- instantiations all throughout the code.
456
-
457
452
The implementation below where each missing parsed_data is being logged
458
453
to the stat is clunky, but necessary. With this, we can only surmise
459
454
that it's safe to remove parser fallback parser if it's all just
460
- '* /missing' in the stats.
455
+ '... /missing' in the stats.
461
456
"""
462
457
463
458
if not self .stats or not field_name :
You can’t perform that action at this time.
0 commit comments