Add SE publisher (Aftonbladet) #803
Conversation
addie9800
left a comment
addie9800
left a comment
There was a problem hiding this comment.
Thanks for adding our now second Swedish publisher. I only have a couple of remarks before we can go ahead.
| ) | ||
|
|
||
|
|
||
| class AftonbladetParser(ParserProxy): |
There was a problem hiding this comment.
You're a bit in a special situation here. It seems as if the publisher did not implement the isAccessibleForFree attribute here, which is the default handling of the free_access attribute. You would need to find a custom implementation for this publisher. Example: https://www.aftonbladet.se/bil/a/bmRM95/privatleasade-audi-som-gick-sonder-far-betala-manadsavgift, this article is marked as free to access.
|
|
||
| @attribute | ||
| def images(self) -> List[Image]: | ||
| return image_extraction(doc=self.precomputed.doc, paragraph_selector=self._paragraph_selector) |
There was a problem hiding this comment.
The parsing of the image authors does not work in this article: https://www.aftonbladet.se/senastenytt/ttsport/sport/a/lw7vKA/ryss-kan-straffas-efter-schackmastarens-dod
| _summary_selector = XPath("//p[contains(@data-test-tag,'lead-text')]") | ||
| _paragraph_selector = XPath( | ||
| "//p[starts-with(@class,'hyperion-css-') and not(contains(@data-test-tag,'lead-text'))]" | ||
| ) |
There was a problem hiding this comment.
This article also has subheadlines: https://www.aftonbladet.se/nyheter/a/yEkM0e/hemliga-kallaren-under-ica-baner-ags-av-leif-jonsson
| class AftonbladetParser(ParserProxy): | ||
| class V1(BaseParser): | ||
| _summary_selector = XPath("//p[contains(@data-test-tag,'lead-text')]") | ||
| _paragraph_selector = XPath( |
There was a problem hiding this comment.
Some bloat at the end of the article is extracted here: https://www.aftonbladet.se/debatt/a/Av4LX3/jagarnas-riksforbund-stoppa-vansinnesdad-inte-helt-vanliga-jagare
2 participants
Please review if you have time. Needs to be merged after SE Expressen (#800)