Add La Vanguardia
#637
Add La Vanguardia
#637
Conversation
# Conflicts: # src/fundus/publishers/es/__init__.py
src/fundus/publishers/es/__init__.py
Outdated
| NewsMap("https://www.lavanguardia.com/newsml/home.xml"), | ||
| RSSFeed("https://www.lavanguardia.com/rss/home.xml"), | ||
| RSSFeed("https://www.lavanguardia.com/rss/internacional.xml"), |
There was a problem hiding this comment.
There seem to be sitemaps as well https://www.lavanguardia.com/sitemap-noticias-202102.xml.gz as well as two other NewsMaps:
https://www.lavanguardia.com/sitemap-google-news.xml
https://www.lavanguardia.com/sitemap-news-agencias.xml
There was a problem hiding this comment.
Ah perfect, I missed them
|
|
||
| @attribute | ||
| def authors(self) -> List[str]: | ||
| return generic_author_parsing(self.precomputed.ld.bf_search("author")) |
There was a problem hiding this comment.
There are some encoding errors for the author field when parsing this article.
There was a problem hiding this comment.
Turns out, it seems to be the case that, if there is this ZWSP character, it seems to be followed by information unrelated to the author, so it can safely be just removed
| _summary_selector = XPath("//h2[@class='epigraph']") | ||
|
|
||
| @attribute | ||
| def body(self) -> Optional[ArticleBody]: |
There was a problem hiding this comment.
The selector seems to have trouble parsing this article
There was a problem hiding this comment.
It seems to me, as if there is nothing we can do about it, since the content is loaded using a script. The HTML we get in Fundus seems to mostly be scripts
| def topics(self) -> List[str]: | ||
| return generic_topic_parsing(self.precomputed.meta.get("Keywords")) |
There was a problem hiding this comment.
One could argue that the topics at the page's bottom are more descriptive. What do you think?
No description provided.