Backup_Repos/calibre
1
0
Fork 0
mirror of git://github.com/kovidgoyal/calibre.git synced 2025-12-20 19:26:06 +01:00
Code Issues Projects Releases Wiki Activity

Update The New Yorker

Browse source
This commit is contained in:
Kovid Goyal 2015-07-31 09:07:11 +05:30
parent 5779af5140
commit db54fbeca0
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
recipes/new_yorker.recipe
View file

@ -41,13 +41,15 @@ def parse_index(self):
articles = []
current_section = 'Current Issue'
feeds = []
for story in soup.findAll(['h5', 'article'], itemtype=[None, 'http://schema.org/NewsArticle']):
for story in soup.findAll(['h5', 'article']):
if story.name == 'h5':
if articles:
feeds.append((current_section, articles))
current_section, articles = self.tag_to_string(story), []
self.log('\nFound section: ' + current_section)
continue
if story['itemtype'] != 'http://schema.org/Article':
continue
h2 = story.find('h2')
url = h2.find('a', href=True)['href']
a = h2.find('a')