Backup_Repos/beets
1
0
Fork 0
mirror of https://github.com/beetbox/beets.git synced 2026-01-06 16:02:53 +01:00
Code Issues Projects Releases Wiki Activity

Fix LyricsWiki scraping code

Browse source 
LyricsWiki now escapes song lyrics using HTML entities (presumably to
prevent scraping), so we now unescape these before parsing.

LyricsWiki has also added a script tag inside the div we are scraping,
so we have to remove this using `scrape_lyrics_from_html`.
This commit is contained in:
Jack Wilsdon 2016-03-17 17:47:50 +00:00
parent 8a0b18c960
commit 60148918d9
1 changed files with 2 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

3
beetsplug/lyrics.py
View file

@ -321,7 +321,8 @@ class LyricsWiki(SymbolsReplaced):
html = self.fetch_url(url)
if not html:
return
lyrics = extract_text_in(html, u"<div class='lyricbox'>")
lyrics = extract_text_in(unescape(html), u"<div class='lyricbox'>")
lyrics = scrape_lyrics_from_html(lyrics)
if lyrics and 'Unfortunately, we are not licensed' not in lyrics:
return lyrics