1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2025-12-07 17:05:25 +01:00
Commit graph

357 commits

Author SHA1 Message Date
Alex Raubach
a9dfdb5dd3 Add a null check to RR author note placement 2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd Support two RR author notes in one chapter 2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126 Simplify Royal Road chapter scraper 2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b Place post-chapter RR author notes at the end of the chapter 2018-09-16 17:36:07 -04:00
Alex Raubach
60084534a8 Create empty dict when leech.json not present 2018-09-15 11:03:52 -04:00
David Lynch
18c9d68617 Xenforo: cope with ThreadmarksPro's fetchers 2018-09-15 00:18:07 -05:00
David Lynch
9b484a429a Example for Vacant Throne 2018-09-15 00:17:36 -05:00
Alex Raubach
0c37727219 Add example of cover_url to readme 2018-09-10 23:43:56 -04:00
Alex Raubach
1f57305e11 Download cover image if cover_url is in json 2018-09-10 23:13:26 -04:00
Alex Raubach
f2fc2c11db Capture cover options from leech.json and pass them to generate_epub() 2018-09-10 23:03:08 -04:00
Alex Raubach
cc29936d92 Fix whitespace 2018-09-02 22:31:10 -04:00
Alex Raubach
b25c497e46 Describe cover_url in README 2018-09-02 22:16:59 -04:00
Alex Raubach
d357bd17e2 Clean up cover downloading and add logging 2018-09-02 22:08:36 -04:00
Alex Raubach
e765594e9e Add cover urls to more examples 2018-09-02 22:08:36 -04:00
Alex Raubach
53a3cde16d Convert other cover image types to PNG 2018-09-02 22:08:36 -04:00
Alex Raubach
ff568eef10 Allow arbitrary sites to include a cover url 2018-09-02 22:08:36 -04:00
Alex Raubach
ea60ac5122 Download cover images for RoyalRoad Stories 2018-09-02 22:08:36 -04:00
Alex Raubach
571e262735 Find RR cover img src and assign to cover_url 2018-09-02 22:08:36 -04:00
Alex Raubach
fe76b5427b Add cover_url attribute 2018-09-02 22:08:36 -04:00
David Lynch
8273ca1a77 Fix spacing 2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2 Royalroad domain name fiddliness 2018-08-29 23:07:06 -05:00
David Lynch
72f8fbd6ba
Merge pull request #14 from arandomhuman/master
Fix royalroadl.com chapter dates
2018-08-29 23:05:33 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed
My bad.
2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing
...I'm bad at the web interface.
2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
2018-08-29 23:00:45 -05:00
random human
23b76d2aac Fix royalroadl.com chapter dates
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
2018-08-30 04:03:29 +05:30
David Lynch
123eb69821
Merge pull request #13 from AlexRaubach/master
Add The Gods Are Bastards, Worm and an array bounds check
2018-08-29 08:38:18 -05:00
Alex Raubach
1bfc9b75f7
Remove unneeded whitespace 2018-08-28 23:24:59 -04:00
Alex Raubach
97a2a8899a
Create Worm site definition 2018-08-28 22:01:10 -04:00
Alex Raubach
2019616505
Check that the chapter has content before parsing
Trying to select the first element in line 87 will throw a list index out of range error if there is no content matching the selector.
2018-08-28 21:59:16 -04:00
Alex Raubach
b83b6d37f1
Add The Gods Are Bastards site definition
a[href*='20'] selects only chapter links that include the year in the url while not selecting links that share to social media.
2018-08-28 21:13:06 -04:00
David Lynch
59e4212e07 Bump python version for travis (flake8 compat) 2018-08-17 21:43:33 -05:00
David Lynch
fb8d6cf0d6
Merge pull request #9 from Zomega/clickify
Switch from using raw argparser to using click.
2018-08-17 21:33:23 -05:00
David Lynch
d79fc7e545 Practical Guide 4 2018-08-17 21:22:57 -05:00
David Lynch
d7e77d8181 Wandering Inn example 2018-08-09 23:28:30 -05:00
David Lynch
499530993c Royalroad seems to need www now 2018-07-11 21:24:22 -05:00
David Lynch
994d6107f9
Merge pull request #12 from frrad/patch-1
Remove trailing comma in json
2018-05-05 15:19:36 -05:00
Frederick Robinson
e959246cee
remove trailing comma in json 2018-05-05 11:26:51 -07:00
Will Oursler
d1842e2bf1 Adds a system for site options to be included as click.options on commands. 2018-04-14 12:56:31 -04:00
Will Oursler
7c1702e6ff Fixes whitespace issues. 2018-04-13 18:18:37 -04:00
Will Oursler
379c087086 Merge a few things I missed in by hand. 2018-04-13 18:10:46 -04:00
Will Oursler
fd7998ea27 Clean up how verbose log output works... 2018-04-13 17:57:08 -04:00
Will Oursler
ecebf1de58 Merge branch 'master' into clickify 2018-04-13 17:52:37 -04:00
Will Oursler
9ab8404120
Merge pull request #2 from kemayo/master
Bring my fork up to date with kemayo's
2018-04-13 16:36:02 -04:00
David Lynch
868ef4b157 Handle mobile links for FFN 2018-03-30 15:18:57 -05:00
David Lynch
7d2c1647e2 Safer check on retry-after 2018-02-28 20:54:37 -06:00
David Lynch
b8123e0b26 Explicitly VACUUM the cache on flush 2018-01-19 14:21:05 -06:00
David Lynch
2042f813d0 Allow AO3 logins for member-only stories 2018-01-19 14:15:43 -06:00
David Lynch
f8d494283c Proper URL normalization for AO3 chapters 2018-01-19 13:19:45 -06:00
David Lynch
fb58879348 New example 2017-12-05 21:34:40 -06:00