Backup_Repos/leech
1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2026-01-10 17:45:08 +01:00
Code Issues Projects Releases Wiki Activity
167 commits 3 branches 0 tags 1.3 MiB
Commit graph

167 commits

This branch
This branch
All branches
Author SHA1 Message Date
David Lynch
61f3bb1a6e Filter down the cover options to valid ones 2018-10-01 15:00:53 -05:00
David Lynch
0c771ee767
Merge pull request #17 from AlexRaubach/rr_notes 
Place post-chapter RR author notes at the end of the chapter
 2018-10-01 12:19:35 -05:00
David Lynch
02bd6ae0c6
Merge pull request #16 from AlexRaubach/covers 
Download cover art from RR and arbitrary sites
 2018-10-01 12:18:39 -05:00
David Lynch
f6acf4a73b Add example for dungeon keeper ami 
Shows `next_selector` in use.
 2018-10-01 11:19:03 -05:00
David Lynch
929284b67d New features for arbitrary sites 
* next_selector: find next content page, if not using chapter selector
* content_title_selector: pull a chapter title from the content
* content_text_selector: pull specific text from the content element

`content_selector` will now fetch all content elements on the page, each
as a Chapter, not just the first one that matches.
 2018-10-01 11:18:39 -05:00
David Lynch
8f8d7b1edd Better fallback for no-title case on chapters 2018-10-01 11:12:52 -05:00
David Lynch
f17b040f64 Fix spacing 2018-09-29 14:32:38 -05:00
David Lynch
b3f4e720d0 Include AlternateHistory as a xenforo site 
Fixes #18. Well, makes it unnecessary. Strictly, it'd maybe still be useful to
show how to do a XenForo site via `arbitary`.
 2018-09-29 12:00:41 -05:00
David Lynch
0f117f8625 Update requirement versions 2018-09-29 12:00:01 -05:00
Alex Raubach
1ff009f893 Improve Prechapter author note detection 2018-09-27 13:48:33 -04:00
Alex Raubach
a9dfdb5dd3 Add a null check to RR author note placement 2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd Support two RR author notes in one chapter 2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126 Simplify Royal Road chapter scraper 2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b Place post-chapter RR author notes at the end of the chapter 2018-09-16 17:36:07 -04:00
Alex Raubach
60084534a8 Create empty dict when leech.json not present 2018-09-15 11:03:52 -04:00
David Lynch
18c9d68617 Xenforo: cope with ThreadmarksPro's fetchers 2018-09-15 00:18:07 -05:00
David Lynch
9b484a429a Example for Vacant Throne 2018-09-15 00:17:36 -05:00
Alex Raubach
0c37727219 Add example of cover_url to readme 2018-09-10 23:43:56 -04:00
Alex Raubach
1f57305e11 Download cover image if cover_url is in json 2018-09-10 23:13:26 -04:00
Alex Raubach
f2fc2c11db Capture cover options from leech.json and pass them to generate_epub() 2018-09-10 23:03:08 -04:00
Alex Raubach
cc29936d92 Fix whitespace 2018-09-02 22:31:10 -04:00
Alex Raubach
b25c497e46 Describe cover_url in README 2018-09-02 22:16:59 -04:00
Alex Raubach
d357bd17e2 Clean up cover downloading and add logging 2018-09-02 22:08:36 -04:00
Alex Raubach
e765594e9e Add cover urls to more examples 2018-09-02 22:08:36 -04:00
Alex Raubach
53a3cde16d Convert other cover image types to PNG 2018-09-02 22:08:36 -04:00
Alex Raubach
ff568eef10 Allow arbitrary sites to include a cover url 2018-09-02 22:08:36 -04:00
Alex Raubach
ea60ac5122 Download cover images for RoyalRoad Stories 2018-09-02 22:08:36 -04:00
Alex Raubach
571e262735 Find RR cover img src and assign to cover_url 2018-09-02 22:08:36 -04:00
Alex Raubach
fe76b5427b Add cover_url attribute 2018-09-02 22:08:36 -04:00
David Lynch
8273ca1a77 Fix spacing 2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2 Royalroad domain name fiddliness 2018-08-29 23:07:06 -05:00
David Lynch
72f8fbd6ba
Merge pull request #14 from arandomhuman/master 
Fix royalroadl.com chapter dates
 2018-08-29 23:05:33 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed 
My bad.
 2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing 
...I'm bad at the web interface.
 2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents 
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
 2018-08-29 23:00:45 -05:00
random human
23b76d2aac Fix royalroadl.com chapter dates 
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
 2018-08-30 04:03:29 +05:30
David Lynch
123eb69821
Merge pull request #13 from AlexRaubach/master 
Add The Gods Are Bastards, Worm and an array bounds check
 2018-08-29 08:38:18 -05:00
Alex Raubach
1bfc9b75f7
Remove unneeded whitespace 2018-08-28 23:24:59 -04:00
Alex Raubach
97a2a8899a
Create Worm site definition 2018-08-28 22:01:10 -04:00
Alex Raubach
2019616505
Check that the chapter has content before parsing 
Trying to select the first element in line 87 will throw a list index out of range error if there is no content matching the selector.
 2018-08-28 21:59:16 -04:00
Alex Raubach
b83b6d37f1
Add The Gods Are Bastards site definition 
a[href*='20'] selects only chapter links that include the year in the url while not selecting links that share to social media.
 2018-08-28 21:13:06 -04:00
David Lynch
59e4212e07 Bump python version for travis (flake8 compat) 2018-08-17 21:43:33 -05:00
David Lynch
fb8d6cf0d6
Merge pull request #9 from Zomega/clickify 
Switch from using raw argparser to using click.
 2018-08-17 21:33:23 -05:00
David Lynch
d79fc7e545 Practical Guide 4 2018-08-17 21:22:57 -05:00
David Lynch
d7e77d8181 Wandering Inn example 2018-08-09 23:28:30 -05:00
David Lynch
499530993c Royalroad seems to need www now 2018-07-11 21:24:22 -05:00
David Lynch
994d6107f9
Merge pull request #12 from frrad/patch-1 
Remove trailing comma in json
 2018-05-05 15:19:36 -05:00
Frederick Robinson
e959246cee
remove trailing comma in json 2018-05-05 11:26:51 -07:00
Will Oursler
d1842e2bf1 Adds a system for site options to be included as click.options on commands. 2018-04-14 12:56:31 -04:00
Will Oursler
7c1702e6ff Fixes whitespace issues. 2018-04-13 18:18:37 -04:00