Backup_Repos/leech
1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2025-12-15 12:56:41 +01:00
Code Issues Projects Releases Wiki Activity
143 commits 2 branches 0 tags 1.3 MiB
Commit graph

143 commits

This branch
This branch
All branches
Author SHA1 Message Date
Alex Raubach
1ff009f893 Improve Prechapter author note detection 2018-09-27 13:48:33 -04:00
Alex Raubach
a9dfdb5dd3 Add a null check to RR author note placement 2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd Support two RR author notes in one chapter 2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126 Simplify Royal Road chapter scraper 2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b Place post-chapter RR author notes at the end of the chapter 2018-09-16 17:36:07 -04:00
David Lynch
8273ca1a77 Fix spacing 2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2 Royalroad domain name fiddliness 2018-08-29 23:07:06 -05:00
David Lynch
72f8fbd6ba
Merge pull request #14 from arandomhuman/master 
Fix royalroadl.com chapter dates
 2018-08-29 23:05:33 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed 
My bad.
 2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing 
...I'm bad at the web interface.
 2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents 
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
 2018-08-29 23:00:45 -05:00
random human
23b76d2aac Fix royalroadl.com chapter dates 
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
 2018-08-30 04:03:29 +05:30
David Lynch
123eb69821
Merge pull request #13 from AlexRaubach/master 
Add The Gods Are Bastards, Worm and an array bounds check
 2018-08-29 08:38:18 -05:00
Alex Raubach
1bfc9b75f7
Remove unneeded whitespace 2018-08-28 23:24:59 -04:00
Alex Raubach
97a2a8899a
Create Worm site definition 2018-08-28 22:01:10 -04:00
Alex Raubach
2019616505
Check that the chapter has content before parsing 
Trying to select the first element in line 87 will throw a list index out of range error if there is no content matching the selector.
 2018-08-28 21:59:16 -04:00
Alex Raubach
b83b6d37f1
Add The Gods Are Bastards site definition 
a[href*='20'] selects only chapter links that include the year in the url while not selecting links that share to social media.
 2018-08-28 21:13:06 -04:00
David Lynch
59e4212e07 Bump python version for travis (flake8 compat) 2018-08-17 21:43:33 -05:00
David Lynch
fb8d6cf0d6
Merge pull request #9 from Zomega/clickify 
Switch from using raw argparser to using click.
 2018-08-17 21:33:23 -05:00
David Lynch
d79fc7e545 Practical Guide 4 2018-08-17 21:22:57 -05:00
David Lynch
d7e77d8181 Wandering Inn example 2018-08-09 23:28:30 -05:00
David Lynch
499530993c Royalroad seems to need www now 2018-07-11 21:24:22 -05:00
David Lynch
994d6107f9
Merge pull request #12 from frrad/patch-1 
Remove trailing comma in json
 2018-05-05 15:19:36 -05:00
Frederick Robinson
e959246cee
remove trailing comma in json 2018-05-05 11:26:51 -07:00
Will Oursler
d1842e2bf1 Adds a system for site options to be included as click.options on commands. 2018-04-14 12:56:31 -04:00
Will Oursler
7c1702e6ff Fixes whitespace issues. 2018-04-13 18:18:37 -04:00
Will Oursler
379c087086 Merge a few things I missed in by hand. 2018-04-13 18:10:46 -04:00
Will Oursler
fd7998ea27 Clean up how verbose log output works... 2018-04-13 17:57:08 -04:00
Will Oursler
ecebf1de58 Merge branch 'master' into clickify 2018-04-13 17:52:37 -04:00
Will Oursler
9ab8404120
Merge pull request #2 from kemayo/master 
Bring my fork up to date with kemayo's
 2018-04-13 16:36:02 -04:00
David Lynch
868ef4b157 Handle mobile links for FFN 2018-03-30 15:18:57 -05:00
David Lynch
7d2c1647e2 Safer check on retry-after 2018-02-28 20:54:37 -06:00
David Lynch
b8123e0b26 Explicitly VACUUM the cache on flush 2018-01-19 14:21:05 -06:00
David Lynch
2042f813d0 Allow AO3 logins for member-only stories 2018-01-19 14:15:43 -06:00
David Lynch
f8d494283c Proper URL normalization for AO3 chapters 2018-01-19 13:19:45 -06:00
David Lynch
fb58879348 New example 2017-12-05 21:34:40 -06:00
David Lynch
e9dab9ab7d Fix linting on royalroad 2017-11-17 22:57:54 -06:00
David Lynch
e099f47e66 Support: RoyalRoad 2017-11-17 21:37:13 -06:00
David Lynch
7bb6da382c Oh hey, another missing Section URL 2017-11-04 00:30:59 -05:00
David Lynch
6d52c72c99 Use logging instead of print 
Fixes #10
 2017-11-04 00:09:09 -05:00
David Lynch
43599aceb5
Merge branch 'master' into clickify 2017-11-03 15:21:44 -05:00
David Lynch
f1ac7c8bda Retry failed site-requests 2017-10-31 00:27:54 -05:00
David Lynch
27b677a444 Fix no-threadmarks autodetect 2017-10-29 19:50:19 -05:00
David Lynch
df8e67d3e1 Include some examples for the arbitrary handler 2017-10-22 17:33:43 -05:00
David Lynch
257ab69394 Arbitrary handler: canonicalize URLs 2017-10-22 17:31:10 -05:00
David Lynch
dc0d2162fb Arbitrary handler had misplaced url arg 2017-10-22 17:06:40 -05:00
Will Oursler
9b4d2a0998 Adds a more sensible default for options in the Site base class. 2017-10-13 19:43:38 -04:00
Will Oursler
c702337040 Reworks how site-specific options work. 2017-10-13 19:37:13 -04:00
David Lynch
3a24cad826 Fill in some TODOs for fiction.live 2017-10-12 18:38:58 -05:00
David Lynch
1fe2e72b30 Site handler for fiction.live 2017-10-12 17:59:02 -05:00