David Lynch
f64fce0286
AO3: login form changed
2018-12-29 21:00:02 -06:00
David Lynch
0a81069d24
Slightly more verbose logging of load failures
2018-12-29 20:46:55 -06:00
David Lynch
10826a01e8
Merge pull request #21 from AlexRaubach/fifthdefiance
...
Add a definition file for The Fifth Defiance
2018-11-05 10:38:13 -06:00
Alex Raubach
46fc230a2c
Create Fifth Defiance definition file
2018-10-29 10:22:06 -04:00
David Lynch
e78ffdb85b
Method to get a site-key for config
...
Means that things like XenForoIndex and AO3Series don't require separate
config entries.
2018-10-11 15:42:59 -05:00
David Lynch
cdcd110c50
AO3: change title detection for logged-in only
2018-10-11 15:42:36 -05:00
David Lynch
482c1ab26e
Reset cover bytesteam after checking its format
...
Caused issues writing the file later, as the internal pointer moved past the
first few bytes when checking whether it was a PNG.
Fixes #19
2018-10-08 09:02:15 -05:00
David Lynch
61f3bb1a6e
Filter down the cover options to valid ones
2018-10-01 15:00:53 -05:00
David Lynch
0c771ee767
Merge pull request #17 from AlexRaubach/rr_notes
...
Place post-chapter RR author notes at the end of the chapter
2018-10-01 12:19:35 -05:00
David Lynch
02bd6ae0c6
Merge pull request #16 from AlexRaubach/covers
...
Download cover art from RR and arbitrary sites
2018-10-01 12:18:39 -05:00
David Lynch
f6acf4a73b
Add example for dungeon keeper ami
...
Shows `next_selector` in use.
2018-10-01 11:19:03 -05:00
David Lynch
929284b67d
New features for arbitrary sites
...
* next_selector: find next content page, if not using chapter selector
* content_title_selector: pull a chapter title from the content
* content_text_selector: pull specific text from the content element
`content_selector` will now fetch all content elements on the page, each
as a Chapter, not just the first one that matches.
2018-10-01 11:18:39 -05:00
David Lynch
8f8d7b1edd
Better fallback for no-title case on chapters
2018-10-01 11:12:52 -05:00
David Lynch
f17b040f64
Fix spacing
2018-09-29 14:32:38 -05:00
David Lynch
b3f4e720d0
Include AlternateHistory as a xenforo site
...
Fixes #18 . Well, makes it unnecessary. Strictly, it'd maybe still be useful to
show how to do a XenForo site via `arbitary`.
2018-09-29 12:00:41 -05:00
David Lynch
0f117f8625
Update requirement versions
2018-09-29 12:00:01 -05:00
Alex Raubach
1ff009f893
Improve Prechapter author note detection
2018-09-27 13:48:33 -04:00
Alex Raubach
a9dfdb5dd3
Add a null check to RR author note placement
2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd
Support two RR author notes in one chapter
2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126
Simplify Royal Road chapter scraper
2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b
Place post-chapter RR author notes at the end of the chapter
2018-09-16 17:36:07 -04:00
Alex Raubach
60084534a8
Create empty dict when leech.json not present
2018-09-15 11:03:52 -04:00
David Lynch
18c9d68617
Xenforo: cope with ThreadmarksPro's fetchers
2018-09-15 00:18:07 -05:00
David Lynch
9b484a429a
Example for Vacant Throne
2018-09-15 00:17:36 -05:00
Alex Raubach
0c37727219
Add example of cover_url to readme
2018-09-10 23:43:56 -04:00
Alex Raubach
1f57305e11
Download cover image if cover_url is in json
2018-09-10 23:13:26 -04:00
Alex Raubach
f2fc2c11db
Capture cover options from leech.json and pass them to generate_epub()
2018-09-10 23:03:08 -04:00
Alex Raubach
cc29936d92
Fix whitespace
2018-09-02 22:31:10 -04:00
Alex Raubach
b25c497e46
Describe cover_url in README
2018-09-02 22:16:59 -04:00
Alex Raubach
d357bd17e2
Clean up cover downloading and add logging
2018-09-02 22:08:36 -04:00
Alex Raubach
e765594e9e
Add cover urls to more examples
2018-09-02 22:08:36 -04:00
Alex Raubach
53a3cde16d
Convert other cover image types to PNG
2018-09-02 22:08:36 -04:00
Alex Raubach
ff568eef10
Allow arbitrary sites to include a cover url
2018-09-02 22:08:36 -04:00
Alex Raubach
ea60ac5122
Download cover images for RoyalRoad Stories
2018-09-02 22:08:36 -04:00
Alex Raubach
571e262735
Find RR cover img src and assign to cover_url
2018-09-02 22:08:36 -04:00
Alex Raubach
fe76b5427b
Add cover_url attribute
2018-09-02 22:08:36 -04:00
David Lynch
8273ca1a77
Fix spacing
2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2
Royalroad domain name fiddliness
2018-08-29 23:07:06 -05:00
David Lynch
72f8fbd6ba
Merge pull request #14 from arandomhuman/master
...
Fix royalroadl.com chapter dates
2018-08-29 23:05:33 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed
...
My bad.
2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing
...
...I'm bad at the web interface.
2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents
...
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
2018-08-29 23:00:45 -05:00
random human
23b76d2aac
Fix royalroadl.com chapter dates
...
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
2018-08-30 04:03:29 +05:30
David Lynch
123eb69821
Merge pull request #13 from AlexRaubach/master
...
Add The Gods Are Bastards, Worm and an array bounds check
2018-08-29 08:38:18 -05:00
Alex Raubach
1bfc9b75f7
Remove unneeded whitespace
2018-08-28 23:24:59 -04:00
Alex Raubach
97a2a8899a
Create Worm site definition
2018-08-28 22:01:10 -04:00
Alex Raubach
2019616505
Check that the chapter has content before parsing
...
Trying to select the first element in line 87 will throw a list index out of range error if there is no content matching the selector.
2018-08-28 21:59:16 -04:00
Alex Raubach
b83b6d37f1
Add The Gods Are Bastards site definition
...
a[href*='20'] selects only chapter links that include the year in the url while not selecting links that share to social media.
2018-08-28 21:13:06 -04:00
David Lynch
59e4212e07
Bump python version for travis (flake8 compat)
2018-08-17 21:43:33 -05:00
David Lynch
fb8d6cf0d6
Merge pull request #9 from Zomega/clickify
...
Switch from using raw argparser to using click.
2018-08-17 21:33:23 -05:00
