David Lynch
2103f37cfb
AO3: fallback for single-chapter works
2020-05-04 00:31:19 -05:00
David Lynch
6fbdc8843d
Make arbitrary site chapter-title selectors more resilient
2020-04-29 17:55:20 -05:00
David Lynch
6631095726
Fiction.live: niche URLs
...
* occasional stories with "Sci-fi" in the URL instead of "stories"
* rare cases of `-` in the work id
Fixes #31
2019-11-14 14:45:19 -06:00
David Lynch
a856f9d0f8
Fiction.live: account for a weird rare bug/possibility in votes
...
Also, add a bunch of error handling / logging to the section-parsing to
avoid this in the future.
Fixes #30
2019-11-07 09:34:39 -06:00
David Lynch
f89f5163b5
Fiction.live: Fix choices array check
...
Fixes #29
2019-11-05 15:02:09 -06:00
David Lynch
4861ffbd7e
Fiction.live can have votes for absent choices
...
Fixes #28 .
2019-10-29 08:17:01 -05:00
David Lynch
dc10e4cf17
FFN: less-destructive attribute clearing
2019-10-17 22:29:01 -05:00
David Lynch
7208cfdaaf
Minor readability improvement: use f-strings
2019-10-15 11:14:27 -05:00
David Lynch
c584988994
Update dependencies
2019-10-14 00:40:34 -05:00
David Lynch
9d0b5f1d3a
Merge pull request #26 from thegrinner/no-vote-fictionlive
...
Fix FictionLive download failure on missing vote node
2019-10-14 00:07:34 -05:00
David Lynch
d782928e0e
Spacebattles is now on XenForo2
2019-10-12 10:51:22 -05:00
thegrinner
4e4f16e7cc
Appease flake8
2019-10-03 17:48:45 -04:00
thegrinner
d0402daa7b
Add handling for votes that don't have a votes kvp
2019-10-03 17:36:43 -04:00
David Lynch
5e034a7d65
Xenforo let non-first-category threadmarks work
...
Currently this just requires passing a link to the reader view of a particular
category. In the future I might want to support more variants on this -- a
flag to pull down all the threadmark categories, for instance.
2019-08-06 17:29:53 -05:00
David Lynch
532a7c6682
Fix typo of title_element in arbitrary
...
Fixes #25
2019-07-30 09:37:03 -05:00
David Lynch
f002064352
Xenforo2 title labels
2019-07-24 23:29:12 -05:00
David Lynch
a148fa8c43
Flake8 errors
2019-07-13 13:17:54 -05:00
David Lynch
3443304ab1
XenForo: handle SV's XenForo2 changes
2019-07-13 11:42:22 -05:00
David Lynch
b1b51bdc8f
Xenforo: clean out title prefixes
2019-06-17 16:13:09 -05:00
David Lynch
c8f5b3f8d8
XenForo should use reader-view if available
...
Much like 40b4856
2019-05-29 01:56:39 -05:00
David Lynch
2bd5d77715
Helper for URL-joining
2019-05-29 01:55:35 -05:00
David Lynch
66576048da
Fix flake8 errors
2019-05-25 20:03:17 -05:00
David Lynch
40b4856a14
Optimize AO3: use full_work URL
2019-05-25 15:31:39 -05:00
David Lynch
f64fce0286
AO3: login form changed
2018-12-29 21:00:02 -06:00
David Lynch
0a81069d24
Slightly more verbose logging of load failures
2018-12-29 20:46:55 -06:00
David Lynch
e78ffdb85b
Method to get a site-key for config
...
Means that things like XenForoIndex and AO3Series don't require separate
config entries.
2018-10-11 15:42:59 -05:00
David Lynch
cdcd110c50
AO3: change title detection for logged-in only
2018-10-11 15:42:36 -05:00
David Lynch
0c771ee767
Merge pull request #17 from AlexRaubach/rr_notes
...
Place post-chapter RR author notes at the end of the chapter
2018-10-01 12:19:35 -05:00
David Lynch
02bd6ae0c6
Merge pull request #16 from AlexRaubach/covers
...
Download cover art from RR and arbitrary sites
2018-10-01 12:18:39 -05:00
David Lynch
929284b67d
New features for arbitrary sites
...
* next_selector: find next content page, if not using chapter selector
* content_title_selector: pull a chapter title from the content
* content_text_selector: pull specific text from the content element
`content_selector` will now fetch all content elements on the page, each
as a Chapter, not just the first one that matches.
2018-10-01 11:18:39 -05:00
David Lynch
f17b040f64
Fix spacing
2018-09-29 14:32:38 -05:00
David Lynch
b3f4e720d0
Include AlternateHistory as a xenforo site
...
Fixes #18 . Well, makes it unnecessary. Strictly, it'd maybe still be useful to
show how to do a XenForo site via `arbitary`.
2018-09-29 12:00:41 -05:00
Alex Raubach
1ff009f893
Improve Prechapter author note detection
2018-09-27 13:48:33 -04:00
Alex Raubach
a9dfdb5dd3
Add a null check to RR author note placement
2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd
Support two RR author notes in one chapter
2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126
Simplify Royal Road chapter scraper
2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b
Place post-chapter RR author notes at the end of the chapter
2018-09-16 17:36:07 -04:00
David Lynch
18c9d68617
Xenforo: cope with ThreadmarksPro's fetchers
2018-09-15 00:18:07 -05:00
Alex Raubach
ff568eef10
Allow arbitrary sites to include a cover url
2018-09-02 22:08:36 -04:00
Alex Raubach
571e262735
Find RR cover img src and assign to cover_url
2018-09-02 22:08:36 -04:00
Alex Raubach
fe76b5427b
Add cover_url attribute
2018-09-02 22:08:36 -04:00
David Lynch
8273ca1a77
Fix spacing
2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2
Royalroad domain name fiddliness
2018-08-29 23:07:06 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed
...
My bad.
2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing
...
...I'm bad at the web interface.
2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents
...
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
2018-08-29 23:00:45 -05:00
random human
23b76d2aac
Fix royalroadl.com chapter dates
...
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
2018-08-30 04:03:29 +05:30
Alex Raubach
1bfc9b75f7
Remove unneeded whitespace
2018-08-28 23:24:59 -04:00
Alex Raubach
2019616505
Check that the chapter has content before parsing
...
Trying to select the first element in line 87 will throw a list index out of range error if there is no content matching the selector.
2018-08-28 21:59:16 -04:00
David Lynch
fb8d6cf0d6
Merge pull request #9 from Zomega/clickify
...
Switch from using raw argparser to using click.
2018-08-17 21:33:23 -05:00
