Backup_Repos/leech
1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2025-12-06 16:33:16 +01:00
Code Issues Projects Releases Wiki Activity
393 commits 3 branches 0 tags 1.3 MiB
Commit graph

38 commits

Author SHA1 Message Date
David Lynch
5f72f23e72 Note to self about royalroad chapter URLs 2025-08-01 19:43:31 -05:00
David Lynch
5cb887f767 Move image processing into sites 
The epub-builder still downloads the image, but all the html-mangling
is done in the extraction process now.

Turns footnotes into a chapter-object, for easier processing later on.
 2025-03-22 19:39:16 -05:00
David Lynch
acce8138a9 Also pass the base through to the super clean for royalroad 2024-12-02 11:01:34 -06:00
David Lynch
31154ed8d4 Fix a call to _clean for royalroad 2024-12-02 00:00:58 -06:00
David Lynch
0cac7ff945 New spoilers behavior: --spoilers [include/inline/skip] 
Fixes #75
 2024-11-23 21:39:54 -06:00
David Lynch
21834bb5ed _clean takes a base argument and reformats image srcs into absolute urls 2024-11-23 15:30:57 -06:00
David Lynch
a0a057c48c _soup always returns a base URL 2024-11-23 15:15:29 -06:00
David Lynch
cc423f62bb Fix the royalroad stolen-content removal 
They added speak:none to the CSS, and I was strictly checking for a rule
that only contained display:none.
 2024-02-10 20:05:49 -06:00
David Lynch
d30e56a518 Strip out the new stolen-content warnings on royalroad 
They might make these harder to work out in the future, but for now...
 2024-01-19 21:34:39 -06:00
David Lynch
7230f65a68 Add offset/limit options to royalroad 2023-05-04 09:42:13 -05:00
KeinNiemand
356bae9a7a Don't prettify royalroad soup, Fixes #92 2023-05-04 13:17:28 +02:00
David Lynch
fe5ca86d87 Royalroad's markup has changed slightly, fix so title and summary work 2023-03-17 16:06:52 -05:00
David Lynch
29589a0886 RoyalRoad: don't error when covers are relative URLs 
Only happens when the work has no set cover, because it gets a /dist/
URL rather than a CDN URL.

Fixes #77
 2022-02-22 12:19:58 -06:00
David Lynch
f204dcd928 Add a class to generated spoiler divs 2022-02-13 11:44:36 -06:00
David Lynch
697e4c0bf9 Royalroad: don't crash on malformed spoiler tags 
Fixes #74
 2022-02-03 11:08:40 -06:00
David Lynch
dc9c9dbe57 Pull summary and tags for royalroad 2021-11-07 13:16:59 -06:00
David Lynch
4242aa6f63 Strip colors on all sites, not just xenforo 2021-11-07 11:16:26 -06:00
David Lynch
f25befc237 Decode cloudflare email address protection 
Makes a generic _clean function on Site that can be called. Will
probably want to migrate some other generic bits into there after
analysis of what's *really* generic.
 2021-03-27 10:46:39 -05:00
David Lynch
ce998c84c3 Extract spoilers to footnotes on royalroad 2021-03-07 11:28:49 -06:00
David Lynch
7208cfdaaf Minor readability improvement: use f-strings 2019-10-15 11:14:27 -05:00
David Lynch
2bd5d77715 Helper for URL-joining 2019-05-29 01:55:35 -05:00
David Lynch
66576048da Fix flake8 errors 2019-05-25 20:03:17 -05:00
David Lynch
0c771ee767
Merge pull request #17 from AlexRaubach/rr_notes 
Place post-chapter RR author notes at the end of the chapter
 2018-10-01 12:19:35 -05:00
Alex Raubach
1ff009f893 Improve Prechapter author note detection 2018-09-27 13:48:33 -04:00
Alex Raubach
a9dfdb5dd3 Add a null check to RR author note placement 2018-09-17 20:22:13 -04:00
Alex Raubach
cf62faf5dd Support two RR author notes in one chapter 2018-09-17 20:03:01 -04:00
Alex Raubach
94900cb126 Simplify Royal Road chapter scraper 2018-09-17 00:05:47 -04:00
Alex Raubach
d71184ae8b Place post-chapter RR author notes at the end of the chapter 2018-09-16 17:36:07 -04:00
Alex Raubach
571e262735 Find RR cover img src and assign to cover_url 2018-09-02 22:08:36 -04:00
David Lynch
8273ca1a77 Fix spacing 2018-08-29 23:39:39 -05:00
David Lynch
17cd0ea4e2 Royalroad domain name fiddliness 2018-08-29 23:07:06 -05:00
David Lynch
6c8ac39d64
fromtimestamp still needed 
My bad.
 2018-08-29 23:04:17 -05:00
David Lynch
a151f02c84
Fix spacing 
...I'm bad at the web interface.
 2018-08-29 23:01:43 -05:00
David Lynch
69c9c21f47
Avoid double-fetching the chapter contents 
Doesn't matter hugely if caching is enabled, but it's still suboptimal.
 2018-08-29 23:00:45 -05:00
random human
23b76d2aac Fix royalroadl.com chapter dates 
Since the timestamp provided with the chapter list is approximate, fetch
the actual chapter in order to get unixtime.
 2018-08-30 04:03:29 +05:30
David Lynch
499530993c Royalroad seems to need www now 2018-07-11 21:24:22 -05:00
David Lynch
e9dab9ab7d Fix linting on royalroad 2017-11-17 22:57:54 -06:00
David Lynch
e099f47e66 Support: RoyalRoad 2017-11-17 21:37:13 -06:00