1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2025-12-06 08:22:56 +01:00
Commit graph

65 commits

Author SHA1 Message Date
David Lynch
81189f4e1d xenforo: minor fixes around images in spoilers 2025-03-22 00:16:11 -05:00
David Lynch
9ed2d54db7 Make the _soup method able to cope with being given a html string 2025-03-04 23:14:51 -06:00
Max Isom
53bc2045f0 Use lxml (>40% faster) 2025-03-04 22:23:50 -06:00
David Lynch
bf248bbfc8 Remove unused register import in xenforo.py 2024-11-23 21:48:46 -06:00
David Lynch
ef43295c25 AlternateHistory is on XenForo2 now
...this was the last site I had in old XenForo, so I will probably want
to clean that up soon.
2024-11-23 21:41:36 -06:00
David Lynch
0cac7ff945 New spoilers behavior: --spoilers [include/inline/skip]
Fixes #75
2024-11-23 21:39:54 -06:00
David Lynch
21834bb5ed _clean takes a base argument and reformats image srcs into absolute urls 2024-11-23 15:30:57 -06:00
David Lynch
a0a057c48c _soup always returns a base URL 2024-11-23 15:15:29 -06:00
Emmanuel Jemeni
4e9ad1ed7e feat: Leech can now download images in xenforo spoilers. The --include-spoilers tag has to be added for Leech to download images in spoilers. 2024-11-23 13:22:54 -06:00
David Lynch
7967c59636 Support 2fa for xenforo logins 2024-10-13 00:52:50 -05:00
David Lynch
249221f5d7 Fix questionable questing, which has moved to xenforo2 2024-05-14 22:08:22 -05:00
David Lynch
1f57cd6f07 Basic success-testing on logins 2024-05-14 22:07:05 -05:00
David Lynch
ef9309eb66 Fix xenforo login 2024-05-14 22:06:09 -05:00
David Lynch
5ddbb310b3 Let xenforo sites cope with index.php URLs 2023-08-06 17:43:28 -05:00
David Lynch
e9f704716a Xenforo: change some of the style-removal
It was causing some formatting issues, particularly on Worm fics which
did forum-style sections. (Also, indented text done via margin-left on
divs, which entirely removed the div and ran lines together.)
2022-04-27 11:07:16 -05:00
David Lynch
08abe54e79 Switch out use of :=, forgot I wasn't requiring 3.8 yet 2022-03-06 10:46:13 -06:00
David Lynch
172877410b Xenforo: if fetching a specific threadmark category, add it to the title
Unless it's 1, since that's always "threadmarks" and the main story.

Refs #79
2022-03-06 10:42:39 -06:00
David Lynch
f204dcd928 Add a class to generated spoiler divs 2022-02-13 11:44:36 -06:00
David Lynch
4242aa6f63 Strip colors on all sites, not just xenforo 2021-11-07 11:16:26 -06:00
David Lynch
d1caf85883 Extract tags when present
Supported currently on Xenforo and AO3
2021-05-01 16:35:49 -05:00
David Lynch
f25befc237 Decode cloudflare email address protection
Makes a generic _clean function on Site that can be called. Will
probably want to migrate some other generic bits into there after
analysis of what's *really* generic.
2021-03-27 10:46:39 -05:00
David Lynch
988368bb66 Better xenforo blockquote chrome removal 2020-08-18 13:21:01 -05:00
David Lynch
7208cfdaaf Minor readability improvement: use f-strings 2019-10-15 11:14:27 -05:00
David Lynch
d782928e0e Spacebattles is now on XenForo2 2019-10-12 10:51:22 -05:00
David Lynch
5e034a7d65 Xenforo let non-first-category threadmarks work
Currently this just requires passing a link to the reader view of a particular
category. In the future I might want to support more variants on this -- a
flag to pull down all the threadmark categories, for instance.
2019-08-06 17:29:53 -05:00
David Lynch
a148fa8c43 Flake8 errors 2019-07-13 13:17:54 -05:00
David Lynch
3443304ab1 XenForo: handle SV's XenForo2 changes 2019-07-13 11:42:22 -05:00
David Lynch
b1b51bdc8f Xenforo: clean out title prefixes 2019-06-17 16:13:09 -05:00
David Lynch
c8f5b3f8d8 XenForo should use reader-view if available
Much like 40b4856 greatly sped up AO3, this greatly speeds up XenForo
2019-05-29 01:56:39 -05:00
David Lynch
e78ffdb85b Method to get a site-key for config
Means that things like XenForoIndex and AO3Series don't require separate
config entries.
2018-10-11 15:42:59 -05:00
David Lynch
f17b040f64 Fix spacing 2018-09-29 14:32:38 -05:00
David Lynch
b3f4e720d0 Include AlternateHistory as a xenforo site
Fixes #18. Well, makes it unnecessary. Strictly, it'd maybe still be useful to
show how to do a XenForo site via `arbitary`.
2018-09-29 12:00:41 -05:00
David Lynch
18c9d68617 Xenforo: cope with ThreadmarksPro's fetchers 2018-09-15 00:18:07 -05:00
Will Oursler
d1842e2bf1 Adds a system for site options to be included as click.options on commands. 2018-04-14 12:56:31 -04:00
Will Oursler
ecebf1de58 Merge branch 'master' into clickify 2018-04-13 17:52:37 -04:00
David Lynch
6d52c72c99 Use logging instead of print
Fixes #10
2017-11-04 00:09:09 -05:00
David Lynch
43599aceb5
Merge branch 'master' into clickify 2017-11-03 15:21:44 -05:00
David Lynch
27b677a444 Fix no-threadmarks autodetect 2017-10-29 19:50:19 -05:00
Will Oursler
c702337040 Reworks how site-specific options work. 2017-10-13 19:37:13 -04:00
Will Oursler
db48233cf4 Switch from using raw argparser to using click. Preserves the existing
interface, except leech --flush becomes leech flush
2017-10-12 13:00:24 -04:00
Will Oursler
5bd07a5b90 Splits out ebook generation logic into a seperate module, in anticipation of maybe supporting multiple output formats. 2017-10-12 09:49:32 -04:00
David Lynch
2ce43c9da7 Xenforo: turn some styles into tags 2017-10-05 13:47:16 -05:00
David Lynch
6840d8a4c9 Xenforo: threadmarks fallback 2017-08-03 16:14:40 -05:00
David Lynch
63e7a0de37 Xenforo: threadmark changes 2017-07-24 22:50:18 -05:00
David Lynch
0230993cb4 Make xenforo title select pickier 2017-03-17 22:39:56 -05:00
David Lynch
40042cdb46 Xenforo: exclude threadmarks from links, too 2017-03-13 00:08:53 -05:00
David Lynch
5b4b9a0dc3 Canonicalize URLs 2017-02-23 15:03:23 -06:00
David Lynch
9e542c9018 Decompose xenforo hidden blockquote notes 2017-02-23 14:20:24 -06:00
David Lynch
24f7137929 Fix footnote backlinks, from structure change 2017-02-05 12:38:12 -06:00
David Lynch
e6343cb1c9 Stories are now made of nested sections/chapters
This is prep-work for improving epub TOC generation a bit.
2017-01-10 00:23:24 -08:00