Backup_Repos/leech
1
0
Fork 0
mirror of https://github.com/kemayo/leech synced 2025-12-15 12:56:41 +01:00
Code Issues Projects Releases Wiki Activity
320 commits 2 branches 0 tags 1.3 MiB
Commit graph

320 commits

This branch
This branch
All branches
Author SHA1 Message Date
Idan Dor
1edde92a9d Fixed whitespacing for flake8. 2024-11-23 13:22:53 -06:00
Idan Dor
31f663c6e0 Added image embedding support for epub 
Specifically, added image_selector for arbitrary sites that allows
selecting img tags from chapters, downloading them
and embedding them within the resulting epub.

In the case of Pale, this means that the character banners and
extra materials do not require an internet connection to view.

Also made the two pale.json's more consistent (pale.json now correctly
includes the title of the chapters).
 2024-11-23 13:22:53 -06:00
IdanDor
7c877ad589 Added examples 2024-11-23 13:22:53 -06:00
David Lynch
59280e4fa7 Bump poetry.lock 2024-11-23 13:22:31 -06:00
David Lynch
7967c59636 Support 2fa for xenforo logins 2024-10-13 00:52:50 -05:00
David Lynch
249221f5d7 Fix questionable questing, which has moved to xenforo2 2024-05-14 22:08:22 -05:00
David Lynch
1f57cd6f07 Basic success-testing on logins 2024-05-14 22:07:05 -05:00
David Lynch
ef9309eb66 Fix xenforo login 2024-05-14 22:06:09 -05:00
David Lynch
7dc6543e44 Fix Wandering Inn 
Fixes #95
 2024-05-14 22:06:09 -05:00
David Lynch
cc423f62bb Fix the royalroad stolen-content removal 
They added speak:none to the CSS, and I was strictly checking for a rule
that only contained display:none.
 2024-02-10 20:05:49 -06:00
David Lynch
64d77b62db Improve cloudflare email decoding 
New format for the protected emails, wrapping a span in an a.
 2024-01-28 13:26:34 -06:00
David Lynch
d30e56a518 Strip out the new stolen-content warnings on royalroad 
They might make these harder to work out in the future, but for now...
 2024-01-19 21:34:39 -06:00
David Lynch
9171672663 Pillow 10 removed the deprecated ImageDraw.textsize 2023-11-15 01:18:06 -06:00
David Lynch
2467ee26fe Update dependencies to newer versions 2023-11-15 00:00:44 -06:00
David Lynch
571a9d3b85 Update package versions 2023-08-06 18:03:51 -05:00
David Lynch
6c692968a4 Use isinstance rather than direct type comparison 2023-08-06 17:56:13 -05:00
David Lynch
03e9d3844f Add the-sietch.com to xenforo sites 2023-08-06 17:43:51 -05:00
David Lynch
5ddbb310b3 Let xenforo sites cope with index.php URLs 2023-08-06 17:43:28 -05:00
David Lynch
8dd20e17d9 Update github actions to use newer python versions 2023-05-04 10:08:56 -05:00
David Lynch
06cd8998ed Update poetry.lock 2023-05-04 10:00:33 -05:00
David Lynch
bd74ad0ec3 Update pyproject.toml build-system 2023-05-04 10:00:20 -05:00
David Lynch
f8ab88866f
Merge pull request #91 from flying-sheep/add-pale-lights 
Add “Pale Lights”
 2023-05-04 09:52:12 -05:00
David Lynch
7230f65a68 Add offset/limit options to royalroad 2023-05-04 09:42:13 -05:00
David Lynch
41f24ae1b5
Merge pull request #93 from KeinNiemand/upstream 
Don't prettify royalroad soup, Fixes #92
 2023-05-04 09:41:43 -05:00
KeinNiemand
356bae9a7a Don't prettify royalroad soup, Fixes #92 2023-05-04 13:17:28 +02:00
Philipp A
e5e9519227 Add pale lights recipe 2023-04-22 22:37:45 +02:00
David Lynch
6895a0eb61 AO3 single-chapter story bugs 2023-03-31 23:51:27 -05:00
David Lynch
fe5ca86d87 Royalroad's markup has changed slightly, fix so title and summary work 2023-03-17 16:06:52 -05:00
David Lynch
b8314341b2 Allow passing in multiple URLs 
Good trick: `./leech.py examples/practical{1,2,3,4,5,6,7}.json`
 2022-10-22 18:05:59 -05:00
David Lynch
c3b28d6169
Merge pull request #82 from 7h0m4s/Update_PracticalGuide_Example_Files 
Update Practical Guide example json
 2022-09-03 14:52:38 -05:00
Thomas Pegoraro
a3496c73b5 -Remove " .entry-wrapper" class from content_selector as the class doesn't exist on the Practical Guide website anymore. 
- Add Practical Guide book 7 json file.
 2022-09-03 13:14:54 +10:00
David Lynch
d81eefa7f3 AO3: use new form helper so this shouldn't break again if fields change 2022-05-13 11:04:25 -05:00
David Lynch
f57db3e1a8 Helper for extracting form data from a soup 2022-05-13 11:04:05 -05:00
David Lynch
e9f704716a Xenforo: change some of the style-removal 
It was causing some formatting issues, particularly on Worm fics which
did forum-style sections. (Also, indented text done via margin-left on
divs, which entirely removed the div and ran lines together.)
 2022-04-27 11:07:16 -05:00
David Lynch
56bc2b941c AO3: utf8 field no longer in login form 2022-04-16 18:26:26 -05:00
David Lynch
08abe54e79 Switch out use of :=, forgot I wasn't requiring 3.8 yet 2022-03-06 10:46:13 -06:00
David Lynch
172877410b Xenforo: if fetching a specific threadmark category, add it to the title 
Unless it's 1, since that's always "threadmarks" and the main story.

Refs #79
 2022-03-06 10:42:39 -06:00
David Lynch
64d97b09d0
Merge pull request #78 from codetheweb/feat-unsong 
Add Unsong
 2022-03-02 11:53:33 -06:00
Max Isom
2414edc1b1
Add Unsong 2022-02-25 21:39:23 -05:00
David Lynch
7eae5dee07 When downloading covers errors don't incorrectly concat a string 
Refs #77
 2022-02-22 12:24:50 -06:00
David Lynch
29589a0886 RoyalRoad: don't error when covers are relative URLs 
Only happens when the work has no set cover, because it gets a /dist/
URL rather than a CDN URL.

Fixes #77
 2022-02-22 12:19:58 -06:00
David Lynch
7eb48c872d Clean up epub file list generation 2022-02-13 12:25:01 -06:00
David Lynch
ba7f694ec4
Merge pull request #76 from kemayo/dependabot/pip/urllib3-1.26.5 
Bump urllib3 from 1.26.2 to 1.26.5
 2022-02-13 11:50:40 -06:00
dependabot[bot]
ebb543e727
Bump urllib3 from 1.26.2 to 1.26.5 
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.2 to 1.26.5.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.2...1.26.5)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-02-13 17:49:20 +00:00
David Lynch
c74cbac820
Merge pull request #73 from kemayo/dependabot/pip/pillow-9.0.0 
Bump pillow from 8.1.0 to 9.0.0
 2022-02-13 11:48:39 -06:00
David Lynch
f204dcd928 Add a class to generated spoiler divs 2022-02-13 11:44:36 -06:00
David Lynch
697e4c0bf9 Royalroad: don't crash on malformed spoiler tags 
Fixes #74
 2022-02-03 11:08:40 -06:00
dependabot[bot]
9949126676
Bump pillow from 8.1.0 to 9.0.0 
Bumps [pillow](https://github.com/python-pillow/Pillow) from 8.1.0 to 9.0.0.
- [Release notes](https://github.com/python-pillow/Pillow/releases)
- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)
- [Commits](https://github.com/python-pillow/Pillow/compare/8.1.0...9.0.0)

---
updated-dependencies:
- dependency-name: pillow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
 2022-01-13 03:54:53 +00:00
David Lynch
dc9c9dbe57 Pull summary and tags for royalroad 2021-11-07 13:16:59 -06:00
David Lynch
4242aa6f63 Strip colors on all sites, not just xenforo 2021-11-07 11:16:26 -06:00