Commit graph

16 commits

Author SHA1 Message Date
Rae Knowler
c51161c3d1 Include Accept:image/* header when requesting an image url 2025-06-07 12:50:12 -05:00
Jim Miller
ac61c2bb68 AO3 use_archive_transformativeworks_org option 2025-03-16 13:52:52 -05:00
Jim Miller
d76fa989d1 Fix encoding auto/chardet 2023-01-01 13:06:03 -06:00
Jim Miller
2192b4fccd Fix reduce_zalgo not imported. 2021-02-20 15:15:22 -06:00
Jim Miller
f02b854343 Remove 'extrasleep' feature--it was ugly--increase slow_down_sleep_time for the couple sites that used it. We can trust the users, right? 2021-01-31 11:34:38 -06:00
Jim Miller
8ba5d2c423 Refactor use_pagecache into an INI setting and a sharable, thread safe cache impl. 2021-01-29 17:31:30 -06:00
Jim Miller
dd261dec96 Re-refactor cache code to not be a fetcher and instead dynamically 'decorate' fetcher do_request with caching code. 2021-01-28 22:10:54 -06:00
Jim Miller
7c6817bc4f Don't use _method names in new code. 2021-01-28 21:16:23 -06:00
Jim Miller
f8d976f42e Refactor fetcher cache into a dynamic subclass of Fetcher impls. 2021-01-28 21:14:15 -06:00
Jim Miller
aa5706f372 Fix Referer header code. 2021-01-27 13:35:42 -06:00
Jim Miller
a906d8f26b Partial refactoring of cache code. 2021-01-27 11:50:55 -06:00
Jim Miller
59a19a7510 Refactor requests code into own fetcher subclass. 2021-01-26 16:28:40 -06:00
Jim Miller
66520e236c Remove unused imports fanficfare 2021-01-25 20:53:31 -06:00
Jim Miller
4959b6eb4f Refactor out some unneeded methods. 2021-01-25 13:20:57 -06:00
Jim Miller
b9998abc48 Replace own retry system with urllib3.util.retry.Retry. 2021-01-25 12:34:49 -06:00
Jim Miller
8e58e90e84 Refactor Requestable class from Configurable and move decode and zalgo there -- INI _filelist broken? 2021-01-24 15:55:21 -06:00