Commit graph

4095 commits

Author SHA1 Message Date
Jim Miller
88bf48ce44 Remove unused copy of six.py 2021-01-25 12:49:01 -06:00
Jim Miller
b9998abc48 Replace own retry system with urllib3.util.retry.Retry. 2021-01-25 12:34:49 -06:00
Jim Miller
b0cbb7da0d Fix INI _filelist by not using same fetcher anymore. 2021-01-24 17:12:07 -06:00
Jim Miller
8e58e90e84 Refactor Requestable class from Configurable and move decode and zalgo there -- INI _filelist broken? 2021-01-24 15:55:21 -06:00
Jim Miller
75b1cc23b5 Refactor _fetchUrl() to get_request() 2021-01-24 14:12:41 -06:00
Jim Miller
3ba65f922b Refactor _fetchUrlRaw() to get_request_raw() 2021-01-24 14:07:04 -06:00
Jim Miller
38a9c7db05 Refactor _fetchUrlOpened() to get_request_redirected() and remove FakeOpened. 2021-01-24 13:44:35 -06:00
Jim Miller
2e905841e2 Always use requests, no parameters on GETs, still FakeOpened and now fake HTTPError 2021-01-24 13:15:32 -06:00
Jim Miller
7c262e71fa Refactor _fetchUrl()s implicit POST to explicit post_request()s 2021-01-23 15:02:48 -06:00
Jim Miller
b948591389 Refactor: rename _postUrl to post_request 2021-01-23 14:04:50 -06:00
Jim Miller
0822212bcb Remove overly complicated _customized_fetch_url() that was complicating refactoring. 2021-01-23 14:03:07 -06:00
Jim Miller
22b1bca6cd Working on refactor network fetch code. 2021-01-23 13:09:11 -06:00
Jim Miller
f9a1fef55d Bump Test Version 3.29.2 2021-01-23 10:24:56 -06:00
Jim Miller
df016a5e36 Fix for chapter error report. Closes #641 2021-01-23 10:24:38 -06:00
Jim Miller
96d0167538 Bump Test Version 3.29.1 2021-01-20 12:27:50 -06:00
Jim Miller
8b1da6f6ec adapter_fanfictionnet: Start keeping story title part of storyUrl. 2021-01-20 12:27:42 -06:00
Jim Miller
0479e418b2 Bump Release Version 3.29.0 Closes #622 2021-01-20 09:52:08 -06:00
Jim Miller
88f1b9c44d Update translations. 2021-01-20 09:46:40 -06:00
Jim Miller
ef98363abb Bump Test Version 3.28.8 2021-01-18 11:45:45 -06:00
Jim Miller
1342e87c14 New strings for translation. 2021-01-18 11:45:38 -06:00
Jim Miller
03c19c10a3 Add better chapter error reporting, refactor proceed_question code. 2021-01-18 11:42:33 -06:00
Jim Miller
eeedfdee87 Add plugin options to mark success/failed/chapter error individually. 2021-01-18 11:05:30 -06:00
Jim Miller
0e95125464 Bump Test Version 3.28.7 2021-01-17 13:47:38 -06:00
Jim Miller
fd46963301 Clear metadata cache after adapter metadata fetch. Cached metadata values may not be replace_metadata processed if fetched before their conditional dependencies. Revealed by AO3 one-shots using title for chapter name. 2021-01-17 13:46:56 -06:00
Jim Miller
210a6a5589 Bump Test Version 3.28.6 2021-01-16 15:25:46 -06:00
Jim Miller
b6b3c9425c Report cloudscraper exceptions as such, plus hide the potentially misleading 'opensource' part.
Closes #634
2021-01-16 15:25:10 -06:00
Jim Miller
7b35682ffd Tweek ffnet/fpcom sleep times again. 2021-01-16 13:10:41 -06:00
Jim Miller
48e042064d slow_down_sleep_time: randomize between 0.5 time and 1.5 time. 2021-01-16 13:08:26 -06:00
Jim Miller
e7a70a8301 Increase times betwen retries on fetch error. 2021-01-16 12:50:20 -06:00
Jim Miller
ffde5bfdb5 Update to cloudscraper v1.2.52 2021-01-16 12:45:08 -06:00
Jim Miller
967993cef2 Bump Test Version 3.28.5 2021-01-16 11:22:29 -06:00
Jim Miller
c84f9f2895 Report chapter_error in custom error column and marked (when configured). 2021-01-16 11:18:16 -06:00
Jim Miller
37cdec2f27 Bump Test Version 3.28.4 2021-01-16 10:23:17 -06:00
Jim Miller
6e68624f2a First rough version of reporting continue_on_chapter_error chapters. 2021-01-16 10:22:50 -06:00
Jim Miller
0cb2053be5 Tweak adapter_test1 chapter error case 2021-01-16 08:39:28 -06:00
Jim Miller
ea82a094f9 ffnet fpcom, continue_on_chapter_error:true by default, increase sleep times. 2021-01-16 08:33:26 -06:00
Jim Miller
69a436af98 Re-enable ffnet and bump up sleep times for same. 2021-01-15 20:06:53 -06:00
Jim Miller
6c0a6594ff Bump Test Version 3.28.3 2021-01-15 10:24:14 -06:00
Jim Miller
feeba370ed adapter_fanficsme: do an extra fetch before login for cookie(?) Closes #633 2021-01-15 10:24:04 -06:00
Jim Miller
e433339f6b Bump Test Version 3.28.2 2021-01-14 10:25:00 -06:00
Jim Miller
07f19f5f70 adapter_webnovelcom: Fixes for site changes. Closes #629 2021-01-14 10:24:50 -06:00
Jim Miller
b2a7986b8f Update translations. 2021-01-11 12:53:10 -06:00
Jim Miller
2593044309 Bump Test Version 3.28.1 2021-01-11 11:49:12 -06:00
Jim Miller
c3ff444b30 quotev.com: site change in date parse, use utf8:ignore as first encoding choice. Closes #625 2021-01-11 11:48:41 -06:00
Jim Miller
a1ea9d0f11 Bump Release Version 3.28.0 2021-01-11 09:06:42 -06:00
Jim Miller
c74460bb56 Update translations 2021-01-11 09:05:08 -06:00
Jim Miller
50dff16eef Tweak disable adapter_fanfictionnet text. 2021-01-10 13:10:45 -06:00
Jim Miller
d85b4b73a6 Bump Test Version 3.27.6 2021-01-09 22:17:15 -06:00
Jim Miller
83dc85d801 Catch exception from emails not decoding, skip & logger.error(). 2021-01-09 22:17:05 -06:00
Jim Miller
18bf6445e0 Disable adapter_fanfictionnet with warning about site blocking. 2021-01-09 12:11:28 -06:00