Commit graph

4105 commits

Author SHA1 Message Date
Jim Miller
10993a4fe2 Remove unused imports calibre-plugin 2021-01-25 21:09:24 -06:00
Jim Miller
00d9c42e57 Remove unused imports writers 2021-01-25 20:54:11 -06:00
Jim Miller
66520e236c Remove unused imports fanficfare 2021-01-25 20:53:31 -06:00
Jim Miller
edd089237e Remove unused imports adapters 2021-01-25 20:53:04 -06:00
Jim Miller
1d8c10b168 Re-impl use_ssl_unverified_context option. 2021-01-25 20:30:08 -06:00
Jim Miller
ca9ea7ef99 Need User-Agent for POST too. Still need to integrate get/post. 2021-01-25 19:28:19 -06:00
Jim Miller
ea29473239 Consolidate 404->StoryDoesNotExist checks in one place. 2021-01-25 18:13:17 -06:00
Jim Miller
8175361275 Update and keep kludge for 500 trekfanfiction.net server error. 2021-01-25 14:08:39 -06:00
Jim Miller
4959b6eb4f Refactor out some unneeded methods. 2021-01-25 13:20:57 -06:00
Jim Miller
bd3fb5dfe1 Fix file:// fetch mostly for default_cover_image 2021-01-25 12:54:15 -06:00
Jim Miller
88bf48ce44 Remove unused copy of six.py 2021-01-25 12:49:01 -06:00
Jim Miller
b9998abc48 Replace own retry system with urllib3.util.retry.Retry. 2021-01-25 12:34:49 -06:00
Jim Miller
b0cbb7da0d Fix INI _filelist by not using same fetcher anymore. 2021-01-24 17:12:07 -06:00
Jim Miller
8e58e90e84 Refactor Requestable class from Configurable and move decode and zalgo there -- INI _filelist broken? 2021-01-24 15:55:21 -06:00
Jim Miller
75b1cc23b5 Refactor _fetchUrl() to get_request() 2021-01-24 14:12:41 -06:00
Jim Miller
3ba65f922b Refactor _fetchUrlRaw() to get_request_raw() 2021-01-24 14:07:04 -06:00
Jim Miller
38a9c7db05 Refactor _fetchUrlOpened() to get_request_redirected() and remove FakeOpened. 2021-01-24 13:44:35 -06:00
Jim Miller
2e905841e2 Always use requests, no parameters on GETs, still FakeOpened and now fake HTTPError 2021-01-24 13:15:32 -06:00
Jim Miller
7c262e71fa Refactor _fetchUrl()s implicit POST to explicit post_request()s 2021-01-23 15:02:48 -06:00
Jim Miller
b948591389 Refactor: rename _postUrl to post_request 2021-01-23 14:04:50 -06:00
Jim Miller
0822212bcb Remove overly complicated _customized_fetch_url() that was complicating refactoring. 2021-01-23 14:03:07 -06:00
Jim Miller
22b1bca6cd Working on refactor network fetch code. 2021-01-23 13:09:11 -06:00
Jim Miller
f9a1fef55d Bump Test Version 3.29.2 2021-01-23 10:24:56 -06:00
Jim Miller
df016a5e36 Fix for chapter error report. Closes #641 2021-01-23 10:24:38 -06:00
Jim Miller
96d0167538 Bump Test Version 3.29.1 2021-01-20 12:27:50 -06:00
Jim Miller
8b1da6f6ec adapter_fanfictionnet: Start keeping story title part of storyUrl. 2021-01-20 12:27:42 -06:00
Jim Miller
0479e418b2 Bump Release Version 3.29.0 Closes #622 2021-01-20 09:52:08 -06:00
Jim Miller
88f1b9c44d Update translations. 2021-01-20 09:46:40 -06:00
Jim Miller
ef98363abb Bump Test Version 3.28.8 2021-01-18 11:45:45 -06:00
Jim Miller
1342e87c14 New strings for translation. 2021-01-18 11:45:38 -06:00
Jim Miller
03c19c10a3 Add better chapter error reporting, refactor proceed_question code. 2021-01-18 11:42:33 -06:00
Jim Miller
eeedfdee87 Add plugin options to mark success/failed/chapter error individually. 2021-01-18 11:05:30 -06:00
Jim Miller
0e95125464 Bump Test Version 3.28.7 2021-01-17 13:47:38 -06:00
Jim Miller
fd46963301 Clear metadata cache after adapter metadata fetch. Cached metadata values may not be replace_metadata processed if fetched before their conditional dependencies. Revealed by AO3 one-shots using title for chapter name. 2021-01-17 13:46:56 -06:00
Jim Miller
210a6a5589 Bump Test Version 3.28.6 2021-01-16 15:25:46 -06:00
Jim Miller
b6b3c9425c Report cloudscraper exceptions as such, plus hide the potentially misleading 'opensource' part.
Closes #634
2021-01-16 15:25:10 -06:00
Jim Miller
7b35682ffd Tweek ffnet/fpcom sleep times again. 2021-01-16 13:10:41 -06:00
Jim Miller
48e042064d slow_down_sleep_time: randomize between 0.5 time and 1.5 time. 2021-01-16 13:08:26 -06:00
Jim Miller
e7a70a8301 Increase times betwen retries on fetch error. 2021-01-16 12:50:20 -06:00
Jim Miller
ffde5bfdb5 Update to cloudscraper v1.2.52 2021-01-16 12:45:08 -06:00
Jim Miller
967993cef2 Bump Test Version 3.28.5 2021-01-16 11:22:29 -06:00
Jim Miller
c84f9f2895 Report chapter_error in custom error column and marked (when configured). 2021-01-16 11:18:16 -06:00
Jim Miller
37cdec2f27 Bump Test Version 3.28.4 2021-01-16 10:23:17 -06:00
Jim Miller
6e68624f2a First rough version of reporting continue_on_chapter_error chapters. 2021-01-16 10:22:50 -06:00
Jim Miller
0cb2053be5 Tweak adapter_test1 chapter error case 2021-01-16 08:39:28 -06:00
Jim Miller
ea82a094f9 ffnet fpcom, continue_on_chapter_error:true by default, increase sleep times. 2021-01-16 08:33:26 -06:00
Jim Miller
69a436af98 Re-enable ffnet and bump up sleep times for same. 2021-01-15 20:06:53 -06:00
Jim Miller
6c0a6594ff Bump Test Version 3.28.3 2021-01-15 10:24:14 -06:00
Jim Miller
feeba370ed adapter_fanficsme: do an extra fetch before login for cookie(?) Closes #633 2021-01-15 10:24:04 -06:00
Jim Miller
e433339f6b Bump Test Version 3.28.2 2021-01-14 10:25:00 -06:00