Jim Miller
be34b6718f
Fix for trying to get story URLs with no books selected.
2014-09-11 11:47:00 -05:00
Jim Miller
79971745a2
Fix for AO3 story list URLs that already have a '?' in them.
2014-09-11 11:46:44 -05:00
Jim Miller
4819ca95b1
Added tag FFDL 2.0.04 for changeset e968a543cce3
2014-09-09 15:57:14 -05:00
Jim Miller
d9c6185e97
Update CLI download zip.
2014-09-09 15:57:05 -05:00
Jim Miller
e5d0fa7eed
Bump versions.
2014-09-09 15:55:29 -05:00
Jim Miller
b5180d9020
Don't need to fetch twice like that.
2014-09-08 16:18:17 -05:00
Jim Miller
9e0a3d7afa
Clear existing data_chunks when downloading again--web service.
2014-09-08 16:13:52 -05:00
Jim Miller
61ba4da640
Fix for changes to fanfiktion.de and enable caching.
2014-09-08 16:04:35 -05:00
Jim Miller
8bb26fd6f3
Change cache debug output to debug level.
2014-09-07 21:59:22 -05:00
Jim Miller
3151d45010
Fix for nhamagicalworldsus changes.
2014-09-07 21:59:05 -05:00
Jim Miller
81b87246d2
Update translations.
2014-09-05 12:58:18 -05:00
Jim Miller
530d7b0ab5
Extend page caching to AO3, fimf, portkey and buffynfaith.net.
2014-09-05 12:57:30 -05:00
Jim Miller
b682d0ba6b
Finish correction of getSiteExampleURLs(cls) correctly.
2014-09-05 11:28:17 -05:00
Jim Miller
af74529b32
Merge pre-base-efiction into default. trekiverse reverted, fannation and
...
maplebook using base_efiction.
2014-08-31 13:58:18 -05:00
Jim Miller
667c19ac3c
Adding fetched file caching feature and optimizing hits for ffnet in particular.
2014-08-31 13:48:47 -05:00
Jim Miller
5de217a0e3
Correct getSiteExampleURLs method def--it's a classmethod.
2014-08-27 15:57:05 -05:00
Jim Miller
3b62e77c01
Some additional messages for translation, from jobs.py.
2014-08-26 20:17:08 -05:00
Jim Miller
e2b6f3f416
Add adapter_sheppardweircom, from scout78.
2014-08-26 20:16:21 -05:00
Jim Miller
2aaa08f923
Fix so autoconvert won't delete FFDL's own output.
2014-08-26 20:15:35 -05:00
Jim Miller
c116dc9bf3
New translation for Portuguese (Brazil).
2014-08-21 12:07:57 -05:00
Jim Miller
8ede0411a9
Translations for new strings for Spanish and French.
2014-08-19 20:03:51 -05:00
Jim Miller
48e8716a9a
Fix numChapters in adapter_literotica.py.
2014-08-15 19:00:51 -05:00
Jim Miller
25097200ad
Merge pre-base-efiction into default. CLI zip does *not* contain base efiction.
2014-08-13 19:44:24 -05:00
Jim Miller
4084763d98
Added tag FFDL 2.0.03 for changeset 02a9eb028955
2014-08-13 19:43:19 -05:00
Jim Miller
d52d2f2438
Update CLI download zip.
2014-08-13 19:43:09 -05:00
Jim Miller
e47e4bf29a
Fix for AO3 authorUrl and authorId. Bump versions.
2014-08-13 19:38:10 -05:00
Jim Miller
fc0656ec1e
Merge pre-base-efiction into default. CLI zip does *not* contain base_efiction
2014-08-13 13:23:33 -05:00
Jim Miller
445d676d24
Added tag FFDL 2.0.02 for changeset 292fdb288fb0
2014-08-13 13:22:24 -05:00
Jim Miller
ef71577b73
Update CLI download zip.
2014-08-13 13:22:14 -05:00
Jim Miller
951fd68ce6
Fix for AO3 authors all coming out as Anonymous. Bump versions.
2014-08-13 13:19:36 -05:00
doe
ab01e26526
Merge eFiction-base-adapter
2014-08-12 03:26:18 +02:00
doe
e740166ba4
Merge upstream
2014-08-12 02:08:09 +02:00
doe
54616e9892
bdsmgesch: Even more generic chapter parsing
2014-08-12 02:06:04 +02:00
Jim Miller
3fbfa5b56c
Merge doe's changes with mine.
2014-08-11 16:11:33 -05:00
Jim Miller
0f166e1e4b
Merge with default
2014-08-11 16:08:43 -05:00
Jim Miller
a606db85d1
Fix for get URLs from page when urlsfromclip is off.
2014-08-11 16:04:08 -05:00
doe
15abab181f
bdsmgesch: Fix for wrongly matched next chapter URL
2014-08-11 17:34:54 +02:00
doe
d81b365aba
bdsmgesch: Better parsing of next/prev links, config option to guess chapter URLs to speed up metadata retrieval
2014-08-11 16:08:55 +02:00
doe
001f1d5fee
Removed getHighestWarningLevel, factored out constants
2014-08-09 03:56:29 +02:00
doe
6b0bebd82f
More metadata for trekiverse and fannation
...
* Romance/Read and Awards/Read
* Encoding set for trekiverse
2014-08-09 03:49:38 +02:00
doe
876255afdb
Make bulk loading optional in BaseEfictionAdapter
...
* Chapters can be downloaded one-by-one or once in extractChapterUrlsAndMetadata
* Both methods deliver the same list of chapter URLs, they are exchangeable
* getHighestWarningLevel obsolete now
* Regexes are compiled once
* Login/Warning logic improved
2014-08-09 03:47:33 +02:00
doe
40c9bcccf7
Added config option 'bulk_load' to config
...
* Setting this to true will load the complete story as printed
and keep it cached between extractMetadata & getChapter in
BaseEfictionAdapter based adapters
2014-08-09 03:40:48 +02:00
doe
8ae585728f
eFiction base: proper login / warning handling
...
* performLogin mostly from TrekiverseOrgAdapter
* handle 'not logged in' and 'be warned' cases
* abstracted strings to eFiction constants
* converted TrekiverseOrgAdapter to use base class
* metadata fields
* self.decode can be overriden with self.getEncoding() (@classmethod)
2014-08-08 15:59:10 +02:00
doe
c1915b05be
eFiction base: better metadata handling
...
* made most of the methods @classmethods
* checked the eFiction source to make sure the class uses the right defaults
* added documentation
* adapted implementing classes
2014-08-08 14:36:12 +02:00
doe
1bf21e09a0
Marked all adapters that are efiction based with a comment '# Software: eFiction'
2014-08-06 15:52:32 +02:00
doe
0c51160924
Foundations of an eFiction base adapter
...
* works for fannation and themaplebookshop
* metadata parsing must be more extensible
* missing documentation
* proper handling of warnings / is_adult checks
* ...
2014-08-06 15:33:21 +02:00
doe
6e897c78f1
themaplebookshelf: URL normalization in __init__
2014-08-06 02:10:25 +02:00
doe
52ccebf16e
tolkienfanfiction: Minor change to avoid un-normalized URIs
2014-08-06 01:28:58 +02:00
doe
a0e9123c58
Fixed wrong getSiteExampleURLs format in bdsmgesch
2014-08-06 01:22:38 +02:00
doe
6e93ded2a3
merge upstream
2014-08-06 01:18:49 +02:00
