Jim Miller
|
b76e812eaa
|
Orphan search exceeds queued task DB timeout as well. Use smaller search
like the regular cleanup and leave manual instead of cron.
|
2011-06-03 21:07:02 -05:00 |
|
Jim Miller
|
ecabbd3af2
|
Use task queue for orphan chunk clean up.
|
2011-06-03 20:40:40 -05:00 |
|
Jim Miller
|
152ee61ed4
|
Now I remember why cleanup was limited--task timeout. Basic reverted to 100
each time, but still by time not day, orphan search will have to become a queue
task--unscheduled for now.
|
2011-06-03 20:12:04 -05:00 |
|
Jim Miller
|
f2283a2052
|
Improve download cleanup, add orphan chunk cleanup, add recent list clear,
improve mediaminer no such story detect.
|
2011-06-03 20:03:14 -05:00 |
|
Jim Miller
|
fb5740c549
|
Install hook to make urlfetch deadline 10s, add limited retry on fetch error.
|
2011-06-02 16:10:19 -05:00 |
|
Jim Miller
|
7133189601
|
Added tag fanficdownloader-4.0.1 for changeset 265d84461442
|
2011-06-02 12:35:37 -05:00 |
|
Jim Miller
|
6d24caee1e
|
Tweak status.html and test1.com.
|
2011-06-02 12:35:13 -05:00 |
|
Jim Miller
|
583275f037
|
Added tag fanficdownloader-4.0.1 for changeset 01d49b13cc3c
|
2011-05-30 23:02:16 -05:00 |
|
Jim Miller
|
50b80b6d68
|
4-0-1 Add mobi back in, changes to recent&status appearance, more reliability.
|
2011-05-30 23:02:00 -05:00 |
|
Jim Miller
|
f7857ad6dc
|
Suppress warnings about Django version.
|
2011-05-30 15:48:35 -05:00 |
|
Jim Miller
|
a3f75cb3eb
|
Improve error handling/reporting, make redownloads appear at top of recent list.
|
2011-05-30 15:05:00 -05:00 |
|
Jim Miller
|
94063d478c
|
Pass normalized URL to queue task, not original url.
|
2011-05-30 09:59:37 -05:00 |
|
Jim Miller
|
f25eae83d3
|
Save corrected URL in DownloadMeta record so status & recent have good URL.
|
2011-05-29 21:21:02 -05:00 |
|
Jim Miller
|
433e371b74
|
Enable (www|m). for fictionpress.com, like ff.net.
|
2011-05-29 17:03:02 -05:00 |
|
Jim Miller
|
def2937327
|
Save appengine version in DownloadMeta to aid troubleshooting.
|
2011-05-29 13:07:12 -05:00 |
|
Jim Miller
|
e99adf3fa9
|
Allow trailing / after /Story_Title on ff.net, fp.com urls.
|
2011-05-29 10:44:46 -05:00 |
|
Jim Miller
|
a05bf24ed3
|
Fix typo that prevented some proper fictionpress.com urls from working.
|
2011-05-28 21:28:54 -05:00 |
|
Jim Miller
|
aa58f1c1ee
|
Make much more forgiving of inexact URLs--that's most of our errors now.
|
2011-05-28 16:09:34 -05:00 |
|
Jim Miller
|
35aeae59f2
|
Tweaking logging slightly.
|
2011-05-27 20:43:36 -05:00 |
|
Jim Miller
|
6d5785a5ac
|
Added tag fanficdownloader-4.0.0 for changeset 3dbb4938aead
|
2011-05-23 18:33:56 -05:00 |
|
Jim Miller
|
07fbb8c5d5
|
Bring 4.0.0 branch into trunk.
|
2011-05-23 18:26:24 -05:00 |
|
Jim Miller
|
ac74918005
|
Make this default appengine version, downloader.py honors -f, remove extratags from default title page.
|
2011-05-23 17:36:56 -05:00 |
|
Jim Miller
|
b85a5ab95b
|
Include announcement of new version.
|
2011-05-23 17:35:24 -05:00 |
|
Jim Miller
|
215552af00
|
Strip html tags and entities from epub chapter titles.
|
2011-05-20 09:56:53 -05:00 |
|
Jim Miller
|
7f0c989319
|
Reduce logging level of normal system exceptions.
|
2011-05-19 20:36:19 -05:00 |
|
Jim Miller
|
d38360be6b
|
Fix zip output file name.
|
2011-05-19 17:30:41 -05:00 |
|
Jim Miller
|
bf52020876
|
Bump html output title size back up to h1.
|
2011-05-19 10:35:41 -05:00 |
|
Jim Miller
|
58b95af0da
|
Fixes for various problems found during testing, remove old files. Beta ready.
|
2011-05-16 12:38:42 -05:00 |
|
Jim Miller
|
df9e877865
|
Fixes to various from first round testing and some code clean up.
|
2011-05-13 21:34:58 -05:00 |
|
Jim Miller
|
a88d4cac50
|
Support for fictionalley.org, add feature to not overwrite files newer than last
update, fix to config section precedence, consolidate date parsing a bit.
|
2011-05-11 22:44:18 -05:00 |
|
Jim Miller
|
756b6944fc
|
Support for mediaminer.org, update copyrights.
|
2011-05-11 12:29:59 -05:00 |
|
Jim Miller
|
6d2f657729
|
Support for thewriterscoffeeshop.com, allow both login/pass and Are Adult in one site.
|
2011-05-10 13:26:34 -05:00 |
|
Jim Miller
|
9b2450a609
|
Support for twiwrite.net, potionsandsnitches.com & harrypotterfanfiction.com.
|
2011-05-09 21:20:06 -05:00 |
|
Jim Miller
|
36d4b9afcf
|
Add adastrafanfic.com support and support to confirm adult w/o login/pass.
|
2011-05-09 14:46:05 -05:00 |
|
Jim Miller
|
d90c9ebced
|
Support for ficwad.com. Further tweaks/improvments, especially to user config.
(I'm getting a bit carried away with making things configurable, honestly.)
|
2011-05-08 21:53:06 -05:00 |
|
Jim Miller
|
ecd1690b70
|
Add fictionpress.com adapter, some more tweak/fixes.
|
2011-05-07 15:14:46 -05:00 |
|
Jim Miller
|
87a57cc286
|
Add (partial) CLI options, fixes to site editconfig.
|
2011-05-07 12:51:03 -05:00 |
|
Jim Miller
|
d91f2e74fd
|
Only ask for Login/Password when required. Save and use user configuration.
|
2011-05-06 20:33:54 -05:00 |
|
Jim Miller
|
d3b1ddcda9
|
Added tag fanficdownloader-3.0.2 for changeset 564ada569d46
|
2011-05-06 19:59:04 -05:00 |
|
Jim Miller
|
a7b80388dd
|
Merge changes from trunk to 4-0 branch.
|
2011-05-06 13:00:32 -05:00 |
|
Jim Miller
|
9515ff00be
|
Tweak output a bit, allow any 'entry' as epub subject.
|
2011-05-06 12:42:20 -05:00 |
|
sigizmund
|
605c4c40fc
|
Mis-aligned ad block
|
2011-05-06 12:00:50 +01:00 |
|
sigizmund
|
3e1f0dd53b
|
Fixing screwed Google Analytics tracking code. I don't know how, but it nearly disappeared and our impressions went down from 250+ a day to around 30.
|
2011-05-06 11:24:27 +01:00 |
|
Jim Miller
|
0e28d86a7b
|
Fix for zip files, status in epub.
|
2011-05-05 20:47:39 -05:00 |
|
Jim Miller
|
94669a2179
|
Fix up exception handling, first working appengine(SDK) version.
|
2011-05-04 17:54:36 -05:00 |
|
Jim Miller
|
547411666d
|
Move CLI up a level to match appengine, change module packaging to suit.
Change mechanism for loading adapters to avoid problems with module init.
Move adapter exceptions to own file.
|
2011-05-04 14:29:24 -05:00 |
|
Jim Miller
|
150316f460
|
Commit first version of reorg/rewrite. Currently CLI only.
|
2011-05-03 11:27:58 -05:00 |
|
Jim Miller
|
f75abaad72
|
3-0-2 Add convert link feature. Remove title page table(for convert). Make favicon.ico work.
|
2011-05-02 13:54:48 -05:00 |
|
Jim Miller
|
bdaea79875
|
Previous change to elim newlines in debug sometimes output breaks download.
Cheap fix, comment out debugs.
|
2011-05-02 13:12:16 -05:00 |
|
Jim Miller
|
7420d27652
|
More log clean up, better handling of bad URL in ficwad, missing story in ffnet.
|
2011-04-26 17:22:51 -05:00 |
|