Jim Miller
0e28d86a7b
Fix for zip files, status in epub.
2011-05-05 20:47:39 -05:00
Jim Miller
94669a2179
Fix up exception handling, first working appengine(SDK) version.
2011-05-04 17:54:36 -05:00
Jim Miller
547411666d
Move CLI up a level to match appengine, change module packaging to suit.
...
Change mechanism for loading adapters to avoid problems with module init.
Move adapter exceptions to own file.
2011-05-04 14:29:24 -05:00
Jim Miller
150316f460
Commit first version of reorg/rewrite. Currently CLI only.
2011-05-03 11:27:58 -05:00
Jim Miller
f75abaad72
3-0-2 Add convert link feature. Remove title page table(for convert). Make favicon.ico work.
2011-05-02 13:54:48 -05:00
Jim Miller
bdaea79875
Previous change to elim newlines in debug sometimes output breaks download.
...
Cheap fix, comment out debugs.
2011-05-02 13:12:16 -05:00
Jim Miller
7420d27652
More log clean up, better handling of bad URL in ficwad, missing story in ffnet.
2011-04-26 17:22:51 -05:00
Jim Miller
1426626d0a
Strip leading newline so it doesn't (falsely) show up in appengine logs as error.
2011-04-25 19:57:40 -05:00
Jim Miller
666e9666cd
Attempting to help with ffnet failures. Increase fetch deadline, add retries with backoff, 1/2 sleep.
...
Also remove <> from error message--HTML eats it.
2011-04-22 17:03:43 -05:00
Jim Miller
1c2c1a5d62
Add support for twiwrite.net. Requires User/Pass like twilighted.net.
2011-04-20 22:34:59 -05:00
Jim Miller
7c5aaa36d5
Save recent downloads longer(5 days, was 2). Fix some redirects.
...
Reduces log errors and makes auto-re-login more transparent.
2011-04-20 17:32:30 -05:00
sigizmund
13b96946d1
Improving logging, can dump the data which was downloaded if download fails.
2011-04-19 12:49:37 +01:00
sigizmund
1119ba52a0
Replaced ad block
2011-04-18 11:07:56 +01:00
Jim Miller
b058477b97
Fix so recent, but pre-compress mobis will still download.
2011-04-03 16:55:51 -05:00
Jim Miller
1f303013bd
Fix to allow retrying, compress mobi chunks, Working/Finished/Failed in status.html title, keep 3 days worth.
2011-04-03 16:47:08 -05:00
Jim Miller
302a8f12a3
Removing storage for old version. Fixes for whofic meta data.
2011-04-01 22:14:05 -05:00
retiefjimm
3e381dd33f
Still tweaking the clean up cron.
2011-03-24 22:09:11 -05:00
retiefjimm
bd82311d51
Mobi improvements: Mark TOC so reader can find it, don't let reader eat every 4096th char, don't prettify. Remove debug outputs from whofic. Increase fetch size of remover.
2011-03-24 12:57:38 -05:00
retiefjimm
efb521c829
Added tag fanficdownloader-0.5 for changeset 0f08ff79de17
2011-03-22 19:45:47 -05:00
retiefjimm
925324bd13
Improved (but not perfected) mobi file output. Reduce cron clean up time to 2 days.
2011-03-22 19:17:41 -05:00
retiefjimm
1d1ed1ef71
Add support for www.whofic.com.
2011-03-22 19:11:17 -05:00
retiefjimm
389fc010f2
After merging QueueProc changes, tweaks clean up cron times and change appspot instance name.
2011-03-22 12:59:12 -05:00
Jim Miller
5ab5991d6e
Merging QueueProc changes to trunk.
2011-03-22 12:48:17 -05:00
retiefjimm
8c606e45fd
Remove 2 sec sleep before making live version.
2011-03-17 17:03:25 -05:00
retiefjimm
e645c054d8
adastrafanfic can have chapters with tags (<i>) in them. Allow get as well as post.
2011-03-15 14:49:16 -05:00
retiefjimm
e6ebd956f8
Datastore max size is 1,000,000, not 1M(=2^20).
2011-03-10 14:30:42 -06:00
retiefjimm
ef5e7700b9
Back out some changes I didn't actually mean to commit. Just some custom stuff.
2011-03-10 13:14:51 -06:00
retiefjimm
53e2a0f204
First version with background queue processing and support for stories >1M.
2011-03-10 13:00:11 -06:00
retiefjimm
0e9d992e13
Make Branch for conversion to Queue Processing.
2011-03-04 11:58:53 -06:00
retiefjimm
790aca39da
Add epubmerge.py, a standalone CLI program to merge multiple epubs together into one.
2011-02-24 18:02:49 -06:00
retiefjimm
7064873b4e
Put title, author and publisher into mobi files properly as meta data. Also strips non-ascii chars from t,a,p--caused problems with mobi gen.
...
Calibre's book reader cannot read the mobi files produced from fanficdownloader, either before or after these changes.
2011-01-23 13:37:29 -06:00
retiefjimm
95e7ba636d
Add commas to word counts.
2011-01-15 10:41:28 -06:00
sigizmund
fe557bbce5
Fixed downloading mobi from fdown
2011-01-03 20:35:15 +00:00
retiefjimm
783a614345
Enable collection of user's own user/password again. Only used by twilighted.net.
2010-12-27 11:29:12 -06:00
retiefjimm
a32ccf7dac
Work around an SGMLParser/BeautifulStoneSoup entity bug--incorrectly inserts (;) when it shouldn't, "AT&T" becomes "AT&T;". Also update to latest BeautifulSoup: has one minor, unrelated change.
2010-12-19 12:21:55 -06:00
retiefjimm
d3abfbf5d6
Add Star Trek fanfic site adastrafanfic.com, plus add filename(linenum) to logger output for CLI.
2010-12-13 23:31:35 -06:00
retiefjimm
d95c72f447
Split info line in ffnet by ' - ' instead of just '-' so Sci-Fi doesn't become just 'Sci'. fpcom already does.
2010-12-08 17:40:10 -06:00
retiefjimm
e05749678e
Move status->subject into output.py as per Bill's suggestion.
2010-12-06 15:03:07 -06:00
retiefjimm
f7d94105ee
Correct example URL.
2010-12-05 21:40:04 -06:00
retiefjimm
50b0573033
Add status (In-Progress or Completed) to metadata as a Subject tag.
2010-12-05 21:38:16 -06:00
wsuetholz
48b882c745
2 second sleep was in Mediaminer as well.
2010-12-05 21:21:44 -06:00
wsuetholz
3fdd079b97
Merge with 8d1772310e5c4ad1772a92b1f0408952b0b370e2
2010-12-05 20:58:38 -06:00
wsuetholz
e674f7c7df
There was still a 2 second sleep between chapters for the fictonpress adapter.. Keep in mind that if you do a lot of downloading from fanfiction.net or fictionpress.com it is possible that your IP address could be locked without the sleep in place.
2010-12-05 20:52:13 -06:00
retiefjimm
8f58164dde
Added tag fanficdownloader-0.4 for changeset f23fd0e4cbc3
2010-12-02 17:36:52 -06:00
wsuetholz
4c99fdbcc1
Removed some leftover functions that were left from using ffnet.py as a base for fpcom.py and mediaminer.py.
2010-11-30 15:17:00 -06:00
wsuetholz
c6b79cb57b
Changed the "Title Page" reference in the TOC and CONTENT epub files to be title_page instead.
2010-11-30 15:11:20 -06:00
wsuetholz
f114a2438e
This one might be controversial..
...
Since none of the EBook readers are really for update-able stories I added tags/subjects in for Last Update Year/Month and Last Update, which at least in FBReader I can order by, and see all stories updated for a certain month, or a certain date. This will let you know to reread the story.
2010-11-30 14:06:12 -06:00
wsuetholz
2f0bb31e24
Take out adding the id: field as a subject.
2010-11-30 13:56:18 -06:00
wsuetholz
30455bfda2
Updated the processing for fictionpress.com of the information line to correctly extract the Updated and Published dates, and the Completion status
2010-11-30 12:13:00 -06:00
wsuetholz
cfb218f21e
Moved the check for a completed story higher in the code, this makes the continue's that are in that portion of the if statement not skip that check.
2010-11-29 18:45:47 -06:00
