Commit graph

1898 commits

Author SHA1 Message Date
Kovid Goyal
764e8bff7e
Remove py3 conditionals 2020-08-22 18:47:56 +05:30
Kovid Goyal
9ff27782de
Remove useless __future__ imports
Not needed on python3
2020-08-22 18:47:55 +05:30
Kovid Goyal
29cd8d64ea
Change shebangs to python from python2
Also remove a few other miscellaneous references to python2
2020-08-22 18:47:51 +05:30
Kovid Goyal
c7b66aada8
Dont use calibre-debug to build pot files 2020-07-31 23:26:02 +05:30
Kovid Goyal
01c9ffee6f
Cant avoid bootstrapping calibre 2020-07-31 22:51:08 +05:30
Kovid Goyal
e0ab635448
Cant generate website strings on github 2020-07-31 22:28:33 +05:30
Kovid Goyal
2c496da4e9
Forgot to clone translations 2020-07-31 22:18:06 +05:30
Kovid Goyal
0137c2a74b
Make dir if it does not exist 2020-07-31 22:05:24 +05:30
Kovid Goyal
5afeace988
Work on a GitHub action to auto-update translations on Transifex 2020-07-31 22:02:13 +05:30
Eli Schwartz
b48bd4f7c8
build: detect mathjax directory with or without es5/ subdir
The release tarballs contain an es5/ directory with the actual mathjax
code. However, when building against a system mathjax it is likely the
es5/ directory is skipped and the directory name is just
/usr/share/mathjax/

Detect this by moving the es5/ component to the definition of the
mathjax source root, but only appending it if the --path-to-mathjax
actually contains such a directory.
2020-06-25 01:23:08 -04:00
Kovid Goyal
e2243bf7a9
Upgrade MathJax to version 3
version 3 is more performant, smaller and simpler to integrate, without
monkeypatching. On the down side, it does not do line breaking, as yet.

Note that only the viewer is currently ported
2020-06-19 18:43:23 +05:30
Kovid Goyal
32438d1565
Handle reading version info from jgoguens updated plugins
The version info is now specified as an attribute of a module, import.
2020-06-17 08:55:46 +05:30
Kovid Goyal
8de4c3268e
Dont keep a local backup of the calibre installers 2020-06-05 08:20:43 +05:30
Kovid Goyal
1c66024316
Linux installer: Detect ARM 64bit as well as 32bit 2020-06-04 19:40:32 +05:30
Kovid Goyal
9015530224
and again 2020-05-15 09:15:09 +05:30
Kovid Goyal
069e3e69b4
... 2020-05-15 09:13:10 +05:30
Kovid Goyal
64b56e4aec
Move hosting script to python 3 2020-05-15 09:09:23 +05:30
Kovid Goyal
28c7e43940
Fix #1860831 [Two Portuguese when to choose the language](https://bugs.launchpad.net/calibre/+bug/1860831) 2020-04-04 17:26:47 +05:30
Kovid Goyal
cb48dcb606
Add rapydscript tests to CI 2020-04-02 16:38:20 +05:30
Kovid Goyal
6c9c141c3e
Add a command to easily run rapydscript tests 2020-04-02 16:34:07 +05:30
Kovid Goyal
2cd43e0fcd
Fix #1869464 [Entries in context menu is not being translated](https://bugs.launchpad.net/calibre/+bug/1869464) 2020-03-28 13:47:35 +05:30
Kovid Goyal
53de96b18b
... 2020-03-27 11:19:51 +05:30
Kovid Goyal
8dd68d157d
ANother rsync invocation that needed compression method fixed 2020-03-17 09:00:12 +05:30
Kovid Goyal
1809676dba
Use -zz for rsync 2020-03-06 08:27:46 +05:30
Kovid Goyal
9864af035a
Use inverted name for ISO 639 names in preference 2020-02-26 22:17:15 +05:30
Kovid Goyal
1e07b48116
Checking of changelog needs python 3 now 2020-02-11 11:24:40 +05:30
Kovid Goyal
449672bab1
Make plugins_mirror.py more polyglot 2020-02-10 20:41:23 +05:30
Kovid Goyal
fc1803a800
Remove obsolete workarounds for buggy distro Qt packages 2020-02-04 08:45:03 +05:30
Kovid Goyal
e2b730b3b2
Fix building of headless on macOS
Apparently we can link against both themesuport private and font
database private as they both contain the same symbol
2020-02-04 08:40:54 +05:30
Kovid Goyal
d51fa29acd
Also generate ISO 639 POT file automatically from the db. Fixes #1860856 [String not found in Transifex](https://bugs.launchpad.net/calibre/+bug/1860856) 2020-01-26 14:29:28 +05:30
Kovid Goyal
5c8093e554
Installtion of deps on github Ubuntu broken again 2020-01-18 09:08:11 +05:30
Aimylios
5c795352c9 Allow excluding individual tests from test run 2020-01-17 21:54:25 +01:00
Kovid Goyal
231664e7ca
Move test location 2020-01-08 22:25:38 +05:30
Kovid Goyal
f0e6ead4c7
Better workaround for XXE in lxml
Instead of disabling resolution of all entities, only disable resolution
of entities from files
2020-01-08 22:03:38 +05:30
Kovid Goyal
f686647286
Command to vendor csslint 2020-01-08 21:01:59 +05:30
Kovid Goyal
e307caafe8
Generate locales.zip parent dir if needed 2020-01-07 21:33:17 +05:30
Kovid Goyal
746381d179
A few more etree.fromstring 2019-12-29 22:02:16 +05:30
Kovid Goyal
6de56e8f93
Compile changelog translations 2019-12-25 16:47:01 +05:30
Kovid Goyal
ff5039dd31
Split website and changelog translations 2019-12-25 09:58:58 +05:30
Kovid Goyal
5ef79c742a
Add support for sip5 2019-12-14 12:40:08 +05:30
Kovid Goyal
283dbdf392
Dont run update since it breaks on github CI 2019-12-13 18:09:23 +05:30
Kovid Goyal
edf231e3ff
Use a token for github 2019-12-12 10:04:36 +05:30
Kovid Goyal
281ddb8678
Make the name of the html syntax highlighter module more explicit
Avoids name collisions with the stdlib html module in python3
2019-12-03 10:45:42 +05:30
Kovid Goyal
9b777491ce
Dont show the useless --system-version option for hyphenation 2019-12-03 08:59:02 +05:30
Eli Schwartz
11d6b27ec7
setup: port over the hyphenation dictionary code to ReVendor()
This makes it automatically support being passed an alternative url, or
an extracted directory.
2019-12-02 21:05:51 -05:00
Eli Schwartz
a66e562b08
setup: refactor mathjax class into generic class for vendoring things 2019-12-02 21:05:51 -05:00
Kovid Goyal
b16b5535bf
Implement mapping of locales to dictionary names 2019-12-01 10:50:32 +05:30
Kovid Goyal
fd4db9e8ed
Make building the dictionaries tarfile reproducible 2019-11-30 21:20:40 +05:30
Kovid Goyal
8081805208
Dont rely on external tar to compress dictionaries 2019-11-30 21:06:37 +05:30
Kovid Goyal
5f46b06dc9
Generate a hash of the hyphenation dicts for cache updates 2019-11-30 20:50:06 +05:30
Kovid Goyal
2a8875f864
... 2019-11-30 20:40:25 +05:30
Kovid Goyal
5c1b69f5b9
Add hyphen dependency 2019-11-30 17:58:57 +05:30
Kovid Goyal
4a45f32357
Start work on libhyphen wrapper 2019-11-30 16:48:27 +05:30
Kovid Goyal
1c54eb1648
Code to fetch hyphenation dictionaries 2019-11-30 10:59:45 +05:30
Kovid Goyal
4feb684c89
Exclude improperly named entries from ISO-639-3
Fixes #1851909 [Some strange languages is shown in the list](https://bugs.launchpad.net/calibre/+bug/1851909)
2019-11-09 13:46:46 +05:30
Eli Schwartz
0163b537dc
linux installer: fix python3 re.sub with mismatched str/bytes
This does not seem to have been a very commonly hit case, since it's
been broken for python3 since before 2014, but a user has just hit it
for the first time.

Fixes #1851873
2019-11-08 14:11:31 -05:00
Kovid Goyal
24baafdc87
Convenient way to build a dependency for all platforms 2019-11-03 08:52:53 +05:30
Kovid Goyal
aa6eaca0be
Code to auto-fix duplicated language name translations 2019-11-02 10:37:45 +05:30
Kovid Goyal
77af13c5f3
Update ISO 3166 database 2019-11-02 09:31:05 +05:30
Kovid Goyal
1b93d540b7
Update the ISO 639-3 language database 2019-11-02 09:21:28 +05:30
Eli Schwartz
1cbdabbbb7
linux install: make sure init_calibre.py is listed in calibre-uninstall
It is written raw, not via write_template, so it was never added to the
manifest. Therefore, it would remain behind when uninstalling calibre.

Also change the order in which steps are executed, in order to write the
env module -- and add it to the manifest -- before the uninstaller is
created, rather than after (which would be too late).
2019-10-29 20:19:22 -04:00
Eli Schwartz
6526c28bd6
check: cleanup file exclusions
Some of these files no longer exist due to being devendored.
BeautifulSoup.py is now something else entirely which is
calibre-specific code and deserves the right to be linted.
2019-10-28 16:10:00 -04:00
Kovid Goyal
fc7aee08df
Start work on fast html to json 2019-10-28 13:30:18 +05:30
Kovid Goyal
167cb89dc7
... 2019-10-28 08:08:00 +05:30
Kovid Goyal
9536ffe8cd
Merge branch 'pin-version' of https://github.com/widdix/calibre 2019-10-14 07:03:36 +05:30
Michael Wittig
f93bf9379e fix 2019-10-13 19:15:32 +02:00
Michael Wittig
92c88b2637 Allow a user to specify the version that is installed 2019-10-13 18:48:46 +02:00
Kovid Goyal
fe673838ef
Apparently running upgrade is not possible 2019-10-13 10:02:35 +05:30
Kovid Goyal
fd20908dcd
Try running update/upgrade on Ubuntu CI VM in the hopes it will fix the libgl1 installation failure 2019-10-13 09:56:00 +05:30
Kovid Goyal
749460cbfc
Better fixes for publish pipeline issues 2019-10-04 07:35:09 +05:30
Kovid Goyal
857c2355bc
Ensure DISPLAY is in environ 2019-10-04 06:25:14 +05:30
Kovid Goyal
28b5ef8723
Also disable translations since it also crashes 2019-10-04 06:13:34 +05:30
Kovid Goyal
c178c78980
Dont build pot as part of publish as it crashes 2019-10-04 06:06:09 +05:30
Kovid Goyal
1c22993e00
Move outline creation into its own file 2019-10-03 16:51:33 +05:30
Kovid Goyal
9c07cc7e82
Use GitHub Actions rather than Azure Pipelines 2019-10-03 10:46:23 +05:30
Kovid Goyal
5196b29005
Notarize macOS builds 2019-09-18 18:55:50 +05:30
Kovid Goyal
61005add0d
Add support for run-local to calibre restart and run_calibre_debug 2019-09-13 10:28:26 +05:30
Kovid Goyal
4d9440a94c
Get rid of home grown multitail
Use the awesomeness that is kitty instead
2019-09-13 09:13:34 +05:30
Kovid Goyal
800880d891
Option to not sign installers 2019-09-13 09:13:34 +05:30
Kovid Goyal
f53a979da9
Forgot to change OS name in one place 2019-09-13 09:13:34 +05:30
Kovid Goyal
da4fc37684
Bump version number to beta level 2019-09-13 09:13:34 +05:30
Kovid Goyal
a3ac1900f6
Work on windows CI 2019-09-13 09:12:39 +05:30
Kovid Goyal
c4ef009bfb
Fix CI detection on azure pipelines 2019-09-13 09:12:38 +05:30
Kovid Goyal
0d4cdeea97
Ensure Qt plugins are loaded in macOS VM 2019-09-13 09:12:38 +05:30
Kovid Goyal
edbd56bbb1
Use fallback library path instead 2019-09-13 09:12:38 +05:30
Kovid Goyal
63539c1dc7
Set the library path for @rpath linked things 2019-09-13 09:12:38 +05:30
Kovid Goyal
987a869614
Disable webengine sandbox in macOS CI 2019-09-13 09:12:38 +05:30
Kovid Goyal
ff5e5f2743
Use proper path for macos SW 2019-09-13 09:12:38 +05:30
Kovid Goyal
7a9f6cf195
... 2019-09-13 09:12:38 +05:30
Kovid Goyal
915f9ad107
Use correct python executable name on macOS 2019-09-13 09:12:38 +05:30
Kovid Goyal
02d590180b
... 2019-09-13 09:12:37 +05:30
Kovid Goyal
c388500dfb
Work on CI 2019-09-13 09:12:37 +05:30
Kovid Goyal
a344028733
Command to export packages 2019-09-13 09:12:37 +05:30
Kovid Goyal
f52d529090
Command to build deps 2019-09-13 09:12:37 +05:30
Kovid Goyal
ac29ca24a7
Make extdev more robust against crashes of test command 2019-09-13 09:12:36 +05:30
Kovid Goyal
ab6b724835
COmmnad ot make testing extension modules easier 2019-09-13 09:12:36 +05:30
Kovid Goyal
7c108d4078
Port the installer build commands to use bypy 2019-09-13 09:12:36 +05:30
Kovid Goyal
be471a8cbe
Work on getting windows running 2019-09-13 09:12:35 +05:30
Kovid Goyal
46295bb17f
Get the hunspell wraper building correctly on all platforms 2019-09-13 09:12:35 +05:30
Kovid Goyal
22a1481bcd
De-vendor hunspell 2019-09-13 09:12:35 +05:30
Kovid Goyal
bf199d6bfa
Get podofo building on older compilers on linux 2019-09-13 09:12:33 +05:30
Kovid Goyal
0f02312390
De-dup images in the PDF 2019-09-13 09:12:26 +05:30
Kovid Goyal
227679985f
Implement imposing headers/footers onto their target pages 2019-09-13 09:12:25 +05:30
Kovid Goyal
d304e08ec1
Code to merge W arrays 2019-09-13 09:12:24 +05:30
Kovid Goyal
c4e3fda682
Code to list fonts in a PDF file 2019-09-13 09:12:22 +05:30
Kovid Goyal
7803f3de36
Rename viewer2 to viewer 2019-09-13 09:12:20 +05:30
Kovid Goyal
b5b0891421
Start work on porting the PDF output plugin to use web engine 2019-09-13 09:12:19 +05:30
Kovid Goyal
070ad5351e
Remove old viewer and coffeescript and viewer resources
Since the PDF output code is also going to be replaced, none
of this is required.
2019-09-13 09:12:17 +05:30
Kovid Goyal
6e14daac89
Infrastructure for loading viewer js 2019-09-13 09:12:12 +05:30
Kovid Goyal
59b9357c0c
Add tests for the new viewer cache 2019-09-13 09:12:11 +05:30
Kovid Goyal
561edbe1ea
Two-way syncing work again 2019-09-13 09:12:09 +05:30
Kovid Goyal
00a9d0f275
Migrate editor coffee script to rapydscript 2019-09-13 09:12:09 +05:30
Eli Schwartz
c161fbe54a
resources: bump mathjax version to 2.7.6
There is actually no real consequential change here, because the update
is a trivial bugfix that doesn't affect calibre's use, but let's do it
anyway because it is both simple and harmless.
2019-08-25 00:21:03 -04:00
Kovid Goyal
c5aeaa8c8a
Cleanup HTML metadata parsing 2019-08-12 10:10:50 +05:30
Eli Schwartz
d50a6ddc1b
use context managers to open files 2019-07-25 01:30:54 -04:00
Eli Schwartz
cba11fb969
unicode_check: do not try to check pyuic-generated files 2019-07-23 17:29:48 -04:00
Kovid Goyal
519a90abdf
Ensure we send a mimetype when upload to github 2019-07-12 09:21:01 +05:30
Bernhard M. Wiedemann
53298f87ff
Sort input file list
so that calibre/plugins/lzma_binding.so builds in a reproducible way
in spite of indeterministic filesystem readdir order
and http://bugs.python.org/issue30461

See https://reproducible-builds.org/ for why this is good.
2019-07-01 14:47:32 +02:00
Kovid Goyal
e804e48747
Start work on building calibre on windows 2019-06-19 10:06:54 +05:30
Kovid Goyal
3a688453ab
Go back to using git to fetch ephemeral translations
No significant speed difference and curl is failing on the macOS
Travis VM
2019-06-13 10:49:13 +05:30
Kovid Goyal
98ec15b970
Retry download on fail 2019-06-13 10:37:16 +05:30
Kovid Goyal
6acfcf12ef
Use a tarball based download when downloading ephemeral translations 2019-06-13 09:33:50 +05:30
Kovid Goyal
ed85704799
Undo the fudge for tanslations failing on macOS as it causes another test to fail 2019-06-11 16:14:15 +05:30
Kovid Goyal
edd44a559a
... 2019-06-11 15:15:12 +05:30
Kovid Goyal
152e823c41
Kobo driver: Add options to more precisely control the generation of cover images, to reduce size and enhance quality
Merge branch 'master' of https://github.com/NiLuJe/calibre
2019-06-11 15:14:26 +05:30
Kovid Goyal
3139dff9eb
Ignore weird failure when building website translation on Travis on macOS 2019-06-11 14:59:00 +05:30
Kovid Goyal
0f3b2e2329
Dont use win32com for adding to recent docs 2019-06-11 14:50:05 +05:30
Kovid Goyal
3f903cbdd1
CHM Input: Fix a regression that broke processing of some CHM files
Fixes #1831511 [Can't open chm file](https://bugs.launchpad.net/calibre/+bug/1831511)

Bug was introduced due to adding of unicode_literals.
Also fix CHM input on python3
2019-06-05 09:08:17 +05:30
Kovid Goyal
f2f57d2dda
Work on new calibre macOS build 2019-06-04 16:22:50 +05:30
NiLuJe
7e6347486b Port ImageMagick's OrderedDither algorithm, and use that instead of
ImageOps' quantize to dither images to the eInk palette.

It works much better for our intended purpose, and it's pretty fast.
2019-06-02 18:29:49 +02:00
Kovid Goyal
cae30d8795
Dont scan smtplib.py in the porting utils 2019-05-29 17:58:23 +05:30
Kovid Goyal
06dc7dd15b
Dont scan Zeroconf.py in the porting utils
This is being replaced by upstream zeroconf in py3
2019-05-28 12:41:48 +05:30
Kovid Goyal
6e0ec5b65c
Get an accurate count for how many files are left that need unicode porting
555 left currently, sigh.
2019-05-27 20:43:01 +05:30
Kovid Goyal
b842fe758a
Fixes for f2e0181926 2019-05-27 14:25:52 +05:30
Eli Schwartz
45ca4c7934
py3: merge multiline __future__ imports to not confuse 2to3 2019-05-27 00:41:14 -04:00
Kovid Goyal
50af7ba51f
py3: port uses of builtin functions that were changed to return iterators 2019-05-23 06:57:33 +05:30
Kovid Goyal
8366df8637
Run code quality checks on the odf package 2019-05-20 16:52:16 +05:30
Kovid Goyal
f32ea26bf1
py3: Port more files to not use str() andhave unicode literals 2019-05-20 06:56:45 +05:30
Kovid Goyal
cddb7d873c
Add a nicer way to check for unicode issues in files 2019-05-16 12:18:34 +05:30
Kovid Goyal
7a4f44b6aa
Report failure to parse files when running 2to3 2019-05-15 21:19:02 +05:30
Kovid Goyal
a08bdbeb4e
Dont depend on calibre in polyglot 2019-05-15 16:42:52 +05:30
Kovid Goyal
bd118e6139
Framework to run 2to3 over the codebase 2019-05-15 16:13:12 +05:30
Eli Schwartz
ae02c30a17
install: first install code, then binaries
Since installing code will also delete a directory tree, it should run
first. This avoids exotic cases where it deletes the binaries it just
installed.

Use case: co-installing python2/python3 using a bindir bundled with the
rest of calibre's code, in order to maintain an alternatives system
pointing symlinks in /usr/bin at the configured binaries.
2019-05-12 18:14:42 -04:00
Eli Schwartz
2a63948440
install: when using a staging root, setup XDG_DATA_DIRS magic
In order for xdg-utils programs to successfully install resources to the
staging root instead of /usr, this variable needs to be set and
additionally some arcane directories must be created that xdg-utils,
astoundingly, does not know how to just gracefully handle.

xdg-mime is simply hopeless as it does not have a --noupdate flag. When
using a staged install, copy it with shutil instead.
2019-05-12 18:14:42 -04:00
Kovid Goyal
61eef65bb6
Merge branch 'git_version' of https://github.com/eli-schwartz/calibre 2019-05-12 12:45:16 +05:30
Eli Schwartz
9dc1ccfe08
setup: add subcommand to update the version in constants.py from git
This creates an additional variable containing the version number
extracted from a git checkout via `git describe`, and diverts all
human-readable output to use that via get_version.
2019-05-12 02:32:59 -04:00
Kovid Goyal
1c22094803
Cleanup urllib imports 2019-05-02 07:25:03 +05:30
Kovid Goyal
d6402a0fdd
Use a non-deprecated technique for resuming partial downloads in the Linux installer. Fixes #1827289 [Deprecation warning in installation script.](https://bugs.launchpad.net/calibre/+bug/1827289) 2019-05-02 07:17:44 +05:30
Kovid Goyal
a2fa719545
Better naming 2019-04-29 21:29:47 +05:30
Kovid Goyal
ed2e2e060f
Ensure completion dict for ebook-convert has unicode strings 2019-04-29 20:48:52 +05:30