julien0221
6a4421f8e1
Whitespace is not trimmed from the end of query strings ( #1263 )
...
* fixed whitespace not trimmed query string
* fixed whitespace trimming on backend
* added query trim tests and fixed double space
2021-04-13 10:32:52 +10:00
WithoutPants
f5dc654f6b
Support streaming via API key ( #1279 )
...
* Support api key via url query parameter
* Add api key to stream URL
2021-04-12 11:05:49 +10:00
WithoutPants
f6ffda7504
Setup and migration UI refactor ( #1190 )
...
* Make config instance-based
* Remove config dependency in paths
* Refactor config init
* Allow startup without database
* Get system status at UI initialise
* Add setup wizard
* Cache and Metadata optional. Database mandatory
* Handle metadata not set during full import/export
* Add links
* Remove config check middleware
* Stash not mandatory
* Panic on missing mandatory config fields
* Redirect setup to main page if setup not required
* Add migration UI
* Remove unused stuff
* Move UI initialisation into App
* Don't create metadata paths on RefreshConfig
* Add folder selector for generated in setup
* Env variable to set and create config file.
Make docker images use a fixed config file.
* Set config file during setup
2021-04-12 09:31:33 +10:00
InfiniteTF
c38660d209
Add phash generation and dupe checking ( #1158 )
2021-04-12 09:04:40 +10:00
WithoutPants
a2582047ca
Join count filter criteria ( #1254 )
...
Co-authored-by: mrbrdo <mrbrdo@gmail.com>
Co-authored-by: peolic <66393006+peolic@users.noreply.github.com>
2021-04-09 18:46:00 +10:00
julien0221
25311247ed
added an url filter option in scenes ( #1266 )
...
* added an url filter option in scenes
* added url filter on gallery, movies, performers and studios
* Add empty string filter to stringCriterionHandler
* Add unit tests
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2021-04-09 15:05:11 +10:00
stashist
4462b3cc8e
Handle /healthz for liveness checks. ( #1264 )
2021-04-09 10:06:02 +10:00
bnkai
2edcdeaeb9
Support today, yesterday when using parseDate in scrapers ( #1261 )
2021-04-07 09:09:04 +10:00
peolic
35718ce59a
Disable sounds on scene/marker wall previews by default ( #1247 )
2021-04-01 16:10:56 +11:00
WithoutPants
1412b554a0
Api key ( #1241 )
2021-03-31 16:08:52 +11:00
WithoutPants
ccb96c3795
Movie UI refresh ( #1227 )
...
* Improve movie UI
* Return nil when no back image set
2021-03-31 14:54:58 +11:00
WithoutPants
d5e9030768
Scene queuing ( #1214 )
...
* Add missing localisation strings
* Ignore container error in scene streams
* Implement missing FindScenes by ID
2021-03-31 14:36:11 +11:00
peolic
7acae34ed4
Fix performer search columns ( #1236 )
...
* Fix performer search columns
* Update changelog
* Move changelog to new version
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2021-03-30 14:04:57 +11:00
bnkai
4299f113e0
Fix Freeones search ( #1230 )
2021-03-25 10:01:56 +11:00
bnkai
68d4a4fe42
Add User Agent to image download reqs ( #1222 )
2021-03-24 08:12:11 +11:00
WithoutPants
73a8bad1bc
Add missing tag writer for performer importer ( #1213 )
2021-03-18 21:45:31 +11:00
WithoutPants
960f843259
Fix filter building with sub-filters ( #1212 )
...
* Fix bracketing on sub-filters
* Add vscode to gitignore
2021-03-18 21:45:18 +11:00
WithoutPants
d93011a828
Add write mutex and max connection lifetime ( #1211 )
2021-03-18 21:45:01 +11:00
bnkai
215737d6c5
Add configFilePath and scrapersPath to configuration query ( #1205 )
2021-03-18 11:07:56 +11:00
InfiniteTF
58243cded0
Remove slim graphql endpoints ( #1207 )
2021-03-17 11:17:01 +11:00
WithoutPants
7e6127975d
Handle NULL in regex criteria ( #1208 )
2021-03-16 11:13:14 +11:00
InfiniteTF
ecac7a8013
Add timestamp suffix to all image urls ( #1200 )
2021-03-13 11:49:20 +11:00
WithoutPants
23d85655a8
Refactor tag query ( #1194 )
2021-03-11 22:17:37 +11:00
WithoutPants
a3a531d122
Fix IsPathInDir ( #1192 )
2021-03-11 13:37:13 +11:00
WithoutPants
55aee21cff
Upload Image from url ( #1193 )
2021-03-11 12:56:34 +11:00
WithoutPants
b3966b3c76
Remove streaming resolutions over max configured ( #1187 )
2021-03-11 12:51:42 +11:00
WithoutPants
a0676d5c30
Performer tags ( #1132 )
...
* Add scraping support for performer tags
* Add performer count to tag cards
* Refactor sqlite test setup
* Add performer tag filtering in gallery and image
* Add bulk update performer
* Add Performers tab to tag page
* Add count filters and sort bys for tags
* Move scene count to icon in performer card #1148
2021-03-10 12:25:51 +11:00
WithoutPants
e5c5cde974
Detect cover images in subdirectories ( #1144 )
2021-03-04 10:52:45 +11:00
SpedNSFW
bde5d07afb
Find correct python executable ( #1156 )
...
* find correct python executable
For script scrapers using python, both python and python3 are valid depending on the OS and running environment. To save users from having any issues, this change will find the correct executable for them.
Co-authored-by: bnkai <bnkai@users.noreply.github.com>
2021-03-03 08:01:01 +11:00
WithoutPants
1850a2b533
Add sqlite filter builder. Add AND, OR, NOT filters to scene filter ( #1115 )
...
* Add resolution enum extension
* Add filter builder
* Use filterBuilder for scene query
* Optimise joins
* Add binary operators to scene query
* Use Query for auto-tag
2021-03-02 11:27:36 +11:00
bnkai
117e6326db
Expose url for URLReplace in JSON scrapeByURL and scrapeByFragment ( #1150 )
...
* Expose url for URLReplace in JSON scrapeByURL and scrapeByFragment
* Apply queryURLReplace to xpath scrapers
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2021-03-02 09:19:56 +11:00
bnkai
fe990e00c1
Check if gallery is already associated during scanning ( #1154 )
2021-03-01 16:37:55 +11:00
gitgiggety
4825de7d35
Fix SQL error in 8K resolution filter ( #1159 )
2021-03-01 16:06:57 +11:00
WithoutPants
7cfff46d02
Gallery filter fix ( #1147 )
...
* Fix gallery performer and tags filters
* Add unit tests
2021-03-01 13:30:40 +11:00
bnkai
44ea777019
Add check version support for armv7, arm64 ( #1142 )
2021-03-01 12:37:46 +11:00
bnkai
711496e9f4
Add full timestamp for console/file logging ( #1130 )
2021-03-01 12:28:09 +11:00
InfiniteTF
7e0db2aad4
Change NULL filters to filter empty strings as well ( #1137 )
2021-03-01 11:48:25 +11:00
bnkai
144cd6e4f2
Skip insecure certificates check when scraping ( #1120 )
...
* Ignore insecure certificates when scraping
* add ScraperCertCheck to scraper config options
2021-03-01 11:47:39 +11:00
SpedNSFW
acbdee76de
Random strings for cookie values ( #1122 )
2021-02-23 13:40:43 +11:00
InfiniteTF
14230d7b52
Enable keepalive for websocket connection ( #1134 )
2021-02-23 13:03:02 +11:00
WithoutPants
f7a8899d90
Add rescan option to overflow dropdown ( #1119 )
...
* Make scan options optional
* Add scene rescan
* Add image rescan
* Add gallery rescan
* Add changelog
2021-02-23 12:56:01 +11:00
WithoutPants
bbc34bd1bf
Exclude media in generated directory ( #1118 )
2021-02-11 11:06:04 +11:00
InfiniteTF
8d8a8530e8
Migrate generated files when a scene is rescanned ( #1106 )
2021-02-10 10:50:34 +11:00
bnkai
bcbbd1474c
fix check version ( #1103 )
2021-02-09 21:00:27 +11:00
bnkai
984a0c9247
Tweak scraper script error printing ( #1107 )
2021-02-09 19:07:53 +11:00
SpedNSFW
714ae541d4
fix json unmarshal error return ( #1109 )
2021-02-09 19:04:42 +11:00
WithoutPants
0dd2e269ee
Don't delete downloads directory at startup if generated not set ( #1098 )
...
* Don't empty directories if generated not set
* Rename downloads to download_stage
2021-02-02 20:32:37 +11:00
WithoutPants
4e9ebe055b
Fix scene filename parser Q filter value ( #1100 )
2021-02-02 20:25:08 +11:00
WithoutPants
e4d91a0226
String regex filter criteria and selective autotag ( #1082 )
...
* Add regex string filter criterion
* Use query interface for auto tagging
* Use Query interface for filename parser
* Remove query regex interfaces
* Add selective auto tag
* Use page size 0 as no limit
2021-02-02 07:57:56 +11:00
InfiniteTF
4fd022a93b
Decouple galleries from scenes ( #1057 )
2021-02-02 07:56:54 +11:00
Belley
86bfb64a0d
Fix freeones scraper ( #1091 )
2021-02-01 08:15:50 +11:00
InfiniteTF
6114caa938
Fix import file copying ( #1085 )
2021-02-01 08:15:10 +11:00
InfiniteTF
89fcd6d775
Make file upload limits configurable ( #1079 )
2021-01-29 20:27:02 +11:00
bnkai
df8675c2e7
Add Dry Run option to clean task ( #1081 )
2021-01-29 15:03:34 +11:00
bnkai
088f32a116
* fix database reset ( #1076 )
2021-01-26 10:37:42 +11:00
WithoutPants
3b41894dbd
Add backup database functionality ( #1069 )
2021-01-21 22:02:09 +11:00
WithoutPants
1e04deb3d4
Data layer restructuring ( #997 )
...
* Move query builders to sqlite package
* Add transaction system
* Wrap model resolvers in transaction
* Add error return value for StringSliceToIntSlice
* Update/refactor mutation resolvers
* Convert query builders
* Remove unused join types
* Add stash id unit tests
* Use WAL journal mode
2021-01-18 12:23:20 +11:00
bnkai
defb23aaa2
Fix vtt sprite generation ( issue #1033 ) ( #1035 )
2021-01-14 12:53:42 +11:00
InfiniteTF
aad4ddc46d
Add batch delete for performers/tags/studios/movies ( #1053 )
...
* Add batch delete for performers/tags/studios/movies
* Fix ListFilter styling bug
2021-01-13 11:57:53 +11:00
SpedNSFW
03a9d65cfe
extend resolutions ( #1036 )
...
* extend resolutions
- Simplifies logic
- Adds more options including 540p, 1440p, and resolutions common to VR such as 1920p
- Supports vertical/portrait videos and images
* implement new resolution filters
2021-01-07 16:10:59 +11:00
bnkai
1882b44951
Strip file extension from scene title when scanning ( #1022 )
2021-01-07 11:38:30 +11:00
InfiniteTF
d50238cf41
Various bugfixes for scene tagger ( #1014 )
...
* Tagger fixes
* Validate stash-box endpoint pattern
2020-12-28 13:28:29 +11:00
WithoutPants
c8bcaaf27d
Fix scene file name parser update ( #998 )
...
* Fix conversion of input maps
* Only set changed scene values in parser update
2020-12-24 09:03:23 +11:00
InfiniteTF
e84c92355e
Fix integer overflow for scene size on 32bit systems ( #994 )
...
* Fix integer overflow for scene size on 32bit systems
* Cast to double in sqlite to prevent potential overflow
* Add migration to reset scene sizes and scan logic to repopulate if empty
2020-12-22 10:29:53 +11:00
bnkai
e883e5fe27
Add Mouse Click support for the CDP scraper ( #827 )
2020-12-22 09:42:31 +11:00
WithoutPants
aadbcaeec2
Organised flag ( #988 )
...
* Add organized boolean to scene model (#729 )
* Add organized button to scene page
* Add flag to galleries and images
* Import/export changes
* Make organized flag not null
* Ignore organized scenes for autotag
Co-authored-by: com1234 <com1234@notarealemail.com>
2020-12-18 08:06:49 +11:00
InfiniteTF
99bd7bc750
Fix broken isMissing filters ( #1000 )
2020-12-17 20:27:44 +01:00
aGlkZGVu
fad64ba126
Implement user customizable menu items ( #974 )
2020-12-09 11:59:09 +11:00
WithoutPants
86747acc78
Use changesets correctly when updating objects ( #976 )
2020-12-04 12:42:56 +11:00
bnkai
a96ab9ce6f
Add support for setting cookies in the scraper ( #934 )
2020-12-01 16:34:09 +11:00
bnkai
aecbd236bc
Tune image referrer path ( #968 )
2020-11-30 10:50:43 +11:00
InfiniteTF
a7d333786f
Fix studio parent getting wiped in edit mode ( #973 )
2020-11-30 10:50:04 +11:00
WithoutPants
54c9f167ba
Show studio as text in scene cards where studio image isn't set ( #965 )
2020-11-27 08:01:56 +11:00
WithoutPants
1d910419d1
Replace natural_sort with third party call ( #964 )
2020-11-27 08:01:36 +11:00
JoeSmithStarkers
df37ddcc2c
Added natural sort for scene and image titles ( #943 )
...
* Added natural sort for scene and images
* Use natural sort for movie names
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-11-25 20:09:07 +11:00
JoeSmithStarkers
e3eb550a7d
Parallel scanning/generation, and combined scanning/preview/sprite ( #820 )
...
* Implement parallel scanning and generation, and combined scanning/preview/sprite generation.
* Added UI component for preview/sprite generation during scan, and configurable number of parallel tasks.
* Add v050 changelog entry
2020-11-25 12:45:10 +11:00
bnkai
e62e74bff4
Use symwalk for scrapers ( #938 )
2020-11-16 09:21:26 +11:00
WithoutPants
0a098b1d63
Selective scan ( #940 )
2020-11-16 09:20:04 +11:00
InfiniteTF
ba8b3b29a4
Update findGalleries to only fetch imageCount instead of all images ( #941 )
2020-11-15 14:40:47 +11:00
WithoutPants
c74f145224
Only set stash from env if not set ( #937 )
2020-11-12 10:05:09 +11:00
WithoutPants
beb84b8e94
Fix image memory issue ( #935 )
...
* Return slim images from mutations
* Fix potential memory leaks
2020-11-10 20:19:13 +11:00
Belley
94392c7c4d
Fixing image for Freeones Scrapers ( #930 )
2020-11-07 09:36:26 +11:00
WithoutPants
5f482b7b8a
Handle zip file modification ( #877 )
...
* Rescan zip if updating mod time
* Use inequality for mod time comparison
* Add sort by file_mod_time (fixes #469 )
2020-11-05 10:26:51 +11:00
InfiniteTF
9ec762ae9a
Fix outstanding tagger issues ( #912 )
...
* Fix potential image errors
* Fix issue preventing favoriting of tagged performers
* Add error handling in case of network issues
* Show individual search errors
* Unset scene results if query fails
* Don't abort scene submission if scene id isn't found
2020-11-05 08:28:58 +11:00
WithoutPants
cbfd9e82b7
Fix image clean ( #913 )
...
* Use correct regex when cleaning images
* Clarify video exclusion pattern heading
2020-11-03 09:34:53 +11:00
WithoutPants
bae82513eb
Add equals/not equals string criteria ( #917 )
...
* Fix encoding of string criteria
* Add equals and includes (and not) string criteria
2020-11-03 09:26:07 +11:00
WithoutPants
8e75a8fff5
Add selection and export for all list pages ( #873 )
...
* Include studios in movie export
* Generalise cards
* Add selection and export for movies
* Refactor gallery card
* Refactor export dialogs
* Add performer selection and export
* Add selection and export for studios
* Add selection and export of tags
* Include movie scenes and gallery images
2020-10-31 09:41:12 +11:00
WithoutPants
90c5a9dd4a
Add page sizes up to 1000 ( #904 )
2020-10-29 09:27:56 +11:00
WithoutPants
c75b5c204d
Don't set default studio image ( #887 )
2020-10-27 09:35:50 +11:00
JoeSmithStarkers
47468fe122
Cache generated regex for each path ( #891 )
2020-10-26 15:57:58 +11:00
InfiniteTF
3346f8dcca
Stash-box tagger integration ( #454 )
2020-10-24 14:31:39 +11:00
WithoutPants
70f73ecf4a
Update freeones scraper ( #881 )
2020-10-24 13:12:21 +11:00
JoeSmithStarkers
71c814c116
Added streaming quality options ( #790 )
2020-10-22 15:02:27 +11:00
WithoutPants
109e55a25a
Query url parameters ( #878 )
2020-10-22 11:56:04 +11:00
WithoutPants
228a5c5537
Use temp redirects for setup ( #875 )
2020-10-22 08:17:15 +11:00
com1234475
3832c8505a
Make performer name mandatory in graphQL ( #273 ) ( #841 )
2020-10-21 11:27:16 +11:00
SpedNSFW
147d0067f5
Add gallery scraping ( #862 )
2020-10-21 09:24:32 +11:00
WithoutPants
872bb70f6e
Fix scan issue when encountering invalid symlinks ( #871 )
...
* Implement fixed symwalk algorithm
* Remove dependency
2020-10-20 17:00:23 +11:00
WithoutPants
8eda72ad89
Image improvements ( #847 )
...
* Fix image performer filtering
* Add performer images tab
* Add studio images tab
* Rename interface
* Add tag images tab
* Add path filtering for images
* Show image stats on stats page
* Fix incorrect scan counts after timeout
* Add gallery filters
* Relax scene gallery selector
2020-10-20 10:11:15 +11:00
InfiniteTF
d9270dd7c3
Treat empty string columns as missing ( #852 )
2020-10-16 11:14:48 +11:00
InfiniteTF
528b32d1b7
Sort images in galleries by path ( #855 )
2020-10-16 10:56:24 +11:00
InfiniteTF
73eb5c7a1f
Add image-count sorting, and image deletion on gallery deletion ( #853 )
2020-10-16 10:35:50 +11:00
InfiniteTF
482f8cbd92
Fix clean and scan bugs ( #846 )
2020-10-14 10:51:36 +11:00
WithoutPants
aca2c7c5f4
Images section ( #813 )
...
* Add new configuration options
* Refactor scan/clean
* Schema changes
* Add details to galleries
* Remove redundant code
* Refine thumbnail generation
* Gallery overhaul
* Don't allow modifying zip gallery images
* Show gallery card overlays
* Hide zoom slider when not in grid mode
2020-10-13 10:12:46 +11:00
WithoutPants
4f9af6ba27
Example python plugin ( #825 )
...
* Add example python plugin
* Fix log incorrectly detecting as progress level
2020-10-12 08:20:20 +11:00
WithoutPants
ade109d9e4
Path filter for scenes and galleries ( #834 )
2020-10-12 08:19:51 +11:00
WithoutPants
98dda782aa
Prevent invalid date tag in video file from aborting scan ( #836 )
...
* Give more context when ffprobe fails
* Suppress JSONTime unmarshal error
* Tidy scan logging
2020-10-11 12:02:41 +11:00
bnkai
94dc74f4a8
Fix ffmpeg/ffprobe downloads ( #824 )
2020-10-03 17:28:02 +10:00
JoeSmithStarkers
30e88b96ee
Added ffmpeg/ffprobe permission correction code for linux/osx ( #814 )
2020-10-03 16:59:23 +10:00
WithoutPants
8866670e53
Add partial import functionality ( #812 )
2020-09-20 18:36:02 +10:00
WithoutPants
7a45943e8e
Stash box client interface ( #751 )
...
* Add gql client generation files
* Update dependencies
* Add stash-box client generation to the makefile
* Move scraped scene object matchers to models
* Add stash-box to scrape with dropdown
* Add scrape scene from fingerprint in UI
2020-09-17 19:57:18 +10:00
WithoutPants
03d4826c85
Selective export ( #770 )
2020-09-15 17:28:53 +10:00
InfiniteTF
03f5e1a442
Config for stash-box instances ( #748 )
2020-09-14 17:13:35 +10:00
caustico
5df1e0025f
Add filter on Movie section "Is Missing is scenes" ( #800 )
2020-09-14 10:35:54 +10:00
InfiniteTF
5d9cc09fca
Allow updating tag name capitalization ( #781 )
2020-09-02 10:30:37 +10:00
WithoutPants
16ea6abf91
Fix age filtering regression ( #778 )
...
* Show filter control in loading/error
* Add performer age unit tests
* Fix addWhere regression
2020-08-31 18:17:17 +10:00
bnkai
b437425a41
Add cbz to supported extensions as gallery ( #774 )
2020-08-31 14:21:49 +10:00
WithoutPants
9a84726128
Fix xpath comment element parsing ( #759 )
2020-08-23 17:39:15 +10:00
WithoutPants
1fd3fcc6a8
Show and allow creation of unknown performers/tags/studios/movies from scraper dialog ( #741 )
...
* Fix toast container z-index
* Make scrape operations network only
* Add CollapseButton component
2020-08-22 18:12:39 +10:00
JoeSmithStarkers
85aa1d8790
Replace os.Rename with util.SafeMove to allow cross device moving to not fail. ( #745 )
...
Fixed annoyingly noisy transcoding progress log messages.
Fixed minor minor issue with directories than are named "blah.mp4" being detected as files to be scanned.
2020-08-21 17:57:07 +10:00
InfiniteTF
ecf745162f
Upgrade doublestar to v2.0.1 ( #742 )
2020-08-17 12:06:40 +10:00
JoeSmithStarkers
ecc42e4e24
Preview generation fallback ( #725 )
...
* Added preview generation fallback feature.
When a preview generation fails (often for wmv/avi files), the new code tries with less stricted (no xerror) and more time consuming options (slow+fast seek).
Fix a minor issue when stash downloads ffmpeg/ffprobe, but doesn't re-detect their paths.
2020-08-17 09:21:58 +10:00
WithoutPants
a39666467e
Fix import performers/movies/studios with no image ( #732 )
2020-08-14 09:40:25 +10:00
woodgen
e3ea3ea85e
scraper/mapped: Add feetToCm post process. ( #711 )
...
This patch adds a feetToCm post process that converts imperial feet and
inches to centimeters.
2020-08-12 11:17:43 +10:00
WithoutPants
e16118f551
Clear image ( #722 )
...
* Allow clearing of tag images
* Allow clearing of studio images
* Allow clearing of performer images
* Allow clearing of movie images
* Add filtering for missing images
2020-08-12 09:19:27 +10:00
woodgen
4045ddf3e9
Implement scraping movies by URL ( #709 )
...
* api/urlbuilders/movie: Auto format.
* graphql+pkg+ui: Implement scraping movies by URL.
This patch implements the missing required boilerplate for scraping
movies by URL, using performers and scenes as a reference.
Although this patch contains a big chunck of ground work for enabling
scraping movies by fragment, the feature would require additional
changes to be completely implemented and was not tested.
* graphql+pkg+ui: Scrape movie studio.
Extends and corrects the movie model for the ability to store and
dereference studio IDs with received studio string from the scraper.
This was done with Scenes as a reference. For simplicity the duplication
of having `ScrapedMovieStudio` and `ScrapedSceneStudio` was kept, which
should probably be refactored to be the same type in the model in the
future.
* ui/movies: Add movie scrape dialog.
Adds possibility to update existing movie entries with the URL scraper.
For this the MovieScrapeDialog.tsx was implemented with Performers and
Scenes as a reference. In addition DurationUtils needs to be called one
time for converting seconds from the model to the string that is
displayed in the component. This seemed the least intrusive to me as it
kept a ScrapeResult<string> type compatible with ScrapedInputGroupRow.
2020-08-10 15:34:15 +10:00
WithoutPants
7158e83b75
Add JSON scrape support ( #717 )
...
* Add support for scene fragment scrape in xpath
2020-08-10 14:21:50 +10:00
WithoutPants
470a2b5833
Fix sprite vtt panic ( #718 )
2020-08-10 09:20:04 +10:00
WithoutPants
634b892df1
Fix typo
2020-08-09 13:48:47 +10:00
WithoutPants
0ffefa6e16
Add plugin tasks ( #651 )
2020-08-08 12:05:35 +10:00
WithoutPants
0874852fa8
Improve oshash collision detection and logging ( #713 )
...
* Log colliding file when setting hash
* Check for existing using both hashes
2020-08-08 11:22:25 +10:00
WithoutPants
5992ff8706
Add oshash support ( #667 )
2020-08-06 11:21:14 +10:00
WithoutPants
b166abfa7b
Fix scraping error ( #704 )
2020-08-04 20:43:56 +10:00
bnkai
4373f9bf01
Add cdp support for xpath scrapers ( #625 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-08-04 10:42:40 +10:00
InfiniteTF
116f61b6bf
Fix potential sprite generation segfault ( #685 )
2020-07-24 09:20:34 +10:00
WithoutPants
a2341f0819
Allow customisation of preview generation ( #673 )
...
* Add generate-specific options
* Include no-cache in preview response
2020-07-23 12:51:35 +10:00
WithoutPants
37be146a9d
Transcode stream refactor ( #609 )
...
* Remove forceMkv and forceHEVC
* Add HLS support and refactor
* Add new streaming endpoints
2020-07-23 11:56:08 +10:00
WithoutPants
2b9215702e
Refactor xpath scraper code. Add fixed and map ( #616 )
...
* Refactor xpath scraper code
* Make post-process a list
* Add map post-process action
* Add fixed xpath values
* Refactor scrapers into cache
* Refactor into mapped config
* Trim test html
2020-07-21 14:06:25 +10:00
WithoutPants
c104c6d075
Generate content for specific scenes ( #672 )
...
* Add UI dialog for scene(s)
* Move preview preset to config
2020-07-19 11:59:18 +10:00
bnkai
ec2bcc7a74
Scan for files with ALLCAPS extensions ( #650 )
2020-07-11 17:22:36 +10:00
bnkai
56210cf456
Use referer on xpath getImage, apply printHTML to subscraper also ( #661 )
2020-07-10 08:42:06 +10:00
WithoutPants
e9141b5dfc
Fix tag query performance problems ( #657 )
...
* Fix sql tracing
* Disable query by marker count
* Disable unit test
2020-07-09 08:42:07 +10:00
WithoutPants
244ae54f3f
Add grid view, image to tag ( #641 )
...
* Add grid view for tags
* Add tag page
* Import/export tags
* Add tag name uniqueness checks
* Fix styling on missing marker previews
* Add trace loglevel
* Add SQL trace
* Add filter options for tags
* Add tag sort by options
* Add tag page keyboard shortcuts
2020-07-07 10:35:43 +10:00
WithoutPants
455e16ece9
Support deleting multiple scenes ( #630 )
...
* Improve layout and add buttons
* Move functionality into ListFilter
* Make modal style dark
* Convert scene options into edit scenes dialog
* Add delete scenes dialog
* Clear selected ids on delete
* Refetch after update/delete
* Use DeleteScenesDialog in Scene page
* Show scene check boxes in small screens
* Change default multi-set mode to set
2020-06-23 10:40:11 +10:00
WithoutPants
7a74658a73
Move image blobs into separate tables ( #618 )
...
* Scene cover fallback to database
* Fix panic if studio not found
* Fix movie studio not being imported/exported
2020-06-23 09:19:19 +10:00
bnkai
f8048dc27c
Increase xpath redirects, use cookies ( #624 )
2020-06-22 12:18:02 +10:00
WithoutPants
77a5b1d814
Add custom served folders ( #620 )
2020-06-21 22:25:13 +10:00
WithoutPants
d3ababf0a1
Gallery list improvement ( #622 )
...
* Add grid view to galleries
* Show scene in gallery card
* Add is missing scene gallery filter
* Don't store galleries with no images
2020-06-21 21:43:57 +10:00
bnkai
9d0522f62d
Add "split" xpath in post-processing , newlines in replace support ( #579 )
2020-06-18 10:47:10 +10:00
bnkai
a7ac02fb50
freeones fixes ( #615 )
2020-06-17 11:02:06 +10:00
bnkai
f40e234748
Apply xpath parseDate after subScraper ( #606 )
2020-06-15 21:38:59 +10:00
WithoutPants
96e6e16507
Parent studios ( #595 )
...
* Refactor getMultiCriterionClause
Co-authored-by: Anon247 <61889302+Anon247@users.noreply.github.com>
2020-06-15 21:34:39 +10:00
WithoutPants
d8ce137086
Reload scrapers button ( #592 )
...
* Add reload scraper option to performer details
* Add scraper reload to scene edit page
* Show scene scraper menu when no queryable scrapers
* Add 0.3 changelog
2020-06-10 13:43:17 +10:00
bnkai
b89956de25
freeones scraper fixes/tweaking ( #584 )
2020-06-02 09:45:37 +10:00
bnkai
dc5efb9e31
Unit testing for performers,studios,movies FindByName/s ( #581 )
2020-05-27 10:48:45 +10:00
InfiniteTF
4ec6d62e01
Selectable wall preview type ( #510 )
...
* Add optional image preview generation
* Add setting for video preview encoding preset
2020-05-27 09:33:49 +10:00
bnkai
ccd75731b7
Change scrape matching (studio, movies, tag, performers) to case insensitive ( #556 )
...
* Change scrape matching (studio, movies, tag, performers) to case insensitive
* * fix collate order
* * make filename parser findbyname calls case insensitive
* * add unit testing for Tags GetFindbyName/s
2020-05-24 16:19:22 +10:00
InfiniteTF
32fce9ac6f
Speed up tag count queries ( #570 )
...
* Speed up tag count queries
* Add test for marker CountByTagID
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-05-24 16:18:02 +10:00
WithoutPants
ec420df871
Add debug logging for xpath scraping ( #555 )
...
* Add debug logging for xpath scraping
* Add logging for processing scene members
2020-05-20 22:46:00 +10:00
WithoutPants
05488d59c3
Find scrapers in subdirectories ( #554 )
2020-05-19 08:44:33 +10:00
bnkai
0fc57ce1e0
Fix xpath comments text ( #550 )
2020-05-18 12:26:20 +10:00
WithoutPants
46746e6848
Fix redirect loops in login, migrate and setup pages ( #549 )
...
* Fix redirect loop when setup and migrate required
* Fix redirect loop between setup and login
2020-05-18 08:55:01 +10:00
WithoutPants
215c4e3bde
Change builtin freeones scraper to community yml ( #542 )
2020-05-15 20:10:20 +10:00
WithoutPants
7fd9428cbb
Fix stash directory with spaces ( #541 )
2020-05-15 09:12:17 +10:00
bnkai
d74a303c00
Fix 0 undefined library size on empty db ( #535 )
2020-05-14 10:44:13 +10:00
WithoutPants
fde02425ab
Make auto tagger matching more flexible ( #534 )
2020-05-13 17:32:39 +10:00
WithoutPants
41c6d9e681
Revert preview generation change
2020-05-13 17:23:23 +10:00
bnkai
4829b4b214
Fix edge case preview generation, tweak preview generation preset ( #528 )
2020-05-11 17:24:52 +10:00
bnkai
bd45daacf3
Add a cache for gallery thumbnails ( #496 )
2020-05-11 17:20:08 +10:00
InfiniteTF
8ba76783b0
Query optimizations ( #478 )
...
* Remove slow and largely pointless groupbys
* Change scene.query to use querybuilder
2020-05-11 15:19:11 +10:00
InfiniteTF
328db57d6c
Overhaul look and feel of folder select ( #527 )
2020-05-09 13:08:00 +10:00
InfiniteTF
e9c68897d7
Add is-missing tags filter ( #526 )
2020-05-09 12:21:08 +10:00
WithoutPants
99f88b8d73
Querybuilder integration tests ( #513 )
...
* Vet fixes
* Change low resolution to < 480
2020-05-04 17:02:49 +10:00
bnkai
0b50e83dbf
freeones scraper tweaks ( #509 )
2020-05-04 14:11:49 +10:00
InfiniteTF
2c85aeedf4
Set movies studioId on create mutation ( #511 )
2020-05-03 08:54:02 +10:00
WithoutPants
3d22d5a742
Refactor build ( #493 )
...
* Add lint/format checks to build
* Make travis get full repo to get tags
* Run packr2 once in cross-compile
* Fix quotes in package.json
* Fix linting issues
* Formatting
* Fix vet issue
* Fix go lint issues
* Show start of each platform compilation
* Add validate target
* Set gitattributes for go fmt and mod vendor
* Fix tag name
* Add fmt-ui target
2020-04-29 12:13:08 +10:00
bnkai
52a1059380
Make image extension check in zip files case insensitive ( #501 )
2020-04-29 09:24:01 +10:00
WithoutPants
309f7047b0
Add parser support for 3-letter month ( #500 )
2020-04-26 16:29:53 +10:00
bnkai
5e84c0922d
Add random male performer image ( #491 )
...
* Add random male performer image during performer creation if gender is male
2020-04-25 09:54:42 +10:00
WithoutPants
5923917e6c
Clean missing galleries ( #489 )
...
* Clean missing galleries
* Refactor matchFile
2020-04-25 09:32:55 +10:00
bnkai
29336d1ee0
Move image with cover.jpg in name to first place in Galleries ( #477 )
2020-04-24 12:53:18 +10:00
bnkai
9b1518beae
Export performance optimization ( #475 )
...
* recreate metadata path if needed, before exporting data
2020-04-24 12:52:21 +10:00
WithoutPants
ba09bfa64a
Include scene o-counter in import/export ( #488 )
...
* Include o-counter in import/export
* Fix scene card o-counter display
2020-04-23 09:14:58 +10:00
WithoutPants
eee7adfb85
Add Studio to movie and fix movie schema ( #458 )
...
* Add movie migration
* Update server and UI code for type changes
* Add studio to movies
* Movie blobs to end
* Document movie duration
* Add filtering on movie studio
2020-04-22 11:22:14 +10:00
WithoutPants
359e80f364
Don't error in IsStreamable resolver ( #482 )
2020-04-20 12:42:56 +10:00
InfiniteTF
2a3c9742cc
Add slim endpoints for entities to speed up filters ( #460 )
...
* Move performers image column to end of table
* Remove redundant index
2020-04-19 12:03:51 +10:00
WithoutPants
849a5261a3
Include gender in performer scraper results ( #448 )
...
* Fix scraper gender
* Set scraped gender in the UI
* Match gender on enum or case insensitive string
2020-04-11 13:26:53 +10:00
WithoutPants
aef31c8b50
Don't redirect login to migrate page ( #453 )
2020-04-10 08:41:09 +10:00
WithoutPants
91d842ed47
Delete marker preview on marker change or delete ( #446 )
2020-04-10 08:39:41 +10:00
bnkai
d5617307f1
Add detection of container/video_codec/audio_codec compatibility for live file streaming or transcoding ( #384 )
...
* add forceMKV, forceHEVC config options
* drop audio stream instead of trying to transcode for ffmpeg unsupported/unknown audio codecs
2020-04-10 08:38:34 +10:00
Anon247
dc37a3045b
Added various missing filters to performer page ( #438 )
2020-04-08 14:21:05 +10:00
WithoutPants
15e7756d33
Replace basic auth with cookie authentication ( #440 )
...
* Add logout functionality and button
* Make session age configurable
2020-04-08 12:51:12 +10:00
WithoutPants
b3e8d1e8dd
Add scene rating to scene filename parser ( #432 )
...
* Fix scene parser display issues in 2.5
* Dropdown menu presentation improvements
* Fix refresh on parser apply
* Ignore line endings on scss files
2020-04-05 07:59:57 +10:00
bnkai
8a6fff61ae
Enable sorting for galleries ( #437 )
2020-04-03 14:40:37 +11:00
bnkai
e58c311ddd
Add library size to main stats page ( #427 )
2020-04-03 13:44:17 +11:00
InfiniteTF
0f622c84f4
Add SVG studio image support, and studio image caching ( #418 )
...
* Support SVGs for studio images and add ETAGs
* Add SVG to studio image input
* Update content sniffing
2020-04-03 09:11:48 +11:00
InfiniteTF
aee9df966b
Cut over to v2.5 UI ( #433 )
...
* Cut over to v2.5 UI
* Use node 12 in travis
* Remove unnecessary `nvm use`
* Update docker file
2020-04-03 08:46:23 +11:00
WithoutPants
82201e23e0
Make ethnicity freetext and fix freeones ethnicity panic ( #431 )
...
* Make ethnicity free text
* Fix panic in freeones scraper for other ethnicity
2020-04-02 08:25:39 +11:00
Anon247
0bbb2bd1d0
Fix to allow scene to be removed when attached to a movie ( #421 )
2020-04-01 12:07:43 +11:00
hiddenpants255
494b794228
Add gender support for performer ( #371 )
...
Co-authored-by: HiddenPants255 <>
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-04-01 09:36:38 +11:00
WithoutPants
d886012d74
Add modes for performer/tag for bulk scene editing ( #412 )
2020-03-23 08:16:11 +11:00
bnkai
acb7260824
Backup database if a migration is needed ( #415 )
...
* Confirm before migrating database
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-03-23 08:07:15 +11:00
WithoutPants
abf2b49803
Configurable scraper user agent string ( #409 )
...
* Add debug scrape option.
Co-authored-by: HiddenPants255 <>
2020-03-21 08:55:15 +11:00
WithoutPants
ff495361d9
Port Movies UI to v2.5 ( #397 )
...
* Ignore generated-graphql.tsx in 2.5
* Make movie name mandatory
* Port #395 fix to v2.5
* Differentiate front/back image browse buttons
* Move URL, Synopsis to separate rows
* Fix unknown query params crashing UI
2020-03-21 08:21:49 +11:00
bnkai
9dacad70a1
Autoassociate galleries to scenes when scanning ( #405 )
2020-03-19 12:36:00 +11:00
WithoutPants
3de6955a9e
Generate cover image ( #376 )
...
* Make mutating metadata ops mutation
* Implement scene generate screenshot
* Remove fetch policy on metadata mutations
* Port UI changes to v2.5
* Set generated image in database
2020-03-12 08:34:04 +11:00
WithoutPants
34d829338d
Add image scraping support ( #370 )
...
* Add sub-scraper functionality
* Add scraping of performer image
* Add scene cover image scraping
* Port UI changes to v2.5
* Fix v2.5 dialog suggest color
* Don't convert eol of UI to support pretty
2020-03-11 11:41:55 +11:00
caustico
5fb8bbf768
Movies Section ( #338 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-03-10 14:28:15 +11:00
InfiniteTF
b3fab3cfef
Make mobile menu behavior more consistent, and stats styles responsive ( #391 )
2020-03-08 12:55:42 +11:00
WithoutPants
088ddc9df4
Add new v2.5 UI ( #357 )
2020-03-05 10:15:02 +11:00
InfiniteTF
41f7a46ac1
Fix performer height filter error ( #388 )
...
* Fix performer height filter error
* Make all performer columns qualified
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-03-03 10:30:29 +11:00
InfiniteTF
80a8d2de97
Use parameter binding for all queries ( #387 )
2020-03-03 09:18:14 +11:00
Infinite
6d71663f99
Fix whitespace
2020-03-01 21:04:37 +01:00
Infinite
195158db8b
Fix performer scrape menu layout
2020-03-01 21:04:37 +01:00
Infinite
3a0420b79e
Change i18n to just use single language setting
2020-03-01 21:04:37 +01:00
Infinite
0fdde7726b
i18n
2020-03-01 21:04:37 +01:00
Infinite
716c33fc8e
Use parameter binding for all queries
2020-02-29 16:18:59 +01:00
bnkai
6578cfb843
Fix version check for v0.1.0+ ( #382 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-02-25 11:59:08 +11:00
WithoutPants
bf49a23df8
Fix panic when version check times out ( #374 )
2020-02-19 07:56:24 +11:00
twotobinary
776727140f
fix(middleware): set baseURL to external host if provided ( #369 )
2020-02-17 14:01:02 +11:00
bnkai
df890dca79
Fix database locked on image cover too big bug ( #359 ) ( #360 )
2020-02-13 11:57:17 +11:00
WithoutPants
3c1eeb3d47
Prepare for 0.1.0 release ( #345 )
...
* Tag develop builds as latest. Version in makefile
* Rename latest to latest_develop
* Update GetLatestVersion
* Separate master and develop releases
* Add release date back into development version
* Remove unused code
* Two minute limit per file to upload to transfer.sh
2020-02-07 06:39:08 +11:00
WithoutPants
f87117b0d6
Add O-counter ( #334 )
...
* Add backend support for o-counter
* Add o-counter buttons everywhere
* Put o-counter button right-aligned on tabs
* Add o-counter filter
2020-02-02 19:17:28 -05:00
InfiniteTF
cd9c6e998e
Add cache headers to static files and etags to performer images ( #337 )
2020-01-31 17:20:14 -05:00
InfiniteTF
6a6e8d8875
Change thumbnail default size and resize algorithm ( #336 )
...
* Change thumbnail resize algorithm and add size parameter
* Height -> Width
* Change default size from 100px to 200px
* Height -> width
2020-01-31 17:19:15 -05:00
WithoutPants
03c07a429d
Add Xpath post processing and performer name query ( #333 )
...
* Extend xpath configuration. Support concatenation
* Add parseDate parsing option
* Add regex replacements
* Add xpath query performer by name
* Fix loading spinner on scrape performer
* Change ReplaceAll to Replace
2020-01-31 17:17:40 -05:00
WithoutPants
78eb527ec4
Scraper fixes ( #332 )
...
* Fix panic on invalid xpath
* Add missing attrs to scraped performer fragment
2020-01-24 22:36:24 -05:00
WithoutPants
3d3f8877de
Accept random seed from UI for random sorting ( #328 )
2020-01-24 22:35:21 -05:00
WithoutPants
c83eb098bc
Allow path separator in scene filename parser pattern ( #327 )
...
* Allow path in filename parser
* Fix helper text re escaping {} characters
2020-01-24 22:34:01 -05:00
bnkai
fed7311d9c
Add timeout to neededGenerate function ( #324 )
...
* Add timeout to neededGenerate function
* * verbose and cosmetic fixes
2020-01-21 22:54:38 -05:00
WithoutPants
cf96cae4c8
Add scene duration filter ( #313 )
...
* Add scene duration filter
2020-01-13 11:43:14 -05:00
WithoutPants
600862c0bb
Autotag no longer overwrites studio ( #312 )
2020-01-09 13:40:23 -05:00
bnkai
87f0b667b5
Add check version functionality ( #296 )
...
* Add check version functionality
* add backend support
* add ui support
* minor fixes
* cosmetic fixes
* workaround query refetch not working after network error
* revert changes to Makefile after testing is complete
* switch to Releases Github API endpoint, add latest Release URL to UI
* latest version is only shown in UI when version is available and data is ready
* resolve conflict , squash rebase
2020-01-07 17:21:23 -05:00
Stash Dev
f8aa0433a3
Fix scene covers not importing correctly
2020-01-06 15:18:06 -08:00
WithoutPants
488cd5575d
Use arg for regex queries ( #311 )
2020-01-06 13:02:25 -05:00
WithoutPants
7fdaccf669
Xpath scraping from URL ( #285 )
...
* Add xpath performer and scene scraping
* Add studio scraping
* Refactor code
* Fix compile error
* Don't overwrite performer URL during a scrape
2020-01-04 11:39:33 -05:00
Stash Dev
d35f3a9b10
Tweaked launch console messages
2019-12-31 14:42:06 -08:00
Stash Dev
653406efd1
Added support for import / export of scene cover images
2019-12-31 14:38:49 -08:00
all-hail-canada
9766071815
Display both server address and listening address in log ( #300 )
...
* Show localhost in console output instead of 0.0.0.0
* Updated message to reflect both navigation and listening address
Co-authored-by: InfiniteTF <infinitekittens@protonmail.com>
2019-12-31 09:22:34 -08:00
Stash Dev
9a51c586db
Fix incorrect sprites
...
The step size was being cast to an int which made the time lose precision and would offset sprite images incorrectly
2019-12-31 09:14:52 -08:00
FleetingOrchard
b31af52d41
Fix usage of Box.Bytes causing depreciation message ( #295 )
...
* Add release make target
* Use Box.Find now that Box.Bytes is depreciated
Pretty much directly mocked off of the post-depreciation implementation
of Box.Bytes in packr. In theory we should totally be checking the
returned error but I'm lazy.
2019-12-28 09:53:16 -08:00
bnkai
52dd0197ee
Added exclude patterns support for Clean Task ( #274 )
...
* Added exclude patterns support for Clean Task
* Added test file
* Refactoring and cosmetic fixes
* * Replace Match with MatchString
2019-12-23 21:06:07 -05:00
WithoutPants
f52db4f58b
Add stash scraper type ( #269 )
...
* Add stash scraper type
* Add graphql client to vendor
* Embed stash credentials in URL
* Fill URL from scraped scene
* Nil IDs returned from remote stash
* Nil check
2019-12-20 19:13:23 -05:00
WithoutPants
043745a84f
Add cache breaker for screenshot using modtime ( #271 )
2019-12-17 12:28:44 -05:00
bnkai
0714cbfa34
Add exclude file from scan feature ( #253 )
...
* Added exclude file from scan feature
* Abort exclusion instead of panicking when pattern isn't valid
* Added UI configuration for exclude patterns
* * cosmetic fixes
* changed behavior of exclude function to continue and ignore invalide regex patterns
* added some more tests (windows networks and continue after regex error)
2019-12-17 09:26:16 -05:00
WithoutPants
92837fe1f7
Add scene metadata scraping functionality ( #236 )
...
* Add scene scraping functionality
* Adapt to changed scraper config
2019-12-15 20:35:34 -05:00
WithoutPants
f8a760d729
Fix vtt for chapter display in scene players ( #263 )
2019-12-13 15:41:46 -05:00
WithoutPants
da3e91193c
Allow uploading of custom scene covers ( #262 )
...
* Refactor common code
* Further refactoring
* Add UI support for changing scene cover image
* Add backend support for changing scene screenshot
2019-12-13 15:40:58 -05:00
WithoutPants
c05496a724
Make scene metadata from file metadata optional ( #259 )
2019-12-13 01:18:02 -05:00
WithoutPants
50784025f2
Change scraper config to yaml ( #256 )
2019-12-12 14:27:44 -05:00
