Commit graph

1152 commits

Author SHA1 Message Date
peolic
39bc8b7351
update scraping docs (#720) 2020-08-11 08:44:57 +10:00
woodgen
4045ddf3e9
Implement scraping movies by URL (#709)
* api/urlbuilders/movie: Auto format.

* graphql+pkg+ui: Implement scraping movies by URL.

This patch implements the missing required boilerplate for scraping
movies by URL, using performers and scenes as a reference.

Although this patch contains a big chunck of ground work for enabling
scraping movies by fragment, the feature would require additional
changes to be completely implemented and was not tested.

* graphql+pkg+ui: Scrape movie studio.

Extends and corrects the movie model for the ability to store and
dereference studio IDs with received studio string from the scraper.
This was done with Scenes as a reference. For simplicity the duplication
of having `ScrapedMovieStudio` and `ScrapedSceneStudio` was kept, which
should probably be refactored to be the same type in the model in the
future.

* ui/movies: Add movie scrape dialog.

Adds possibility to update existing movie entries with the URL scraper.

For this the MovieScrapeDialog.tsx was implemented with Performers and
Scenes as a reference. In addition DurationUtils needs to be called one
time for converting seconds from the model to the string that is
displayed in the component. This seemed the least intrusive to me as it
kept a ScrapeResult<string> type compatible with ScrapedInputGroupRow.
2020-08-10 15:34:15 +10:00
WithoutPants
7158e83b75
Add JSON scrape support (#717)
* Add support for scene fragment scrape in xpath
2020-08-10 14:21:50 +10:00
WithoutPants
470a2b5833
Fix sprite vtt panic (#718) 2020-08-10 09:20:04 +10:00
WithoutPants
711fadcffd
Don't play after failover (#716) 2020-08-10 09:19:37 +10:00
WithoutPants
634b892df1
Fix typo 2020-08-09 13:48:47 +10:00
WithoutPants
0ffefa6e16
Add plugin tasks (#651) 2020-08-08 12:05:35 +10:00
WithoutPants
0874852fa8
Improve oshash collision detection and logging (#713)
* Log colliding file when setting hash
* Check for existing using both hashes
2020-08-08 11:22:25 +10:00
WithoutPants
5992ff8706
Add oshash support (#667) 2020-08-06 11:21:14 +10:00
friendlycrab
f59ad0ca2b
Allow adding performer & studio from scenes page (#663)
* Allow adding performer & studio from scenes page

Adds "create" options for performer and studio select in SceneEditPanel.
Adds new FilterSelectComponent to reduce duplicate logic in selects.

Make invalidateQueries case insensitive so we can pass upper-case query
names that also work with refetchQueries
2020-08-05 15:38:11 +10:00
WithoutPants
f5c3cafa63
Fix markers not autoplaying (#698)
* Fix marker seeking
* Autostart when loading from marker
2020-08-05 09:48:23 +10:00
WithoutPants
b166abfa7b
Fix scraping error (#704) 2020-08-04 20:43:56 +10:00
bnkai
4373f9bf01
Add cdp support for xpath scrapers (#625)
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-08-04 10:42:40 +10:00
Nic Patterson
1b4a9eed36
add non-binary option for gender (#695) 2020-08-01 16:26:00 +10:00
WithoutPants
b465c36fc7
Fix tag delete (#690)
* Fix tag list delete button not working
* Fix tags not refreshed when created/deleted
2020-07-29 11:51:20 +10:00
WithoutPants
278be33618
Fix marker seeking (#689) 2020-07-29 11:50:58 +10:00
WithoutPants
c327a98ecb
Fix missing video player poster (#686) 2020-07-24 10:45:48 +10:00
InfiniteTF
116f61b6bf
Fix potential sprite generation segfault (#685) 2020-07-24 09:20:34 +10:00
WithoutPants
a2341f0819
Allow customisation of preview generation (#673)
* Add generate-specific options
* Include no-cache in preview response
2020-07-23 12:51:35 +10:00
WithoutPants
37be146a9d
Transcode stream refactor (#609)
* Remove forceMkv and forceHEVC
* Add HLS support and refactor
* Add new streaming endpoints
2020-07-23 11:56:08 +10:00
InfiniteTF
274d84ce93
Fix performer card name truncation (#682) 2020-07-22 11:21:14 +10:00
WithoutPants
2b9215702e
Refactor xpath scraper code. Add fixed and map (#616)
* Refactor xpath scraper code
* Make post-process a list
* Add map post-process action
* Add fixed xpath values
* Refactor scrapers into cache
* Refactor into mapped config
* Trim test html
2020-07-21 14:06:25 +10:00
InfiniteTF
f4ae9b09a6
Fix FormattedDate timezone bug (#681) 2020-07-21 13:04:56 +10:00
WithoutPants
c1be600b01
Don't show dialog when setting front movie image (#678) 2020-07-21 08:30:26 +10:00
WithoutPants
c104c6d075
Generate content for specific scenes (#672)
* Add UI dialog for scene(s)
* Move preview preset to config
2020-07-19 11:59:18 +10:00
WithoutPants
8e4945325d
Fix badly sized performer container (#670) 2020-07-19 11:10:52 +10:00
WithoutPants
8076405965
Support random performer sort (#666) 2020-07-14 08:51:39 +10:00
bnkai
ec2bcc7a74
Scan for files with ALLCAPS extensions (#650) 2020-07-11 17:22:36 +10:00
bnkai
56210cf456
Use referer on xpath getImage, apply printHTML to subscraper also (#661) 2020-07-10 08:42:06 +10:00
WithoutPants
e9141b5dfc
Fix tag query performance problems (#657)
* Fix sql tracing
* Disable query by marker count
* Disable unit test
2020-07-09 08:42:07 +10:00
WithoutPants
f5784246ce
Add website link to readme 2020-07-08 13:05:55 +10:00
WithoutPants
244ae54f3f
Add grid view, image to tag (#641)
* Add grid view for tags
* Add tag page
* Import/export tags
* Add tag name uniqueness checks
* Fix styling on missing marker previews
* Add trace loglevel
* Add SQL trace
* Add filter options for tags
* Add tag sort by options
* Add tag page keyboard shortcuts
2020-07-07 10:35:43 +10:00
WithoutPants
54430dbc11
Fix travis not validating UI (#653)
* Fix travis not validating UI
* Fix lint errors
2020-07-06 08:58:35 +10:00
WithoutPants
f1c544affb
Scrape dialog (#644)
* Fix performer page button spacing
* Improve scene URL scrape button styling
2020-07-02 10:10:29 +10:00
WithoutPants
bfeb7d1824
Add keyboard shortcuts (#637)
* Add documentation
* Fix manual styling
* Add dialog for setting Movie images
* Mention manual in README
2020-07-02 08:45:14 +10:00
WithoutPants
3157d748bc
Scene selection improvements (#642)
* Select subsequent scenes on card click
2020-07-01 11:50:43 +10:00
WithoutPants
d516947af2
Strip debug symbols from release builds (#636)
* Add release target that strips debug symbols
* Make cross compile use make
2020-06-29 14:44:21 +10:00
WithoutPants
56b9c081ec
[RFC] Fix query toolbar, performer/studio/movie page styling improvements (#632)
* Fix query toolbar
* Fix performer page styling
* Improve studio page styling
* Improve movie page styling
2020-06-26 07:49:00 +10:00
WithoutPants
883a0e785a
Fix UI not showing version (#631) 2020-06-24 15:46:37 +10:00
WithoutPants
455e16ece9
Support deleting multiple scenes (#630)
* Improve layout and add buttons
* Move functionality into ListFilter
* Make modal style dark
* Convert scene options into edit scenes dialog
* Add delete scenes dialog
* Clear selected ids on delete
* Refetch after update/delete
* Use DeleteScenesDialog in Scene page
* Show scene check boxes in small screens
* Change default multi-set mode to set
2020-06-23 10:40:11 +10:00
WithoutPants
83f8bc0832
In-app help manual (#628) 2020-06-23 10:15:02 +10:00
WithoutPants
534d47500b
Integrate build version in UI (#629) 2020-06-23 09:51:57 +10:00
WithoutPants
aa57b75243
Add changelog entry for #618 2020-06-23 09:21:18 +10:00
WithoutPants
7a74658a73
Move image blobs into separate tables (#618)
* Scene cover fallback to database
* Fix panic if studio not found
* Fix movie studio not being imported/exported
2020-06-23 09:19:19 +10:00
bnkai
f8048dc27c
Increase xpath redirects, use cookies (#624) 2020-06-22 12:18:02 +10:00
WithoutPants
77a5b1d814
Add custom served folders (#620) 2020-06-21 22:25:13 +10:00
WithoutPants
d3ababf0a1
Gallery list improvement (#622)
* Add grid view to galleries
* Show scene in gallery card
* Add is missing scene gallery filter
* Don't store galleries with no images
2020-06-21 21:43:57 +10:00
WithoutPants
e50f1d01be
Fix scene delete (#621) 2020-06-19 23:09:47 +10:00
WithoutPants
f60ce01fec
Render pagination at top as well (#614) 2020-06-18 11:10:00 +10:00
bnkai
9d0522f62d
Add "split" xpath in post-processing , newlines in replace support (#579) 2020-06-18 10:47:10 +10:00