bnkai
4373f9bf01
Add cdp support for xpath scrapers ( #625 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-08-04 10:42:40 +10:00
WithoutPants
2b9215702e
Refactor xpath scraper code. Add fixed and map ( #616 )
...
* Refactor xpath scraper code
* Make post-process a list
* Add map post-process action
* Add fixed xpath values
* Refactor scrapers into cache
* Refactor into mapped config
* Trim test html
2020-07-21 14:06:25 +10:00
bnkai
56210cf456
Use referer on xpath getImage, apply printHTML to subscraper also ( #661 )
2020-07-10 08:42:06 +10:00
bnkai
f8048dc27c
Increase xpath redirects, use cookies ( #624 )
2020-06-22 12:18:02 +10:00
bnkai
9d0522f62d
Add "split" xpath in post-processing , newlines in replace support ( #579 )
2020-06-18 10:47:10 +10:00
bnkai
f40e234748
Apply xpath parseDate after subScraper ( #606 )
2020-06-15 21:38:59 +10:00
WithoutPants
ec420df871
Add debug logging for xpath scraping ( #555 )
...
* Add debug logging for xpath scraping
* Add logging for processing scene members
2020-05-20 22:46:00 +10:00
bnkai
0fc57ce1e0
Fix xpath comments text ( #550 )
2020-05-18 12:26:20 +10:00
WithoutPants
abf2b49803
Configurable scraper user agent string ( #409 )
...
* Add debug scrape option.
Co-authored-by: HiddenPants255 <>
2020-03-21 08:55:15 +11:00
WithoutPants
34d829338d
Add image scraping support ( #370 )
...
* Add sub-scraper functionality
* Add scraping of performer image
* Add scene cover image scraping
* Port UI changes to v2.5
* Fix v2.5 dialog suggest color
* Don't convert eol of UI to support pretty
2020-03-11 11:41:55 +11:00
caustico
5fb8bbf768
Movies Section ( #338 )
...
Co-authored-by: WithoutPants <53250216+WithoutPants@users.noreply.github.com>
2020-03-10 14:28:15 +11:00
WithoutPants
03c07a429d
Add Xpath post processing and performer name query ( #333 )
...
* Extend xpath configuration. Support concatenation
* Add parseDate parsing option
* Add regex replacements
* Add xpath query performer by name
* Fix loading spinner on scrape performer
* Change ReplaceAll to Replace
2020-01-31 17:17:40 -05:00
WithoutPants
78eb527ec4
Scraper fixes ( #332 )
...
* Fix panic on invalid xpath
* Add missing attrs to scraped performer fragment
2020-01-24 22:36:24 -05:00
WithoutPants
7fdaccf669
Xpath scraping from URL ( #285 )
...
* Add xpath performer and scene scraping
* Add studio scraping
* Refactor code
* Fix compile error
* Don't overwrite performer URL during a scrape
2020-01-04 11:39:33 -05:00
