Backup_Repos/FanFicFare
1
0
Fork 0
mirror of https://github.com/JimmXinu/FanFicFare.git synced 2026-05-09 05:21:13 +02:00
Code Issues Projects Releases Wiki Activity

Don't use mobile User-Agents with cloudscraper--adapter_fanfictionnet doesn't handle mobile pages.

Browse source
This commit is contained in:
Jim Miller 2020-12-22 14:29:40 -06:00
parent c6cafa87f2
commit a2607ffa54
1 changed files with 9 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

10
fanficfare/configurable.py
View file

@ -1073,7 +1073,15 @@ class Configuration(ConfigParser):
def get_scraper(self):
if not self.scraper:
self.scraper = cloudscraper.CloudScraper()
## ffnet adapter can't parse mobile output, so we only
## want desktop browser. But cloudscraper then insists on
## a browser and platform, too.
self.scraper = cloudscraper.CloudScraper(browser={
'browser': 'chrome',
'platform': 'windows',
'mobile': False,
'desktop': True,
})
## CloudScraper is subclass of requests.Session.
## probably need import higher up if ever used.
# import requests