Commit 972b31c

committed

Explicitly set the default request headers.

1 parent 3d4e7ff commit 972b31cCopy full SHA for 972b31c

File tree

-4

lines changed

-4

lines changed

Lines changed: 7 additions & 4 deletions

Original file line number	Diff line number	Diff line change
`@@ -38,10 +38,13 @@`
`38`	`38`	`#TELNETCONSOLE_ENABLED = False`
`39`	`39`
`40`	`40`	`# Override the default request headers:`
`41`		`-#DEFAULT_REQUEST_HEADERS = {`
`42`		`-# 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8',`
`43`		`-# 'Accept-Language': 'en',`
`44`		`-#}`
	`41`	`+DEFAULT_REQUEST_HEADERS = {`
	`42`	`+ 'Accept': 'text/html,application/xhtml+xml,application/xml;q=0.9,/;q=0.8',`
	`43`	`+ 'User-Agent': USER_AGENT,`
	`44`	`+ 'Connection': 'Keep-Alive',`
	`45`	`+ 'Accept-Encoding': 'gzip, deflate',`
	`46`	`+ 'Accept-Language': 'en-US,*',`
	`47`	`+}`
`45`	`48`
`46`	`49`	`# Enable or disable spider middlewares`
`47`	`50`	`# See http://scrapy.readthedocs.org/en/latest/topics/spider-middleware.html`

Comments

(0)