Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Sign up
Appearance settings

Commit f37f3ce

Browse files
author
Germey
committed
change max number
1 parent 43336d4 commit f37f3ce

File tree

6 files changed

+6
-6
lines changed

6 files changed

+6
-6
lines changed

‎proxypool/crawlers/public/daili66.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55

66
BASE_URL = 'http://www.66ip.cn/{page}.html'
7-
MAX_PAGE = 50
7+
MAX_PAGE = 3
88

99

1010
class Daili66Crawler(BaseCrawler):

‎proxypool/crawlers/public/ip3366.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
import re
44

55

6-
MAX_PAGE = 8
6+
MAX_PAGE = 3
77
BASE_URL = 'http://www.ip3366.net/free/?stype={stype}&page={page}'
88

99

‎proxypool/crawlers/public/jiangxianli.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55

66
BASE_URL = 'https://ip.jiangxianli.com/api/proxy_ips?page={page}'
77

8-
MAX_PAGE = 10
8+
MAX_PAGE = 3
99

1010

1111
class JiangxianliCrawler(BaseCrawler):

‎proxypool/crawlers/public/kuaidaili.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55

66

77
BASE_URL = 'https://www.kuaidaili.com/free/{type}/{page}/'
8-
MAX_PAGE = 300
8+
MAX_PAGE = 3
99

1010

1111
class KuaidailiCrawler(BaseCrawler):

‎proxypool/crawlers/public/taiyangdaili.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
from pyquery import PyQuery as pq
44

55
BaseUrl = 'http://www.taiyanghttp.com/free/page{num}'
6-
MAX_PAGE = 5
6+
MAX_PAGE = 3
77

88

99
class TaiyangdailiCrawler(BaseCrawler):

‎proxypool/crawlers/public/xiaoshudaili.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@
55

66
BASE_URL = "http://www.xsdaili.cn/"
77
PAGE_BASE_URL = "http://www.xsdaili.cn/dayProxy/ip/{page}.html"
8-
MAX_PAGE = 50
8+
MAX_PAGE = 3
99

1010

1111
class XiaoShuCrawler(BaseCrawler):

0 commit comments

Comments
(0)

AltStyle によって変換されたページ (->オリジナル) /