首页 > Python 爬虫 POST

Python 爬虫 POST

问各位大神一个问题!

我用requests这个模块来做post
但有一个问题

requests.post(url,data)

data的值要参照网页中post的值来定义
比如
username:xxx
password:xxx
或者其他什么的
但我抓取不到post页面...

例如我在百度上搜索新闻,但没看到post方法,只有get...
这个时候怎么处理?
我怎么试百度自动查询?


那就用get方法呗


因为这个请求就是使用GET的方式发出的, 而且 还是采用的 jsonp 的形式.

https://sp0.baidu.com/5a1Fazu8AA54nxGko9WTAnF6hhy/su?wd=hello&json=1&p=3&sid=18455_17745_1432_13702_18535_17943_18731_18546_18559_17001_17073_15550_11771_17996_10633&req=2&pbs=hello&csor=5&cb=jQuery110209103324085008353_1451398236482&_=1451398236493

jQuery110209103324085008353_1451398236482({"q":"hello","p":false,"bs":"","csor":"5","g":[ { "q": "hello kitty", "t": "n", "st": { "q": "hello kitty", "new": 0 } }, { "q": "hello adele", "t": "n", "st": { "q": "hello adele", "new": 0 } }, { "q": "hello bitches", "t": "n", "st": { "q": "hello bitches", "new": 0 } }, { "q": "hello venus", "t": "n", "st": { "q": "hello venus", "new": 0 } }, { "q": "hello 阿黛尔", "t": "n", "st": { "q": "hello 阿黛尔", "new": 0 } }, { "q": "hello world", "t": "n", "st": { "q": "hello world", "new": 0 } }, { "q": "hello树先生", "t": "n", "st": { "q": "hello树先生", "new": 0 } }, { "q": "hello china", "t": "n", "st": { "q": "hello china", "new": 0 } }, { "q": "hello 歌词", "t": "n", "st": { "q": "hello 歌词", "new": 0 } }, { "q": "hello baby", "t": "n", "st": { "q": "hello baby", "new": 0 } } ],"s":["hello kitty","hello adele","hello bitches","hello venus","hello 阿黛尔","hello world","hello树先生","hello china","hello 歌词","hello baby"]});
【热门文章】
【热门文章】