uwsgi 有一个进程的 cpu 占用率很高,对应的是个小站,查看下日志. 好多机器人.
但是怎么感觉不像是真的机器人呢? bing baidu 机器人携手一起来.
而且访问的都是些什么目录啊,我又不是 wordpress 的站.
看日志:
199.30.20.3 - - [01/Aug/2014:12:06:02 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
199.30.20.3 - - [01/Aug/2014:12:06:11 +0800] "GET /wp-content/uploads/2008/02/dmp3.jpg HTTP/1.1" 301 184 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
199.30.20.3 - - [01/Aug/2014:12:06:11 +0800] "GET /wp-content/uploads/2008/02/dmp3.jpg HTTP/1.1" 404 142 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
208.115.113.89 - - [01/Aug/2014:12:15:57 +0800] "GET / HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)"
112.111.25.110 - - [01/Aug/2014:12:17:28 +0800] "GET / HTTP/1.0" 301 184 "http://www.keji3.com/" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)"
208.115.111.73 - - [01/Aug/2014:13:11:57 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)"
208.115.111.73 - - [01/Aug/2014:13:11:57 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)"
157.55.39.7 - - [01/Aug/2014:13:26:24 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
157.55.39.9 - - [01/Aug/2014:13:26:39 +0800] "GET /2008/02/02/a-perfect-match-his-and-hers-keyholder/ HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)"
123.125.71.13 - - [01/Aug/2014:13:48:31 +0800] "GET / HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.108.100 - - [01/Aug/2014:13:48:48 +0800] "GET / HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
220.181.51.81 - - [01/Aug/2014:13:55:14 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "Mozilla/5.0 (Windows NT 5.1; rv:6.0.2) Gecko/20100101 Firefox/6.0.2"
123.125.71.50 - - [01/Aug/2014:13:56:32 +0800] "GET / HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
208.115.111.73 - - [01/Aug/2014:14:15:48 +0800] "GET /users/ HTTP/1.1" 301 184 "-" "Mozilla/5.0 (compatible; DotBot/1.1; http://www.opensiteexplorer.org/dotbot, help@moz.com)"
42.156.138.38 - - [01/Aug/2014:14:21:26 +0800] "GET / HTTP/1.1" 301 184 "-" "YisouSpider"
65.55.215.58 - - [01/Aug/2014:14:31:38 +0800] "GET /robots.txt HTTP/1.1" 301 184 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
65.55.215.58 - - [01/Aug/2014:14:31:43 +0800] "GET /wp-content/uploads/2008/02/dmp2.jpg HTTP/1.1" 301 184 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
65.55.215.58 - - [01/Aug/2014:14:31:44 +0800] "GET /wp-content/uploads/2008/02/dmp2.jpg HTTP/1.1" 404 142 "-" "msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)"
uwsgi 的日志如下:
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 204/218] 42.156.138.38 () {34 vars in 396 bytes} [Fri Aug 1 06:21:27 2014] GET / => generated 16099 bytes in 96 msecs (HTTP/1.1 200) 2 headers in 208 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 205/219] 65.55.215.58 () {38 vars in 506 bytes} [Fri Aug 1 06:31:43 2014] GET /robots.txt => generated 3508 bytes in 50 msecs (HTTP/1.1 404) 1 headers in 59 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 206/220] 65.55.215.58 () {38 vars in 506 bytes} [Fri Aug 1 06:31:43 2014] GET /robots.txt => generated 3508 bytes in 53 msecs (HTTP/1.1 404) 1 headers in 59 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 207/221] 122.224.86.107 () {40 vars in 687 bytes} [Fri Aug 1 06:53:57 2014] GET / => generated 16099 bytes in 98 msecs (HTTP/1.1 200) 2 headers in 208 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 208/222] 61.4.177.5 () {34 vars in 499 bytes} [Fri Aug 1 07:20:41 2014] GET /feed/ => generated 5648 bytes in 60 msecs (HTTP/1.1 404) 2 headers in 208 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 209/223] 208.115.113.89 () {34 vars in 508 bytes} [Fri Aug 1 07:20:44 2014] GET /robots.txt => generated 3508 bytes in 63 msecs (HTTP/1.1 404) 1 headers in 59 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 210/224] 208.115.113.89 () {34 vars in 508 bytes} [Fri Aug 1 07:20:45 2014] GET /robots.txt => generated 3508 bytes in 52 msecs (HTTP/1.1 404) 1 headers in 59 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 211/225] 122.224.86.107 () {42 vars in 763 bytes} [Fri Aug 1 07:26:34 2014] GET /forum/xian-hua-23/ => generated 13257 bytes in 105 msecs (HTTP/1.1 200) 2 headers in 208 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 212/226] 123.125.71.82 () {38 vars in 533 bytes} [Fri Aug 1 07:28:58 2014] GET /forum/btc-26/ => generated 7899 bytes in 83 msecs (HTTP/1.1 200) 2 headers in 208 bytes (1 switches on core 0)
{address space usage: 206217216 bytes/196MB} {rss usage: 48672768 bytes/46MB} [pid: 4544|app: 0|req: 213/227] 220.181.51.146 () {40 vars in 605 bytes} [Fri Aug 1 07:37:05 2014] GET / => generated 16099 bytes in 96 msecs (HTTP/1.0 200) 2 headers in 208 bytes (1 switches on core 0)
速度确实不高
CPU 为什么 100% 还是不知道,我把进程kill掉就好了,不解决问题,过两天还会有这样的现象.
Fri Aug 1 15:45:21 2014 - DAMN ! worker 1 (pid: 4543) died, killed by signal 9 :( trying respawn ...
Fri Aug 1 15:45:21 2014 - Respawned uWSGI worker 1 (new pid: 32034)