一、数据来源:
1、这批脸书爬虫(facebook)IP来源于尚贤达猎头公司网站采集数据;
2、数据采集时间段:2023年10月-2024年7月;
3、判断标准:主要根据用户代理是否包含“facebook”和IP核实。
二、脸书爬虫(facebook)主要有4个用户代理
序号 | 用户代理(UserAgebt) |
1 | facebookscraper/1.0(+http://www.facebook.com/sharescraper_help.php) |
2 | facebookexternalhit/1.1+(+http://www.facebook.com/externalhit_uatext.php) |
3 | meta-externalagent/1.1+(+https://developers.facebook.com/docs/sharing/webmasters/crawler) |
4 | facebookexternalhit/1.1 |
三、脸书爬虫(facebook)IP地址:
173.252.107.1 | 173.252.69.5 | 173.252.87.113 | 66.220.149.116 | 69.171.249.27 | |
173.252.107.10 | 173.252.69.6 | 173.252.87.114 | 66.220.149.117 | 69.171.249.28 | |
173.252.107.11 | 173.252.69.7 | 173.252.87.115 | 66.220.149.118 | 69.171.249.29 | |
173.252.107.111 | 173.252.69.8 | 173.252.87.116 | 66.220.149.12 | 69.171.249.3 | |
173.252.107.112 | 173.252.69.9 | 173.252.87.117 | 66.220.149.125 | 69.171.249.30 | |
173.252.107.113 | 173.252.70.1 | 173.252.87.118 | 66.220.149.126 | 69.171.249.31 | |
173.252.107.114 | 173.252.70.111 | 173.252.87.119 | 66.220.149.13 | 69.171.249.32 | |
173.252.107.115 | 173.252.70.112 | 173.252.87.12 | 66.220.149.14 | 69.171.249.33 | |
173.252.107.116 | 173.252.70.113 | 173.252.87.120 | 66.220.149.15 | 69.171.249.34 | |
173.252.107.117 | 173.252.70.114 | 173.252.87.124 | 66.220.149.16 | 69.171.249.35 | |
173.252.107.118 | 173.252.70.116 | 173.252.87.13 | 66.220.149.17 | 69.171.249.36 | |
173.252.107.119 | 173.252.70.117 | 173.252.87.14 | 66.220.149.19 | 69.171.249.37 | |
173.252.107.12 | 173.252.70.118 | 173.252.87.15 | 66.220.149.2 | 69.171.249.4 | |
173.252.107.120 | 173.252.70.124 | 173.252.87.16 | 66.220.149.20 | 69.171.249.5 | |
173.252.107.124 | 173.252.70.126 | 173.252.87.17 | 66.220.149.21 | 69.171.249.6 | |
173.252.107.126 | 173.252.70.2 | 173.252.87.18 | 66.220.149.22 | 69.171.249.7 | |
173.252.107.13 | 173.252.70.3 | 173.252.87.19 | 66.220.149.23 | 69.171.249.8 | |
173.252.107.14 | 173.252.70.4 | 173.252.87.2 | 66.220.149.24 | 69.171.249.9 | |
173.252.107.15 | 173.252.79.119 | 173.252.87.20 | 66.220.149.26 | 69.171.251.11 | |
173.252.107.16 | 173.252.79.120 | 173.252.87.21 | 66.220.149.27 | 69.171.251.116 | |
173.252.107.17 | 173.252.79.2 | 173.252.87.22 | 66.220.149.28 | 69.171.251.5 | |
173.252.107.18 | 173.252.79.4 | 173.252.87.23 | 66.220.149.29 | 69.63.184.1 | |
173.252.107.19 | 173.252.79.6 | 173.252.87.24 | 66.220.149.3 | 69.63.184.10 | |
173.252.107.2 | 173.252.79.7 | 173.252.87.25 | 66.220.149.30 | 69.63.184.11 | |
173.252.107.20 | 173.252.83.1 | 173.252.87.26 | 66.220.149.31 | 69.63.184.111 | |
173.252.107.21 | 173.252.83.10 | 173.252.87.3 | 66.220.149.33 | 69.63.184.113 | |
173.252.107.22 | 173.252.83.11 | 173.252.87.30 | 66.220.149.34 | 69.63.184.116 | |
173.252.107.23 | 173.252.83.111 | 173.252.87.34 | 66.220.149.35 | 69.63.184.117 | |
173.252.107.24 | 173.252.83.112 | 173.252.87.4 | 66.220.149.37 | 69.63.184.118 | |
173.252.107.25 | 173.252.83.113 | 173.252.87.5 | 66.220.149.38 | 69.63.184.119 | |
173.252.107.26 | 173.252.83.114 | 173.252.87.6 | 66.220.149.39 | 69.63.184.12 | |
173.252.107.27 | 173.252.83.115 | 173.252.87.7 | 66.220.149.4 | 69.63.184.120 | |
173.252.107.28 | 173.252.83.116 | 173.252.87.8 | 66.220.149.40 | 69.63.184.13 | |
173.252.107.29 | 173.252.83.117 | 173.252.87.9 | 66.220.149.41 | 69.63.184.15 | |
173.252.107.3 | 173.252.83.118 | 173.252.95.1 | 66.220.149.42 | 69.63.184.16 | |
173.252.107.30 | 173.252.83.119 | 173.252.95.10 | 66.220.149.5 | 69.63.184.17 | |
173.252.107.31 | 173.252.83.12 | 173.252.95.118 | 66.220.149.6 | 69.63.184.18 | |
173.252.107.32 | 173.252.83.120 | 173.252.95.119 | 66.220.149.7 | 69.63.184.19 | |
173.252.107.33 | 173.252.83.124 | 173.252.95.16 | 66.220.149.8 | 69.63.184.2 | |
173.252.107.34 | 173.252.83.125 | 173.252.95.18 | 66.220.149.9 | 69.63.184.20 | |
173.252.107.37 | 173.252.83.126 | 173.252.95.19 | 67.220.86.160 | 69.63.184.21 | |
173.252.107.38 | 173.252.83.13 | 173.252.95.21 | 69.171.230.10 | 69.63.184.22 | |
173.252.107.4 | 173.252.83.14 | 173.252.95.24 | 69.171.230.11 | 69.63.184.23 | |
173.252.107.5 | 173.252.83.15 | 173.252.95.25 | 69.171.230.112 | 69.63.184.24 | |
173.252.107.6 | 173.252.83.16 | 173.252.95.4 | 69.171.230.113 | 69.63.184.3 | |
173.252.107.7 | 173.252.83.17 | 173.252.95.5 | 69.171.230.114 | 69.63.184.4 | |
173.252.107.8 | 173.252.83.18 | 173.252.95.6 | 69.171.230.115 | 69.63.184.5 | |
173.252.107.9 | 173.252.83.19 | 173.252.95.7 | 69.171.230.116 | 69.63.184.6 | |
173.252.111.116 | 173.252.83.2 | 173.252.95.8 | 69.171.230.117 | 69.63.184.7 | |
173.252.111.118 | 173.252.83.20 | 31.13.103.10 | 69.171.230.118 | 69.63.184.8 | |
173.252.111.14 | 173.252.83.21 | 31.13.103.119 | 69.171.230.119 | 69.63.184.9 | |
173.252.111.5 | 173.252.83.22 | 31.13.103.4 | 69.171.230.12 | 69.63.189.1 | |
173.252.127.1 | 173.252.83.23 | 31.13.115.1 | 69.171.230.120 | 69.63.189.10 | |
173.252.127.10 | 173.252.83.24 | 31.13.115.10 | 69.171.230.125 | 69.63.189.112 | |
173.252.127.11 | 173.252.83.25 | 31.13.115.116 | 69.171.230.126 | 69.63.189.117 | |
173.252.127.112 | 173.252.83.26 | 31.13.115.120 | 69.171.230.13 | 69.63.189.119 | |
173.252.127.113 | 173.252.83.27 | 31.13.115.2 | 69.171.230.14 | 69.63.189.120 | |
173.252.127.114 | 173.252.83.28 | 31.13.115.5 | 69.171.230.15 | 69.63.189.2 | |
173.252.127.115 | 173.252.83.29 | 31.13.127.11 | 69.171.230.19 | 69.63.189.3 | |
173.252.127.116 | 173.252.83.3 | 31.13.127.114 | 69.171.230.23 | 69.63.189.4 | |
173.252.127.117 | 173.252.83.30 | 31.13.127.118 | 69.171.230.24 | 69.63.189.5 | |
173.252.127.118 | 173.252.83.31 | 31.13.127.13 | 69.171.230.25 | 69.63.189.7 | |
173.252.127.119 | 173.252.83.32 | 31.13.127.15 | 69.171.230.3 | 69.63.189.9 | |
173.252.127.12 | 173.252.83.33 | 31.13.127.16 | 69.171.230.8 | ||
173.252.127.13 | 173.252.83.34 | 54.167.129.239 | 69.171.230.9 | ||
173.252.127.14 | 173.252.83.35 | 57.141.3.1 | 69.171.231.116 | ||
173.252.127.15 | 173.252.83.36 | 57.141.3.10 | 69.171.231.118 | ||
173.252.127.16 | 173.252.83.37 | 57.141.3.11 | 69.171.231.5 | ||
173.252.127.17 | 173.252.83.38 | 57.141.3.12 | 69.171.249.1 | ||
173.252.127.18 | 173.252.83.39 | 57.141.3.13 | 69.171.249.10 | ||
173.252.127.19 | 173.252.83.4 | 57.141.3.14 | 69.171.249.11 | ||
173.252.127.2 | 173.252.83.40 | 57.141.3.15 | 69.171.249.111 | ||
173.252.127.20 | 173.252.83.41 | 57.141.3.16 | 69.171.249.112 | ||
173.252.127.21 | 173.252.83.42 | 57.141.3.17 | 69.171.249.113 | ||
173.252.127.22 | 173.252.83.43 | 57.141.3.18 | 69.171.249.114 | ||
173.252.127.23 | 173.252.83.44 | 57.141.3.19 | 69.171.249.115 | ||
173.252.127.24 | 173.252.83.45 | 57.141.3.2 | 69.171.249.116 | ||
173.252.127.25 | 173.252.83.46 | 57.141.3.20 | 69.171.249.117 | ||
173.252.127.26 | 173.252.83.47 | 57.141.3.21 | 69.171.249.118 | ||
173.252.127.27 | 173.252.83.48 | 57.141.3.22 | 69.171.249.119 | ||
173.252.127.3 | 173.252.83.49 | 57.141.3.23 | 69.171.249.12 | ||
173.252.127.4 | 173.252.83.5 | 57.141.3.24 | 69.171.249.120 | ||
173.252.127.5 | 173.252.83.50 | 57.141.3.25 | 69.171.249.124 | ||
173.252.127.6 | 173.252.83.51 | 57.141.3.26 | 69.171.249.125 | ||
173.252.127.7 | 173.252.83.52 | 57.141.3.27 | 69.171.249.126 | ||
173.252.127.8 | 173.252.83.53 | 57.141.3.28 | 69.171.249.13 | ||
173.252.127.9 | 173.252.83.54 | 57.141.3.29 | 69.171.249.14 | ||
173.252.69.1 | 173.252.83.55 | 57.141.3.3 | 69.171.249.15 | ||
173.252.69.111 | 173.252.83.56 | 57.141.3.30 | 69.171.249.16 | ||
173.252.69.112 | 173.252.83.6 | 57.141.3.4 | 69.171.249.17 | ||
173.252.69.113 | 173.252.83.60 | 57.141.3.5 | 69.171.249.18 | ||
173.252.69.114 | 173.252.83.64 | 57.141.3.6 | 69.171.249.19 | ||
173.252.69.115 | 173.252.83.7 | 57.141.3.7 | 69.171.249.2 | ||
173.252.69.116 | 173.252.83.8 | 57.141.3.8 | 69.171.249.20 | ||
173.252.69.117 | 173.252.83.9 | 57.141.3.9 | 69.171.249.21 | ||
173.252.69.118 | 173.252.87.1 | 66.220.149.1 | 69.171.249.22 | ||
173.252.69.125 | 173.252.87.10 | 66.220.149.10 | 69.171.249.23 | ||
173.252.69.2 | 173.252.87.11 | 66.220.149.112 | 69.171.249.24 | ||
173.252.69.3 | 173.252.87.111 | 66.220.149.113 | 69.171.249.25 | ||
173.252.69.4 | 173.252.87.112 | 66.220.149.115 | 69.171.249.26 |
四、脸书爬虫(facebook)的一些特点:
1、对网站没什么危害,但抓取网站频繁,对资源消耗较大,如果不做境外业务,可能通过防火墙阻止。
五、EXECL格式数据下载
点击进入下载页面