一、数据来源:
1、这批今日头条爬虫(zhanzhang.toutiao.com)IP来源于尚贤达猎头网站采集数据;
2、数据采集时间段:2023年10月-2024年7月;
3、判断标准:主要根据用户代理是否包含“zhanzhang.toutiao.com”和IP核实。
二、今日头条爬虫(zhanzhang.toutiao.com)主要有4个用户代理
序号 |
UA |
1 |
Mozilla/5.0+(Linux;+Android+5.0)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
2 |
Mozilla/5.0+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/70.0.0.0+Safari/537.36 |
3 |
Mozilla/5.0+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
4 |
Mozilla/5.0+(iPhone;+CPU+iPhone+OS+7_1_2+like+Mac+OS+X)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Version/7.0+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/) |
三、今日头条爬虫(zhanzhang.toutiao.com)IP地址:
1、主要有以下四个网段:
(1)、110.249.201.0/24
(2)、110.249.202.0/24
(3)、111.225.148.0/24
(4)、111.225.149.0/24
110.249.201.10 |
110.249.201.79 |
110.249.202.57 |
111.225.148.245 |
111.225.149.21 |
110.249.201.100 |
110.249.201.8 |
110.249.202.58 |
111.225.148.246 |
111.225.149.210 |
110.249.201.101 |
110.249.201.80 |
110.249.202.59 |
111.225.148.247 |
111.225.149.211 |
110.249.201.102 |
110.249.201.81 |
110.249.202.6 |
111.225.148.248 |
111.225.149.212 |
110.249.201.103 |
110.249.201.82 |
110.249.202.60 |
111.225.148.249 |
111.225.149.213 |
110.249.201.104 |
110.249.201.83 |
110.249.202.61 |
111.225.148.25 |
111.225.149.214 |
110.249.201.105 |
110.249.201.84 |
110.249.202.62 |
111.225.148.26 |
111.225.149.215 |
110.249.201.106 |
110.249.201.85 |
110.249.202.63 |
111.225.148.27 |
111.225.149.216 |
110.249.201.107 |
110.249.201.86 |
110.249.202.64 |
111.225.148.28 |
111.225.149.217 |
110.249.201.108 |
110.249.201.87 |
110.249.202.65 |
111.225.148.29 |
111.225.149.218 |
110.249.201.109 |
110.249.201.88 |
110.249.202.66 |
111.225.148.3 |
111.225.149.219 |
110.249.201.11 |
110.249.201.89 |
110.249.202.67 |
111.225.148.30 |
111.225.149.22 |
110.249.201.110 |
110.249.201.9 |
110.249.202.68 |
111.225.148.31 |
111.225.149.220 |
110.249.201.111 |
110.249.201.90 |
110.249.202.69 |
111.225.148.32 |
111.225.149.221 |
110.249.201.112 |
110.249.201.91 |
110.249.202.7 |
111.225.148.33 |
111.225.149.222 |
110.249.201.113 |
110.249.201.92 |
110.249.202.70 |
111.225.148.34 |
111.225.149.223 |
110.249.201.114 |
110.249.201.93 |
110.249.202.71 |
111.225.148.35 |
111.225.149.224 |
110.249.201.115 |
110.249.201.94 |
110.249.202.72 |
111.225.148.36 |
111.225.149.225 |
110.249.201.116 |
110.249.201.95 |
110.249.202.73 |
111.225.148.37 |
111.225.149.226 |
110.249.201.117 |
110.249.201.96 |
110.249.202.74 |
111.225.148.38 |
111.225.149.227 |
110.249.201.118 |
110.249.201.97 |
110.249.202.75 |
111.225.148.39 |
111.225.149.228 |
110.249.201.119 |
110.249.201.98 |
110.249.202.76 |
111.225.148.4 |
111.225.149.229 |
110.249.201.12 |
110.249.201.99 |
110.249.202.77 |
111.225.148.40 |
111.225.149.23 |
110.249.201.120 |
110.249.202.10 |
110.249.202.78 |
111.225.148.41 |
111.225.149.230 |
110.249.201.121 |
110.249.202.100 |
110.249.202.79 |
111.225.148.42 |
111.225.149.231 |
110.249.201.13 |
110.249.202.101 |
110.249.202.8 |
111.225.148.43 |
111.225.149.232 |
110.249.201.130 |
110.249.202.102 |
110.249.202.80 |
111.225.148.44 |
111.225.149.233 |
110.249.201.131 |
110.249.202.103 |
110.249.202.81 |
111.225.148.45 |
111.225.149.234 |
110.249.201.132 |
110.249.202.104 |
110.249.202.82 |
111.225.148.46 |
111.225.149.235 |
110.249.201.133 |
110.249.202.105 |
110.249.202.83 |
111.225.148.47 |
111.225.149.236 |
110.249.201.134 |
110.249.202.106 |
110.249.202.84 |
111.225.148.48 |
111.225.149.237 |
110.249.201.135 |
110.249.202.107 |
110.249.202.85 |
111.225.148.49 |
111.225.149.238 |
110.249.201.136 |
110.249.202.108 |
110.249.202.86 |
111.225.148.5 |
111.225.149.239 |
110.249.201.137 |
110.249.202.109 |
110.249.202.87 |
111.225.148.50 |
111.225.149.24 |
110.249.201.138 |
110.249.202.11 |
110.249.202.88 |
111.225.148.51 |
111.225.149.240 |
110.249.201.139 |
110.249.202.110 |
110.249.202.89 |
111.225.148.52 |
111.225.149.241 |
110.249.201.14 |
110.249.202.111 |
110.249.202.9 |
111.225.148.53 |
111.225.149.242 |
110.249.201.140 |
110.249.202.112 |
110.249.202.90 |
111.225.148.54 |
111.225.149.243 |
110.249.201.141 |
110.249.202.113 |
110.249.202.91 |
111.225.148.55 |
111.225.149.244 |
110.249.201.142 |
110.249.202.114 |
110.249.202.92 |
111.225.148.56 |
111.225.149.245 |
110.249.201.143 |
110.249.202.115 |
110.249.202.93 |
111.225.148.57 |
111.225.149.246 |
110.249.201.144 |
110.249.202.116 |
110.249.202.94 |
111.225.148.58 |
111.225.149.247 |
110.249.201.145 |
110.249.202.117 |
110.249.202.95 |
111.225.148.59 |
111.225.149.248 |
110.249.201.146 |
110.249.202.118 |
110.249.202.96 |
111.225.148.6 |
111.225.149.249 |
110.249.201.147 |
110.249.202.119 |
110.249.202.97 |
111.225.148.60 |
111.225.149.25 |
110.249.201.148 |
110.249.202.12 |
110.249.202.98 |
111.225.148.61 |
111.225.149.26 |
110.249.201.149 |
110.249.202.120 |
110.249.202.99 |
111.225.148.62 |
111.225.149.27 |
110.249.201.15 |
110.249.202.121 |
111.225.148.10 |
111.225.148.63 |
111.225.149.28 |
110.249.201.150 |
110.249.202.13 |
111.225.148.100 |
111.225.148.64 |
111.225.149.3 |
110.249.201.151 |
110.249.202.130 |
111.225.148.101 |
111.225.148.65 |
111.225.149.30 |
110.249.201.152 |
110.249.202.131 |
111.225.148.102 |
111.225.148.66 |
111.225.149.31 |
110.249.201.153 |
110.249.202.132 |
111.225.148.103 |
111.225.148.67 |
111.225.149.32 |
110.249.201.154 |
110.249.202.133 |
111.225.148.104 |
111.225.148.68 |
111.225.149.33 |
110.249.201.155 |
110.249.202.134 |
111.225.148.105 |
111.225.148.69 |
111.225.149.34 |
110.249.201.156 |
110.249.202.135 |
111.225.148.106 |
111.225.148.7 |
111.225.149.35 |
110.249.201.157 |
110.249.202.136 |
111.225.148.107 |
111.225.148.70 |
111.225.149.36 |
110.249.201.158 |
110.249.202.137 |
111.225.148.108 |
111.225.148.71 |
111.225.149.37 |
110.249.201.159 |
110.249.202.138 |
111.225.148.109 |
111.225.148.72 |
111.225.149.38 |
110.249.201.16 |
110.249.202.139 |
111.225.148.11 |
111.225.148.73 |
111.225.149.39 |
110.249.201.160 |
110.249.202.14 |
111.225.148.110 |
111.225.148.74 |
111.225.149.4 |
110.249.201.161 |
110.249.202.140 |
111.225.148.111 |
111.225.148.75 |
111.225.149.40 |
110.249.201.162 |
110.249.202.141 |
111.225.148.112 |
111.225.148.76 |
111.225.149.41 |
110.249.201.163 |
110.249.202.142 |
111.225.148.113 |
111.225.148.77 |
111.225.149.42 |
110.249.201.164 |
110.249.202.143 |
111.225.148.114 |
111.225.148.78 |
111.225.149.43 |
110.249.201.165 |
110.249.202.144 |
111.225.148.115 |
111.225.148.79 |
111.225.149.44 |
110.249.201.166 |
110.249.202.145 |
111.225.148.116 |
111.225.148.8 |
111.225.149.45 |
110.249.201.167 |
110.249.202.146 |
111.225.148.117 |
111.225.148.80 |
111.225.149.46 |
110.249.201.168 |
110.249.202.147 |
111.225.148.118 |
111.225.148.81 |
111.225.149.47 |
110.249.201.169 |
110.249.202.148 |
111.225.148.119 |
111.225.148.82 |
111.225.149.48 |
110.249.201.17 |
110.249.202.149 |
111.225.148.12 |
111.225.148.83 |
111.225.149.49 |
110.249.201.170 |
110.249.202.15 |
111.225.148.120 |
111.225.148.84 |
111.225.149.5 |
110.249.201.171 |
110.249.202.150 |
111.225.148.121 |
111.225.148.85 |
111.225.149.50 |
110.249.201.172 |
110.249.202.151 |
111.225.148.13 |
111.225.148.86 |
111.225.149.51 |
110.249.201.173 |
110.249.202.152 |
111.225.148.130 |
111.225.148.87 |
111.225.149.52 |
110.249.201.174 |
110.249.202.153 |
111.225.148.131 |
111.225.148.88 |
111.225.149.53 |
110.249.201.175 |
110.249.202.154 |
111.225.148.132 |
111.225.148.89 |
111.225.149.54 |
110.249.201.176 |
110.249.202.155 |
111.225.148.133 |
111.225.148.9 |
111.225.149.55 |
110.249.201.177 |
110.249.202.156 |
111.225.148.134 |
111.225.148.90 |
111.225.149.56 |
110.249.201.178 |
110.249.202.157 |
111.225.148.135 |
111.225.148.91 |
111.225.149.57 |
110.249.201.179 |
110.249.202.158 |
111.225.148.136 |
111.225.148.92 |
111.225.149.58 |
110.249.201.18 |
110.249.202.159 |
111.225.148.137 |
111.225.148.93 |
111.225.149.59 |
110.249.201.180 |
110.249.202.16 |
111.225.148.138 |
111.225.148.94 |
111.225.149.6 |
110.249.201.181 |
110.249.202.160 |
111.225.148.139 |
111.225.148.95 |
111.225.149.60 |
110.249.201.182 |
110.249.202.161 |
111.225.148.14 |
111.225.148.96 |
111.225.149.61 |
110.249.201.183 |
110.249.202.162 |
111.225.148.140 |
111.225.148.97 |
111.225.149.62 |
110.249.201.184 |
110.249.202.163 |
111.225.148.141 |
111.225.148.98 |
111.225.149.63 |
110.249.201.185 |
110.249.202.164 |
111.225.148.142 |
111.225.148.99 |
111.225.149.64 |
110.249.201.186 |
110.249.202.165 |
111.225.148.143 |
111.225.149.10 |
111.225.149.65 |
110.249.201.187 |
110.249.202.166 |
111.225.148.144 |
111.225.149.100 |
111.225.149.66 |
110.249.201.188 |
110.249.202.167 |
111.225.148.145 |
111.225.149.101 |
111.225.149.67 |
110.249.201.189 |
110.249.202.168 |
111.225.148.146 |
111.225.149.102 |
111.225.149.68 |
110.249.201.19 |
110.249.202.169 |
111.225.148.147 |
111.225.149.103 |
111.225.149.69 |
110.249.201.190 |
110.249.202.17 |
111.225.148.148 |
111.225.149.104 |
111.225.149.7 |
110.249.201.191 |
110.249.202.170 |
111.225.148.149 |
111.225.149.105 |
111.225.149.70 |
110.249.201.192 |
110.249.202.171 |
111.225.148.15 |
111.225.149.106 |
111.225.149.71 |
110.249.201.193 |
110.249.202.172 |
111.225.148.150 |
111.225.149.107 |
111.225.149.72 |
110.249.201.194 |
110.249.202.173 |
111.225.148.151 |
111.225.149.108 |
111.225.149.73 |
110.249.201.195 |
110.249.202.174 |
111.225.148.152 |
111.225.149.109 |
111.225.149.74 |
110.249.201.196 |
110.249.202.175 |
111.225.148.153 |
111.225.149.11 |
111.225.149.75 |
110.249.201.197 |
110.249.202.176 |
111.225.148.154 |
111.225.149.110 |
111.225.149.76 |
110.249.201.198 |
110.249.202.177 |
111.225.148.155 |
111.225.149.111 |
111.225.149.77 |
110.249.201.199 |
110.249.202.178 |
111.225.148.156 |
111.225.149.112 |
111.225.149.78 |
110.249.201.2 |
110.249.202.179 |
111.225.148.157 |
111.225.149.113 |
111.225.149.79 |
110.249.201.20 |
110.249.202.18 |
111.225.148.158 |
111.225.149.114 |
111.225.149.8 |
110.249.201.200 |
110.249.202.180 |
111.225.148.159 |
111.225.149.115 |
111.225.149.80 |
110.249.201.201 |
110.249.202.181 |
111.225.148.16 |
111.225.149.116 |
111.225.149.81 |
110.249.201.202 |
110.249.202.182 |
111.225.148.160 |
111.225.149.117 |
111.225.149.82 |
110.249.201.203 |
110.249.202.183 |
111.225.148.161 |
111.225.149.118 |
111.225.149.83 |
110.249.201.204 |
110.249.202.184 |
111.225.148.162 |
111.225.149.119 |
111.225.149.84 |
110.249.201.205 |
110.249.202.185 |
111.225.148.163 |
111.225.149.12 |
111.225.149.85 |
110.249.201.206 |
110.249.202.186 |
111.225.148.164 |
111.225.149.120 |
111.225.149.86 |
110.249.201.207 |
110.249.202.187 |
111.225.148.165 |
111.225.149.121 |
111.225.149.87 |
110.249.201.208 |
110.249.202.188 |
111.225.148.166 |
111.225.149.13 |
111.225.149.88 |
110.249.201.209 |
110.249.202.189 |
111.225.148.167 |
111.225.149.130 |
111.225.149.89 |
110.249.201.21 |
110.249.202.19 |
111.225.148.168 |
111.225.149.131 |
111.225.149.9 |
110.249.201.210 |
110.249.202.190 |
111.225.148.169 |
111.225.149.132 |
111.225.149.90 |
110.249.201.212 |
110.249.202.191 |
111.225.148.17 |
111.225.149.133 |
111.225.149.91 |
110.249.201.214 |
110.249.202.192 |
111.225.148.170 |
111.225.149.134 |
111.225.149.92 |
110.249.201.216 |
110.249.202.193 |
111.225.148.171 |
111.225.149.135 |
111.225.149.93 |
110.249.201.218 |
110.249.202.194 |
111.225.148.172 |
111.225.149.136 |
111.225.149.94 |
110.249.201.219 |
110.249.202.195 |
111.225.148.173 |
111.225.149.137 |
111.225.149.95 |
110.249.201.221 |
110.249.202.196 |
111.225.148.174 |
111.225.149.138 |
111.225.149.96 |
110.249.201.222 |
110.249.202.197 |
111.225.148.175 |
111.225.149.139 |
111.225.149.97 |
110.249.201.225 |
110.249.202.198 |
111.225.148.176 |
111.225.149.14 |
111.225.149.98 |
110.249.201.227 |
110.249.202.199 |
111.225.148.177 |
111.225.149.140 |
111.225.149.99 |
110.249.201.228 |
110.249.202.2 |
111.225.148.178 |
111.225.149.141 |
|
110.249.201.230 |
110.249.202.20 |
111.225.148.179 |
111.225.149.142 |
|
110.249.201.231 |
110.249.202.200 |
111.225.148.18 |
111.225.149.143 |
|
110.249.201.232 |
110.249.202.201 |
111.225.148.180 |
111.225.149.144 |
|
110.249.201.233 |
110.249.202.202 |
111.225.148.181 |
111.225.149.145 |
|
110.249.201.234 |
110.249.202.203 |
111.225.148.182 |
111.225.149.146 |
|
110.249.201.235 |
110.249.202.204 |
111.225.148.183 |
111.225.149.147 |
|
110.249.201.236 |
110.249.202.205 |
111.225.148.184 |
111.225.149.148 |
|
110.249.201.237 |
110.249.202.206 |
111.225.148.185 |
111.225.149.149 |
|
110.249.201.238 |
110.249.202.207 |
111.225.148.186 |
111.225.149.15 |
|
110.249.201.239 |
110.249.202.208 |
111.225.148.187 |
111.225.149.150 |
|
110.249.201.24 |
110.249.202.209 |
111.225.148.188 |
111.225.149.151 |
|
110.249.201.240 |
110.249.202.21 |
111.225.148.189 |
111.225.149.152 |
|
110.249.201.241 |
110.249.202.211 |
111.225.148.19 |
111.225.149.153 |
|
110.249.201.242 |
110.249.202.212 |
111.225.148.190 |
111.225.149.154 |
|
110.249.201.243 |
110.249.202.213 |
111.225.148.191 |
111.225.149.155 |
|
110.249.201.244 |
110.249.202.215 |
111.225.148.192 |
111.225.149.156 |
|
110.249.201.245 |
110.249.202.216 |
111.225.148.193 |
111.225.149.157 |
|
110.249.201.246 |
110.249.202.217 |
111.225.148.194 |
111.225.149.158 |
|
110.249.201.247 |
110.249.202.219 |
111.225.148.195 |
111.225.149.159 |
|
110.249.201.248 |
110.249.202.221 |
111.225.148.196 |
111.225.149.16 |
|
110.249.201.249 |
110.249.202.222 |
111.225.148.197 |
111.225.149.160 |
|
110.249.201.28 |
110.249.202.225 |
111.225.148.198 |
111.225.149.161 |
|
110.249.201.29 |
110.249.202.227 |
111.225.148.199 |
111.225.149.162 |
|
110.249.201.3 |
110.249.202.228 |
111.225.148.2 |
111.225.149.163 |
|
110.249.201.30 |
110.249.202.229 |
111.225.148.20 |
111.225.149.164 |
|
110.249.201.31 |
110.249.202.230 |
111.225.148.200 |
111.225.149.165 |
|
110.249.201.32 |
110.249.202.231 |
111.225.148.201 |
111.225.149.166 |
|
110.249.201.33 |
110.249.202.232 |
111.225.148.202 |
111.225.149.167 |
|
110.249.201.34 |
110.249.202.233 |
111.225.148.203 |
111.225.149.168 |
|
110.249.201.36 |
110.249.202.234 |
111.225.148.204 |
111.225.149.169 |
|
110.249.201.37 |
110.249.202.235 |
111.225.148.205 |
111.225.149.170 |
|
110.249.201.38 |
110.249.202.236 |
111.225.148.206 |
111.225.149.171 |
|
110.249.201.4 |
110.249.202.237 |
111.225.148.207 |
111.225.149.172 |
|
110.249.201.40 |
110.249.202.238 |
111.225.148.208 |
111.225.149.173 |
|
110.249.201.42 |
110.249.202.239 |
111.225.148.209 |
111.225.149.174 |
|
110.249.201.43 |
110.249.202.24 |
111.225.148.21 |
111.225.149.175 |
|
110.249.201.44 |
110.249.202.240 |
111.225.148.210 |
111.225.149.176 |
|
110.249.201.45 |
110.249.202.241 |
111.225.148.211 |
111.225.149.177 |
|
110.249.201.46 |
110.249.202.242 |
111.225.148.212 |
111.225.149.178 |
|
110.249.201.47 |
110.249.202.243 |
111.225.148.213 |
111.225.149.179 |
|
110.249.201.48 |
110.249.202.244 |
111.225.148.214 |
111.225.149.18 |
|
110.249.201.49 |
110.249.202.245 |
111.225.148.215 |
111.225.149.180 |
|
110.249.201.5 |
110.249.202.246 |
111.225.148.216 |
111.225.149.181 |
|
110.249.201.50 |
110.249.202.247 |
111.225.148.217 |
111.225.149.182 |
|
110.249.201.51 |
110.249.202.248 |
111.225.148.218 |
111.225.149.183 |
|
110.249.201.52 |
110.249.202.249 |
111.225.148.219 |
111.225.149.184 |
|
110.249.201.53 |
110.249.202.26 |
111.225.148.22 |
111.225.149.185 |
|
110.249.201.54 |
110.249.202.3 |
111.225.148.220 |
111.225.149.186 |
|
110.249.201.55 |
110.249.202.31 |
111.225.148.221 |
111.225.149.187 |
|
110.249.201.56 |
110.249.202.32 |
111.225.148.222 |
111.225.149.188 |
|
110.249.201.57 |
110.249.202.33 |
111.225.148.223 |
111.225.149.189 |
|
110.249.201.58 |
110.249.202.34 |
111.225.148.224 |
111.225.149.19 |
|
110.249.201.59 |
110.249.202.35 |
111.225.148.225 |
111.225.149.190 |
|
110.249.201.6 |
110.249.202.36 |
111.225.148.226 |
111.225.149.191 |
|
110.249.201.60 |
110.249.202.37 |
111.225.148.227 |
111.225.149.192 |
|
110.249.201.61 |
110.249.202.38 |
111.225.148.228 |
111.225.149.193 |
|
110.249.201.62 |
110.249.202.39 |
111.225.148.229 |
111.225.149.194 |
|
110.249.201.63 |
110.249.202.4 |
111.225.148.23 |
111.225.149.195 |
|
110.249.201.64 |
110.249.202.42 |
111.225.148.230 |
111.225.149.196 |
|
110.249.201.65 |
110.249.202.43 |
111.225.148.231 |
111.225.149.197 |
|
110.249.201.66 |
110.249.202.44 |
111.225.148.232 |
111.225.149.198 |
|
110.249.201.67 |
110.249.202.45 |
111.225.148.233 |
111.225.149.199 |
|
110.249.201.68 |
110.249.202.46 |
111.225.148.234 |
111.225.149.2 |
|
110.249.201.69 |
110.249.202.47 |
111.225.148.235 |
111.225.149.20 |
|
110.249.201.7 |
110.249.202.48 |
111.225.148.236 |
111.225.149.200 |
|
110.249.201.70 |
110.249.202.49 |
111.225.148.237 |
111.225.149.201 |
|
110.249.201.71 |
110.249.202.5 |
111.225.148.238 |
111.225.149.202 |
|
110.249.201.72 |
110.249.202.50 |
111.225.148.239 |
111.225.149.203 |
|
110.249.201.73 |
110.249.202.51 |
111.225.148.24 |
111.225.149.204 |
|
110.249.201.74 |
110.249.202.52 |
111.225.148.240 |
111.225.149.205 |
|
110.249.201.75 |
110.249.202.53 |
111.225.148.241 |
111.225.149.206 |
|
110.249.201.76 |
110.249.202.54 |
111.225.148.242 |
111.225.149.207 |
|
110.249.201.77 |
110.249.202.55 |
111.225.148.243 |
111.225.149.208 |
|
110.249.201.78 |
110.249.202.56 |
111.225.148.244 |
111.225.149.209 |
四、今日头条爬虫(zhanzhang.toutiao.com)的一些特点:
对网站没什么危害,但抓取网站频繁,对资源消耗较大,可为网站带来些许客户
五、EXECL格式数据下载