今日头条爬虫(zhanzhang.toutiao.com)IP及UA,真实采集数据

发布于:2024-08-02 ⋅ 阅读:(35) ⋅ 点赞:(0)

  一、数据来源:

1、这批今日头条爬虫(zhanzhang.toutiao.com)IP来源于尚贤达猎头网站采集数据;

2、数据采集时间段:2023年10月-2024年7月;

3、判断标准:主要根据用户代理是否包含“zhanzhang.toutiao.com”和IP核实。

二、今日头条爬虫(zhanzhang.toutiao.com)主要有4个用户代理

序号

UA

1

Mozilla/5.0+(Linux;+Android+5.0)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)

2

Mozilla/5.0+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Chrome/70.0.0.0+Safari/537.36

3

Mozilla/5.0+AppleWebKit/537.36+(KHTML,+like+Gecko)+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)

4

Mozilla/5.0+(iPhone;+CPU+iPhone+OS+7_1_2+like+Mac+OS+X)+AppleWebKit/537.36+(KHTML,+like+Gecko)+Version/7.0+Mobile+Safari/537.36+(compatible;+Bytespider;+https://zhanzhang.toutiao.com/)

三、今日头条爬虫(zhanzhang.toutiao.com)IP地址:

1、主要有以下四个网段:

(1)、110.249.201.0/24

(2)、110.249.202.0/24

(3)、111.225.148.0/24

(4)、111.225.149.0/24

110.249.201.10

110.249.201.79

110.249.202.57

111.225.148.245

111.225.149.21

110.249.201.100

110.249.201.8

110.249.202.58

111.225.148.246

111.225.149.210

110.249.201.101

110.249.201.80

110.249.202.59

111.225.148.247

111.225.149.211

110.249.201.102

110.249.201.81

110.249.202.6

111.225.148.248

111.225.149.212

110.249.201.103

110.249.201.82

110.249.202.60

111.225.148.249

111.225.149.213

110.249.201.104

110.249.201.83

110.249.202.61

111.225.148.25

111.225.149.214

110.249.201.105

110.249.201.84

110.249.202.62

111.225.148.26

111.225.149.215

110.249.201.106

110.249.201.85

110.249.202.63

111.225.148.27

111.225.149.216

110.249.201.107

110.249.201.86

110.249.202.64

111.225.148.28

111.225.149.217

110.249.201.108

110.249.201.87

110.249.202.65

111.225.148.29

111.225.149.218

110.249.201.109

110.249.201.88

110.249.202.66

111.225.148.3

111.225.149.219

110.249.201.11

110.249.201.89

110.249.202.67

111.225.148.30

111.225.149.22

110.249.201.110

110.249.201.9

110.249.202.68

111.225.148.31

111.225.149.220

110.249.201.111

110.249.201.90

110.249.202.69

111.225.148.32

111.225.149.221

110.249.201.112

110.249.201.91

110.249.202.7

111.225.148.33

111.225.149.222

110.249.201.113

110.249.201.92

110.249.202.70

111.225.148.34

111.225.149.223

110.249.201.114

110.249.201.93

110.249.202.71

111.225.148.35

111.225.149.224

110.249.201.115

110.249.201.94

110.249.202.72

111.225.148.36

111.225.149.225

110.249.201.116

110.249.201.95

110.249.202.73

111.225.148.37

111.225.149.226

110.249.201.117

110.249.201.96

110.249.202.74

111.225.148.38

111.225.149.227

110.249.201.118

110.249.201.97

110.249.202.75

111.225.148.39

111.225.149.228

110.249.201.119

110.249.201.98

110.249.202.76

111.225.148.4

111.225.149.229

110.249.201.12

110.249.201.99

110.249.202.77

111.225.148.40

111.225.149.23

110.249.201.120

110.249.202.10

110.249.202.78

111.225.148.41

111.225.149.230

110.249.201.121

110.249.202.100

110.249.202.79

111.225.148.42

111.225.149.231

110.249.201.13

110.249.202.101

110.249.202.8

111.225.148.43

111.225.149.232

110.249.201.130

110.249.202.102

110.249.202.80

111.225.148.44

111.225.149.233

110.249.201.131

110.249.202.103

110.249.202.81

111.225.148.45

111.225.149.234

110.249.201.132

110.249.202.104

110.249.202.82

111.225.148.46

111.225.149.235

110.249.201.133

110.249.202.105

110.249.202.83

111.225.148.47

111.225.149.236

110.249.201.134

110.249.202.106

110.249.202.84

111.225.148.48

111.225.149.237

110.249.201.135

110.249.202.107

110.249.202.85

111.225.148.49

111.225.149.238

110.249.201.136

110.249.202.108

110.249.202.86

111.225.148.5

111.225.149.239

110.249.201.137

110.249.202.109

110.249.202.87

111.225.148.50

111.225.149.24

110.249.201.138

110.249.202.11

110.249.202.88

111.225.148.51

111.225.149.240

110.249.201.139

110.249.202.110

110.249.202.89

111.225.148.52

111.225.149.241

110.249.201.14

110.249.202.111

110.249.202.9

111.225.148.53

111.225.149.242

110.249.201.140

110.249.202.112

110.249.202.90

111.225.148.54

111.225.149.243

110.249.201.141

110.249.202.113

110.249.202.91

111.225.148.55

111.225.149.244

110.249.201.142

110.249.202.114

110.249.202.92

111.225.148.56

111.225.149.245

110.249.201.143

110.249.202.115

110.249.202.93

111.225.148.57

111.225.149.246

110.249.201.144

110.249.202.116

110.249.202.94

111.225.148.58

111.225.149.247

110.249.201.145

110.249.202.117

110.249.202.95

111.225.148.59

111.225.149.248

110.249.201.146

110.249.202.118

110.249.202.96

111.225.148.6

111.225.149.249

110.249.201.147

110.249.202.119

110.249.202.97

111.225.148.60

111.225.149.25

110.249.201.148

110.249.202.12

110.249.202.98

111.225.148.61

111.225.149.26

110.249.201.149

110.249.202.120

110.249.202.99

111.225.148.62

111.225.149.27

110.249.201.15

110.249.202.121

111.225.148.10

111.225.148.63

111.225.149.28

110.249.201.150

110.249.202.13

111.225.148.100

111.225.148.64

111.225.149.3

110.249.201.151

110.249.202.130

111.225.148.101

111.225.148.65

111.225.149.30

110.249.201.152

110.249.202.131

111.225.148.102

111.225.148.66

111.225.149.31

110.249.201.153

110.249.202.132

111.225.148.103

111.225.148.67

111.225.149.32

110.249.201.154

110.249.202.133

111.225.148.104

111.225.148.68

111.225.149.33

110.249.201.155

110.249.202.134

111.225.148.105

111.225.148.69

111.225.149.34

110.249.201.156

110.249.202.135

111.225.148.106

111.225.148.7

111.225.149.35

110.249.201.157

110.249.202.136

111.225.148.107

111.225.148.70

111.225.149.36

110.249.201.158

110.249.202.137

111.225.148.108

111.225.148.71

111.225.149.37

110.249.201.159

110.249.202.138

111.225.148.109

111.225.148.72

111.225.149.38

110.249.201.16

110.249.202.139

111.225.148.11

111.225.148.73

111.225.149.39

110.249.201.160

110.249.202.14

111.225.148.110

111.225.148.74

111.225.149.4

110.249.201.161

110.249.202.140

111.225.148.111

111.225.148.75

111.225.149.40

110.249.201.162

110.249.202.141

111.225.148.112

111.225.148.76

111.225.149.41

110.249.201.163

110.249.202.142

111.225.148.113

111.225.148.77

111.225.149.42

110.249.201.164

110.249.202.143

111.225.148.114

111.225.148.78

111.225.149.43

110.249.201.165

110.249.202.144

111.225.148.115

111.225.148.79

111.225.149.44

110.249.201.166

110.249.202.145

111.225.148.116

111.225.148.8

111.225.149.45

110.249.201.167

110.249.202.146

111.225.148.117

111.225.148.80

111.225.149.46

110.249.201.168

110.249.202.147

111.225.148.118

111.225.148.81

111.225.149.47

110.249.201.169

110.249.202.148

111.225.148.119

111.225.148.82

111.225.149.48

110.249.201.17

110.249.202.149

111.225.148.12

111.225.148.83

111.225.149.49

110.249.201.170

110.249.202.15

111.225.148.120

111.225.148.84

111.225.149.5

110.249.201.171

110.249.202.150

111.225.148.121

111.225.148.85

111.225.149.50

110.249.201.172

110.249.202.151

111.225.148.13

111.225.148.86

111.225.149.51

110.249.201.173

110.249.202.152

111.225.148.130

111.225.148.87

111.225.149.52

110.249.201.174

110.249.202.153

111.225.148.131

111.225.148.88

111.225.149.53

110.249.201.175

110.249.202.154

111.225.148.132

111.225.148.89

111.225.149.54

110.249.201.176

110.249.202.155

111.225.148.133

111.225.148.9

111.225.149.55

110.249.201.177

110.249.202.156

111.225.148.134

111.225.148.90

111.225.149.56

110.249.201.178

110.249.202.157

111.225.148.135

111.225.148.91

111.225.149.57

110.249.201.179

110.249.202.158

111.225.148.136

111.225.148.92

111.225.149.58

110.249.201.18

110.249.202.159

111.225.148.137

111.225.148.93

111.225.149.59

110.249.201.180

110.249.202.16

111.225.148.138

111.225.148.94

111.225.149.6

110.249.201.181

110.249.202.160

111.225.148.139

111.225.148.95

111.225.149.60

110.249.201.182

110.249.202.161

111.225.148.14

111.225.148.96

111.225.149.61

110.249.201.183

110.249.202.162

111.225.148.140

111.225.148.97

111.225.149.62

110.249.201.184

110.249.202.163

111.225.148.141

111.225.148.98

111.225.149.63

110.249.201.185

110.249.202.164

111.225.148.142

111.225.148.99

111.225.149.64

110.249.201.186

110.249.202.165

111.225.148.143

111.225.149.10

111.225.149.65

110.249.201.187

110.249.202.166

111.225.148.144

111.225.149.100

111.225.149.66

110.249.201.188

110.249.202.167

111.225.148.145

111.225.149.101

111.225.149.67

110.249.201.189

110.249.202.168

111.225.148.146

111.225.149.102

111.225.149.68

110.249.201.19

110.249.202.169

111.225.148.147

111.225.149.103

111.225.149.69

110.249.201.190

110.249.202.17

111.225.148.148

111.225.149.104

111.225.149.7

110.249.201.191

110.249.202.170

111.225.148.149

111.225.149.105

111.225.149.70

110.249.201.192

110.249.202.171

111.225.148.15

111.225.149.106

111.225.149.71

110.249.201.193

110.249.202.172

111.225.148.150

111.225.149.107

111.225.149.72

110.249.201.194

110.249.202.173

111.225.148.151

111.225.149.108

111.225.149.73

110.249.201.195

110.249.202.174

111.225.148.152

111.225.149.109

111.225.149.74

110.249.201.196

110.249.202.175

111.225.148.153

111.225.149.11

111.225.149.75

110.249.201.197

110.249.202.176

111.225.148.154

111.225.149.110

111.225.149.76

110.249.201.198

110.249.202.177

111.225.148.155

111.225.149.111

111.225.149.77

110.249.201.199

110.249.202.178

111.225.148.156

111.225.149.112

111.225.149.78

110.249.201.2

110.249.202.179

111.225.148.157

111.225.149.113

111.225.149.79

110.249.201.20

110.249.202.18

111.225.148.158

111.225.149.114

111.225.149.8

110.249.201.200

110.249.202.180

111.225.148.159

111.225.149.115

111.225.149.80

110.249.201.201

110.249.202.181

111.225.148.16

111.225.149.116

111.225.149.81

110.249.201.202

110.249.202.182

111.225.148.160

111.225.149.117

111.225.149.82

110.249.201.203

110.249.202.183

111.225.148.161

111.225.149.118

111.225.149.83

110.249.201.204

110.249.202.184

111.225.148.162

111.225.149.119

111.225.149.84

110.249.201.205

110.249.202.185

111.225.148.163

111.225.149.12

111.225.149.85

110.249.201.206

110.249.202.186

111.225.148.164

111.225.149.120

111.225.149.86

110.249.201.207

110.249.202.187

111.225.148.165

111.225.149.121

111.225.149.87

110.249.201.208

110.249.202.188

111.225.148.166

111.225.149.13

111.225.149.88

110.249.201.209

110.249.202.189

111.225.148.167

111.225.149.130

111.225.149.89

110.249.201.21

110.249.202.19

111.225.148.168

111.225.149.131

111.225.149.9

110.249.201.210

110.249.202.190

111.225.148.169

111.225.149.132

111.225.149.90

110.249.201.212

110.249.202.191

111.225.148.17

111.225.149.133

111.225.149.91

110.249.201.214

110.249.202.192

111.225.148.170

111.225.149.134

111.225.149.92

110.249.201.216

110.249.202.193

111.225.148.171

111.225.149.135

111.225.149.93

110.249.201.218

110.249.202.194

111.225.148.172

111.225.149.136

111.225.149.94

110.249.201.219

110.249.202.195

111.225.148.173

111.225.149.137

111.225.149.95

110.249.201.221

110.249.202.196

111.225.148.174

111.225.149.138

111.225.149.96

110.249.201.222

110.249.202.197

111.225.148.175

111.225.149.139

111.225.149.97

110.249.201.225

110.249.202.198

111.225.148.176

111.225.149.14

111.225.149.98

110.249.201.227

110.249.202.199

111.225.148.177

111.225.149.140

111.225.149.99

110.249.201.228

110.249.202.2

111.225.148.178

111.225.149.141

110.249.201.230

110.249.202.20

111.225.148.179

111.225.149.142

110.249.201.231

110.249.202.200

111.225.148.18

111.225.149.143

110.249.201.232

110.249.202.201

111.225.148.180

111.225.149.144

110.249.201.233

110.249.202.202

111.225.148.181

111.225.149.145

110.249.201.234

110.249.202.203

111.225.148.182

111.225.149.146

110.249.201.235

110.249.202.204

111.225.148.183

111.225.149.147

110.249.201.236

110.249.202.205

111.225.148.184

111.225.149.148

110.249.201.237

110.249.202.206

111.225.148.185

111.225.149.149

110.249.201.238

110.249.202.207

111.225.148.186

111.225.149.15

110.249.201.239

110.249.202.208

111.225.148.187

111.225.149.150

110.249.201.24

110.249.202.209

111.225.148.188

111.225.149.151

110.249.201.240

110.249.202.21

111.225.148.189

111.225.149.152

110.249.201.241

110.249.202.211

111.225.148.19

111.225.149.153

110.249.201.242

110.249.202.212

111.225.148.190

111.225.149.154

110.249.201.243

110.249.202.213

111.225.148.191

111.225.149.155

110.249.201.244

110.249.202.215

111.225.148.192

111.225.149.156

110.249.201.245

110.249.202.216

111.225.148.193

111.225.149.157

110.249.201.246

110.249.202.217

111.225.148.194

111.225.149.158

110.249.201.247

110.249.202.219

111.225.148.195

111.225.149.159

110.249.201.248

110.249.202.221

111.225.148.196

111.225.149.16

110.249.201.249

110.249.202.222

111.225.148.197

111.225.149.160

110.249.201.28

110.249.202.225

111.225.148.198

111.225.149.161

110.249.201.29

110.249.202.227

111.225.148.199

111.225.149.162

110.249.201.3

110.249.202.228

111.225.148.2

111.225.149.163

110.249.201.30

110.249.202.229

111.225.148.20

111.225.149.164

110.249.201.31

110.249.202.230

111.225.148.200

111.225.149.165

110.249.201.32

110.249.202.231

111.225.148.201

111.225.149.166

110.249.201.33

110.249.202.232

111.225.148.202

111.225.149.167

110.249.201.34

110.249.202.233

111.225.148.203

111.225.149.168

110.249.201.36

110.249.202.234

111.225.148.204

111.225.149.169

110.249.201.37

110.249.202.235

111.225.148.205

111.225.149.170

110.249.201.38

110.249.202.236

111.225.148.206

111.225.149.171

110.249.201.4

110.249.202.237

111.225.148.207

111.225.149.172

110.249.201.40

110.249.202.238

111.225.148.208

111.225.149.173

110.249.201.42

110.249.202.239

111.225.148.209

111.225.149.174

110.249.201.43

110.249.202.24

111.225.148.21

111.225.149.175

110.249.201.44

110.249.202.240

111.225.148.210

111.225.149.176

110.249.201.45

110.249.202.241

111.225.148.211

111.225.149.177

110.249.201.46

110.249.202.242

111.225.148.212

111.225.149.178

110.249.201.47

110.249.202.243

111.225.148.213

111.225.149.179

110.249.201.48

110.249.202.244

111.225.148.214

111.225.149.18

110.249.201.49

110.249.202.245

111.225.148.215

111.225.149.180

110.249.201.5

110.249.202.246

111.225.148.216

111.225.149.181

110.249.201.50

110.249.202.247

111.225.148.217

111.225.149.182

110.249.201.51

110.249.202.248

111.225.148.218

111.225.149.183

110.249.201.52

110.249.202.249

111.225.148.219

111.225.149.184

110.249.201.53

110.249.202.26

111.225.148.22

111.225.149.185

110.249.201.54

110.249.202.3

111.225.148.220

111.225.149.186

110.249.201.55

110.249.202.31

111.225.148.221

111.225.149.187

110.249.201.56

110.249.202.32

111.225.148.222

111.225.149.188

110.249.201.57

110.249.202.33

111.225.148.223

111.225.149.189

110.249.201.58

110.249.202.34

111.225.148.224

111.225.149.19

110.249.201.59

110.249.202.35

111.225.148.225

111.225.149.190

110.249.201.6

110.249.202.36

111.225.148.226

111.225.149.191

110.249.201.60

110.249.202.37

111.225.148.227

111.225.149.192

110.249.201.61

110.249.202.38

111.225.148.228

111.225.149.193

110.249.201.62

110.249.202.39

111.225.148.229

111.225.149.194

110.249.201.63

110.249.202.4

111.225.148.23

111.225.149.195

110.249.201.64

110.249.202.42

111.225.148.230

111.225.149.196

110.249.201.65

110.249.202.43

111.225.148.231

111.225.149.197

110.249.201.66

110.249.202.44

111.225.148.232

111.225.149.198

110.249.201.67

110.249.202.45

111.225.148.233

111.225.149.199

110.249.201.68

110.249.202.46

111.225.148.234

111.225.149.2

110.249.201.69

110.249.202.47

111.225.148.235

111.225.149.20

110.249.201.7

110.249.202.48

111.225.148.236

111.225.149.200

110.249.201.70

110.249.202.49

111.225.148.237

111.225.149.201

110.249.201.71

110.249.202.5

111.225.148.238

111.225.149.202

110.249.201.72

110.249.202.50

111.225.148.239

111.225.149.203

110.249.201.73

110.249.202.51

111.225.148.24

111.225.149.204

110.249.201.74

110.249.202.52

111.225.148.240

111.225.149.205

110.249.201.75

110.249.202.53

111.225.148.241

111.225.149.206

110.249.201.76

110.249.202.54

111.225.148.242

111.225.149.207

110.249.201.77

110.249.202.55

111.225.148.243

111.225.149.208

110.249.201.78

110.249.202.56

111.225.148.244

111.225.149.209

四、今日头条爬虫(zhanzhang.toutiao.com)的一些特点:

对网站没什么危害,但抓取网站频繁,对资源消耗较大,可为网站带来些许客户

五、EXECL格式数据下载

​下载