Skocz do zawartości


Zdjęcie

Blokada robotów w htaccess i robots.txt


  • Zaloguj się, aby dodać odpowiedź
20 odpowiedzi w tym temacie

#1 yesitsme

yesitsme

    BlackSeo

  • Użytkownik
  • PipPipPip
  • 167 postów

Napisano 23 maj 2013 - 16:21

Witajcie, może ktoś chciałby się podzielić albo pomóc stworzyć htaccess lub/oraz robots.txt
Czego potrzebujesz? Chce zablokować wszystkie roboty OPRÓCZ:
-google
-majestic
-ahrefs
-opensiteexplorer

oraz wszystkie roboty pobierające obrazki, nawet ten googlowy.

#2 Mefisak

Mefisak

    BlackHat

  • BlackHat
  • PipPipPip
  • 222 postów

Napisano 23 maj 2013 - 17:29

robots.txt - przepuszcza tylko wybrane

User-Agent: googlebot
Allow: /

User-Agent: MJ12bot
Allow: /

User-Agent: AhrefsBot
Allow: /

User-Agent: rogerbot
Allow: /

User-Agent: *
Disallow: /


#3 zeki

zeki

    BlackHat

  • BlackHat
  • PipPipPip
  • 848 postów
  • LocationMazowsze

Napisano 24 maj 2013 - 00:28

khem a ahrefsa i majestica nie blokujesz? Po co ktoś ma szpiegować?

#4 zoozool

zoozool

    Administrator

  • Administrator
  • 1368 postów

Napisano 24 maj 2013 - 07:44

nawet jeśli zablokuje, to nadal w ahref i majesticseo będą widoczne linki z domen, które nie blokują tych wyszukiwarek ;)

#5 BlackSEO

BlackSEO

    Advanced Member

  • Elita
  • PipPipPip
  • 6031 postów

Napisano 24 maj 2013 - 07:53

RewriteCond %{HTTP_USER_AGENT} .*Twice.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*roge.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Yand.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Baidu.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*site.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Ahre.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*seo.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Yahoo.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Voil.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*libw.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Java.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Sogou.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*psbot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Exabot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*boitho.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*ajSitemap.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Rankivabot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*DBLBot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*MJ1.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*ask.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*DotBot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*MJ12bot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*AhrefsBot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*sitebot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*LexxeBot.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Yandex.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*Ezooms.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*ichiro.* [OR]

RewriteCond %{HTTP_USER_AGENT} .*AppEngine-Google.* [OR]

Allow from all

Deny from 110.0.0.0/8

Deny from 111.0.0.0/8

Deny from 112.0.0.0/5

Deny from 120.0.0.0/6

Deny from 124.0.0.0/8

Deny from 125.0.0.0/8

Deny from 147.0.0.0/8

Deny from 169.208.0.0/8

Deny from 175.0.0.0/8

Deny from 180.0.0.0/8

Deny from 182.0.0.0/8

Deny from 183.0.0.0/8

Deny from 202.0.0.0/8

Deny from 203.0.0.0/8

Deny from 210.0.0.0/8

Deny from 211.0.0.0/8

Deny from 218.0.0.0/8

Deny from 219.0.0.0/8

Deny from 220.0.0.0/8

Deny from 221.0.0.0/8

Deny from 222.0.0.0/8

Deny from 65.19.

Deny from 64.71.131

Deny from 85.186.163.12

Deny from 83.17.138.202

Deny from 208.66.195

Deny from 66.55.138.98

Deny from 72.3.

Deny from 69.244.

Deny from 69.255.

Deny from 200.3.114

Deny from 58.187.68.186

Deny from 58.187.124.27

Deny from 222.255.63.99

Deny from 222.255.192.118

Deny from 69.25.71.12

Deny from 209.8.20.194

Deny from 85.255.117.221

Deny from 85.255.118.108

Deny from 128.241.20.199

Deny from 128.241.20.196

Deny from 64.92.167.82

Deny from 203.223.150.64

Deny from 203.121.79.95

Deny from 211.24.141.98

Deny from 24.95.243.224

Deny from 72.36.205.10

Deny from 219.93.182.99

Deny from 64.92.167.82

Deny from 81.177.22.111

Deny from 125.136.136.78

Deny from 168.188.14.215

Deny from 221.19.244.74

Deny from 68.229.85.135

Deny from 59.186.67.28

Deny from 66.122.198.87

Deny from 24.168.99.115

Deny from 75.68.184.244

Deny from 67.82.212.245

Deny from 210.123.124.168

Deny from 71.201.216.239

Deny from 24.149.233.170

Deny from 81.177.34.184

Deny from 69.123.158.121

Deny from 208.67.83.25

Deny from 77.91.0.109

Deny from 87.116.95.219

Deny from 68.106.94.63

Deny from 85.255.117.98

Deny from 218.38.13.111

Deny from 85.180.186.90

Deny from 58.120.132.232

Deny from 67.84.47.97

Deny from 211.41.249.126

Deny from 220.29.4.184

Deny from 67.81.235.37

Deny from 24.30.24.205

Deny from 68.198.15.106

Deny from 24.185.253.215

Deny from 4.156.129.9

Deny from 203.235.13.73

Deny from 125.189.53.221

Deny from 82.245.226.52

Deny from 195.224.154.232

Deny from 82.247.25.226

Deny from 66.232.123.132

Deny from 61.10.22.11

Deny from 71.203.137.166

Deny from 200.50.66.98

Deny from 59.171.236.55

Deny from 209.9.169.98

Deny from 89.163.145.240

Deny from 72.36.95.228

Deny from 203.162.27.93

Deny from 72.47.23.84

Deny from 207.61.242.110

Deny from 221.162.91.254

Deny from 12.190.1.141

Deny from 74.130.235.74

Deny from 70.42.51.30

Deny from 75.126.151.122

Deny from 66.232.103.246

Deny from 24.131.104.124

Deny from 58.239.32.181

Deny from 125.128.146.104

Deny from 59.25.9.95

Deny from 24.182.56.15

Deny from 221.151.103.84

Deny from 121.130.123.37

Deny from 220.116.142.200

Deny from 219.240.36.175

Deny from 61.253.10.18

Deny from 72.232.7.242

Deny from 38.99.44.107

Deny from 72.29.90.23

Deny from 220.117.157.16

Deny from 221.151.103.84

Deny from 218.235.251.164

Deny from 70.87.15.10

Deny from 218.188.67.222

Deny from 66.122.198.87

Deny from 218.42.64.60

Deny from 195.76.242.227

Deny from 213.170.35.27

Deny from 59.165.204.67

Deny from 207.67.117.173

Deny from 190.7.62.202

Deny from 204.169.23.246

Deny from 209.58.83.178

Deny from 89.202.127.9

Deny from 85.100.234.139

Deny from 125.244.148.2

Deny from 216.56.12.20

Deny from 200.81.1.45

Deny from 201.48.159.138

Deny from 161.53.7.184

Deny from 201.63.98.83

Deny from 85.17.187.9

Deny from 209.131.124.42

Deny from 60.244.123.129

Deny from 195.254.148.73

Deny from 213.254.232.74

Deny from 200.84.84.172

Deny from 195.229.242.57

Deny from 203.147.0.30

Deny from 203.144.144.164

Deny from 85.21.125.100

Deny from 210.0.140.99

Deny from 209.50.135.53

Deny from 201.18.38.242

Deny from 74.136.32.114

Deny from 200.138.45.244

Deny from 122.210.177.181

Deny from 75.125.34.66

Deny from 216.217.98.100

Deny from 193.90.144.102

Deny from 195.225.178.28

Deny from 65.98.103.12

Deny from 71.145.140.32

Deny from 208.36.144.8

Deny from 85.92.130.117

Deny from 203.160.1.162

Deny from 82.112.124.79

Deny from 210.18.104.227

Deny from 24.56.211.200

Deny from 212.51.122.19

Deny from 85.108.208.78

Deny from 84.145.222.53

Deny from 212.51.122.19

Deny from 85.17.226.81

Deny from 195.229.242.154

Deny from 75.157.132.75

Deny from 71.188.183.210

Deny from 85.255.112.

Deny from 85.255.113.

Deny from 85.255.114.

Deny from 85.255.115.

Deny from 85.255.116.

Deny from 85.255.117.

Deny from 85.255.118.

Deny from 85.255.119.

Deny from 85.255.120.

Deny from 85.255.121.

Deny from 85.255.122.

Deny from 85.255.123.

Deny from 85.255.124.

Deny from 85.255.125.

Deny from 85.255.126.

Deny from 85.255.127.

Deny from 85.98.93.111

Deny from 193.34.92.187

Deny from 85.19.150.85

Deny from 67.98.248.51

Deny from 82.126.187.114

Deny from 66.212.18.198

Deny from 200.21.223.90

Deny from 77.45.199.239

Deny from 89.171.219.150

Deny from 201.9.246.229

Deny from 89.221.56.139

Deny from 210.245.164.10

Deny from 217.195.192.40

Deny from 211.172.232.90

Deny from 64.207.204.19

Deny from 213.160.188.77

Deny from 213.71.9.25

Deny from 82.141.173.75

Deny from 220.130.53.126

Deny from 83.12.231.38

Deny from 217.13.86.10

Deny from 81.1.220.207

Deny from 91.148.18.139

Deny from 66.27.189.29

Deny from 212.244.115.33

Deny from 78.94.100.82

Deny from 219.19.84.83

Deny from 96.10.22.152

Deny from 74.161.75.102

Deny from 220.77.47.44

Deny from 89.0.30.180

Deny from 211.225.18.156

Deny from 80.145.233.160

Deny from 218.152.52.242

Deny from 216.183.146.68

Deny from 220.78.90.47

Deny from 69.159.114.242

Deny from 219.251.173.136

Deny from 72.139.52.205

Deny from 67.68.118.211

Deny from 92.81.112.99

Deny from 24.172.69.134

Deny from 89.0.191.230

Deny from 211.214.217.87

Deny from 88.232.169.81

Deny from 220.84.216.107

Deny from 206.74.118.83

Deny from 67.149.177.24

Deny from 77.247.164.174

Deny from 83.1.81.194

Deny from 88.224.83.243

Deny from 92.81.203.67

Deny from 80.176.131.32

Deny from 85.98.163.45

Deny from 69.203.143.49

Deny from 200.8.204.115

Deny from 80.187.104.2

Deny from 78.88.205.87

Deny from 88.66.194.106

Deny from 201.235.150.234

Deny from 189.55.29.143

Deny from 212.142.143.116

Deny from 212.248.240.1

Deny from 76.246.45.204

Deny from 69.217.73.52

Deny from 216.58.96.135

Deny from 80.252.254.241

Deny from 83.29.214.221

Deny from 62.133.141.15

Deny from 217.136.207.168

Deny from 77.252.68.253

Deny from 78.108.224.27

Deny from 81.88.114.208

Deny from 62.5.176.249

Deny from 85.106.174.44

Deny from 124.244.215.225

Deny from 201.40.175.237

Deny from 200.49.171.126

Deny from 80.227.1.101

Deny from 222.82.226.145

Deny from 71.167.175.55

Deny from 79.86.246.228

Deny from 200.51.41.29

Deny from 198.70.212.57

Deny from 189.56.193.250

Deny from 200.13.243.76

Deny from 200.129.43.168

Deny from 83.238.23.214

Deny from 203.26.122.8

Deny from 213.244.9.50

Deny from 89.149.227.100

Deny from 212.26.255.102

Deny from 216.155.68.242

Deny from 38.101.222.130

Deny from 60.234.20.98

Deny from 125.244.112.66

Deny from 89.149.205.199

Deny from 63.209.206.122

Deny from 124.217.230.104

Deny from 203.131.209.142

Deny from 218.152.150.147

Deny from 24.138.133.97

Deny from 116.46.106.16

Deny from 123.236.97.173

Deny from 221.164.41.29

Deny from 89.0.169.227

Deny from 59.95.110.2

Deny from 80.13.133.38

Deny from 206.248.223.151

Deny from 88.117.24.0

Deny from 211.218.72.195

Deny from 85.255.32.30

Deny from 92.80.7.48

Deny from 61.11.71.53

Deny from 61.31.172.63

Deny from 121.168.149.47

Deny from 124.44.145.208

Deny from 211.220.12.90

Deny from 211.218.101.7

Deny from 222.97.212.71

Deny from 61.80.180.238

Deny from 121.162.213.50

Deny from 71.105.9.80

Deny from 121.136.214.161

Deny from 66.167.42.180

Deny from 69.158.153.198

Deny from 121.158.119.12

Deny from 71.253.102.165

Deny from 80.121.109.190

Deny from 66.203.162.203

Deny from 217.110.54.240

Deny from 86.109.103.76

Deny from 89.248.99.153

Deny from 194.79.75.195

Deny from 216.113.192.99

Deny from 66.96.80.31

Deny from 213.203.223.115

Deny from 61.100.189.222

Deny from 64.33.49.76

Deny from 85.17.208.143

Deny from 70.85.82.84

Deny from 68.76.31.154

Deny from 218.50.53.151

Deny from 218.38.12.74

Deny from 64.34.169.108

Deny from 62.193.236.107

Deny from 222.239.78.91

Deny from 74.86.130.109

Deny from 75.126.9.99

Deny from 63.167.66.230

Deny from 189.1.132.59

Deny from 222.96.156.153

Deny from 83.149.90.29

Deny from 209.172.34.237

Deny from 130.161.158.3

Deny from 211.115.89.60

Deny from 88.191.48.162

Deny from 196.30.245.149

Deny from 217.20.117.47

Deny from 209.85.29.25

Deny from 201.91.215.136

Deny from 161.53.125.15

Deny from 62.220.146.59

Deny from 193.188.66.23

Deny from 83.15.229.170

Deny from 208.100.26.14

Deny from 80.51.77.2

Deny from 194.183.224.104

Deny from 85.17.200.74

Deny from 61.19.121.124

Deny from 85.114.132.12

Deny from 66.79.163.220

Deny from 211.218.149.119

Deny from 222.231.1.53

Deny from 204.202.2.203

Deny from 218.189.222.164

Deny from 204.202.2.203

Deny from 61.250.95.201

Deny from 69.94.120.198

Deny from 85.119.152.152

Deny from 76.74.186.159

Deny from 70.84.141.194

Deny from 202.142.220.82

Deny from 87.118.102.153

Deny from 202.213.133.233

Deny from 85.88.11.140

Deny from 88.80.206.12

Deny from 75.18.221.75

Deny from 217.197.68.66

Deny from 201.28.114.173

Deny from 72.21.55.2

Deny from 201.35.66.58

Deny from 62.116.173.131

Deny from 201.217.93.91

Deny from 213.227.137.187

Deny from 204.68.172.35

Deny from 211.233.19.105

Deny from 211.233.19.105

Deny from 80.237.144.235

Deny from 89.248.96.141

Deny from 222.122.47.228

Deny from 222.122.206.203

Deny from 222.122.227.

Deny from 222.236.47.176

Deny from 83.17.81.2

Deny from 212.42.230.152

Deny from 69.72.221.130

Deny from 83.16.96.219

Deny from 207.234.224.141

Deny from 194.204.11.65

Deny from 72.29.73.171

Deny from 74.6.8.107

Deny from 80.194.210.35

Deny from 87.101.244.6

Deny from 85.17.145.57

Deny from 210.114.223.160

Deny from 81.23.229.105

Deny from 81.169.171.5

Deny from 194.126.239.14

Deny from 72.55.148.27

Deny from 217.111.41.132

Deny from 218.150.78.201

Deny from 195.140.135.102

Deny from 221.143.49.246

Deny from 196.207.40.212

Deny from 62.168.15.147

Deny from 87.117.225.155

Deny from 92.113.21.146

Deny from 209.85.108.34

Deny from 84.18.207.65

Deny from 204.9.78.190

Deny from 72.21.49.130

Deny from 91.121.92.203

Deny from 64.22.112.178

Deny from 213.215.226.36

Deny from 206.71.183.50

Deny from 217.141.105.203

Deny from 196.207.15.201

Deny from 61.61.254.36

Deny from 217.141.250.204

Deny from 203.162.2.134

Deny from 157.158.0.30

Deny from 91.121.200.220

Deny from 203.158.221.227

Deny from 61.188.38.192

Deny from 38.99.44.105

Deny from 195.24.77.247

Deny from 88.198.34.243

Deny from 24.33.149.14

Deny from 211.38.131.22

Deny from 65.210.117.93

Deny from 81.210.48.58

Deny from 84.34.147.92

Deny from 83.13.29.123

Deny from 209.17.168.2

Deny from 200.19.221.136

Deny from 83.31.61.200

Deny from 80.50.231.222

Deny from 85.178.99.165

Deny from 67.69.254.243

Deny from 91.66.211.49

Deny from 66.212.19.148

Deny from 208.115.111.

Deny from 213.186.114.175

Deny from 200.63.42.89

Deny from 76.69.182.67

Deny from 193.34.144.72

Deny from 85.222.78.178

Deny from 208.111.154.16

Deny from 196.207.254.45

Deny from 41.208.169.34

Deny from 84.40.208.74

Deny from 78.110.175.15

Deny from 93.174.93.220

Deny from 213.172.182.110

Deny from 209.62.41.210

Deny from 65.222.217.211

Deny from 87.118.108.229

Deny from 58.229.189.184

Deny from 78.46.75.178

Deny from 68.178.254.149

Deny from 64.202.161.131

Deny from 221.132.112.94

Deny from 72.36.131.98

Deny from 85.10.202.240

Deny from 69.197.137.2

Deny from 196.207.243.58

Deny from 78.46.88.202

Deny from 212.116.219.190

Deny from 41.208.132.150

Deny from 60.240.249.194

Deny from 10.210.209.91

Deny from 217.12.16.54

Deny from 121.142.118.50

Deny from 89.149.253.214

Deny from 89.122.29.82

Deny from 85.10.206.147

Deny from 81.202.102.198

Deny from 64.191.25.37

Deny from 74.52.

Deny from 74.53.

Deny from 74.54.

Deny from 74.55.

Deny from 213.154.91.46

Deny from 196.207.195.95

Deny from 92.48.122.144

Deny from 213.46.223.17

Deny from 216.240.136.125

Deny from 121.174.76.83

Deny from 94.178.59.124

Deny from 216.143.82.245

Deny from 67.19.130.218

Deny from 213.239.198.104

Deny from 10.112.0.153

Deny from 195.128.18.18

Deny from 195.149.228.99

Deny from 89.161.130.200

Deny from 84.244.189.99

Deny from 114.30.47.1

Deny from 91.121.203.53

Deny from 91.121.218.169

Deny from 163.28.32.100

Deny from 200.226.137.11

Deny from 67.69.254.245

Deny from 66.198.41.11

Deny from 94.102.60.151

Deny from 79.135.

Deny from 201.68.111.224

Deny from 220.33.204.83

Deny from 65.28.240.175

Deny from 71.235.86.254

Deny from 64.66.192.62

Deny from 189.20.202.89

Deny from 59.90.133.57

Deny from 12.110.109.201

Deny from 218.225.183.104

Deny from 85.120.220.27

Deny from 69.1.118.22

Deny from 64.66.192.61

Deny from 194.176.176.82

Deny from 61.64.56.42

Deny from 24.67.168.96

Deny from 203.194.104.157

Deny from 172.191.36.85

Deny from 194.8.74.235

Deny from 75.63.148.195

Deny from 62.23.5.170

Deny from 222.36.12.42

Deny from 61.8.74.242

Deny from 219.103.10.47

Deny from 201.37.230.154

Deny from 81.80.246.54

Deny from 24.185.37.200

Deny from 88.104.102.53

Deny from 77.97.36.35

Deny from 201.34.16.21

Deny from 67.223.234.160

Deny from 80.90.160.194

Deny from 70.119.146.106

Deny from 202.109.110.2

Deny from 170.35.208.23

Deny from 87.101.244.9

Deny from 71.59.148.180

Deny from 123.130.112.17

Deny from 209.94.64.70

Deny from 70.64.75.137

Deny from 212.44.61.185

Deny from 96.57.154.179

Deny from 202.158.150.174

Deny from 212.62.97.23

Deny from 41.205.111.8

Deny from 192.28.2.6

Deny from 80.93.90.96

Deny from 69.72.144.34

Deny from 66.90.85.60

Deny from 173.8.136.81

Deny from 65.208.70.115

Deny from 212.116.219.81

Deny from 68.180.184.229

Deny from 69.119.218.16

Deny from 218.118.14.98

Deny from 202.231.110.58

Deny from 124.125.100.55

Deny from 59.94.114.144

Deny from 217.199.217.100

Deny from 122.252.228.202

Deny from 216.32.71.251

Deny from 85.214.81.233

Deny from 85.214.72.166

Deny from 129.70.142.34

Deny from 82.41.103.57

Deny from 69.92.76.59

Deny from 59.56.174.199

Deny from 210.212.213.83

Deny from 203.110.240.22

Deny from 201.252.120.133

Deny from 124.53.159.169

Deny from 200.163.66.252

Deny from 203.160.1.71

Deny from 123.255.250.5

Deny from 91.200.233.195

Deny from 201.86.70.162

Deny from 221.224.108.82

Deny from 58.9.48.27

Deny from 83.136.1.138

Deny from 213.185.116.12

Deny from 210.143.19.50

Deny from 209.139.208.194

Deny from 203.190.160.91

Deny from 76.106.127.211

Deny from 201.91.128.225

Deny from 58.8.110.189

Deny from 123.236.175.54

Deny from 71.111.58.193

Deny from 75.51.108.205

Deny from 79.164.40.229

Deny from 88.27.162.5

Deny from 70.189.55.100

Deny from 86.2.162.179

Deny from 70.32.40.18

Deny from 72.51.31.19

Deny from 222.83.215.36

Deny from 77.226.240.26

Deny from 76.21.168.45

Deny from 189.42.120.34

Deny from 140.113.156.245

Deny from 203.155.1.252

Deny from 216.117.131.47

Deny from 164.128.242.62

Deny from 201.236.234.62

Deny from 118.98.214.58

Deny from 124.107.19.185

Deny from 75.68.212.175

Deny from 59.11.145.60

Deny from 201.13.171.71

Deny from 64.48.129.25

Deny from 85.249.1.45

Deny from 189.55.239.95

Deny from 91.151.119.76

Deny from 200.104.250.92

Deny from 75.37.214.224

Deny from 201.82.117.121

Deny from 208.131.157.20

Deny from 211.225.151.136

Deny from 203.63.5.226

Deny from 91.199.210.11

Deny from 206.110.253.132

Deny from 93.175.232.70

Deny from 89.185.48.164

Deny from 203.146.218.238

Deny from 80.254.146.36

Deny from 217.146.178.27

Deny from 195.70.38.248

Deny from 195.130.111.220

Deny from 217.145.248.2

Deny from 93.190.49.109

Deny from 87.104.2.147

Deny from 83.147.244.19

Deny from 198.4.83.48

Deny from 93.91.144.130

Deny from 85.128.81.122

Deny from 87.162.112.164

Deny from 82.76.19.222

Deny from 200.68.103.73

Deny from 213.248.50.104

Deny from 217.113.238.113

Deny from 208.109.123.157

Deny from 213.218.127.86

Deny from 209.164.164.15

Deny from 66.109.51.138

Deny from 210.245.63.218

Deny from 194.232.108.21

Deny from 193.138.125.51

Deny from 195.113.207.43

Deny from 93.100.16.90

Deny from 88.84.156.122

Deny from 84.23.37.37

Deny from 88.65.240.139

Deny from 198.151.13.7

Deny from 202.58.51.182

Deny from 203.161.12.74

Deny from 79.120.0.2

Deny from 202.85.139.15

Deny from 83.18.13.50

Deny from 217.26.168.45

Deny from 194.209.207.78

Deny from 84.55.104.132

Deny from 213.208.174.123

Deny from 91.208.182.126

Deny from 210.86.181.202

Deny from 220.76.249.205

Deny from 89.185.250.125

Deny from 208.43.179.15

Deny from 218.97.194.94

Deny from 69.246.59.137

Deny from 85.214.59.79

Deny from 91.121.159.202

Deny from 59.36.232.253

Deny from 119.70.40.

Deny from 125.248.151.58

Deny from 200.78.218.2

Deny from 199.195.109.19

Deny from 218.26.110.162

Deny from 59.94.14.96

Deny from 217.70.

Deny from 208.43.222.73

Deny from 195.159.29.239

Deny from 203.127.156.232

Deny from 88.191.40.40

Deny from 210.211.161.223

Deny from 213.246.39.67

Deny from 83.149.158.98

Deny from 210.253.14.181

Deny from 213.25.114.10

Deny from 212.111.4.142

Deny from 84.23.101.198

Deny from 85.10.199.207

Deny from 195.70.220.15

Deny from 82.242.49.212

Deny from 85.238.144.30

Deny from 67.208.3.221

Deny from 88.89.176.54

Deny from 212.247.100.194

Deny from 93.180.17.44

Deny from 208.20.21.157

Deny from 85.18.173.168

Deny from 195.64.77.210

Deny from 200.216.75.22

Deny from 208.43.222.74

Deny from 125.138.218.30

Deny from 93.186.99.90

Deny from 81.2.91.174

Deny from 212.54.25.158

Deny from 212.234.105.99

Deny from 193.192.70.82

Deny from 202.239.242.75

Deny from 91.146.164.31

Deny from 203.25.75.5

Deny from 212.58.203.164

Deny from 80.58.205.50

Deny from 213.23.159.27

Deny from 213.130.111.206

Deny from 212.3.226.119

Deny from 93.190.49.104

Deny from 213.136.64.134

Deny from 202.190.124.12

Deny from 92.48.124.114

Deny from 216.126.79.41

Deny from 195.23.115.120

Deny from 92.66.26.228

Deny from 202.16.208.197

Deny from 195.145.225.218

Deny from 88.46.81.250

Deny from 93.92.40.

Deny from 93.92.41.

Deny from 93.92.42.

Deny from 93.92.43.

Deny from 93.92.44.

Deny from 93.92.45.

Deny from 93.92.46.

Deny from 93.92.47.

Deny from 84.244.189.205

Deny from 219.5.172.253

Deny from 213.181.163.109

Deny from 149.32.192.33

Deny from 67.192.179.66

Deny from 41.214.69.161

Deny from 38.105.83.20

Deny from 89.162.212.46

Deny from 66.197.195.149

Deny from 66.90.118.101

Deny from 206.161.120.9

Deny from 41.208.155.199

Deny from 80.122.229.70

Deny from 89.122.29.76

Deny from 78.26.179.68

Deny from 94.229.65.171

Deny from 62.242.65.119

Deny from 83.233.30.35

Deny from 194.8.75.159

Deny from 85.17.237.201

Deny from 168.75.162.134

Deny from 83.233.30.104

Deny from 82.15.207.78

Deny from 38.105.83.19

Deny from 217.175.94.130

Deny from 201.229.208.2

Deny from 89.123.28.23

Deny from 207.61.241.100

Deny from 220.227.47.6

Deny from 89.144.96.79

Deny from 200.21.232.130

Deny from 78.46.83.105

Deny from 219.50.118.63

Deny from 66.110.119.167

Deny from 219.139.73.230

Deny from 62.99.163.242

Deny from 194.246.124.67

Deny from 163.29.250.4

Deny from 194.44.170.81

Deny from 202.168.193.131

Deny from 200.243.243.150

Deny from 124.30.18.245

Deny from 118.98.232.202

Deny from 91.142.12.62

Deny from 77.247.209.43

Deny from 98.223.204.15

Deny from 87.245.155.179

Deny from 85.114.131.54

Deny from 220.128.169.153

Deny from 75.101.198.242

Deny from 66.128.38.41

Deny from 124.5.165.8

Deny from 212.241.180.239

Deny from 200.213.117.2

Deny from 84.2.129.111

Deny from 77.254.163.128

Deny from 160.75.90.69

Deny from 62.30.249.131

Deny from 193.170.123.130

Deny from 140.113.152.201

Deny from 67.159.60.10

Deny from 173.45.77.10

Deny from 77.249.26.44

Deny from 84.120.79.142

Deny from 85.25.124.167

Deny from 78.159.112.96

Deny from 195.91.229.203

Deny from 94.125.180.79

Deny from 94.28.104.162

Deny from 203.180.1.13

Deny from 221.5.251.211

Deny from 125.22.40.120

Deny from 221.130.193.14

Deny from 189.11.175.34

Deny from 125.58.228.69

Deny from 210.196.98.51

Deny from 213.175.207.198

Deny from 149.6.161.50

Deny from 211.75.91.19

Deny from 89.206.25.99

Deny from 168.166.46.219

Deny from 58.223.251.70

Deny from 220.168.44.228

Deny from 218.204.223.208

Deny from 194.160.76.5

Deny from 210.51.54.165

Deny from 217.219.86.148

Deny from 150.176.182.29

Deny from 80.127.3.115

Deny from 95.84.155.131

Deny from 124.244.121.221

Deny from 208.87.234.180

Deny from 98.203.124.180

Deny from 220.181.77.114

Deny from 120.28.64.69

Deny from 93.174.93.58

Deny from 70.177.53.43

Deny from 190.141.153.236

Deny from 203.73.180.16

Deny from 220.135.212.133

Deny from 119.82.226.66

Deny from 86.51.34.34

Deny from 195.209.224.91

Deny from 212.116.219.52

Deny from 67.19.148.234

Deny from 212.117.162.228

Deny from 91.203.68.222

Deny from 201.229.208.3

Deny from 201.6.3.241

Deny from 207.35.173.123

Deny from 189.21.246.135

Deny from 218.72.152.47

Deny from 202.103.191.96

Deny from 95.169.190.71

Deny from 89.247.151.132

Deny from 94.102.49.213

Deny from 89.248.172.50

Deny from 76.106.233.28

Deny from 77.238.234.113

Deny from 77.238.113.120

Deny from 65.222.217.210

Deny from 209.131.124.48

Deny from 209.131.124.43

Deny from 209.131.124.43

Deny from 83.233.165.88

Deny from 89.248.174.76

Deny from 83.167.62.168

Deny from 209.131.124.48

Deny from 209.131.124.62

Deny from 93.174.93.222

Deny from 85.25.124.132

Deny from 66.40.34.166

Deny from 91.205.124.17

Deny from 64.128.171.4

Deny from 212.227.136.205

Deny from 69.175.12.154

Deny from 38.105.83.22

Deny from 173.45.107.170

Deny from 38.99.97.62

Deny from 91.214.44.

Deny from 210.150.10.91

Deny from 213.5.71.85

Deny from 195.23.32.200

Deny from 204.236.

Deny from 188.123.238.221

Deny from 94.75.229.132

Deny from 188.72.199.25

Deny from 78.46.79.52

Deny from 77.68.105.51

Deny from 91.205.96.13

Deny from 194.8.75.147

Deny from 174.121.75.42

Deny from 41.208.168.105

Deny from 88.198.7.39

Deny from 79.172.201.152

Deny from 112.65.135.54

Deny from 190.144.53.138

Deny from 87.221.246.23

Deny from 82.160.202.14

Deny from 79.125.74.168

Deny from 217.21.54.67

Deny from 91.201.66.4

Deny from 212.235.107.31

Deny from 213.5.71.86

Deny from 188.92.72.172

Deny from 85.17.82.87

Deny from 91.121.177.184

Deny from 212.117.172.80

Deny from 92.53.113.52

Deny from 91.205.173.243

Deny from 213.93.147.235

Deny from 118.71.238.11

Deny from 213.5.64.19

Deny from 188.165.204.218

Deny from 213.5.64.20

Deny from 93.188.122.138

Deny from 85.105.35.142

Deny from 70.104.26.63

Deny from 200.243.125.162

Deny from 109.123.220.28

Deny from 91.83.40.188

Deny from 91.83.40.187

Deny from 61.244.235.34

Deny from 24.38.42.122

Deny from 200.21.205.217

Deny from 71.91.231.186

Deny from 193.220.23.33

Deny from 115.126.3.163

Deny from 193.105.240.32

Deny from 77.254.193.226

Deny from 74.115.6.56

Deny from 69.167.158.167

Deny from 115.113.116.207

Deny from 60.217.232.89

Deny from 218.69.96.4

Deny from 190.144.61.218

Deny from 201.249.68.80

Deny from 196.29.192.136

Deny from 58.22.101.239

Deny from 200.238.83.49

Deny from 140.114.63.4

Deny from 208.27.113.137

Deny from 85.194.127.11

Deny from 193.136.138.15

Deny from 210.5.71.130

Deny from 188.72.230.222

Deny from 221.214.27.252

Deny from 178.32.19.10

Deny from 95.211.0.80

Deny from 41.224.190.100

Deny from 93.85.173.219

Deny from 86.35.194.134

Deny from 213.5.64.211

Deny from 77.247.25.135

Deny from 77.247.27.236

Deny from 178.162.182.149

Deny from 77.92.233.198

Deny from 212.117.164.64

Deny from 178.239.58.

Deny from 188.143.232.

Deny from 193.106.136.

Deny from 95.211.121.1

Deny from 188.40.

Deny from 46.252.130

Deny from 46.252.131

Deny from 91.200.240

Deny from 91.200.241

Deny from 91.200.242

Deny from 91.200.243

Deny from 158.143.70.203

Deny from 67.169.155.45

Deny from 83.144.240.60

Deny from 152.101.130.245

Deny from 58.64.151.135

Deny from 123.125.156.92

Deny from 95.111.33.115

Deny from 204.12.72.100

Deny from 62.4.73.228

Deny from 173.236.55.6

Deny from 180.153.142.149

Deny from 193.104.3.135

Deny from 121.145.120.165

Deny from 94.19.191.183

Deny from 216.17.86.98

Deny from 203.189.230.6

Deny from 202.68.174.206

Deny from 121.0.28.54

Deny from 200.21.174.236

Deny from 208.125.235.51

Deny from 142.22.16.

Deny from 62.193.126.4

Deny from 59.165.249.102

Deny from 93.186.192.216

Deny from 84.253.39.111

Deny from 211.13.231.163

Deny from 195.235.92.25

Deny from 112.160.129.155

Deny from 50.18.71.209

Deny from 50.18.3.88

Deny from 216.91.145.56

Deny from 85.9.22.162

Deny from 69.163.96.3

Deny from 85.202.1.82

Deny from 62.162.28.226

Deny from 115.78.224.215

Deny from 93.79.132.29

Deny from 199.232.72.123

Deny from 148.122.38.202

Deny from 74.92.192.117

Deny from 129.194.8.73

Deny from 188.134.67.110

Deny from 175.41.142.118

Deny from 87.244.213.3

Deny from 41.189.90.1

Deny from 182.48.16.12

Deny from 91.224.160.4

Deny from 205.202.120.216

Deny from 213.230.23.101

Deny from 117.6.131.103

Deny from 98.249.251.144

Deny from 112.105.142.20

Deny from 208.110.220.133

Deny from 218.186.15.10

Deny from 79.142.67.

Deny from 79.142.68.

Deny from 79.142.69.

Deny from 62.189.102.229

Deny from 211.103.156.211

Deny from 118.182.20.242

Deny from 202.108.5.35

Deny from 87.228.78.119

Deny from 221.249.73.61

Deny from 65.166.193.25

Deny from 85.226.254.114

Deny from 174.36.42.103

Deny from 125.39.144.146

Deny from 94.124.131.70

Deny from 190.25.225.74

Deny from 109.111.184.1

Deny from 41.190.16.17

Deny from 95.79.115.120

Deny from 18.111.111.106

Deny from 74.105.156.34

Deny from 200.192.89.231

Deny from 62.75.139.246

Deny from 174.129.240.22

Deny from 88.85.52.117

Deny from 178.33.249.19

Deny from 134.184.43.109

Deny from 216.109.73.21

Deny from 147.91.71.30

Deny from 46.159.

Deny from 46.158.

Deny from 85.234.20.

Deny from 85.234.21.

Deny from 178.34.

Deny from 94.175.232.210

Deny from 80.92.231.

Deny from 12.113.37.106

Deny from 212.121.198.

Deny from 190.3.106.

Deny from 86.96.

Deny from 195.184.101.

Deny from 195.140.208.

Deny from 195.140.209.

Deny from 195.140.210.

Deny from 195.140.211.

Deny from 74.121.148.

Deny from 74.121.149.

Deny from 74.121.150.

Deny from 74.121.151.

Deny from 62.206.137.

Deny from 58.114.

Deny from 58.115.

Deny from 66.196.243.

Deny from 198.80.

Deny from 190.200.

Deny from 12.104.222.

Deny from 187.108.57.

Deny from 173.163.

Deny from 58.221.227

Deny from 92.43.114.

Deny from 187.110.226.

Deny from 64.151.

Deny from 200.123.

Deny from 87.106.

Deny from 192.44.

Deny from 195.140.208.

Deny from 195.140.209.

Deny from 195.140.210.

Deny from 195.140.211.

Deny from 50.19.

Deny from 193.128.96.

Deny from 207.86.

Deny from 207.87.

Deny from 50.56.

Deny from 200.52.65.

Deny from 213.6.

Deny from 173.214.

Deny from 64.206.

Deny from 46.137.

Deny from 86.101.180.

Deny from 86.101.181.

Deny from 84.248.

Deny from 84.249.

Deny from 89.250.243.

Deny from 89.250.244.

Deny from 195.228.86.

Deny from 195.228.87.

Deny from 209.226.

Deny from 200.146.119.

Deny from 46.182.32.

Deny from 110.75.

Deny from 12.186.220.

Deny from 193.10.64.

Deny from 193.10.65.

Deny from 193.10.66.

Deny from 193.10.67.

Deny from 89.135.

Deny from 134.106.

Deny from 58.211.230.

Deny from 174.0.

Deny from 88.79.223.

Deny from 70.38.78.

Deny from 202.143.

Deny from 119.160.

Deny from 178.255.199.

Deny from 80.64.

Deny from 49.212.

Deny from 86.62.

Deny from 75.171.

Deny from 201.214.

Deny from  202.46.

Deny from 186.112.

Deny from 186.113.

Deny from 186.114.

Deny from 174.120.

Deny from 174.121.

Deny from 174.122.

Deny from 174.123.

Deny from 85.12.

Deny from 212.222.128.

Deny from 90.83.12.

Deny from 87.249.116.

Deny from 216.94.

Deny from 216.95.

Deny from 94.23.

Deny from 64.8.69.

Deny from 82.120.223.

Deny from 184.72.

Deny from 184.73.

Deny from 119.46.

Deny from 128.187.

Deny from 84.237.

Deny from 195.135.

Deny from 94.228.220.

Deny from 121.52.155.

Deny from 89.106.13.

Deny from 94.41.

Deny from 87.255.

Deny from 82.131.170.

Deny from 109.87.114.

Deny from 178.165.

Deny from 210.48.

Deny from 125.6.

Deny from 60.209.

Deny from 123.121.

Deny from 178.63.64.

Deny from 222.208.

Deny from 207.112.

Deny from 210.165.

Deny from 200.113.108.

Deny from 123.189.

Deny from 200.251.

Deny from 115.155.

Deny from 221.212.235.

Deny from 117.59.

Deny from 123.172.

Deny from 222.219.

Deny from 222.220.

Deny from 222.221.

Deny from 59.45.

Deny from 220.234.

Deny from 119.246.

Deny from 119.247.

Deny from 115.43.

Deny from 111.116.

Deny from 113.139.

Deny from 221.211.

Deny from 94.200.27.

Deny from 219.217.

Deny from 222.57.

Deny from 58.254.

Deny from 222.33.

Deny from 59.44.

Deny from 113.253.

Deny from 116.55.

Deny from 112.216.

Deny from 222.81.

Deny from 113.233.

Deny from 66.240.182.

Deny from 193.48.

Deny from 161.139.

Deny from 79.170.50.

Deny from 200.72.

Deny from 114.41.

Deny from 206.210.224.

Deny from 206.210.225.

Deny from 82.178.23.

Deny from 58.72.

Deny from 195.88.50.

Deny from 187.62.64.

Deny from 84.237.79.

Deny from 46.98.

Deny from 188.116.4.

Deny from 82.199.113.

Deny from 82.199.114.

Deny from 89.189.

Deny from 80.63.56.

Deny from 109.169.68.

Deny from 109.169.69.

Deny from 190.254.

Deny from 83.69.226.


#6 Took

Took

    BlackHat

  • BlackHat
  • PipPipPip
  • 865 postów

Napisano 24 maj 2013 - 07:58

Ja mam taki htaccess:

RewriteEngine on
RewriteBase /
RewriteCond %{HTTP_USER_AGENT} .*Twice.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*roge.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yand.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Baidu.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*site.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Ahre.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*seo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Yahoo.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Voil.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*libw.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Java.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Sogou.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*psbot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Exabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*boitho.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ajSitemap.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Rankivabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*DBLBot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*MJ1.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*Rankivabot.* [OR]
RewriteCond %{HTTP_USER_AGENT} .*ask.*
RewriteRule ^(.*)$ http://domena.pl/ [L,R=301]
Order Allow,Deny
Allow from all


#7 BlackSEO

BlackSEO

    Advanced Member

  • Elita
  • PipPipPip
  • 6031 postów

Napisano 24 maj 2013 - 13:49

A co znaczy ten zapis?
Order Allow,Deny


#8 Took

Took

    BlackHat

  • BlackHat
  • PipPipPip
  • 865 postów

Napisano 24 maj 2013 - 14:01

http://www.maxi-pedia.com/Order+allow+deny


#9 wilk

wilk

    BlackHat

  • BlackHat
  • PipPipPip
  • 871 postów

Napisano 24 maj 2013 - 20:59

@Zeki - czasem warto nie zablokowac jeśli chcesz się komuś pochwalić Trust Flowem czy jego odpowiednikami w Ahrefsie i Open Site Explorerze. To się przydaje gdy np. chcesz sprzedać link komuś, kogo nie rusza PageRank, ale zalezy mu na na trustrankowych linkach.

#10 Hermit

Hermit

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 50 postów

Napisano 20 lipiec 2013 - 22:19

nawet jeśli zablokuje, to nadal w ahref i majesticseo będą widoczne linki z domen, które nie blokują tych wyszukiwarek ;)


Jestem archeologiem, ale możesz coś więcej na ten temat napisać? Zablokowanie tego gówna u siebie naprawdę nie wystarczy? [black-seo.gif]

#11 krzyniolek

krzyniolek

    BlackHat

  • BlackHat
  • PipPipPip
  • 854 postów

Napisano 20 lipiec 2013 - 22:30

Skutecznie mozęsz zablokować tlyko przez przekierowania - po prsotu te roboty nie przestrzegają tych reguł, a zawsze znajdzie się taki którego nazwy nie znasz i nie dodasz.

#12 darkman

darkman

    Elita

  • Elita
  • PipPipPip
  • 524 postów
  • Location# 127.0.0.1

Napisano 21 lipiec 2013 - 02:44

.htaccess
# Silence is golden.
RewriteEngine on
RewriteCond %{HTTP_USER_AGENT} MSNBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bingbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Ezooms [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Aboundexbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MJ12bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} IstellaBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Exabot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ExB\ Language\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} rogerbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Spinn3r [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Butterfly [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ShowyouBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Yahoo\! [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bitlybot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Genieo\ Web\ filter [NC,OR]
RewriteCond %{HTTP_USER_AGENT} proximic [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YandexBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Baiduspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SeznamBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} coccoc [NC,OR]
RewriteCond %{HTTP_USER_AGENT} sistrix [NC,OR]
RewriteCond %{HTTP_USER_AGENT} TurnitinBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GrapeshotCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CareerBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} psbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mail\.Ru\ bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ia_archiver [NC,OR]
RewriteCond %{HTTP_USER_AGENT} IntegromeDB [NC,OR]
RewriteCond %{HTTP_USER_AGENT} sogou\ spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Peeplo\ Screenshot\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Qualidator\.com\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} 80legs [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ChangeDetection [NC,OR]
RewriteCond %{HTTP_USER_AGENT} magpie\-crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AddThis\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ichiro [NC,OR]
RewriteCond %{HTTP_USER_AGENT} findlinks [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Woko [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ZumBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NaverBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} archive\.org_bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Steeler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} aiHitBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SEOENGBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Vagabondo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ShopWiki [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Yahoo\!\ JAPAN [NC,OR]
RewriteCond %{HTTP_USER_AGENT} uMBot\-FC [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AhrefsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BLEXBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PaperLiBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FacebookExternalHit [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetaURI\ API [NC,OR]
RewriteCond %{HTTP_USER_AGENT} UnwindFetchor [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Jyxobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SemrushBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetaJobBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} meanpathbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Netseer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} oBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Blekkobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} spbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} LinkAider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Daumoa [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Wotbox [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FlipboardProxy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} linkdex\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SEOkicks\-Robot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Nuhk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} trendictionbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Gigabot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Infohelfer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} VoilaBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} firmilybot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetcraftSurveyAgent [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CompSpyBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CloudServerMarketSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} netEstate\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} UASlinkChecker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AMZNKAssocBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Sosospider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OpenindexSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BacklinkCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AcoonBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} yacybot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HubSpot\ Connect [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SearchmetricsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WBSearchBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetaHeadersBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} webmastercoffee [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Najdi\.si [NC,OR]
RewriteCond %{HTTP_USER_AGENT} UnisterBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Strokebot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GeliyooBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bot\-pge\.chlooe\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Crawler4j [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ownCloud\ Server\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} QuerySeekerSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Crowsnest [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CirrusExplorer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bixocrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ProCogSEOBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} search\.KumKie\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Falconsbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Dlvr\.it/1\.0 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} thumbshots\-de\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} 200PleaseBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Zookabot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} discoverybot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MojeekBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} woriobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Panscient\ web\ crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Plukkie [NC,OR]
RewriteCond %{HTTP_USER_AGENT} R6\ bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bl\.uk_lddc_bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AraBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} iCjobs [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SolomonoBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Grahambot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Automattic\ Analytics\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} emefgebot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SBSearch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YoudaoBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PiplBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} TinEye [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FlightDeckReportsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} fastbot\ crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} 4seohuntBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Updownerbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} JikeSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NLNZ_IAHarvester2013 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Nigma\.ru [NC,OR]
RewriteCond %{HTTP_USER_AGENT} wsAnalyzer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YioopBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OpenWebSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YodaoBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SpiderLing [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Esribot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Thumbshots\.ru [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BlogPulse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NextGenSearchBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bot\.wsowner\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} wscheck\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Qseero [NC,OR]
RewriteCond %{HTTP_USER_AGENT} drupact [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HuaweiSymantecSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PagePeeker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HomeTags [NC,OR]
RewriteCond %{HTTP_USER_AGENT} facebookplatform [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Browsershots [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Pixray\-Seeker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BDFetch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MeMoNewsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ProCogBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WillyBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} peerindex [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Job\ Roboter\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MLBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebNL [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Peepowbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Semager [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MIA\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Eurobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DripfeedBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} webinatorbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Whoismindbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Bad\-Neighborhood [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Hailoobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} akula [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetamojiCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Page2RSS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EasyBib\ AutoCite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} suggybot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NerdByNature\.Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EventGuruBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} quickobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FyberSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} gonzo [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CCBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} bnf\.fr_bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} UptimeRobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Speedy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Influencebot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MSRBOT [NC,OR]
RewriteCond %{HTTP_USER_AGENT} KeywordDensityRobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} heritrix [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Ronzoobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} RyzeCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ScoutJet [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Twikle [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SWEBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} RADaR\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DCPbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Castabot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} percbotspider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WeSEE\:Search [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CatchBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} imbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EdisterBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WASALive\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Accelobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} PostPost [NC,OR]
RewriteCond %{HTTP_USER_AGENT} factbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Setoozbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} biwec [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GarlikCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Search17Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Lijit [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetaGeneratorCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Robots_Tester [NC,OR]
RewriteCond %{HTTP_USER_AGENT} JUST\-CRAWLER [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Apercite [NC,OR]
RewriteCond %{HTTP_USER_AGENT} pmoz\.info\ ODP\ link\ checker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} LemurWebCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Covario\-IDS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Holmes [NC,OR]
RewriteCond %{HTTP_USER_AGENT} RankurBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DotBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} envolk [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Ask\ Jeeves/Teoma [NC,OR]
RewriteCond %{HTTP_USER_AGENT} LexxeBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} adressendeutschland\.de [NC,OR]
RewriteCond %{HTTP_USER_AGENT} StackRambler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Abrave\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EvriNid [NC,OR]
RewriteCond %{HTTP_USER_AGENT} arachnode\.net [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CamontSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} wikiwix\-bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Nymesis [NC,OR]
RewriteCond %{HTTP_USER_AGENT} trendictionbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Sitedomain\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SEODat [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SygolBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Snapbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OpenCalaisSemanticProxy [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ZookaBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CligooRobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} cityreview [NC,OR]
RewriteCond %{HTTP_USER_AGENT} nworm [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AboutUsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ICC\-Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Qirina\ Hurdler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SBIder [NC,OR]
RewriteCond %{HTTP_USER_AGENT} TwengaBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Dot\ TK\ \-\ spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} EuripBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ParchBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Peew [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AntBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YRSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Urlfilebot\ \(Urlbot\) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Gaisbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WatchMouse [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Tagoobot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Motoricerca\-Robots\.txt\-Checker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebWatch/Robot_txtChecker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} urlfan\-bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} StatoolsBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} page_verifier [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SSLBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SAI\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DomainDB [NC,OR]
RewriteCond %{HTTP_USER_AGENT} LinkWalker [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WMCAI_robot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} voyager [NC,OR]
RewriteCond %{HTTP_USER_AGENT} copyright\ sheriff [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Ocelli [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Twiceler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} amibot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} abby [NC,OR]
RewriteCond %{HTTP_USER_AGENT} NetResearchServer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} VideoSurf_bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} XML\ Sitemaps\ Generator [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BlinkaCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} nodestackbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Pompos [NC,OR]
RewriteCond %{HTTP_USER_AGENT} taptubot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BabalooSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Yaanb [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Girafabot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} livedoor\ ScreenShot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} eCairn\-Grabber [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FauBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Toread\-Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Setoozbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MetaURI [NC,OR]
RewriteCond %{HTTP_USER_AGENT} L\.webis [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Web\-sniffer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FairShare [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Ruky\-Roboter [NC,OR]
RewriteCond %{HTTP_USER_AGENT} ThumbShots\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} BotOnParade [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Amagit\.COM [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HatenaScreenshot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HolmesBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} dotSemantic [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Karneval\-Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HostTracker\.com [NC,OR]
RewriteCond %{HTTP_USER_AGENT} AportWorm [NC,OR]
RewriteCond %{HTTP_USER_AGENT} XmarksFetch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FeedFinder/bloggz\.se [NC,OR]
RewriteCond %{HTTP_USER_AGENT} CorpusCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Willow\ Internet\ Crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OrgbyBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GingerCrawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} pingdom\.com_bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Nutch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} baypup [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Linguee\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Mp3Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} 192\.comAgent [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Surphace\ Scout [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WikioFeedBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Szukacz [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DBLBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Thumbnail\.CZ\ robot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} LinguaBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GurujiBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Charlotte [NC,OR]
RewriteCond %{HTTP_USER_AGENT} 50\.nu [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SanszBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} moba\-crawler [NC,OR]
RewriteCond %{HTTP_USER_AGENT} HeartRails_Capture [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SurveyBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} MnoGoSearch [NC,OR]
RewriteCond %{HTTP_USER_AGENT} smart\.apnoti\.com\ Robot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Topicbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} JadynAveBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} OsObot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebImages [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WinWebBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Scooter [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Scarlett [NC,OR]
RewriteCond %{HTTP_USER_AGENT} GOFORITBOT [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DKIMRepBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Yanga [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DNS\-Digger\-Explorer [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Robozilla [NC,OR]
RewriteCond %{HTTP_USER_AGENT} adidxbot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} YowedoBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} botmobi [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Fooooo_Web_Video_Crawl [NC,OR]
RewriteCond %{HTTP_USER_AGENT} UptimeDog [NC,OR]
RewriteCond %{HTTP_USER_AGENT} \^Nail [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Metaspinner/0\.01 [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Touche [NC,OR]
RewriteCond %{HTTP_USER_AGENT} RSSMicro\.com\ RSS/Atom\ Feed\ Robot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} SniffRSS [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Kalooga [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FeedCatBot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} WebRankSpider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Flatland\ Industries\ Web\ Spider [NC,OR]
RewriteCond %{HTTP_USER_AGENT} DealGates\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Link\ Valet\ Online [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Shelob [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Technoratibot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Flocke\ bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} FollowSite\ Bot [NC,OR]
RewriteCond %{HTTP_USER_AGENT} Visbot [NC]
RewriteCond %{HTTP_USER_AGENT} AhrefsBot [NC]
RewriteRule ^(.*)$ http://nasa.gov/ [L,R=301]

# Silence is golden.
RewriteCond %{HTTP_USER_AGENT} ^-?$
RewriteRule ^(.*)$ http://nasa.gov/ [L,R=301]

# I see you.
RewriteCond %{HTTP_USER_AGENT} SumTingWong [NC]
RewriteRule ^(.*)$ http://encyklopedia.in/ [L,R=301]

+
robots.txt
# Silence is golden.
User-Agent: *
Disallow: / 

# Suck the juice out of me.
User-Agent: Googlebot

Sitemap: domainname.com/sitemap.xml

[black-seo.gif]

#13 Tler

Tler

    BlackHat

  • BlackHat
  • PipPipPip
  • 550 postów

Napisano 21 lipiec 2013 - 09:13

Taka aktualna lista do blokowania jest tutaj:
http://www.robotpoison.com/

#14 gielo

gielo

    BlackHat

  • BlackHat
  • PipPipPip
  • 729 postów
  • LocationChełm

Napisano 21 lipiec 2013 - 09:45

Do tego dobrze jet dorzucić blokady całych klas na iptables ip z krajów największych spamerów jak rosja, chiny, indie itp. Szczególnie gdy zaplecze masz na serwerach dedykowanych. Z hostingami problem jest ten, że serwer może nie wytrzymać dużej ilości wpisów w .htaccess, a dostępu do iptables na serwerze nie masz. Takie blokady, to się robi najlepiej na firewallu serwera. Te boty, yo także najlepiej po ip w firewallu blokować.

#15 Hermit

Hermit

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 50 postów

Napisano 02 sierpień 2013 - 23:22

Tylko nie przesadzajcie z tym .htcssem bo wam strony zamuli

#16 krzyniolek

krzyniolek

    BlackHat

  • BlackHat
  • PipPipPip
  • 854 postów

Napisano 04 sierpień 2013 - 12:21

Lepiej zablokować na pewno range, trochę wtedy oszczędzamy na obciążeniu.

#17 Patryk

Patryk

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 78 postów

Napisano 25 lipiec 2014 - 23:21

Mimo, że odbiega to od tematu, a ja zasługuję na tytuł forumowego archeologa pozwolę sobie odkopać i zarzucić pytanie (bo z wątkiem tematycznie związane):

Wiem, że jest strona linkowana. Widzę też, że roboty ahrefs, majestic i moz są blokowane. Jakie są mało znane sprawdzajki bl które ogarniają jakoś polski internet? Znacie coś?

#18 abc123456

abc123456

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 90 postów

Napisano 14 maj 2018 - 07:18

abc20180514

mont blanc   louis vuitton outlet online   coach outlet store online   kate spade outlet   ralph lauren outlet   nike shoes   coach factory outlet   mont blanc pens   christian louboutin outlet   ralph lauren outlet   jordans   pandora charms sale   vans shoes   polo outlet store   birkenstock outlet   pandora jewelry outlet   nike outlet   oakley sunglasses   coach outlet store   birkenstock sandals   fitflops   canada goose jackets   kate spade outlet   coach outlet   coach outlet   canada goose jackets uk   gucci handbags   abercrombie   nike huarache   yeezy boost   canada goose sale   mulberry uk   canada goose jackets   kate spade outlet store   ecco shoes   coach outlet store   moncler outlet   polo outlet   ugg outlet   uggs outlet   coach outlet store   cheap jordans   coach outlet   pandora jewelry   michael kors outlet   ray ban sunglasses   adidas outlet   valentino shoes   coach outlet   nike outlet online   canada goose   oakley sunglasses   ugg boots on sale   fitflops sale clearance   air max 2019   fred perry   timberland boots   air max 2018   canada goose outlet   christian louboutin   uggs   yeezy boost 350   burberry outlet   michael kors outlet clearance   coach outlet   kate spade outlet   ferragamo shoes   hermens bags   michael kors handbags   mulberry handbags   cheap mlb jerseys   michael kors outlet   moncler outlet   louboutin shoes   pandora jewelry   cheap oakley sunglasses   cheap jordans free shipping   moncler   christian louboutin outlet   pandora jewelry   michael kors outlet   adidas   birkenstock   coach outlet   ugg outlet   burberry outlet   ugg boots   cheap mlb jerseys china   kate spade outlet   jordan shoes   supreme clothing   adidas shoes   burberry outlet   hermes handbags   ugg boots on sale   canada goose outlet   cheap jordans   michael kors outlet   timberland outlet   mbt shoes   supra shoes   pandora charms sale clearance   air jordan shoes   reebok shoes   coach factory outlet   air jordans   canada goose uk   mbt shoes   coach outlet   longchamp outlet   air max 97   michael kors outlet canada   canada goose outlet   polo ralph lauren   michael kors handbags   coach factory outlet   ultra boost   adidas shoes   adidas outlet   prada handbags   tory burch outlet   philipp plein outlet   michael kors outlet canada   toms outlet   ralph lauren   canada goose outlet   adidas shoes   kate spade   ray ban sunglasses   harden vol 1   ray ban sunglasses   ray ban sunglasses discount   uggs canada   adidas yeezy boost   cheap jordans   polo ralph lauren outlet online   coach outlet online   nike free 4.0   michael kors outlet canada   louis vuitton outlet   pandora charms   adidas nmd   tiffany and co   ralph lauren outlet   ugg australia   adidas nmd shoes   birkenstock sandals   oakley sunglasses   moncler jackets   longchamp outlet   coach factory outlet   timberland boots   michael kors outlet   nike air max   ralph lauren outlet   adidas yeezy   pandora outlet   north face jackets   cheap jordans for sale   kate spade outlet store   moncler outlet   polo ralph lauren outlet online   michael kors   nike air max   kate spade   michael kors   mbt   louis vuitton   coach outlet   adidas yeezy   oakley sunglasses   ferragamo outlet   coach outlet   birkenstock sandals   moncler jackets outlet   louis vuitton outlet   new balance shoes   rolex watches   cheap ray ban sunglasses   louis vuitton handbags   adidas outlet   moncler jackets   coach outlet   cheap mlb jerseys   canada goose sale   cheap oakley sunglasses   cheap jordan shoes   oakley sunglasses   tory burch outlet store   polo ralph lauren outlet   pandora charms uk   nike outlet   canada goose jackets   louis vuitton   cheap ray ban sunglasses   cheap nike air max   moncler jackets   ralph lauren   ralph lauren outlet online   michael kors outlet   michael kors outlet clearance   pandora outlet   cheap uggs   pandora jewelry   coach outlet   pandora charms   pandora jewelry   canada goose   air max 2018   pandora charms   fitflops sale   kate spade handbags   kate spade handbag   coach outlet canada   north face jackets   pandora charms   prada outlet   moncler jackets   hermes outlet   michael kors outlet   michael kors outlet clearance   uggs   supreme clothing   coach outlet store   yeezy boost   cheap oakley sunglasses   coach factorty outlet   coach outlet store   skechers shoes   adidas originals   pandora store   hermes handbags   canada goose outlet   tory burch outlet online   ray ban sunglasses discount   michael kors outlet online   cheap nfl jerseys   ugg boots   coach factory outlet   converse outlet store   birkenstock sandals   nike outlet   red bottoms shoes   jordan shoes   cheap jordans   vans store   canada goose uk   ugg outlet   fitflops   cheap oakley sunglasses   ugg outlet   jordan shoes   ecco shoes for men   canada goose uk   fred perry polo   adidas yeezy   kate spade   coach outlet   coach factory outlet online   canada goose jackets   canada goose jackets   abercrombie and fitch   nike shoes   canada goose outlet   adidas nmd   coach outlet store   coach factory outlet   christian louboutin outlet   canada goose outlet   pandora   ugg outlet   red bottom shoes   nike outlet   timberland outlet   adidas yeezy   pandora jewelry   discount oakley sunglasses   fitflops sale clearance   oakley sunglasses   hollister clothing   yeezy boost   coach outlet   supreme new york   new balance outlet   toms shoes   moncler jackets   canada goose outlet   birkenstock shoes   jordan retro 11   coach factory outlet   kevin durant shoes   mulberry outlet   coach canada   ralph lauren sale clearance   gucci outlet   christian louboutin shoes   oakley sunglasses outlet   adidas superstar   pandora jewelry official site   burberry outlet store   toms outlet   coach outlet online   mulberry bags   louis vuitton outlet online   yeezy boost   moncler coats   polo ralph lauren outlet   canada goose sale   coach factory outlet   mcm handbags   nike shoes   cheap jordans   moncler outlet   mlb jerseys   longchamp handbags   valentino shoes outlet   oakley sunglasses   michael kors outlet online   uggs   jordan retro   coach factory outlet   uggs outlet   nmd adidas   converse shoes   mcm outlet   gucci handbags outlet   coach outlet online   coach outlet   pandora outlet   kate spade outlet store   pandora jewelry outlet   polo ralph lauren outlet online   red bottoms   kobe bryant shoes   nike outlet online   air max 97   moncler outlet   nike shoes   nike store   adidas yeezy boost   kate spade outlet   jordan shoes   replica watches   michael kors outlet   kate spade handbags   louboutin shoes   birkenstock shoes   longchamp outlet online   air jordan shoes   tods outlet   ray ban sunglasses   philipp plein shirt   coach outlet   coach outlet   nike shoes   asics shoes   nmd shoes   coach factory outlet   nike shoes for men   ralph lauren uk   cheap ray bans   coach outlet   canada goose   michael kors factory outlet   salvatore ferragamo shoes   canada goose jackets   north face outlet   canada goose uk   michael kors outlet   coach outlet   adidas campus   polo ralph lauren outlet   oakey sunglasses   coach outlet store   birkenstocks   ralph lauren sale   nike air max   pandora jewelry official site   canada goose jackets   adidas shoes   coach factory outlet online   fitflops   ray ban sunglasses   ralph lauren sale clearance   pandora charms   rolex watches   air max 90   adidas superstar   supra shoes   oakley sunglasses sale   canada goose outlet   nike zoom   coach factory outlet   louis vuitton outlet store   ralph lauren uk   coach outlet store online clearances   valentino shoes   adidas yeezy boost   fitflops sale clearance   michael kors outlet clearance   tory burch outlet   fitflops   pandora charms   ralph lauren sale clearance   yeezy boost   pandora charms   kate spade bags   pandora jewelry   pandora charms   ralph lauren outlet   canada goose outlet   michael kors outlet   salvatore ferragamo   coach outlet   supreme clothing   polo ralph lauren outlet   polo ralph lauren outlet online   polo outlet   nfl jerseys wholesale   cheap nba jerseys   nike outlet store   timberland boots   tiffany outlet   louboutin shoes   oakley sunglasses   christian louboutin   air max 2017   tory burch outlet   adidas nmd   moncler outlet   hermes handbags   nba jerseys   michael kors outlet clearance   canada goose outlet   polo ralph lauren outlet   michael kors outlet   ralph lauren   kate spade outlet store   cheap nfl jerseys   canada goose uk   michael kors outlet   coach outlet   birkenstock outlet   timberland boots outlet   nike free run   pandora jewelry   adidas nmd   fitflops   hermes bags   pandora jewelry   fitflops sale   kate spade outlet   coach outlet   pandora charms sale clearance   michael kors outlet   ugg boots   canada goose   jordan shoes   michael kors outlet online   jordan shoes   michael kors outlet   nike air max outlet   adidas yeezy   tiffany and co   adidas shoes   kobe shoes   ralph lauren outlet   air jordans   puma shoes   hermes birkin   yeezy 350 boost   jordans   pandora outlet   coach factorty outlet abc20180514

#19 xiaoou

xiaoou

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 141 postów

Napisano 31 lipiec 2018 - 14:08

20180731 xiaoou

arcteryx jacket mizuno shoes dsquared2 jeans tory burch handbags nike air max 97 hermes outlet store ralph lauren shirts longchamp outlet online cheap ray ban sunglasses gucci outlet online adidas outlet online yeezy boost lebron shoes ugg outlet stores pandora outlet kate spade sale polo ralph lauren outlet canada goose outlet store cheap nhl jerseys moncler outlet store uggs outlet polo ralph lauren shirts 49ers jersey alife clothing air max 90 cheap jordan shoes fitflops shoes ugg outlet coach factory outlet oakley sunglasses wholesale coach outlet clearance coach outlet online ray ban nike blazer pas cher tory burch outlet online air max 90 cazal outlet ferragamo shoes camisetas futbol baratas longchamp pas cher 10 deep clothing michael kors handbags canada goose outlet store polo ralph lauren outlet cheap jordan shoes ferragamo shoes yeezy boost 350 pandora jewelry gucci outlet store ugg outlet jordan retro moncler coats burberry outlet sale pandora outlet mulberry handbags michael kors outlet online bottega veneta outlet online michael kors outlet online cheap jordan shoes off white clothing canada goose jackets outlet polo outlet factory store mishka snapbacks cheap jordan shoes cheap ray ban sunglasses christian louboutin shoes ugg boots clearance michael kors outlet michael?kors?handbags isabel marant shoes uggs outlet michael kors canada air max 90 brequet wathes kate spade sale cheap nba jerseys balenciaga shoes adidas yeezy boost tory burch outlet stores manolo blahnik outlet canada goose coats ravens jerseys jordan 32 nhl jerseys asics running shoes alexander mcqueen shoes coach outlet online uggs outlet ferragamo shoes canada goose jackets outlet chopard jewelry ugg outlet cheap football shirts ray ban sunglasses outlet swarovski jewelry adidas wings shoes true religion jeans longchamp bags canada goose outlet store fossil watches pandora charms sale clearance air jordan shoes canada goose jackets kate spade sale hermes birkin bag light up shoes fitflops michael kors outlet online canada goose jackets sale true religion outlet store canada goose jackets pandora charms sale clearance ugg boots moncler jackets coach outlet online coach outlet online nike air max 2017 a bathing ape adidas shoes air max shoes tory burch outlet online michael kors outlet online adidas crazy nike revolution ralph lauren shirts nike factory store kd 10 elite cartier bracelet canada goose outlet store cheap oakley sunglasses jordan shoes canada goose jackets coach outlet online ferragamo shoes coach outlet online burberry outlet online fitflops sale clearance foamposite shoes lacoste shirts michael kors outlet online cheap soccer jerseys mlb jerseys nike outlet store gentle monster sunglasses longchamp handbags kobe bryants shoes ralph lauren outlet adidas store malone souliers bulgari jewelry michael kors outlet online chrome hearts outlet store cheap oakley sunglasses jordan 4 nike air huarache ugg boots clearance ugg boots salomon outlet cheap oakley sunglasses coach outlet online nobis jackets ralph lauren outlet mulberry handbags air jordan retro pandora charms sale clearance christian louboutin shoes texans jerseys pandora charms sale clearance michael kors outlet clearance coach outlet online reebok shoes nfl jerseys bcbg dresses coach outlet michael kors outlet online soccer jerseys wholesale coach outlet moncler outlet online michael kors outlet online coach outlet nike shoes michael kors outlet clearance football shirts cheap jordans cheap ugg boots air jordan shoes jordan shoes swarovski outlet store cheap jordans for sale toms outlet christian louboutin shoes longchamp bags ray ban sunglasses nike pegasus air jordan shoes miu miu shoes polo ralph lauren polo ralph lauren kd shoes michael kors outlet online christian louboutin shoes swarovski jewellery supreme t shirts ed hardy outlet links of london jewellery coach outlet online nike shoes outlet adidas nmd r1 uggs outlet coach outlet store michael kors factory outlet pandora outlet longchamp outlet burberry canada uggs outlet furla handbags kd 9 fitflops pandora outlet audemars piguet watches mulberry handbags sale christian louboutin shoes adidas soccer shoes air more uptempo uggs outlet christian louboutin shoes mulberry bags canada goose outlet online pandora charms louboutin shoes puma shoes coach outlet stussy hoodie cheap jordans canada goose jackets nike air max true religion outlet cheap ray ban sunglasses jerseys from china prada outlet online michael kors outlet online canada goose outlet store jordan retro coach outlet online colts jerseys kevin durant shoes canada goose outlet chloe outlet uggs outlet jordan 12 michael kors outlet mulberry outlet,mulberry handbags outlet canada goose outlet kate spade coach canada canada goose outlet valentino shoes michael kors outlet north face denail jacket clearance coach outlet online oakley sunglasses wholesale oakley sunglasses uk chrome hearts online store burberry outlet store air max 95

#20 xiaoou

xiaoou

    Advanced Member

  • Użytkownik
  • PipPipPip
  • 141 postów

Napisano 31 lipiec 2018 - 14:11

20180731 xiaoou

arcteryx jacket mizuno shoes dsquared2 jeans tory burch handbags nike air max 97 hermes outlet store ralph lauren shirts longchamp outlet online cheap ray ban sunglasses gucci outlet online adidas outlet online yeezy boost lebron shoes ugg outlet stores pandora outlet kate spade sale polo ralph lauren outlet canada goose outlet store cheap nhl jerseys moncler outlet store uggs outlet polo ralph lauren shirts 49ers jersey alife clothing air max 90 cheap jordan shoes fitflops shoes ugg outlet coach factory outlet oakley sunglasses wholesale coach outlet clearance coach outlet online ray ban nike blazer pas cher tory burch outlet online air max 90 cazal outlet ferragamo shoes camisetas futbol baratas longchamp pas cher 10 deep clothing michael kors handbags canada goose outlet store polo ralph lauren outlet cheap jordan shoes ferragamo shoes yeezy boost 350 pandora jewelry gucci outlet store ugg outlet jordan retro moncler coats burberry outlet sale pandora outlet mulberry handbags michael kors outlet online bottega veneta outlet online michael kors outlet online cheap jordan shoes off white clothing canada goose jackets outlet polo outlet factory store mishka snapbacks cheap jordan shoes cheap ray ban sunglasses christian louboutin shoes ugg boots clearance michael kors outlet michael?kors?handbags isabel marant shoes uggs outlet michael kors canada air max 90 brequet wathes kate spade sale cheap nba jerseys balenciaga shoes adidas yeezy boost tory burch outlet stores manolo blahnik outlet canada goose coats ravens jerseys jordan 32 nhl jerseys asics running shoes alexander mcqueen shoes coach outlet online uggs outlet ferragamo shoes canada goose jackets outlet chopard jewelry ugg outlet cheap football shirts ray ban sunglasses outlet swarovski jewelry adidas wings shoes true religion jeans longchamp bags canada goose outlet store fossil watches pandora charms sale clearance air jordan shoes canada goose jackets kate spade sale hermes birkin bag light up shoes fitflops michael kors outlet online canada goose jackets sale true religion outlet store canada goose jackets pandora charms sale clearance ugg boots moncler jackets coach outlet online coach outlet online nike air max 2017 a bathing ape adidas shoes air max shoes tory burch outlet online michael kors outlet online adidas crazy nike revolution ralph lauren shirts nike factory store kd 10 elite cartier bracelet canada goose outlet store cheap oakley sunglasses jordan shoes canada goose jackets coach outlet online ferragamo shoes coach outlet online burberry outlet online fitflops sale clearance foamposite shoes lacoste shirts michael kors outlet online cheap soccer jerseys mlb jerseys nike outlet store gentle monster sunglasses longchamp handbags kobe bryants shoes ralph lauren outlet adidas store malone souliers bulgari jewelry michael kors outlet online chrome hearts outlet store cheap oakley sunglasses jordan 4 nike air huarache ugg boots clearance ugg boots salomon outlet cheap oakley sunglasses coach outlet online nobis jackets ralph lauren outlet mulberry handbags air jordan retro pandora charms sale clearance christian louboutin shoes texans jerseys pandora charms sale clearance michael kors outlet clearance coach outlet online reebok shoes nfl jerseys bcbg dresses coach outlet michael kors outlet online soccer jerseys wholesale coach outlet moncler outlet online michael kors outlet online coach outlet nike shoes michael kors outlet clearance football shirts cheap jordans cheap ugg boots air jordan shoes jordan shoes swarovski outlet store cheap jordans for sale toms outlet christian louboutin shoes longchamp bags ray ban sunglasses nike pegasus air jordan shoes miu miu shoes polo ralph lauren polo ralph lauren kd shoes michael kors outlet online christian louboutin shoes swarovski jewellery supreme t shirts ed hardy outlet links of london jewellery coach outlet online nike shoes outlet adidas nmd r1 uggs outlet coach outlet store michael kors factory outlet pandora outlet longchamp outlet burberry canada uggs outlet furla handbags kd 9 fitflops pandora outlet audemars piguet watches mulberry handbags sale christian louboutin shoes adidas soccer shoes air more uptempo uggs outlet christian louboutin shoes mulberry bags canada goose outlet online pandora charms louboutin shoes puma shoes coach outlet stussy hoodie cheap jordans canada goose jackets nike air max true religion outlet cheap ray ban sunglasses jerseys from china prada outlet online michael kors outlet online canada goose outlet store jordan retro coach outlet online colts jerseys kevin durant shoes canada goose outlet chloe outlet uggs outlet jordan 12 michael kors outlet mulberry outlet,mulberry handbags outlet canada goose outlet kate spade coach canada canada goose outlet valentino shoes michael kors outlet north face denail jacket clearance coach outlet online oakley sunglasses wholesale oakley sunglasses uk chrome hearts online store burberry outlet store air max 95




Użytkownicy przeglądający ten temat: 0

0 members, 0 guests, 0 anonymous users