Tangkapan skrin

Penerangan

blocks urls based on robots.txt Enforces robots.txt rules for your own browser traffic. Every domain you visit is checked — disallowed paths are blocked before the request reaches the network.