To safeguard our expansive and ethical Residential network, Bright Data applies monitoring rules to ensure all Residential proxy traffic aligns with approved use cases and compliance policies.
robots.txt
error, you will need to request Full access, which can be granted once we get to know you and your use case better through KYC.
402 Residential Failed (bad_endpoint)
error and you’ll need to apply for Full access mode instead.
Why does Immediate access mode require an SSL certificate?
Why installing an SSL certificate is simple and secure
What is robots.txt and how does it affect Immediate access?
robots.txt
is a file that website owners use to define which areas of their site can be accessed by automated systems. In Immediate access mode, Bright Data adheres to these rules to ensure ethical compliance. Requests to blocked areas will return a 402 Residential Failed (bad_endpoint)
error. For unrestricted Full access, complete KYC.Why can't I add dedicated residential proxies?
Why do you require KYC for Full Access?
What is the process for KYC verification?
How much time it takes to get my KYC approved?
How do I know that my KYC has been approved?