Acceptable Use Policy
Last updated: June 10, 2026
This Acceptable Use Policy ("AUP") applies to everyone who uses Crawley Cloud. Web scraping is a powerful tool — use it responsibly and lawfully. Violations may result in suspension or termination.
- Only scrape data you are legally allowed to access and use.
- Respect target sites' Terms of Service and robots.txt (the crawler honors robots.txt by default — only disable it where you are authorized to).
- Use reasonable rates and concurrency; do not overload or degrade target sites.
- Do not circumvent authentication, paywalls, or access controls you are not authorized to bypass.
- No scraping of content that is illegal to collect, or that infringes intellectual property or trade secrets.
- No collection of sensitive personal data for unlawful profiling, harassment, doxxing, or spam.
- No scraping of child sexual abuse material or other illegal content.
- No using the Service to launch denial-of-service or other attacks.
- No attempts to access internal/private networks, cloud metadata endpoints, or other tenants' data.
- No reselling raw access in violation of these terms, sharing credentials, or evading quotas.
You are solely responsible for ensuring your scraping activity complies with applicable laws (including data-protection laws such as GDPR/CCPA) and third-party agreements. We may remove projects or data, and report activity, where required by law.
To report abuse of the platform, email abuse@devcloudsoftware.com.