Perplexity is facing accusations of scraping website content without authorization, even when explicitly prohibited by site owners. Cloudflare, a web security firm, investigated these claims and confirmed Perplexity’s deceptive tactics.
Their research revealed that Perplexity’s web crawlers were disregarding website directives intended to prevent scraping. Furthermore, these crawlers were actively masking their identity to evade detection, making it difficult for website owners to monitor or block their activity.
Cloudflare successfully developed a method to block Perplexity’s access, demonstrating the ability to protect websites from this unauthorized content acquisition. The investigation raises concerns about ethical data collection practices and the potential impact on content creators and website publishers. The findings underscore the need for clear guidelines and enforcement regarding web scraping activities by AI-powered search engines.
