Techaro Adds WebAssembly to Anubis AI Firewall to Block Scrapers

Techaro has integrated WebAssembly (WASM) into Anubis, an open-source "Web AI Firewall" designed to shield websites from aggressive AI crawlers and scraper bots. The update enables the utility to deploy more complex verification challenges to distinguish human users from automated scripts.

Anubis operates as a firewall utility that protects upstream resources by issuing challenges, such as proof-of-work tasks, to incoming requests. To achieve this new WASM integration, Techaro added Rust and the wazero runtime to the Anubis build closure. This technical shift allows the system to execute more computationally intensive logic on the client side. To ensure accessibility, the developers also implemented a pure JavaScript fallback and interpreter flow for users with browser configurations that disable WebAssembly.

The War on AI Scraping

This update arrives as AI companies ramp up the frequency and intensity of web scraping to gather training data for large language models (LLMs). For many website owners, traditional methods like robots.txt files have become insufficient, as they are often ignored by aggressive crawlers. Anubis positions itself as a lightweight, self-hosted alternative to enterprise services like Cloudflare, specifically targeting community-run projects and the "small internet" that require robust protection without the overhead of massive corporate platforms.

Raising the Cost of Entry

The transition to WebAssembly is significant because it allows bot-protection tools to execute sophisticated challenges without sacrificing the performance experienced by legitimate users. By shifting the computational burden to the client, Anubis increases the resource cost for bot operators attempting to bypass the firewall. This creates a technical barrier that makes large-scale scraping more expensive and difficult to maintain, while keeping the experience seamless for humans.

Future Outlook

As the arms race between AI scrapers and firewall utilities continues, the ability to deploy dynamic, high-performance challenges will be critical. Observers will be watching to see if other open-source security tools adopt similar WASM-based architectures to counter the evolving capabilities of AI-driven bots. While the core implementation of Rust and wazero is now live, the effectiveness of these challenges against the latest generation of headless browsers remains a key point of interest for the community.