Machine learning

• Generative AI bots may account for more than half of global web traffic. Much of their activity — which involves directly scraping HTML content — eludes traditional analytics tools.
• By ignoring certain protocols, AI agents and crawlers overload processors and bandwidth, forcing publishers to fund costly infrastructure that generates no revenue.
• Web players are attempting to turn these bots into paying customers through paid feeds, at the risk of creating a two-tier internet between large corporations and small and medium-sized businesses.