ChatGPT Search Can Draw On More Pages After A Cloudflare Pilot via @sejournal, @MattGSouthern

Cloudflare and OpenAI say a research pilot has helped OpenAI discover and index hundreds of millions of new web pages. The pilot used a participating cohort of about 1% of Cloudflare’s total network. The companies shared those early results on Oct. 15 in a post on Cloudflare’s blog coauthored by two OpenAI staff. Cloudflare announced the pilot on July 8. The post says finding new pages can initially increase crawling, and it doesn’t report how often the new pages were cited in ChatGPT or how many visits they sent. Cloudflare’s network signals are used by OpenAI to help its search crawler find web pages with value.