MH-6062Data & Analytics
90% of Investment Firms Now Buy Alternative Data
90% of investment firms now use alternative data, up from 67% a year earlier, as retailers and AI developers drive record demand for web data budgets and licensing.
Wire notes
- 90% of surveyed investment professionals use alternative data in 2025, up from 67% in 2024 and 62% in 2023 (Lowenstein Sandler).
- Reddit's 2024 IPO filing disclosed $203 million in data-licensing agreements, with Google and OpenAI among the buyers.
- 80% of AI crawling over the 12 months to July 2025 was for training, per Cloudflare.
- HUMAN Security measured 187% growth in monthly AI-driven traffic from January to December 2025.
- Grand View Research forecasts the alternative data market at $276.9 billion by 2033, growing 37.6% a year.

By Amara Osei
Nine in ten investment professionals now use alternative data — data drawn from outside company filings and market prices, such as web traffic, product listings or job postings. Lowenstein Sandler's 2025 Alternative Data Report, based on 107 professionals at hedge funds, private equity and venture capital firms polled between November and December 2025, put adoption at 90%, up from 67% a year earlier and 62% in 2023.
The budgets follow the behavior. The same survey found 89% of firms plan to raise their alternative data budgets, and over two-thirds of respondents already spend more than $1 million on it. A separate Crisil Coalition Greenwich study of 56 buy-side firms in the US, UK and Europe found 63% plan to spend more.
Those two surveys measure stated intent, not booked spending — a distinction the reports themselves do not resolve.
Why do retailers pay for web data?
Scale explains the urgency. EMARKETER forecast worldwide retail ecommerce sales of $6.419 trillion in 2025, or 20.5% of all retail sales. At that size, one pricing error can repeat across thousands of products overnight.
McKinsey's benchmark quantifies the payoff: on average, a 1% price increase lifts operating profits by 8.7%, provided sales volume holds. That arithmetic is why retailers and brands track competitors' prices and promotions, much of it using data collected from public product pages.
Adoption is moving from tracking to tooling:
- In a KPMG survey of 300 US senior executives in September 2025, 49% said they use AI for pricing and cost modeling, up from 41% in May 2025.
- In consumer goods, that share was 63%.
- 40% of all respondents had adopted dynamic pricing in contracts.
- The Simon-Kucher Global Pricing Study 2025, polling over 2,200 business leaders in 28 countries, found 72% use AI in pricing and 41% use it to analyze competitor pricing and customer price sensitivity.
How much web data does AI training consume?
AI developers have become the fastest-growing class of web data buyers. A Mozilla Foundation study of 47 large language models released between 2019 and October 2023 found at least 64% were trained on Common Crawl, a free archive of web pages.
Paid licensing is now material. Reddit's 2024 IPO filing disclosed data-licensing agreements signed in January that year with a combined contract value of $203 million. Reuters later reported Google was among the licensees, and OpenAI announced a separate Reddit data partnership in May 2024.
Cloudflare's traffic data shows where the volume sits. Over the 12 months to July 2025, 80% of AI crawling was for training, 18% for search and 2% for actions taken on behalf of users. In July 2025, Anthropic's crawlers fetched 38,065 pages for every visitor they referred, down from 286,930 in January — an improvement, but still a heavily one-sided exchange for the sites being read. Cloudflare's 2025 Year in Review found AI bots made 4.2% of HTML requests across its network; Googlebot, which crawls for both search and AI, made another 4.5%.
HUMAN Security measured monthly AI-driven traffic growing 187% from January to December 2025, with traffic from AI agents and agentic browsers up 7,851% year over year — from a low base, the firm noted. In November 2025, Akamai reported a 300% rise in AI bot activity over the previous year. Commerce sites alone received more than 25 billion AI bot requests in July and August 2025. Across the websites analyzed, bots made up more than 53% of traffic in 2025, and malicious bots accounted for 40% of all traffic, according to the Thales 2026 Bad Bot Report.
How big is the market?
Analyst firms size it differently, so totals rarely match. Two current estimates bracket the scale:
| Market | Recent estimate | Forecast | Source |
|---|---|---|---|
| Web scraping | $1.83 billion (2027) | $4.03 billion by 2031, 17.08% a year | Mordor Intelligence |
| Alternative data | $18.8 billion (2025) | $276.9 billion by 2033, 37.6% a year | Grand View Research |
The reports measure different things, which explains most of the gap. Both are forecasts, and figures projected that far out are better read as a direction than a total.
What the next round of numbers will show
Across finance, retail and AI, more organizations use web data each year and spend more on it. The open question is whether AI's appetite for training data keeps outpacing investor and retailer demand — and future industry research will decide which side of the ledger grows faster.
via digitalinformationworld.com (Source)
More from Amara Osei
Show full bio
News editor covering people, launches and day-to-day practice in marketing, advertising, marketing technology, media, SEO and search at Marketing Herald.
346 articles
More on the wire
- Next credits 'acceleration of marketing efforts' for H1 growth
- Walmart, Amazon Center Streaming as Requests for Retail Data Rise 14%
- Amazon: 400 Million Customers Used Alexa for Shopping in a Year
- Adobe Forecasts U.S. Online Holiday Spend to Exceed $275 Billion
- Amazon retail growth puts focus on stores and grocery