Explainer · suggestion
What is Robots.txt, and why is everyone looking it up this week?
Hook: Robots.txt is getting attention. Explain what changed and who should care, in plain words.
Based on: Attention is above its usual level.
Developer Tools & Programming · first detected 21 Aug 2026 · scored 15 Nov 2026 ·
Attention data: Wikipedia pageviews via the Wikimedia Analytics API · News data: GDELT Project · Research data: arXiv (thank you to arXiv for use of its open access interoperability) · Community data: Hacker News (Y Combinator) official API · Headlines: niche publications via their public feeds (headline, date and link only) · Community data: Hacker News Search by Algolia · Q&A data: Stack Overflow (Stack Exchange Network), CC BY-SA · Social data: Bluesky (AT Protocol) post counts · Research data: OpenAlex (CC0)
Attention is cooling, and the topic is moderately covered: worth watching.
Trend
29/100Cooling
Attention is a little below its usual level.
Opportunity
18/100Some
A little room, but the topic is either slow or already busy.
Confidence
92%High
Several sources and a long history back this score.
Trend, 30 days
| Component | Value | Weight | Points |
|---|---|---|---|
| Attention growth | 31% | 0.41 | +12.9 |
| Coverage growth | 0% | 0.00 | +0.0 |
| Cross-source breadth | 0% | 0.12 | +0.0 |
| Acceleration | 0% | 0.18 | +0.0 |
| Audience size | 68% | 0.29 | +19.9 |
| Saturation (subtracted) | 34% | 0.10 | −3.4 |
| Trend score (0–100) | 29.4 |
Opportunity = trend 29.4 × (1 − ½ × saturation 34%) × stage weight 0.8 × (½ + ½ × niche relevance 0.8) = 17.6
Saturation parts: volume 68%, time elevated 0%, mainstream 0%. Spike ratio = mean of the last 3 days ÷ median of days 4–31. Growth parts are centred: 50% means at the usual level. A source counts as spiking at ≥ 1.5× and robust z ≥ 2.
| Source | Spike | Robust z | Week over week | Spiking |
|---|---|---|---|---|
| rss | 0.00× | 0.0 | 0% | no |
| arxiv | 0.00× | 0.0 | 0% | no |
| gdelt | 0.00× | 0.0 | 0% | no |
| wikipedia | 0.59× | -1.0 | -91% | no |
| hacker news | 0.00× | 0.0 | 0% | no |
Full method: methodology. Rising means rising now; it is not a prediction that a topic will go viral.
Wikipedia views
211/day
last 3 days on average · usual 356 · latest day 195
2026-10-17 → 2026-11-15 · fetched 16 Nov, 13:08 UTC
Bluesky posts
9/day
latest day
2026-10-17 → 2026-11-15 · fetched 16 Nov, 13:27 UTC · not used in today's score
Hacker News stories
0/day
latest day
2026-10-17 → 2026-11-15 · fetched 16 Nov, 13:20 UTC · not used in today's score
Hacker News stories (live feed)
0/day
latest day
2026-10-19 → 2026-11-15 · fetched 15 Nov, 12:31 UTC
New arXiv papers
0/day
latest day
2026-10-18 → 2026-11-15 · fetched 16 Nov, 13:13 UTC
New research works
0/day
latest day
2026-10-19 → 2026-11-15 · fetched 13 Nov, 12:54 UTC · not used in today's score
News coverage
0/day
latest day
2026-10-19 → 2026-11-15 · fetched 15 Nov, 12:31 UTC
Niche headlines
0/day
latest day
2026-10-18 → 2026-11-15 · fetched 15 Nov, 12:31 UTC
Stack Overflow questions
0/day
latest day
2026-10-21 → 2026-11-15 · fetched 16 Nov, 13:31 UTC · not used in today's score
Attention data: Wikipedia pageviews via the Wikimedia Analytics API · News data: GDELT Project · Research data: arXiv (thank you to arXiv for use of its open access interoperability) · Community data: Hacker News (Y Combinator) official API · Headlines: niche publications via their public feeds (headline, date and link only) · Community data: Hacker News Search by Algolia · Q&A data: Stack Overflow (Stack Exchange Network), CC BY-SA · Social data: Bluesky (AT Protocol) post counts · Research data: OpenAlex (CC0) · Data as of 16 Nov, 13:31 UTC
Observed (measured data)
Interpretation (our reading, not a fact)
No source shows a sharp jump: the score comes from attention that is high or building gradually, not from a sudden spike.
None of our news sources has a recent headline about it.
Written from the measured data and headlines on this page (scored 15 Nov 2026).
Check what people are posting about “Robots.txt” right now on Reddit and YouTube. Opens their sites; we don't collect their data.
Suggestions written from the signals on this page, not advice and not a forecast.
Explainer · suggestion
Hook: Robots.txt is getting attention. Explain what changed and who should care, in plain words.
Based on: Attention is above its usual level.
Comparison · suggestion
Hook: Both are protocols people compare; Robots.txt is the one gaining attention. Test them on the same task.
Based on: Vulkan is the strongest other protocol of its kind on this radar today. Attention is above its usual level.
Tutorial · suggestion
Hook: What the spec looks like in practice: one client, one server, one working call.
Based on: Attention is above its usual level.
Angle 1 · livestream
Hook: Skip the hello-world: this is what building something real with Robots.txt is like.
Copy the chart above as a PNG, share the link (it comes with a trend card), or embed a live widget that updates with every data refresh.
Passes the rising rules: Wikipedia views at 11× its 4-week median, 2× or more on each of the last 3 days
Wikipedia views up 4.4× against its 4-week median
Wikipedia views up 7.6× against its 4-week median
Wikipedia views up 2.5× against its 4-week median
Wikipedia views up 1.9× against its 4-week median
Wikipedia views up 1.2× against its 4-week median