The curated data, guides and checker for the second edition are described in the reader companion. Use its edition-matched release for the book's companion files. The project notes below document earlier work.
Utilities and datasets for extracting, analyzing, and repurposing content from johndcook.com/blog — 17 years and 5,233 posts of mathematical blogging.
A curated 365‑day calendar of facts about the blog, shipped as a physical desk calendar / card deck.
Status: Delivered. 365 facts curated from 9,000+ candidates across 21 categories; final print assets and cover spec are frozen for the first edition (Metastats: 365 Days of Facts about JohnDCook.com).
Key Files:
data/johndcook_calendar_365.csv— Final curated 365 facts (canonical)data/johndcook_calendar_candidates_filtered.csv— 1,599 filtered candidatesdata/johndcook_calendar_candidates_v3.csv— 5,090 original candidatesdata/new_deep_analysis_facts.csv— 42 PhD-level analysis facts (twitter, scholar, code evolution, mathematicians)data/new_analysis_facts.csv— 37 GSC/crypto/tone/stats factsdata/hn_facts.csv— 10 Hacker News impact factsout/calendar-final/— Final 365 card images for printout/metastats_cover.png— Working cover art for the deck
Print & Design Docs:
docs/calendar-print-spec.md— print/export spec for the 365 cardsdocs/metastats-cover-spec.md— spec for generating/updating the Metastats cover
Categories:
otd— On-this-day historical factsstats— PhD-level statistical analysis (Zipf's law, Heaps' law, autocorrelation, entropy)gsc— Google Search Console insights (traffic, CTR, geographic reach)hn— Hacker News impact (1,266 submissions, 25K+ upvotes, 4 posts with 500+ points)code— Programming language evolution (Perl→Python trajectory, Mathematica constant)mathematician— Most-referenced mathematicians (Euler 124, Fourier 65, Gauss 55)crypto— Cryptocurrency coverage (elliptic curves, Monero, Bitcoin)twitter— John's 20+ topic-specific Twitter accountsscholar— Academic impact (5,881 citations, 32 publications)tools— Standalone calculators (interpolation calculator drives 83.7% of search traffic)tone— Semantic analysis (86.4% first-person, explanatory style)rarity,quirk,density,constant,span,evergreen,engagement,meta
The candidate-generation pipeline and analysis scripts remain in the repo for future editions, but the CSV and images above define the shipped 365‑day Metastats calendar.
Autonomous bot posting facts to @jdc_facts.
Status: Live and running. Posts at 8am + 6pm UTC (2x daily).
Facts: 427 facts from calendar, HN, GSC, and analysis sources (~7 months runway).
How it works: GitHub Actions runs bot/post_fact.py on schedule, picks random unposted fact, posts to X, tracks state.
See: bot/README.md for full documentation.
A data-driven companion book celebrating johndcook.com/blog as a long-running, quietly influential institution.
Title: Methodical: One Blog, Seventeen Years, 1.8 Million Words
Subtitle: A Data Portrait of John D. Cook's Blog
See:
book/OUTLINE_V4.md— canonical content outlinebook/PRODUCTION_SPEC.md— audience, style, and production detailsbook/README.md— start-here guide for drafting agents
Structure (high level):
- Front Matter — Foreword, Prologue
- Part I: The Architecture — scale, categories, rhythm
- Part II: The Obsessions — constants, special functions, mathematicians
- Part III: The Bridge — programming languages and cryptography
- Part IV: The Unexpected — music, typography, Unicode, clinical trials, interviews
- Part V: The Long View — evolution over eras and what the numbers miss
- Back Matter — reference tables and a curated reading list
Target: ~175 pages, narrative-first with supporting visualizations; gift for Cook, readable by his audience and data-viz/blogging enthusiasts.
data/johndcook_posts_enriched.jsonl— 5,233 posts with full content, categories, tags, word countsdata/johndcook_posts.jsonl— Basic post extractiondata/johndcook_text_index.jsonl— Text analysis indexdata/posts_metadata.csv— Post metadata
data/gsc_exports/— 16 months of Google Search Console data (queries, pages, countries, Discover)data/wp_taxonomies/— WordPress category and tag definitions
- Interpolation calculator: 538,000+ clicks (83.7% of all search traffic)
- 244 countries reached; Romania has mysterious 9.98% CTR (2x global average)
- Tools drive 98% of search traffic; blog posts drive 59%
- 1,266 submissions over 17 years
- 25,486 total upvotes, 10,757 comments
- 4 posts exceeded 500 points (likely #1): "Organizing complexity" (742), "Software reuse" (667), "987654321/123456789" (637), "Rule of succession" (575)
- ColinWright submitted 112 posts — a superfan since 2009
- 5,881 Google Scholar citations
- 32 peer-reviewed publications + 13 MD Anderson working papers
- 13 years at MD Anderson Cancer Center (2000-2013) before independent consulting
- Python: 731 posts (lingua franca since ~2015)
- Mathematica: 782 posts (steady since 2008)
- Perl: 147 posts (2008-2014, now legacy)
- LaTeX: 783 posts (nearly every math post)
- 2015 was the Python inflection point (3x jump from 2014)
- 17 years continuous publication
- Longest gap: 12 days (Feb 13-26, 2025)
- Peak: 26 consecutive days (Nov 13 - Dec 8, 2022)
- Euler: 124 posts (most-referenced)
- Fourier: 65 posts
- Gauss: 55 posts
- Riemann: 47 posts
- Ramanujan: 34 posts
- Living mathematicians: Terence Tao (15+), Donald Knuth (12+)
- "Dungeons, Dragons, and Numbers" went viral: 3,282 clicks, 53,563 impressions
- "TV tuned to a dead channel" hit 5.04% CTR — literary references outperform
- Install dev deps:
make setup - Lint/test:
make lint/make test - Validate the canonical 365 set stays unchanged:
python -m cookbook.cli calendar validate - Snapshot the 365 for print/export:
python -m cookbook.cli calendar snapshot - Run candidate generators:
python -m cookbook.cli calendar candidates --version v4 - Fetch/enrich/index data:
python -m cookbook.cli ingest wp-api|taxonomies|enrich|index - Bot: rebuild facts (
python -m cookbook.cli bot build), validate (python -m cookbook.cli bot validate), post (python -m cookbook.cli bot post --dry-run)
- Older scripts in
data/(e.g.,rebuild.py,rebuild_calendar.py,REBUILD_PLAN.md) remain for reference but are deprecated. Use the CLI commands above instead. Seedocs/legacy-scripts.mdfor details.
- Python 3.x
- Optional but recommended: install repo deps with
make setup(Typer/Tweepy for CLI/bot, pytest/ruff for validation)
- Treat source blog data as read-only
- All generated artifacts go in
data/ - Content preserves Unicode (Greek letters, math symbols)
- Calendar facts designed to be nerdy and technical — gift for a mathematician
2025-11-28: Major analysis pass
- Integrated 16 months of Google Search Console data
- Scraped Hacker News API (1,266 submissions, 25K+ upvotes)
- Google Scholar citations (5,881)
- Deep code language evolution analysis (Perl→Python trajectory)
- Mathematician reference counts
- Twitter account network mapping (20+ topic accounts)
- Rebuilt calendar from 13 to 21 categories with 42 new PhD-level facts
- Twitter bot launched at @jdc_facts
2025-11-30: Metastats calendar delivery
- Finalized canonical 365‑fact CSV and exported print-ready card images to
out/calendar-final/. - Defined Metastats cover and card print specs under
docs/. - Marked legacy calendar exploration scripts as deprecated and archived the original calendar brief.