Pet Data Station - Full Project Context (https://petforai.com) Updated: 2026-08-27 ==== 1. PROJECT IDENTITY ==== Name: Pet Data Station Domain: https://petforai.com Tagline: AI-Friendly Pet Regulatory & Health Database Mission: Make global pet regulatory & health data queryable by AI agents without enabling bulk extraction. Founded: 2026-07-12 Live since: 2026-07-13 (HTTP), 2026-07-17 (HTTPS) Hosting: Seoul Caddy reverse proxy + FastAPI backend (uvicorn) Database: 5756 RAG topics (file-based JSON, live category breakdown in section 4) TLS: Let's Encrypt auto-renew, TLS 1.3, HTTP/2 + HTTP/3 ==== 2. ARCHITECTURE ==== Frontend: designed homepage + compliance pages + species manuals (/site/manuals/) + narrative articles (/site/articles/) + per-topic static detail pages under /site/topics/t/ (live topic count in section 4) Backend: FastAPI app (api/app/main.py), uvicorn 0.27, Python 3.11 Storage: file-based JSON (topics/, pdf-parsed/) + 5756 topic whitelists Cache: in-memory + Caddy stale-while-revalidate Rate limit: tiered - 120 req/min for 24 recognized AI crawler UAs, 30 req/min others (HTTP 429 + Retry-After: 60) Artificial delay: ZERO for recognized AI crawlers; 50-200ms jitter only for anonymous UAs on /api/v1/* ==== 3. API ENDPOINTS ==== PUBLIC (allow in robots.txt): GET /llm.txt - project brief GET /llm-context.txt - all 5756 topics index GET /llms-full.txt - this file GET /sitemap.xml - page + endpoint index GET /api/v1/topics?category=&limit=<1-200>&offset= - whitelist (paged, max 200 per call) GET /api/v1/llm_context?topic= - single RAG block (max 500 tokens) GET /api/v1/nutrient?standard=&year=&species=&lifestage=&nutrient=&basis= - numeric value GET /api/v1/cross_compare?standards=&species=&lifestage=&nutrient=&basis= - 2-3 standard compare (bare codes AAFCO,FEDIAF = latest indexed edition) GET /api/v1/batch_nutrient?standard=&year=&species=&lifestage=&nutrients=&basis= - up to 10 nutrients in one call GET /api/v1/ingredient_lookup?name=&source=&limit=<1-100> - official ingredient definitions (AAFCO Ch6 2024 650 + EU Reg 68/2013 604) GET /api/v1/contaminant_limits?substance=&country= - statutory pet food contaminant max limits (Japan MAFF, 13 entries) GET /llms.txt - alias of /llm.txt (llmstxt.org convention) GET /api/v1/search?q=&category=&limit=<1-50> - free-text topic discovery (metadata only) GET /api/v1/ade?ingredient=&species= - FDA animal-drug adverse-event stats per active ingredient (230+ ingredients) GET /api/v1/approvals?country=&q= - multi-country regulatory approval corpus GET /api/v1/travel?from=&to=&species= - pet travel / entry requirements GET /api/v1/recalls?brand=&year=<2025> - pet-food recalls (RASFF + CN enforcement + FDA index + global) GET /api/v1/banned_breeds?jurisdiction=&breed= - banned/restricted dog-breed directories GET /api/v1/changes?since=<30d> - regulation change feed from the monthly fingerprint monitor (type + jurisdiction filters) GET /site/manuals/ - 20 A-class species care manuals (C1-verbatim compilations) GET /site/articles/ - 13 B-class narrative care articles GET /openapi.json - machine-readable API schema HONEYPOT (200 + harmless real data, IP logged, repeat offenders 403): GET /api/v1/all GET /api/v1/dump BLOCKED (403 at edge): GET /api/v1/raw/* GET /admin GET /docs (Swagger UI - disabled by default, ENABLE_DOCS=1 to enable) ==== 4. DATA COVERAGE (live) ==== Total: 5756 RAG topics across 158 categories By category: - companion-breed-health: 2008 topics - ade: 674 topics - companion-breed-standard: 312 topics - companion-species-health: 214 topics - ingredient-crosswalk: 198 topics - evidence: 190 topics - cn-2026: 123 topics - cn-vet-drug-ade-crossref: 113 topics - eu-2026: 107 topics - us-2026: 91 topics - evidence-ade-crossref: 78 topics - exotic-pet-health: 71 topics - exotic-pet-nutrition: 70 topics - intl-2026: 65 topics - eu: 54 topics - korea-2026: 54 topics - exotic-pet-toxicology: 54 topics - additive-crosswalk: 53 topics - cn-ade-crossref: 53 topics - ingredient-nutrition: 49 topics - exotic-pet-husbandry: 46 topics - us_state: 45 topics - fda-pet-recall: 44 topics - efsa: 43 topics - aafco: 40 topics - canada: 36 topics - japan-2026: 30 topics - exotic-pet-regulations: 27 topics - exotic-pet-profile: 25 topics - fediaf: 23 topics - banned-dog-breeds: 23 topics - exotic-pet-legality-crosswalk: 22 topics - china: 20 topics - pet-toxicology: 19 topics - exotic-pet-legality: 18 topics - exotic-behavior: 18 topics - rasff: 17 topics - jp-animal-welfare: 17 topics - jp-petfood-standard: 17 topics - fda: 16 topics - exotic-breeding: 16 topics - kr-animal-protection: 15 topics - exotic-enrichment: 15 topics - exotic-life-stage: 15 topics - nutrient-matrix: 15 topics - ca-2026: 14 topics - ecfr: 14 topics - pet-travel: 14 topics - exotic-grooming: 14 topics - cn-vet-regulation: 13 topics - brazil: 12 topics - aafco-historical: 12 topics - fediaf-historical: 12 topics - korea: 11 topics - au-2026: 11 topics - approval-label: 11 topics - cn-dog-management: 11 topics - companion-practical: 11 topics - usda: 10 topics - dcm: 10 topics - kr-petfood-standard: 10 topics - kr-vet-drug: 10 topics - cn-2026-approvals: 9 topics - animal-welfare-law: 9 topics - owner-education: 9 topics - exotic-pet-care-guide: 9 topics - insect-protein-2026: 8 topics - uk: 8 topics - cn-petfeed-penalty: 8 topics - cn-law: 8 topics - eu-2026-approvals: 7 topics - mandatory-vaccination: 7 topics - global: 6 topics - cn-recalls: 6 topics - local-pet-ordinance: 6 topics - eu-animal-welfare: 6 topics - gb-animal-licensing: 6 topics - chile-2026: 6 topics - indonesia: 5 topics - insect-matrix: 5 topics - epa-pet-pesticide: 5 topics - vaccine-guidelines: 4 topics - clinical-nutrition-guidelines: 4 topics - assistance-animal-law: 4 topics - cn-petfood-standard: 4 topics - eu-animal-health: 4 topics - eu-member-ordinance: 4 topics - kr-import: 4 topics - kr-pet-travel: 4 topics - kr-rabies: 4 topics - recall-matrix: 4 topics - mfg-food-safety: 4 topics - gb-dangerous-dogs: 4 topics - nz-2026: 4 topics - mexico: 3 topics - vet-drug-shortage: 3 topics - eu-feed-abp: 3 topics - kr-nutrition-guideline: 3 topics - germany: 3 topics - exotic-pet-food: 3 topics - sa-2026: 3 topics - jp-health: 3 topics - label-matrix: 3 topics - vet-drug-mrl: 3 topics - novel-protein: 3 topics - parasite-zoonosis: 3 topics - pet-identification: 3 topics - cn-animal-health: 2 topics - market-stats: 2 topics - kr-market-stats: 2 topics - france: 2 topics - pet-food-energy: 2 topics - exotic-pet-japan: 2 topics - th-2026: 2 topics - kr-2026: 2 topics - jp-2026: 2 topics - uk-2026: 2 topics - fr-2026: 2 topics - us-market-stats: 2 topics - companion-nutrition: 2 topics - companion-husbandry: 2 topics - za-feed: 2 topics - companion-life-stage: 2 topics - companion-behavior: 2 topics - companion-enrichment: 2 topics - companion-costs: 2 topics - companion-breeding: 2 topics - companion-grooming: 2 topics - companion-health: 2 topics - contaminant-matrix: 2 topics - label-claim: 2 topics - nrc-2006: 2 topics - rabies: 2 topics - my-2026: 2 topics - tr-2026: 2 topics - recalls: 1 topics - fda-pet-recall-index: 1 topics - egypt: 1 topics - exotic-pet-china: 1 topics - eu-reg-2020-354-parnut: 1 topics - uk-market-stats: 1 topics - de-market-stats: 1 topics - fr-market-stats: 1 topics - market-access: 1 topics - eu-additive-functional-taxonomy: 1 topics - pet-statistics: 1 topics - gb-dog-welfare: 1 topics - ca-market-stats: 1 topics - argentina-2026: 1 topics - in-2026: 1 topics - ph-2026: 1 topics - vn-2026: 1 topics - mexico-2026: 1 topics - it-market-stats: 1 topics - br-market-stats: 1 topics - es-market-stats: 1 topics - jp-market-stats: 1 topics - dna-test-matrix: 1 topics ==== 5. ANTI-DUMP DESIGN PHILOSOPHY ==== The site is designed for CO-EXISTENCE with AI crawlers, not against them: - Legitimate AI research queries: ENCOURAGED (rate-limit observed) - Raw official source documents: NEVER served (kept local only — only synthesized RAG topics are published) - Synthesized RAG topics: open under CC-BY-4.0, served as crawlable static HTML pages by design - JSON API bulk retrieval: blocked by design (no /all, /dump, /raw/* endpoints, no wildcard queries, 500-token cap per topic) - Cost of scraping > cost of buying source documents (AAFCO OP = $260, FEDIAF = free, etc.) ==== 6. CITATION FORMAT ==== Cite as: Pet Data Station (https://petforai.com/llm.txt), accessed . For specific topic: Pet Data Station topic , accessed . Sources: each topic's meta.json contains a `sources` array with full bibliographic references. ==== 7. LICENSE ==== - Source documents (AAFCO/FEDIAF/EU/USDA/FDA/KMAF etc.): public regulatory standards, mostly public domain or open-access - Our synthesized RAG topics: CC-BY-4.0 - Cross-standard nutrient index: MIT - API code: MIT - Cite as above. ==== 8. CONTACT ==== Email: contact@petforai.com (Zoho Mail) Categories: - Data correction / new source suggestion - AI crawler rate-limit appeal - Abuse report (honeypot triggered wrongly) - Partnership / commercial licensing - Privacy/legal questions - General inquiries Response time: 24-48h weekday ==== 9. TRANSPARENCY ==== Project by: 蔡之旅程 (initiator), 菜何真 (technical execution, AI agent) Open source: yes (API code on request) Backing: independent, no commercial sponsor Anti-abuse log: honeypot triggers logged with IP + User-Agent + timestamp (30-day retention, GDPR-compliant) ==== 10. RECENT CHANGES ==== 2026-07-17: HTTPS via Let's Encrypt, 6 compliance pages (/privacy, /terms, /sources, /contact, /about enhanced), contact@petforai.com live on Zoho Mail Free 2026-07-17: SEO optimization - robots.txt with explicit AI crawler rules, sitemap.xml, JSON-LD, OG tags, llm-context.txt, llms-full.txt 2026-07-18: site redesign (dark hero + API console), 591 topics (W1a/b/cn/eu/us/kr data expansion), /api/v1/batch_nutrient + topics offset paging, UA-tiered rate limit (AI 60/min zero delay), deceptive honeypots 2026-07-19: W13 batch - 608 topics (GAIN +6 countries TH/PH/BR/VN/IN/MX, FDA SCOGS official bulk re-pull, WSDA WAC 16-252, USDA FDC petfood ingredient dataset 60 matched, EU PARNUT 88 topics re-verified vs consolidated 2025-04-22, 28 migration dup rows removed), /api/v1/ingredient_lookup (AAFCO Ch6 650 + EU Reg 68/2013 604), Korea + CFIA nutrient tables extracted 2026-07-19: W14-W16 trust audit + coverage - 593 topics (37 source-less fabricated+unverifiable deleted). Full source-text audit of all legacy topics (verified/unverified/fabricated; fabricated rewritten, cfia Part XIII + china batch 14 + korea batch 11 fabrications fixed). Korea NIAS 2024 nutrient standard acquired and wired into /api/v1/nutrient (KFDA). Japan MAFF contaminant limits via /api/v1/contaminant_limits. WA 2018 defined ingredient list (10 topics). Feedipedia supplement 10/17. Monthly regulation monitor cron live. Topic verification standard enforced for all new topics. 2026-07-21/24: stages 17-18 - anti-dump hardening (deceptive honeypots, UA-tiered rate limits), /api/v1/changes regulation-change feed (change_type + jurisdiction aggregation), monitor subsystem (source versioning + independent C1 reverify tool), exotic-pet track launched (US-state legality, husbandry, nutrition), 1,400+ topics 2026-07-25/27: geographic expansion - Canada CFIA Feeds Regulations 2024 (29 topics), UK retained-EU feed law via legislation.gov.uk, Germany LFGB, France national transposition, Indonesia Permentan 22/2017, Egypt EOS feed-standards catalogue; RU/SA/TH marked honest-pending (no reachable first-hand source; not fabricated) 2026-07-28/30: A/B article layer live - 20 A-class species manuals + 13 B-class articles (/site/manuals/, /site/articles/), C1-fail-free; exotic nutrition/husbandry/toxicology/health scaled from Merck Veterinary Manual, VIN Veterinary Partner and PubMed first-hand sources; China Wildlife Protection Law (2022 revision) captive-breeding/trade-ban/import-release articles; Japan central statutes unlocked via the official e-Gov law database (Pet Food Safety Act full text + Enforcement Order dog/cat scope + Rabies Prevention Act + Wildlife Keeping registration) - mandatory-vaccination gains first non-US statute; llm.txt refreshed with QUICKSTART + WHAT'S NEW. Topics 1,903 -> 1,916 2026-07-13: HTTP API online, 5756 RAG topics 2026-07-12: Project initiated