Workflows · Technical Optimisation
Fix the technical issues blocking AI crawlers.
A weighted Technical Score — page speed, mobile, Core Web Vitals, technical SEO, and crawlability — plus named crawler-access checks for GPTBot, ClaudeBot, PerplexityBot, and Google-Extended specifically.
Site Health · kayahouse.sg
Technical Score: 68/100- highGPTBot blocked on /products/* via robots.txt
- highClaudeBot returns 403 on all category pages
- mediumMissing Product schema on 42 pages
- mediumNo answer-first summary on 18 blog posts
- lowH1/H2 hierarchy skips a level on 6 pages
Named AI crawler access checks
Confirm GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, and Google-Extended can each actually reach your pages — robots.txt rules and CDN bot-blocking block one or more of these more often than teams expect, silently.
Schema.org markup audits
Flag missing or malformed Product, FAQ, and Article schema.org markup — the structured data that makes rich snippets and knowledge-graph eligibility possible, and that AI engines lean on to extract facts confidently.
A weighted Technical Score, not a pass/fail
Page Speed, Mobile Optimisation, Core Web Vitals, Technical SEO, and Crawlability each carry a fixed weight, rolling up into one 0–100 score you can track release over release.
Render-parity checks
Compare what a browser renders against what a crawler without JavaScript execution sees — a common gap for client-rendered pages that quietly blocks AI crawlers even when robots.txt allows them.
llms.txt support
Generate and validate an llms.txt file — the emerging convention for pointing AI systems at your most citation-worthy pages directly, alongside your existing sitemap.
Re-checks on a schedule
Re-run the full audit automatically after each deploy so a regression gets caught before it shows up as a visibility drop two weeks later.
How the Technical Score is built
Five weighted components, one 0–100 score
FCP, LCP, TTI, TBT
Responsive design, viewport, touch targets
LCP, INP, CLS
Sitemap, robots.txt, canonicals, HTTPS, schema
Internal links, broken links, redirect chains
Technical Score feeds into your Overall Health Score alongside Content and AEO — see how those combine on AEO Insights.
See your Technical Score in minutes.
Connect a domain and get a live crawler-access and schema audit — no credit card required.