PageSourceSearch
Opt out API access

Site profile

scrapio.dev

Built with gtm, gtag, @clerk/ui 1.34.0, @blotoutio/providers-blotout-consent-sdk 1.73.0, dashjs 5.2.1, posthog-js 1.434.12, @marimo-team/frontend 0.25.0, @inkeep/cxkit-js 0.5.119, onetrust, @reachfive/identity-core 1.42.0, @reachfive/identity-ui 2.1.0, jspdf 4.2.1 and more. 5 pages and 101 stored files, last crawled 2026-10-04.

rank 9,127,130 44 libraries 0 identifiers 70 third-party hosts 1 crawl open the site

Technologies and libraries

Recognised by fingerprinting the stored files and bundles against known releases; a version is the release the bytes match.

LibraryVersionSeen
gtm 2026-10-04
gtag 2026-10-04
@clerk/ui 1.34.0 2026-10-04
@blotoutio/providers-blotout-consent-sdk 1.73.0 2026-10-04
dashjs 5.2.1 2026-10-04
posthog-js 1.434.12 2026-10-04
@marimo-team/frontend 0.25.0 2026-10-04
@inkeep/cxkit-js 0.5.119 2026-10-04
onetrust 2026-10-04
@reachfive/identity-core 1.42.0 2026-10-04
@reachfive/identity-ui 2.1.0 2026-10-04
jspdf 4.2.1 2026-10-04
oidc-client 1.11.5 2026-10-04
exceljs 4.4.0 2026-10-04
cloudflare-turnstile 2026-10-04
cloudflare-insights 2026-10-04
@foxy.io/elements 1.54.0 2026-10-04
spectorjs 0.9.33 2026-10-04
@moveo-ai/web-client 0.117.0 2026-10-04
@chatvolt/embeds 4.3.16 2026-10-04
webex 3.12.0 2026-10-04
volantis-static 0.0.1761982841160 2026-10-04
@plattar/plattar-ar-adapter 2.8.1 2026-10-04
ovenplayer 0.10.54 2026-10-04
graphql-playground-react 1.7.28 2026-10-04
@recogito/annotorious 2.7.14 2026-10-04
@johanaarstein/dotlottie-player 1.5.23 2026-10-04
webcrypto 0.1.1 2026-10-04
showdown-katex 0.8.0 2026-10-04
replaywebpage 2.5.3 2026-10-04
latex.js 0.12.6 2026-10-04
tonweb 0.0.66 2026-10-04
@accusoft/pdf-viewer 3.11.158639 2026-10-04
@ant-design/x 2.9.0 2026-10-04
@widgetti/solara-vuetify-app 10.1.1 2026-10-04
mori-chat-widget 2.0.49 2026-10-04
@isle-project/dll 0.50.65 2026-10-04
@formbird/angular-elements 8.5.10 2026-10-04
wonder-image 2.1.2-alpha.4 2026-10-04
@joyfill/components 4.0.0-rc26 2026-10-04
prometix 1.7.0 2026-10-04
machinelearn 2.1.5 2026-10-04
@chativa/connector-directline 0.15.0 2026-10-04
coherentpdf 2.5.5 2026-10-04

Tracking, tag and verification IDs

No analytics property, tag manager container, pixel or site-verification token was found in the stored source.

Third-party hosts

Hosts outside scrapio.dev that its pages load scripts, frames or stylesheets from, and that its own scripts name in absolute URLs (connect). Each links to every site loading from the same host.

HostLoaded asFound in
accounts.google.com connect view source
aistudio.google.com connect view source
api-eu.mixpanel.com connect view source
api-in.mixpanel.com connect view source
api.example.com connect view source
api.github.com connect view source
api.jquery.com connect view source
api.mixpanel.com connect view source
app.devin.ai connect view source
app.mintlify.com connect view source
app.posthog.com connect view source
base-ui.com connect view source
cdn.cookielaw.org connect view source
cdn.getkoala.com connect view source
cdn.heapanalytics.com connect view source
cdn.segment.com connect view source
challenges.cloudflare.com connect view source
chat-assets.frontapp.com connect view source
chat.openai.com connect view source
claude.ai connect view source
cran.r-project.org connect view source
curl.haxx.se connect view source
d3gk2c5xim1je2.cloudfront.net connect view source
dashboard.mintlify.com connect view source
devel-m6w6.rhcloud.com connect view source
developer.apple.com connect view source
developer.mozilla.org connect view source
discord.com connect view source
docs.guzzlephp.org connect view source
docs.microsoft.com connect view source
docs.python-requests.org connect view source
example.com connect view source
fonts.googleapis.com connect view source
fonts.gstatic.com connect view source
github.com connect view source
golang.org connect view source
grok.com connect view source
httpie.org connect view source
ipinfo.io connect view source
js.hcaptcha.com connect view source
leaves.mintlify.com connect view source
mintlify.b-cdn.net connect view source
mintlify.com connect view source
nodejs.org connect view source
openjdk.java.net connect view source
ph.mintlify.com connect view source
php.net connect view source
react.dev connect view source
restsharp.org connect view source
ruby-doc.org connect view source
sentry.io connect view source
square.github.io connect view source
static.cloudflareinsights.com script view source
tag.clearbitscripts.com connect view source
tools.ietf.org connect view source
travis-ci.org connect view source
unirest.io connect view source
us.app.unleash-hosted.com connect view source
us.i.posthog.com connect view source
us.posthog.com connect view source
vercel.live connect view source
www.clarity.ms connect view source
www.gnu.org connect view source
www.googletagmanager.com connect view source
www.ibm.com connect view source
www.json.org connect view source
www.mintlify.com connect view source
www.perplexity.ai connect view source
www.w3.org connect view source
yandex.com connect view source

Stored pages and scripts

The newest stored version of each file, newest first@if (p.FilesTruncated) { (the 500 newest of 101) }. Versions are the crawls at which the file was new or its content changed; each opens the file as it was then, rebuilt from the same stored chunks.

FileKindSizeCollectedVersions
https://cdn.cookielaw.org/scripttemplates/otSDKStub.js js library not fetched 2026-10-04 2026-10-04
https://challenges.cloudflare.com/turnstile/v0/api.js?render=explicit js library not fetched 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/static/chunks/205acf40249deeba.js js 212 B 2026-10-04 2026-10-04
https://static.cloudflareinsights.com/beacon.min…85bb4c19e7a9bdbcba1788362987495 js library not fetched 2026-10-04 2026-10-04
https://www.googletagmanager.com/gtag/js?id=G-HM69DD5NE8 js library not fetched 2026-10-04 2026-10-04
https://www.googletagmanager.com/gtm.js?id= js library not fetched 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/static/chunks/d676d10e036ac50f.js js 287 B 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/pages/_error-6b187ff0763e54e2.js js 224 B 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/static/chunks/cf0c32aeedb12a97.js js 287 B 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/pages/_error-bda15e7831eec981.js js 218 B 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…Wu0nxJ1AGuUkLZj/_ssgManifest.js js 858 B 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/eWccc9xEUrDG6dk_XuFgp/_ssgManifest.js js 80 B 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…/_buildManifest.js js 774 B 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/eWccc9xEUrDG6dk_XuFgp/_buildManifest.js js 2.8 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/XCGQFPhHmZZqCKK8Ia8x0/_ssgManifest.js js 212 B 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/XCGQFPhHmZZqCKK8Ia8x0/_buildManifest.js js 1.5 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/app/(mar…/page-6e0871747ac6a591.js js 6.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 364.6 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/app/(mar…/blog/page-08d4def257f6ad04.js js 7.1 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 89.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 197.9 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 57.7 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 28.9 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 27.1 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 79.7 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 177.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 237.6 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 64.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 177.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 39.1 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 64.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 35.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 64.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 35.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 56.6 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 16.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 18.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 110 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 8 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 32.6 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 270.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 47.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 101.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 26.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 23.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 8.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 6.8 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 4.8 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 498.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 80.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 82.3 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 109.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 18.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 57 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 9.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 60.3 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 57.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 70.1 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 42.5 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 26.3 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 41.1 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 36.6 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 21.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 33.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 39.8 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 28 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 32.9 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 6.8 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 31.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 10.7 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 10.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 46.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 183.2 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 63.5 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/webpack-847c5174ff4dd1d9.js js 3.4 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/mintlify-assets/_next/s…pl_GVtXmXHpaP6SrfeCHtJggY5XmUiC js 35.8 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/polyfills-42372ed130431b0a.js js 110 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/6279-a969c7d928e96068.js js 107.8 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/app/login/page-492e4b504dbeb792.js js 6.5 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/9664-bbf55e28a0306eec.js js 8.4 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/891cff7f-20d4441a62c5abf7.js js 317.8 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/app/layout-1b2c20737d2033ee.js js 3.9 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/main-app-b9b4a7b8cc5e95a8.js js 905 B 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/18-d073d0c42b3ac076.js js 169.4 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/87c73c54-dd8d81ac9604067c.js js 169 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/_next/static/chunks/f4bee63f-cfba4131f3314388.js js 292 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/webpack-2708f39b3e993b75.js js 3.2 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/polyfills-42372ed130431b0a.js js 110 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/app/(mar…/layout-1bc1a0ac54343c32.js js 5.7 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/app/(marketing)/page-0a4f7176be14f5d4.js js 5.3 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/664-6d821dc1aacb6b48.js js 8.3 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/app/layout-67814f683396b65d.js js 9 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/main-app-1c7ba46e07306dfa.js js 885 B 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/18-0507b67c725a0854.js js 168.9 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/87c73c54-0375ba195de27293.js js 169 KB 2026-10-04 2026-10-04
https://scrapio.dev/_next/static/chunks/f4bee63f-e7f291fc8cae1d7e.js js 292 KB 2026-10-04 2026-10-04
https://scrapio.dev/pricing html 232.9 KB 2026-10-04 2026-10-04
https://docs.scrapio.dev/api-reference/search html 476.4 KB 2026-10-04 2026-10-04
https://scrapio.dev/blog html 95.2 KB 2026-10-04 2026-10-04
https://app.scrapio.dev/login html 12.1 KB 2026-10-04 2026-10-04
https://scrapio.dev/ html 331.5 KB 2026-10-04 2026-10-04

Timeline

One entry per crawl, newest first, with what changed since the crawl before: libraries, identifiers, third-party hosts and files. Historical versions stay viewable because the stored chunks are shared between versions, never copied.

  1. first crawl

    5 pages, 101 files, 7.2 MB; 44 libraries, 0 identifiers, 70 third-party hosts

    44 libraries added
    • posthog-js 1.434.12
    • @ant-design/x 2.9.0
    • @inkeep/cxkit-js 0.5.119
    • @clerk/ui 1.34.0
    • @moveo-ai/web-client 0.117.0
    • @joyfill/components 4.0.0-rc26
    • mori-chat-widget 2.0.49
    • spectorjs 0.9.33
    • jspdf 4.2.1
    • @reachfive/identity-core 1.42.0
    • @reachfive/identity-ui 2.1.0
    • ovenplayer 0.10.54
    • and 32 more
    70 third-party hosts added
    101 files added

Questions about scrapio.dev

How does PageSourceSearch know what scrapio.dev is built with?
From the site's own source code. The crawler stores the exact bytes of its pages and first-party scripts; the libraries are recognised by fingerprinting that code against known releases, the identifiers are read out of the tag snippets, and the third-party hosts are the script, iframe and stylesheet sources in the HTML and the absolute URLs inside the scripts. Nothing is inferred from headers or guessed.
How far back does the history of scrapio.dev go?
To the first crawl the timeline lists. Every crawl records what the site looked like; when a file's content changes, its earlier version stays viewable because the stored chunks are never deleted, only mapped. A crawl that finds a file unchanged adds no copy.
Can I see an older version of a script from scrapio.dev?
Yes. In the stored files list, every date under a file opens the version that was live at that crawl, with the same viewer as the current one. The raw bytes can be downloaded from there.
Which other websites use the same tracking IDs as scrapio.dev?
Each identifier links to its reverse lookup, the list of every site in the index whose source carries the same id: the sites one analytics property or tag manager container is shared across.

Look up another site, browse sites by tracking ID, third-party host or technology. Site owners: see the crawler page for how stored pages are removed.