crawlee.dev

Technologies and libraries

Recognised by fingerprinting the stored files and bundles against known releases; a version is the release the bytes match.

Tracking, tag and verification IDs

Public identifiers read out of the source. Each links to every other site in the index that carries the same one.

Third-party hosts

Hosts outside crawlee.dev that its pages load scripts, frames or stylesheets from, and that its own scripts name in absolute URLs (connect). Each links to every site loading from the same host.

Stored pages and scripts

The newest stored version of each file, newest first@if (p.FilesTruncated) { (the 500 newest of 359) }. Versions are the crawls at which the file was new or its content changed; each opens the file as it was then, rebuilt from the same stored chunks.

Timeline

One entry per crawl, newest first, with what changed since the crawl before: libraries, identifiers, third-party hosts and files. Historical versions stay viewable because the stored chunks are shared between versions, never copied.

1. 2026-10-03 first crawl

   5 pages, 200 files, 5.8 MB; 11 libraries, 1 identifier, 81 third-party hosts

   11 libraries added

   • @clerk/ui 1.34.0
   • @inkeep/cxkit-js 0.5.119
   • spectorjs 0.9.33
   • @joyfill/components 4.0.0-rc26
   • @ant-design/x 2.9.0
   • mori-chat-widget 2.0.49
   • @moveo-ai/web-client 0.117.0
   • @chainlink/cl-search-frontend 0.13.2
   • artplayer-plugin-vast 1.0.0
   • @progress/kendo-date-math 1.5.17
   • @inkeep/agents-ui-js-cloud 0.17.8
   1 identifier added

   • kod1r788 Intercom app id
   81 third-party hosts added

   • www.googletagmanager.com
   • www.w3.org
   • react.dev
   • docusaurus.io
   • sdk.apify.com
   • github.com
   • api-iam.intercom.io
   • widget.intercom.io
   • discord.com
   • stackoverflow.com
   • twitter.com
   • www.youtube.com
   • and 69 more
   200 files added

   • https://crawlee.dev/ html
   • https://crawlee.dev/blog html
   • https://crawlee.dev/js/docs/guides html
   • https://crawlee.dev/js html
   • https://crawlee.dev/python html
   • https://crawlee.dev/js/custom.js js
   • https://crawlee.dev/assets/js/runtime~main.8645865f.js js
   • https://crawlee.dev/assets/js/main.a17a51e8.js js
   • https://crawlee.dev/python/js/custom.js js
   • https://crawlee.dev/crawlee-python/js/custom.js js
   • https://crawlee.dev/python/assets/js/runtime~main.8f189fb5.js js
   • https://crawlee.dev/python/assets/js/main.82b8e40f.js js
   • and 188 more