Free during beta
Put Crawlpit Monster on your Mac.
The full crawler, no account and no card. It runs on your machine and sends nothing about your sites anywhere.
Not sure which you have? Click the Apple menu, choose About This Mac, and look for "Apple M" (Apple Silicon) or "Intel" next to Chip or Processor.
Three steps, then you are crawling.
Open the disk image
Double-click the downloaded .dmg, then drag Crawlpit Monster into your Applications folder.
Open it the first time
In Applications, Control-click Crawlpit Monster and choose Open, then click Open again in the dialog.
If macOS says "damaged"
That is the quarantine flag, not a real problem. Run the one Terminal command below, then open the app again.
One extra step, only for now
We are still finishing Apple's notarization. Until that is done, macOS may block the app on first open or call it "damaged." It is not damaged. This command removes the quarantine flag macOS adds to downloads from developers it does not yet recognize. Once we notarize the app, this step goes away and updates just work.
$xattr -cr "/Applications/Crawlpit Monster.app"
Open Terminal from Applications, Utilities. Paste the command, press Return, then launch Crawlpit Monster normally. You only need to do this once per install.
In the beta build
- Full crawls, up to 50,000 pages per project
- Every report: broken links, titles and meta, headings, alt text, indexability, structured data, internal links, orphan pages
- Health score and saved crawl history
- Crawls staging, localhost, and password-protected sites
Requirements
- SystemmacOS 12 Monterey or later
- ChipApple Silicon or Intel
- SpaceAbout 250 MB free
- NetworkOnly to reach the sites you crawl
- Version0.9.0 beta · changelog
Questions about the download.
Why do I need to run a Terminal command?
Because we have not finished Apple's notarization yet. macOS quarantines apps from developers it does not recognize and can label them "damaged." The xattr -cr command removes that quarantine flag. Once the app is notarized, the step disappears and updates install on their own.
Is Crawlpit Monster safe to run?
It runs entirely on your Mac. It does not make you sign in, it does not phone home, and it does not send anything about the sites you crawl. The download is served over HTTPS from crawlpit.monster.
What does it cost?
It is free during the beta. When paid plans arrive later, the build you already have keeps working, and we will give plenty of notice before anything changes.
Is there a Windows version?
Not yet. A Windows build is planned. Join the newsletter on the home page to hear the moment it lands.
How do updates work?
Once notarization is in place, the app checks for updates and installs them quietly in the background. In this early beta you may need to download a new build by hand now and then.