If you run a website and found EgregorHarvester in your logs, this page is for you.
Some prices on Egregor come from public web pages and open data: pages anyone can open without signing in, such as a store's posted prices or a published rate table. We read them on a schedule, not on demand, and we only read; we never post, buy, sign in, or fill in a form.
One request a second, at most, to any one site, and a small number of pages per run.
robots.txt is honored. If your robots.txt disallows a page for us, we do not fetch it.
We say who we are. Every request carries the User-Agent EgregorHarvester/1.0 (+https://egregormap.com/harvest; takedown@egregormap.com).
No logins. We do not read pages that need an account we do not hold.
Either add a robots.txt rule for EgregorHarvester, or write to takedown@egregormap.com naming your site. We stop reading it within seven days.