TaxCommuteBot
TaxCommuteBot is the crawler of TaxCommute, a tax news briefing for tax professionals.
What it does
It reads public tax news so we can tell our listeners what changed. We never copy and paste your article: our AI writes a short summary of a few sentences in its own words, with a link to your article, so readers who want the full story go to your website. It identifies itself as TaxCommuteBot/1.0 (+https://taxcommute.com/bot).
How we respect your website
Before every visit, it reads the robots.txt file on your website and follows it. It visits a website at most twice a day. Twice a week, we also read your terms and conditions, because what robots.txt allows is not always what your terms allow. If your terms change, we stop as a precaution until a person has read them. If we cannot read them, a person checks them by hand before we continue.
How to block it
TaxCommuteBot follows robots.txt. To keep it off your whole site, add:
User-agent: TaxCommuteBot
Disallow: /Want your content removed?
For each article, TaxCommute shows a short summary of two or three sentences, written in our own words, with a link to the original. If you'd rather we didn't, email hello@taxcommute.com with your website. You don't need to give a reason. Within two working days we stop visiting your website, remove the summaries and links to your content from TaxCommute, and confirm this to you in writing.
Contact
Questions, or want us to stop? Email hello@taxcommute.com. We reply within two working days and stop at once if you ask.