Information for webmasters, site owners, and developers about our web crawler.
ParliTrack Bot is an automated web crawler operated by ParliTrack. Our platform is dedicated to aggregating, analyzing, and structuring parliamentary and legislative data from various public sources globally. The goal is to promote transparency, accessibility, and insights into legislative processes.
The bot visits websites to index publicly available content related to legislative activities, news updates, official records, and related datasets. This allows us to provide up-to-date information to our users and researchers.
ParliTrack Bot identifies itself with the following User-Agent string in HTTP headers:
ParliTrack-Bot/1.0 (+https://parlitrack.com/bot; bot@parlitrack.com)If you see requests from this User-Agent, they are from our system.
We strictly adhere to the Robots Exclusion Protocol (robots.txt). You have full control over how our bot interacts with your site.
If your robots.txt allows crawling for all bots (User-agent: *), ParliTrack Bot will crawl your site according to standard politeness policies.
To prevent ParliTrack Bot from crawling your entire site, add the following lines to your robots.txt file:
User-agent: ParliTrack-Bot
Disallow: /To prevent crawling of specific directories or files while allowing others:
User-agent: ParliTrack-Bot
Disallow: /private/
Disallow: /search
Disallow: /temporary-files/We implement delays between requests to ensure we do not overload your servers or degrade your site's performance.
We focus on gathering publicly available information relevant to our legislative tracking services.
We do not intentionally target, harvest, or store private personal data that is not part of the public record.
We continuously monitor our bot's activity to ensure compliance with web standards and best practices.
We value the web ecosystem and want to ensure our presence is beneficial. If you notice any issues with our bot, such as excessive crawling, errors, or if you have specific questions, please contact us immediately.
bot@parlitrack.comPlease include your domain name and relevant log entries (if applicable) to help us investigate quickly.