CDL School Shortlist

CDL School Shortlist

VentureKitBot

Who runs the VentureKitBot checks on CDL school websites, what they read, and how to ask them to stop.

Who we are

VentureKitBot is the name CDL School Shortlist, an independent directory of CDL training schools, uses when it checks a school's own website. Every request it sends carries this user agent:

VentureKitBot/1.0 (+https://cdlschoolshortlist.com/bot/)

What it reads

It checks whether a school's website is online, with a short request (a HEAD request, then a small GET if the site needs one) to the website address on the listing. To find a school's published tuition, or a statement about class openings, it reads the school's home page and a few linked pages or PDFs on the same site, so a listing can show the published price or the opening with its source and the date we read it. Before we write to a school, it also checks that the business contact address we hold is still printed on the school's own website. It does not publish descriptions or photos, and it does not extract people's names or other personal details as listing facts.

It does not read the website of a school whose listing shows only its city until the school claims it.

How it behaves

  • It reads your robots.txt before it fetches a page and follows it for VentureKitBot or for all robots (*). A page your robots.txt disallows is not fetched, and a redirect to a page your robots.txt disallows is not followed.
  • If your robots.txt cannot be read (your server returns a 5xx error, does not answer, or refuses access with a 401 or 403), it does not read your site. If you have no robots.txt (a 404), nothing is disallowed.
  • It never uses proxies, never solves CAPTCHAs, and never pretends to be a person's browser.

How to ask it to stop

Add these two lines to your robots.txt, in place of any rules you already have for VentureKitBot, and it will stop reading your site:

User-agent: VentureKitBot

Disallow: /

It reads your robots.txt at the start of each run, so a new rule applies from its next run.

You can also write to [email protected] with your website address to ask us to stop checking it or to review facts taken from it. The robots.txt rule above is the sure way.

If a fact about your school is wrong

Write to [email protected], or claim your listing for free. See corrections.

Updated 2026-11-04