Quick answer
Robots.txt is a small file that tells search engines which parts of your site they should not crawl.
What it means
Robots.txt is a small file that tells search engines which parts of your site they should not crawl. In normal terms, it is one small part of how Google and people understand your site.
Why it matters
It can protect private or low-value areas from being crawled, but one bad line can block your whole site from Google.
What to do about it
Keep it simple. Do not block important pages, CSS or JavaScript. Check it after site launches and migrations.
Bloom's take
Bloom treats robots.txt changes carefully because a small mistake can cause a big traffic drop.
Related terms
Questions people ask
What is Robots.txt in simple terms?
Robots.txt is a small file that tells search engines which parts of your site they should not crawl.
Does robots.txt matter for SEO?
Yes, when it affects whether Google can understand, trust or show your page. It is not always the biggest job on the list, but it is worth fixing when it blocks traffic or confuses visitors.
How do I check robots.txt on my site?
Start with the page itself, then use Google Search Console or a simple site scan. Look for the issue on important pages first, not every tiny page you have ever published.
Can Bloom help with robots.txt?
Yes. Bloom turns this into a plain task when it matters. If it is technical or fiddly, you can also hand it to a Bloom specialist from inside the app.
Next step
Want this checked on your site? See Bloom services, or see how Bloom turns SEO issues into plain tasks.