SEO 도구

Robots.txt Generator

Generate robots.txt files with custom allow and disallow rules for web crawlers

Global Parameters

User-Agent Group #1

robots.txt Source
# Generated by FreeTools.io

User-agent: *
Disallow: /admin/
Disallow: /private/
Allow: /

Sitemap: https://example.com/sitemap.xml

Crawler Guide

User-agent: * applies to all bots.

Disallow: / prevents bots from crawling anything.

필요한 게 없나요?

커뮤니티 피드백으로 무료 도구를 만듭니다. 워크플로에 필요한 도구를 제안해 주세요!

Robots.txt Generator — Free Online Tool | FreeTool