<h2 id="%E3%81%AF%E3%81%98%E3%82%81%E3%81%AB" data-line="0" class="code-line">
<a class="header-anchor-link" href="#%E3%81%AF%E3%81%98%E3%82%81%E3%81%AB" aria-hidden="true"></a> はじめに</h2>
Firecrawlの発表した<code>llmstxt.new</code>が凄そうなので試してみる。
<iframe id="zenn-embedded__965021f2c2e78" src="https://embed.zenn.studio/tweet#zenn-embedded__965021f2c2e78" data-content="https%3A%2F%2Fx.com%2Ffirecrawl_dev%2Fstatus%2F1912902024188072291" frameborder="0" scrolling="no" loading="lazy"></iframe><a href="https://x.com/firecrawl_dev/status/1912902024188072291" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://x.com/firecrawl_dev/status/1912902024188072291</a>
<h2 id="llmstxt.new" data-line="6" class="code-line">
<a class="header-anchor-link" href="#llmstxt.new" aria-hidden="true"></a> llmstxt.new</h2>
<iframe id="zenn-embedded__14710f997bbc6" src="https://embed.zenn.studio/card#zenn-embedded__14710f997bbc6" data-content="https%3A%2F%2Fwww.firecrawl.dev%2Fblog%2Flaunch-week-iii-day-4-announcing-llmstxt-new" frameborder="0" scrolling="no" loading="lazy"></iframe><a href="https://www.firecrawl.dev/blog/launch-week-iii-day-4-announcing-llmstxt-new" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://www.firecrawl.dev/blog/launch-week-iii-day-4-announcing-llmstxt-new</a>
ざっくり言うと<code>llmstxt.new/example.com/</code>のようにURLの後ろに対象のWebサイトを指定するとLLMs.txtが作れるらしい。すごい。
<h2 id="%E8%A9%A6%E3%81%97%E3%81%A6%E3%81%BF%E3%82%8B" data-line="12" class="code-line">
<a class="header-anchor-link" href="#%E8%A9%A6%E3%81%97%E3%81%A6%E3%81%BF%E3%82%8B" aria-hidden="true"></a> 試してみる</h2>
<h3 id="1.-url%E3%81%AB%E4%BB%98%E4%B8%8E%E3%81%99%E3%82%8B%E5%BD%A2%E5%BC%8F" data-line="14" class="code-line">
<a class="header-anchor-link" href="#1.-url%E3%81%AB%E4%BB%98%E4%B8%8E%E3%81%99%E3%82%8B%E5%BD%A2%E5%BC%8F" aria-hidden="true"></a> 1. URLに付与する形式</h3>
Clineの公式にはllms.txtがない。
<iframe id="zenn-embedded__ffae7cfb1e27" src="https://embed.zenn.studio/card#zenn-embedded__ffae7cfb1e27" data-content="https%3A%2F%2Fcline.bot%2F" frameborder="0" scrolling="no" loading="lazy"></iframe><a href="https://cline.bot/" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://cline.bot/</a>
よって<a href="https://llmstxt.new/https://cline.bot/" target="_blank" rel="nofollow noopener noreferrer">https://llmstxt.new/https://cline.bot/</a>でアクセスしてみる。レスポンスが無くて不安になるのだが、待っているとllms.txtが作れる。
<div class="code-block-container"><pre class="language-markdown"><code class="language-markdown code-line" data-line="22"># https://cline.bot llms.txt

- [Collaborative AI Coder](https://cline.bot/): Collaborative AI tool for developers to enhance productivity.
- [Join Cline's Mission](https://cline.bot/careers): Join Cline to revolutionize AI-assisted software development.
- [Enterprise AI Development](https://cline.bot/enterprise): Customizable AI development platform launching in phases by 2025.
- [Cline AI Blog](https://cline.bot/blog): Explore Cline's AI coding tools, updates, and insights.
- [Cline FAQ Guide](https://cline.bot/faq): Comprehensive guide to using Cline AI coding assistant.
- [Cline AI Assistant](https://marketplace.visualstudio.com/items?itemName=saoudrizwan.claude-dev): AI coding assistant for Visual Studio Code, enhancing productivity.
- [Cline Privacy Notice](https://cline.bot/privacy): Cline's privacy notice details data collection and usage practices.
- [Cline Bot Terms](https://cline.bot/tos): Cline Bot's terms outline user agreements and service usage rules.
- [MCP Marketplace](https://cline.bot/mcp-marketplace): Explore and install various MCP servers for enhanced AI capabilities.
- [Join Cline's Mission](https://cline.bot/careers): Join Cline to revolutionize AI-assisted software development together.
 

*Note: This is an incomplete llmstxt result. To enable full generation, please provide your Firecrawl API key by either:
1. Adding the 'FIRECRAWL_API_KEY' header to your request (e.g., 'FIRECRAWL_API_KEY: your-api-key-here'), or
2. Including it as a query parameter (e.g., '?FIRECRAWL_API_KEY=your-api-key-here')
</code></pre></div><h3 id="2.-form%E3%81%ABurl%E3%82%92%E5%85%A5%E3%82%8C%E3%82%8B%E5%BD%A2%E5%BC%8F" data-line="42" class="code-line">
<a class="header-anchor-link" href="#2.-form%E3%81%ABurl%E3%82%92%E5%85%A5%E3%82%8C%E3%82%8B%E5%BD%A2%E5%BC%8F" aria-hidden="true"></a> 2. FormにURLを入れる形式</h3>
普通に<a href="https://www.llmstxt.new/" target="_blank" rel="nofollow noopener noreferrer">https://www.llmstxt.new/</a>にアクセスしてもいい。 
<img src="https://storage.googleapis.com/zenn-user-upload/9f8a6515049b-20250418.png" loading="lazy" class="md-img">
このようにllms.txtが作れた！
<div class="code-block-container"><pre class="language-markdown"><code class="language-markdown code-line" data-line="49">*Note: This is an incomplete result, please enable full generation by entering a Firecrawl key.

# https://docs.cline.bot/ llms.txt

- [Cline Documentation](https://docs.cline.bot/): Comprehensive guide to using and extending Cline's capabilities.
- [AI Coding Assistant](https://docs.cline.bot/getting-started/what-is-cline): Cline is an AI assistant for coding productivity.
- [Cline Coding Essentials](https://docs.cline.bot/getting-started/for-new-coders): Essential guide for new coders using Cline tools.
- [Cline Installation Guide](https://docs.cline.bot/getting-started/installing-cline): Step-by-step guide to install and set up Cline.
- [Development Essentials Guide](https://docs.cline.bot/getting-started/installing-dev-essentials): Essential tools and installation guide for software development.
- [Cline Tech Stack Overview](https://docs.cline.bot/getting-started/our-favorite-tech-stack): Explore essential tools and technologies for Cline development.
- [Context Management Guide](https://docs.cline.bot/getting-started/understanding-context-management): Learn how to manage context effectively with Cline.
- [AI Model Selection Guide](https://docs.cline.bot/getting-started/model-selection-guide): Guide to selecting AI models based on context windows.
- [Cline Prompting Guide](https://docs.cline.bot/improving-your-prompting-skills/prompting): Learn to enhance your prompting skills with Cline effectively.
- [Cline Memory Bank Guide](https://docs.cline.bot/improving-your-prompting-skills/cline-memory-bank): A comprehensive guide to using Cline's Memory Bank effectively.
</code></pre></div><h2 id="%E6%B3%A8%E6%84%8F%EF%BC%9A%E5%AF%BE%E8%B1%A1%E3%81%AE%E3%82%B5%E3%82%A4%E3%83%88%E3%82%92%E7%B6%B2%E7%BE%85%E3%81%99%E3%82%8B%E3%82%82%E3%81%AE%E3%81%A7%E3%81%AF%E3%81%AA%E3%81%84" data-line="66" class="code-line">
<a class="header-anchor-link" href="#%E6%B3%A8%E6%84%8F%EF%BC%9A%E5%AF%BE%E8%B1%A1%E3%81%AE%E3%82%B5%E3%82%A4%E3%83%88%E3%82%92%E7%B6%B2%E7%BE%85%E3%81%99%E3%82%8B%E3%82%82%E3%81%AE%E3%81%A7%E3%81%AF%E3%81%AA%E3%81%84" aria-hidden="true"></a> 注意：対象のサイトを網羅するものではない</h2>
<code>2. FormにURLを入れる形式</code>で試した結果を読むと、llms.txtの中にMCPやカスタムモデルがないのがわかる。
<img src="https://storage.googleapis.com/zenn-user-upload/4433ac2b6e46-20250418.png" loading="lazy" class="md-img">
つまり網羅性のあるファイルは作れておらず、何らかの方法でフィルタして列挙されていそう。全部盛りが欲しかったら、有料のAPIキーで<code>llms-full.txt</code>を作ってね。ということだろう。妥当ですね。
GitHubの内容をガバっと取ってくるなら<code>uithub</code>でもいいんだと思う。
<iframe id="zenn-embedded__e797681890dd5" src="https://embed.zenn.studio/card#zenn-embedded__e797681890dd5" data-content="https%3A%2F%2Fuithub.com%2F" frameborder="0" scrolling="no" loading="lazy"></iframe><a href="https://uithub.com/" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://uithub.com/</a>
<h3 id="%E3%81%A8%E3%81%84%E3%81%86%E8%A8%B3%E3%81%A7" data-line="78" class="code-line">
<a class="header-anchor-link" href="#%E3%81%A8%E3%81%84%E3%81%86%E8%A8%B3%E3%81%A7" aria-hidden="true"></a> という訳で</h3>
この機会にFirecrawlに登録してみた。取得した結果をブログに貼ろうと思ったら、文字数超過してしまったので、Gistを参照。
<iframe id="zenn-embedded__b1e37953b4c32" src="https://embed.zenn.studio/card#zenn-embedded__b1e37953b4c32" data-content="https%3A%2F%2Fgist.github.com%2Fwatany-dev%2F6358b9c1cbed53c060a0d6a1abf77961" frameborder="0" scrolling="no" loading="lazy"></iframe><a href="https://gist.github.com/watany-dev/6358b9c1cbed53c060a0d6a1abf77961" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://gist.github.com/watany-dev/6358b9c1cbed53c060a0d6a1abf77961</a>
これくらいの量だと、無料クレジット500のうち51を使った。

”llmstxt.new”でWebサイトからllms.txtを作れる

注意：対象のサイトを網羅するものではない

Discussion