Koichiro Mori

<p>ローカルLLMについての調査</p>


<p><span class="embed-block zenn-embedded zenn-embedded-card"><iframe id="zenn-embedded__d8fb430a4e4f6" src="https://embed.zenn.studio/card#zenn-embedded__d8fb430a4e4f6" data-content="https%3A%2F%2Fzenn.dev%2Fsaldra%2Farticles%2F201dd9e7d8c743" frameborder="0" scrolling="no" loading="lazy"></iframe></span><a href="https://zenn.dev/saldra/articles/201dd9e7d8c743" style="display:none" target="_blank">https://zenn.dev/saldra/articles/201dd9e7d8c743</a></p>
<p>メリット</p>
<ul>
<li>APIの仕様に左右されない</li>
<li>オフラインでも使える</li>
</ul>
<p>デメリット</p>
<ul>
<li>APIより性能は低い</li>
<li>計算資源をたくさん使う</li>
<li>スケール難易度が高い</li>
</ul>


<p><span class="embed-block zenn-embedded zenn-embedded-card"><iframe id="zenn-embedded__14d7e7b30ec74" src="https://embed.zenn.studio/card#zenn-embedded__14d7e7b30ec74" data-content="https%3A%2F%2Fgithub.com%2Foobabooga%2Ftext-generation-webui" frameborder="0" scrolling="no" loading="lazy"></iframe></span><a href="https://github.com/oobabooga/text-generation-webui" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://github.com/oobabooga/text-generation-webui</a></p>
