kenichiuda

<h2 id="unicode-normalization-form-c(nfc)">
<a class="header-anchor-link" href="#unicode-normalization-form-c(nfc)" aria-hidden="true"></a> Unicode Normalization Form C(NFC)</h2>
<p>NFKCはナシ。<br>
<a href="https://docs.microsoft.com/ja-jp/dotnet/api/system.string.normalize?view=net-6.0" target="_blank" rel="nofollow noopener noreferrer">String.Normalize メソッド (System) | Microsoft Docs</a></p>


<h2 id="cjk%E9%83%A8%E9%A6%96%2F%E5%BA%B7%E7%86%99%E9%83%A8%E9%A6%96%E3%82%92%E7%BD%AE%E6%8F%9B">
<a class="header-anchor-link" href="#cjk%E9%83%A8%E9%A6%96%2F%E5%BA%B7%E7%86%99%E9%83%A8%E9%A6%96%E3%82%92%E7%BD%AE%E6%8F%9B" aria-hidden="true"></a> CJK部首/康熙部首を置換</h2>
<p><a href="https://imabari.hateblo.jp/entry/2020/08/03/220407" target="_blank" rel="nofollow noopener noreferrer">PythonでCJK部首/康熙部首を置換 - メモ</a></p>


<h2 id="%E4%B8%8D%E5%8F%AF%E8%A6%96%E6%96%87%E5%AD%97(zwj%2Fzwnj%E3%81%AA%E3%81%A9)%E3%81%AE%E5%89%8A%E9%99%A4(%E3%81%9F%E3%81%A0%E3%81%97%E7%B5%B5%E6%96%87%E5%AD%97%E3%81%AB%E6%B3%A8%E6%84%8F)">
<a class="header-anchor-link" href="#%E4%B8%8D%E5%8F%AF%E8%A6%96%E6%96%87%E5%AD%97(zwj%2Fzwnj%E3%81%AA%E3%81%A9)%E3%81%AE%E5%89%8A%E9%99%A4(%E3%81%9F%E3%81%A0%E3%81%97%E7%B5%B5%E6%96%87%E5%AD%97%E3%81%AB%E6%B3%A8%E6%84%8F)" aria-hidden="true"></a> 不可視文字(ZWJ/ZWNJなど)の削除(ただし絵文字に注意)</h2>
<p>異体字セレクターの削除も</p>


<p>現時点だと、Windows 付属のicu.dllを使っている場合は Unicode 13.0か？</p>
<blockquote>
<p>ICU 68.2 includes Unicode 13.0 and CLDR 38.1.</p>
</blockquote>
<p><span class="embed-block zenn-embedded zenn-embedded-card"><iframe id="zenn-embedded__fefd8a60ea995" src="https://embed.zenn.studio/card#zenn-embedded__fefd8a60ea995" data-content="https%3A%2F%2Fgithub.com%2Fmicrosoft%2Ficu%2Freleases%2Ftag%2Fv68.2.0.1" frameborder="0" scrolling="no" loading="lazy"></iframe></span><a href="https://github.com/microsoft/icu/releases/tag/v68.2.0.1" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://github.com/microsoft/icu/releases/tag/v68.2.0.1</a></p>


<h2 id="%E5%85%A8%E8%A7%92%E8%8B%B1%E6%95%B0%E3%81%AE%E5%8D%8A%E8%A7%92%E5%8C%96%E3%80%81%E5%8D%8A%E8%A7%92%E3%81%8B%E3%81%AA%E3%81%AE%E5%85%A8%E8%A7%92%E5%8C%96">
<a class="header-anchor-link" href="#%E5%85%A8%E8%A7%92%E8%8B%B1%E6%95%B0%E3%81%AE%E5%8D%8A%E8%A7%92%E5%8C%96%E3%80%81%E5%8D%8A%E8%A7%92%E3%81%8B%E3%81%AA%E3%81%AE%E5%85%A8%E8%A7%92%E5%8C%96" aria-hidden="true"></a> 全角英数の半角化、半角かなの全角化</h2>
<p><a href="https://gist.github.com/udaken/111c5b8c4dc613c940a0a38402bed90d" target="_blank" rel="nofollow noopener noreferrer">StrConv(VbStrConvNarrow/VbStrConvWide)で変換される文字</a></p>


<h2 id="shift-jis-%E2%86%94-ms932%E3%81%AE%E3%83%96%E3%83%AC%E3%82%92%E7%B5%B1%E4%B8%80">
<a class="header-anchor-link" href="#shift-jis-%E2%86%94-ms932%E3%81%AE%E3%83%96%E3%83%AC%E3%82%92%E7%B5%B1%E4%B8%80" aria-hidden="true"></a> Shift JIS ↔ MS932のブレを統一</h2>
<p><span class="embed-block zenn-embedded zenn-embedded-card"><iframe id="zenn-embedded__7b6057b626ffd" src="https://embed.zenn.studio/card#zenn-embedded__7b6057b626ffd" data-content="https%3A%2F%2Fja.wikipedia.org%2Fwiki%2FUnicode%23%25E6%25B3%25A2%25E3%2583%2580%25E3%2583%2583%25E3%2582%25B7%25E3%2583%25A5%25E3%2583%25BB%25E5%2585%25A8%25E8%25A7%2592%25E3%2583%2581%25E3%2583%25AB%25E3%2583%2580%25E5%2595%258F%25E9%25A1%258C" frameborder="0" scrolling="no" loading="lazy"></iframe></span><a href="https://ja.wikipedia.org/wiki/Unicode#%E6%B3%A2%E3%83%80%E3%83%83%E3%82%B7%E3%83%A5%E3%83%BB%E5%85%A8%E8%A7%92%E3%83%81%E3%83%AB%E3%83%80%E5%95%8F%E9%A1%8C" style="display:none" target="_blank" rel="nofollow noopener noreferrer">https://ja.wikipedia.org/wiki/Unicode#波ダッシュ・全角チルダ問題</a></p>


<h2 id="%E8%A8%98%E5%8F%B7%E7%AD%89%E3%81%AE%E7%B5%90%E5%90%88">
<a class="header-anchor-link" href="#%E8%A8%98%E5%8F%B7%E7%AD%89%E3%81%AE%E7%B5%90%E5%90%88" aria-hidden="true"></a> 記号等の結合</h2>
<table>
<thead>
<tr>
<th></th>
<th></th>
</tr>
</thead>
<tbody>
<tr>
<td><code>...</code></td>
<td><code>…</code></td>
</tr>
<tr>
<td><code>!?</code></td>
<td><code>⁉</code></td>
</tr>
<tr>
<td><code>!!</code></td>
<td><code>‼</code></td>
</tr>
</tbody>
</table>



`...`	`…`
`!?`	`⁉`
`!!`	`‼`