Alumis.Text.Tokenization

Text tokenization based on Unicode grapheme clustering, and the XID_Start and XID_Continue binary properties.

Version:	1.0.9
Author(s):	Emil Müller
Last Update:	Wednesday, April 24, 2019
.NET Fiddle:	Create the first Fiddle
NuGet Url:	https://www.nuget.org/packages/Alumis.Text.Tokenization

NuGet .NET CLI Paket CLIR Direct Download

Install-Package Alumis.Text.Tokenization

dotnet add package Alumis.Text.Tokenization

paket add Alumis.Text.Tokenization


                                Alumis.Text.Tokenization Download (Unzip the "nupkg" after downloading)

Alumis.Text.Tokenization NuGet Package