PragmaticSegmenterNet 1.0.2
There is a newer version of this package available.
See the version list below for details.
See the version list below for details.
dotnet add package PragmaticSegmenterNet --version 1.0.2
NuGet\Install-Package PragmaticSegmenterNet -Version 1.0.2
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="PragmaticSegmenterNet" Version="1.0.2" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add PragmaticSegmenterNet --version 1.0.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: PragmaticSegmenterNet, 1.0.2"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install PragmaticSegmenterNet as a Cake Addin #addin nuget:?package=PragmaticSegmenterNet&version=1.0.2 // Install PragmaticSegmenterNet as a Cake Tool #tool nuget:?package=PragmaticSegmenterNet&version=1.0.2
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
PragmaticSegmenterNet
This project is a direct port of Pragmatic Segmenter which provides rule-based sentence boundary detection.
Usage
The Segmenter class provides the Segment method which in the simplest usage takes a string:
using PragmaticSegmenterNet;
IReadOnlyList<string> result = Segmenter.Segment("One Sentence. And another sentence.");
// ["One Sentence.", "And another sentence."]
IReadOnlyList<string> result2 = Segmenter.Segment("Anything.", Language.Italian);
// ["Anything"]
The Segment method has a number of optional parameters:
IReadOnlyList<string> Segment(string text, Language language = Language.English, bool cleanText = true, DocumentType documentType = DocumentType.Any)
- Language - An enum representing the supported languages, the default is English, see the supported languages list below for the list of currently supported languages.
- CleanText - A boolean indicating whether the input text should be cleaned prior to segmentation. Cleaning removes extra newlines and whitespace. Defaults to
true. - DocumentType - Used by the text cleaning process to determine which reformatting to apply. For PDFs this handles newlines in the middle of a sentence whereas for HTML documents this will handle HMTL tags. Defaults to any which does not apply any special formatting.
Languages
- English = 0 (default)
- Amharic = 1
- Arabic = 2
- Armenian = 3
- Bulgarian = 4
- Burmese = 5
- Chinese = 6
- Danish = 7
- Dutch = 8
- French = 9
- German = 10
- Greek = 11
- Hindi = 12
- Italian = 13
- Japanese = 14
- Kazakh = 15 (partial support, potentially only for the Cyrillic form of the alphabet)
- Persian = 16
- Polish = 17
- Russian = 18
- Spanish = 19
- Urdu = 20
Releases
1.0.2
- Fixes an issue with periods following abbreviations.
1.0.1
- Fixes an issue with single character inputs.
Credit
This project wouldn't be possible without the work done by Pragmatic Segmenter team. Any bugs in the code are entirely my fault.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. |
| .NET Core | netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed. |
| .NET Standard | netstandard2.0 is compatible. netstandard2.1 was computed. |
| .NET Framework | net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed. |
| MonoAndroid | monoandroid was computed. |
| MonoMac | monomac was computed. |
| MonoTouch | monotouch was computed. |
| Tizen | tizen40 was computed. tizen60 was computed. |
| Xamarin.iOS | xamarinios was computed. |
| Xamarin.Mac | xamarinmac was computed. |
| Xamarin.TVOS | xamarintvos was computed. |
| Xamarin.WatchOS | xamarinwatchos was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
.NETStandard 2.0
- No dependencies.
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.