ReadabilityLib 0.5.0-beta

Readability

A C# port of standalone version of the readability library used for Firefox Reader View.

Installation

Readability is available on Nuget:

dotnet add package Readability

You can then using Readability; it.

Basic usage

To parse a document, you must create a new DocumentReader object from a Brackets document object, and then call the Parse() method. Here's an example:

var article = new DocumentReader(document).Parse();

API Reference

new DocumentReader(document, options)

The options object accepts a number of properties, all optional:

• maxElemsToParse (number, default 0 i.e. no limit): the maximum number of elements to parse.
• nbTopCandidates (number, default 5): the number of top candidates to consider when analysing how tight the competition is among candidates.
• charThreshold (number, default 500): the number of characters an article must have in order to return a result.
• classesToPreserve (array): a set of classes to preserve on HTML elements when the keepClasses options is set to false.
• keepClasses (boolean, default false): whether to preserve all classes on HTML elements. When set to false only classes specified in the classesToPreserve array are kept.
• disableJSONLD (boolean, default false): when extracting page metadata, Readability gives precedence to Schema.org fields specified in the JSON-LD format. Set this option to true to skip JSON-LD parsing.
• serializer (function, default el => el.innerHTML) controls how the content property returned by the parse() method is produced from the root DOM element. It may be useful to specify the serializer as the identity function (el => el) to obtain a DOM element instead of a string for content if you plan to process it further.
• allowedVideoRegex (RegExp, default undefined ): a regular expression that matches video URLs that should be allowed to be included in the article content. If undefined, the default regex is applied.

Parse()

Returns an object containing the following properties:

• title: article title;
• content: HTML string of processed article content;
• textContent: text content of the article, with all the HTML tags removed;
• length: length of an article, in characters;
• excerpt: article description, or short excerpt from the content;
• byline: author metadata;
• dir: content direction;
• siteName: name of the site;
• lang: content language;
• publishedTime: published time;

The parse() method works by modifying the DOM. This removes some elements in the web page, which may be undesirable. You can avoid this by passing the clone of the document object to the Readability constructor:

var documentClone = document.Clone();
var article = new DocumentReader(documentClone).Parse();

IsProbablyReaderable(document, options)

A quick-and-dirty way of figuring out if it's plausible that the contents of a given document are suitable for processing with Readability. It is likely to produce both false positives and false negatives. The reason it exists is to avoid bogging down a time-sensitive process (like loading and showing the user a webpage) with the complex logic in the core of Readability. Improvements to its logic (while not deteriorating its performance) are very welcome.

The options object accepts a number of properties, all optional:

• minContentLength (number, default 140): the minimum node content length used to decide if the document is readerable;
• minScore (number, default 20): the minimum cumulated 'score' used to determine if the document is readerable;
• visibilityChecker (function, default isNodeVisible): the function used to determine if a node is visible;

The function returns a boolean corresponding to whether or not we suspect Readability.parse() will succeed at returning an article object. Here's an example:

/*
    Only instantiate Readability  if we suspect
    the `parse()` method will produce a meaningful result.
*/
if (isProbablyReaderable(document)) {
    let article = new Readability(document).parse();
}

License

Copyright (c) 2010 Arc90 Inc

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

   http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.