An Overview of Public Domain Language Engineering Generic Tools

This page is an accompaniment to the talk given at the TELRI "Language Resources for Language Technology" Seminar. You can also get the slides to the talk in PostScript format.

A draft version of the paper with the same title, but somewhat different content from the talk is now also available:

Comments welcome!

Follow links to tools, tool repositories and information pages mentioned in the talk:

Corpus annotation standards
SGML tools
Corpus annotation tools
Computational linguistic tools

Corpus annotation standards

SGML is an ISO standard, which codifies (descriptions of) document structure;
HyTime is an ISO standard for hypermedia, utilising SGML;
TEI is a set of proposals for encoding textual data;
HTML is the of the World Wide Web.

SGML tools

Extensive SGML archives are in ftp.ifi.uio.no/pub/SGML and ftp.gmd.de/gmd/sgml

A good guide to SGML tools is "The Whirlwind Guide to SGML Tools and Vendors", from where most the following taxonomy has been shamelessly plundered:

Core tool - SGML validating parser: sgmls, sp, YASP, etc.
Capturing the Data - conversion tools:
- up-translation: Perl
- conversion: Copenhagen SGML tool CoST, MID's MetaMorphosis, etc.
Managing the Information - editors:
- (x)emacs & its psgml-mode (see a picture);
- Some MS Windows SGML editors (you have to pay to get these!):
  - Microsoft Word/SGML,
  - WordPerfect (SGML edition),
  - SoftQuad Inc.,
  - ArborText Adept Editor for PC,
  - Frame FrameMaker + SGML.
Managing the Information - databases and document managers.

Corpus annotation tools

Segmenter: one is to be available from the MULTEXT(-EAST) project;
Taggers (Part-of-Speech disambiguation):
- Xerox tagger;
- Brill's rule-based tagger.
Church & Gale aligner (to be available from the MULTEXT(-EAST) project);

Computational linguistic tools

Tools and information on them are available from:

And here are some more interesting CL tools:

Morphology: PC-KIMMO;
Lexical structure / morphology: DATR;
Formalisms (syntax / semantics / MT): PC-PATR, ALE, CUF, TFS, ALEP, etc.

And some more Computational Linguistics on the Internet.

To TELRI WG5 page

Tomaz Erjavec, IJS
Last updated 14. Jan. 1996