Computing and Information Services CIS Home Page Brown Home Page STG Projects section
<faculty grants>     <projects>     <about>     <staff>     <publications>    <search>

Typographic Regularization in the WWP Textbase 


STG lead(s): Jacque Russom

In materials printed before 1630, the letters v, u, j, and i did not have the values that they have today. The word that we spell ivory was written iuory, the word that we spell jury was written iury, etc. This difference in typographical conventions makes early texts more difficult to read and compromises the matching of forms in information retrieval tasks.

The Women Writers Project uses SGML tagging to encode a regularized spelling for such typographical variants, thereby allowing the option to display and search on either the original form or the regularized form. Encoding this information by hand was time-consuming and inefficient, since a great many high-frequency words require such tagging (e.g, haue, loue, iudge).

STG undertook to develop a system to automatically tag words subject to this typographic convention with the regularized form. To a great extent, pattern matching rules based on the linguistic principles for English consonants and vowels can be invoked to identify and tag words appropriately. These rules are supplemented by programs that recognize SGML markup indicating such things as word division across a line break, errors or abbreviations within a word, or structural elements to be excluded from regularization.  

The Brown University Women Writers Project's main undertaking is an SGML-encoded full-text database of pre-Victorian women's writing in English. This collection currently includes nearly 200 texts representing a broad cross-section of the literate culture of pre-Victorian Britain. The WWP supports teaching and research in a wide variety of disciplines such as English, history, women's studies, comparative literature, and religious studies. 

Principal Investigator(s) or Parent Project Lead(s):
Allen Renear
Scholarly Technology Group, Brown University 

Research domains: humanities computing 
Type: report 
Components and related resources:
Brown University Women Writers Project Home Page  http://www.wwp.brown.edu 
Links:
Typographic Regularization in the WWP Textbase  http://www.nyu.edu/its/humanities/ach_allc2001/papers/russom/index.html 

STG involvement initiated: September 1998   Status:maintenance 
  Funding support: Computing and Information Services
Contact:STG_info@brown.edu 

  Record last modified: 13-Sep-2005 


Home | Information Technology

Home

Quick Links

Announcements

Apr. 14 - 12:57 pm

Background on OpenSSL and Heartbleed

Late on Monday, April 7, researchers discovered a flaw in the security tool, OpenSSL, which provides the encryption that protects Internet traffic and communications between...

Apr. 14 - 11:18 am

CIS is excited to announce an important addition to our software portfolio, LabVIEW! LabVIEW is a development environment for problem solving and measurement or control systems. The software is supported by...

Apr. 11 - 10:33 am

Brown instructors, have a project in mind to make your class more engaging involving technology? Want to spend a few days this summer learning what technology support Brown has to offer and getting hands-on help...

Apr. 9 - 9:14 am

Yesterday, Microsoft issued the last update for Windows XP. As a result, Computing and Information Services will not be able continue supporting XP. For security reasons, CIS recommends upgrade or replacement of your...

Feb. 26 - 4:20 pm

We've heard from a lot of students who don't realize it's possible to print to PAWPrints from their own computers. We've recorded Mac and PC videos of the setup. Remember that you need to be connected to Brown-...