I think VI/VIM is your answer.
You looks you know some Linux - so you're very close.
Source(s):
http://vimdoc.sourceforge.net/htmldoc/usr_toc.html

Permalink | Report

It sounds like you are going to do what Proustr is doing: twittering Proust. He basically outlines how he processes the text here:

http://www.omgtldr.com/proustr/

A simpler way might be to do one sentence at a time, but the problem is that some sentences are more than 140 characters. If you are interested in the sentence idea I think it would work kind of like this: In MS Word you can do the replace function and replace "period space" with "period space tab" and then export the file into Excel using a tab delimited setting. Then just save it as a CSV for import into MySQL. This would almost give you what you want, but not quite. I know it's an ugly solution, so I'm sure you will find a better one.
Source(s):
http://twitter.com/proustr
http://www.omgtldr.com/proustr/

Permalink | Report