That's right. If I just need to type a letter, I use the Atari, I prefer the keyboard and the software is simpler to use. Also, using the Atari, I know my documents are secure, away from potential hackers (yes, I know I'm paranoid). If I need to do layout, or add pictures to my docs, then I use Pages on the Mac.
I also keep a diary, using Cut & Paste, again so that it is secure.
I also have this theory, that if a computer was good enough for certain tasks 20 years ago, then it is still good enough for those tasks now.
There are somethings it is not suitable for (photo editing, 3D rendering, commercial software development, etc), but for basic word processing, spreadsheets, etc, it was capable then, and still is.
Hell, most people still read books made from paper, and yet we have PDA's now capable of holding a massive number of ebooks.
Besides, sometimes it's nice to get away from the clutter of modern applications.