Old Dell won't turn on

I have a really old Dell (a dimension 2400). I want to throw it away but I want to make sure I didn't leave any files on it. The problem is that it doesn't turn on anymore. I was told I needed memory. Should I buy an external hard drive or just memory?