I just find out such thing exists and it is now added to the list of things I wanted to by this year. Usually installing a graphics card requires the services of a repairman. External graphics card can make things much more easier. Look at the improvement of performance of this old computer after an external graphics card is attached:
The fact that it is outside means that this graphics card will have better ventilation. The biggest negative is the fact it may have more exposure to dust.