Forget buying a car for fun. Cars are boring.
Buy a cheap boring car that gets good gas mileage and can get you from A-B in relative comfort. You can find those cheap. Ford Focus, Honda Civic, etc.
Then buy a motorcycle for fun. You can find those cheap as well. For under $5k you can find a used low mileage bike in great condition that will absolutely destroy 99.99% of the cars on the road. Plus, they are just more fun than a car.