Don't rush with furnishing your home. Just start with the basics and needs.
Always make sure you can afford the house expenses like rent.
Make sure that you move into a place where you can easily get food and supplies. The travel expenses and terrible traffic would really be costly, so the nearer your supply source is, the more you can save.
Try to decorate with double duty items. Like those couches that can be folded to a sofa or those chairs that can be used as storage. Works really well, especially in smaller homes.
Try buying items at the dollar stores (88 if it is in the local scene), they offer a variety of items to choose from, like kitchen products to bathroom products. And all for a dollar or less