What are my rights if I simply change my mind about an item I've purchased in a shop and I decide that I don't want it?

You do not have an automatic right to a refund in these circumstances. However, many retailers will allow you to change your mind within a certain period, provided the goods are re-saleable. They will normally require proof of purchase e.g. the receipt.