Swap history

When you get offered a swap and agree to it and get no reply, what can you do? We all have the right to change our mind but it's only polite you let the other party know about it.