Power supply is stuck.?

I just bought a new power supply for my computer. It fit in my computer well, I plugged everything in and screwed it in, but wanted to take it out to look at something. But it won't come out. I unplugged everything, unscrewed the screws. It wiggles like it's loose, but it will not come out.