WordPress Upgrade stop at downloading process

One of my old blog is upgrading to wordpress 3.0 and I was facing an issue of halt at the “”Downloading update from http://wordpress.org/wordpress-3.2.1.zip.”

At first I thought it was some permission issue causing it. Then later found that it was caused by some memory issue when I move to the new web hosting. To resolve it, luckily there is an useful WordPress plug in out there called Memory Bump. http://wordpress.org/extend/plugins/memory-bump/

Just install it and immediately I have no issue with the upgrade