While pressing and holding the two blue squares at the top of the battery, pull up on the battery to remove.  

Remember to always store your battery and PowerShell separately when not in use to prevent the battery from depleting.

When reinserting the battery you will hear a click when it is locked in.