Talk:Gems/@comment-16225100-20140122142218/@comment-3991817-20140122144855

Yes, if you remove a gem from a building it will go back into your inventory.