Attribute Modifiers Bug!

So we have a plugin that creates a virtual storage for my server; and I made a "Frozen Bow" that gave the holder speed. Without logging out of the virtual storage system it kept the frozen bow in hand (which then got deleted) but kept the attribute modifier on the player. Any idea on how to fix? (Spigot 1.8.3)
Code:
/give {player} minecraft:bow 1 0 {AttributeModifiers:[{AttributeName:"generic.movementSpeed",Name:"generic.movementSpeed",Amount:1,Operation:0,UUIDMost:86027,UUIDLeast:173195}],display:{Name:"Frozen Bow"},ench:[{id:48,lvl:4},{id:49,lvl:4}]}