It won’t come off.

The little black thumb thing is pointed towards lock, turn it to open it still will not come off. I have pushed down on the cap trying so but it is on there.

How do I get this thing off? I am guessing it is broken and needs to be replaced?