Yeah, seriously, I think it was just Uriel trying to intimidate Cas into coming onto his side. "ME AND MY FOLLOWERS ARE THE ONLY ONES WHO CAN KILL YOU, SO YOU BEST BE DOING WHAT WE SAY" kinda thing.

It's the knives. They're just like Ruby's knife, but for angels instead of demons.