As far as I know, it's a particular term. They're not going to hunt down say...street magicians that pull rabbits out of hats.

( that was all smoke and mirrors anyway. flash and falsehoods. not what he did at all. )

So yes, it's witches and warlocks, mostly. People like me who are born with the ability, I suppose.