Is COUNT(*) slow in MySQL?

Contrary to popular belief, using an asterisk in your database queries isn't always a performance killer, especially when it comes to counting rows.