Ahhhh yes that scan was selected, however this one was not....
Scan theme files against repository versions for changes
I think that was my problem. I will have to go through all my sites and make sure that option is ticked.
Not sure why it is off by default...