Que tal:
select datepart(yyyy, [date]) as [year]
from shoptransfer
group by datepart(yyyy, [date])
Ou:
select count(*) as qty, datepart(yyyy, [date]) as [year]
from shoptransfer
group by datepart(yyyy, [date])
order by [year]
Isso é baseado no comando do OP:"Quero agrupar por ano parte da coluna de data (varchar)"
