as a core service no - you would be able to sign on to google drive (and any other service for that matter) that isnt linked to your SSO infrastructure as any normal user does (manually)
google drive is integrateable with active directory though so if thats your SSO infra then you could link it up