Simply deleting the default StorageClass may not work, as it may be re-created automatically by the addon manager running in your cluster. 
you might need to consult the docs for your installation for details about addon manager and how to disable individual addons.
Changing the default StorageClass :
- 
List the StorageClasses in your cluster: kubectl get storageclass
 The output is similar to this: NAME                 PROVISIONER               AGE
standard (default)   kubernetes.io/gce-pd      1d
gold                 kubernetes.io/gce-pd      1d The default StorageClass is marked by (default). 
- 
Mark the default StorageClass as non-default: The default StorageClass has an annotation storageclass.kubernetes.io/is-default-class set to true. Any other value or absence of the annotation is interpreted as false. To mark a StorageClass as non-default, you need to change its value to false:   kubectl patch storageclass <your-class-name> -p '{"metadata": {"annotations":{"storageclass.kubernetes.io/is-default-class":"false"}}}'where <your-class-name> is the name of your chosen StorageClass. 
- 
Mark a StorageClass as default: Similarly to the previous step, you need to add/set the annotation storageclass.kubernetes.io/is-default-class=true.   kubectl patch storageclass <your-class-name> -p '{"metadata": {"annotations":{"storageclass.kubernetes.io/is-default-class":"true"}}}'Please note that at most one StorageClass can be marked as default. If two or more of them are marked as default, a PersistentVolumeClaim without storageClassName explicitly specified cannot be created. 
- 
Verify that your chosen StorageClass is default: kubectl get storageclass The output is similar to this:   NAME             PROVISIONER               AGE
  standard         kubernetes.io/gce-pd      1d
  gold (default)   kubernetes.io/gce-pd      1d