What happens if the filesystem fails to delete the actual file from backend storage?

Virtual filesystems created by CBFS Connect are no different than other filesystems in how such situations are handled: information about existence of the file would be removed from Windows' cache, but the next time the directory's contents are enumerated the "deleted" file or subdirectory would be found again.