Public vs private
All new files are created private.
When you create a public link for a file, it becomes public. Other people have to be able to read it. This is what it means to be public.
Once a file is public it stays public forever. You can however delete the contents of the file. So you have a public file that's empty.