You would do this in the admin and edit the page urls and remove the file extension or if making pages do not add it. I do not know how Muse works in that regard though, not sure if you can or not with how Muse works.
You can have a whole site through BC with no file extensions so you know its possible.