Fujikawaguchiko is just the official name, most refer to it as Kawaguchiko (this is the main train station there).
Not that unusual in English either, e.g. Commonwealth of Massachusetts, State of Rhode Island and Providence Plantations, Newcastle-upon-Tyne, Stratford-upon-Avon.