Is there a way to change the order in which symbols are alphabetically?

I have a spreadsheet that has cells that consist of words both from English and Latvian. The Latvian alphabet is the same as English, but there are different letters, that are usually just versions of other letters (so for example Ā, Ē, Ģ, Ķ ect.). Whenever i try sorting the cells alphabetically excel just ignores the symbols and treats them as if they're a different letter (so for example it treats Ļ as if it was just L). Is there any way to solve this?