On Windows 10 to change your SSH key you first need to delete the currently stored identity in the Windows Credential Manager (just start typing that into the Windows search bar).
Your Github ID is stored under Windows Credentials -> Generic Credentials