after thinking about it
Perhaps at the beginning of season 2 we see the aftermath of franks brutal attack on Billy and he uses his money from ANVIL to get facial surgery (cause no way he did not sustain extensive damage from that) to fix his face but alas they cant fully repair his face, which is why he still has visible scarring but looks normal.
Despite all his money, power and vanity, frank took his face from him
"It's gonna be the same for you. When you look at your ugly, mangled face, you're gonna remember what you did. You'll remember, Bill. You're gonna remember me!"
It might not seem that bad in the photos released but to someone that narcissistic who prides themselves on their appearance and being perfect
it is a fate worse than death and that would eat him alive and that would further drive him to get revenge on castle.
or perhaps it gets worse throughout the season, similar to classic doctor doom where it started off as a noticeable cut but to victor it was an imperfection and it drove him to further damage it himself or frank causes more damage
just a thought anyway