No, Steam did not always offer a permanent removal feature for games in your library.
Just came in last week.
Removing unwanted games I never wanted to use
Alright, thanks everyone. It's good to hear that. Nice addition!