He got a used computer from my brother.
The tiny sound isn't coming from the PSU, it's from the BIOS speaker. A single small beep indicates everything is functioning properly.
Can you upload a computer photo? I will look to it
I can focus solely on PSU.
It's probably the PSU, maybe the fan is the issue.