Yes, you can pair an RX580 with 8GB RAM on a GA H61M DS2 motherboard.
Yes, it should work.
The rx580 supports connection via the PCIe 3 x16 port.