If he isn't in pain and just isn't eating, I would wait for the vet.
Rescues are challenging and this one sounds pretty bad. It is always hard to say but find comfort in two things. He can either get better or worse. Either way, he has known what it is like to be cared for -and- if it gets worse, you can give him the final gift of kindness and mercy.