You could just anonymously call the Humane Society or your local Animal Care&Control and report that there is an abandoned cat at that house, and let them take it from there if you are apprehensive about getting your name involved. Or maybe you can find someone who will take the cat and give him a good home. The neighbor most likely will think the cat just ran away to find food. She doesn't take care of him anyways.