What do I get from fishing perfectly?

I've gone fishing a few times now and have gotten a "Perfect!" a few times. Does this affect the quality of the fish I get? I'm not sure because each time I've gotten the "Perfect!", I only get a regular quality fish (not silver or gold starred).