Personally, I think Link must talk a lot more than we think he does. For example, there are moments when we know he must have spoken, such as when he goes up to a villager and they say something like “What? You’re looking for the [item]? You should go and see [person] about it, he probably knows where it is.”
Not to mention, it doesn’t make sense for all these people to randomly share information with silent strangers who walk up to you, so I always think of those as snippets of a conversation we didn’t hear. Nintendo’s aim in not showing Link talking is probably to leave his voice to your imagination so that you can better imagine yourself as him while you are playing.