"There's a difference between freedom of speech, and freedom to violate privacy of others."
I think that is a very dangerous way to look at thing. The right to privacy is a limitation to freedom of speech. You might think that it's a reasonable limitation in this case, but it's still a limitation and not something different.
Sure, it is a limitation on freedom of speech. Copyright is also a limitation to freedom of speech, as are libel and slander laws. In a society where free speech is absolute, if I have more money than you, I can destroy your reputation, and possibly your entire life, by spreading false information about you, and you would have no recourse. Is that a good thing?
I think that is a very dangerous way to look at thing. The right to privacy is a limitation to freedom of speech. You might think that it's a reasonable limitation in this case, but it's still a limitation and not something different.