It is true that the poet does not directly address his neighbors; but he does address a great congress of persons who dwell at the back of his mind, a congress of all those who have taught him and whom he has admired; they constitute his ideal audience and his better self.
What is the opposite of two? A lonely me, a lonely you.
To this congress the poet speaks not of peculiar and personal things, but of what in himself is most common, most anonymous, most fundamental, most true of all men.