According to the Washington Post and Times Herald, when Castro arrived at the Embassy of Cuba (now the Cuban Interests Section), 2630 16th Street, NW, an attache suggested that he go to the balcony and wave to the friendly crowd gathered outside. From the article:
“I’m no man on a balcony,” Castro snorted, and took off, dodging nimbly through the traffic, to meet the people.
Returning to the Embassy, where a crowd of about 200, all cleared by security guards, awaited him, he went to his third-floor room. flopped on a bed fully clothed, and announced, “I’m tired. Tired.”
From Ghosts of DC.
Thanks to Rev. John D. De Taeye of Councilmember Graham's office.