Same for me, I used to travel for work earlier (2002-2006) and I loved it. The only problem at that time was the language barrier, almost nobody was speaking English in the eastern part and just a few people in Tirana or Dures.
In 2009 I tried to go there with a friend on a motorcycle trip, but we were unable to get in the country due to language barrier, I don't know what was wrong. So we went to Ohrid instead.
I'm Italian so I had an advantage in terms of language, since it seems almost everyone understands it. I've been told it's because people used to illegally watch Italian TV under the communist regime. I guess it might be also related to past colonialism.
In 2009 I tried to go there with a friend on a motorcycle trip, but we were unable to get in the country due to language barrier, I don't know what was wrong. So we went to Ohrid instead.