Embrace that moment. You won't be let in the EU in the nearest future, so cherish your memories. As far as Vienna is considered - I loved the cathedral (and the old town), the park, and of course the Prater. When you ask me - Vienna is in the list of the just few cities I could live in - I really liked it (although I spent just a week there).