Muwatta Malik 1606

وَحَدَّثَنِي مَالِكٌ، أَنَّهُ بَلَغَهُ أَنَّ عُمَرَ بْنَ عَبْدِ الْعَزِيزِ، حِينَ خَرَجَ مِنَ الْمَدِينَةِ الْتَفَتَ إِلَيْهَا فَبَكَى ثُمَّ قَالَ يَا مُزَاحِمُ أَتَخْشَى أَنْ نَكُونَ مِمَّنْ نَفَتِ الْمَدِينَةُ

Malik related to me that he had heard that when Umar ibn Abd al- Aziz left Madina, he turned towards it and wept. Then he said, "O Muzahim! Do you fear that we might be among those that Madina casts off?

Reference

Muwatta Malik 1606

In-book

Book 45, Hadith 9