Is it safe to leave a rented bike outside the temples in Anuradhapura?

It is generally very safe. Most guesthouses provide a simple chain lock with the bike. Just park it in the designated areas near the shoe counters. There are usually many people and vendors around, and bike theft is very rare in the sacred city area. Just dont leave any valuables in the front basket.