More than $3.5 million in improvements will include a glassy new exterior, technology upgrades, a reading garden, classrooms and meeting spaces.