Bird Nest Fiasco

I was cleaning up the foundation plantings, which includes cutting the clematis vines. I checked first to see if any house finches had moved in. I found an unused nest and figured that if finches had planned on using it, they would harass me to let me know as I worked in the area. Two hours and not a peep. I removed the nest to an entryway table and cut the base of the vines...and then the birds showed up and started yelling at me.

They had obviously worked hard on this nest. It was sturdier than the finch nests I've found in previous years. I felt bad. So I decided to put it back in the same area and wire it to the trellis. Do you think they'll notice?

They haven't said anything yet....