The 26-year-old Sharpsville woman received the calls regularly on Friday and Saturday between midnight and 3 a.m., police said.
The woman, whose identity was not released, had caller ID and asked the phone company to trace the number, police said.
The calls were traced to a phone booth in Hermitage, about two miles away, police said.
The phone company, at her request, forwarded calls on Friday to her cell phone.
The woman and three of her cousins staked out the phone booth and around 1:30 a.m., a former neighbor arrived and made a call, police said. The woman's cell phone rang, police said.
Family members prevented the man from leaving until police arrived.
Fred Marini, 43, of Hermitage, was charged Wednesday with harassment and stalking.
Marini has an unlisted phone number and could not be reached for comment Thursday.