I believe that you get one mason bee per hole, busy laying eggs (ie. if you are seeing lots of visits to a particular hole, it should be the same bee making lots of visits).
I suggest blocking the holes ASAP and making the bees homeless. The eggs already laid will be lost, but hopefully they...