When the drivers stop to give a pedestrian in a crosswalk the right of way, unless there is a compelling reason not to, the pedestrian should take it and proceed. Yesterday I stopped along with the driver to my left to enable a man standing in the middle of 4 lanes of traffic to cross.
He didn't. Instead he stood his ground and motioned for us both to carry on. We hesitated, but when he continued to motion us on, we continued on our way, as did the stream of traffic behind us.
Why would he choose to take the risk of remaining in the middle of the road when everyone was providing a safe path to proceed? In this case, misguided politeness created confusion and this was not a good thing from everyone's perspective.