Is Phi Beta Kappa really that big of a deal?

No. My brother was PhiBK, could not get into a Ph.D. program and had great difficulty in getting into law school. He became an outstanding lawyer.