Here I discuss the "mathematician's misconception" from a number of angles: the confusion between mathematical reality - and our knowledge of that mathematical reality. We also discuss why it is mathematics is effective in the natural sciences, like physics and whether and to what extent physics must reduce to mathematics in some ultimate sense. In the discussion between Sam Harris and Max Tegmark here, they are really probing the border between metaphysics and physics.