We use the texture map to actually move the surface point. This is called displacement mapping. How is this fundamentally different than bump mapping?

The geometry must be displaced before visibility is determined. Is this easily done in the graphics pipeline? In a ray-tracer?