Thermoplastic pultrusion reinforcement insert in a hollow plastic frame of a window or door unit