Labor reallocation occurs even during periods of full employment. Companies lose market share to rivals, businesses decide to spend money on capital expenditures that automate away existing roles, etc. If your goal is to stop immigration until layoffs cease to exist, you’re essentially calling for a permanent moratorium.