Millions of workers left the labor force during the pandemic. Older workers have been slow to return, in part because many found themselves financially secure enough to retire.