French PM’s proposal to scrap public holidays ‘psychologically not a good idea’, expert says