Luddites are generally made fun of because they somehow believed that destroying property was an effective way of protest, instead of providing others with an excuse to arrest them.
Labor rights did not exist at the time (1768-1817), so nobody would need to circumvent them, either. This was when efforts were made to create them. And the Luddites made a negative contribution.